2023-11-04T01:10:12.163 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:10:12.164 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919 -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/orig.config.yaml 2023-11-04T01:10:12.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:10:12.280 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445919' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd1V3htK5J+6UMoV/b32NQraS+rYC07ZBofi4cORbpKRsmgg2F4pQDqNWN/GHmDCBqncrv/iSWN5TaGBSCJYhs= smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIB3bMpXE6SKK2rBX2MEDzeur8W0Ch7DQRTXqZD+YZxuC+dXPogiTOM2LUfNSZgNxOJRWi6w+K9ZeJA+6YmNdyw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:10:12.281 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:10:12.282 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:10:12.282 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:10:12.283 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:10:12.305 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:10:12.305 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:10:12.305 INFO:teuthology.packaging:ref: None 2023-11-04T01:10:12.305 INFO:teuthology.packaging:tag: None 2023-11-04T01:10:12.306 INFO:teuthology.packaging:branch: main 2023-11-04T01:10:12.306 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:10:12.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-04T01:10:12.523 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052.g7188d8cd 2023-11-04T01:10:12.523 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:10:12.530 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:10:12.530 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:10:12.568 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:10:12.583 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:10:12.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:10:12.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.709431', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd1V3htK5J+6UMoV/b32NQraS+rYC07ZBofi4cORbpKRsmgg2F4pQDqNWN/GHmDCBqncrv/iSWN5TaGBSCJYhs='} 2023-11-04T01:10:12.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.705980', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIB3bMpXE6SKK2rBX2MEDzeur8W0Ch7DQRTXqZD+YZxuC+dXPogiTOM2LUfNSZgNxOJRWi6w+K9ZeJA+6YmNdyw='} 2023-11-04T01:10:12.640 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:10:12.647 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:10:12.647 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:10:12.647 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:10:12.726 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a4f58bee0>, signals=[15]) 2023-11-04T01:10:12.726 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:10:12.733 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:10:12.733 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:10:12.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:12.820 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:10:12.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:12.904 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:10:12.911 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-11-04T01:10:12.927 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-11-04T01:10:12.927 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:12.983 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:12.984 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:12.984 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:12.984 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:12.984 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:12.984 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:12.984 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-11-04T01:10:13.006 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-11-04T01:10:13.023 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-11-04T01:10:13.023 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-04T01:10:13.078 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:13.079 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:13.080 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:13.080 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:13.080 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-04T01:10:13.106 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:10:13.115 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:10:13.120 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:10:13.120 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:13.123 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:13.137 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:10:13.143 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:10:13.143 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:13.180 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:13.278 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:10:13.332 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:10:13.352 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:10:13.352 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:10:13.353 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:13.353 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:13.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:13.369 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-11-04T01:10:13.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:13.370 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-11-04T01:10:13.426 INFO:teuthology.orchestra.run.smithi125.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:13.426 INFO:teuthology.task.kernel:Running kernel on smithi125: 5.14.0-361.el9.x86_64 2023-11-04T01:10:13.426 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum install -y kernel 2023-11-04T01:10:13.427 INFO:teuthology.orchestra.run.smithi093.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:13.427 INFO:teuthology.task.kernel:Running kernel on smithi093: 5.14.0-361.el9.x86_64 2023-11-04T01:10:13.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum install -y kernel 2023-11-04T01:10:15.414 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-11-04T01:10:15.490 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-11-04T01:10:16.739 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-11-04T01:10:16.790 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2023-11-04T01:10:17.831 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-11-04T01:10:18.005 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 7.9 MB 00:00 2023-11-04T01:10:22.800 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 18 MB 00:03 2023-11-04T01:10:23.499 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 18 MB 00:04 2023-11-04T01:10:26.806 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 5.8 MB 00:00 2023-11-04T01:10:28.198 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2023-11-04T01:10:30.883 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 19 MB 00:02 2023-11-04T01:10:34.706 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - CRB 753 kB/s | 5.8 MB 00:07 2023-11-04T01:10:35.391 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2023-11-04T01:10:36.282 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-11-04T01:10:37.440 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:37.440 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:37.537 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-11-04T01:10:37.549 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-11-04T01:10:37.549 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:37.550 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout:Install 4 Packages 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:10:37.551 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 95 M 2023-11-04T01:10:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 120 M 2023-11-04T01:10:37.552 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-11-04T01:10:37.885 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 13 MB/s | 19 MB 00:01 2023-11-04T01:10:38.876 INFO:teuthology.orchestra.run.smithi093.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 5.4 MB/s | 5.3 MB 00:00 2023-11-04T01:10:39.443 INFO:teuthology.orchestra.run.smithi093.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 13 MB/s | 20 MB 00:01 2023-11-04T01:10:41.018 INFO:teuthology.orchestra.run.smithi093.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 15 MB/s | 32 MB 00:02 2023-11-04T01:10:42.366 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-04T01:10:44.456 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:44.456 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:44.531 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-11-04T01:10:44.542 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:10:44.543 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-11-04T01:10:44.544 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-11-04T01:10:44.544 INFO:teuthology.orchestra.run.smithi125.stdout:Install 4 Packages 2023-11-04T01:10:44.544 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:10:44.544 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 95 M 2023-11-04T01:10:44.544 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 120 M 2023-11-04T01:10:44.545 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-11-04T01:10:44.884 INFO:teuthology.orchestra.run.smithi093.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 5.4 MB/s | 38 MB 00:07 2023-11-04T01:10:44.884 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:44.884 INFO:teuthology.orchestra.run.smithi093.stdout:Total 13 MB/s | 95 MB 00:07 2023-11-04T01:10:45.730 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-11-04T01:10:46.088 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-11-04T01:10:46.089 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-11-04T01:10:46.267 INFO:teuthology.orchestra.run.smithi125.stdout:(1/4): kernel-core-5.14.0-378.el9.x86_64.rpm 13 MB/s | 20 MB 00:01 2023-11-04T01:10:46.476 INFO:teuthology.orchestra.run.smithi125.stdout:(2/4): kernel-5.14.0-378.el9.x86_64.rpm 3.0 MB/s | 5.3 MB 00:01 2023-11-04T01:10:47.193 INFO:teuthology.orchestra.run.smithi125.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 35 MB/s | 32 MB 00:00 2023-11-04T01:10:47.404 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-11-04T01:10:47.404 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-11-04T01:10:49.986 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-11-04T01:10:50.623 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:10:50.742 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:52.968 INFO:teuthology.orchestra.run.smithi125.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 4.5 MB/s | 38 MB 00:08 2023-11-04T01:10:52.968 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:52.968 INFO:teuthology.orchestra.run.smithi125.stdout:Total 11 MB/s | 95 MB 00:08 2023-11-04T01:10:53.507 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:53.684 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:53.816 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-11-04T01:10:54.178 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-11-04T01:10:54.178 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-11-04T01:10:55.466 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-11-04T01:10:55.466 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-11-04T01:10:58.080 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-11-04T01:10:58.294 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:58.398 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:10:58.700 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:10:58.817 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:01.602 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:01.802 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:03.033 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:06.411 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:06.616 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:11.248 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:31.707 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:31.749 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:32.176 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:32.177 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:32.177 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:32.177 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:32.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:11:32.552 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-11-04T01:11:33.051 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:33.193 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:33.194 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:33.194 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:11:33.195 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:11:33.195 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:11:33.195 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:11:33.195 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi093.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:11:33.195 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:33.311 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:33.311 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:33.311 DEBUG:teuthology.orchestra.run.smithi093:> sudo rpm -qi grub2-tools 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Name : grub2-tools 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Epoch : 1 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Version : 2.06 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Release : 68.el9 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Architecture: x86_64 2023-11-04T01:11:33.345 INFO:teuthology.orchestra.run.smithi093.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Group : Unspecified 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Size : 8264254 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:License : GPLv3+ 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Packager : builder@centos.org 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Vendor : CentOS 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:11:33.346 INFO:teuthology.orchestra.run.smithi093.stdout:Summary : Support tools for GRUB. 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:Description : 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:hardware devices. 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:11:33.347 INFO:teuthology.orchestra.run.smithi093.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:11:33.348 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:11:33.348 INFO:teuthology.task.kernel:Updating grub on smithi093 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:11:33.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:11:33.963 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-11-04T01:11:35.452 INFO:teuthology.orchestra.run.smithi093.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:11:35.485 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-11-04T01:11:35.488 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-11-04T01:11:35.503 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.xGfrodhxq9 2023-11-04T01:11:35.503 DEBUG:teuthology.orchestra.run.smithi093:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xGfrodhxq9 2023-11-04T01:11:35.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.xGfrodhxq9 2023-11-04T01:11:35.711 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.xGfrodhxq9 is 6KB 2023-11-04T01:11:35.759 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.xGfrodhxq9 2023-11-04T01:11:35.773 DEBUG:teuthology.orchestra.run.smithi093:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:11:35.838 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:11:35.838 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:11:35.838 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:11:35.838 INFO:teuthology.orchestra.run.smithi093.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:11:35.839 DEBUG:teuthology.orchestra.run.smithi093:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:11:35.982 DEBUG:teuthology.orchestra.run.smithi093:> sudo shutdown -r now 2023-11-04T01:11:39.852 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:39.894 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:40.317 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:40.317 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:40.317 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:40.317 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:40.714 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:40.714 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:11:40.715 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-11-04T01:11:41.205 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:41.345 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:41.346 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:41.346 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:11:41.346 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:11:41.346 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:11:41.346 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:11:41.346 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi125.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:11:41.347 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:41.461 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:41.462 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:41.462 DEBUG:teuthology.orchestra.run.smithi125:> sudo rpm -qi grub2-tools 2023-11-04T01:11:41.495 INFO:teuthology.orchestra.run.smithi125.stdout:Name : grub2-tools 2023-11-04T01:11:41.495 INFO:teuthology.orchestra.run.smithi125.stdout:Epoch : 1 2023-11-04T01:11:41.495 INFO:teuthology.orchestra.run.smithi125.stdout:Version : 2.06 2023-11-04T01:11:41.495 INFO:teuthology.orchestra.run.smithi125.stdout:Release : 68.el9 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: x86_64 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Group : Unspecified 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Size : 8264254 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:License : GPLv3+ 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Packager : builder@centos.org 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Vendor : CentOS 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:11:41.496 INFO:teuthology.orchestra.run.smithi125.stdout:Summary : Support tools for GRUB. 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:Description : 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:hardware devices. 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:11:41.497 INFO:teuthology.orchestra.run.smithi125.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:11:41.498 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:11:41.498 INFO:teuthology.task.kernel:Updating grub on smithi125 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:11:41.498 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:11:42.168 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2023-11-04T01:11:43.556 INFO:teuthology.orchestra.run.smithi125.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:22:49.628 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:22:49.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-04T01:22:49.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:22:49.643 INFO:teuthology.orchestra.run.smithi125.stderr:done 2023-11-04T01:22:49.644 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-11-04T01:22:49.670 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.dYkHhdZ96P 2023-11-04T01:22:49.671 DEBUG:teuthology.orchestra.run.smithi125:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dYkHhdZ96P 2023-11-04T01:22:49.751 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.dYkHhdZ96P 2023-11-04T01:22:49.895 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.dYkHhdZ96P is 6KB 2023-11-04T01:22:49.944 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.dYkHhdZ96P 2023-11-04T01:22:49.959 DEBUG:teuthology.orchestra.run.smithi125:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:22:50.037 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:22:50.037 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:22:50.037 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:22:50.037 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:22:50.039 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:22:50.192 DEBUG:teuthology.orchestra.run.smithi125:> sudo shutdown -r now 2023-11-04T01:22:50.220 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-11-04T01:22:50.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-04T01:22:50.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:22:50.581 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-11-04T01:22:50.596 INFO:teuthology.orchestra.run.smithi093.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:22:50.596 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:22:50.596 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:22:51.597 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:22:51.597 DEBUG:teuthology.orchestra.run.smithi093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:22:51.671 INFO:teuthology.orchestra.run.smithi093.stdout:ttyS1 2023-11-04T01:22:51.708 DEBUG:teuthology.parallel:result is None 2023-11-04T01:23:20.195 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:23:20.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-04T01:23:20.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:20.198 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:24:29.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-04T01:24:29.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:29.651 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-04T01:24:29.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-04T01:24:29.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:24:29.996 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-11-04T01:24:30.010 INFO:teuthology.orchestra.run.smithi125.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:24:30.010 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:24:30.010 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:24:30.010 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:24:31.011 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:24:31.011 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:24:31.085 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2023-11-04T01:24:31.143 DEBUG:teuthology.parallel:result is None 2023-11-04T01:24:31.143 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:24:31.158 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:24:31.158 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:31.161 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:31.176 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:24:31.185 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:24:31.200 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:24:31.200 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:31.218 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:31.245 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:24:31.256 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:24:31.256 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:31.283 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:31.318 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:31.319 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:31.332 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:31.333 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:31.334 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:24:31.346 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:24:31.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:31.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:31.404 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:24:31.415 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:24:31.415 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:31.446 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:31.462 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:31.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:31.589 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:31.671 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:31.713 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:24:31.713 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:31.779 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:31.819 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:31.868 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:31.955 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:32.000 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:24:32.000 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:32.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-11-04T01:24:32.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-11-04T01:24:32.126 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:32.163 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:32.561 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:24:32.569 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:24:32.569 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:24:32.587 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:24:32.602 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2023-11-04T01:24:32.648 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: 2023-11-04T01:24:32.650 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2023-11-04T01:24:32.741 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2023-11-04T01:24:32.743 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:24:32.743 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2023-11-04T01:24:32.761 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2023-11-04T01:24:32.762 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2023-11-04T01:24:32.782 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2023-11-04T01:24:32.782 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi125.front.sepia.ceph.com': 'permissive'} 2023-11-04T01:24:32.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:32.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:32.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:32.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:32.856 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:24:32.857 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:32.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:32.942 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:24:32.952 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-04T01:24:32.957 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-04T01:24:33.075 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:24:33.094 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:24:33.095 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi093.front.sepia.ceph.com,smithi125.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:33:03.919 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi125.front.sepia.ceph.com')] 2023-11-04T01:33:03.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-04T01:33:03.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:04.010 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-11-04T01:33:04.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-04T01:33:04.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-04T01:33:04.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:04.177 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-04T01:33:04.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-04T01:33:04.250 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:33:04.262 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:33:04.262 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:04.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:04.267 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:04.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:04.300 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:04.319 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:04.335 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:04.339 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:04.354 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2023-11-04T01:33:04.367 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2023-11-04T01:33:04.368 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2023-11-04T01:33:04.382 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2023-11-04T01:33:04.384 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:04.399 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:04.410 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:04.419 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:04.449 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:04.450 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:04.450 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-11-04T01:33:04.450 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.450 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.450 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.451 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.463 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:04.464 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:04.465 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-11-04T01:33:04.465 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.465 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.465 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.465 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:04.466 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:33:04.486 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:33:04.487 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:33:04.487 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:33:04.487 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:33:04.524 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:33:04.524 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:33:04.524 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:04.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:04.568 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:04.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:04.876 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:04.877 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:04.965 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:04.966 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:05.094 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:05.095 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:33:05.095 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:05.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:05.137 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:05.147 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:05.147 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:33:05.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:05.177 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:05.178 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:05.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:05.249 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:05.306 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:05.330 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:05.375 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2023-11-04T01:33:05.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2023-11-04T01:33:05.399 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-11-04T01:33:05.400 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-11-04T01:33:05.624 INFO:teuthology.orchestra.run.smithi093.stdout:72 files removed 2023-11-04T01:33:05.635 INFO:teuthology.orchestra.run.smithi125.stdout:72 files removed 2023-11-04T01:33:05.657 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:05.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:06.341 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 216 kB/s | 78 kB 00:00 2023-11-04T01:33:06.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 207 kB/s | 78 kB 00:00 2023-11-04T01:33:06.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-11-04T01:33:06.734 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-11-04T01:33:07.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2023-11-04T01:33:07.145 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-11-04T01:33:07.597 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-11-04T01:33:07.597 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-11-04T01:33:09.004 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2023-11-04T01:33:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2023-11-04T01:33:10.645 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 7.9 MB 00:01 2023-11-04T01:33:12.494 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-04T01:33:15.767 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 7.9 MB 00:06 2023-11-04T01:33:16.379 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 5.8 MB 00:00 2023-11-04T01:33:17.779 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 15 kB 00:00 2023-11-04T01:33:19.754 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-11-04T01:33:23.976 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 18 MB 00:07 2023-11-04T01:33:24.426 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-11-04T01:33:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:33:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:33:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:33:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:33:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:33:26.909 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================ 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================ 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:33:26.920 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:33:26.921 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:33:26.922 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:33:26.923 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:33:26.924 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:33:26.925 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:33:26.926 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:33:26.927 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:33:26.928 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:33:26.929 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:33:26.930 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:33:26.931 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:33:26.932 INFO:teuthology.orchestra.run.smithi125.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout:Installing weak dependencies: 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================ 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout:Install 132 Packages 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 10 Packages 2023-11-04T01:33:26.933 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:33:26.934 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 200 M 2023-11-04T01:33:26.934 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-11-04T01:33:27.448 INFO:teuthology.orchestra.run.smithi125.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 24 kB/s | 6.5 kB 00:00 2023-11-04T01:33:27.799 INFO:teuthology.orchestra.run.smithi125.stdout:(2/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 8.4 MB/s | 5.2 MB 00:00 2023-11-04T01:33:27.857 INFO:teuthology.orchestra.run.smithi125.stdout:(3/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 2.1 MB/s | 859 kB 00:00 2023-11-04T01:33:27.907 INFO:teuthology.orchestra.run.smithi125.stdout:(4/142): ceph-immutable-object-cache-18.0.0-703 1.3 MB/s | 140 kB 00:00 2023-11-04T01:33:28.316 INFO:teuthology.orchestra.run.smithi125.stdout:(5/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 3.6 MB/s | 1.5 MB 00:00 2023-11-04T01:33:28.716 INFO:teuthology.orchestra.run.smithi125.stdout:(6/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 11 MB/s | 4.4 MB 00:00 2023-11-04T01:33:29.025 INFO:teuthology.orchestra.run.smithi125.stdout:(7/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 1.8 MB/s | 2.1 MB 00:01 2023-11-04T01:33:29.246 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.8 MB 00:01 2023-11-04T01:33:29.500 INFO:teuthology.orchestra.run.smithi125.stdout:(8/142): ceph-common-18.0.0-7035.g7532011a.el9. 8.2 MB/s | 19 MB 00:02 2023-11-04T01:33:29.542 INFO:teuthology.orchestra.run.smithi125.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 581 kB/s | 24 kB 00:00 2023-11-04T01:33:29.867 INFO:teuthology.orchestra.run.smithi125.stdout:(10/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 15 MB/s | 18 MB 00:01 2023-11-04T01:33:29.975 INFO:teuthology.orchestra.run.smithi125.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 2.0 MB/s | 217 kB 00:00 2023-11-04T01:33:30.092 INFO:teuthology.orchestra.run.smithi125.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 267 kB/s | 31 kB 00:00 2023-11-04T01:33:30.226 INFO:teuthology.orchestra.run.smithi125.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 5.3 MB/s | 718 kB 00:00 2023-11-04T01:33:30.293 INFO:teuthology.orchestra.run.smithi125.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 2.4 MB/s | 163 kB 00:00 2023-11-04T01:33:30.352 INFO:teuthology.orchestra.run.smithi125.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 2.1 MB/s | 126 kB 00:00 2023-11-04T01:33:30.485 INFO:teuthology.orchestra.run.smithi125.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 3.5 MB/s | 476 kB 00:00 2023-11-04T01:33:30.877 INFO:teuthology.orchestra.run.smithi125.stdout:(17/142): librgw2-18.0.0-7035.g7532011a.el9.x86 12 MB/s | 4.8 MB 00:00 2023-11-04T01:33:30.944 INFO:teuthology.orchestra.run.smithi125.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 681 kB/s | 45 kB 00:00 2023-11-04T01:33:31.052 INFO:teuthology.orchestra.run.smithi125.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.1 MB/s | 127 kB 00:00 2023-11-04T01:33:31.153 INFO:teuthology.orchestra.run.smithi125.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.6 MB/s | 162 kB 00:00 2023-11-04T01:33:31.387 INFO:teuthology.orchestra.run.smithi125.stdout:(21/142): ceph-radosgw-18.0.0-7035.g7532011a.el 3.7 MB/s | 8.7 MB 00:02 2023-11-04T01:33:31.412 INFO:teuthology.orchestra.run.smithi125.stdout:(22/142): python3-rados-18.0.0-7035.g7532011a.e 1.2 MB/s | 320 kB 00:00 2023-11-04T01:33:31.480 INFO:teuthology.orchestra.run.smithi125.stdout:(23/142): python3-rbd-18.0.0-7035.g7532011a.el9 3.2 MB/s | 299 kB 00:00 2023-11-04T01:33:31.496 INFO:teuthology.orchestra.run.smithi125.stdout:(24/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.2 MB/s | 99 kB 00:00 2023-11-04T01:33:31.554 INFO:teuthology.orchestra.run.smithi125.stdout:(25/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 1.1 MB/s | 84 kB 00:00 2023-11-04T01:33:31.730 INFO:teuthology.orchestra.run.smithi125.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 969 kB/s | 169 kB 00:00 2023-11-04T01:33:31.780 INFO:teuthology.orchestra.run.smithi125.stdout:(27/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 11 MB/s | 3.0 MB 00:00 2023-11-04T01:33:31.821 INFO:teuthology.orchestra.run.smithi125.stdout:(28/142): ceph-grafana-dashboards-18.0.0-7035.g 253 kB/s | 23 kB 00:00 2023-11-04T01:33:31.847 INFO:teuthology.orchestra.run.smithi125.stdout:(29/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.9 MB/s | 132 kB 00:00 2023-11-04T01:33:31.864 INFO:teuthology.orchestra.run.smithi093.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-11-04T01:33:32.580 INFO:teuthology.orchestra.run.smithi125.stdout:(30/142): ceph-test-18.0.0-7035.g7532011a.el9.x 14 MB/s | 41 MB 00:03 2023-11-04T01:33:32.631 INFO:teuthology.orchestra.run.smithi125.stdout:(31/142): ceph-mgr-dashboard-18.0.0-7035.g75320 2.2 MB/s | 1.8 MB 00:00 2023-11-04T01:33:32.656 INFO:teuthology.orchestra.run.smithi125.stdout:(32/142): ceph-mgr-modules-core-18.0.0-7035.g75 3.2 MB/s | 243 kB 00:00 2023-11-04T01:33:32.741 INFO:teuthology.orchestra.run.smithi125.stdout:(33/142): ceph-mgr-diskprediction-local-18.0.0- 8.3 MB/s | 7.4 MB 00:00 2023-11-04T01:33:32.756 INFO:teuthology.orchestra.run.smithi125.stdout:(34/142): ceph-prometheus-alerts-18.0.0-7035.g7 151 kB/s | 15 kB 00:00 2023-11-04T01:33:32.773 INFO:teuthology.orchestra.run.smithi125.stdout:(35/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 335 kB/s | 48 kB 00:00 2023-11-04T01:33:32.807 INFO:teuthology.orchestra.run.smithi125.stdout:(36/142): ceph-volume-18.0.0-7035.g7532011a.el9 3.8 MB/s | 262 kB 00:00 2023-11-04T01:33:32.824 INFO:teuthology.orchestra.run.smithi125.stdout:(37/142): cephfs-top-18.0.0-7035.g7532011a.el9. 362 kB/s | 18 kB 00:00 2023-11-04T01:33:32.849 INFO:teuthology.orchestra.run.smithi125.stdout:(38/142): cephadm-18.0.0-7035.g7532011a.el9.noa 2.9 MB/s | 270 kB 00:00 2023-11-04T01:33:32.991 INFO:teuthology.orchestra.run.smithi125.stdout:(39/142): boost-program-options-1.75.0-8.el9.x8 634 kB/s | 106 kB 00:00 2023-11-04T01:33:33.025 INFO:teuthology.orchestra.run.smithi125.stdout:(40/142): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 920 kB 00:00 2023-11-04T01:33:33.050 INFO:teuthology.orchestra.run.smithi125.stdout:(41/142): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 307 kB 00:00 2023-11-04T01:33:33.067 INFO:teuthology.orchestra.run.smithi125.stdout:(42/142): flexiblas-3.0.4-8.el9.x86_64.rpm 425 kB/s | 32 kB 00:00 2023-11-04T01:33:33.134 INFO:teuthology.orchestra.run.smithi125.stdout:(43/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-11-04T01:33:33.150 INFO:teuthology.orchestra.run.smithi125.stdout:(44/142): libaio-devel-0.3.111-13.el9.x86_64.rp 124 kB/s | 10 kB 00:00 2023-11-04T01:33:33.167 INFO:teuthology.orchestra.run.smithi125.stdout:(45/142): flexiblas-openblas-openmp-3.0.4-8.el9 175 kB/s | 17 kB 00:00 2023-11-04T01:33:33.193 INFO:teuthology.orchestra.run.smithi125.stdout:(46/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-04T01:33:33.227 INFO:teuthology.orchestra.run.smithi125.stdout:(47/142): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-11-04T01:33:33.251 INFO:teuthology.orchestra.run.smithi125.stdout:(48/142): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2023-11-04T01:33:33.268 INFO:teuthology.orchestra.run.smithi125.stdout:(49/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2023-11-04T01:33:33.294 INFO:teuthology.orchestra.run.smithi125.stdout:(50/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-11-04T01:33:33.319 INFO:teuthology.orchestra.run.smithi125.stdout:(51/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-11-04T01:33:33.336 INFO:teuthology.orchestra.run.smithi125.stdout:(52/142): openblas-0.3.21-2.el9.x86_64.rpm 829 kB/s | 34 kB 00:00 2023-11-04T01:33:33.411 INFO:teuthology.orchestra.run.smithi125.stdout:(53/142): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2023-11-04T01:33:33.453 INFO:teuthology.orchestra.run.smithi125.stdout:(54/142): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-11-04T01:33:33.478 INFO:teuthology.orchestra.run.smithi125.stdout:(55/142): postgresql-contrib-13.11-1.el9.x86_64 5.7 MB/s | 811 kB 00:00 2023-11-04T01:33:33.503 INFO:teuthology.orchestra.run.smithi125.stdout:(56/142): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2023-11-04T01:33:33.594 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-11-04T01:33:33.598 INFO:teuthology.orchestra.run.smithi125.stdout:(57/142): python3-babel-2.9.1-2.el9.noarch.rpm 50 MB/s | 5.8 MB 00:00 2023-11-04T01:33:33.671 INFO:teuthology.orchestra.run.smithi125.stdout:(58/142): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-11-04T01:33:33.696 INFO:teuthology.orchestra.run.smithi125.stdout:(59/142): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 205 kB 00:00 2023-11-04T01:33:33.721 INFO:teuthology.orchestra.run.smithi125.stdout:(60/142): python3-jinja2-2.11.3-4.el9.noarch.rp 1.8 MB/s | 228 kB 00:00 2023-11-04T01:33:33.746 INFO:teuthology.orchestra.run.smithi125.stdout:(61/142): python3-jsonpatch-1.21-16.el9.noarch. 327 kB/s | 24 kB 00:00 2023-11-04T01:33:33.771 INFO:teuthology.orchestra.run.smithi125.stdout:(62/142): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2023-11-04T01:33:33.797 INFO:teuthology.orchestra.run.smithi125.stdout:(63/142): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-11-04T01:33:33.822 INFO:teuthology.orchestra.run.smithi125.stdout:(64/142): python3-markupsafe-1.1.1-12.el9.x86_6 421 kB/s | 32 kB 00:00 2023-11-04T01:33:33.847 INFO:teuthology.orchestra.run.smithi125.stdout:(65/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 217 kB 00:00 2023-11-04T01:33:33.933 INFO:teuthology.orchestra.run.smithi125.stdout:(66/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-11-04T01:33:33.956 INFO:teuthology.orchestra.run.smithi125.stdout:(67/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-04T01:33:33.981 INFO:teuthology.orchestra.run.smithi125.stdout:(68/142): python3-prettytable-0.7.2-27.el9.noar 314 kB/s | 41 kB 00:00 2023-11-04T01:33:34.006 INFO:teuthology.orchestra.run.smithi125.stdout:(69/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-04T01:33:34.048 INFO:teuthology.orchestra.run.smithi125.stdout:(70/142): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 211 kB 00:00 2023-11-04T01:33:34.065 INFO:teuthology.orchestra.run.smithi125.stdout:(71/142): python3-requests-oauthlib-1.3.0-12.el 516 kB/s | 43 kB 00:00 2023-11-04T01:33:34.090 INFO:teuthology.orchestra.run.smithi125.stdout:(72/142): python3-toml-0.10.2-6.el9.noarch.rpm 926 kB/s | 39 kB 00:00 2023-11-04T01:33:34.166 INFO:teuthology.orchestra.run.smithi125.stdout:(73/142): socat-1.7.4.1-5.el9.x86_64.rpm 2.9 MB/s | 300 kB 00:00 2023-11-04T01:33:34.341 INFO:teuthology.orchestra.run.smithi125.stdout:(74/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 54 MB/s | 16 MB 00:00 2023-11-04T01:33:34.358 INFO:teuthology.orchestra.run.smithi125.stdout:(75/142): uuid-1.6.2-55.el9.x86_64.rpm 213 kB/s | 56 kB 00:00 2023-11-04T01:33:34.375 INFO:teuthology.orchestra.run.smithi125.stdout:(76/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 304 kB/s | 63 kB 00:00 2023-11-04T01:33:34.406 INFO:teuthology.orchestra.run.smithi125.stdout:(77/142): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-11-04T01:33:34.434 INFO:teuthology.orchestra.run.smithi125.stdout:(78/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-11-04T01:33:34.460 INFO:teuthology.orchestra.run.smithi125.stdout:(79/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-11-04T01:33:34.493 INFO:teuthology.orchestra.run.smithi125.stdout:(80/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2023-11-04T01:33:34.519 INFO:teuthology.orchestra.run.smithi125.stdout:(81/142): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-11-04T01:33:34.544 INFO:teuthology.orchestra.run.smithi125.stdout:(82/142): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-11-04T01:33:34.570 INFO:teuthology.orchestra.run.smithi125.stdout:(83/142): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-04T01:33:34.595 INFO:teuthology.orchestra.run.smithi125.stdout:(84/142): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-04T01:33:34.870 INFO:teuthology.orchestra.run.smithi125.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 81 kB/s | 22 kB 00:00 2023-11-04T01:33:34.912 INFO:teuthology.orchestra.run.smithi125.stdout:(86/142): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2023-11-04T01:33:35.138 INFO:teuthology.orchestra.run.smithi125.stdout:(87/142): jq-1.6-15.el9.x86_64.rpm 700 kB/s | 187 kB 00:00 2023-11-04T01:33:35.237 INFO:teuthology.orchestra.run.smithi125.stdout:(88/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 256 kB/s | 26 kB 00:00 2023-11-04T01:33:35.264 INFO:teuthology.orchestra.run.smithi125.stdout:(89/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 129 kB/s | 45 kB 00:00 2023-11-04T01:33:35.296 INFO:teuthology.orchestra.run.smithi125.stdout:(90/142): automake-1.16.2-8.el9.noarch.rpm 983 kB/s | 689 kB 00:00 2023-11-04T01:33:35.388 INFO:teuthology.orchestra.run.smithi125.stdout:(91/142): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2023-11-04T01:33:35.413 INFO:teuthology.orchestra.run.smithi125.stdout:(92/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 738 kB/s | 86 kB 00:00 2023-11-04T01:33:35.497 INFO:teuthology.orchestra.run.smithi125.stdout:(93/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2023-11-04T01:33:35.947 INFO:teuthology.orchestra.run.smithi125.stdout:(94/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 5.8 MB/s | 4.1 MB 00:00 2023-11-04T01:33:36.864 INFO:teuthology.orchestra.run.smithi125.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 27 kB/s | 24 kB 00:00 2023-11-04T01:33:37.031 INFO:teuthology.orchestra.run.smithi125.stdout:(96/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 191 kB/s | 309 kB 00:01 2023-11-04T01:33:37.131 INFO:teuthology.orchestra.run.smithi125.stdout:(97/142): liboath-2.6.7-2.el9.x86_64.rpm 182 kB/s | 49 kB 00:00 2023-11-04T01:33:37.290 INFO:teuthology.orchestra.run.smithi125.stdout:(98/142): libunwind-1.6.2-1.el9.x86_64.rpm 260 kB/s | 67 kB 00:00 2023-11-04T01:33:37.740 INFO:teuthology.orchestra.run.smithi125.stdout:(99/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.3 MB/s | 837 kB 00:00 2023-11-04T01:33:37.840 INFO:teuthology.orchestra.run.smithi125.stdout:(100/142): python3-asyncssh-2.13.2-3.el9.noarch 996 kB/s | 548 kB 00:00 2023-11-04T01:33:38.032 INFO:teuthology.orchestra.run.smithi125.stdout:(101/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 149 kB/s | 43 kB 00:00 2023-11-04T01:33:38.099 INFO:teuthology.orchestra.run.smithi125.stdout:(102/142): libarrow-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2023-11-04T01:33:38.109 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-11-04T01:33:38.127 INFO:teuthology.orchestra.run.smithi125.stdout:(103/142): python3-cachetools-4.2.4-1.el9.noarc 114 kB/s | 32 kB 00:00 2023-11-04T01:33:38.291 INFO:teuthology.orchestra.run.smithi125.stdout:(104/142): python3-certifi-2021.10.8-2.el9.noar 58 kB/s | 15 kB 00:00 2023-11-04T01:33:38.394 INFO:teuthology.orchestra.run.smithi125.stdout:(105/142): python3-cheroot-8.6.0-4.el9.noarch.r 588 kB/s | 172 kB 00:00 2023-11-04T01:33:38.433 INFO:teuthology.orchestra.run.smithi125.stdout:(106/142): python3-cherrypy-18.6.1-2.el9.noarch 1.1 MB/s | 358 kB 00:00 2023-11-04T01:33:38.609 INFO:teuthology.orchestra.run.smithi125.stdout:(107/142): python3-google-auth-2.23.3-1.el9.noa 621 kB/s | 197 kB 00:00 2023-11-04T01:33:38.659 INFO:teuthology.orchestra.run.smithi125.stdout:(108/142): python3-jaraco-8.2.1-3.el9.noarch.rp 40 kB/s | 11 kB 00:00 2023-11-04T01:33:38.676 INFO:teuthology.orchestra.run.smithi125.stdout:(109/142): python3-jaraco-classes-3.2.1-5.el9.n 73 kB/s | 18 kB 00:00 2023-11-04T01:33:38.876 INFO:teuthology.orchestra.run.smithi125.stdout:(110/142): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2023-11-04T01:33:38.903 INFO:teuthology.orchestra.run.smithi125.stdout:(111/142): python3-jaraco-functools-3.5.0-2.el9 80 kB/s | 19 kB 00:00 2023-11-04T01:33:38.926 INFO:teuthology.orchestra.run.smithi125.stdout:(112/142): python3-jaraco-text-3.2.0-6.el9.noar 78 kB/s | 20 kB 00:00 2023-11-04T01:33:39.113 INFO:teuthology.orchestra.run.smithi125.stdout:(113/142): python3-jwt+crypto-2.4.0-1.el9.noarc 39 kB/s | 9.0 kB 00:00 2023-11-04T01:33:39.152 INFO:teuthology.orchestra.run.smithi125.stdout:(114/142): python3-jwt-2.4.0-1.el9.noarch.rpm 163 kB/s | 41 kB 00:00 2023-11-04T01:33:39.339 INFO:teuthology.orchestra.run.smithi125.stdout:(115/142): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2023-11-04T01:33:39.394 INFO:teuthology.orchestra.run.smithi125.stdout:(116/142): python3-logutils-0.3.5-21.el9.noarch 163 kB/s | 46 kB 00:00 2023-11-04T01:33:39.445 INFO:teuthology.orchestra.run.smithi125.stdout:(117/142): python3-more-itertools-8.12.0-2.el9. 270 kB/s | 79 kB 00:00 2023-11-04T01:33:39.595 INFO:teuthology.orchestra.run.smithi125.stdout:(118/142): python3-natsort-7.1.1-5.el9.noarch.r 223 kB/s | 58 kB 00:00 2023-11-04T01:33:39.695 INFO:teuthology.orchestra.run.smithi125.stdout:(119/142): python3-portend-3.1.0-2.el9.noarch.r 66 kB/s | 16 kB 00:00 2023-11-04T01:33:39.720 INFO:teuthology.orchestra.run.smithi125.stdout:(120/142): python3-pecan-1.4.2-3.el9.noarch.rpm 836 kB/s | 272 kB 00:00 2023-11-04T01:33:39.870 INFO:teuthology.orchestra.run.smithi125.stdout:(121/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 327 kB/s | 90 kB 00:00 2023-11-04T01:33:39.971 INFO:teuthology.orchestra.run.smithi125.stdout:(122/142): python3-repoze-lru-0.7-16.el9.noarch 112 kB/s | 31 kB 00:00 2023-11-04T01:33:40.029 INFO:teuthology.orchestra.run.smithi125.stdout:(123/142): python3-routes-2.5.1-5.el9.noarch.rp 610 kB/s | 188 kB 00:00 2023-11-04T01:33:40.171 INFO:teuthology.orchestra.run.smithi125.stdout:(124/142): python3-rsa-4.9-2.el9.noarch.rpm 197 kB/s | 59 kB 00:00 2023-11-04T01:33:40.246 INFO:teuthology.orchestra.run.smithi125.stdout:(125/142): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2023-11-04T01:33:40.297 INFO:teuthology.orchestra.run.smithi125.stdout:(126/142): python3-typing-extensions-4.4.0-2.el 191 kB/s | 51 kB 00:00 2023-11-04T01:33:40.422 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:40.423 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:40.438 INFO:teuthology.orchestra.run.smithi093.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:33:40.438 INFO:teuthology.orchestra.run.smithi093.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:33:40.438 INFO:teuthology.orchestra.run.smithi093.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:33:40.439 INFO:teuthology.orchestra.run.smithi093.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:40.441 INFO:teuthology.orchestra.run.smithi093.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:40.445 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:33:40.445 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:33:40.480 INFO:teuthology.orchestra.run.smithi125.stdout:(127/142): python3-webob-1.8.7-6.el9.noarch.rpm 744 kB/s | 230 kB 00:00 2023-11-04T01:33:40.516 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:33:40.526 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:33:40.527 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:33:40.528 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:33:40.529 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:33:40.530 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:33:40.531 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:33:40.532 INFO:teuthology.orchestra.run.smithi093.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:33:40.533 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:33:40.534 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:33:40.535 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:33:40.536 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:33:40.537 INFO:teuthology.orchestra.run.smithi093.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:33:40.538 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:33:40.538 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:33:40.538 INFO:teuthology.orchestra.run.smithi093.stdout:Installing weak dependencies: 2023-11-04T01:33:40.538 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:33:40.538 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:33:40.541 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-11-04T01:33:40.541 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================ 2023-11-04T01:33:40.541 INFO:teuthology.orchestra.run.smithi093.stdout:Install 132 Packages 2023-11-04T01:33:40.541 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 10 Packages 2023-11-04T01:33:40.541 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:33:40.542 INFO:teuthology.orchestra.run.smithi125.stdout:(128/142): python3-websocket-client-1.2.3-2.el9 316 kB/s | 90 kB 00:00 2023-11-04T01:33:40.542 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 200 M 2023-11-04T01:33:40.543 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-11-04T01:33:40.614 INFO:teuthology.orchestra.run.smithi125.stdout:(129/142): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2023-11-04T01:33:40.725 INFO:teuthology.orchestra.run.smithi125.stdout:(130/142): python3-zc-lockfile-2.0-10.el9.noarc 82 kB/s | 20 kB 00:00 2023-11-04T01:33:40.842 INFO:teuthology.orchestra.run.smithi125.stdout:(131/142): re2-20211101-3.el9.x86_64.rpm 621 kB/s | 192 kB 00:00 2023-11-04T01:33:41.023 INFO:teuthology.orchestra.run.smithi125.stdout:(132/142): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2023-11-04T01:33:41.057 INFO:teuthology.orchestra.run.smithi125.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:33:41.124 INFO:teuthology.orchestra.run.smithi125.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 34 MB/s | 2.2 MB 00:00 2023-11-04T01:33:41.182 INFO:teuthology.orchestra.run.smithi125.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 31 MB/s | 1.8 MB 00:00 2023-11-04T01:33:41.274 INFO:teuthology.orchestra.run.smithi125.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 456 kB/s | 42 kB 00:00 2023-11-04T01:33:41.275 INFO:teuthology.orchestra.run.smithi093.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-11-04T01:33:41.308 INFO:teuthology.orchestra.run.smithi125.stdout:(137/142): NetworkManager-tui-1.45.5-1.el9.x86_ 7.2 MB/s | 245 kB 00:00 2023-11-04T01:33:41.341 INFO:teuthology.orchestra.run.smithi125.stdout:(138/142): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-04T01:33:41.382 INFO:teuthology.orchestra.run.smithi125.stdout:(139/142): libacl-2.3.1-4.el9.x86_64.rpm 664 kB/s | 22 kB 00:00 2023-11-04T01:33:41.408 INFO:teuthology.orchestra.run.smithi125.stdout:(140/142): xfsdump-3.1.12-4.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2023-11-04T01:33:41.800 INFO:teuthology.orchestra.run.smithi125.stdout:(141/142): librbd1-18.0.0-7035.g7532011a.el9.x8 3.1 MB/s | 3.0 MB 00:00 2023-11-04T01:33:42.109 INFO:teuthology.orchestra.run.smithi125.stdout:(142/142): librados2-18.0.0-7035.g7532011a.el9. 2.4 MB/s | 3.3 MB 00:01 2023-11-04T01:33:42.118 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:33:42.119 INFO:teuthology.orchestra.run.smithi125.stdout:Total 13 MB/s | 200 MB 00:15 2023-11-04T01:33:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-11-04T01:33:42.385 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-11-04T01:33:42.385 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-11-04T01:33:42.516 INFO:teuthology.orchestra.run.smithi093.stdout:(2/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 692 kB/s | 859 kB 00:01 2023-11-04T01:33:42.642 INFO:teuthology.orchestra.run.smithi093.stdout:(3/142): ceph-immutable-object-cache-18.0.0-703 1.1 MB/s | 140 kB 00:00 2023-11-04T01:33:43.475 INFO:teuthology.orchestra.run.smithi093.stdout:(4/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 2.5 MB/s | 2.1 MB 00:00 2023-11-04T01:33:43.542 INFO:teuthology.orchestra.run.smithi093.stdout:(5/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 2.0 MB/s | 5.2 MB 00:02 2023-11-04T01:33:43.792 INFO:teuthology.orchestra.run.smithi093.stdout:(6/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 4.6 MB/s | 1.5 MB 00:00 2023-11-04T01:33:44.109 INFO:teuthology.orchestra.run.smithi093.stdout:(7/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 7.7 MB/s | 4.4 MB 00:00 2023-11-04T01:33:44.153 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-11-04T01:33:44.154 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-11-04T01:33:45.184 INFO:teuthology.orchestra.run.smithi093.stdout:(8/142): ceph-radosgw-18.0.0-7035.g7532011a.el9 8.1 MB/s | 8.7 MB 00:01 2023-11-04T01:33:45.260 INFO:teuthology.orchestra.run.smithi093.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 321 kB/s | 24 kB 00:00 2023-11-04T01:33:46.251 INFO:teuthology.orchestra.run.smithi093.stdout:(10/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 7.2 MB/s | 18 MB 00:02 2023-11-04T01:33:46.793 INFO:teuthology.orchestra.run.smithi093.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 401 kB/s | 217 kB 00:00 2023-11-04T01:33:46.868 INFO:teuthology.orchestra.run.smithi093.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 415 kB/s | 31 kB 00:00 2023-11-04T01:33:47.010 INFO:teuthology.orchestra.run.smithi093.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 5.0 MB/s | 718 kB 00:00 2023-11-04T01:33:47.121 INFO:teuthology.orchestra.run.smithi093.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 1.5 MB/s | 163 kB 00:00 2023-11-04T01:33:47.202 INFO:teuthology.orchestra.run.smithi093.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 1.5 MB/s | 126 kB 00:00 2023-11-04T01:33:47.306 INFO:teuthology.orchestra.run.smithi093.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 4.7 MB/s | 476 kB 00:00 2023-11-04T01:33:47.836 INFO:teuthology.orchestra.run.smithi093.stdout:(17/142): librgw2-18.0.0-7035.g7532011a.el9.x86 9.0 MB/s | 4.8 MB 00:00 2023-11-04T01:33:47.903 INFO:teuthology.orchestra.run.smithi093.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 679 kB/s | 45 kB 00:00 2023-11-04T01:33:48.012 INFO:teuthology.orchestra.run.smithi093.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.1 MB/s | 127 kB 00:00 2023-11-04T01:33:48.121 INFO:teuthology.orchestra.run.smithi093.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.5 MB/s | 162 kB 00:00 2023-11-04T01:33:48.237 INFO:teuthology.orchestra.run.smithi093.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 2.7 MB/s | 320 kB 00:00 2023-11-04T01:33:48.354 INFO:teuthology.orchestra.run.smithi093.stdout:(22/142): python3-rbd-18.0.0-7035.g7532011a.el9 2.5 MB/s | 299 kB 00:00 2023-11-04T01:33:48.446 INFO:teuthology.orchestra.run.smithi093.stdout:(23/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.1 MB/s | 99 kB 00:00 2023-11-04T01:33:48.530 INFO:teuthology.orchestra.run.smithi093.stdout:(24/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 1.0 MB/s | 84 kB 00:00 2023-11-04T01:33:48.855 INFO:teuthology.orchestra.run.smithi093.stdout:(25/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 9.3 MB/s | 3.0 MB 00:00 2023-11-04T01:33:49.031 INFO:teuthology.orchestra.run.smithi093.stdout:(26/142): ceph-common-18.0.0-7035.g7532011a.el9 2.3 MB/s | 19 MB 00:08 2023-11-04T01:33:49.056 INFO:teuthology.orchestra.run.smithi093.stdout:(27/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 847 kB/s | 169 kB 00:00 2023-11-04T01:33:49.081 INFO:teuthology.orchestra.run.smithi093.stdout:(28/142): ceph-grafana-dashboards-18.0.0-7035.g 464 kB/s | 23 kB 00:00 2023-11-04T01:33:49.115 INFO:teuthology.orchestra.run.smithi093.stdout:(29/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 2.2 MB/s | 132 kB 00:00 2023-11-04T01:33:49.824 INFO:teuthology.orchestra.run.smithi093.stdout:(30/142): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-11-04T01:33:49.869 INFO:teuthology.orchestra.run.smithi093.stdout:(31/142): ceph-mgr-dashboard-18.0.0-7035.g75320 2.2 MB/s | 1.8 MB 00:00 2023-11-04T01:33:49.873 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-11-04T01:33:49.908 INFO:teuthology.orchestra.run.smithi093.stdout:(32/142): ceph-mgr-modules-core-18.0.0-7035.g75 2.8 MB/s | 243 kB 00:00 2023-11-04T01:33:49.925 INFO:teuthology.orchestra.run.smithi093.stdout:(33/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 808 kB/s | 48 kB 00:00 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:33:49.975 INFO:teuthology.orchestra.run.smithi093.stdout:(34/142): ceph-prometheus-alerts-18.0.0-7035.g7 226 kB/s | 15 kB 00:00 2023-11-04T01:33:49.978 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:33:50.004 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:33:50.010 INFO:teuthology.orchestra.run.smithi093.stdout:(35/142): ceph-volume-18.0.0-7035.g7532011a.el9 3.1 MB/s | 262 kB 00:00 2023-11-04T01:33:50.042 INFO:teuthology.orchestra.run.smithi093.stdout:(36/142): cephadm-18.0.0-7035.g7532011a.el9.noa 4.0 MB/s | 270 kB 00:00 2023-11-04T01:33:50.058 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:33:50.060 INFO:teuthology.orchestra.run.smithi093.stdout:(37/142): cephfs-top-18.0.0-7035.g7532011a.el9. 363 kB/s | 18 kB 00:00 2023-11-04T01:33:50.176 INFO:teuthology.orchestra.run.smithi093.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 907 kB/s | 106 kB 00:00 2023-11-04T01:33:50.218 INFO:teuthology.orchestra.run.smithi093.stdout:(39/142): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2023-11-04T01:33:50.243 INFO:teuthology.orchestra.run.smithi093.stdout:(40/142): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-11-04T01:33:50.268 INFO:teuthology.orchestra.run.smithi093.stdout:(41/142): flexiblas-3.0.4-8.el9.x86_64.rpm 637 kB/s | 32 kB 00:00 2023-11-04T01:33:50.327 INFO:teuthology.orchestra.run.smithi093.stdout:(42/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-11-04T01:33:50.352 INFO:teuthology.orchestra.run.smithi093.stdout:(43/142): flexiblas-openblas-openmp-3.0.4-8.el9 211 kB/s | 17 kB 00:00 2023-11-04T01:33:50.378 INFO:teuthology.orchestra.run.smithi093.stdout:(44/142): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2023-11-04T01:33:50.387 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:33:50.411 INFO:teuthology.orchestra.run.smithi093.stdout:(45/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-11-04T01:33:50.437 INFO:teuthology.orchestra.run.smithi093.stdout:(46/142): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-04T01:33:50.446 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:33:50.471 INFO:teuthology.orchestra.run.smithi093.stdout:(47/142): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-11-04T01:33:50.496 INFO:teuthology.orchestra.run.smithi093.stdout:(48/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 804 kB/s | 46 kB 00:00 2023-11-04T01:33:50.521 INFO:teuthology.orchestra.run.smithi093.stdout:(49/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-04T01:33:50.547 INFO:teuthology.orchestra.run.smithi093.stdout:(50/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-11-04T01:33:50.565 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:33:50.572 INFO:teuthology.orchestra.run.smithi093.stdout:(51/142): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-11-04T01:33:50.588 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:33:50.655 INFO:teuthology.orchestra.run.smithi093.stdout:(52/142): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2023-11-04T01:33:50.681 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:33:50.689 INFO:teuthology.orchestra.run.smithi093.stdout:(53/142): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-11-04T01:33:50.722 INFO:teuthology.orchestra.run.smithi093.stdout:(54/142): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-11-04T01:33:50.732 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:33:50.747 INFO:teuthology.orchestra.run.smithi093.stdout:(55/142): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-11-04T01:33:50.762 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:33:50.831 INFO:teuthology.orchestra.run.smithi093.stdout:(56/142): postgresql-server-13.11-1.el9.x86_64. 52 MB/s | 5.7 MB 00:00 2023-11-04T01:33:50.921 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:33:50.923 INFO:teuthology.orchestra.run.smithi093.stdout:(57/142): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2023-11-04T01:33:50.948 INFO:teuthology.orchestra.run.smithi093.stdout:(58/142): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 205 kB 00:00 2023-11-04T01:33:51.132 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:33:51.152 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:33:51.244 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:33:51.269 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:33:51.330 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:33:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:(59/142): ceph-test-18.0.0-7035.g7532011a.el9.x 6.8 MB/s | 41 MB 00:06 2023-11-04T01:33:51.359 INFO:teuthology.orchestra.run.smithi093.stdout:(60/142): python3-jsonpatch-1.21-16.el9.noarch. 60 kB/s | 24 kB 00:00 2023-11-04T01:33:51.382 INFO:teuthology.orchestra.run.smithi093.stdout:(61/142): python3-jinja2-2.11.3-4.el9.noarch.rp 526 kB/s | 228 kB 00:00 2023-11-04T01:33:51.412 INFO:teuthology.orchestra.run.smithi093.stdout:(62/142): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2023-11-04T01:33:51.441 INFO:teuthology.orchestra.run.smithi093.stdout:(63/142): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-11-04T01:33:51.467 INFO:teuthology.orchestra.run.smithi093.stdout:(64/142): python3-markupsafe-1.1.1-12.el9.x86_6 540 kB/s | 32 kB 00:00 2023-11-04T01:33:51.511 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:33:51.550 INFO:teuthology.orchestra.run.smithi093.stdout:(65/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-04T01:33:51.575 INFO:teuthology.orchestra.run.smithi093.stdout:(66/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-11-04T01:33:51.604 INFO:teuthology.orchestra.run.smithi093.stdout:(67/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-04T01:33:51.619 INFO:teuthology.orchestra.run.smithi093.stdout:(68/142): python3-prettytable-0.7.2-27.el9.noar 622 kB/s | 41 kB 00:00 2023-11-04T01:33:51.639 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:33:51.643 INFO:teuthology.orchestra.run.smithi093.stdout:(69/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-11-04T01:33:51.668 INFO:teuthology.orchestra.run.smithi093.stdout:(70/142): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-11-04T01:33:51.687 INFO:teuthology.orchestra.run.smithi093.stdout:(71/142): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 43 kB 00:00 2023-11-04T01:33:51.703 INFO:teuthology.orchestra.run.smithi093.stdout:(72/142): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-04T01:33:51.703 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:33:51.800 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:51.810 INFO:teuthology.orchestra.run.smithi093.stdout:(73/142): socat-1.7.4.1-5.el9.x86_64.rpm 2.3 MB/s | 300 kB 00:00 2023-11-04T01:33:51.835 INFO:teuthology.orchestra.run.smithi093.stdout:(74/142): uuid-1.6.2-55.el9.x86_64.rpm 430 kB/s | 56 kB 00:00 2023-11-04T01:33:51.853 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:51.994 INFO:teuthology.orchestra.run.smithi093.stdout:(75/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2023-11-04T01:33:52.020 INFO:teuthology.orchestra.run.smithi093.stdout:(76/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 304 kB/s | 63 kB 00:00 2023-11-04T01:33:52.045 INFO:teuthology.orchestra.run.smithi093.stdout:(77/142): fuse-2.9.9-15.el9.x86_64.rpm 382 kB/s | 79 kB 00:00 2023-11-04T01:33:52.078 INFO:teuthology.orchestra.run.smithi093.stdout:(78/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2023-11-04T01:33:52.103 INFO:teuthology.orchestra.run.smithi093.stdout:(79/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-11-04T01:33:52.128 INFO:teuthology.orchestra.run.smithi093.stdout:(80/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-11-04T01:33:52.147 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:33:52.154 INFO:teuthology.orchestra.run.smithi093.stdout:(81/142): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-11-04T01:33:52.179 INFO:teuthology.orchestra.run.smithi093.stdout:(82/142): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-04T01:33:52.189 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:33:52.204 INFO:teuthology.orchestra.run.smithi093.stdout:(83/142): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-11-04T01:33:52.224 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:33:52.230 INFO:teuthology.orchestra.run.smithi093.stdout:(84/142): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-04T01:33:52.301 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:33:52.313 INFO:teuthology.orchestra.run.smithi093.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 269 kB/s | 22 kB 00:00 2023-11-04T01:33:52.355 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:33:52.384 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:33:52.430 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:33:52.430 INFO:teuthology.orchestra.run.smithi093.stdout:(86/142): jq-1.6-15.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-11-04T01:33:52.455 INFO:teuthology.orchestra.run.smithi093.stdout:(87/142): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2023-11-04T01:33:52.481 INFO:teuthology.orchestra.run.smithi093.stdout:(88/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2023-11-04T01:33:52.508 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:33:52.550 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:33:52.556 INFO:teuthology.orchestra.run.smithi093.stdout:(89/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 255 kB/s | 26 kB 00:00 2023-11-04T01:33:52.569 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:33:52.591 INFO:teuthology.orchestra.run.smithi093.stdout:(90/142): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2023-11-04T01:33:52.626 INFO:teuthology.orchestra.run.smithi093.stdout:(91/142): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2023-11-04T01:33:52.640 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:33:52.682 INFO:teuthology.orchestra.run.smithi093.stdout:(92/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 21 MB/s | 4.1 MB 00:00 2023-11-04T01:33:52.682 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:33:52.707 INFO:teuthology.orchestra.run.smithi093.stdout:(93/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2023-11-04T01:33:52.728 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:33:52.740 INFO:teuthology.orchestra.run.smithi093.stdout:(94/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 573 kB/s | 86 kB 00:00 2023-11-04T01:33:52.800 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:33:52.936 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:33:52.995 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:33:53.007 INFO:teuthology.orchestra.run.smithi093.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 91 kB/s | 24 kB 00:00 2023-11-04T01:33:53.191 INFO:teuthology.orchestra.run.smithi093.stdout:(96/142): liboath-2.6.7-2.el9.x86_64.rpm 265 kB/s | 49 kB 00:00 2023-11-04T01:33:53.250 INFO:teuthology.orchestra.run.smithi093.stdout:(97/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 544 kB/s | 309 kB 00:00 2023-11-04T01:33:53.351 INFO:teuthology.orchestra.run.smithi093.stdout:(98/142): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2023-11-04T01:33:53.529 INFO:teuthology.orchestra.run.smithi093.stdout:(99/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.0 MB/s | 837 kB 00:00 2023-11-04T01:33:53.530 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:33:53.604 INFO:teuthology.orchestra.run.smithi093.stdout:(100/142): libarrow-9.0.0-9.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2023-11-04T01:33:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:33:53.634 INFO:teuthology.orchestra.run.smithi093.stdout:(101/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 400 kB/s | 43 kB 00:00 2023-11-04T01:33:53.661 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:33:53.698 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:33:53.718 INFO:teuthology.orchestra.run.smithi093.stdout:(102/142): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-11-04T01:33:53.728 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:33:53.743 INFO:teuthology.orchestra.run.smithi093.stdout:(103/142): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2023-11-04T01:33:53.768 INFO:teuthology.orchestra.run.smithi093.stdout:(104/142): python3-asyncssh-2.13.2-3.el9.noarch 1.3 MB/s | 548 kB 00:00 2023-11-04T01:33:53.827 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:33:53.861 INFO:teuthology.orchestra.run.smithi093.stdout:(105/142): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-11-04T01:33:53.866 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:33:53.885 INFO:teuthology.orchestra.run.smithi093.stdout:(106/142): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2023-11-04T01:33:53.920 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:33:53.936 INFO:teuthology.orchestra.run.smithi093.stdout:(107/142): python3-google-auth-2.23.3-1.el9.noa 1.2 MB/s | 197 kB 00:00 2023-11-04T01:33:53.993 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:33:53.994 INFO:teuthology.orchestra.run.smithi093.stdout:(108/142): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2023-11-04T01:33:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:(109/142): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2023-11-04T01:33:54.024 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:33:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:(110/142): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2023-11-04T01:33:54.063 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:33:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:(111/142): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2023-11-04T01:33:54.108 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:33:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:(112/142): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2023-11-04T01:33:54.153 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:33:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:(113/142): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-04T01:33:54.195 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:33:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:(114/142): python3-jwt-2.4.0-1.el9.noarch.rpm 407 kB/s | 41 kB 00:00 2023-11-04T01:33:54.246 INFO:teuthology.orchestra.run.smithi093.stdout:(115/142): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2023-11-04T01:33:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:(116/142): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2023-11-04T01:33:54.329 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:33:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:(117/142): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2023-11-04T01:33:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:(118/142): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2023-11-04T01:33:54.371 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:33:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:(119/142): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-11-04T01:33:54.413 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:33:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:(120/142): python3-portend-3.1.0-2.el9.noarch.r 103 kB/s | 16 kB 00:00 2023-11-04T01:33:54.506 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:33:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:(121/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 566 kB/s | 90 kB 00:00 2023-11-04T01:33:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:(122/142): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2023-11-04T01:33:54.547 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:33:54.587 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:33:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:(123/142): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-11-04T01:33:54.611 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:33:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:(124/142): python3-rsa-4.9-2.el9.noarch.rpm 544 kB/s | 59 kB 00:00 2023-11-04T01:33:54.638 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:33:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:(125/142): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2023-11-04T01:33:54.666 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:33:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:(126/142): python3-typing-extensions-4.4.0-2.el 435 kB/s | 51 kB 00:00 2023-11-04T01:33:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:(127/142): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-11-04T01:33:54.753 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:33:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:(128/142): python3-websocket-client-1.2.3-2.el9 763 kB/s | 90 kB 00:00 2023-11-04T01:33:54.790 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:33:54.839 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:33:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:(129/142): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-11-04T01:33:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:(130/142): python3-zc-lockfile-2.0-10.el9.noarc 159 kB/s | 20 kB 00:00 2023-11-04T01:33:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:(131/142): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-11-04T01:33:54.894 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:33:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:(132/142): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2023-11-04T01:33:55.094 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:33:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:33:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 34 MB/s | 2.2 MB 00:00 2023-11-04T01:33:55.226 INFO:teuthology.orchestra.run.smithi093.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 30 MB/s | 1.8 MB 00:00 2023-11-04T01:33:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-04T01:33:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:(137/142): NetworkManager-tui-1.45.5-1.el9.x86_ 7.2 MB/s | 245 kB 00:00 2023-11-04T01:33:55.299 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:33:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:(138/142): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-04T01:33:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:(139/142): libacl-2.3.1-4.el9.x86_64.rpm 658 kB/s | 22 kB 00:00 2023-11-04T01:33:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:(140/142): xfsdump-3.1.12-4.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2023-11-04T01:33:55.428 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:33:55.481 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:33:55.510 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:33:55.544 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:33:55.578 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:33:55.610 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:33:55.645 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:33:55.687 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:33:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:(141/142): librados2-18.0.0-7035.g7532011a.el9. 4.0 MB/s | 3.3 MB 00:00 2023-11-04T01:33:55.722 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:33:55.746 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:33:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:(142/142): librbd1-18.0.0-7035.g7532011a.el9.x8 3.3 MB/s | 3.0 MB 00:00 2023-11-04T01:33:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:33:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:Total 13 MB/s | 200 MB 00:15 2023-11-04T01:33:55.820 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:33:55.854 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:33:55.904 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:33:55.946 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:33:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-11-04T01:33:55.980 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:33:56.069 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:33:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-11-04T01:33:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-11-04T01:33:56.107 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:33:56.211 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:33:56.258 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:33:56.995 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:33:57.047 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:33:57.081 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:33:57.174 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:33:57.214 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:33:57.391 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:33:57.420 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:33:57.509 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:33:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-11-04T01:33:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-11-04T01:33:58.178 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:33:58.306 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:33:59.572 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:33:59.656 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:33:59.693 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:33:59.718 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:33:59.746 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:00.047 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:00.084 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:00.175 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:00.205 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:00.242 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:00.669 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:00.699 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:00.775 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:00.796 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:02.878 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:02.910 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:03.457 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:03.488 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:03.535 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-11-04T01:34:03.577 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:03.577 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:03.578 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:03.578 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:03.597 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:34:03.614 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:03.630 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:34:03.659 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:34:03.704 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:34:04.034 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:34:04.082 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:04.202 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:04.233 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:04.325 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:04.379 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:04.409 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:34:04.571 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:34:04.628 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:34:04.655 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:04.758 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:04.784 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:04.826 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:05.018 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:34:05.128 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:05.188 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:05.286 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:05.341 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:05.600 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:05.635 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:34:05.669 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:34:05.736 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:34:05.791 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:34:05.823 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:34:05.865 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:34:05.936 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:34:05.970 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:34:05.998 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:34:06.070 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:34:06.103 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:34:06.146 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:34:06.219 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:34:06.352 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:34:06.406 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:34:06.928 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:34:07.006 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:34:07.040 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:34:07.077 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:34:07.108 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:34:07.218 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:34:07.253 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:34:07.309 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:34:07.382 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:34:07.413 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:34:07.452 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:34:07.496 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:34:07.541 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:34:07.591 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:34:07.754 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:34:07.793 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:34:07.834 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:34:07.928 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:34:07.962 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:34:08.000 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:34:08.037 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:34:08.060 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:34:08.087 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:34:08.176 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:34:08.219 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:34:08.269 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:34:08.329 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:34:08.530 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:34:08.590 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:34:08.720 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:34:08.768 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:34:08.806 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:34:08.839 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:34:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:34:08.911 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:34:08.944 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:34:09.136 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:34:09.242 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:34:09.270 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:34:09.349 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:34:09.380 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:34:09.413 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:34:09.455 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:34:09.489 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:34:09.579 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:34:09.616 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:34:09.718 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:34:09.775 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:34:10.511 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:34:10.555 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:34:10.589 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:34:10.690 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:34:10.735 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:34:10.907 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:34:10.938 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:34:11.014 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:34:11.690 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:34:11.800 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:34:13.051 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:34:13.127 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:34:13.159 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:34:13.189 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:34:13.217 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:13.519 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:13.555 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:13.637 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:13.668 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:13.704 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:14.132 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:14.164 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:14.221 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:14.251 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /root 2023-11-04T01:34:15.063 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2023-11-04T01:34:15.064 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:15.225 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:15.240 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:15.241 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:15.241 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:15.241 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:16.375 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:16.414 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:16.803 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:16.828 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:16.828 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:16.828 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:16.828 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:16.829 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:16.829 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:16.955 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:16.991 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:17.037 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:17.059 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:17.060 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:17.060 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:17.060 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:17.060 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:17.060 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:17.066 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:17.066 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:17.066 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:17.066 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:17.105 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:17.498 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:17.520 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:17.886 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:17.911 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:17.941 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:18.002 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:18.031 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:18.247 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:18.280 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:19.238 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:19.269 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:19.370 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:19.519 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:34:19.554 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:19.577 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:19.577 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:19.577 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:34:19.577 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:19.577 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:19.578 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:19.622 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:19.633 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:20.419 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:34:20.448 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:20.471 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:20.523 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:20.545 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:20.545 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:20.545 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:34:20.545 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:20.591 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:20.613 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:20.910 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:20.931 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:24.752 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:34:24.806 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:34:24.832 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:34:25.015 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:34:25.148 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:34:25.207 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:34:25.249 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:34:25.274 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:34:25.296 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:34:25.326 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:34:25.399 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:34:25.459 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:34:25.483 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:34:26.075 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:26.116 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:26.136 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:26.186 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:34:27.011 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:34:27.095 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:34:27.136 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:34:27.225 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:34:27.257 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:34:27.283 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:34:27.283 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:27.350 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:27.375 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:34:27.400 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:34:27.425 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:34:27.433 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:27.433 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:27.611 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:27.612 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:27.695 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:27.719 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:27.720 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:27.804 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:27.869 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:28.596 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:28.596 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2023-11-04T01:34:28.596 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2023-11-04T01:34:28.596 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2023-11-04T01:34:28.597 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2023-11-04T01:34:28.597 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2023-11-04T01:34:28.597 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /root 2023-11-04T01:34:28.597 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2023-11-04T01:34:28.597 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:28.760 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:28.775 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:28.775 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:28.775 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:28.775 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:30.323 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:30.347 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:30.547 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:30.569 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:30.569 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:30.570 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:30.570 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:30.570 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:30.570 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:31.015 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:31.037 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:31.417 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:31.437 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:31.457 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:31.520 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:31.544 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:31.764 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:31.795 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:34:32.482 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:34:32.483 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:34:32.484 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:34:32.484 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:34:32.485 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:34:32.496 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:34:32.496 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:34:32.496 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:34:32.496 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:34:32.496 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:34:32.498 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:34:32.498 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:34:32.498 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:34:32.498 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:34:32.498 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:34:32.544 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:34:32.545 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:34:32.545 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:34:32.545 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:34:32.545 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:34:32.545 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:34:32.546 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:34:32.547 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:34:32.547 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:34:32.547 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:34:32.547 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:34:32.548 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:34:32.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:34:32.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:34:32.551 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:34:32.552 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:34:32.552 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:34:32.552 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:34:32.553 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:34:32.553 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:34:32.553 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:34:32.553 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:34:32.554 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:34:32.555 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:34:32.556 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:32.557 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:34:32.748 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:32.784 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:32.878 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:33.026 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:34:33.114 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:33.140 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:33.140 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:33.140 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:34:33.140 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:33.140 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:33.141 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:33.181 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:33.192 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:33.971 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:34:34.010 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:34.030 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:34.031 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:34.031 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:34:34.031 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:34.031 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:34.031 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:34.074 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:34.096 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:34.096 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:34.096 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:34:34.097 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:34.144 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:34.171 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:34.459 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:34.483 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:34.483 INFO:teuthology.orchestra.run.smithi093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:34.483 INFO:teuthology.orchestra.run.smithi093.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:34:34.483 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:34.484 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:34.484 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:35.307 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.308 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.309 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:34:35.310 INFO:teuthology.orchestra.run.smithi125.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:34:35.311 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:34:35.312 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.313 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:34:35.314 INFO:teuthology.orchestra.run.smithi125.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:34:35.315 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:34:35.316 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:34:35.316 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.316 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.316 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:34:35.317 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:34:35.318 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:34:35.319 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:34:35.320 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:34:35.320 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.321 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:34:35.322 INFO:teuthology.orchestra.run.smithi125.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:34:35.323 INFO:teuthology.orchestra.run.smithi125.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:34:35.329 INFO:teuthology.orchestra.run.smithi125.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:34:35.329 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:34:35.329 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:34:35.329 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:34:35.329 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:34:35.330 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:34:35.331 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:34:35.331 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:35.331 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-11-04T01:34:35.767 DEBUG:teuthology.parallel:result is None 2023-11-04T01:34:38.304 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:34:38.353 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:34:38.384 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:34:38.581 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:34:38.697 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:34:38.754 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:34:38.800 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:34:38.835 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:34:38.857 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:34:38.884 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:34:38.963 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:34:39.016 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:34:39.058 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:34:39.693 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:39.731 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:39.751 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:39.803 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:34:40.652 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:34:40.727 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:34:40.770 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:34:40.863 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:34:40.897 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:34:40.923 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:34:40.923 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:41.007 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:41.032 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:34:41.057 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:34:41.082 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:34:41.090 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:41.090 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:41.281 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:41.282 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:41.354 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:41.376 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:41.376 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:41.461 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:41.525 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:45.947 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:45.947 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:34:45.947 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:34:45.947 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:45.948 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:34:45.949 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:34:45.949 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:34:45.949 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:34:45.974 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:34:45.975 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:34:45.976 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:34:45.976 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:34:45.984 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:34:45.985 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:34:45.986 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:34:45.986 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:34:45.986 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:34:45.996 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:34:45.996 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:34:45.996 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:34:45.996 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:34:45.996 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:34:45.997 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:34:45.998 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:34:46.008 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:34:46.012 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:34:46.012 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:34:46.013 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:34:46.019 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:34:46.021 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:34:46.021 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:34:46.021 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:34:46.022 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:34:46.023 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:34:46.025 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:34:46.026 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:34:46.026 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:34:46.026 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:34:46.046 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:34:46.047 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:34:46.052 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:46.053 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:34:48.300 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:48.300 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:48.300 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-11-04T01:34:48.301 INFO:teuthology.orchestra.run.smithi093.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.302 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.303 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.303 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.303 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.303 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:48.304 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.305 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:34:48.306 INFO:teuthology.orchestra.run.smithi093.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:34:48.307 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:34:48.308 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:34:48.309 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:34:48.310 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.311 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:34:48.312 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:34:48.314 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:34:48.314 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:34:48.327 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:48.328 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-11-04T01:34:48.691 DEBUG:teuthology.parallel:result is None 2023-11-04T01:34:48.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:34:48.843 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:34:48.869 INFO:teuthology.orchestra.run.smithi093.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:34:48.869 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:34:48.870 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:34:48.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:34:49.242 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:34:49.272 INFO:teuthology.orchestra.run.smithi125.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:34:49.272 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:34:49.272 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:34:49.273 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:34:49.273 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:49.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:34:49.304 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:49.304 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:34:49.345 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:34:49.345 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:49.345 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:34:49.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:34:49.441 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:49.441 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:34:49.473 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:34:49.542 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:34:49.542 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:49.542 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:34:49.570 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:34:49.637 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:49.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:34:49.667 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:34:49.736 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:34:49.737 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:49.737 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:34:49.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:34:49.831 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:49.831 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:34:49.861 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:34:49.929 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:34:50.045 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:34:50.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2023-11-04T01:34:50.048 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2023-11-04T01:34:50.077 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:34:50.077 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:34:50.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:34:50.148 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:34:50.148 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:34:50.186 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:34:50.224 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:34:50.226 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:34:50.226 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:34:50.226 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:50.226 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:34:50.269 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:50.398 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:50.425 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:50.426 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:34:50.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:50.569 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:34:50.602 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:34:50.602 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:34:50.602 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445919', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd1V3htK5J+6UMoV/b32NQraS+rYC07ZBofi4cORbpKRsmgg2F4pQDqNWN/GHmDCBqncrv/iSWN5TaGBSCJYhs=', 'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIB3bMpXE6SKK2rBX2MEDzeur8W0Ch7DQRTXqZD+YZxuC+dXPogiTOM2LUfNSZgNxOJRWi6w+K9ZeJA+6YmNdyw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:34:50.603 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:34:50.606 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:34:50.652 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:34:50.666 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:34:50.720 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:50.720 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:34:50.742 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:34:50.742 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-04 01:34:41.841085303 +0000 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-04 01:32:03.719247174 +0000 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-04 01:32:03.719247174 +0000 2023-11-04T01:34:50.799 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-11-04 01:32:03.719247174 +0000 2023-11-04T01:34:50.800 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:34:50.864 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-04T01:34:50.864 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-04T01:34:50.864 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000201906 s, 2.5 MB/s 2023-11-04T01:34:50.865 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:34:50.921 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:50.976 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-04 01:34:41.841085303 +0000 2023-11-04T01:34:50.977 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-04 01:32:04.848223344 +0000 2023-11-04T01:34:50.977 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-04 01:32:04.848223344 +0000 2023-11-04T01:34:50.977 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-11-04 01:32:04.848223344 +0000 2023-11-04T01:34:50.977 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000180772 s, 2.8 MB/s 2023-11-04T01:34:51.042 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:34:51.097 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-11-04T01:34:51.151 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:34:51.151 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-04 01:34:41.842085281 +0000 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-04 01:32:06.200194807 +0000 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-04 01:32:06.200194807 +0000 2023-11-04T01:34:51.152 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-11-04 01:32:06.200194807 +0000 2023-11-04T01:34:51.152 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:34:51.219 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-04T01:34:51.219 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-04T01:34:51.219 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000187551 s, 2.7 MB/s 2023-11-04T01:34:51.219 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:34:51.278 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-11-04T01:34:51.332 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-04 01:34:41.842085281 +0000 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-04 01:32:07.353170471 +0000 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-04 01:32:07.353170471 +0000 2023-11-04T01:34:51.333 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2023-11-04 01:32:07.353170471 +0000 2023-11-04T01:34:51.333 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:34:51.399 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-04T01:34:51.399 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-04T01:34:51.399 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.00020849 s, 2.5 MB/s 2023-11-04T01:34:51.400 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:34:51.459 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:51.460 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:51.460 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:34:51.477 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:34:51.477 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-04 01:34:28.221090899 +0000 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-04 01:32:03.545756644 +0000 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-04 01:32:03.545756644 +0000 2023-11-04T01:34:51.535 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2023-11-04 01:32:03.545756644 +0000 2023-11-04T01:34:51.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:34:51.602 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-04T01:34:51.603 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-04T01:34:51.603 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000211081 s, 2.4 MB/s 2023-11-04T01:34:51.604 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:34:51.663 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-11-04T01:34:51.721 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-04 01:34:28.222090882 +0000 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-04 01:32:04.642738330 +0000 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-04 01:32:04.642738330 +0000 2023-11-04T01:34:51.722 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2023-11-04 01:32:04.642738330 +0000 2023-11-04T01:34:51.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:34:51.791 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-04T01:34:51.791 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-04T01:34:51.792 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000209115 s, 2.4 MB/s 2023-11-04T01:34:51.793 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:34:51.850 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-11-04T01:34:51.909 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-04 01:34:28.222090882 +0000 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-04 01:32:05.864717927 +0000 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-04 01:32:05.864717927 +0000 2023-11-04T01:34:51.910 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2023-11-04 01:32:05.864717927 +0000 2023-11-04T01:34:51.911 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:34:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-04T01:34:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-04T01:34:51.978 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000200238 s, 2.6 MB/s 2023-11-04T01:34:51.979 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:34:52.037 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-11-04T01:34:52.095 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:34:52.095 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:34:52.095 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-04T01:34:52.095 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:34:52.095 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:34:52.096 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-11-04 01:34:28.222090882 +0000 2023-11-04T01:34:52.096 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-11-04 01:32:06.710703802 +0000 2023-11-04T01:34:52.096 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-11-04 01:32:06.710703802 +0000 2023-11-04T01:34:52.096 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2023-11-04 01:32:06.710703802 +0000 2023-11-04T01:34:52.096 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:34:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-11-04T01:34:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-11-04T01:34:52.163 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.00019503 s, 2.6 MB/s 2023-11-04T01:34:52.164 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:34:52.220 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:52.220 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:34:52.221 INFO:tasks.ceph:Generating config... 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:34:52.222 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:34:52.222 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:34:52.222 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:34:52.223 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:34:52.224 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:34:52.224 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:34:52.225 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:34:52.225 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:34:52.295 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:34:52.299 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:34:52.343 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:34:52.370 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.93'), ('mon.b', '172.21.15.125'), ('mon.c', '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]')] 2023-11-04T01:34:52.371 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.93,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:34:52.371 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:52.371 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:34:52.425 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.93 --add b 172.21.15.125 --addv c '[v2:172.21.15.125:3301,v1:172.21.15.125:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:52.509 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: generated fsid a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:setting min_mon_release = pacific 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:epoch 0 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:fsid a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:last_changed 2023-11-04T01:34:52.508629+0000 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:created 2023-11-04T01:34:52.508629+0000 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:min_mon_release 16 (pacific) 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:election_strategy: 1 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:0: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.a 2023-11-04T01:34:52.510 INFO:teuthology.orchestra.run.smithi093.stdout:1: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.b 2023-11-04T01:34:52.517 INFO:teuthology.orchestra.run.smithi093.stdout:2: [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] mon.c 2023-11-04T01:34:52.517 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:34:52.518 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:34:52.533 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a91d0b76-a9fc-4383-b1e1-1b6875ba32e4... 2023-11-04T01:34:52.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:34:52.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:34:52.626 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-11-04T01:34:52.626 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-11-04T01:34:52.626 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:34:52.626 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:34:52.627 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:34:52.628 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-11-04T01:34:52.629 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-11-04T01:34:52.639 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.93,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2023-11-04T01:34:52.639 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:34:52.644 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-11-04T01:34:52.650 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug trim objects = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.651 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 20 2023-11-04T01:34:52.652 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 20 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 10 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:34:52.653 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-11-04T01:34:52.654 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-04T01:34:52.654 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-04T01:34:52.654 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:52.654 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:52.654 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-11-04T01:34:52.666 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.666 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-11-04T01:34:52.666 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:34:52.666 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-04T01:34:52.666 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:34:52.667 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-11-04T01:34:52.668 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-04T01:34:52.669 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-04T01:34:52.670 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-04T01:34:52.671 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-04T01:34:52.683 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-11-04T01:34:52.683 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-11-04T01:34:52.683 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:34:52.683 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-11-04T01:34:52.684 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:34:52.685 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.686 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.93,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-11-04T01:34:52.687 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.705 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.706 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug trim objects = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-11-04T01:34:52.707 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-11-04T01:34:52.708 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2023-11-04T01:34:52.709 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-11-04T01:34:52.710 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-04T01:34:52.711 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-11-04T01:34:52.742 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-04T01:34:52.742 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-11-04T01:34:52.742 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-11-04T01:34:52.743 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:34:52.743 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-11-04T01:34:52.743 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:34:52.745 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.769 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:34:52.769 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-11-04T01:34:52.770 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:34:52.771 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:34:52.777 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-11-04T01:34:52.777 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-11-04T01:34:52.777 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:34:52.777 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = "" 2023-11-04T01:34:52.778 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-11-04T01:34:52.780 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-04T01:34:52.781 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-04T01:34:52.782 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:34:52.782 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:34:52.845 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:34:52.845 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:52.845 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:34:52.874 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:52.874 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:34:52.931 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:34:52.931 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:52.931 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:34:52.931 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:34:53.010 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:34:53.010 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:53.069 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:34:53.069 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:53.069 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:34:53.069 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:34:53.112 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:34:53.113 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:53.169 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:34:53.169 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:34:53.170 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:34:53.224 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:34:53.228 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:34:53.315 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:34:53.319 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:34:53.319 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:34:53.373 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:34:53.383 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:34:53.450 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:34:53.544 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:34:53.546 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:34:53.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:34:53.634 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:34:53.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:34:53.666 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:34:53.763 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:34:53.765 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:34:53.795 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:34:53.795 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:34:53.837 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:34:53.852 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:34:53.937 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:34:53.952 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:34:53.994 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:34:54.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:34:54.094 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:34:54.109 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:34:54.110 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:34:54.110 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:34:54.141 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:54.141 INFO:tasks.ceph:role: osd.0 2023-11-04T01:34:54.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:34:54.142 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:34:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:34:54.216 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:34:54.216 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:34:54.216 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:34:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:34:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-11-04T01:34:54.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-04T01:34:54.730 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:34:54.856 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:34:54.895 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:34:54.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:54.966 INFO:tasks.ceph:role: osd.1 2023-11-04T01:34:54.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:34:54.966 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:34:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:34:55.040 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:34:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:34:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-11-04T01:34:55.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-04T01:34:55.489 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:34:55.578 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:34:55.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:34:55.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:55.684 INFO:tasks.ceph:role: osd.2 2023-11-04T01:34:55.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:34:55.684 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:34:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:34:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:34:56.246 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-11-04T01:34:56.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-04T01:34:56.248 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:34:56.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:34:56.408 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:34:56.478 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:34:56.478 INFO:tasks.ceph:role: osd.3 2023-11-04T01:34:56.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:34:56.478 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:34:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:34:56.553 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:34:56.553 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:34:56.553 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:34:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:34:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2023-11-04T01:34:57.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-04T01:34:57.052 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:34:57.183 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:34:57.219 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.316+0000 7f6116818500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.316+0000 7f6116818500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.316+0000 7f6116818500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.316+0000 7f6116818500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.316+0000 7f6116818500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:34:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:34:57.317+0000 7f6116818500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:35:00.182 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:00.214 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.304+0000 7fdbe069c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:35:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.304+0000 7fdbe069c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:35:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.305+0000 7fdbe069c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.305+0000 7fdbe069c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.305+0000 7fdbe069c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:00.305+0000 7fdbe069c500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:35:03.156 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:03.189 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:03.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.276+0000 7f61fcc12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:35:03.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.276+0000 7f61fcc12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:35:03.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.276+0000 7f61fcc12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:03.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.276+0000 7f61fcc12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:03.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.276+0000 7f61fcc12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:03.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:03.277+0000 7f61fcc12500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:35:06.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:06.157 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.243+0000 7f9836812500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.243+0000 7f9836812500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.243+0000 7f9836812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.243+0000 7f9836812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.243+0000 7f9836812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:06.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:06.244+0000 7f9836812500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:35:09.088 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:09.118 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:09.149 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:09.149 INFO:tasks.ceph:role: osd.4 2023-11-04T01:35:09.149 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:35:09.149 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:35:09.225 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:09.226 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:09.737 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-04T01:35:09.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-04T01:35:09.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:09.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:09.898 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:09.966 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:09.966 INFO:tasks.ceph:role: osd.5 2023-11-04T01:35:09.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:35:09.967 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:35:10.041 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:10.041 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:10.041 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:10.042 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:10.521 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-04T01:35:10.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-04T01:35:10.523 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:10.617 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:10.646 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:10.713 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:10.714 INFO:tasks.ceph:role: osd.6 2023-11-04T01:35:10.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:35:10.714 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:10.788 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:11.310 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-04T01:35:11.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-04T01:35:11.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:11.427 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:11.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:11.530 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:11.530 INFO:tasks.ceph:role: osd.7 2023-11-04T01:35:11.530 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:35:11.530 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:11.605 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:12.101 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-11-04T01:35:12.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-11-04T01:35:12.103 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:12.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:12.252 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.353+0000 7fe148c05500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.353+0000 7fe148c05500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.353+0000 7fe148c05500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.353+0000 7fe148c05500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.353+0000 7fe148c05500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:12.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:12.354+0000 7fe148c05500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:35:15.203 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:15.236 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:15.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.330+0000 7fc71f80c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:35:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.330+0000 7fc71f80c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:35:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.330+0000 7fc71f80c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.330+0000 7fc71f80c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.330+0000 7fc71f80c500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:15.331+0000 7fc71f80c500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:35:18.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:18.214 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:18.306+0000 7fac1260c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:35:20.604 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:20.611 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:21.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:21.181 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.266+0000 7f6d7539b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.266+0000 7f6d7539b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.266+0000 7f6d7539b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.266+0000 7f6d7539b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.266+0000 7f6d7539b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:21.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:21.267+0000 7f6d7539b500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:35:24.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:24.163 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:35:24.164 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.164 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:35:24.196 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.196 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:35:24.267 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.267 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:35:24.336 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.336 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:35:24.405 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.405 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:35:24.473 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.473 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:35:24.541 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:24.541 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:35:24.608 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.609 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:35:24.644 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.644 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:35:24.716 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.716 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:35:24.785 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.786 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:35:24.855 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:35:24.923 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.924 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:35:24.992 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:24.992 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:35:25.063 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:25.063 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:35:25.079 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:25.080 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:35:25.137 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:25.137 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:35:25.153 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:25.153 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:35:25.208 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:35:25.209 DEBUG:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:25.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:25.252 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.y] 2023-11-04T01:35:25.252 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA== 2023-11-04T01:35:25.252 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-04T01:35:25.252 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA== 2023-11-04T01:35:25.252 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA== 2023-11-04T01:35:25.253 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.7] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg== 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:35:25.254 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:35:25.255 INFO:teuthology.orchestra.run.smithi093.stdout:[client.2] 2023-11-04T01:35:25.255 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA== 2023-11-04T01:35:25.255 INFO:teuthology.orchestra.run.smithi093.stdout:[client.1] 2023-11-04T01:35:25.255 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA== 2023-11-04T01:35:25.255 INFO:teuthology.orchestra.run.smithi093.stdout:[client.3] 2023-11-04T01:35:25.263 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA== 2023-11-04T01:35:25.274 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.y] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ== 2023-11-04T01:35:25.275 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.4] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.5] 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig== 2023-11-04T01:35:25.276 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.6] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q== 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.7] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg== 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout:[client.2] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA== 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA== 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout:[client.3] 2023-11-04T01:35:25.277 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA== 2023-11-04T01:35:25.279 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:25.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:25.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.375 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.432 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.486 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.490 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.540 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.544 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.595 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.603 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.656 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.658 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.710 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:25.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:25.767 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.771 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.839 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.841 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:25.897 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.900 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:25.955 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:26.007 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:26.009 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:26.060 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:26.065 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:26.119 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.177 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.179 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.236 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.239 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.298 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:26.354 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:35:26.354 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:26.385 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:26.481 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:26.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:26.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:26.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:26.665 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:26.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:26.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:26.856 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:26.859 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:26.917 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:35:26.917 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:35:26.918 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:35:26.920 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:35:26.920 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:35:26.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:35:26.960 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:35:26.960 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:35:26.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:35:26.963 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:35:26.963 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:35:26.963 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:35:26.963 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:35:26.971 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:35:26.971 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:35:26.971 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:35:26.975 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:35:26.975 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:35:26.976 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:35:27.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.075+0000 7f6e8f5a9640 1 Processor -- start 2023-11-04T01:35:27.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 -- start start 2023-11-04T01:35:27.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 0x7f6e880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e880c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8815aff0 con 0x7f6e880adac0 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e880c52d0 con 0x7f6e88159c00 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.076+0000 7f6e8f5a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8815a3e0 con 0x7f6e880c48e0 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8d345640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 0x7f6e880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8db46640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6e880adac0 0x7f6e880adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56380/0 (socket says 172.21.15.93:56380) 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8db46640 1 -- 172.21.15.93:0/3628794964 learned_addr learned my addr 172.21.15.93:0/3628794964 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8d345640 1 -- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 msgr2=0x7f6e880cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8d345640 1 -- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 msgr2=0x7f6e880cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8d345640 1 --2- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 0x7f6e880cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:27.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e880c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8d345640 1 --2- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 0x7f6e880cc890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:27.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8cb44640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 msgr2=0x7f6e880c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:27.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8cb44640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 msgr2=0x7f6e880c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:27.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e880c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:27.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.077+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e880c4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:27.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653334315 0 0) 0x7f6e8815aff0 con 0x7f6e880adac0 2023-11-04T01:35:27.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e74003520 con 0x7f6e880adac0 2023-11-04T01:35:27.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760910991 0 0) 0x7f6e74003520 con 0x7f6e880adac0 2023-11-04T01:35:27.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 msgr2=0x7f6e880c4d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:35:27.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e880c4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 msgr2=0x7f6e880cc890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 --2- 172.21.15.93:0/3628794964 >> v2:172.21.15.93:3300/0 conn(0x7f6e88159c00 0x7f6e880cc890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8815a6c0 con 0x7f6e880adac0 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6e800019f0 con 0x7f6e880adac0 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.270+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 >> v1:172.21.15.93:6789/0 conn(0x7f6e880adac0 legacy=0x7f6e880adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e74003970 0x7f6e74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e740047c0 0x7f6e74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880c52d0 con 0x7f6e740047c0 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8815a3e0 con 0x7f6e74003970 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7400dcc0 con 0x7f6e880c48e0 2023-11-04T01:35:27.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e740047c0 0x7f6e74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8db46640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8d345640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e74003970 0x7f6e74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 msgr2=0x7f6e74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:27.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e74003970 msgr2=0x7f6e74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:27.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e74003970 0x7f6e74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8cb44640 1 -- 172.21.15.93:0/3628794964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74003520 con 0x7f6e740047c0 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.271+0000 7f6e8db46640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e880c48e0 0x7f6e74005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.272+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e740047c0 0x7f6e74004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6e84006fd0 tx=0x7f6e740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf4a210a3a7a55f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.272+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84033650 con 0x7f6e740047c0 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.272+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e840337b0 con 0x7f6e740047c0 2023-11-04T01:35:27.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.272+0000 7f6e7ffff640 1 -- 172.21.15.93:0/3628794964 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84033b60 con 0x7f6e740047c0 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/3628794964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e740047c0 msgr2=0x7f6e74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 --2- 172.21.15.93:0/3628794964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e740047c0 0x7f6e74004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6e84006fd0 tx=0x7f6e740057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8db46640 1 -- 172.21.15.93:0/3628794964 reap_dead start 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/3628794964 shutdown_connections 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/3628794964 >> 172.21.15.93:0/3628794964 conn(0x7f6e880ce950 msgr2=0x7f6e880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/3628794964 shutdown_connections 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.273+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/3628794964 wait complete. 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.274+0000 7f6e8f5a9640 1 Processor -- start 2023-11-04T01:35:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.274+0000 7f6e8f5a9640 1 -- start start 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e740047c0 0x7f6e880b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e8815c1f0 0x7f6e8815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8814be00 con 0x7f6e881f1c90 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8815cbb0 con 0x7f6e8815c1f0 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8f5a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8814bf90 con 0x7f6e740047c0 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40586/0 (socket says 172.21.15.93:40586) 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 -- 172.21.15.93:0/4001296433 learned_addr learned my addr 172.21.15.93:0/4001296433 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8d345640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e740047c0 0x7f6e880b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8db46640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e8815c1f0 0x7f6e8815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 -- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e740047c0 msgr2=0x7f6e880b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e740047c0 0x7f6e880b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 -- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e8815c1f0 msgr2=0x7f6e8815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e8815c1f0 0x7f6e8815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 -- 172.21.15.93:0/4001296433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880b3ad0 con 0x7f6e881f1c90 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e8cb44640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e84000c00 tx=0x7f6e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.275+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84046400 con 0x7f6e881f1c90 2023-11-04T01:35:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84040070 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e880b3db0 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84046780 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e880b4370 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6e8402f030 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.276+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6e8404f8b0 con 0x7f6e881f1c90 2023-11-04T01:35:27.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.277+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e88074290 con 0x7f6e881f1c90 2023-11-04T01:35:27.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.279+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6e84042070 con 0x7f6e881f1c90 2023-11-04T01:35:27.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.344+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6e881541b0 con 0x7f6e881f1c90 2023-11-04T01:35:27.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.346+0000 7f6e7dffb640 1 -- 172.21.15.93:0/4001296433 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6e8400b5e0 con 0x7f6e881f1c90 2023-11-04T01:35:27.347 INFO:teuthology.orchestra.run.smithi093.stderr:adjusted tunables profile to default 2023-11-04T01:35:27.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.346+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 msgr2=0x7f6e880c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.346+0000 7f6e8f5a9640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e84000c00 tx=0x7f6e84004730 comp rx=0 tx=0).stop 2023-11-04T01:35:27.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 shutdown_connections 2023-11-04T01:35:27.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e8815c1f0 0x7f6e8815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e881f1c90 0x7f6e880c7de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 --2- 172.21.15.93:0/4001296433 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e740047c0 0x7f6e880b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 >> 172.21.15.93:0/4001296433 conn(0x7f6e880ce950 msgr2=0x7f6e8806ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:27.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 shutdown_connections 2023-11-04T01:35:27.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:27.347+0000 7f6e8f5a9640 1 -- 172.21.15.93:0/4001296433 wait complete. 2023-11-04T01:35:27.359 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:35:27.359 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:35:27.359 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:27.360 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:35:27.386 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:27.386 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:35:27.455 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:27.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:35:27.524 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:35:27.525 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:35:27.592 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:27.593 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:35:27.621 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:27.622 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:35:27.688 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:27.688 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:35:27.743 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:27.741+0000 7f850b21d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:35:27.756 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:35:27.757 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:35:27.773 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:27.772+0000 7fe76a21d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:35:27.796 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:27.794+0000 7f850b21d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:35:27.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 63817301-aed9-4ea9-a7df-508da2bde793 0 2023-11-04T01:35:27.823 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:27.822+0000 7fe76a21d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:35:27.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.960+0000 7f7027e90640 1 Processor -- start 2023-11-04T01:35:27.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.960+0000 7f7027e90640 1 -- start start 2023-11-04T01:35:27.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7027e90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f70200b64c0 0x7f70200b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7027e90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70200cd3b0 0x7f70200cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7027e90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200cdd40 con 0x7f702015af20 2023-11-04T01:35:27.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7027e90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200cc380 con 0x7f70200b64c0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7027e90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200d01f0 con 0x7f70200cd3b0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702642d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f70200cd3b0 0x7f70200cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7025c2c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f702015af20 0x7f70200cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58884/0 (socket says 172.21.15.125:58884) 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7025c2c640 1 -- 172.21.15.125:0/58190804 learned_addr learned my addr 172.21.15.125:0/58190804 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702542b640 1 --2- 172.21.15.125:0/58190804 >> v2:172.21.15.93:3300/0 conn(0x7f70200b64c0 0x7f70200b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702642d640 1 -- 172.21.15.125:0/58190804 >> v2:172.21.15.93:3300/0 conn(0x7f70200b64c0 msgr2=0x7f70200b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702642d640 1 --2- 172.21.15.125:0/58190804 >> v2:172.21.15.93:3300/0 conn(0x7f70200b64c0 0x7f70200b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702642d640 1 -- 172.21.15.125:0/58190804 >> v1:172.21.15.125:6789/0 conn(0x7f702015af20 legacy=0x7f70200cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f702642d640 1 -- 172.21.15.125:0/58190804 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200b6a40 con 0x7f70200cd3b0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.961+0000 7f7024c2a640 1 -- 172.21.15.125:0/58190804 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159382560 0 0) 0x7f70200cdd40 con 0x7f702015af20 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.962+0000 7f702642d640 1 --2- 172.21.15.125:0/58190804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200cd3b0 0x7f70200cd800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70200b6950 tx=0x7f701802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f2f1c1c7f3f993 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:27.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.962+0000 7f7024c2a640 1 -- 172.21.15.125:0/58190804 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701802cc80 con 0x7f70200cd3b0 2023-11-04T01:35:27.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.962+0000 7f7024c2a640 1 -- 172.21.15.125:0/58190804 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701802cde0 con 0x7f70200cd3b0 2023-11-04T01:35:27.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.962+0000 7f7024c2a640 1 -- 172.21.15.125:0/58190804 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018034660 con 0x7f70200cd3b0 2023-11-04T01:35:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 -- 172.21.15.125:0/58190804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200cd3b0 msgr2=0x7f70200cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 --2- 172.21.15.125:0/58190804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200cd3b0 0x7f70200cd800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70200b6950 tx=0x7f701802bed0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 -- 172.21.15.125:0/58190804 shutdown_connections 2023-11-04T01:35:27.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 --2- 172.21.15.125:0/58190804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200cd3b0 0x7f70200cd800 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 --2- 172.21.15.125:0/58190804 >> v2:172.21.15.93:3300/0 conn(0x7f70200b64c0 0x7f70200b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 -- 172.21.15.125:0/58190804 >> 172.21.15.125:0/58190804 conn(0x7f702006ea20 msgr2=0x7f702006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:27.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 -- 172.21.15.125:0/58190804 shutdown_connections 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.963+0000 7f7027e90640 1 -- 172.21.15.125:0/58190804 wait complete. 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.964+0000 7f7027e90640 1 Processor -- start 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.964+0000 7f7027e90640 1 -- start start 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 0x7f70201efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f702015af20 0x7f70200c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c65d0 con 0x7f702015af20 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c75b0 con 0x7f70200b64c0 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7027e90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c5720 con 0x7f70200cd3b0 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f702542b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 0x7f70201efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36158/0 (socket says 172.21.15.125:36158) 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 -- 172.21.15.125:0/3064848770 learned_addr learned my addr 172.21.15.125:0/3064848770 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f702642d640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f702015af20 0x7f70200c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 -- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 msgr2=0x7f70201efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 0x7f70201efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 -- 172.21.15.125:0/3064848770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f702015af20 msgr2=0x7f70200c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f702015af20 0x7f70200c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 -- 172.21.15.125:0/3064848770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018009a70 con 0x7f70200b64c0 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f702542b640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 0x7f70201efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.965+0000 7f7025c2c640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f701000c430 tx=0x7f701000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100074e0 con 0x7f70200b64c0 2023-11-04T01:35:27.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010007660 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70201f0380 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010004a20 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70200c5ca0 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f701001d3f0 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.966+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7010013750 con 0x7f70200b64c0 2023-11-04T01:35:27.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.967+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020159f50 con 0x7f70200b64c0 2023-11-04T01:35:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:27.969+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7010013910 con 0x7f70200b64c0 2023-11-04T01:35:28.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.040+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63817301-aed9-4ea9-a7df-508da2bde793", "id": 0} v 0) v1 -- 0x7f7020073050 con 0x7f70200b64c0 2023-11-04T01:35:28.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.045+0000 7f70167fc640 1 -- 172.21.15.125:0/3064848770 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63817301-aed9-4ea9-a7df-508da2bde793", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7010013be0 con 0x7f70200b64c0 2023-11-04T01:35:28.052 INFO:teuthology.orchestra.run.smithi125.stdout:0 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 msgr2=0x7f70200c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f701000c430 tx=0x7f701000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 shutdown_connections 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f702015af20 0x7f70200c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f70200cd3b0 0x7f70201efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 --2- 172.21.15.125:0/3064848770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70200b64c0 0x7f70200c7070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 >> 172.21.15.125:0/3064848770 conn(0x7f702006ea20 msgr2=0x7f702015a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 shutdown_connections 2023-11-04T01:35:28.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.046+0000 7f7027e90640 1 -- 172.21.15.125:0/3064848770 wait complete. 2023-11-04T01:35:28.058 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new ffae6dfb-7bfe-405e-8c01-747a63e544c2 1 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.156+0000 7fee58ee0640 1 Processor -- start 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.156+0000 7fee58ee0640 1 -- start start 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 0x7fee5415f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fee5406cd70 0x7fee5406d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5406d740 con 0x7fee5406cd70 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540ca1a0 con 0x7fee5415aa40 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee58ee0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415f690 con 0x7fee54070f80 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54894/0 (socket says 172.21.15.125:54894) 2023-11-04T01:35:28.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 -- 172.21.15.125:0/3390668128 learned_addr learned my addr 172.21.15.125:0/3390668128 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee5259c640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 0x7fee5415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee4bfff640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.93:3300/0 conn(0x7fee5406cd70 0x7fee5406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 -- 172.21.15.125:0/3390668128 >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 msgr2=0x7fee5415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 0x7fee5415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 -- 172.21.15.125:0/3390668128 >> v2:172.21.15.93:3300/0 conn(0x7fee5406cd70 msgr2=0x7fee5406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.93:3300/0 conn(0x7fee5406cd70 0x7fee5406d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee52d9d640 1 -- 172.21.15.125:0/3390668128 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540ca440 con 0x7fee54070f80 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.157+0000 7fee5259c640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 0x7fee5415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee52d9d640 1 --2- 172.21.15.125:0/3390668128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee540d0120 tx=0x7fee4c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f0d3bacbf8fad5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee51d9b640 1 -- 172.21.15.125:0/3390668128 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c02ca70 con 0x7fee54070f80 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee51d9b640 1 -- 172.21.15.125:0/3390668128 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c02cbd0 con 0x7fee54070f80 2023-11-04T01:35:28.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee51d9b640 1 -- 172.21.15.125:0/3390668128 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0343f0 con 0x7fee54070f80 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 -- 172.21.15.125:0/3390668128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 msgr2=0x7fee540713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 --2- 172.21.15.125:0/3390668128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee540d0120 tx=0x7fee4c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 -- 172.21.15.125:0/3390668128 shutdown_connections 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.93:3300/0 conn(0x7fee5406cd70 0x7fee5406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 --2- 172.21.15.125:0/3390668128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee54070f80 0x7fee540713b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.158+0000 7fee58ee0640 1 --2- 172.21.15.125:0/3390668128 >> v2:172.21.15.125:3300/0 conn(0x7fee5415aa40 0x7fee5415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.159+0000 7fee58ee0640 1 -- 172.21.15.125:0/3390668128 >> 172.21.15.125:0/3390668128 conn(0x7fee540cf140 msgr2=0x7fee540cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.159+0000 7fee58ee0640 1 -- 172.21.15.125:0/3390668128 shutdown_connections 2023-11-04T01:35:28.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.159+0000 7fee58ee0640 1 -- 172.21.15.125:0/3390668128 wait complete. 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.160+0000 7fee58ee0640 1 Processor -- start 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.160+0000 7fee58ee0640 1 -- start start 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.160+0000 7fee58ee0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.160+0000 7fee58ee0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee54070f80 0x7fee540c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 0x7fee540c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54145ad0 con 0x7fee54070f80 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54148af0 con 0x7fee5415aa40 2023-11-04T01:35:28.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c8170 con 0x7fee5406cd70 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54910/0 (socket says 172.21.15.125:54910) 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 -- 172.21.15.125:0/2677066652 learned_addr learned my addr 172.21.15.125:0/2677066652 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee52d9d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 0x7fee540c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4bfff640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee54070f80 0x7fee540c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 -- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 msgr2=0x7fee540c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 0x7fee540c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 -- 172.21.15.125:0/2677066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee54070f80 msgr2=0x7fee540c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee54070f80 0x7fee540c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 -- 172.21.15.125:0/2677066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44009400 con 0x7fee5406cd70 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee52d9d640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 0x7fee540c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee5259c640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee4400ebe0 tx=0x7fee4400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44009760 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400cc30 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c009b30 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400eee0 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540c8730 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee44005c90 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.161+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fee44013930 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.162+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee54065fa0 con 0x7fee5406cd70 2023-11-04T01:35:28.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.166+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fee44021060 con 0x7fee5406cd70 2023-11-04T01:35:28.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.270+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ffae6dfb-7bfe-405e-8c01-747a63e544c2", "id": 1} v 0) v1 -- 0x7fee54073000 con 0x7fee5406cd70 2023-11-04T01:35:28.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.273+0000 7fee4affd640 1 -- 172.21.15.125:0/2677066652 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffae6dfb-7bfe-405e-8c01-747a63e544c2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee44017070 con 0x7fee5406cd70 2023-11-04T01:35:28.275 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 msgr2=0x7fee54147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee4400ebe0 tx=0x7fee4400c520 comp rx=0 tx=0).stop 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 shutdown_connections 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee5415aa40 0x7fee540c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee54070f80 0x7fee540c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 --2- 172.21.15.125:0/2677066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee5406cd70 0x7fee54147890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 >> 172.21.15.125:0/2677066652 conn(0x7fee540cf140 msgr2=0x7fee54071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 shutdown_connections 2023-11-04T01:35:28.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.274+0000 7fee58ee0640 1 -- 172.21.15.125:0/2677066652 wait complete. 2023-11-04T01:35:28.286 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 399b004b-5df2-4fe3-92f3-db3965c8c8cf 2 2023-11-04T01:35:28.360 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.359+0000 7fe76a21d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:35:28.378 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.376+0000 7f850b21d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:35:28.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.384+0000 7fcf668d4640 1 Processor -- start 2023-11-04T01:35:28.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.384+0000 7fcf668d4640 1 -- start start 2023-11-04T01:35:28.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf668d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf668d4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcf6015e590 0x7fcf600722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf668d4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600ca620 con 0x7fcf600b21f0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf668d4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6006e7e0 con 0x7fcf6015e590 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf668d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600cb060 con 0x7fcf6015e1b0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf64e71640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcf600b21f0 0x7fcf6006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58892/0 (socket says 172.21.15.125:58892) 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf64e71640 1 -- 172.21.15.125:0/1098430914 learned_addr learned my addr 172.21.15.125:0/1098430914 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5f7fe640 1 --2- 172.21.15.125:0/1098430914 >> v2:172.21.15.93:3300/0 conn(0x7fcf6015e590 0x7fcf600722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5effd640 1 -- 172.21.15.125:0/1098430914 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323465006 0 0) 0x7fcf600ca620 con 0x7fcf600b21f0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5effd640 1 -- 172.21.15.125:0/1098430914 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003520 con 0x7fcf600b21f0 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5ffff640 1 -- 172.21.15.125:0/1098430914 >> v2:172.21.15.93:3300/0 conn(0x7fcf6015e590 msgr2=0x7fcf600722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:28.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5ffff640 1 --2- 172.21.15.125:0/1098430914 >> v2:172.21.15.93:3300/0 conn(0x7fcf6015e590 0x7fcf600722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5ffff640 1 -- 172.21.15.125:0/1098430914 >> v1:172.21.15.125:6789/0 conn(0x7fcf600b21f0 legacy=0x7fcf6006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.385+0000 7fcf5ffff640 1 -- 172.21.15.125:0/1098430914 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600ca060 con 0x7fcf6015e1b0 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.386+0000 7fcf5ffff640 1 --2- 172.21.15.125:0/1098430914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600ae770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf500097a0 tx=0x7fcf5002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40e87b003a25d72d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.386+0000 7fcf5effd640 1 -- 172.21.15.125:0/1098430914 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5002e070 con 0x7fcf6015e1b0 2023-11-04T01:35:28.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.386+0000 7fcf5effd640 1 -- 172.21.15.125:0/1098430914 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf500315a0 con 0x7fcf6015e1b0 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.386+0000 7fcf5effd640 1 -- 172.21.15.125:0/1098430914 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50031910 con 0x7fcf6015e1b0 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 -- 172.21.15.125:0/1098430914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 msgr2=0x7fcf600ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 --2- 172.21.15.125:0/1098430914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600ae770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf500097a0 tx=0x7fcf5002b840 comp rx=0 tx=0).stop 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 -- 172.21.15.125:0/1098430914 shutdown_connections 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 --2- 172.21.15.125:0/1098430914 >> v2:172.21.15.93:3300/0 conn(0x7fcf6015e590 0x7fcf600722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 --2- 172.21.15.125:0/1098430914 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600ae770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 -- 172.21.15.125:0/1098430914 >> 172.21.15.125:0/1098430914 conn(0x7fcf6006d800 msgr2=0x7fcf6006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 -- 172.21.15.125:0/1098430914 shutdown_connections 2023-11-04T01:35:28.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.387+0000 7fcf668d4640 1 -- 172.21.15.125:0/1098430914 wait complete. 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.389+0000 7fcf668d4640 1 Processor -- start 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.389+0000 7fcf668d4640 1 -- start start 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 0x7fcf60150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf6015e590 0x7fcf6014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601e39b0 con 0x7fcf6015e590 2023-11-04T01:35:28.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601e36d0 con 0x7fcf600b21f0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf668d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60150c80 con 0x7fcf6015e1b0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf5f7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf5ffff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 0x7fcf60150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf5f7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54914/0 (socket says 172.21.15.125:54914) 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf5f7fe640 1 -- 172.21.15.125:0/2417855303 learned_addr learned my addr 172.21.15.125:0/2417855303 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.390+0000 7fcf64e71640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf6015e590 0x7fcf6014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 -- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 msgr2=0x7fcf600c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 -- 172.21.15.125:0/2417855303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf6015e590 msgr2=0x7fcf6014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf6015e590 0x7fcf6014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 -- 172.21.15.125:0/2417855303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009400 con 0x7fcf600b21f0 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5f7fe640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:28.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5ffff640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 0x7fcf60150740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf50033000 tx=0x7fcf500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50042070 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf500044e0 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf600c5c00 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50006e10 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf600c61c0 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf50046070 con 0x7fcf600b21f0 2023-11-04T01:35:28.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.391+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcf50003e40 con 0x7fcf600b21f0 2023-11-04T01:35:28.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.392+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf600c6350 con 0x7fcf600b21f0 2023-11-04T01:35:28.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.394+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcf5004d070 con 0x7fcf600b21f0 2023-11-04T01:35:28.412 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.410+0000 7fe76a21d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:35:28.437 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.432+0000 7f850b21d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:35:28.455 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.454+0000 7fe76a21d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:35:28.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.465+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "399b004b-5df2-4fe3-92f3-db3965c8c8cf", "id": 2} v 0) v1 -- 0x7fcf600b2f30 con 0x7fcf600b21f0 2023-11-04T01:35:28.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.468+0000 7fcf5cff9640 1 -- 172.21.15.125:0/2417855303 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "399b004b-5df2-4fe3-92f3-db3965c8c8cf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf50003a20 con 0x7fcf600b21f0 2023-11-04T01:35:28.475 INFO:teuthology.orchestra.run.smithi125.stdout:2 2023-11-04T01:35:28.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 msgr2=0x7fcf60150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 0x7fcf60150740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf50033000 tx=0x7fcf500046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 shutdown_connections 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf6015e590 0x7fcf6014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf6015e1b0 0x7fcf600c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 --2- 172.21.15.125:0/2417855303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf600b21f0 0x7fcf60150740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.469+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 >> 172.21.15.125:0/2417855303 conn(0x7fcf6006d800 msgr2=0x7fcf600b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.470+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 shutdown_connections 2023-11-04T01:35:28.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.470+0000 7fcf668d4640 1 -- 172.21.15.125:0/2417855303 wait complete. 2023-11-04T01:35:28.483 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 2a2e65c1-4164-4158-bc9a-109001ede685 3 2023-11-04T01:35:28.484 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.480+0000 7f850b21d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:35:28.509 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.508+0000 7fe76a21d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:35:28.538 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.536+0000 7f850b21d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:35:28.550 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.549+0000 7fe76a21d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:35:28.582 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.580+0000 7f850b21d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:35:28.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.581+0000 7f8ff73f5640 1 Processor -- start 2023-11-04T01:35:28.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.581+0000 7f8ff73f5640 1 -- start start 2023-11-04T01:35:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.581+0000 7f8ff73f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8ff01615d0 0x7f8ff00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff73f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff015d6f0 con 0x7f8ff00cdc60 2023-11-04T01:35:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff73f5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff015d9d0 con 0x7f8ff006cd70 2023-11-04T01:35:28.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff73f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff015dcb0 con 0x7f8ff01615d0 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff5191640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8ff006cd70 0x7f8ff006d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58900/0 (socket says 172.21.15.125:58900) 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff5191640 1 -- 172.21.15.125:0/3775603158 learned_addr learned my addr 172.21.15.125:0/3775603158 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff4990640 1 --2- 172.21.15.125:0/3775603158 >> v2:172.21.15.93:3300/0 conn(0x7f8ff01615d0 0x7f8ff00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258593687 0 0) 0x7f8ff015d9d0 con 0x7f8ff006cd70 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fdc003520 con 0x7f8ff006cd70 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965622506 0 0) 0x7f8ff015d6f0 con 0x7f8ff00cdc60 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff015d9d0 con 0x7f8ff00cdc60 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff4990640 1 -- 172.21.15.125:0/3775603158 >> v1:172.21.15.125:6789/0 conn(0x7f8ff006cd70 legacy=0x7f8ff006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff4990640 1 -- 172.21.15.125:0/3775603158 >> v1:172.21.15.93:6789/0 conn(0x7f8ff00cdc60 legacy=0x7f8ff006a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.582+0000 7f8ff4990640 1 -- 172.21.15.125:0/3775603158 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff015df90 con 0x7f8ff01615d0 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.583+0000 7f8ff4990640 1 --2- 172.21.15.125:0/3775603158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff01615d0 0x7f8ff00cd720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00097a0 tx=0x7f8fe002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f09619e25ab6957 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.583+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0031830 con 0x7f8ff01615d0 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.583+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe0031990 con 0x7f8ff01615d0 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.583+0000 7f8fe7fff640 1 -- 172.21.15.125:0/3775603158 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0031d00 con 0x7f8ff01615d0 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 -- 172.21.15.125:0/3775603158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff01615d0 msgr2=0x7f8ff00cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/3775603158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff01615d0 0x7f8ff00cd720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00097a0 tx=0x7f8fe002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 -- 172.21.15.125:0/3775603158 shutdown_connections 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/3775603158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff01615d0 0x7f8ff00cd720 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 -- 172.21.15.125:0/3775603158 >> 172.21.15.125:0/3775603158 conn(0x7f8ff00cf140 msgr2=0x7f8ff00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 -- 172.21.15.125:0/3775603158 shutdown_connections 2023-11-04T01:35:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.584+0000 7f8ff73f5640 1 -- 172.21.15.125:0/3775603158 wait complete. 2023-11-04T01:35:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.585+0000 7f8ff73f5640 1 Processor -- start 2023-11-04T01:35:28.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.585+0000 7f8ff73f5640 1 -- start start 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff00cdc60 0x7f8ff00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff01615d0 0x7f8ff01e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00c45a0 con 0x7f8ff00cdc60 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00b2d00 con 0x7f8ff01615d0 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00c3c70 con 0x7f8ff006cd70 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5992640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff01615d0 0x7f8ff01e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54928/0 (socket says 172.21.15.125:54928) 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 -- 172.21.15.125:0/1366513362 learned_addr learned my addr 172.21.15.125:0/1366513362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff4990640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff00cdc60 0x7f8ff00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 -- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff01615d0 msgr2=0x7f8ff01e67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff01615d0 0x7f8ff01e67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 -- 172.21.15.125:0/1366513362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff00cdc60 msgr2=0x7f8ff00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff00cdc60 0x7f8ff00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 -- 172.21.15.125:0/1366513362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0009400 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff5191640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c500 tx=0x7f8fec00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005ce0 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec005e60 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff00c3f50 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.586+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec007330 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.587+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff00b2a10 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.587+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8fec01c440 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.587+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8fec01cb80 con 0x7f8ff006cd70 2023-11-04T01:35:28.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.588+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff006da30 con 0x7f8ff006cd70 2023-11-04T01:35:28.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.591+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8fec017070 con 0x7f8ff006cd70 2023-11-04T01:35:28.651 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.649+0000 7fe76a21d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:35:28.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.661+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2a2e65c1-4164-4158-bc9a-109001ede685", "id": 3} v 0) v1 -- 0x7f8ff00b4e30 con 0x7f8ff006cd70 2023-11-04T01:35:28.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.665+0000 7f8fe5ffb640 1 -- 172.21.15.125:0/1366513362 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a2e65c1-4164-4158-bc9a-109001ede685", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8fec01c7c0 con 0x7f8ff006cd70 2023-11-04T01:35:28.669 INFO:teuthology.orchestra.run.smithi125.stdout:3 2023-11-04T01:35:28.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 msgr2=0x7f8ff00c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c500 tx=0x7f8fec00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 shutdown_connections 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff01615d0 0x7f8ff01e67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff00cdc60 0x7f8ff00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 --2- 172.21.15.125:0/1366513362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff006cd70 0x7f8ff00c5c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 >> 172.21.15.125:0/1366513362 conn(0x7f8ff00cf140 msgr2=0x7f8ff00aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 shutdown_connections 2023-11-04T01:35:28.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.666+0000 7f8ff73f5640 1 -- 172.21.15.125:0/1366513362 wait complete. 2023-11-04T01:35:28.678 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 91bebbf7-e2ad-42f0-b9fc-6d6f4566803a 4 2023-11-04T01:35:28.689 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.686+0000 7f850b21d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:35:28.723 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.720+0000 7fe76a21d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:28.761 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.759+0000 7f850b21d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:28.766 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.765+0000 7fe76a21d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:35:28.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.775+0000 7f3ce6210640 1 Processor -- start 2023-11-04T01:35:28.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.775+0000 7f3ce6210640 1 -- start start 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3ce6210640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ce006a830 0x7f3ce00b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3ce6210640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00cdf80 con 0x7f3ce00722a0 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3ce6210640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce0072710 con 0x7f3ce01603d0 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3ce6210640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00b19d0 con 0x7f3ce006a830 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3cd6ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ce006a830 0x7f3ce00b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3cd6ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ce006a830 0x7f3ce00b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36200/0 (socket says 172.21.15.125:36200) 2023-11-04T01:35:28.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3cd6ffd640 1 -- 172.21.15.125:0/421070294 learned_addr learned my addr 172.21.15.125:0/421070294 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.776+0000 7f3cdf7fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3ce01603d0 0x7f3ce006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58916/0 (socket says 172.21.15.125:58916) 2023-11-04T01:35:28.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cd6ffd640 1 -- 172.21.15.125:0/421070294 >> v1:172.21.15.125:6789/0 conn(0x7f3ce01603d0 legacy=0x7f3ce006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cd6ffd640 1 -- 172.21.15.125:0/421070294 >> v1:172.21.15.93:6789/0 conn(0x7f3ce00722a0 legacy=0x7f3ce00ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cd6ffd640 1 -- 172.21.15.125:0/421070294 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00ce6f0 con 0x7f3ce006a830 2023-11-04T01:35:28.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cd6ffd640 1 --2- 172.21.15.125:0/421070294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce006a830 0x7f3ce00b1490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=854326d4624a0984 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cdeffd640 1 -- 172.21.15.125:0/421070294 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8030860 con 0x7f3ce006a830 2023-11-04T01:35:28.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cdeffd640 1 -- 172.21.15.125:0/421070294 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80309c0 con 0x7f3ce006a830 2023-11-04T01:35:28.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.777+0000 7f3cdeffd640 1 -- 172.21.15.125:0/421070294 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8030d50 con 0x7f3ce006a830 2023-11-04T01:35:28.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 -- 172.21.15.125:0/421070294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce006a830 msgr2=0x7f3ce00b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 --2- 172.21.15.125:0/421070294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce006a830 0x7f3ce00b1490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 -- 172.21.15.125:0/421070294 shutdown_connections 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 --2- 172.21.15.125:0/421070294 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce006a830 0x7f3ce00b1490 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 -- 172.21.15.125:0/421070294 >> 172.21.15.125:0/421070294 conn(0x7f3ce006d800 msgr2=0x7f3ce006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 -- 172.21.15.125:0/421070294 shutdown_connections 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.778+0000 7f3ce6210640 1 -- 172.21.15.125:0/421070294 wait complete. 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.779+0000 7f3ce6210640 1 Processor -- start 2023-11-04T01:35:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.779+0000 7f3ce6210640 1 -- start start 2023-11-04T01:35:28.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ce006a830 0x7f3ce00b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00cbac0 con 0x7f3ce006a830 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b2ab0 con 0x7f3ce01603d0 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3ce6210640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00cb500 con 0x7f3ce00722a0 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cd6ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36202/0 (socket says 172.21.15.125:36202) 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cd6ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54940/0 (socket says 172.21.15.125:54940) 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cdffff640 1 -- 172.21.15.125:0/2631044182 learned_addr learned my addr 172.21.15.125:0/2631044182 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.780+0000 7f3cdf7fe640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ce006a830 0x7f3ce00b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 -- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 msgr2=0x7f3ce0148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 -- 172.21.15.125:0/2631044182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ce006a830 msgr2=0x7f3ce00b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ce006a830 0x7f3ce00b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 -- 172.21.15.125:0/2631044182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80094d0 con 0x7f3ce01603d0 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cd6ffd640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:28.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdffff640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c7a0 tx=0x7f3cd800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8003b70 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8003cf0 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce00cb7e0 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8003ea0 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00c49d0 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3cd80050d0 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.781+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3cd8012980 con 0x7f3ce01603d0 2023-11-04T01:35:28.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.782+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce00c4550 con 0x7f3ce01603d0 2023-11-04T01:35:28.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.784+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3ce00c4550 con 0x7f3ce01603d0 2023-11-04T01:35:28.818 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.817+0000 7fe76a21d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:35:28.825 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.823+0000 7f850b21d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:35:28.865 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:28.864+0000 7fe76a21d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:35:28.889 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.887+0000 7f850b21d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:35:28.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.891+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91bebbf7-e2ad-42f0-b9fc-6d6f4566803a", "id": 4} v 0) v1 -- 0x7f3ce00c4bc0 con 0x7f3ce01603d0 2023-11-04T01:35:28.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.894+0000 7f3cdcff9640 1 -- 172.21.15.125:0/2631044182 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91bebbf7-e2ad-42f0-b9fc-6d6f4566803a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cd8005560 con 0x7f3ce01603d0 2023-11-04T01:35:28.898 INFO:teuthology.orchestra.run.smithi125.stdout:4 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 msgr2=0x7f3ce00c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c7a0 tx=0x7f3cd800cc60 comp rx=0 tx=0).stop 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 shutdown_connections 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce01603d0 0x7f3ce00c8c90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ce00722a0 0x7f3ce0148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 --2- 172.21.15.125:0/2631044182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ce006a830 0x7f3ce00b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 >> 172.21.15.125:0/2631044182 conn(0x7f3ce006d800 msgr2=0x7f3ce00cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 shutdown_connections 2023-11-04T01:35:28.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:28.895+0000 7f3ce6210640 1 -- 172.21.15.125:0/2631044182 wait complete. 2023-11-04T01:35:28.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new f4abe089-5616-4c4e-bf2b-c9514a0ed20e 5 2023-11-04T01:35:28.939 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:28.937+0000 7f850b21d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:35:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.035+0000 7f868e10f640 1 Processor -- start 2023-11-04T01:35:29.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.035+0000 7f868e10f640 1 -- start start 2023-11-04T01:35:29.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f868e10f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f868e10f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f868e10f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880b1cc0 con 0x7f868815add0 2023-11-04T01:35:29.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f868e10f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86880b1fa0 con 0x7f8688072370 2023-11-04T01:35:29.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f868e10f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868815a0e0 con 0x7f8688071f90 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f8687fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54944/0 (socket says 172.21.15.125:54944) 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 -- 172.21.15.125:0/4281510444 learned_addr learned my addr 172.21.15.125:0/4281510444 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f8687fff640 1 --2- 172.21.15.125:0/4281510444 >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36208/0 (socket says 172.21.15.125:36208) 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 -- 172.21.15.125:0/4281510444 >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 msgr2=0x7f86880cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 --2- 172.21.15.125:0/4281510444 >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 -- 172.21.15.125:0/4281510444 >> v1:172.21.15.93:6789/0 conn(0x7f868815add0 legacy=0x7f86880cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f86877fe640 1 -- 172.21.15.125:0/4281510444 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868815a2f0 con 0x7f8688071f90 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.036+0000 7f8687fff640 1 --2- 172.21.15.125:0/4281510444 >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:29.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.037+0000 7f86877fe640 1 --2- 172.21.15.125:0/4281510444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f867c00bb10 tx=0x7f867c02e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9becba5fb5cf6b3c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.037+0000 7f86867fc640 1 -- 172.21.15.125:0/4281510444 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c036440 con 0x7f8688071f90 2023-11-04T01:35:29.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.037+0000 7f86867fc640 1 -- 172.21.15.125:0/4281510444 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0365a0 con 0x7f8688071f90 2023-11-04T01:35:29.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.037+0000 7f86867fc640 1 -- 172.21.15.125:0/4281510444 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c036930 con 0x7f8688071f90 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 -- 172.21.15.125:0/4281510444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 msgr2=0x7f86880b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 --2- 172.21.15.125:0/4281510444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f867c00bb10 tx=0x7f867c02e150 comp rx=0 tx=0).stop 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 -- 172.21.15.125:0/4281510444 shutdown_connections 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 --2- 172.21.15.125:0/4281510444 >> v2:172.21.15.125:3300/0 conn(0x7f8688072370 0x7f86880cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 --2- 172.21.15.125:0/4281510444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8688071f90 0x7f86880b1490 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 -- 172.21.15.125:0/4281510444 >> 172.21.15.125:0/4281510444 conn(0x7f868806d800 msgr2=0x7f868806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 -- 172.21.15.125:0/4281510444 shutdown_connections 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.038+0000 7f868e10f640 1 -- 172.21.15.125:0/4281510444 wait complete. 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.039+0000 7f868e10f640 1 Processor -- start 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.039+0000 7f868e10f640 1 -- start start 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8688071f90 0x7f8688146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b25f0 con 0x7f8688071f90 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b3f20 con 0x7f8688072370 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f868e10f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b3960 con 0x7f868815add0 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8686ffd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8686ffd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36216/0 (socket says 172.21.15.125:36216) 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54946/0 (socket says 172.21.15.125:54946) 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8686ffd640 1 -- 172.21.15.125:0/2070102407 learned_addr learned my addr 172.21.15.125:0/2070102407 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f86877fe640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8688071f90 0x7f8688146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 -- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 msgr2=0x7f86880b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 -- 172.21.15.125:0/2070102407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8688071f90 msgr2=0x7f8688146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8688071f90 0x7f8688146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 -- 172.21.15.125:0/2070102407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009a70 con 0x7f868815add0 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8686ffd640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.040+0000 7f8687fff640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f868000efc0 tx=0x7f868000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000cd30 con 0x7f868815add0 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868000f040 con 0x7f868815add0 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c00b770 con 0x7f868815add0 2023-11-04T01:35:29.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680003bd0 con 0x7f868815add0 2023-11-04T01:35:29.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880b2210 con 0x7f868815add0 2023-11-04T01:35:29.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8680014780 con 0x7f868815add0 2023-11-04T01:35:29.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.041+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f868001ddf0 con 0x7f868815add0 2023-11-04T01:35:29.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.042+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880b2730 con 0x7f868815add0 2023-11-04T01:35:29.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.044+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f86880b2730 con 0x7f868815add0 2023-11-04T01:35:29.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.113+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f4abe089-5616-4c4e-bf2b-c9514a0ed20e", "id": 5} v 0) v1 -- 0x7f86880ca7f0 con 0x7f868815add0 2023-11-04T01:35:29.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.117+0000 7f866ffff640 1 -- 172.21.15.125:0/2070102407 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4abe089-5616-4c4e-bf2b-c9514a0ed20e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8680018030 con 0x7f868815add0 2023-11-04T01:35:29.120 INFO:teuthology.orchestra.run.smithi125.stdout:5 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.117+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 msgr2=0x7f86880c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.117+0000 7f868e10f640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f868000efc0 tx=0x7f868000c490 comp rx=0 tx=0).stop 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.117+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 shutdown_connections 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f868815add0 0x7f86880c6ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8688072370 0x7f86880b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 --2- 172.21.15.125:0/2070102407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8688071f90 0x7f8688146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 >> 172.21.15.125:0/2070102407 conn(0x7f868806d800 msgr2=0x7f868815d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 shutdown_connections 2023-11-04T01:35:29.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.118+0000 7f868e10f640 1 -- 172.21.15.125:0/2070102407 wait complete. 2023-11-04T01:35:29.130 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new dc032167-826d-4ac0-bc13-72d87a93f915 6 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.227+0000 7f57962b0640 1 Processor -- start 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.227+0000 7f57962b0640 1 -- start start 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.227+0000 7f57962b0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5790072370 0x7f57900cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.227+0000 7f57962b0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900b1cc0 con 0x7f579015add0 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f57962b0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579015a2f0 con 0x7f5790071f90 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f57962b0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900b1fa0 con 0x7f5790072370 2023-11-04T01:35:29.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5790072370 0x7f57900cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5790072370 0x7f57900cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36232/0 (socket says 172.21.15.125:36232) 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f578ffff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5790071f90 0x7f57900b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58932/0 (socket says 172.21.15.125:58932) 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 -- 172.21.15.125:0/1519805687 learned_addr learned my addr 172.21.15.125:0/1519805687 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 -- 172.21.15.125:0/1519805687 >> v1:172.21.15.125:6789/0 conn(0x7f5790071f90 legacy=0x7f57900b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 -- 172.21.15.125:0/1519805687 >> v1:172.21.15.93:6789/0 conn(0x7f579015add0 legacy=0x7f57900cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.228+0000 7f579484d640 1 -- 172.21.15.125:0/1519805687 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579015a5d0 con 0x7f5790072370 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f579484d640 1 --2- 172.21.15.125:0/1519805687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f57900cf3d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e50 tx=0x7f578802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d935a8d43eeafa38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f578effd640 1 -- 172.21.15.125:0/1519805687 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578802cbb0 con 0x7f5790072370 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f578effd640 1 -- 172.21.15.125:0/1519805687 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578802cd10 con 0x7f5790072370 2023-11-04T01:35:29.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f578effd640 1 -- 172.21.15.125:0/1519805687 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788034610 con 0x7f5790072370 2023-11-04T01:35:29.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 -- 172.21.15.125:0/1519805687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 msgr2=0x7f57900cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 --2- 172.21.15.125:0/1519805687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f57900cf3d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5788009e50 tx=0x7f578802c010 comp rx=0 tx=0).stop 2023-11-04T01:35:29.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 -- 172.21.15.125:0/1519805687 shutdown_connections 2023-11-04T01:35:29.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 --2- 172.21.15.125:0/1519805687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f57900cf3d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 -- 172.21.15.125:0/1519805687 >> 172.21.15.125:0/1519805687 conn(0x7f579006d800 msgr2=0x7f579006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 -- 172.21.15.125:0/1519805687 shutdown_connections 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.229+0000 7f57962b0640 1 -- 172.21.15.125:0/1519805687 wait complete. 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 Processor -- start 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 -- start start 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 0x7f57900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f579015add0 0x7f57900c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c74f0 con 0x7f579015add0 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c8500 con 0x7f5790072370 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.231+0000 7f57962b0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c9080 con 0x7f5790071f90 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 0x7f57900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36238/0 (socket says 172.21.15.125:36238) 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 -- 172.21.15.125:0/3243219083 learned_addr learned my addr 172.21.15.125:0/3243219083 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f579484d640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f579015add0 0x7f57900c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 -- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 msgr2=0x7f57900c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 0x7f57900c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 -- 172.21.15.125:0/3243219083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f579015add0 msgr2=0x7f57900c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f579015add0 0x7f57900c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 -- 172.21.15.125:0/3243219083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009b30 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578ffff640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 0x7f57900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578f7fe640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f578400c400 tx=0x7f578400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840052d0 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784005430 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900c7740 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784003830 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.232+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900c7d00 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.233+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5784003c90 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.233+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57900cd280 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.233+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5784011b80 con 0x7f5790072370 2023-11-04T01:35:29.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.237+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5784021060 con 0x7f5790072370 2023-11-04T01:35:29.247 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.240+0000 7fe76a21d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:35:29.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.308+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc032167-826d-4ac0-bc13-72d87a93f915", "id": 6} v 0) v1 -- 0x7f57900cea70 con 0x7f5790072370 2023-11-04T01:35:29.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.312+0000 7f578cff9640 1 -- 172.21.15.125:0/3243219083 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc032167-826d-4ac0-bc13-72d87a93f915", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5784017070 con 0x7f5790072370 2023-11-04T01:35:29.314 INFO:teuthology.orchestra.run.smithi125.stdout:6 2023-11-04T01:35:29.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 msgr2=0x7f5790145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f578400c400 tx=0x7f578400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 shutdown_connections 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f579015add0 0x7f57900c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5790072370 0x7f5790145da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 --2- 172.21.15.125:0/3243219083 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5790071f90 0x7f57900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 >> 172.21.15.125:0/3243219083 conn(0x7f579006d800 msgr2=0x7f579015d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 shutdown_connections 2023-11-04T01:35:29.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.313+0000 7f57962b0640 1 -- 172.21.15.125:0/3243219083 wait complete. 2023-11-04T01:35:29.329 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd new 1b77cc47-cb40-47b4-aa7e-fdf668b39977 7 2023-11-04T01:35:29.336 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.334+0000 7f850b21d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:35:29.375 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.374+0000 7fe76a21d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:35:29.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.427+0000 7f01e5210640 1 Processor -- start 2023-11-04T01:35:29.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.427+0000 7f01e5210640 1 -- start start 2023-11-04T01:35:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01e5210640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 0x7f01e00b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01e5210640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01e5210640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00cdf80 con 0x7f01e006a660 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01e5210640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e00b19d0 con 0x7f01e01603d0 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01e5210640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e006aaf0 con 0x7f01e00722a0 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01df59e640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f01e006a660 0x7f01e0160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58942/0 (socket says 172.21.15.125:58942) 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01df59e640 1 -- 172.21.15.125:0/3372235323 learned_addr learned my addr 172.21.15.125:0/3372235323 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.428+0000 7f01d7fff640 1 --2- 172.21.15.125:0/3372235323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54954/0 (socket says 172.21.15.125:54954) 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01ded9d640 1 --2- 172.21.15.125:0/3372235323 >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 0x7f01e00b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01d7fff640 1 -- 172.21.15.125:0/3372235323 >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 msgr2=0x7f01e00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01d7fff640 1 --2- 172.21.15.125:0/3372235323 >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 0x7f01e00b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01de59c640 1 -- 172.21.15.125:0/3372235323 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337972265 0 0) 0x7f01e00cdf80 con 0x7f01e006a660 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01d7fff640 1 -- 172.21.15.125:0/3372235323 >> v1:172.21.15.125:6789/0 conn(0x7f01e006a660 legacy=0x7f01e0160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01d7fff640 1 -- 172.21.15.125:0/3372235323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e00ce6f0 con 0x7f01e00722a0 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01ded9d640 1 --2- 172.21.15.125:0/3372235323 >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 0x7f01e00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.429+0000 7f01d7fff640 1 --2- 172.21.15.125:0/3372235323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01c80097a0 tx=0x7f01c802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79501d09103a564 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01de59c640 1 -- 172.21.15.125:0/3372235323 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c802e070 con 0x7f01e00722a0 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01de59c640 1 -- 172.21.15.125:0/3372235323 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80315a0 con 0x7f01e00722a0 2023-11-04T01:35:29.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01de59c640 1 -- 172.21.15.125:0/3372235323 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8031930 con 0x7f01e00722a0 2023-11-04T01:35:29.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 -- 172.21.15.125:0/3372235323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 msgr2=0x7f01e006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 --2- 172.21.15.125:0/3372235323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01c80097a0 tx=0x7f01c802b840 comp rx=0 tx=0).stop 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 -- 172.21.15.125:0/3372235323 shutdown_connections 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 --2- 172.21.15.125:0/3372235323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e00722a0 0x7f01e006a120 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 --2- 172.21.15.125:0/3372235323 >> v2:172.21.15.93:3300/0 conn(0x7f01e01603d0 0x7f01e00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 -- 172.21.15.125:0/3372235323 >> 172.21.15.125:0/3372235323 conn(0x7f01e006d800 msgr2=0x7f01e006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 -- 172.21.15.125:0/3372235323 shutdown_connections 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.430+0000 7f01e5210640 1 -- 172.21.15.125:0/3372235323 wait complete. 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 Processor -- start 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 -- start start 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e006a660 0x7f01e00c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e00722a0 0x7f01e0148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0152230 con 0x7f01e00722a0 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00c5d50 con 0x7f01e006a660 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01e5210640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00c3a20 con 0x7f01e01603d0 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01df59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01ded9d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e006a660 0x7f01e00c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01df59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.125:54964/0 (socket says 172.21.15.125:54964) 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.432+0000 7f01df59e640 1 -- 172.21.15.125:0/3571698654 learned_addr learned my addr 172.21.15.125:0/3571698654 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d7fff640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e00722a0 0x7f01e0148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 -- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e006a660 msgr2=0x7f01e00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e006a660 0x7f01e00c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 -- 172.21.15.125:0/3571698654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e00722a0 msgr2=0x7f01e0148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e00722a0 0x7f01e0148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 -- 172.21.15.125:0/3571698654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009400 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01df59e640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c7e0 tx=0x7f01d800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d800a640 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d800a7c0 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e00c3d00 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d800ab70 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e00c42c0 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f01d80070d0 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.433+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f01d8012a60 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.434+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e00c2c80 con 0x7f01e01603d0 2023-11-04T01:35:29.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.436+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f01d8018070 con 0x7f01e01603d0 2023-11-04T01:35:29.479 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.475+0000 7f850b21d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:35:29.503 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.499+0000 7fe76a21d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:35:29.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.507+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1b77cc47-cb40-47b4-aa7e-fdf668b39977", "id": 7} v 0) v1 -- 0x7f01e00b5990 con 0x7f01e01603d0 2023-11-04T01:35:29.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.511+0000 7f01d77fe640 1 -- 172.21.15.125:0/3571698654 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b77cc47-cb40-47b4-aa7e-fdf668b39977", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01d8012530 con 0x7f01e01603d0 2023-11-04T01:35:29.513 INFO:teuthology.orchestra.run.smithi125.stdout:7 2023-11-04T01:35:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.511+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 msgr2=0x7f01e015aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.511+0000 7f01e5210640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c7e0 tx=0x7f01d800cca0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 shutdown_connections 2023-11-04T01:35:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e01603d0 0x7f01e015aa70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e00722a0 0x7f01e0148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 --2- 172.21.15.125:0/3571698654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e006a660 0x7f01e00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 >> 172.21.15.125:0/3571698654 conn(0x7f01e006d800 msgr2=0x7f01e00cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 shutdown_connections 2023-11-04T01:35:29.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:35:29.512+0000 7f01e5210640 1 -- 172.21.15.125:0/3571698654 wait complete. 2023-11-04T01:35:29.524 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:35:29.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:35:29.526 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:35:29.526 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:35:29.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:35:29.528 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:35:29.529 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:35:29.536 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:35:29.538 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:35:29.538 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:35:29.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:35:29.550 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.548+0000 7fe76a21d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:35:29.551 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:35:29.551 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:35:29.551 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:35:29.566 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:35:29.566 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:35:29.567 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:35:29.569 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:35:29.569 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:35:29.569 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:35:29.578 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:35:29.578 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:35:29.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:35:29.582 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:35:29.582 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:29.631 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.630+0000 7f850b21d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:35:29.665 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.664+0000 7fe76a21d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:29.687 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.687+0000 7f850b21d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:35:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.696+0000 7f49708f3640 1 Processor -- start 2023-11-04T01:35:29.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.696+0000 7f49708f3640 1 -- start start 2023-11-04T01:35:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f49708f3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f496c15e1c0 0x7f496c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f49708f3640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cd250 con 0x7f496c0b3da0 2023-11-04T01:35:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f49708f3640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0b1b80 con 0x7f496c0b14a0 2023-11-04T01:35:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f49708f3640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0b1e60 con 0x7f496c15e1c0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f496ad9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f496c0b3da0 0x7f496c0ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56412/0 (socket says 172.21.15.93:56412) 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f496ad9d640 1 -- 172.21.15.93:0/2694356150 learned_addr learned my addr 172.21.15.93:0/2694356150 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f496a59c640 1 --2- 172.21.15.93:0/2694356150 >> v2:172.21.15.125:3300/0 conn(0x7f496c15e1c0 0x7f496c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291606176 0 0) 0x7f496c0cd250 con 0x7f496c0b3da0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4958003520 con 0x7f496c0b3da0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824973147 0 0) 0x7f496c0b1b80 con 0x7f496c0b14a0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f496c0cd250 con 0x7f496c0b14a0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 222908116 0 0) 0x7f4958003520 con 0x7f496c0b3da0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 >> v2:172.21.15.125:3300/0 conn(0x7f496c15e1c0 msgr2=0x7f496c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 --2- 172.21.15.93:0/2694356150 >> v2:172.21.15.125:3300/0 conn(0x7f496c15e1c0 0x7f496c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 >> v1:172.21.15.125:6789/0 conn(0x7f496c0b14a0 legacy=0x7f496c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0b2140 con 0x7f496c0b3da0 2023-11-04T01:35:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f49640019f0 con 0x7f496c0b3da0 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 >> v1:172.21.15.93:6789/0 conn(0x7f496c0b3da0 legacy=0x7f496c0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4958003b00 0x7f4958003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0b1e60 con 0x7f49580047c0 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c000 con 0x7f4958003b00 2023-11-04T01:35:29.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c1c0 con 0x7f4958005180 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f496a59c640 1 --2- 172.21.15.93:0/2694356150 >> v2:172.21.15.125:3300/0 conn(0x7f496c15e1c0 0x7f496c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.697+0000 7f4963fff640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f496ad9d640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f496a59c640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4958003b00 0x7f4958003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 -- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958005180 msgr2=0x7f495800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 -- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4958003b00 msgr2=0x7f4958003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4958003b00 0x7f4958003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f496ad9d640 1 -- 172.21.15.93:0/2694356150 reap_dead start 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 -- 172.21.15.93:0/2694356150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958003520 con 0x7f49580047c0 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f496a59c640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4958003b00 0x7f4958003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.698+0000 7f4963fff640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 0x7f4958004c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49540018c0 tx=0x7f49580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03503392ffc6f1f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540052d0 con 0x7f49580047c0 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954005450 con 0x7f49580047c0 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f4969d9b640 1 -- 172.21.15.93:0/2694356150 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954003830 con 0x7f49580047c0 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 -- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 msgr2=0x7f4958004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 0x7f4958004c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49540018c0 tx=0x7f49580057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 -- 172.21.15.93:0/2694356150 shutdown_connections 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 --2- 172.21.15.93:0/2694356150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 -- 172.21.15.93:0/2694356150 >> 172.21.15.93:0/2694356150 conn(0x7f496c06d8b0 msgr2=0x7f496c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 -- 172.21.15.93:0/2694356150 shutdown_connections 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.699+0000 7f49708f3640 1 -- 172.21.15.93:0/2694356150 wait complete. 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 Processor -- start 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 -- start start 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f496c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f496c0c3bb0 0x7f496c0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c95c0 con 0x7f496c1515b0 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c4570 con 0x7f49580047c0 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f49708f3640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c151a30 con 0x7f496c0c3bb0 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f4963fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f4963fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40636/0 (socket says 172.21.15.93:40636) 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f4963fff640 1 -- 172.21.15.93:0/2685309698 learned_addr learned my addr 172.21.15.93:0/2685309698 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f496a59c640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f496c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.701+0000 7f496ad9d640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f496c0c3bb0 0x7f496c0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 -- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f496c0c3bb0 msgr2=0x7f496c0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f496c0c3bb0 0x7f496c0c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 -- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 msgr2=0x7f496c0c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f496c0c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 -- 172.21.15.93:0/2685309698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0c8dd0 con 0x7f496c1515b0 2023-11-04T01:35:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4963fff640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4954005040 tx=0x7f49540012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:29.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540052e0 con 0x7f496c1515b0 2023-11-04T01:35:29.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954007050 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540073c0 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c15ac50 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c0c92e0 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f49540067d0 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.702+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4954033b00 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.703+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c0cc220 con 0x7f496c1515b0 2023-11-04T01:35:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.705+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4954042020 con 0x7f496c1515b0 2023-11-04T01:35:29.765 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.764+0000 7fe76a21d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:35:29.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.765+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f496c15ade0 con 0x7f496c1515b0 2023-11-04T01:35:29.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.765+0000 7f4962ffd640 1 -- 172.21.15.93:0/2685309698 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f49540014e0 con 0x7f496c1515b0 2023-11-04T01:35:29.767 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:29.767 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":10,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:29.509599+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 msgr2=0x7f496c0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4954005040 tx=0x7f49540012d0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 shutdown_connections 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f496c0c3bb0 0x7f496c0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f496c1515b0 0x7f496c0c8890 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 --2- 172.21.15.93:0/2685309698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f496c0c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:29.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 >> 172.21.15.93:0/2685309698 conn(0x7f496c06d8b0 msgr2=0x7f496c15d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:29.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 shutdown_connections 2023-11-04T01:35:29.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:29.766+0000 7f49708f3640 1 -- 172.21.15.93:0/2685309698 wait complete. 2023-11-04T01:35:29.778 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:35:29.779 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:35:29.786 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.785+0000 7f850b21d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:29.880 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:29.879+0000 7f850b21d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:35:29.910 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.908+0000 7fe76a21d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:29.951 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:29.950+0000 7fe76a21d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:30.018 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:30.017+0000 7f850b21d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:35:30.060 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:30.059+0000 7f850b21d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:35:30.092 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:30.090+0000 7fe76a21d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:35:30.135 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:35:30.130+0000 7fb3ea08c500 -1 Falling back to public interface 2023-11-04T01:35:30.135 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:35:30.134+0000 7fdb1f210500 -1 Falling back to public interface 2023-11-04T01:35:30.154 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:35:30.153+0000 7fd98c0a5500 -1 Falling back to public interface 2023-11-04T01:35:30.171 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:35:30.170+0000 7fb5bd39b500 -1 Falling back to public interface 2023-11-04T01:35:30.172 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:35:30.171+0000 7fe56c4c9500 -1 Falling back to public interface 2023-11-04T01:35:30.172 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:35:30.172+0000 7f997da1d500 -1 Falling back to public interface 2023-11-04T01:35:30.179 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:35:30.175+0000 7f4acb20c500 -1 Falling back to public interface 2023-11-04T01:35:30.182 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:35:30.181+0000 7fa72ae12500 -1 Falling back to public interface 2023-11-04T01:35:30.207 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:30.204+0000 7f850b21d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:35:30.585 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:30.676 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.674+0000 7f7ed33cc640 1 Processor -- start 2023-11-04T01:35:30.676 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.674+0000 7f7ed33cc640 1 -- start start 2023-11-04T01:35:30.677 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed33cc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ecc0cd600 0x7f7ecc0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:30.677 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed33cc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:30.677 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed33cc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0b63e0 con 0x7f7ecc15ade0 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed33cc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cc2f0 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed33cc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cdfb0 con 0x7f7ecc0cd600 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed1969640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed1969640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40650/0 (socket says 172.21.15.93:40650) 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed1969640 1 -- 172.21.15.93:0/3791158092 learned_addr learned my addr 172.21.15.93:0/3791158092 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.675+0000 7f7ed0967640 1 --2- 172.21.15.93:0/3791158092 >> v2:172.21.15.125:3300/0 conn(0x7f7ecc0cd600 0x7f7ecc0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.676+0000 7f7ed1969640 1 -- 172.21.15.93:0/3791158092 >> v2:172.21.15.125:3300/0 conn(0x7f7ecc0cd600 msgr2=0x7f7ecc0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.676+0000 7f7ed1969640 1 --2- 172.21.15.93:0/3791158092 >> v2:172.21.15.125:3300/0 conn(0x7f7ecc0cd600 0x7f7ecc0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.676+0000 7f7ed1969640 1 -- 172.21.15.93:0/3791158092 >> v1:172.21.15.125:6789/0 conn(0x7f7ecc15ade0 legacy=0x7f7ecc0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.676+0000 7f7ed1969640 1 -- 172.21.15.93:0/3791158092 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0cb240 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.678 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.676+0000 7f7ec3fff640 1 -- 172.21.15.93:0/3791158092 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279160241 0 0) 0x7f7ecc0b63e0 con 0x7f7ecc15ade0 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.677+0000 7f7ed1969640 1 --2- 172.21.15.93:0/3791158092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0d0ba0 tx=0x7f7ec402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ae8054b23f07b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.677+0000 7f7ec3fff640 1 -- 172.21.15.93:0/3791158092 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec402cb20 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.677+0000 7f7ec3fff640 1 -- 172.21.15.93:0/3791158092 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec402cc80 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.677+0000 7f7ec3fff640 1 -- 172.21.15.93:0/3791158092 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40343f0 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 -- 172.21.15.93:0/3791158092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc0ce8c0 msgr2=0x7f7ecc0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/3791158092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0d0ba0 tx=0x7f7ec402bf80 comp rx=0 tx=0).stop 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 -- 172.21.15.93:0/3791158092 shutdown_connections 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/3791158092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc0cecf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/3791158092 >> v2:172.21.15.125:3300/0 conn(0x7f7ecc0cd600 0x7f7ecc0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 -- 172.21.15.93:0/3791158092 >> 172.21.15.93:0/3791158092 conn(0x7f7ecc06ea40 msgr2=0x7f7ecc06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:30.680 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 -- 172.21.15.93:0/3791158092 shutdown_connections 2023-11-04T01:35:30.681 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.678+0000 7f7ed33cc640 1 -- 172.21.15.93:0/3791158092 wait complete. 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.679+0000 7f7ed33cc640 1 Processor -- start 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.679+0000 7f7ed33cc640 1 -- start start 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ecc0cd600 0x7f7ecc154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:30.683 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cab20 con 0x7f7ecc15ade0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c9a80 con 0x7f7ecc0ce8c0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c9d60 con 0x7f7ecc0cd600 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40666/0 (socket says 172.21.15.93:40666) 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 -- 172.21.15.93:0/614843642 learned_addr learned my addr 172.21.15.93:0/614843642 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed0967640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1168640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ecc0cd600 0x7f7ecc154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 -- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ecc0cd600 msgr2=0x7f7ecc154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ecc0cd600 0x7f7ecc154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 -- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ecc0ce8c0 msgr2=0x7f7ecc1f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc1f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 -- 172.21.15.93:0/614843642 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009b30 con 0x7f7ecc15ade0 2023-11-04T01:35:30.684 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed1969640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4036040 tx=0x7f7ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4009510 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4007e20 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec403e450 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.680+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0ca040 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.681+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc0ca600 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.681+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ec403e8b0 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.681+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7ec4048e00 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.682+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc0b5c00 con 0x7f7ecc15ade0 2023-11-04T01:35:30.685 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.684+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7ec4043030 con 0x7f7ecc15ade0 2023-11-04T01:35:30.745 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.744+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc04e490 con 0x7f7ecc15ade0 2023-11-04T01:35:30.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.744+0000 7f7ec1ffb640 1 -- 172.21.15.93:0/614843642 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7ec403ed40 con 0x7f7ecc15ade0 2023-11-04T01:35:30.746 INFO:teuthology.misc.health.smithi093.stdout: 2023-11-04T01:35:30.746 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":10,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:29.509599+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 msgr2=0x7f7ecc1f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4036040 tx=0x7f7ec4004a40 comp rx=0 tx=0).stop 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 shutdown_connections 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ecc15ade0 0x7f7ecc1f6110 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ecc0ce8c0 0x7f7ecc1f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 --2- 172.21.15.93:0/614843642 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ecc0cd600 0x7f7ecc154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:30.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.745+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 >> 172.21.15.93:0/614843642 conn(0x7f7ecc06ea40 msgr2=0x7f7ecc156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:30.748 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.746+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 shutdown_connections 2023-11-04T01:35:30.748 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:30.746+0000 7f7ed33cc640 1 -- 172.21.15.93:0/614843642 wait complete. 2023-11-04T01:35:30.756 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:35:30.886 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:30.885+0000 7fe76a21d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:35:31.012 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:31.011+0000 7f850b21d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:35:31.154 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:31.152+0000 7fe76a21d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:35:31.203 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:31.202+0000 7fe76a21d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:35:31.280 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:31.279+0000 7f850b21d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:35:31.305 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:31.304+0000 7fe76a21d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:35:31.335 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:31.332+0000 7f850b21d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:35:31.436 INFO:tasks.ceph.mgr.x.smithi125.stderr:2023-11-04T01:35:31.435+0000 7f850b21d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:35:32.331 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:32.328+0000 7fe70b29c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:35:32.331 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:35:32.328+0000 7fe70b29c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:35:33.581 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:35:33.578+0000 7fb3ea08c500 -1 osd.1 0 log_to_monitors true 2023-11-04T01:35:33.642 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:35:33.640+0000 7fdb1f210500 -1 osd.0 0 log_to_monitors true 2023-11-04T01:35:33.646 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:35:33.644+0000 7fd98c0a5500 -1 osd.2 0 log_to_monitors true 2023-11-04T01:35:33.654 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:35:33.652+0000 7f997da1d500 -1 osd.5 0 log_to_monitors true 2023-11-04T01:35:33.670 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:35:33.668+0000 7fb5bd39b500 -1 osd.3 0 log_to_monitors true 2023-11-04T01:35:33.706 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:35:33.704+0000 7fe56c4c9500 -1 osd.4 0 log_to_monitors true 2023-11-04T01:35:33.713 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:35:33.711+0000 7f4acb20c500 -1 osd.6 0 log_to_monitors true 2023-11-04T01:35:33.717 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:35:33.715+0000 7fa72ae12500 -1 osd.7 0 log_to_monitors true 2023-11-04T01:35:37.414 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:35:37.412+0000 7fb3e601c640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:35:37.434 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:35:37.432+0000 7fb3dde43640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.441 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:35:37.438+0000 7fd988033640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:35:37.453 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:35:37.451+0000 7fd97fe5a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.456 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:35:37.454+0000 7fb5b9329640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:35:37.466 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:35:37.464+0000 7fb5b1150640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.474 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:35:37.471+0000 7fdb1abfe640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:35:37.490 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:35:37.488+0000 7fdb12a25640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.516 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:35:37.512+0000 7fa727083640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:35:37.525 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:35:37.523+0000 7f4ac6bdc640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:35:37.533 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:35:37.531+0000 7fa71e696640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.540 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:35:37.537+0000 7fe568c6d640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:35:37.542 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:35:37.540+0000 7f4abea03640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.562 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:37.563 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:35:37.552+0000 7fe560280640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.601 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:35:37.599+0000 7f9979b99640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:35:37.616 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:35:37.614+0000 7f99711ac640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:35:37.650 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.647+0000 7fccda207640 1 Processor -- start 2023-11-04T01:35:37.650 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.647+0000 7fccda207640 1 -- start start 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccda207640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccd415d1b0 0x7fccd40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccda207640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd415da00 con 0x7fccd40b8890 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccda207640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd4161180 con 0x7fccd415cdd0 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccda207640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd41619a0 con 0x7fccd415d1b0 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccd3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccd415d1b0 0x7fccd40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.651 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccd2ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fccd40b8890 0x7fccd4160a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54512/0 (socket says 172.21.15.93:54512) 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccd2ffd640 1 -- 172.21.15.93:0/2895346063 learned_addr learned my addr 172.21.15.93:0/2895346063 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.648+0000 7fccd3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccd415d1b0 0x7fccd40cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46520/0 (socket says 172.21.15.93:46520) 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd3fff640 1 -- 172.21.15.93:0/2895346063 >> v1:172.21.15.125:6789/0 conn(0x7fccd415cdd0 legacy=0x7fccd415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd3fff640 1 -- 172.21.15.93:0/2895346063 >> v1:172.21.15.93:6789/0 conn(0x7fccd40b8890 legacy=0x7fccd4160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd3fff640 1 -- 172.21.15.93:0/2895346063 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd41613e0 con 0x7fccd415d1b0 2023-11-04T01:35:37.652 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd27fc640 1 -- 172.21.15.93:0/2895346063 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328170358 0 0) 0x7fccd415da00 con 0x7fccd40b8890 2023-11-04T01:35:37.653 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd3fff640 1 --2- 172.21.15.93:0/2895346063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40cdbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009d90 tx=0x7fcccc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9862af568c76aab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:37.653 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.649+0000 7fccd27fc640 1 -- 172.21.15.93:0/2895346063 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc02cd00 con 0x7fccd415d1b0 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccd27fc640 1 -- 172.21.15.93:0/2895346063 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc02ce60 con 0x7fccd415d1b0 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccd27fc640 1 -- 172.21.15.93:0/2895346063 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc034660 con 0x7fccd415d1b0 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 -- 172.21.15.93:0/2895346063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 msgr2=0x7fccd40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 --2- 172.21.15.93:0/2895346063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40cdbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009d90 tx=0x7fcccc02bf50 comp rx=0 tx=0).stop 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 -- 172.21.15.93:0/2895346063 shutdown_connections 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 --2- 172.21.15.93:0/2895346063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40cdbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 -- 172.21.15.93:0/2895346063 >> 172.21.15.93:0/2895346063 conn(0x7fccd40cf8a0 msgr2=0x7fccd40cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 -- 172.21.15.93:0/2895346063 shutdown_connections 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.650+0000 7fccda207640 1 -- 172.21.15.93:0/2895346063 wait complete. 2023-11-04T01:35:37.654 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.651+0000 7fccda207640 1 Processor -- start 2023-11-04T01:35:37.655 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.651+0000 7fccda207640 1 -- start start 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccd40b8890 0x7fccd414a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccd415cdd0 0x7fccd40c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40c7d30 con 0x7fccd415d1b0 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd414a6e0 con 0x7fccd40b8890 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccda207640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40c6e90 con 0x7fccd415cdd0 2023-11-04T01:35:37.660 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46524/0 (socket says 172.21.15.93:46524) 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 -- 172.21.15.93:0/3290846917 learned_addr learned my addr 172.21.15.93:0/3290846917 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd37fe640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccd40b8890 0x7fccd414a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd2ffd640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccd415cdd0 0x7fccd40c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 -- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccd415cdd0 msgr2=0x7fccd40c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccd415cdd0 0x7fccd40c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 -- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccd40b8890 msgr2=0x7fccd414a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccd40b8890 0x7fccd414a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.652+0000 7fccd3fff640 1 -- 172.21.15.93:0/3290846917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc009a70 con 0x7fccd415d1b0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccd3fff640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcccc037040 tx=0x7fcccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc03d600 con 0x7fccd415d1b0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc03d780 con 0x7fccd415d1b0 2023-11-04T01:35:37.661 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd40c70d0 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc03db30 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.653+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd40c7670 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.654+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd40c7e70 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.654+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fcccc03b040 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.654+0000 7fccbbfff640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 0x7fccc006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.654+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fcccc0aa770 con 0x7fccd415d1b0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.655+0000 7fccd37fe640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 0x7fccc006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.655+0000 7fccd37fe640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 0x7fccc006d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fccc4000f60 tx=0x7fccc4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:37.662 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.659+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fccd40c7e70 con 0x7fccd415d1b0 2023-11-04T01:35:37.827 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.825+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd40c7e70 con 0x7fccd415d1b0 2023-11-04T01:35:37.828 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.826+0000 7fccbbfff640 1 -- 172.21.15.93:0/3290846917 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fccd40c7e70 con 0x7fccd415d1b0 2023-11-04T01:35:37.828 INFO:teuthology.misc.health.smithi093.stdout: 2023-11-04T01:35:37.828 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":12,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:35.333644+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 msgr2=0x7fccc006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 0x7fccc006d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fccc4000f60 tx=0x7fccc4009040 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 msgr2=0x7fccd40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcccc037040 tx=0x7fcccc004a40 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 shutdown_connections 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.827+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fccc006ade0 0x7fccc006d2a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccd415d1b0 0x7fccd40c8e10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccd415cdd0 0x7fccd40c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 --2- 172.21.15.93:0/3290846917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccd40b8890 0x7fccd414a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:37.832 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 >> 172.21.15.93:0/3290846917 conn(0x7fccd40cf8a0 msgr2=0x7fccd415dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:37.833 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 shutdown_connections 2023-11-04T01:35:37.833 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:37.828+0000 7fccda207640 1 -- 172.21.15.93:0/3290846917 wait complete. 2023-11-04T01:35:37.839 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:35:44.647 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:44.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.742+0000 7ff4c61a9640 1 Processor -- start 2023-11-04T01:35:44.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.742+0000 7ff4c61a9640 1 -- start start 2023-11-04T01:35:44.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4c61a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4c006d910 0x7ff4c006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4c61a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c00b42b0 0x7ff4c0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.746 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4c61a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00ca540 con 0x7ff4c00ade60 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4c61a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00cb2f0 con 0x7ff4c006d910 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4c61a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b1f10 con 0x7ff4c00b42b0 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4c006d910 0x7ff4c006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4c006d910 0x7ff4c006dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51742/0 (socket says 172.21.15.93:51742) 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4bf7fe640 1 -- 172.21.15.93:0/2427731828 learned_addr learned my addr 172.21.15.93:0/2427731828 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.743+0000 7ff4bffff640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c00b42b0 0x7ff4c0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4bf7fe640 1 -- 172.21.15.93:0/2427731828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c00b42b0 msgr2=0x7ff4c0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4bf7fe640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c00b42b0 0x7ff4c0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4bf7fe640 1 -- 172.21.15.93:0/2427731828 >> v1:172.21.15.125:6789/0 conn(0x7ff4c00ade60 legacy=0x7ff4c00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.747 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4bf7fe640 1 -- 172.21.15.93:0/2427731828 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c006e230 con 0x7ff4c006d910 2023-11-04T01:35:44.749 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4bf7fe640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c006d910 0x7ff4c006dcf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000bb10 tx=0x7ff4b002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3133edb1cf423a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4be7fc640 1 -- 172.21.15.93:0/2427731828 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0036440 con 0x7ff4c006d910 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4be7fc640 1 -- 172.21.15.93:0/2427731828 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b00365a0 con 0x7ff4c006d910 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.744+0000 7ff4be7fc640 1 -- 172.21.15.93:0/2427731828 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0036930 con 0x7ff4c006d910 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 -- 172.21.15.93:0/2427731828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c006d910 msgr2=0x7ff4c006dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c006d910 0x7ff4c006dcf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000bb10 tx=0x7ff4b002e150 comp rx=0 tx=0).stop 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 -- 172.21.15.93:0/2427731828 shutdown_connections 2023-11-04T01:35:44.753 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c00b42b0 0x7ff4c0070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/2427731828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c006d910 0x7ff4c006dcf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 -- 172.21.15.93:0/2427731828 >> 172.21.15.93:0/2427731828 conn(0x7ff4c00ce9b0 msgr2=0x7ff4c00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 -- 172.21.15.93:0/2427731828 shutdown_connections 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.745+0000 7ff4c61a9640 1 -- 172.21.15.93:0/2427731828 wait complete. 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.746+0000 7ff4c61a9640 1 Processor -- start 2023-11-04T01:35:44.754 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.746+0000 7ff4c61a9640 1 -- start start 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c006d910 0x7ff4c01545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 0x7ff4c00b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c015b210 con 0x7ff4c00ade60 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0154b00 con 0x7ff4c00b42b0 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4c61a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c015a590 con 0x7ff4c006d910 2023-11-04T01:35:44.758 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4beffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4beffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51748/0 (socket says 172.21.15.93:51748) 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4beffd640 1 -- 172.21.15.93:0/1642818886 learned_addr learned my addr 172.21.15.93:0/1642818886 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4bf7fe640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c006d910 0x7ff4c01545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.747+0000 7ff4bffff640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 0x7ff4c00b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 -- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c006d910 msgr2=0x7ff4c01545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c006d910 0x7ff4c01545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 -- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 msgr2=0x7ff4c00b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 0x7ff4c00b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.759 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 -- 172.21.15.93:0/1642818886 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b000b770 con 0x7ff4c00ade60 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4bffff640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 0x7ff4c00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4beffd640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c450 tx=0x7ff4b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40052d0 con 0x7ff4c00ade60 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4005430 con 0x7ff4c00ade60 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4012870 con 0x7ff4c00ade60 2023-11-04T01:35:44.760 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c015a870 con 0x7ff4c00ade60 2023-11-04T01:35:44.763 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.748+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c015ae30 con 0x7ff4c00ade60 2023-11-04T01:35:44.763 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.749+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c004e490 con 0x7ff4c00ade60 2023-11-04T01:35:44.763 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.749+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4b40129d0 con 0x7ff4c00ade60 2023-11-04T01:35:44.763 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.750+0000 7ff4a7fff640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 0x7ff4ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:44.763 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.750+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4b4088c20 con 0x7ff4c00ade60 2023-11-04T01:35:44.764 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.750+0000 7ff4bf7fe640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 0x7ff4ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:44.764 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.750+0000 7ff4bf7fe640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 0x7ff4ac06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0038000 tx=0x7ff4b0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:44.764 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.754+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4b4054160 con 0x7ff4c00ade60 2023-11-04T01:35:44.922 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.920+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c00cf780 con 0x7ff4c00ade60 2023-11-04T01:35:44.923 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.921+0000 7ff4a7fff640 1 -- 172.21.15.93:0/1642818886 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12862 (secure 0 0 0) 0x7ff4b4057780 con 0x7ff4c00ade60 2023-11-04T01:35:44.923 INFO:teuthology.misc.health.smithi093.stdout: 2023-11-04T01:35:44.923 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":16,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:41.422553+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:44.932 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 msgr2=0x7ff4ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 0x7ff4ac06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0038000 tx=0x7ff4b0032000 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 msgr2=0x7ff4c00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c450 tx=0x7ff4b400c910 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 shutdown_connections 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4ac06ae70 0x7ff4ac06d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c00b42b0 0x7ff4c00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c00ade60 0x7ff4c00c5c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 --2- 172.21.15.93:0/1642818886 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c006d910 0x7ff4c01545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 >> 172.21.15.93:0/1642818886 conn(0x7ff4c00ce9b0 msgr2=0x7ff4c00afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 shutdown_connections 2023-11-04T01:35:44.933 INFO:teuthology.misc.health.smithi093.stderr:2023-11-04T01:35:44.923+0000 7ff4c61a9640 1 -- 172.21.15.93:0/1642818886 wait complete. 2023-11-04T01:35:44.935 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:35:44.935 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:35:44.935 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:35:44.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:35:44.940 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:35:44.943 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:35:44.943 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:35:44.946 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:35:44.946 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:35:44.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:35:44.950 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:35:44.951 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:35:44.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:35:44.953 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:35:44.953 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:35:44.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:45.016 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:35:45.021 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:35:45.036 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:35:45.036 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:35:45.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.054+0000 7f1c94c64640 1 Processor -- start 2023-11-04T01:35:45.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.054+0000 7f1c94c64640 1 -- start start 2023-11-04T01:35:45.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c94c64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900cb540 0x7f1c900c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c94c64640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c900c9d90 0x7f1c9006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c94c64640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9006a120 con 0x7f1c9015d100 2023-11-04T01:35:45.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c94c64640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c900ae9e0 con 0x7f1c900c9d90 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c94c64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9006a3e0 con 0x7f1c900cb540 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c8ed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c900c9d90 0x7f1c9006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c8ed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c900c9d90 0x7f1c9006b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51808/0 (socket says 172.21.15.93:51808) 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.055+0000 7f1c8ed9d640 1 -- 172.21.15.93:0/1861141026 learned_addr learned my addr 172.21.15.93:0/1861141026 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8dd9b640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900cb540 0x7f1c900c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8ed9d640 1 -- 172.21.15.93:0/1861141026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900cb540 msgr2=0x7f1c900c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8ed9d640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900cb540 0x7f1c900c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8ed9d640 1 -- 172.21.15.93:0/1861141026 >> v1:172.21.15.125:6789/0 conn(0x7f1c9015d100 legacy=0x7f1c9006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8ed9d640 1 -- 172.21.15.93:0/1861141026 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9006a6c0 con 0x7f1c900c9d90 2023-11-04T01:35:45.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.056+0000 7f1c8ed9d640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900c9d90 0x7f1c9006b1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27a7cd2c54b974 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c8d59a640 1 -- 172.21.15.93:0/1861141026 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80030840 con 0x7f1c900c9d90 2023-11-04T01:35:45.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c8d59a640 1 -- 172.21.15.93:0/1861141026 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c800309a0 con 0x7f1c900c9d90 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c8d59a640 1 -- 172.21.15.93:0/1861141026 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80030d30 con 0x7f1c900c9d90 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 -- 172.21.15.93:0/1861141026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900c9d90 msgr2=0x7f1c9006b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900c9d90 0x7f1c9006b1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8002b980 comp rx=0 tx=0).stop 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 -- 172.21.15.93:0/1861141026 shutdown_connections 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900c9d90 0x7f1c9006b1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 --2- 172.21.15.93:0/1861141026 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900cb540 0x7f1c900c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 -- 172.21.15.93:0/1861141026 >> 172.21.15.93:0/1861141026 conn(0x7f1c900b0cf0 msgr2=0x7f1c900b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 -- 172.21.15.93:0/1861141026 shutdown_connections 2023-11-04T01:35:45.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.057+0000 7f1c94c64640 1 -- 172.21.15.93:0/1861141026 wait complete. 2023-11-04T01:35:45.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.058+0000 7f1c94c64640 1 Processor -- start 2023-11-04T01:35:45.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 -- start start 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900c9d90 0x7f1c9015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9015d100 0x7f1c900c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c6760 con 0x7f1c900cb540 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c6a40 con 0x7f1c9015d100 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c94c64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c6d20 con 0x7f1c900c9d90 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c8dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c8dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51814/0 (socket says 172.21.15.93:51814) 2023-11-04T01:35:45.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c8dd9b640 1 -- 172.21.15.93:0/3818774674 learned_addr learned my addr 172.21.15.93:0/3818774674 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c8e59c640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900c9d90 0x7f1c9015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.059+0000 7f1c8ed9d640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9015d100 0x7f1c900c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 -- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900c9d90 msgr2=0x7f1c9015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900c9d90 0x7f1c9015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 -- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9015d100 msgr2=0x7f1c900c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9015d100 0x7f1c900c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 -- 172.21.15.93:0/3818774674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800094d0 con 0x7f1c900cb540 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c8dd9b640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c84007ef0 tx=0x7f1c8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84014620 con 0x7f1c900cb540 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84014780 con 0x7f1c900cb540 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84014b30 con 0x7f1c900cb540 2023-11-04T01:35:45.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c900c7000 con 0x7f1c900cb540 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.060+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9015bfa0 con 0x7f1c900cb540 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.061+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c900674e0 con 0x7f1c900cb540 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.061+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c84014c90 con 0x7f1c900cb540 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.062+0000 7f1c7effd640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 0x7f1c7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.062+0000 7f1c8e59c640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 0x7f1c7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.062+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c84089b20 con 0x7f1c900cb540 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.062+0000 7f1c8e59c640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 0x7f1c7006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c86a0 tx=0x7f1c88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.066+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c84054fd0 con 0x7f1c900cb540 2023-11-04T01:35:45.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.232+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c90066570 con 0x7f1c900cb540 2023-11-04T01:35:45.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.232+0000 7f1c7effd640 1 -- 172.21.15.93:0/3818774674 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f1c840585f0 con 0x7f1c900cb540 2023-11-04T01:35:45.235 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:45.235 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:41.422553+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:45.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 msgr2=0x7f1c7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 0x7f1c7006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c86a0 tx=0x7f1c88009040 comp rx=0 tx=0).stop 2023-11-04T01:35:45.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 msgr2=0x7f1c9015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c84007ef0 tx=0x7f1c8400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 shutdown_connections 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7006ae70 0x7f1c7006d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9015d100 0x7f1c900c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c900cb540 0x7f1c9015ba60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 --2- 172.21.15.93:0/3818774674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c900c9d90 0x7f1c9015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 >> 172.21.15.93:0/3818774674 conn(0x7f1c900b0cf0 msgr2=0x7f1c900cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 shutdown_connections 2023-11-04T01:35:45.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.234+0000 7f1c94c64640 1 -- 172.21.15.93:0/3818774674 wait complete. 2023-11-04T01:35:45.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:35:45.251 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:35:45.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.381+0000 7f0458cc9640 1 Processor -- start 2023-11-04T01:35:45.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.381+0000 7f0458cc9640 1 -- start start 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0458cc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04540ca0a0 0x7f04540cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0458cc9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04540cc300 0x7f04540cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0458cc9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540caa20 con 0x7f045415e3f0 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0458cc9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540b3300 con 0x7f04540cc300 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0458cc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540cb230 con 0x7f04540ca0a0 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04540cc300 0x7f04540cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04540cc300 0x7f04540cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51816/0 (socket says 172.21.15.93:51816) 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 -- 172.21.15.93:0/72053508 learned_addr learned my addr 172.21.15.93:0/72053508 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f044bfff640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04540ca0a0 0x7f04540cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 -- 172.21.15.93:0/72053508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04540ca0a0 msgr2=0x7f04540cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04540ca0a0 0x7f04540cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 -- 172.21.15.93:0/72053508 >> v1:172.21.15.125:6789/0 conn(0x7f045415e3f0 legacy=0x7f04540b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0452d9d640 1 -- 172.21.15.93:0/72053508 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540ca530 con 0x7f04540cc300 2023-11-04T01:35:45.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.382+0000 7f0451d9b640 1 -- 172.21.15.93:0/72053508 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095531356 0 0) 0x7f04540caa20 con 0x7f045415e3f0 2023-11-04T01:35:45.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.383+0000 7f0452d9d640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540cc300 0x7f04540cce60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f044c009e50 tx=0x7f044c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babd0149b24e0a21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.383+0000 7f0451d9b640 1 -- 172.21.15.93:0/72053508 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c02cb00 con 0x7f04540cc300 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.383+0000 7f0451d9b640 1 -- 172.21.15.93:0/72053508 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c02cc60 con 0x7f04540cc300 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.383+0000 7f0451d9b640 1 -- 172.21.15.93:0/72053508 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0343f0 con 0x7f04540cc300 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 -- 172.21.15.93:0/72053508 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540cc300 msgr2=0x7f04540cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540cc300 0x7f04540cce60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f044c009e50 tx=0x7f044c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 -- 172.21.15.93:0/72053508 shutdown_connections 2023-11-04T01:35:45.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540cc300 0x7f04540cce60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 --2- 172.21.15.93:0/72053508 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04540ca0a0 0x7f04540cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 -- 172.21.15.93:0/72053508 >> 172.21.15.93:0/72053508 conn(0x7f0454071820 msgr2=0x7f0454071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 -- 172.21.15.93:0/72053508 shutdown_connections 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.384+0000 7f0458cc9640 1 -- 172.21.15.93:0/72053508 wait complete. 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.385+0000 7f0458cc9640 1 Processor -- start 2023-11-04T01:35:45.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.385+0000 7f0458cc9640 1 -- start start 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04540cc300 0x7f04541e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f045415e3f0 0x7f04540af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04541e56e0 con 0x7f04540b0d20 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540c6ee0 con 0x7f04540cc300 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0458cc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04541f0a80 con 0x7f045415e3f0 2023-11-04T01:35:45.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51820/0 (socket says 172.21.15.93:51820) 2023-11-04T01:35:45.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 -- 172.21.15.93:0/750751263 learned_addr learned my addr 172.21.15.93:0/750751263 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f045259c640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04540cc300 0x7f04541e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 -- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f045415e3f0 msgr2=0x7f04540af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f044bfff640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f045415e3f0 0x7f04540af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f045415e3f0 0x7f04540af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 -- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04540cc300 msgr2=0x7f04541e51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04540cc300 0x7f04541e51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 -- 172.21.15.93:0/750751263 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009b30 con 0x7f04540b0d20 2023-11-04T01:35:45.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.386+0000 7f0452d9d640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f044c036040 tx=0x7f044c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.387+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c009510 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.387+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c03e450 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.387+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04541f0d60 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.387+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c03e5e0 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.387+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04541f1320 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.388+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04541f3d20 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.388+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f044c03e740 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.388+0000 7f044affd640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 0x7f043406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.388+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f044c0abb30 con 0x7f04540b0d20 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.388+0000 7f045259c640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 0x7f043406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.389+0000 7f045259c640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 0x7f043406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0444000f60 tx=0x7f0444009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.392+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04541f3d20 con 0x7f04540b0d20 2023-11-04T01:35:45.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.559+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04541f3d20 con 0x7f04540b0d20 2023-11-04T01:35:45.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.559+0000 7f044affd640 1 -- 172.21.15.93:0/750751263 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04541f3d20 con 0x7f04540b0d20 2023-11-04T01:35:45.562 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 msgr2=0x7f043406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 0x7f043406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0444000f60 tx=0x7f0444009040 comp rx=0 tx=0).stop 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 msgr2=0x7f045415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f044c036040 tx=0x7f044c004a40 comp rx=0 tx=0).stop 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 shutdown_connections 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f043406ae70 0x7f043406d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04540b0d20 0x7f045415a500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f045415e3f0 0x7f04540af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 --2- 172.21.15.93:0/750751263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04540cc300 0x7f04541e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 >> 172.21.15.93:0/750751263 conn(0x7f0454071820 msgr2=0x7f04540b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 shutdown_connections 2023-11-04T01:35:45.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.561+0000 7f0458cc9640 1 -- 172.21.15.93:0/750751263 wait complete. 2023-11-04T01:35:45.575 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:45.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.672+0000 7fe76f3ce640 1 Processor -- start 2023-11-04T01:35:45.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.672+0000 7fe76f3ce640 1 -- start start 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76f3ce640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe76815ae40 0x7fe76815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76f3ce640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7680cbc00 0x7fe7680cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76f3ce640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680cc450 con 0x7fe7680cd860 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76f3ce640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76815f400 con 0x7fe76815ae40 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76f3ce640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76815b220 con 0x7fe7680cbc00 2023-11-04T01:35:45.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe76815ae40 0x7fe76815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe76815ae40 0x7fe76815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51822/0 (socket says 172.21.15.93:51822) 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 -- 172.21.15.93:0/3692487172 learned_addr learned my addr 172.21.15.93:0/3692487172 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76c969640 1 --2- 172.21.15.93:0/3692487172 >> v2:172.21.15.125:3300/0 conn(0x7fe7680cbc00 0x7fe7680cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 -- 172.21.15.93:0/3692487172 >> v2:172.21.15.125:3300/0 conn(0x7fe7680cbc00 msgr2=0x7fe7680cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 --2- 172.21.15.93:0/3692487172 >> v2:172.21.15.125:3300/0 conn(0x7fe7680cbc00 0x7fe7680cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 -- 172.21.15.93:0/3692487172 >> v1:172.21.15.125:6789/0 conn(0x7fe7680cd860 legacy=0x7fe7680b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.673+0000 7fe76d16a640 1 -- 172.21.15.93:0/3692487172 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76815f890 con 0x7fe76815ae40 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.674+0000 7fe76d16a640 1 --2- 172.21.15.93:0/3692487172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe76815ae40 0x7fe76815bfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7680b05d0 tx=0x7fe76402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5bd1510eaa5686 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.674+0000 7fe75ffff640 1 -- 172.21.15.93:0/3692487172 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764030860 con 0x7fe76815ae40 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.674+0000 7fe75ffff640 1 -- 172.21.15.93:0/3692487172 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640309c0 con 0x7fe76815ae40 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.674+0000 7fe75ffff640 1 -- 172.21.15.93:0/3692487172 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764030d50 con 0x7fe76815ae40 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 -- 172.21.15.93:0/3692487172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe76815ae40 msgr2=0x7fe76815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/3692487172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe76815ae40 0x7fe76815bfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7680b05d0 tx=0x7fe76402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 -- 172.21.15.93:0/3692487172 shutdown_connections 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/3692487172 >> v2:172.21.15.125:3300/0 conn(0x7fe7680cbc00 0x7fe7680cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/3692487172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe76815ae40 0x7fe76815bfb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 -- 172.21.15.93:0/3692487172 >> 172.21.15.93:0/3692487172 conn(0x7fe76806ea90 msgr2=0x7fe76806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 -- 172.21.15.93:0/3692487172 shutdown_connections 2023-11-04T01:35:45.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.675+0000 7fe76f3ce640 1 -- 172.21.15.93:0/3692487172 wait complete. 2023-11-04T01:35:45.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.676+0000 7fe76f3ce640 1 Processor -- start 2023-11-04T01:35:45.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.676+0000 7fe76f3ce640 1 -- start start 2023-11-04T01:35:45.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7680cbc00 0x7fe7681578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 0x7fe7680c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680ca520 con 0x7fe7680cd860 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76814f480 con 0x7fe76815ae40 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76f3ce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c98a0 con 0x7fe7680cbc00 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51824/0 (socket says 172.21.15.93:51824) 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 -- 172.21.15.93:0/2122634117 learned_addr learned my addr 172.21.15.93:0/2122634117 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76d16a640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7680cbc00 0x7fe7681578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76d96b640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 0x7fe7680c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 -- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7680cbc00 msgr2=0x7fe7681578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7680cbc00 0x7fe7681578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 -- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 msgr2=0x7fe7680c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 0x7fe7680c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 -- 172.21.15.93:0/2122634117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640094d0 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76d96b640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 0x7fe7680c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe76c969640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe75800d830 tx=0x7fe75800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.677+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800b6c0 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.678+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800b820 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.678+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7680c9b80 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.678+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800bbb0 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.678+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7680ca140 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.679+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680ce2d0 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.679+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe75801e460 con 0x7fe7680cd860 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.679+0000 7fe75dffb640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 0x7fe74c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:45.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.679+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe758089a40 con 0x7fe7680cd860 2023-11-04T01:35:45.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.679+0000 7fe76d16a640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 0x7fe74c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:45.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.680+0000 7fe76d16a640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 0x7fe74c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe764036000 tx=0x7fe76403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:45.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.683+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe75808be60 con 0x7fe7680cd860 2023-11-04T01:35:45.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.887+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7680ca660 con 0x7fe7680cd860 2023-11-04T01:35:45.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.888+0000 7fe75dffb640 1 -- 172.21.15.93:0/2122634117 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7fe7680ca660 con 0x7fe7680cd860 2023-11-04T01:35:45.890 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:45.891 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:35:45.891 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 2 2023-11-04T01:35:45.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 msgr2=0x7fe74c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 0x7fe74c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe764036000 tx=0x7fe76403b040 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 msgr2=0x7fe768157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe75800d830 tx=0x7fe75800dcf0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 shutdown_connections 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe74c06ae70 0x7fe74c06d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815ae40 0x7fe7680c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7680cd860 0x7fe768157e10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 --2- 172.21.15.93:0/2122634117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7680cbc00 0x7fe7681578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 >> 172.21.15.93:0/2122634117 conn(0x7fe76806ea90 msgr2=0x7fe76815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 shutdown_connections 2023-11-04T01:35:45.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:45.890+0000 7fe76f3ce640 1 -- 172.21.15.93:0/2122634117 wait complete. 2023-11-04T01:35:47.909 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.015+0000 7f6e898af640 1 Processor -- start 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.015+0000 7f6e898af640 1 -- start start 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e898af640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6e840ce240 0x7f6e84157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e898af640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e84157540 0x7f6e840d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e898af640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8415e000 con 0x7f6e840cde60 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e898af640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8415e5c0 con 0x7f6e84157540 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e898af640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8415e2e0 con 0x7f6e840ce240 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e84157540 0x7f6e840d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e84157540 0x7f6e840d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51832/0 (socket says 172.21.15.93:51832) 2023-11-04T01:35:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 -- 172.21.15.93:0/650133411 learned_addr learned my addr 172.21.15.93:0/650133411 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e7bfff640 1 --2- 172.21.15.93:0/650133411 >> v2:172.21.15.125:3300/0 conn(0x7f6e840ce240 0x7f6e84157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 -- 172.21.15.93:0/650133411 >> v2:172.21.15.125:3300/0 conn(0x7f6e840ce240 msgr2=0x7f6e84157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 --2- 172.21.15.93:0/650133411 >> v2:172.21.15.125:3300/0 conn(0x7f6e840ce240 0x7f6e84157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 -- 172.21.15.93:0/650133411 >> v1:172.21.15.125:6789/0 conn(0x7f6e840cde60 legacy=0x7f6e8415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.016+0000 7f6e837fe640 1 -- 172.21.15.93:0/650133411 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840d1120 con 0x7f6e84157540 2023-11-04T01:35:48.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.017+0000 7f6e837fe640 1 --2- 172.21.15.93:0/650133411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e84157540 0x7f6e840d1920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e840cf5f0 tx=0x7f6e7c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454120f658b2b6be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.017+0000 7f6e827fc640 1 -- 172.21.15.93:0/650133411 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c02ca80 con 0x7f6e84157540 2023-11-04T01:35:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.017+0000 7f6e827fc640 1 -- 172.21.15.93:0/650133411 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c02cbe0 con 0x7f6e84157540 2023-11-04T01:35:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.017+0000 7f6e827fc640 1 -- 172.21.15.93:0/650133411 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0343f0 con 0x7f6e84157540 2023-11-04T01:35:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 -- 172.21.15.93:0/650133411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e84157540 msgr2=0x7f6e840d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 --2- 172.21.15.93:0/650133411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e84157540 0x7f6e840d1920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e840cf5f0 tx=0x7f6e7c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 -- 172.21.15.93:0/650133411 shutdown_connections 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 --2- 172.21.15.93:0/650133411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e84157540 0x7f6e840d1920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 --2- 172.21.15.93:0/650133411 >> v2:172.21.15.125:3300/0 conn(0x7f6e840ce240 0x7f6e84157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 -- 172.21.15.93:0/650133411 >> 172.21.15.93:0/650133411 conn(0x7f6e84071f30 msgr2=0x7f6e840cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 -- 172.21.15.93:0/650133411 shutdown_connections 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.018+0000 7f6e898af640 1 -- 172.21.15.93:0/650133411 wait complete. 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.019+0000 7f6e898af640 1 Processor -- start 2023-11-04T01:35:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.019+0000 7f6e898af640 1 -- start start 2023-11-04T01:35:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e840cde60 0x7f6e8415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e84157540 0x7f6e841f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84153a90 con 0x7f6e840ce240 2023-11-04T01:35:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840cc570 con 0x7f6e84157540 2023-11-04T01:35:48.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841f34a0 con 0x7f6e840cde60 2023-11-04T01:35:48.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51842/0 (socket says 172.21.15.93:51842) 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 -- 172.21.15.93:0/3673022429 learned_addr learned my addr 172.21.15.93:0/3673022429 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 -- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e840cde60 msgr2=0x7f6e8415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e840cde60 0x7f6e8415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e837fe640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e84157540 0x7f6e841f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 -- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e84157540 msgr2=0x7f6e841f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e84157540 0x7f6e841f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 -- 172.21.15.93:0/3673022429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c009b30 con 0x7f6e840ce240 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e7bfff640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00d800 tx=0x7f6e6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00b6c0 con 0x7f6e840ce240 2023-11-04T01:35:48.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00b820 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00bbb0 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8415b4a0 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.020+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8415ba60 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.021+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84074290 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.022+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e6c00bd10 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.022+0000 7f6e80ff9640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 0x7f6e6406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.022+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e6c0897f0 con 0x7f6e840ce240 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.022+0000 7f6e82ffd640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 0x7f6e6406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.022+0000 7f6e82ffd640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 0x7f6e6406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.026+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e6c054bf0 con 0x7f6e840ce240 2023-11-04T01:35:48.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.225+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e840c9580 con 0x7f6e840ce240 2023-11-04T01:35:48.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.226+0000 7f6e80ff9640 1 -- 172.21.15.93:0/3673022429 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f6e6c058210 con 0x7f6e840ce240 2023-11-04T01:35:48.229 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:48.230 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:35:48.231 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 3 2023-11-04T01:35:48.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 msgr2=0x7f6e6406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 0x7f6e6406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e74006fd0 tx=0x7f6e74006bc0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 msgr2=0x7f6e84153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00d800 tx=0x7f6e6c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 shutdown_connections 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6e6406aea0 0x7f6e6406d360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e84157540 0x7f6e841f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e840ce240 0x7f6e84153550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 --2- 172.21.15.93:0/3673022429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6e840cde60 0x7f6e8415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 >> 172.21.15.93:0/3673022429 conn(0x7f6e84071f30 msgr2=0x7f6e84072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 shutdown_connections 2023-11-04T01:35:48.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.228+0000 7f6e898af640 1 -- 172.21.15.93:0/3673022429 wait complete. 2023-11-04T01:35:48.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:48.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.339+0000 7f4506178640 1 Processor -- start 2023-11-04T01:35:48.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.339+0000 7f4506178640 1 -- start start 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.339+0000 7f4506178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f450015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f4506178640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45000ce240 0x7f45000d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f4506178640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450015e000 con 0x7f450015daa0 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f4506178640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450015e5c0 con 0x7f45000ce240 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f4506178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450015e2e0 con 0x7f45000cde60 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44feffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f450015daa0 0x7f4500157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:35130/0 (socket says 172.21.15.93:35130) 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44feffd640 1 -- 172.21.15.93:0/3171308606 learned_addr learned my addr 172.21.15.93:0/3171308606 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719850431 0 0) 0x7f450015e000 con 0x7f450015daa0 2023-11-04T01:35:48.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f450015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e8003520 con 0x7f450015daa0 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fffff640 1 --2- 172.21.15.93:0/3171308606 >> v2:172.21.15.125:3300/0 conn(0x7f45000ce240 0x7f45000d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536323328 0 0) 0x7f44e8003520 con 0x7f450015daa0 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 msgr2=0x7f450015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f450015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 >> v2:172.21.15.125:3300/0 conn(0x7f45000ce240 msgr2=0x7f45000d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 --2- 172.21.15.93:0/3171308606 >> v2:172.21.15.125:3300/0 conn(0x7f45000ce240 0x7f45000d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000d1120 con 0x7f450015daa0 2023-11-04T01:35:48.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f44f4001670 con 0x7f450015daa0 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 >> v1:172.21.15.93:6789/0 conn(0x7f450015daa0 legacy=0x7f4500157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44e8003970 0x7f44e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f44e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8004d00 0x7f44e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450015e5c0 con 0x7f44e8003970 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450015e2e0 con 0x7f44e8004d00 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e800b980 con 0x7f45000cde60 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44e8003970 0x7f44e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44feffd640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f44e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.340+0000 7f44fffff640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8004d00 0x7f44e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 -- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 msgr2=0x7f44e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f44e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 -- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8004d00 msgr2=0x7f44e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8004d00 0x7f44e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 -- 172.21.15.93:0/3171308606 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8003520 con 0x7f44e8003970 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44feffd640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45000cde60 0x7f44e80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44fffff640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44e8004d00 0x7f44e8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44e8003970 0x7f44e8003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009ac0 tx=0x7f44e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589449fa7cb9f35e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f002c6b0 con 0x7f44e8003970 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f002c810 con 0x7f44e8003970 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.341+0000 7f44fe7fc640 1 -- 172.21.15.93:0/3171308606 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f002cba0 con 0x7f44e8003970 2023-11-04T01:35:48.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 -- 172.21.15.93:0/3171308606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44e8003970 msgr2=0x7f44e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 --2- 172.21.15.93:0/3171308606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44e8003970 0x7f44e8003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009ac0 tx=0x7f44e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f44fffff640 1 -- 172.21.15.93:0/3171308606 reap_dead start 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 -- 172.21.15.93:0/3171308606 shutdown_connections 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 -- 172.21.15.93:0/3171308606 >> 172.21.15.93:0/3171308606 conn(0x7f4500071f30 msgr2=0x7f45000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 -- 172.21.15.93:0/3171308606 shutdown_connections 2023-11-04T01:35:48.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.342+0000 7f4506178640 1 -- 172.21.15.93:0/3171308606 wait complete. 2023-11-04T01:35:48.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.343+0000 7f4506178640 1 Processor -- start 2023-11-04T01:35:48.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.343+0000 7f4506178640 1 -- start start 2023-11-04T01:35:48.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8003970 0x7f45000c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 0x7f45001f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500150a40 con 0x7f4500156dd0 2023-11-04T01:35:48.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4500150d20 con 0x7f4500157250 2023-11-04T01:35:48.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f4506178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4500151000 con 0x7f44e8003970 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51874/0 (socket says 172.21.15.93:51874) 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 -- 172.21.15.93:0/4282276517 learned_addr learned my addr 172.21.15.93:0/4282276517 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8003970 0x7f45000c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 -- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8003970 msgr2=0x7f45000c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8003970 0x7f45000c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 -- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 msgr2=0x7f45001f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44fffff640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 0x7f45001f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 0x7f45001f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44feffd640 1 -- 172.21.15.93:0/4282276517 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45001512e0 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.344+0000 7f44fffff640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 0x7f45001f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f44feffd640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e870 tx=0x7f44f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400c850 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400c9b0 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400cd60 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45001515c0 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.345+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45001f68c0 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.346+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45001409b0 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.346+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44f401d460 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.346+0000 7f44e7fff640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 0x7f44ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.347+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44f4089340 con 0x7f4500156dd0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.347+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 0x7f44ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.347+0000 7f44ff7fe640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 0x7f44ec06d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.351+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45001409b0 con 0x7f4500156dd0 2023-11-04T01:35:48.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.520+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45001409b0 con 0x7f4500156dd0 2023-11-04T01:35:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.521+0000 7f44e7fff640 1 -- 172.21.15.93:0/4282276517 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f45001409b0 con 0x7f4500156dd0 2023-11-04T01:35:48.523 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:48.524 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:41.422553+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 msgr2=0x7f44ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 0x7f44ec06d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0030000 comp rx=0 tx=0).stop 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 msgr2=0x7f45001f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e870 tx=0x7f44f400ed30 comp rx=0 tx=0).stop 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 shutdown_connections 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44ec06aea0 0x7f44ec06d360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4500157250 0x7f45001f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4500156dd0 0x7f45001f5b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 --2- 172.21.15.93:0/4282276517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44e8003970 0x7f45000c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 >> 172.21.15.93:0/4282276517 conn(0x7f4500071f30 msgr2=0x7f45000cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 shutdown_connections 2023-11-04T01:35:48.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.523+0000 7f4506178640 1 -- 172.21.15.93:0/4282276517 wait complete. 2023-11-04T01:35:48.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:35:48.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:35:48.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.643+0000 7ff9d9d05640 1 Processor -- start 2023-11-04T01:35:48.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.643+0000 7ff9d9d05640 1 -- start start 2023-11-04T01:35:48.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d9d05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9d40cd6d0 0x7ff9d4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d9d05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40cde60 con 0x7ff9d4153e60 2023-11-04T01:35:48.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d9d05640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d4160f90 con 0x7ff9d40b4880 2023-11-04T01:35:48.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d9d05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d4161960 con 0x7ff9d40cd6d0 2023-11-04T01:35:48.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff9d4153e60 0x7ff9d415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:35138/0 (socket says 172.21.15.93:35138) 2023-11-04T01:35:48.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d37fe640 1 -- 172.21.15.93:0/1397527968 learned_addr learned my addr 172.21.15.93:0/1397527968 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:48.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/1397527968 >> v2:172.21.15.125:3300/0 conn(0x7ff9d40cd6d0 0x7ff9d4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269995865 0 0) 0x7ff9d40cde60 con 0x7ff9d4153e60 2023-11-04T01:35:48.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9bc003520 con 0x7ff9d4153e60 2023-11-04T01:35:48.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769966849 0 0) 0x7ff9bc003520 con 0x7ff9d4153e60 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 >> v2:172.21.15.125:3300/0 conn(0x7ff9d40cd6d0 msgr2=0x7ff9d4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 --2- 172.21.15.93:0/1397527968 >> v2:172.21.15.125:3300/0 conn(0x7ff9d40cd6d0 0x7ff9d4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 >> v1:172.21.15.125:6789/0 conn(0x7ff9d40b4880 legacy=0x7ff9d40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40ce090 con 0x7ff9d4153e60 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff9c4001670 con 0x7ff9d4153e60 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 >> v1:172.21.15.93:6789/0 conn(0x7ff9d4153e60 legacy=0x7ff9d415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc003970 0x7ff9bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 0x7ff9bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9bc005180 0x7ff9bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4161960 con 0x7ff9bc0047c0 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc00c020 con 0x7ff9bc003970 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.644+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc00c1e0 con 0x7ff9bc005180 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 0x7ff9bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d37fe640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc003970 0x7ff9bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d3fff640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9bc005180 0x7ff9bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 -- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9bc005180 msgr2=0x7ff9bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9bc005180 0x7ff9bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 -- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc003970 msgr2=0x7ff9bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc003970 0x7ff9bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 -- 172.21.15.93:0/1397527968 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc003520 con 0x7ff9bc0047c0 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d3fff640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9bc005180 0x7ff9bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d3fff640 1 -- 172.21.15.93:0/1397527968 reap_dead start 2023-11-04T01:35:48.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.645+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 0x7ff9bc004c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009ac0 tx=0x7ff9bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0254c8c40f76c1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c802c6b0 con 0x7ff9bc0047c0 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c802c810 con 0x7ff9bc0047c0 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d27fc640 1 -- 172.21.15.93:0/1397527968 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c802cba0 con 0x7ff9bc0047c0 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 -- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 msgr2=0x7ff9bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 0x7ff9bc004c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009ac0 tx=0x7ff9bc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 -- 172.21.15.93:0/1397527968 shutdown_connections 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/1397527968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9bc0047c0 0x7ff9bc004c40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 -- 172.21.15.93:0/1397527968 >> 172.21.15.93:0/1397527968 conn(0x7ff9d40cf880 msgr2=0x7ff9d40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 -- 172.21.15.93:0/1397527968 shutdown_connections 2023-11-04T01:35:48.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.646+0000 7ff9d9d05640 1 -- 172.21.15.93:0/1397527968 wait complete. 2023-11-04T01:35:48.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.647+0000 7ff9d9d05640 1 Processor -- start 2023-11-04T01:35:48.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 -- start start 2023-11-04T01:35:48.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc0047c0 0x7ff9d40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40c9100 0x7ff9d40b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41461c0 con 0x7ff9d40c9560 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40cbb40 con 0x7ff9bc0047c0 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d9d05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40cd050 con 0x7ff9d40c9100 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51888/0 (socket says 172.21.15.93:51888) 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d3fff640 1 -- 172.21.15.93:0/3547788931 learned_addr learned my addr 172.21.15.93:0/3547788931 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d37fe640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc0047c0 0x7ff9d40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.648+0000 7ff9d2ffd640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40c9100 0x7ff9d40b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 -- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40c9100 msgr2=0x7ff9d40b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40c9100 0x7ff9d40b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 -- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc0047c0 msgr2=0x7ff9d40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc0047c0 0x7ff9d40ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 -- 172.21.15.93:0/3547788931 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40cc680 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d3fff640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9d406c900 tx=0x7ff9cc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00eed0 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc003970 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc003d20 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d4142d50 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.649+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40cc030 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.650+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40cc810 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.650+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9cc0050d0 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.651+0000 7ff9bbfff640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 0x7ff9c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.651+0000 7ff9d37fe640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 0x7ff9c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.651+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff9cc088c60 con 0x7ff9d40c9560 2023-11-04T01:35:48.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.651+0000 7ff9d37fe640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 0x7ff9c006d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4007de0 tx=0x7ff9c4001bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.655+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9cc054080 con 0x7ff9d40c9560 2023-11-04T01:35:48.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.819+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9d40d0b80 con 0x7ff9d40c9560 2023-11-04T01:35:48.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.819+0000 7ff9bbfff640 1 -- 172.21.15.93:0/3547788931 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9cc0576a0 con 0x7ff9d40c9560 2023-11-04T01:35:48.823 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 msgr2=0x7ff9c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 0x7ff9c006d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4007de0 tx=0x7ff9c4001bd0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 msgr2=0x7ff9d40b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9d406c900 tx=0x7ff9cc00eb90 comp rx=0 tx=0).stop 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 shutdown_connections 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c006aea0 0x7ff9c006d360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40c9560 0x7ff9d40b76d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40c9100 0x7ff9d40b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 --2- 172.21.15.93:0/3547788931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc0047c0 0x7ff9d40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.821+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 >> 172.21.15.93:0/3547788931 conn(0x7ff9d40cf880 msgr2=0x7ff9d40d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.822+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 shutdown_connections 2023-11-04T01:35:48.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.822+0000 7ff9d9d05640 1 -- 172.21.15.93:0/3547788931 wait complete. 2023-11-04T01:35:48.835 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:35:48.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.930+0000 7f99634af640 1 Processor -- start 2023-11-04T01:35:48.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.931+0000 7f99634af640 1 -- start start 2023-11-04T01:35:48.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.931+0000 7f99634af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c0aec80 0x7f995c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.931+0000 7f99634af640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f995c0af060 0x7f995c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.931+0000 7f99634af640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0b1590 con 0x7f995c06ef40 2023-11-04T01:35:48.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f99634af640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c155a40 con 0x7f995c0af060 2023-11-04T01:35:48.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f99634af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c06a660 con 0x7f995c0aec80 2023-11-04T01:35:48.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f995c0af060 0x7f995c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f995c0af060 0x7f995c06a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51890/0 (socket says 172.21.15.93:51890) 2023-11-04T01:35:48.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 -- 172.21.15.93:0/2768432749 learned_addr learned my addr 172.21.15.93:0/2768432749 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f996124b640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c0aec80 0x7f995c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 -- 172.21.15.93:0/2768432749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c0aec80 msgr2=0x7f995c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:48.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c0aec80 0x7f995c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 -- 172.21.15.93:0/2768432749 >> v1:172.21.15.125:6789/0 conn(0x7f995c06ef40 legacy=0x7f995c0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.932+0000 7f9960a4a640 1 -- 172.21.15.93:0/2768432749 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c06a8e0 con 0x7f995c0af060 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f9960a4a640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c06a120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9958009850 tx=0x7f995802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba48ddc1a28d2c5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f9953fff640 1 -- 172.21.15.93:0/2768432749 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958004230 con 0x7f995c0af060 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f9953fff640 1 -- 172.21.15.93:0/2768432749 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958004390 con 0x7f995c0af060 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f9953fff640 1 -- 172.21.15.93:0/2768432749 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958003810 con 0x7f995c0af060 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 -- 172.21.15.93:0/2768432749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 msgr2=0x7f995c06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c06a120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9958009850 tx=0x7f995802b960 comp rx=0 tx=0).stop 2023-11-04T01:35:48.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 -- 172.21.15.93:0/2768432749 shutdown_connections 2023-11-04T01:35:48.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c06a120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 --2- 172.21.15.93:0/2768432749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c0aec80 0x7f995c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 -- 172.21.15.93:0/2768432749 >> 172.21.15.93:0/2768432749 conn(0x7f995c098d40 msgr2=0x7f995c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:48.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 -- 172.21.15.93:0/2768432749 shutdown_connections 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.933+0000 7f99634af640 1 -- 172.21.15.93:0/2768432749 wait complete. 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 Processor -- start 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 -- start start 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c06ef40 0x7f995c0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c0aec80 0x7f995c0c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c7a00 con 0x7f995c0af060 2023-11-04T01:35:48.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c7da0 con 0x7f995c0aec80 2023-11-04T01:35:48.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f99634af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c8080 con 0x7f995c06ef40 2023-11-04T01:35:48.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f9961a4c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f996124b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c06ef40 0x7f995c0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.935+0000 7f9961a4c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51900/0 (socket says 172.21.15.93:51900) 2023-11-04T01:35:48.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 -- 172.21.15.93:0/3805804682 learned_addr learned my addr 172.21.15.93:0/3805804682 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9960a4a640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c0aec80 0x7f995c0c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 -- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c06ef40 msgr2=0x7f995c0c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c06ef40 0x7f995c0c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 -- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c0aec80 msgr2=0x7f995c0c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c0aec80 0x7f995c0c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 -- 172.21.15.93:0/3805804682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009460 con 0x7f995c0af060 2023-11-04T01:35:48.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9961a4c640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f995400c6b0 tx=0x7f995400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954003b70 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954003cf0 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c0c8360 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954003ea0 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.936+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0c8920 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.937+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c074290 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.937+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9954005310 con 0x7f995c0af060 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.938+0000 7f9951ffb640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 0x7f994006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:48.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.938+0000 7f996124b640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 0x7f994006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:48.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.938+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9954088e90 con 0x7f995c0af060 2023-11-04T01:35:48.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.938+0000 7f996124b640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 0x7f994006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f994c005f80 tx=0x7f994c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:48.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:48.942+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99540543d0 con 0x7f995c0af060 2023-11-04T01:35:49.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.112+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f995c0c8b10 con 0x7f995c0af060 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.112+0000 7f9951ffb640 1 -- 172.21.15.93:0/3805804682 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f99540579f0 con 0x7f995c0af060 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:35:49.115 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 msgr2=0x7f994006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 0x7f994006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f994c005f80 tx=0x7f994c008040 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 msgr2=0x7f995c14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f995400c6b0 tx=0x7f995400cb70 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 shutdown_connections 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f994006ae70 0x7f994006d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f995c0af060 0x7f995c14cdb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f995c0aec80 0x7f995c0c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 --2- 172.21.15.93:0/3805804682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f995c06ef40 0x7f995c0c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 >> 172.21.15.93:0/3805804682 conn(0x7f995c098d40 msgr2=0x7f995c0aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 shutdown_connections 2023-11-04T01:35:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.114+0000 7f99634af640 1 -- 172.21.15.93:0/3805804682 wait complete. 2023-11-04T01:35:49.134 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:35:49.134 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:35:49.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.247+0000 7f444750c640 1 Processor -- start 2023-11-04T01:35:49.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.247+0000 7f444750c640 1 -- start start 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f444750c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44400ca010 0x7f44400ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f444750c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f444006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f444750c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400ca930 con 0x7f444015b0c0 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f444750c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400b4a00 con 0x7f44400ca010 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f444750c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444006ab30 con 0x7f44400b36e0 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f4444aa7640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f444015b0c0 0x7f444006e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:35152/0 (socket says 172.21.15.93:35152) 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.248+0000 7f4444aa7640 1 -- 172.21.15.93:0/676528349 learned_addr learned my addr 172.21.15.93:0/676528349 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 --2- 172.21.15.93:0/676528349 >> v2:172.21.15.125:3300/0 conn(0x7f44400ca010 0x7f44400ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4445aa9640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f444006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057698943 0 0) 0x7f44400ca930 con 0x7f444015b0c0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442c003520 con 0x7f444015b0c0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 717596497 0 0) 0x7f442c003520 con 0x7f444015b0c0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 msgr2=0x7f444006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f444006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 >> v2:172.21.15.125:3300/0 conn(0x7f44400ca010 msgr2=0x7f44400ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 --2- 172.21.15.93:0/676528349 >> v2:172.21.15.125:3300/0 conn(0x7f44400ca010 0x7f44400ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444006adf0 con 0x7f444015b0c0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4430001670 con 0x7f444015b0c0 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 >> v1:172.21.15.93:6789/0 conn(0x7f444015b0c0 legacy=0x7f444006e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f442c003970 0x7f442c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c0047c0 0x7f442c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f442c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400b4a00 con 0x7f442c003970 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444006ab30 con 0x7f442c0047c0 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c00b9b0 con 0x7f44400b36e0 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f442c003970 0x7f442c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4444aa7640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c0047c0 0x7f442c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4445aa9640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f442c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 -- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 msgr2=0x7f442c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f442c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 -- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c0047c0 msgr2=0x7f442c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:49.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c0047c0 0x7f442c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f44452a8640 1 -- 172.21.15.93:0/676528349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c003520 con 0x7f442c003970 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4444aa7640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c0047c0 0x7f442c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.249+0000 7f4445aa9640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44400b36e0 0x7f442c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.250+0000 7f44452a8640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f442c003970 0x7f442c003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f443c009fc0 tx=0x7f442c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a182824479e2bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.250+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c02cc60 con 0x7f442c003970 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.250+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c00f040 con 0x7f442c003970 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.250+0000 7f4437fff640 1 -- 172.21.15.93:0/676528349 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034440 con 0x7f442c003970 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 -- 172.21.15.93:0/676528349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f442c003970 msgr2=0x7f442c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 --2- 172.21.15.93:0/676528349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f442c003970 0x7f442c003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f443c009fc0 tx=0x7f442c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f4445aa9640 1 -- 172.21.15.93:0/676528349 reap_dead start 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 -- 172.21.15.93:0/676528349 shutdown_connections 2023-11-04T01:35:49.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 -- 172.21.15.93:0/676528349 >> 172.21.15.93:0/676528349 conn(0x7f444006cf70 msgr2=0x7f444006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:49.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 -- 172.21.15.93:0/676528349 shutdown_connections 2023-11-04T01:35:49.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.251+0000 7f444750c640 1 -- 172.21.15.93:0/676528349 wait complete. 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.252+0000 7f444750c640 1 Processor -- start 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.252+0000 7f444750c640 1 -- start start 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 0x7f4440157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4440158450 0x7f44401e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444015a000 con 0x7f44401597b0 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440159d20 con 0x7f442c003970 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4440157970 con 0x7f4440158450 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51926/0 (socket says 172.21.15.93:51926) 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 -- 172.21.15.93:0/2882335962 learned_addr learned my addr 172.21.15.93:0/2882335962 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 -- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4440158450 msgr2=0x7f44401e4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4440158450 0x7f44401e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f44452a8640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 0x7f4440157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 -- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 msgr2=0x7f4440157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 0x7f4440157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 -- 172.21.15.93:0/2882335962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440157c50 con 0x7f44401597b0 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f44452a8640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 0x7f4440157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:49.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4444aa7640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44300019d0 tx=0x7f443000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000c660 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000c7c0 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4440157f30 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.253+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000cb30 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.254+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44400a8320 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.254+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44400b0a00 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.255+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f443000cc90 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.255+0000 7f4435ffb640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 0x7f442406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.255+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44300890a0 con 0x7f44401597b0 2023-11-04T01:35:49.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.255+0000 7f44452a8640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 0x7f442406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:49.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.255+0000 7f44452a8640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 0x7f442406d360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:49.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.259+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4430054530 con 0x7f44401597b0 2023-11-04T01:35:49.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:49.429+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f444006b3b0 con 0x7f44401597b0 2023-11-04T01:35:50.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.037+0000 7f4435ffb640 1 -- 172.21.15.93:0/2882335962 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4430057b50 con 0x7f44401597b0 2023-11-04T01:35:50.040 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 msgr2=0x7f442406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 0x7f442406d360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c02e000 comp rx=0 tx=0).stop 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 msgr2=0x7f44400a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44300019d0 tx=0x7f443000eb90 comp rx=0 tx=0).stop 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 shutdown_connections 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f442406aea0 0x7f442406d360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4440158450 0x7f44401e4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44401597b0 0x7f44400a7de0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 --2- 172.21.15.93:0/2882335962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f442c003970 0x7f4440157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 >> 172.21.15.93:0/2882335962 conn(0x7f444006cf70 msgr2=0x7f44400afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:50.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 shutdown_connections 2023-11-04T01:35:50.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.040+0000 7f444750c640 1 -- 172.21.15.93:0/2882335962 wait complete. 2023-11-04T01:35:50.058 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-04T01:35:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.164+0000 7fed201b7640 1 Processor -- start 2023-11-04T01:35:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 -- start start 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1806a830 0x7fed180b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed180722a0 0x7fed180ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180cdf80 con 0x7fed181603d0 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed180b19d0 con 0x7fed180722a0 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed201b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed18072730 con 0x7fed1806a830 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed1e754640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed180722a0 0x7fed180ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.165+0000 7fed1e754640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed180722a0 0x7fed180ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51934/0 (socket says 172.21.15.93:51934) 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 -- 172.21.15.93:0/4108070665 learned_addr learned my addr 172.21.15.93:0/4108070665 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1d752640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1806a830 0x7fed180b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 -- 172.21.15.93:0/4108070665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1806a830 msgr2=0x7fed180b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1806a830 0x7fed180b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 -- 172.21.15.93:0/4108070665 >> v1:172.21.15.125:6789/0 conn(0x7fed181603d0 legacy=0x7fed1806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 -- 172.21.15.93:0/4108070665 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180ce6f0 con 0x7fed180722a0 2023-11-04T01:35:50.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.166+0000 7fed1e754640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed180722a0 0x7fed180ca380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fde10d898d1b522 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:50.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed1cf51640 1 -- 172.21.15.93:0/4108070665 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1002c9e0 con 0x7fed180722a0 2023-11-04T01:35:50.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed1cf51640 1 -- 172.21.15.93:0/4108070665 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1002cb40 con 0x7fed180722a0 2023-11-04T01:35:50.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed1cf51640 1 -- 172.21.15.93:0/4108070665 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100343f0 con 0x7fed180722a0 2023-11-04T01:35:50.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 -- 172.21.15.93:0/4108070665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed180722a0 msgr2=0x7fed180ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:50.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed180722a0 0x7fed180ca380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1002be40 comp rx=0 tx=0).stop 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 -- 172.21.15.93:0/4108070665 shutdown_connections 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed180722a0 0x7fed180ca380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 --2- 172.21.15.93:0/4108070665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed1806a830 0x7fed180b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 -- 172.21.15.93:0/4108070665 >> 172.21.15.93:0/4108070665 conn(0x7fed1806d800 msgr2=0x7fed1806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 -- 172.21.15.93:0/4108070665 shutdown_connections 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.167+0000 7fed201b7640 1 -- 172.21.15.93:0/4108070665 wait complete. 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.168+0000 7fed201b7640 1 Processor -- start 2023-11-04T01:35:50.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.168+0000 7fed201b7640 1 -- start start 2023-11-04T01:35:50.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 0x7fed181447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed181603d0 0x7fed18144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181f2b60 con 0x7fed1806a830 2023-11-04T01:35:50.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed18145250 con 0x7fed180722a0 2023-11-04T01:35:50.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed201b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b4930 con 0x7fed181603d0 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51944/0 (socket says 172.21.15.93:51944) 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 -- 172.21.15.93:0/913933143 learned_addr learned my addr 172.21.15.93:0/913933143 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1e754640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed181603d0 0x7fed18144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1d752640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 0x7fed181447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 -- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed181603d0 msgr2=0x7fed18144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed181603d0 0x7fed18144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 -- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 msgr2=0x7fed181447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 0x7fed181447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 -- 172.21.15.93:0/913933143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009b30 con 0x7fed1806a830 2023-11-04T01:35:50.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1d752640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 0x7fed181447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.169+0000 7fed1df53640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b3f0 tx=0x7fed1400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14011830 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed14011990 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed180b4c10 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14011d40 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed180b51d0 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.170+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed180b5990 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.171+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed1401a400 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.171+0000 7fed0e7fc640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.171+0000 7fed1d752640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.171+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fed14089300 con 0x7fed1806a830 2023-11-04T01:35:50.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.172+0000 7fed1d752640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed181f5fc0 tx=0x7fed08008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:50.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.176+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed14054500 con 0x7fed1806a830 2023-11-04T01:35:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:50.342+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fed1815a480 con 0x7fed1806a830 2023-11-04T01:35:50.691 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:50.694 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.040+0000 7fed0e7fc640 1 -- 172.21.15.93:0/913933143 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fed14057b20 con 0x7fed1806a830 2023-11-04T01:35:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:35:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 msgr2=0x7fecfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed181f5fc0 tx=0x7fed08008040 comp rx=0 tx=0).stop 2023-11-04T01:35:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 msgr2=0x7fed180c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b3f0 tx=0x7fed1400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 shutdown_connections 2023-11-04T01:35:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed181603d0 0x7fed18144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed180722a0 0x7fed181447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 --2- 172.21.15.93:0/913933143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed1806a830 0x7fed180c7da0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b3f0 tx=0x7fed1400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.043+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 >> 172.21.15.93:0/913933143 conn(0x7fed1806d800 msgr2=0x7fed181598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.044+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 shutdown_connections 2023-11-04T01:35:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.045+0000 7fed201b7640 1 -- 172.21.15.93:0/913933143 wait complete. 2023-11-04T01:35:51.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:35:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 Processor -- start 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 -- start start 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87380b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87380cde60 con 0x7f8738153e60 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8738160f90 con 0x7f87380cd6d0 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f873d30c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b5200 con 0x7f87380b4880 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f8736ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8738153e60 0x7f873815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:35160/0 (socket says 172.21.15.93:35160) 2023-11-04T01:35:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.174+0000 7f8736ffd640 1 -- 172.21.15.93:0/897180809 learned_addr learned my addr 172.21.15.93:0/897180809 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288579058 0 0) 0x7f87380cde60 con 0x7f8738153e60 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8724003520 con 0x7f8738153e60 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87377fe640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87380b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2441343747 0 0) 0x7f8724003520 con 0x7f8738153e60 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 msgr2=0x7f87380b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87380b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 >> v1:172.21.15.125:6789/0 conn(0x7f87380cd6d0 legacy=0x7f8738161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380ce090 con 0x7f8738153e60 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8730001670 con 0x7f8738153e60 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 >> v1:172.21.15.93:6789/0 conn(0x7f8738153e60 legacy=0x7f873815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8724004020 0x7f87240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004d00 0x7f8724005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b5200 con 0x7f8724004020 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872400bbc0 con 0x7f8724004d00 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872400bd80 con 0x7f87380b4880 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8724004020 0x7f87240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f8736ffd640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87377fe640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004d00 0x7f8724005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 -- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 msgr2=0x7f87240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380b4880 0x7f87240039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 -- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004d00 msgr2=0x7f8724005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004d00 0x7f8724005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.175+0000 7f87367fc640 1 -- 172.21.15.93:0/897180809 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724003520 con 0x7f8724004020 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.176+0000 7f87367fc640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8724004020 0x7f87240047c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8720001720 tx=0x7f87240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb8cf879fa26aae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.176+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200052d0 con 0x7f8724004020 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.176+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872002e050 con 0x7f8724004020 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.176+0000 7f8735ffb640 1 -- 172.21.15.93:0/897180809 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720003830 con 0x7f8724004020 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 -- 172.21.15.93:0/897180809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8724004020 msgr2=0x7f87240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 --2- 172.21.15.93:0/897180809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8724004020 0x7f87240047c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8720001720 tx=0x7f87240057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f87377fe640 1 -- 172.21.15.93:0/897180809 reap_dead start 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 -- 172.21.15.93:0/897180809 shutdown_connections 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 -- 172.21.15.93:0/897180809 >> 172.21.15.93:0/897180809 conn(0x7f87380cf880 msgr2=0x7f87380cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 -- 172.21.15.93:0/897180809 shutdown_connections 2023-11-04T01:35:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.177+0000 7f873d30c640 1 -- 172.21.15.93:0/897180809 wait complete. 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.178+0000 7f873d30c640 1 Processor -- start 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.178+0000 7f873d30c640 1 -- start start 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004020 0x7f87381f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380c9110 0x7f8738158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381f2590 con 0x7f87380c8c90 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380c9650 con 0x7f8724004020 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8738157b70 con 0x7f87380c9110 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51962/0 (socket says 172.21.15.93:51962) 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 -- 172.21.15.93:0/3116423266 learned_addr learned my addr 172.21.15.93:0/3116423266 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f8736ffd640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004020 0x7f87381f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87377fe640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380c9110 0x7f8738158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 -- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380c9110 msgr2=0x7f8738158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380c9110 0x7f8738158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 -- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004020 msgr2=0x7f87381f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004020 0x7f87381f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 -- 172.21.15.93:0/3116423266 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738157e50 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f87367fc640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8720008fd0 tx=0x7f8720001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200076c0 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720000ed0 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8738158130 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.179+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720006c00 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.180+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873814d640 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.180+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873814d7d0 con 0x7f87380c8c90 2023-11-04T01:35:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.181+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87200035f0 con 0x7f87380c8c90 2023-11-04T01:35:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.181+0000 7f872f7fe640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 0x7f871806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.181+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f87200ab270 con 0x7f87380c8c90 2023-11-04T01:35:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.181+0000 7f8736ffd640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 0x7f871806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.182+0000 7f8736ffd640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 0x7f871806d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87300017a0 tx=0x7f8730001670 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.185+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8720076430 con 0x7f87380c8c90 2023-11-04T01:35:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:51.389+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8738074290 con 0x7f87380c8c90 2023-11-04T01:35:52.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.053+0000 7f872f7fe640 1 -- 172.21.15.93:0/3116423266 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8720079a50 con 0x7f87380c8c90 2023-11-04T01:35:52.055 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 msgr2=0x7f871806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 0x7f871806d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87300017a0 tx=0x7f8730001670 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 msgr2=0x7f873815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8720008fd0 tx=0x7f8720001120 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 shutdown_connections 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f871806aea0 0x7f871806d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87380c9110 0x7f8738158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87380c8c90 0x7f873815dec0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 --2- 172.21.15.93:0/3116423266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8724004020 0x7f87381f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 >> 172.21.15.93:0/3116423266 conn(0x7f87380cf880 msgr2=0x7f87380d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 shutdown_connections 2023-11-04T01:35:52.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.055+0000 7f873d30c640 1 -- 172.21.15.93:0/3116423266 wait complete. 2023-11-04T01:35:52.071 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-04T01:35:52.072 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-04T01:35:52.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.174+0000 7fdf25eb4640 1 Processor -- start 2023-11-04T01:35:52.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.174+0000 7fdf25eb4640 1 -- start start 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf25eb4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdf200b0db0 0x7fdf200cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf25eb4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200ceb70 con 0x7fdf2015e650 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf25eb4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200b2260 con 0x7fdf200afc00 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf25eb4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf200b2820 con 0x7fdf200b0db0 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf1effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdf200b0db0 0x7fdf200cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf1f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdf2015e650 0x7fdf200b06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40884/0 (socket says 172.21.15.93:40884) 2023-11-04T01:35:52.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.175+0000 7fdf1f7fe640 1 -- 172.21.15.93:0/1079738213 learned_addr learned my addr 172.21.15.93:0/1079738213 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:52.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1effd640 1 -- 172.21.15.93:0/1079738213 >> v1:172.21.15.125:6789/0 conn(0x7fdf200afc00 legacy=0x7fdf200aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:52.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1effd640 1 -- 172.21.15.93:0/1079738213 >> v1:172.21.15.93:6789/0 conn(0x7fdf2015e650 legacy=0x7fdf200b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1e7fc640 1 -- 172.21.15.93:0/1079738213 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622693754 0 0) 0x7fdf200ceb70 con 0x7fdf2015e650 2023-11-04T01:35:52.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1effd640 1 -- 172.21.15.93:0/1079738213 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200b2540 con 0x7fdf200b0db0 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1effd640 1 --2- 172.21.15.93:0/1079738213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf200b0db0 0x7fdf200cf830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097a0 tx=0x7fdf1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e84f08cd9881de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1e7fc640 1 -- 172.21.15.93:0/1079738213 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1402e070 con 0x7fdf200b0db0 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1e7fc640 1 -- 172.21.15.93:0/1079738213 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140315a0 con 0x7fdf200b0db0 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.176+0000 7fdf1e7fc640 1 -- 172.21.15.93:0/1079738213 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14031930 con 0x7fdf200b0db0 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 -- 172.21.15.93:0/1079738213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf200b0db0 msgr2=0x7fdf200cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/1079738213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf200b0db0 0x7fdf200cf830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097a0 tx=0x7fdf1402b840 comp rx=0 tx=0).stop 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 -- 172.21.15.93:0/1079738213 shutdown_connections 2023-11-04T01:35:52.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/1079738213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf200b0db0 0x7fdf200cf830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 -- 172.21.15.93:0/1079738213 >> 172.21.15.93:0/1079738213 conn(0x7fdf2009a140 msgr2=0x7fdf200d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:52.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 -- 172.21.15.93:0/1079738213 shutdown_connections 2023-11-04T01:35:52.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.177+0000 7fdf25eb4640 1 -- 172.21.15.93:0/1079738213 wait complete. 2023-11-04T01:35:52.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.178+0000 7fdf25eb4640 1 Processor -- start 2023-11-04T01:35:52.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.178+0000 7fdf25eb4640 1 -- start start 2023-11-04T01:35:52.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 0x7fdf2006b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 0x7fdf200cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200cfd70 con 0x7fdf2015e650 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2006b770 con 0x7fdf200b0db0 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf25eb4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2006ba10 con 0x7fdf200afc00 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60536/0 (socket says 172.21.15.93:60536) 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 -- 172.21.15.93:0/3836527824 learned_addr learned my addr 172.21.15.93:0/3836527824 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1effd640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 0x7fdf200cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 -- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 msgr2=0x7fdf2006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1f7fe640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 0x7fdf2006b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 0x7fdf2006b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 -- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 msgr2=0x7fdf200cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 0x7fdf200cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1ffff640 1 -- 172.21.15.93:0/3836527824 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009400 con 0x7fdf2015e650 2023-11-04T01:35:52.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1effd640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 0x7fdf200cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.179+0000 7fdf1f7fe640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 0x7fdf2006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf1ffff640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c410 tx=0x7fdf1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011790 con 0x7fdf2015e650 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf180118f0 con 0x7fdf2015e650 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2006bcf0 con 0x7fdf2015e650 2023-11-04T01:35:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18011ce0 con 0x7fdf2015e650 2023-11-04T01:35:52.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.180+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2006c2b0 con 0x7fdf2015e650 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.181+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2006ff50 con 0x7fdf2015e650 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.181+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf1801c460 con 0x7fdf2015e650 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.181+0000 7fdf07fff640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 0x7fdf0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.182+0000 7fdf1f7fe640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 0x7fdf0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.182+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf18089250 con 0x7fdf2015e650 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.182+0000 7fdf1f7fe640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 0x7fdf0c06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf10007fd0 tx=0x7fdf10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:52.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.186+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf18054390 con 0x7fdf2015e650 2023-11-04T01:35:52.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:52.362+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fdf2006fc70 con 0x7fdf2015e650 2023-11-04T01:35:53.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.007+0000 7fdf07fff640 1 -- 172.21.15.93:0/3836527824 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fdf180579b0 con 0x7fdf2015e650 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 msgr2=0x7fdf0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 0x7fdf0c06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf10007fd0 tx=0x7fdf10009040 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 msgr2=0x7fdf20158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c410 tx=0x7fdf1800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 shutdown_connections 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf0c06ae70 0x7fdf0c06d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf2015e650 0x7fdf20158320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf200b0db0 0x7fdf200cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 --2- 172.21.15.93:0/3836527824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdf200afc00 0x7fdf2006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 >> 172.21.15.93:0/3836527824 conn(0x7fdf2009a140 msgr2=0x7fdf200adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:53.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 shutdown_connections 2023-11-04T01:35:53.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.009+0000 7fdf25eb4640 1 -- 172.21.15.93:0/3836527824 wait complete. 2023-11-04T01:35:53.024 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:35:53.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.130+0000 7f6f74a90640 1 Processor -- start 2023-11-04T01:35:53.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.130+0000 7f6f74a90640 1 -- start start 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f74a90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f7006a830 0x7f6f7015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f74a90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f700ccea0 con 0x7f6f7015ab00 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f74a90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f700cd180 con 0x7f6f7015aee0 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f74a90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7015b470 con 0x7f6f7006a830 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f6e59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6f7015ab00 0x7f6f700cc400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40898/0 (socket says 172.21.15.93:40898) 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f6e59c640 1 -- 172.21.15.93:0/1050490925 learned_addr learned my addr 172.21.15.93:0/1050490925 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.131+0000 7f6f6ed9d640 1 --2- 172.21.15.93:0/1050490925 >> v2:172.21.15.93:3300/0 conn(0x7f6f7006a830 0x7f6f7015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6ed9d640 1 -- 172.21.15.93:0/1050490925 >> v1:172.21.15.125:6789/0 conn(0x7f6f7015aee0 legacy=0x7f6f7006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:53.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6ed9d640 1 -- 172.21.15.93:0/1050490925 >> v1:172.21.15.93:6789/0 conn(0x7f6f7015ab00 legacy=0x7f6f700cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6ed9d640 1 -- 172.21.15.93:0/1050490925 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7015b750 con 0x7f6f7006a830 2023-11-04T01:35:53.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6d59a640 1 -- 172.21.15.93:0/1050490925 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69496728 0 0) 0x7f6f700ccea0 con 0x7f6f7015ab00 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6ed9d640 1 --2- 172.21.15.93:0/1050490925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f7015bc70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f680097a0 tx=0x7f6f6802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24865ed9518c337 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6d59a640 1 -- 172.21.15.93:0/1050490925 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68030610 con 0x7f6f7006a830 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6d59a640 1 -- 172.21.15.93:0/1050490925 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68030770 con 0x7f6f7006a830 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.132+0000 7f6f6d59a640 1 -- 172.21.15.93:0/1050490925 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68030b00 con 0x7f6f7006a830 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 -- 172.21.15.93:0/1050490925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 msgr2=0x7f6f7015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 --2- 172.21.15.93:0/1050490925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f7015bc70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f680097a0 tx=0x7f6f6802b960 comp rx=0 tx=0).stop 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 -- 172.21.15.93:0/1050490925 shutdown_connections 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 --2- 172.21.15.93:0/1050490925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f7015bc70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 -- 172.21.15.93:0/1050490925 >> 172.21.15.93:0/1050490925 conn(0x7f6f7006d8b0 msgr2=0x7f6f7006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:53.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 -- 172.21.15.93:0/1050490925 shutdown_connections 2023-11-04T01:35:53.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.133+0000 7f6f74a90640 1 -- 172.21.15.93:0/1050490925 wait complete. 2023-11-04T01:35:53.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.134+0000 7f6f74a90640 1 Processor -- start 2023-11-04T01:35:53.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.134+0000 7f6f74a90640 1 -- start start 2023-11-04T01:35:53.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 0x7f6f700ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 0x7f6f700acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7014e7e0 con 0x7f6f7006a830 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700cd5f0 con 0x7f6f7015ab00 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f74a90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700ce450 con 0x7f6f7015aee0 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60548/0 (socket says 172.21.15.93:60548) 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 -- 172.21.15.93:0/383035155 learned_addr learned my addr 172.21.15.93:0/383035155 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6dd9b640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 0x7f6f700ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6ed9d640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 0x7f6f700acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 -- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 msgr2=0x7f6f700acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 0x7f6f700acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 -- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 msgr2=0x7f6f700ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 0x7f6f700ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6e59c640 1 -- 172.21.15.93:0/383035155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68009400 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6dd9b640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 0x7f6f700ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.135+0000 7f6f6ed9d640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 0x7f6f700acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f6e59c640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c890 tx=0x7f6f6000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000a640 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000a7c0 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f700cd840 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000ab70 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.136+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f700cde00 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.137+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7015bc70 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.137+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f6000acd0 con 0x7f6f7006a830 2023-11-04T01:35:53.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.137+0000 7f6f5effd640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 0x7f6f5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:53.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.137+0000 7f6f6dd9b640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 0x7f6f5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:53.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.137+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6f60089040 con 0x7f6f7006a830 2023-11-04T01:35:53.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.138+0000 7f6f6dd9b640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 0x7f6f5006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f700caa50 tx=0x7f6f64008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:53.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.141+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f60054010 con 0x7f6f7006a830 2023-11-04T01:35:53.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:53.309+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6f700afea0 con 0x7f6f7006a830 2023-11-04T01:35:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.069+0000 7f6f5effd640 1 -- 172.21.15.93:0/383035155 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f6f60057630 con 0x7f6f7006a830 2023-11-04T01:35:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data_ec' created 2023-11-04T01:35:55.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 msgr2=0x7f6f5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 0x7f6f5006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f700caa50 tx=0x7f6f64008040 comp rx=0 tx=0).stop 2023-11-04T01:35:55.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 msgr2=0x7f6f700ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c890 tx=0x7f6f6000cd50 comp rx=0 tx=0).stop 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 shutdown_connections 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f5006ae70 0x7f6f5006d330 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f700caa50 tx=0x7f6f64008040 comp rx=0 tx=0).stop 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f7015aee0 0x7f6f700acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f7015ab00 0x7f6f700ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 --2- 172.21.15.93:0/383035155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f7006a830 0x7f6f700ce8e0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c890 tx=0x7f6f6000cd50 comp rx=0 tx=0).stop 2023-11-04T01:35:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.075+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 >> 172.21.15.93:0/383035155 conn(0x7f6f7006d8b0 msgr2=0x7f6f70158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.078+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 shutdown_connections 2023-11-04T01:35:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.080+0000 7f6f74a90640 1 -- 172.21.15.93:0/383035155 wait complete. 2023-11-04T01:35:55.096 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-04T01:35:55.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.200+0000 7f3f8c490640 1 Processor -- start 2023-11-04T01:35:55.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.200+0000 7f3f8c490640 1 -- start start 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8c490640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f840cb650 0x7f3f840b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8c490640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840cdc30 con 0x7f3f840cb270 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8c490640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840cd620 con 0x7f3f8406a830 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8c490640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8406fe00 con 0x7f3f840cb650 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8a22c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3f840cb270 0x7f3f8406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40900/0 (socket says 172.21.15.93:40900) 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8a22c640 1 -- 172.21.15.93:0/2092319665 learned_addr learned my addr 172.21.15.93:0/2092319665 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8aa2d640 1 --2- 172.21.15.93:0/2092319665 >> v2:172.21.15.125:3300/0 conn(0x7f3f840cb650 0x7f3f840b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287832851 0 0) 0x7f3f840cdc30 con 0x7f3f840cb270 2023-11-04T01:35:55.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.201+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f6c003520 con 0x7f3f840cb270 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734799750 0 0) 0x7f3f6c003520 con 0x7f3f840cb270 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 >> v2:172.21.15.125:3300/0 conn(0x7f3f840cb650 msgr2=0x7f3f840b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 --2- 172.21.15.93:0/2092319665 >> v2:172.21.15.125:3300/0 conn(0x7f3f840cb650 0x7f3f840b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 >> v1:172.21.15.125:6789/0 conn(0x7f3f8406a830 legacy=0x7f3f84160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840700e0 con 0x7f3f840cb270 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3f740019f0 con 0x7f3f840cb270 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8aa2d640 1 --2- 172.21.15.93:0/2092319665 >> v2:172.21.15.125:3300/0 conn(0x7f3f840cb650 0x7f3f840b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 >> v1:172.21.15.93:6789/0 conn(0x7f3f840cb270 legacy=0x7f3f8406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c003970 0x7f3f6c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 0x7f3f6c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c005040 0x7f3f6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8406fe00 con 0x7f3f6c004370 2023-11-04T01:35:55.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00bfa0 con 0x7f3f6c005040 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00c160 con 0x7f3f6c003970 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 0x7f3f6c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8a22c640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c003970 0x7f3f6c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8aa2d640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c005040 0x7f3f6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c003970 msgr2=0x7f3f6c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c003970 0x7f3f6c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c005040 msgr2=0x7f3f6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c005040 0x7f3f6c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f8aa2d640 1 -- 172.21.15.93:0/2092319665 reap_dead start 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.202+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2092319665 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c003520 con 0x7f3f6c004370 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 0x7f3f6c004840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001860 tx=0x7f3f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cb66b66e5b7a9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7802f050 con 0x7f3f6c004370 2023-11-04T01:35:55.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78033610 con 0x7f3f6c004370 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8922a640 1 -- 172.21.15.93:0/2092319665 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780339c0 con 0x7f3f6c004370 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8c490640 1 -- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 msgr2=0x7f3f6c004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 0x7f3f6c004840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001860 tx=0x7f3f6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8c490640 1 -- 172.21.15.93:0/2092319665 shutdown_connections 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.203+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2092319665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f6c004370 0x7f3f6c004840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.204+0000 7f3f8c490640 1 -- 172.21.15.93:0/2092319665 >> 172.21.15.93:0/2092319665 conn(0x7f3f8406d820 msgr2=0x7f3f8406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.204+0000 7f3f8c490640 1 -- 172.21.15.93:0/2092319665 shutdown_connections 2023-11-04T01:35:55.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.204+0000 7f3f8c490640 1 -- 172.21.15.93:0/2092319665 wait complete. 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 Processor -- start 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 -- start start 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c004370 0x7f3f840b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f840abe20 0x7f3f840cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840b6130 con 0x7f3f8415c240 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840ac380 con 0x7f3f6c004370 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f8c490640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840ac660 con 0x7f3f840abe20 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.205+0000 7f3f89a2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60566/0 (socket says 172.21.15.93:60566) 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2209448164 learned_addr learned my addr 172.21.15.93:0/2209448164 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f8aa2d640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f840abe20 0x7f3f840cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f8a22c640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c004370 0x7f3f840b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f840abe20 msgr2=0x7f3f840cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f840abe20 0x7f3f840cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c004370 msgr2=0x7f3f840b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c004370 0x7f3f840b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 -- 172.21.15.93:0/2209448164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840accd0 con 0x7f3f8415c240 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f89a2b640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7802bd30 tx=0x7f3f78001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7803d8e0 con 0x7f3f8415c240 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7803da40 con 0x7f3f8415c240 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f840acfb0 con 0x7f3f8415c240 2023-11-04T01:35:55.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7803ddf0 con 0x7f3f8415c240 2023-11-04T01:35:55.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.206+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f840aeda0 con 0x7f3f8415c240 2023-11-04T01:35:55.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.207+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8404e490 con 0x7f3f8415c240 2023-11-04T01:35:55.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.208+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f78047410 con 0x7f3f8415c240 2023-11-04T01:35:55.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.208+0000 7f3f82ffd640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 0x7f3f7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.208+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3f780abe70 con 0x7f3f8415c240 2023-11-04T01:35:55.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.208+0000 7f3f8a22c640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 0x7f3f7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.208+0000 7f3f8a22c640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 0x7f3f7006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f740013d0 tx=0x7f3f74006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:55.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.212+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f78076e00 con 0x7f3f8415c240 2023-11-04T01:35:55.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:55.378+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3f840b59d0 con 0x7f3f8415c240 2023-11-04T01:35:56.037 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:35:56.035+0000 7f699b707640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:35:56.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.073+0000 7f3f82ffd640 1 -- 172.21.15.93:0/2209448164 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3f7807a420 con 0x7f3f8415c240 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:set pool 4 allow_ec_overwrites to true 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 msgr2=0x7f3f7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 0x7f3f7006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f740013d0 tx=0x7f3f74006040 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 msgr2=0x7f3f840ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7802bd30 tx=0x7f3f78001230 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 shutdown_connections 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f7006aea0 0x7f3f7006d360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f840abe20 0x7f3f840cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f8415c240 0x7f3f840ab8e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 --2- 172.21.15.93:0/2209448164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c004370 0x7f3f840b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 >> 172.21.15.93:0/2209448164 conn(0x7f3f8406d820 msgr2=0x7f3f840b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 shutdown_connections 2023-11-04T01:35:56.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.076+0000 7f3f8c490640 1 -- 172.21.15.93:0/2209448164 wait complete. 2023-11-04T01:35:56.099 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-04T01:35:56.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.202+0000 7f1d76eda640 1 Processor -- start 2023-11-04T01:35:56.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.202+0000 7f1d76eda640 1 -- start start 2023-11-04T01:35:56.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d76eda640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1d700b1a40 0x7f1d700ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d76eda640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7006a830 0x7f1d700cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d76eda640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d70160990 con 0x7f1d701605b0 2023-11-04T01:35:56.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d76eda640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700cc7c0 con 0x7f1d700b1a40 2023-11-04T01:35:56.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d76eda640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700cd750 con 0x7f1d7006a830 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1d700b1a40 0x7f1d700ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1d700b1a40 0x7f1d700ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60576/0 (socket says 172.21.15.93:60576) 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 -- 172.21.15.93:0/194177931 learned_addr learned my addr 172.21.15.93:0/194177931 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d75477640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7006a830 0x7f1d700cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 -- 172.21.15.93:0/194177931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7006a830 msgr2=0x7f1d700cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7006a830 0x7f1d700cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 -- 172.21.15.93:0/194177931 >> v1:172.21.15.125:6789/0 conn(0x7f1d701605b0 legacy=0x7f1d7006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.203+0000 7f1d6ffff640 1 -- 172.21.15.93:0/194177931 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700cc4e0 con 0x7f1d700b1a40 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d6ffff640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d700b1a40 0x7f1d700ccbc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009870 tx=0x7f1d5c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9d83b949f1b8ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d6f7fe640 1 -- 172.21.15.93:0/194177931 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0317c0 con 0x7f1d700b1a40 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d6f7fe640 1 -- 172.21.15.93:0/194177931 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c031920 con 0x7f1d700b1a40 2023-11-04T01:35:56.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d6f7fe640 1 -- 172.21.15.93:0/194177931 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c031cb0 con 0x7f1d700b1a40 2023-11-04T01:35:56.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 -- 172.21.15.93:0/194177931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d700b1a40 msgr2=0x7f1d700ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d700b1a40 0x7f1d700ccbc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009870 tx=0x7f1d5c02b860 comp rx=0 tx=0).stop 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 -- 172.21.15.93:0/194177931 shutdown_connections 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7006a830 0x7f1d700cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 --2- 172.21.15.93:0/194177931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d700b1a40 0x7f1d700ccbc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 -- 172.21.15.93:0/194177931 >> 172.21.15.93:0/194177931 conn(0x7f1d70071820 msgr2=0x7f1d70071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 -- 172.21.15.93:0/194177931 shutdown_connections 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.204+0000 7f1d76eda640 1 -- 172.21.15.93:0/194177931 wait complete. 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 Processor -- start 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 -- start start 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 0x7f1d7015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7015dba0 0x7f1d700b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701570f0 con 0x7f1d701605b0 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701489d0 con 0x7f1d7006a830 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d76eda640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7015e0a0 con 0x7f1d7015dba0 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.206+0000 7f1d6ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60592/0 (socket says 172.21.15.93:60592) 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 -- 172.21.15.93:0/630395424 learned_addr learned my addr 172.21.15.93:0/630395424 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d74c76640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 0x7f1d7015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d75477640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7015dba0 0x7f1d700b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 -- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7015dba0 msgr2=0x7f1d700b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7015dba0 0x7f1d700b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 -- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 msgr2=0x7f1d7015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:56.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 0x7f1d7015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:56.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 -- 172.21.15.93:0/630395424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c0094d0 con 0x7f1d701605b0 2023-11-04T01:35:56.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d74c76640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 0x7f1d7015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:56.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6ffff640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c032860 con 0x7f1d701605b0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c0329e0 con 0x7f1d701605b0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7015e380 con 0x7f1d701605b0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c032d90 con 0x7f1d701605b0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.207+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7015e940 con 0x7f1d701605b0 2023-11-04T01:35:56.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.208+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d700672a0 con 0x7f1d701605b0 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.209+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d5c04d3f0 con 0x7f1d701605b0 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.209+0000 7f1d6d7fa640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 0x7f1d5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.209+0000 7f1d74c76640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 0x7f1d5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.209+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1d5c0ab770 con 0x7f1d701605b0 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.209+0000 7f1d74c76640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 0x7f1d5406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007fd0 tx=0x7f1d64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:56.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.213+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d5c0764d0 con 0x7f1d701605b0 2023-11-04T01:35:56.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:56.416+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f1d70074290 con 0x7f1d701605b0 2023-11-04T01:35:57.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.074+0000 7f1d6d7fa640 1 -- 172.21.15.93:0/630395424 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f1d5c079af0 con 0x7f1d701605b0 2023-11-04T01:35:57.076 INFO:teuthology.orchestra.run.smithi093.stderr:added data pool 4 to fsmap 2023-11-04T01:35:57.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 msgr2=0x7f1d5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 0x7f1d5406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007fd0 tx=0x7f1d64009040 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 msgr2=0x7f1d700c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 shutdown_connections 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d5406ae70 0x7f1d5406d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d7015dba0 0x7f1d700b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d701605b0 0x7f1d700c9510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 --2- 172.21.15.93:0/630395424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d7006a830 0x7f1d7015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 >> 172.21.15.93:0/630395424 conn(0x7f1d70071820 msgr2=0x7f1d7015ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 shutdown_connections 2023-11-04T01:35:57.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.076+0000 7f1d76eda640 1 -- 172.21.15.93:0/630395424 wait complete. 2023-11-04T01:35:57.090 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:57.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 Processor -- start 2023-11-04T01:35:57.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 -- start start 2023-11-04T01:35:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f232c15ac70 0x7f232c0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 0x7f232c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c0b3c10 con 0x7f232c0cec10 2023-11-04T01:35:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0cf180 con 0x7f232c15ac70 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.187+0000 7f2330aa9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0cf460 con 0x7f232c0b2d10 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f232c15ac70 0x7f232c0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f232c15ac70 0x7f232c0d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60604/0 (socket says 172.21.15.93:60604) 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 -- 172.21.15.93:0/65297677 learned_addr learned my addr 172.21.15.93:0/65297677 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232ad9d640 1 --2- 172.21.15.93:0/65297677 >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 0x7f232c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 -- 172.21.15.93:0/65297677 >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 msgr2=0x7f232c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 --2- 172.21.15.93:0/65297677 >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 0x7f232c0b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 -- 172.21.15.93:0/65297677 >> v1:172.21.15.125:6789/0 conn(0x7f232c0cec10 legacy=0x7f232c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232a59c640 1 -- 172.21.15.93:0/65297677 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0cf740 con 0x7f232c15ac70 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.188+0000 7f232ad9d640 1 --2- 172.21.15.93:0/65297677 >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 0x7f232c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f232a59c640 1 --2- 172.21.15.93:0/65297677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c0d0330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f232c0cd560 tx=0x7f231c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71986e09d662754 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2329d9b640 1 -- 172.21.15.93:0/65297677 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c004230 con 0x7f232c15ac70 2023-11-04T01:35:57.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2329d9b640 1 -- 172.21.15.93:0/65297677 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c004390 con 0x7f232c15ac70 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2329d9b640 1 -- 172.21.15.93:0/65297677 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c031830 con 0x7f232c15ac70 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 -- 172.21.15.93:0/65297677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 msgr2=0x7f232c0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 --2- 172.21.15.93:0/65297677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c0d0330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f232c0cd560 tx=0x7f231c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 -- 172.21.15.93:0/65297677 shutdown_connections 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 --2- 172.21.15.93:0/65297677 >> v2:172.21.15.125:3300/0 conn(0x7f232c0b2d10 0x7f232c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 --2- 172.21.15.93:0/65297677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c0d0330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 -- 172.21.15.93:0/65297677 >> 172.21.15.93:0/65297677 conn(0x7f232c0cd600 msgr2=0x7f232c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 -- 172.21.15.93:0/65297677 shutdown_connections 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.189+0000 7f2330aa9640 1 -- 172.21.15.93:0/65297677 wait complete. 2023-11-04T01:35:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 Processor -- start 2023-11-04T01:35:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 -- start start 2023-11-04T01:35:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232c0b2d10 0x7f232c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f232c0cec10 0x7f232c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c15b820 con 0x7f232c15ac70 2023-11-04T01:35:57.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1541d0 con 0x7f232c0b2d10 2023-11-04T01:35:57.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f2330aa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1544b0 con 0x7f232c0cec10 2023-11-04T01:35:57.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60606/0 (socket says 172.21.15.93:60606) 2023-11-04T01:35:57.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.191+0000 7f232ad9d640 1 -- 172.21.15.93:0/1625562600 learned_addr learned my addr 172.21.15.93:0/1625562600 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232a59c640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232c0b2d10 0x7f232c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2323fff640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f232c0cec10 0x7f232c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 -- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f232c0cec10 msgr2=0x7f232c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f232c0cec10 0x7f232c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 -- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232c0b2d10 msgr2=0x7f232c150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232c0b2d10 0x7f232c150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 -- 172.21.15.93:0/1625562600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009460 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f232ad9d640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f232400cef0 tx=0x7f232400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400d840 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232400d9c0 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c15b1d0 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400dd70 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.192+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c14f0d0 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.193+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c15b9d0 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.193+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f232401e3b0 con 0x7f232c15ac70 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.194+0000 7f2322ffd640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 0x7f230c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.194+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f232408a3a0 con 0x7f232c15ac70 2023-11-04T01:35:57.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.194+0000 7f232a59c640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 0x7f230c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.194+0000 7f232a59c640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 0x7f230c06d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f231c035000 tx=0x7f231c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.198+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f232c15b9d0 con 0x7f232c15ac70 2023-11-04T01:35:57.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.400+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f232c15b960 con 0x7f232c15ac70 2023-11-04T01:35:57.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.401+0000 7f2322ffd640 1 -- 172.21.15.93:0/1625562600 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f2324055220 con 0x7f232c15ac70 2023-11-04T01:35:57.403 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:35:56.418138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:35:57.404 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 7 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 msgr2=0x7f230c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 0x7f230c06d360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f231c035000 tx=0x7f231c008030 comp rx=0 tx=0).stop 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 msgr2=0x7f232c1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f232400cef0 tx=0x7f232400a710 comp rx=0 tx=0).stop 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 shutdown_connections 2023-11-04T01:35:57.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230c06aea0 0x7f230c06d360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232c15ac70 0x7f232c1538d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f232c0cec10 0x7f232c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 --2- 172.21.15.93:0/1625562600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232c0b2d10 0x7f232c150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.402+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 >> 172.21.15.93:0/1625562600 conn(0x7f232c0cd600 msgr2=0x7f232c0c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.403+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 shutdown_connections 2023-11-04T01:35:57.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.403+0000 7f2330aa9640 1 -- 172.21.15.93:0/1625562600 wait complete. 2023-11-04T01:35:57.415 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 Processor -- start 2023-11-04T01:35:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 -- start start 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f16a815ab70 0x7f16a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a806eba0 0x7f16a806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a806aa90 con 0x7f16a806a660 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80cba70 con 0x7f16a815ab70 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.513+0000 7f16acfc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8161c50 con 0x7f16a806eba0 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f16a815ab70 0x7f16a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f16a815ab70 0x7f16a80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60612/0 (socket says 172.21.15.93:60612) 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 -- 172.21.15.93:0/1063886805 learned_addr learned my addr 172.21.15.93:0/1063886805 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 -- 172.21.15.93:0/1063886805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a806eba0 msgr2=0x7f16a806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 --2- 172.21.15.93:0/1063886805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a806eba0 0x7f16a806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 -- 172.21.15.93:0/1063886805 >> v1:172.21.15.125:6789/0 conn(0x7f16a806a660 legacy=0x7f16a80ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.514+0000 7f16a659c640 1 -- 172.21.15.93:0/1063886805 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a806d310 con 0x7f16a815ab70 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16a659c640 1 --2- 172.21.15.93:0/1063886805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a815ab70 0x7f16a80cbea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1698009850 tx=0x7f169802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94cd1c1df8eb9ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16a5d9b640 1 -- 172.21.15.93:0/1063886805 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169802e070 con 0x7f16a815ab70 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16a5d9b640 1 -- 172.21.15.93:0/1063886805 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698004030 con 0x7f16a815ab70 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16a5d9b640 1 -- 172.21.15.93:0/1063886805 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698004420 con 0x7f16a815ab70 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 -- 172.21.15.93:0/1063886805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a815ab70 msgr2=0x7f16a80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1063886805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a815ab70 0x7f16a80cbea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1698009850 tx=0x7f169802b840 comp rx=0 tx=0).stop 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 -- 172.21.15.93:0/1063886805 shutdown_connections 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1063886805 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a806eba0 0x7f16a806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1063886805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a815ab70 0x7f16a80cbea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 -- 172.21.15.93:0/1063886805 >> 172.21.15.93:0/1063886805 conn(0x7f16a8098d40 msgr2=0x7f16a80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 -- 172.21.15.93:0/1063886805 shutdown_connections 2023-11-04T01:35:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.515+0000 7f16acfc9640 1 -- 172.21.15.93:0/1063886805 wait complete. 2023-11-04T01:35:57.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 Processor -- start 2023-11-04T01:35:57.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 -- start start 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a806a660 0x7f16a8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a815ab70 0x7f16a80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c5fb0 con 0x7f16a806eba0 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8156540 con 0x7f16a806a660 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f16acfc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c53a0 con 0x7f16a815ab70 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.517+0000 7f169dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60614/0 (socket says 172.21.15.93:60614) 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 -- 172.21.15.93:0/1582673237 learned_addr learned my addr 172.21.15.93:0/1582673237 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f16a659c640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a806a660 0x7f16a8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f16a6d9d640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a815ab70 0x7f16a80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 -- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a815ab70 msgr2=0x7f16a80b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a815ab70 0x7f16a80b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 -- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a806a660 msgr2=0x7f16a8156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a806a660 0x7f16a8156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 -- 172.21.15.93:0/1582673237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009460 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169dd9b640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f169000b4a0 tx=0x7f169000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690005a10 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690005b70 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80c5680 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690010610 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.518+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80c5c40 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.519+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80c6160 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.520+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1690010770 con 0x7f16a806eba0 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.520+0000 7f169f7fe640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 0x7f168806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.520+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1690089130 con 0x7f16a806eba0 2023-11-04T01:35:57.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.520+0000 7f16a659c640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 0x7f168806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.520+0000 7f16a659c640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 0x7f168806d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1698034000 tx=0x7f1698008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.524+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1690053f20 con 0x7f16a806eba0 2023-11-04T01:35:57.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.692+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a806a450 con 0x7f16a806eba0 2023-11-04T01:35:57.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.694+0000 7f169f7fe640 1 -- 172.21.15.93:0/1582673237 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f1690057540 con 0x7f16a806eba0 2023-11-04T01:35:57.696 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.695+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 msgr2=0x7f168806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.695+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 0x7f168806d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1698034000 tx=0x7f1698008030 comp rx=0 tx=0).stop 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.695+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 msgr2=0x7f16a80c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.695+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f169000b4a0 tx=0x7f169000b960 comp rx=0 tx=0).stop 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 shutdown_connections 2023-11-04T01:35:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f168806ae70 0x7f168806d330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16a815ab70 0x7f16a80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16a806eba0 0x7f16a80c48e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 --2- 172.21.15.93:0/1582673237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16a806a660 0x7f16a8156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 >> 172.21.15.93:0/1582673237 conn(0x7f16a8098d40 msgr2=0x7f16a80cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 shutdown_connections 2023-11-04T01:35:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.696+0000 7f16acfc9640 1 -- 172.21.15.93:0/1582673237 wait complete. 2023-11-04T01:35:57.709 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.805+0000 7fc5ba14c640 1 Processor -- start 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.805+0000 7fc5ba14c640 1 -- start start 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5ba14c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5b40cce10 0x7fc5b40b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5ba14c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc5b406a830 0x7fc5b415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5ba14c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b415e6e0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5ba14c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b415dd10 con 0x7fc5b40cce10 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5ba14c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b415d720 con 0x7fc5b406a830 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5b37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5b40cce10 0x7fc5b40b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5b37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5b40cce10 0x7fc5b40b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60616/0 (socket says 172.21.15.93:60616) 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5b37fe640 1 -- 172.21.15.93:0/110411317 learned_addr learned my addr 172.21.15.93:0/110411317 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5b3fff640 1 --2- 172.21.15.93:0/110411317 >> v2:172.21.15.125:3300/0 conn(0x7fc5b406a830 0x7fc5b415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.806+0000 7fc5b37fe640 1 -- 172.21.15.93:0/110411317 >> v2:172.21.15.125:3300/0 conn(0x7fc5b406a830 msgr2=0x7fc5b415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b37fe640 1 --2- 172.21.15.93:0/110411317 >> v2:172.21.15.125:3300/0 conn(0x7fc5b406a830 0x7fc5b415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b37fe640 1 -- 172.21.15.93:0/110411317 >> v1:172.21.15.125:6789/0 conn(0x7fc5b40b18b0 legacy=0x7fc5b406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b37fe640 1 -- 172.21.15.93:0/110411317 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b406fe00 con 0x7fc5b40cce10 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b37fe640 1 --2- 172.21.15.93:0/110411317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40cce10 0x7fc5b40b1fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40c34a0 tx=0x7fc5a402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3024179463c7fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b27fc640 1 -- 172.21.15.93:0/110411317 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031750 con 0x7fc5b40cce10 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b27fc640 1 -- 172.21.15.93:0/110411317 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40318b0 con 0x7fc5b40cce10 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.807+0000 7fc5b27fc640 1 -- 172.21.15.93:0/110411317 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031c40 con 0x7fc5b40cce10 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 -- 172.21.15.93:0/110411317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40cce10 msgr2=0x7fc5b40b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/110411317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40cce10 0x7fc5b40b1fc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40c34a0 tx=0x7fc5a402b7f0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 -- 172.21.15.93:0/110411317 shutdown_connections 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/110411317 >> v2:172.21.15.125:3300/0 conn(0x7fc5b406a830 0x7fc5b415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/110411317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40cce10 0x7fc5b40b1fc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 -- 172.21.15.93:0/110411317 >> 172.21.15.93:0/110411317 conn(0x7fc5b406d8b0 msgr2=0x7fc5b406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 -- 172.21.15.93:0/110411317 shutdown_connections 2023-11-04T01:35:57.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.808+0000 7fc5ba14c640 1 -- 172.21.15.93:0/110411317 wait complete. 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.809+0000 7fc5ba14c640 1 Processor -- start 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.809+0000 7fc5ba14c640 1 -- start start 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5b406a830 0x7fc5b40c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b40cce10 0x7fc5b4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40c7030 con 0x7fc5b40b18b0 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40c7200 con 0x7fc5b40cce10 2023-11-04T01:35:57.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5ba14c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40c74c0 con 0x7fc5b406a830 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60622/0 (socket says 172.21.15.93:60622) 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 -- 172.21.15.93:0/4247156457 learned_addr learned my addr 172.21.15.93:0/4247156457 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b37fe640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5b406a830 0x7fc5b40c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b3fff640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b40cce10 0x7fc5b4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 -- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5b406a830 msgr2=0x7fc5b40c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5b406a830 0x7fc5b40c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 -- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b40cce10 msgr2=0x7fc5b4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b40cce10 0x7fc5b4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 -- 172.21.15.93:0/4247156457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40094d0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.810+0000 7fc5b2ffd640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b3f0 tx=0x7fc5a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.811+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011830 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.811+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8011990 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.811+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b40c77a0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.811+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d40 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.811+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b40c7d60 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.812+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b40674e0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.812+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5a801a400 con 0x7fc5b40b18b0 2023-11-04T01:35:57.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.812+0000 7fc59bfff640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 0x7fc5a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:57.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.813+0000 7fc5b37fe640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 0x7fc5a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.813+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5a80899e0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.813+0000 7fc5b37fe640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 0x7fc5a006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4035000 tx=0x7fc5a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:57.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.817+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5a8054830 con 0x7fc5b40b18b0 2023-11-04T01:35:57.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.985+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5b40b59a0 con 0x7fc5b40b18b0 2023-11-04T01:35:57.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.986+0000 7fc59bfff640 1 -- 172.21.15.93:0/4247156457 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fc5a8015090 con 0x7fc5b40b18b0 2023-11-04T01:35:57.989 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 msgr2=0x7fc5a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 0x7fc5a006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4035000 tx=0x7fc5a4008030 comp rx=0 tx=0).stop 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 msgr2=0x7fc5b415fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b3f0 tx=0x7fc5a800b8b0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 shutdown_connections 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc5a006ae70 0x7fc5a006d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b40cce10 0x7fc5b4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5b40b18b0 0x7fc5b415fc70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 --2- 172.21.15.93:0/4247156457 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5b406a830 0x7fc5b40c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:57.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 >> 172.21.15.93:0/4247156457 conn(0x7fc5b406d8b0 msgr2=0x7fc5b40ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:57.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 shutdown_connections 2023-11-04T01:35:57.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:57.988+0000 7fc5ba14c640 1 -- 172.21.15.93:0/4247156457 wait complete. 2023-11-04T01:35:58.064 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:35:58.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.164+0000 7ff6be21a640 1 Processor -- start 2023-11-04T01:35:58.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.164+0000 7ff6be21a640 1 -- start start 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6be21a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 0x7ff6b8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6be21a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6b8157540 0x7ff6b80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6be21a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b815e000 con 0x7ff6b80cde60 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6be21a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b815e5c0 con 0x7ff6b8157540 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6be21a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815e2e0 con 0x7ff6b80ce240 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6affff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 0x7ff6b8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b7fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6b8157540 0x7ff6b80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b77fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff6b80cde60 0x7ff6b815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:53966/0 (socket says 172.21.15.93:53966) 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6affff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 0x7ff6b8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:36820/0 (socket says 172.21.15.93:36820) 2023-11-04T01:35:58.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b77fe640 1 -- 172.21.15.93:0/1732064727 learned_addr learned my addr 172.21.15.93:0/1732064727 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:58.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b7fff640 1 -- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 msgr2=0x7ff6b8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b7fff640 1 --2- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 0x7ff6b8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b7fff640 1 -- 172.21.15.93:0/1732064727 >> v1:172.21.15.125:6789/0 conn(0x7ff6b80cde60 legacy=0x7ff6b815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.165+0000 7ff6b7fff640 1 -- 172.21.15.93:0/1732064727 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80d1120 con 0x7ff6b8157540 2023-11-04T01:35:58.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.166+0000 7ff6b7fff640 1 --2- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b8157540 0x7ff6b80d1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009d90 tx=0x7ff6b002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180cf25a93c2b7fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.166+0000 7ff6b6ffd640 1 -- 172.21.15.93:0/1732064727 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b002cc50 con 0x7ff6b8157540 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.166+0000 7ff6b6ffd640 1 -- 172.21.15.93:0/1732064727 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b002cdb0 con 0x7ff6b8157540 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.166+0000 7ff6b6ffd640 1 -- 172.21.15.93:0/1732064727 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0034660 con 0x7ff6b8157540 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 -- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b8157540 msgr2=0x7ff6b80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b8157540 0x7ff6b80d1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009d90 tx=0x7ff6b002bea0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 -- 172.21.15.93:0/1732064727 shutdown_connections 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b8157540 0x7ff6b80d1920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1732064727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b80ce240 0x7ff6b8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 -- 172.21.15.93:0/1732064727 >> 172.21.15.93:0/1732064727 conn(0x7ff6b8071f30 msgr2=0x7ff6b80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 -- 172.21.15.93:0/1732064727 shutdown_connections 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.167+0000 7ff6be21a640 1 -- 172.21.15.93:0/1732064727 wait complete. 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.168+0000 7ff6be21a640 1 Processor -- start 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.168+0000 7ff6be21a640 1 -- start start 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b80cde60 0x7ff6b81f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 0x7ff6b81f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b814c0e0 con 0x7ff6b80ce240 2023-11-04T01:35:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b814c980 con 0x7ff6b80cde60 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b814b9e0 con 0x7ff6b8157540 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60628/0 (socket says 172.21.15.93:60628) 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 -- 172.21.15.93:0/1805327882 learned_addr learned my addr 172.21.15.93:0/1805327882 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b77fe640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b80cde60 0x7ff6b81f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b7fff640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 0x7ff6b81f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 -- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 msgr2=0x7ff6b81f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 0x7ff6b81f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 -- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b80cde60 msgr2=0x7ff6b81f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b80cde60 0x7ff6b81f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 -- 172.21.15.93:0/1805327882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009a70 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b7fff640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 0x7ff6b81f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6affff640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e9e0 tx=0x7ff6a000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0009670 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000c9d0 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b814c330 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000cd80 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.169+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b81f2180 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.170+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b814cb10 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.171+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6a0013470 con 0x7ff6b80ce240 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.171+0000 7ff6b4ff9640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 0x7ff69806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.171+0000 7ff6b77fe640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 0x7ff69806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.171+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6a0089a40 con 0x7ff6b80ce240 2023-11-04T01:35:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.172+0000 7ff6b77fe640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 0x7ff69806d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005880 tx=0x7ff6a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.175+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6a00548a0 con 0x7ff6b80ce240 2023-11-04T01:35:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.375+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6b8074290 con 0x7ff6b80ce240 2023-11-04T01:35:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.376+0000 7ff6b4ff9640 1 -- 172.21.15.93:0/1805327882 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7ff6a0017090 con 0x7ff6b80ce240 2023-11-04T01:35:58.379 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:35:56.418138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:35:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 7 2023-11-04T01:35:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 msgr2=0x7ff69806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 0x7ff69806d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005880 tx=0x7ff6a8009040 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 msgr2=0x7ff6b81f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e9e0 tx=0x7ff6a000eea0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 shutdown_connections 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff69806aea0 0x7ff69806d360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6b8157540 0x7ff6b81f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce240 0x7ff6b81f5980 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 --2- 172.21.15.93:0/1805327882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6b80cde60 0x7ff6b81f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 >> 172.21.15.93:0/1805327882 conn(0x7ff6b8071f30 msgr2=0x7ff6b80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 shutdown_connections 2023-11-04T01:35:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.378+0000 7ff6be21a640 1 -- 172.21.15.93:0/1805327882 wait complete. 2023-11-04T01:35:58.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:35:58.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 Processor -- start 2023-11-04T01:35:58.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 -- start start 2023-11-04T01:35:58.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6e40cc870 0x7ff6e40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e40cd690 con 0x7ff6e4159da0 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e40cd970 con 0x7ff6e40cc430 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.488+0000 7ff6ea76e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e40cdc50 con 0x7ff6e40cc870 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff6e4159da0 0x7ff6e40b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40914/0 (socket says 172.21.15.93:40914) 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e3fff640 1 -- 172.21.15.93:0/508419030 learned_addr learned my addr 172.21.15.93:0/508419030 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160550359 0 0) 0x7ff6e40cd690 con 0x7ff6e4159da0 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e8d0b640 1 --2- 172.21.15.93:0/508419030 >> v2:172.21.15.125:3300/0 conn(0x7ff6e40cc870 0x7ff6e40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003520 con 0x7ff6e4159da0 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639507659 0 0) 0x7ff6cc003520 con 0x7ff6e4159da0 2023-11-04T01:35:58.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 >> v2:172.21.15.125:3300/0 conn(0x7ff6e40cc870 msgr2=0x7ff6e40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 --2- 172.21.15.93:0/508419030 >> v2:172.21.15.125:3300/0 conn(0x7ff6e40cc870 0x7ff6e40cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 >> v1:172.21.15.125:6789/0 conn(0x7ff6e40cc430 legacy=0x7ff6e40ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e40cdf30 con 0x7ff6e4159da0 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff6d4001670 con 0x7ff6e4159da0 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 >> v1:172.21.15.93:6789/0 conn(0x7ff6e4159da0 legacy=0x7ff6e40b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6cc003970 0x7ff6cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6cc005180 0x7ff6cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40cdc50 con 0x7ff6cc0047c0 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc00c020 con 0x7ff6cc003970 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc00c1e0 con 0x7ff6cc005180 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e3fff640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6cc003970 0x7ff6cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.489+0000 7ff6e8d0b640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6cc005180 0x7ff6cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 -- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6cc005180 msgr2=0x7ff6cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6cc005180 0x7ff6cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 -- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6cc003970 msgr2=0x7ff6cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6cc003970 0x7ff6cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 -- 172.21.15.93:0/508419030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc003520 con 0x7ff6cc0047c0 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e8d0b640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6cc005180 0x7ff6cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e8d0b640 1 -- 172.21.15.93:0/508419030 reap_dead start 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6cc004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001750 tx=0x7ff6cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd839a4ae0026e63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80052d0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d802e050 con 0x7ff6cc0047c0 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.490+0000 7ff6e2ffd640 1 -- 172.21.15.93:0/508419030 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003830 con 0x7ff6cc0047c0 2023-11-04T01:35:58.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 -- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 msgr2=0x7ff6cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6cc004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001750 tx=0x7ff6cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 -- 172.21.15.93:0/508419030 shutdown_connections 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/508419030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6cc004c40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 -- 172.21.15.93:0/508419030 >> 172.21.15.93:0/508419030 conn(0x7ff6e406d8b0 msgr2=0x7ff6e406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 -- 172.21.15.93:0/508419030 shutdown_connections 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.491+0000 7ff6ea76e640 1 -- 172.21.15.93:0/508419030 wait complete. 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.492+0000 7ff6ea76e640 1 Processor -- start 2023-11-04T01:35:58.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.492+0000 7ff6ea76e640 1 -- start start 2023-11-04T01:35:58.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6e41f1350 0x7ff6e40b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 0x7ff6e41f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e41f11d0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40b2020 con 0x7ff6e40b1ba0 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6ea76e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40c6c70 con 0x7ff6e41f1350 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60642/0 (socket says 172.21.15.93:60642) 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 -- 172.21.15.93:0/852633911 learned_addr learned my addr 172.21.15.93:0/852633911 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6e41f1350 0x7ff6e40b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 -- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6e41f1350 msgr2=0x7ff6e40b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6e41f1350 0x7ff6e40b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e8d0b640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 0x7ff6e41f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 -- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 msgr2=0x7ff6e41f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 0x7ff6e41f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 -- 172.21.15.93:0/852633911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e40c6f50 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e8d0b640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 0x7ff6e41f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.493+0000 7ff6e3fff640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007290 tx=0x7ff6d4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.494+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4001650 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.494+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400f9c0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.494+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e40c7230 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.494+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400fd50 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.494+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e41f17d0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.495+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e406e1d0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.495+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6d401d460 con 0x7ff6cc0047c0 2023-11-04T01:35:58.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.495+0000 7ff6e0ff9640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 0x7ff6d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.495+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6d4089a10 con 0x7ff6cc0047c0 2023-11-04T01:35:58.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.495+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 0x7ff6d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.496+0000 7ff6e37fe640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 0x7ff6d006d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8033000 tx=0x7ff6d8009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:58.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.499+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6d40547d0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.668+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e40674e0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.670+0000 7ff6e0ff9640 1 -- 172.21.15.93:0/852633911 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7ff6d4057df0 con 0x7ff6cc0047c0 2023-11-04T01:35:58.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:35:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:35:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 msgr2=0x7ff6d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 0x7ff6d006d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8033000 tx=0x7ff6d8009030 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 msgr2=0x7ff6e40adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007290 tx=0x7ff6d4007750 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 shutdown_connections 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6d006aea0 0x7ff6d006d360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6e40b1ba0 0x7ff6e41f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6e41f1350 0x7ff6e40b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 --2- 172.21.15.93:0/852633911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6cc0047c0 0x7ff6e40adfa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 >> 172.21.15.93:0/852633911 conn(0x7ff6e406d8b0 msgr2=0x7ff6e4159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 shutdown_connections 2023-11-04T01:35:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:58.672+0000 7ff6ea76e640 1 -- 172.21.15.93:0/852633911 wait complete. 2023-11-04T01:35:59.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:35:51.391271+0000', 'modified': '2023-11-04T01:35:56.418138+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6835/2694324946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6834', 'nonce': 2694324946}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 2694324946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-04T01:35:59.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:35:59.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:35:59.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 Processor -- start 2023-11-04T01:35:59.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 -- start start 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb44015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400cde60 con 0x7fb4400b4880 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440160f90 con 0x7fb4400cd6d0 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.189+0000 7fb4459b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44015e400 con 0x7fb440153e60 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb4400b4880 0x7fb4400d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40924/0 (socket says 172.21.15.93:40924) 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43f7fe640 1 -- 172.21.15.93:0/805940376 learned_addr learned my addr 172.21.15.93:0/805940376 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb44015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745526079 0 0) 0x7fb4400cde60 con 0x7fb4400b4880 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb428003520 con 0x7fb4400b4880 2023-11-04T01:35:59.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243496779 0 0) 0x7fb428003520 con 0x7fb4400b4880 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 msgr2=0x7fb44015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb44015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 >> v1:172.21.15.125:6789/0 conn(0x7fb4400cd6d0 legacy=0x7fb440161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400ce090 con 0x7fb4400b4880 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fb4380019f0 con 0x7fb4400b4880 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 >> v1:172.21.15.93:6789/0 conn(0x7fb4400b4880 legacy=0x7fb4400d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb428003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb4280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb428004d00 0x7fb428005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44015e400 con 0x7fb4280039a0 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42800b980 con 0x7fb428004d00 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42800bb40 con 0x7fb440153e60 2023-11-04T01:35:59.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb428003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb428004d00 0x7fb428005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb4280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 -- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 msgr2=0x7fb4280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb440153e60 0x7fb4280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 -- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb428004d00 msgr2=0x7fb428005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb428004d00 0x7fb428005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43effd640 1 -- 172.21.15.93:0/805940376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428003520 con 0x7fb4280039a0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.190+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb428004d00 0x7fb428005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.191+0000 7fb43effd640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb428003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb430009ac0 tx=0x7fb4280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba3337040823dae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.191+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43002c600 con 0x7fb4280039a0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.191+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43002c760 con 0x7fb4280039a0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.191+0000 7fb43dffb640 1 -- 172.21.15.93:0/805940376 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43002caf0 con 0x7fb4280039a0 2023-11-04T01:35:59.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 -- 172.21.15.93:0/805940376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 msgr2=0x7fb428003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 --2- 172.21.15.93:0/805940376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb428003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb430009ac0 tx=0x7fb4280057f0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb43f7fe640 1 -- 172.21.15.93:0/805940376 reap_dead start 2023-11-04T01:35:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 -- 172.21.15.93:0/805940376 shutdown_connections 2023-11-04T01:35:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 -- 172.21.15.93:0/805940376 >> 172.21.15.93:0/805940376 conn(0x7fb4400cf880 msgr2=0x7fb4400cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 -- 172.21.15.93:0/805940376 shutdown_connections 2023-11-04T01:35:59.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.192+0000 7fb4459b6640 1 -- 172.21.15.93:0/805940376 wait complete. 2023-11-04T01:35:59.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.193+0000 7fb4459b6640 1 Processor -- start 2023-11-04T01:35:59.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.193+0000 7fb4459b6640 1 -- start start 2023-11-04T01:35:59.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 0x7fb440155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4400cc2b0 0x7fb4400cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb440156b80 con 0x7fb4280039a0 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44014ece0 con 0x7fb440152440 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440155f70 con 0x7fb4400cc2b0 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60654/0 (socket says 172.21.15.93:60654) 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 -- 172.21.15.93:0/2026868712 learned_addr learned my addr 172.21.15.93:0/2026868712 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4400cc2b0 0x7fb4400cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 0x7fb440155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 -- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4400cc2b0 msgr2=0x7fb4400cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4400cc2b0 0x7fb4400cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 -- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 msgr2=0x7fb440155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 0x7fb440155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 -- 172.21.15.93:0/2026868712 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440156250 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 0x7fb440155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb43effd640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb43002c1a0 tx=0x7fb430004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb427fff640 1 -- 172.21.15.93:0/2026868712 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430003810 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb427fff640 1 -- 172.21.15.93:0/2026868712 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430003970 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb440156b80 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.194+0000 7fb427fff640 1 -- 172.21.15.93:0/2026868712 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430003ce0 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.195+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb440156810 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.196+0000 7fb427fff640 1 -- 172.21.15.93:0/2026868712 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb430034440 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.196+0000 7fb427fff640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 0x7fb42c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.196+0000 7fb427fff640 1 -- 172.21.15.93:0/2026868712 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4300ab8e0 con 0x7fb4280039a0 2023-11-04T01:35:59.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.196+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 0x7fb42c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.197+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 0x7fb42c06d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb434007fd0 tx=0x7fb434009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.197+0000 7fb448627740 1 Processor -- start 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.197+0000 7fb448627740 1 -- start start 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bbed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bafe740 con 0x562b7bbedc90 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bb608d0 con 0x562b7bc1ac30 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b7bb5dfc0 con 0x562b7bc1a850 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60670/0 (socket says 172.21.15.93:60670) 2023-11-04T01:35:59.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 -- 172.21.15.93:0/3429567800 learned_addr learned my addr 172.21.15.93:0/3429567800 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43effd640 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bbed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 -- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 msgr2=0x562b7bbed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bbed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 -- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 msgr2=0x562b7bc1d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.198+0000 7fb43f7fe640 1 -- 172.21.15.93:0/3429567800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b7bb1cca0 con 0x562b7bbedc90 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4400c6900 tx=0x7fb438005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1271dcc198e12901 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb4257fa640 1 -- 172.21.15.93:0/3429567800 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438007790 con 0x562b7bbedc90 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb4257fa640 1 -- 172.21.15.93:0/3429567800 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380078f0 con 0x562b7bbedc90 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb4257fa640 1 -- 172.21.15.93:0/3429567800 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438014400 con 0x562b7bbedc90 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 -- 172.21.15.93:0/3429567800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 msgr2=0x562b7bc1db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4400c6900 tx=0x7fb438005f40 comp rx=0 tx=0).stop 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 -- 172.21.15.93:0/3429567800 shutdown_connections 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bbedc90 0x562b7bc1db20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 --2- 172.21.15.93:0/3429567800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bbed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 -- 172.21.15.93:0/3429567800 >> 172.21.15.93:0/3429567800 conn(0x562b7bbefa60 msgr2=0x562b7bc385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 -- 172.21.15.93:0/3429567800 shutdown_connections 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.199+0000 7fb448627740 1 -- 172.21.15.93:0/3429567800 wait complete. 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.200+0000 7fb448627740 1 -- start start 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.200+0000 7fb448627740 1 Processor -- start 2023-11-04T01:35:59.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc19780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 0x562b7bc48080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bb598b0 con 0x562b7bc1ac30 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bb13c80 con 0x562b7bc33150 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b7bb13920 con 0x562b7bc1a850 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 10 client.0 _ll_register_callbacks cb 0x562b7b86bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60684/0 (socket says 172.21.15.93:60684) 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 -- 172.21.15.93:0/996150454 learned_addr learned my addr 172.21.15.93:0/996150454 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43effd640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc19780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 0x562b7bc48080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 -- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 msgr2=0x562b7bc19780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc19780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 -- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 msgr2=0x562b7bc48080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 0x562b7bc48080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 -- 172.21.15.93:0/996150454 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43800f040 con 0x562b7bc1ac30 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43effd640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc19780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 0x562b7bc48080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb434001de0 tx=0x7fb4340012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0f44dcecaa7119 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb41e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434027070 con 0x562b7bc1ac30 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb43401c070 con 0x562b7bc1ac30 2023-11-04T01:35:59.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.201+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b7bb05bf0 con 0x562b7bc1ac30 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb434014e10 con 0x562b7bc1ac30 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 10 client.4416 fetch_fsmap learned FSMap version 7 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562b7bb57f30 con 0x562b7bc1ac30 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434031020 con 0x562b7bc1ac30 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fb43402a020 con 0x562b7bc1ac30 2023-11-04T01:35:59.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 20 client.4416 populate_metadata read hostname 'smithi093' 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc53810 0x562b7bc55c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 4 client.4416 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 --> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b7bb52890 con 0x562b7bc53810 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb43effd640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc53810 0x562b7bc55c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb41e7fc640 10 client.4416 ms_handle_connect on v2:172.21.15.125:6834/2694324946 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.202+0000 7fb43effd640 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc53810 0x562b7bc55c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad22279e06280c74 server_cookie=4d90873160f6bef8 in_seq=0 out_seq=0 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb41e7fc640 1 -- 172.21.15.93:0/996150454 <== mds.0 v2:172.21.15.125:6834/2694324946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562b7bb52890 con 0x562b7bc53810 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb41e7fc640 10 client.4416 handle_command_reply: tid=0 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 client.4416 shutdown 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 msgr2=0x562b7bc32c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb434001de0 tx=0x7fb4340012b0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 shutdown_connections 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc53810 0x562b7bc55c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc33150 0x562b7bc48080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc32c10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 --2- 172.21.15.93:0/996150454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc19780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 >> 172.21.15.93:0/996150454 conn(0x562b7bbedc90 msgr2=0x562b7bc1d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb41e7fc640 0 client.4416 ms_handle_reset on v2:172.21.15.125:6834/2694324946 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 shutdown_connections 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.203+0000 7fb448627740 1 -- 172.21.15.93:0/996150454 wait complete. 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.204+0000 7fb448627740 20 client.4416 trim_cache size 0 max 16384 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.219+0000 7fb448627740 1 Processor -- start 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.219+0000 7fb448627740 1 -- start start 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.219+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc329f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.219+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc3b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.219+0000 7fb448627740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb448627740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bad9280 con 0x562b7bc33150 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bbf3ff0 con 0x562b7bc1ac30 2023-11-04T01:35:59.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b7bc32860 con 0x562b7bc1a850 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60686/0 (socket says 172.21.15.93:60686) 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 -- 172.21.15.93:0/2562689742 learned_addr learned my addr 172.21.15.93:0/2562689742 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43effd640 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc3b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 -- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 msgr2=0x562b7bc329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc329f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 -- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 msgr2=0x562b7bc3b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc3b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 -- 172.21.15.93:0/2562689742 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b7baf5d10 con 0x562b7bc33150 2023-11-04T01:35:59.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb438006000 tx=0x7fb43800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478790b50c3dc34a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb425ffb640 1 -- 172.21.15.93:0/2562689742 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438007790 con 0x562b7bc33150 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb425ffb640 1 -- 172.21.15.93:0/2562689742 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438007a60 con 0x562b7bc33150 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.220+0000 7fb425ffb640 1 -- 172.21.15.93:0/2562689742 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438020640 con 0x562b7bc33150 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- 172.21.15.93:0/2562689742 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 msgr2=0x562b7bc39010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb438006000 tx=0x7fb43800e000 comp rx=0 tx=0).stop 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- 172.21.15.93:0/2562689742 shutdown_connections 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc33150 0x562b7bc39010 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1ac30 0x562b7bc3b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 --2- 172.21.15.93:0/2562689742 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc1a850 0x562b7bc329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- 172.21.15.93:0/2562689742 >> 172.21.15.93:0/2562689742 conn(0x562b7bbedc90 msgr2=0x562b7bbf17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- 172.21.15.93:0/2562689742 shutdown_connections 2023-11-04T01:35:59.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- 172.21.15.93:0/2562689742 wait complete. 2023-11-04T01:35:59.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 -- start start 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.221+0000 7fb448627740 1 Processor -- start 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1a850 0x562b7bca2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc33150 0x562b7bc1d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bc37240 con 0x562b7bc1ac30 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7bc18a50 con 0x562b7bc1a850 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b7bca30c0 con 0x562b7bc33150 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb448627740 10 client.0 _ll_register_callbacks cb 0x7fb434005270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60692/0 (socket says 172.21.15.93:60692) 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 -- 172.21.15.93:0/266954163 learned_addr learned my addr 172.21.15.93:0/266954163 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43effd640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1a850 0x562b7bca2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43f7fe640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc33150 0x562b7bc1d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 -- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc33150 msgr2=0x562b7bc1d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc33150 0x562b7bc1d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 -- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1a850 msgr2=0x562b7bca2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1a850 0x562b7bca2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.222+0000 7fb43e7fc640 1 -- 172.21.15.93:0/266954163 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b7bb1cca0 con 0x562b7bc1ac30 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb43e7fc640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb434001db0 tx=0x7fb434015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721164775f71ee4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434027040 con 0x562b7bc1ac30 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb434032080 con 0x562b7bc1ac30 2023-11-04T01:35:59.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4380078f0 con 0x562b7bc1ac30 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb434014e10 con 0x562b7bc1ac30 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 10 client.4422 fetch_fsmap learned FSMap version 7 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562b7bb1b500 con 0x562b7bc1ac30 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380078f0 con 0x562b7bc1ac30 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fb43402a040 con 0x562b7bc1ac30 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 20 client.4422 populate_metadata read hostname 'smithi093' 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc47270 0x562b7bc47650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 4 client.4422 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 --> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562b7bb525b0 con 0x562b7bc47270 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.223+0000 7fb43effd640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc47270 0x562b7bc47650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb43effd640 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc47270 0x562b7bc47650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6423a8bf31aa332c server_cookie=ac5676d20fcf935 in_seq=0 out_seq=0 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb41e7fc640 10 client.4422 ms_handle_connect on v2:172.21.15.125:6834/2694324946 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb41e7fc640 1 -- 172.21.15.93:0/266954163 <== mds.0 v2:172.21.15.125:6834/2694324946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562b7bb525b0 con 0x562b7bc47270 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb41e7fc640 10 client.4422 handle_command_reply: tid=0 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 client.4422 shutdown 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 msgr2=0x562b7bc1d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb434001db0 tx=0x7fb434015000 comp rx=0 tx=0).stop 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 shutdown_connections 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x562b7bc47270 0x562b7bc47650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x562b7bc33150 0x562b7bc1d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562b7bc1ac30 0x562b7bc1d0e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb41e7fc640 0 client.4422 ms_handle_reset on v2:172.21.15.125:6834/2694324946 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 --2- 172.21.15.93:0/266954163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b7bc1a850 0x562b7bca2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 >> 172.21.15.93:0/266954163 conn(0x562b7bbedc90 msgr2=0x562b7bc19720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 shutdown_connections 2023-11-04T01:35:59.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 1 -- 172.21.15.93:0/266954163 wait complete. 2023-11-04T01:35:59.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.224+0000 7fb448627740 20 client.4422 trim_cache size 0 max 16384 2023-11-04T01:35:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4315, 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 7.1683914260000003, 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 7, 2023-11-04T01:35:59.300 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 24, 2023-11-04T01:35:59.301 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:35:59.301 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 14.188165994 2023-11-04T01:35:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 msgr2=0x7fb42c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 0x7fb42c06d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb434007fd0 tx=0x7fb434009040 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 msgr2=0x7fb44014e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb43002c1a0 tx=0x7fb430004730 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 shutdown_connections 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb42c06ae70 0x7fb42c06d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4400cc2b0 0x7fb4400cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb440152440 0x7fb440155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 --2- 172.21.15.93:0/2026868712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4280039a0 0x7fb44014e7a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 >> 172.21.15.93:0/2026868712 conn(0x7fb4400cf880 msgr2=0x7fb4400cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 shutdown_connections 2023-11-04T01:35:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.225+0000 7fb4459b6640 1 -- 172.21.15.93:0/2026868712 wait complete. 2023-11-04T01:35:59.304 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:35:59.304 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:35:59.304 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:35:59.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.413+0000 7fc837a44640 1 Processor -- start 2023-11-04T01:35:59.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.413+0000 7fc837a44640 1 -- start start 2023-11-04T01:35:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc837a44640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc8300cde60 0x7fc83015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc837a44640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 0x7fc8300d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc837a44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83015e000 con 0x7fc83015daa0 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc837a44640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015e5c0 con 0x7fc8300cde60 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc837a44640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015e2e0 con 0x7fc8300ce240 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc8300cde60 0x7fc83015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc834fdf640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc83015daa0 0x7fc830157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40932/0 (socket says 172.21.15.93:40932) 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc834fdf640 1 -- 172.21.15.93:0/625739474 learned_addr learned my addr 172.21.15.93:0/625739474 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc835fe1640 1 --2- 172.21.15.93:0/625739474 >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 0x7fc8300d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 -- 172.21.15.93:0/625739474 >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 msgr2=0x7fc8300d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 --2- 172.21.15.93:0/625739474 >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 0x7fc8300d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 -- 172.21.15.93:0/625739474 >> v1:172.21.15.93:6789/0 conn(0x7fc83015daa0 legacy=0x7fc830157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 -- 172.21.15.93:0/625739474 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300d1120 con 0x7fc8300cde60 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc835fe1640 1 --2- 172.21.15.93:0/625739474 >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 0x7fc8300d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc827fff640 1 -- 172.21.15.93:0/625739474 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792150762 0 0) 0x7fc83015e000 con 0x7fc83015daa0 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc8357e0640 1 --2- 172.21.15.93:0/625739474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300cde60 0x7fc83015d560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8300cf2e0 tx=0x7fc82c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7584093b88e5de7c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc827fff640 1 -- 172.21.15.93:0/625739474 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c031830 con 0x7fc8300cde60 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc827fff640 1 -- 172.21.15.93:0/625739474 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c031990 con 0x7fc8300cde60 2023-11-04T01:35:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.415+0000 7fc827fff640 1 -- 172.21.15.93:0/625739474 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c031d20 con 0x7fc8300cde60 2023-11-04T01:35:59.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 -- 172.21.15.93:0/625739474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300cde60 msgr2=0x7fc83015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 --2- 172.21.15.93:0/625739474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300cde60 0x7fc83015d560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8300cf2e0 tx=0x7fc82c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 -- 172.21.15.93:0/625739474 shutdown_connections 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 --2- 172.21.15.93:0/625739474 >> v2:172.21.15.125:3300/0 conn(0x7fc8300ce240 0x7fc8300d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 --2- 172.21.15.93:0/625739474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300cde60 0x7fc83015d560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 -- 172.21.15.93:0/625739474 >> 172.21.15.93:0/625739474 conn(0x7fc830071f30 msgr2=0x7fc8300cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 -- 172.21.15.93:0/625739474 shutdown_connections 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.416+0000 7fc837a44640 1 -- 172.21.15.93:0/625739474 wait complete. 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.417+0000 7fc837a44640 1 Processor -- start 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.417+0000 7fc837a44640 1 -- start start 2023-11-04T01:35:59.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8300cde60 0x7fc8301543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc83015daa0 0x7fc83015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830158150 con 0x7fc8300ce240 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830158430 con 0x7fc8300cde60 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830158710 con 0x7fc83015daa0 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:60722/0 (socket says 172.21.15.93:60722) 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 -- 172.21.15.93:0/753143940 learned_addr learned my addr 172.21.15.93:0/753143940 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 -- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc83015daa0 msgr2=0x7fc83015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc83015daa0 0x7fc83015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 -- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8300cde60 msgr2=0x7fc8301543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8300cde60 0x7fc8301543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 -- 172.21.15.93:0/753143940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009400 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc834fdf640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c410 tx=0x7fc82000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200074e0 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820007660 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8301589f0 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.418+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820004a20 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.419+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8301548f0 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.420+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830158f10 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.420+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc820004b80 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.420+0000 7fc825ffb640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 0x7fc81406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.421+0000 7fc8357e0640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 0x7fc81406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.421+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc820089700 con 0x7fc8300ce240 2023-11-04T01:35:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.421+0000 7fc8357e0640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 0x7fc81406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:35:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.425+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc830158f10 con 0x7fc8300ce240 2023-11-04T01:35:59.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.626+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc830158f10 con 0x7fc8300ce240 2023-11-04T01:35:59.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.626+0000 7fc825ffb640 1 -- 172.21.15.93:0/753143940 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc830158f10 con 0x7fc8300ce240 2023-11-04T01:35:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:35:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 msgr2=0x7fc81406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 0x7fc81406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c030000 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 msgr2=0x7fc8300b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c410 tx=0x7fc82000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 shutdown_connections 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc81406ae70 0x7fc81406d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc83015daa0 0x7fc83015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8300ce240 0x7fc8300b6370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 --2- 172.21.15.93:0/753143940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8300cde60 0x7fc8301543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 >> 172.21.15.93:0/753143940 conn(0x7fc830071f30 msgr2=0x7fc8300d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:35:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 shutdown_connections 2023-11-04T01:35:59.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:35:59.628+0000 7fc837a44640 1 -- 172.21.15.93:0/753143940 wait complete. 2023-11-04T01:35:59.641 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-04T01:35:59.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:35:59.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:35:59.641 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-04T01:35:59.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:35:59.642 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-04T01:35:59.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:35:59.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:35:59.642 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:35:59.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:35:59.642 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:35:59.661 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41840sec preferred_lft 41840sec 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:35:59.662 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:35:59.663 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:35:59.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2023-11-04T01:35:59.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:35:59.664 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:35:59.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:35:59.836 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:35:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:35:59.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:35:59.873 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:35:59.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:35:59.941 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:00.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.210 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:36:00.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.226 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-11-04T01:36:00.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.284 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:00.284 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:00.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:00.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-04T01:36:00.285 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:00.368 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-04T01:36:00.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.368 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-04T01:36:00.369 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:00.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.505 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:00.505 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:00.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:36:00.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:00.506 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:00.562 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-04T01:36:00.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:00.562 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:36:00.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:00.620 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:00.674 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:00.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.738 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:00.790 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:00.790 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-04T01:36:00.832 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:00.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:00.852 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:00.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi093.stderr:2023-11-04T01:36:00.953+0000 7fb099658480 -1 init, newargv = 0x55f1654362d0 newargc=15 2023-11-04T01:36:00.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi093.stderr:ceph-fuse[125359]: starting ceph client 2023-11-04T01:36:00.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi093.stderr:ceph-fuse[125359]: starting fuse 2023-11-04T01:36:02.006 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:02.025 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:02.026 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:02.026 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:02.026 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:02.026 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:02.026 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:02.027 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:02.028 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:02.028 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:02.033 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:02.034 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:02.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:02.035 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:02.082 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:36:02.082 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:02.083 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:02.084 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.admin")) 2023-11-04T01:36:02.085 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:36:02.208 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.admin.125359.asok 2023-11-04T01:36:02.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:02.218 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.125359.asok 2023-11-04T01:36:02.219 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:02.219 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.admin.125359.asok status 2023-11-04T01:36:02.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "admin", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "125359", 2023-11-04T01:36:02.387 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4437, 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 4437 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:02.388 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2870875394 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2870875394 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.4437 192.168.0.1:0/2870875394", 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/2870875394", 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 7, 2023-11-04T01:36:02.389 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 24, 2023-11-04T01:36:02.390 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:02.390 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:36:02.390 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:36:02.390 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:36:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:02.401 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:02.401 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:02.401 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:02.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:02.460 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:36:02.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:02.466 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:02.466 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:02.467 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:02.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:02.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:02.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:02.537 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-04T01:36:02.566 INFO:teuthology.orchestra.run.smithi093.stdout:# file: . 2023-11-04T01:36:02.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-04T01:36:02.566 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:02.566 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:02.566 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:02.622 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:02.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.762+0000 7fac816cf640 1 Processor -- start 2023-11-04T01:36:02.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.762+0000 7fac816cf640 1 -- start start 2023-11-04T01:36:02.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.762+0000 7fac816cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac7c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac816cf640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c15e000 con 0x7fac7c0ce240 2023-11-04T01:36:02.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac816cf640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c15e2e0 con 0x7fac7c15daa0 2023-11-04T01:36:02.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac816cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c15e5c0 con 0x7fac7c0cde60 2023-11-04T01:36:02.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fac7c0ce240 0x7fac7c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50100/0 (socket says 172.21.15.93:50100) 2023-11-04T01:36:02.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7b7fe640 1 -- 172.21.15.93:0/977998940 learned_addr learned my addr 172.21.15.93:0/977998940 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:02.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657348698 0 0) 0x7fac7c15e000 con 0x7fac7c0ce240 2023-11-04T01:36:02.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7affd640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac7c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac64003520 con 0x7fac7c0ce240 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1297012709 0 0) 0x7fac64003520 con 0x7fac7c0ce240 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 msgr2=0x7fac7c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac7c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 >> v1:172.21.15.125:6789/0 conn(0x7fac7c15daa0 legacy=0x7fac7c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0d1120 con 0x7fac7c0ce240 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fac740019f0 con 0x7fac7c0ce240 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 >> v1:172.21.15.93:6789/0 conn(0x7fac7c0ce240 legacy=0x7fac7c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac640039a0 0x7fac64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac64004d00 0x7fac64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c15e5c0 con 0x7fac64004d00 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6400ba30 con 0x7fac640039a0 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6400bbf0 con 0x7fac7c0cde60 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7b7fe640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac64004d00 0x7fac64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7affd640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac640039a0 0x7fac64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.763+0000 7fac7a7fc640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 -- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 msgr2=0x7fac640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0cde60 0x7fac640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 -- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac640039a0 msgr2=0x7fac64003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac640039a0 0x7fac64003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 -- 172.21.15.93:0/977998940 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64003520 con 0x7fac64004d00 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac7b7fe640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac64004d00 0x7fac64005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac7400a800 tx=0x7fac640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b17f6b6b82d63c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac740072d0 con 0x7fac64004d00 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7402f070 con 0x7fac64004d00 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.764+0000 7fac79ffb640 1 -- 172.21.15.93:0/977998940 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74007690 con 0x7fac64004d00 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 -- 172.21.15.93:0/977998940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac64004d00 msgr2=0x7fac64005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 --2- 172.21.15.93:0/977998940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac64004d00 0x7fac64005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac7400a800 tx=0x7fac640057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac7b7fe640 1 -- 172.21.15.93:0/977998940 reap_dead start 2023-11-04T01:36:02.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 -- 172.21.15.93:0/977998940 shutdown_connections 2023-11-04T01:36:02.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 -- 172.21.15.93:0/977998940 >> 172.21.15.93:0/977998940 conn(0x7fac7c071f30 msgr2=0x7fac7c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:02.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 -- 172.21.15.93:0/977998940 shutdown_connections 2023-11-04T01:36:02.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.765+0000 7fac816cf640 1 -- 172.21.15.93:0/977998940 wait complete. 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.766+0000 7fac816cf640 1 Processor -- start 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.766+0000 7fac816cf640 1 -- start start 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac7c158c50 0x7fac7c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0c8180 0x7fac7c15a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c8600 con 0x7fac7c1f5810 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1f5bf0 con 0x7fac7c158c50 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac816cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1595e0 con 0x7fac7c0c8180 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:32946/0 (socket says 172.21.15.93:32946) 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 -- 172.21.15.93:0/3932087956 learned_addr learned my addr 172.21.15.93:0/3932087956 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7b7fe640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0c8180 0x7fac7c15a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7a7fc640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac7c158c50 0x7fac7c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 -- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0c8180 msgr2=0x7fac7c15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0c8180 0x7fac7c15a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 -- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac7c158c50 msgr2=0x7fac7c0c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac7c158c50 0x7fac7c0c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 -- 172.21.15.93:0/3932087956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c142130 con 0x7fac7c1f5810 2023-11-04T01:36:02.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.767+0000 7fac7affd640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0119d0 tx=0x7fac6c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.768+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00fb50 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.768+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c00fcb0 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.768+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c159830 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.768+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c014440 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.768+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c159df0 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.769+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c074290 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.769+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac6c0145a0 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.769+0000 7fac637fe640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 0x7fac6806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.769+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac6c08a1c0 con 0x7fac7c1f5810 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.769+0000 7fac7a7fc640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 0x7fac6806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.770+0000 7fac7a7fc640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 0x7fac6806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac7c154c30 tx=0x7fac70009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:02.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.773+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac6c054f80 con 0x7fac7c1f5810 2023-11-04T01:36:02.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.942+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac7c0d0060 con 0x7fac7c1f5810 2023-11-04T01:36:02.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.943+0000 7fac637fe640 1 -- 172.21.15.93:0/3932087956 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fac6c0585a0 con 0x7fac7c1f5810 2023-11-04T01:36:02.945 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:02.945 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 msgr2=0x7fac6806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 0x7fac6806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fac7c154c30 tx=0x7fac70009040 comp rx=0 tx=0).stop 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 msgr2=0x7fac7c141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0119d0 tx=0x7fac6c011e90 comp rx=0 tx=0).stop 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 shutdown_connections 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac6806aea0 0x7fac6806d360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac7c0c8180 0x7fac7c15a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac7c158c50 0x7fac7c0c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 --2- 172.21.15.93:0/3932087956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7c1f5810 0x7fac7c141bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:02.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 >> 172.21.15.93:0/3932087956 conn(0x7fac7c071f30 msgr2=0x7fac7c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:02.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 shutdown_connections 2023-11-04T01:36:02.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:02.945+0000 7fac816cf640 1 -- 172.21.15.93:0/3932087956 wait complete. 2023-11-04T01:36:02.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:02.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:03.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.058+0000 7fee07456640 1 Processor -- start 2023-11-04T01:36:03.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.058+0000 7fee07456640 1 -- start start 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee07456640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee00070e20 0x7fee000adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee07456640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fee0015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee07456640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000c3900 con 0x7fee0015ad30 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee07456640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee000ae260 con 0x7fee00070e20 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee07456640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c3be0 con 0x7fee000ad730 2023-11-04T01:36:03.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee051f2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fee0015ad30 0x7fee00070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50114/0 (socket says 172.21.15.93:50114) 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee051f2640 1 -- 172.21.15.93:0/2284580098 learned_addr learned my addr 172.21.15.93:0/2284580098 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee049f1640 1 --2- 172.21.15.93:0/2284580098 >> v2:172.21.15.125:3300/0 conn(0x7fee00070e20 0x7fee000adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273956834 0 0) 0x7fee000c3900 con 0x7fee0015ad30 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.059+0000 7fee059f3640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fee0015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedec003520 con 0x7fee0015ad30 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1106694671 0 0) 0x7fedec003520 con 0x7fee0015ad30 2023-11-04T01:36:03.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 msgr2=0x7fee0015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fee0015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 >> v2:172.21.15.125:3300/0 conn(0x7fee00070e20 msgr2=0x7fee000adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 --2- 172.21.15.93:0/2284580098 >> v2:172.21.15.125:3300/0 conn(0x7fee00070e20 0x7fee000adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000c3ec0 con 0x7fee0015ad30 2023-11-04T01:36:03.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fedfc0019f0 con 0x7fee0015ad30 2023-11-04T01:36:03.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 >> v1:172.21.15.93:6789/0 conn(0x7fee0015ad30 legacy=0x7fee00070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fedec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fedec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedec004d00 0x7fedec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000ae260 con 0x7fedec003970 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c3be0 con 0x7fedec004d00 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec00b9b0 con 0x7fee000ad730 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fedec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee049f1640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fedec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee059f3640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedec004d00 0x7fedec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 -- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 msgr2=0x7fedec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000ad730 0x7fedec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 -- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedec004d00 msgr2=0x7fedec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedec004d00 0x7fedec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee051f2640 1 -- 172.21.15.93:0/2284580098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec003520 con 0x7fedec003970 2023-11-04T01:36:03.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.060+0000 7fee059f3640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedec004d00 0x7fedec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:03.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.061+0000 7fee051f2640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fedec003d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00a8d0 tx=0x7fedec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e06651913c006c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.061+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc034630 con 0x7fedec003970 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.061+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc02f070 con 0x7fedec003970 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.061+0000 7fedf7fff640 1 -- 172.21.15.93:0/2284580098 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0349d0 con 0x7fedec003970 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 -- 172.21.15.93:0/2284580098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 msgr2=0x7fedec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 --2- 172.21.15.93:0/2284580098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fedec003d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00a8d0 tx=0x7fedec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee059f3640 1 -- 172.21.15.93:0/2284580098 reap_dead start 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 -- 172.21.15.93:0/2284580098 shutdown_connections 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 -- 172.21.15.93:0/2284580098 >> 172.21.15.93:0/2284580098 conn(0x7fee000ce950 msgr2=0x7fee000ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 -- 172.21.15.93:0/2284580098 shutdown_connections 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.062+0000 7fee07456640 1 -- 172.21.15.93:0/2284580098 wait complete. 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.063+0000 7fee07456640 1 Processor -- start 2023-11-04T01:36:03.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.063+0000 7fee07456640 1 -- start start 2023-11-04T01:36:03.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000b3180 0x7fee000b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00155530 0x7fee001559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c73e0 con 0x7fedec003970 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c6760 con 0x7fee00155530 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c6a40 con 0x7fee000b3180 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:32962/0 (socket says 172.21.15.93:32962) 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 -- 172.21.15.93:0/3260824946 learned_addr learned my addr 172.21.15.93:0/3260824946 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee049f1640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000b3180 0x7fee000b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee059f3640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00155530 0x7fee001559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 -- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000b3180 msgr2=0x7fee000b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000b3180 0x7fee000b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 -- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00155530 msgr2=0x7fee001559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00155530 0x7fee001559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 -- 172.21.15.93:0/3260824946 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000c6d20 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee051f2640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00a9f0 tx=0x7fedfc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc040480 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0405e0 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee000c7000 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.064+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc040990 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.065+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee000b3b20 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.065+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee000c7650 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.066+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedfc031030 con 0x7fedec003970 2023-11-04T01:36:03.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.066+0000 7fedf5ffb640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 0x7fede406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.066+0000 7fee049f1640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 0x7fede406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.066+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fedfc0aba10 con 0x7fedec003970 2023-11-04T01:36:03.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.067+0000 7fee049f1640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 0x7fede406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee001f1c60 tx=0x7fedf0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.071+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedfc07a1d0 con 0x7fedec003970 2023-11-04T01:36:03.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.236+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee00074290 con 0x7fedec003970 2023-11-04T01:36:03.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.237+0000 7fedf5ffb640 1 -- 172.21.15.93:0/3260824946 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedfc045030 con 0x7fedec003970 2023-11-04T01:36:03.238 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:03.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 msgr2=0x7fede406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 0x7fede406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee001f1c60 tx=0x7fedf0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 msgr2=0x7fee001526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00a9f0 tx=0x7fedfc001360 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 shutdown_connections 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fede406ae70 0x7fede406d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee00155530 0x7fee001559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fee000b3180 0x7fee000b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 --2- 172.21.15.93:0/3260824946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedec003970 0x7fee001526d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 >> 172.21.15.93:0/3260824946 conn(0x7fee000ce950 msgr2=0x7fee0015b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 shutdown_connections 2023-11-04T01:36:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.239+0000 7fee07456640 1 -- 172.21.15.93:0/3260824946 wait complete. 2023-11-04T01:36:03.252 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:03.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.354+0000 7f4e9e525640 1 Processor -- start 2023-11-04T01:36:03.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.354+0000 7f4e9e525640 1 -- start start 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9e525640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4e980d0710 0x7f4e980cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9e525640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e980cda50 0x7f4e980b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9e525640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980d0280 con 0x7f4e9815e430 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9e525640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980cf670 con 0x7f4e980d0710 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9e525640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980cf950 con 0x7f4e980cda50 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4e980d0710 0x7f4e980cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4e980d0710 0x7f4e980cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:32972/0 (socket says 172.21.15.93:32972) 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e977fe640 1 -- 172.21.15.93:0/1197894779 learned_addr learned my addr 172.21.15.93:0/1197894779 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.355+0000 7f4e9cac2640 1 --2- 172.21.15.93:0/1197894779 >> v2:172.21.15.125:3300/0 conn(0x7f4e980cda50 0x7f4e980b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e977fe640 1 -- 172.21.15.93:0/1197894779 >> v2:172.21.15.125:3300/0 conn(0x7f4e980cda50 msgr2=0x7f4e980b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e977fe640 1 --2- 172.21.15.93:0/1197894779 >> v2:172.21.15.125:3300/0 conn(0x7f4e980cda50 0x7f4e980b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e977fe640 1 -- 172.21.15.93:0/1197894779 >> v1:172.21.15.125:6789/0 conn(0x7f4e9815e430 legacy=0x7f4e980cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e977fe640 1 -- 172.21.15.93:0/1197894779 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980cfc30 con 0x7f4e980d0710 2023-11-04T01:36:03.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e977fe640 1 --2- 172.21.15.93:0/1197894779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980d0710 0x7f4e980cd510 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b6250 tx=0x7f4e8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6347ace76033ddda server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.356+0000 7f4e96ffd640 1 -- 172.21.15.93:0/1197894779 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c031870 con 0x7f4e980d0710 2023-11-04T01:36:03.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e96ffd640 1 -- 172.21.15.93:0/1197894779 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c0319d0 con 0x7f4e980d0710 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e96ffd640 1 -- 172.21.15.93:0/1197894779 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c031d60 con 0x7f4e980d0710 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 -- 172.21.15.93:0/1197894779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980d0710 msgr2=0x7f4e980cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 --2- 172.21.15.93:0/1197894779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980d0710 0x7f4e980cd510 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b6250 tx=0x7f4e8c02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 -- 172.21.15.93:0/1197894779 shutdown_connections 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 --2- 172.21.15.93:0/1197894779 >> v2:172.21.15.125:3300/0 conn(0x7f4e980cda50 0x7f4e980b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 --2- 172.21.15.93:0/1197894779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980d0710 0x7f4e980cd510 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 -- 172.21.15.93:0/1197894779 >> 172.21.15.93:0/1197894779 conn(0x7f4e9806ea20 msgr2=0x7f4e9806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 -- 172.21.15.93:0/1197894779 shutdown_connections 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.357+0000 7f4e9e525640 1 -- 172.21.15.93:0/1197894779 wait complete. 2023-11-04T01:36:03.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.358+0000 7f4e9e525640 1 Processor -- start 2023-11-04T01:36:03.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.358+0000 7f4e9e525640 1 -- start start 2023-11-04T01:36:03.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e980d0710 0x7f4e980caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e9815e430 0x7f4e98158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c8b70 con 0x7f4e980cda50 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980ca5f0 con 0x7f4e980d0710 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9e525640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980cafc0 con 0x7f4e9815e430 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:32984/0 (socket says 172.21.15.93:32984) 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e97fff640 1 -- 172.21.15.93:0/4146431179 learned_addr learned my addr 172.21.15.93:0/4146431179 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e9cac2640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e9815e430 0x7f4e98158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.359+0000 7f4e977fe640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e980d0710 0x7f4e980caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 -- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e9815e430 msgr2=0x7f4e98158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e9815e430 0x7f4e98158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 -- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e980d0710 msgr2=0x7f4e980caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e980d0710 0x7f4e980caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 -- 172.21.15.93:0/4146431179 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0094d0 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e97fff640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c430 tx=0x7f4e8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011790 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e880118f0 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980c9a40 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011ce0 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.360+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e980ca280 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.361+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980ca410 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.361+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e8801c460 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.362+0000 7f4e94ff9640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 0x7f4e8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.362+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e880898d0 con 0x7f4e980cda50 2023-11-04T01:36:03.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.362+0000 7f4e977fe640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 0x7f4e8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.362+0000 7f4e977fe640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 0x7f4e8406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c036000 tx=0x7f4e8c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.366+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e88054690 con 0x7f4e980cda50 2023-11-04T01:36:03.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.536+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e98074290 con 0x7f4e980cda50 2023-11-04T01:36:03.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.537+0000 7f4e94ff9640 1 -- 172.21.15.93:0/4146431179 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e88057cb0 con 0x7f4e980cda50 2023-11-04T01:36:03.539 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:03.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.538+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 msgr2=0x7f4e8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.538+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 0x7f4e8406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c036000 tx=0x7f4e8c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:03.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 msgr2=0x7f4e9806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c430 tx=0x7f4e8800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 shutdown_connections 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e8406ae70 0x7f4e8406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e9815e430 0x7f4e98158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e980d0710 0x7f4e980caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 --2- 172.21.15.93:0/4146431179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e980cda50 0x7f4e9806c020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 >> 172.21.15.93:0/4146431179 conn(0x7f4e9806ea20 msgr2=0x7f4e980b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 shutdown_connections 2023-11-04T01:36:03.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.539+0000 7f4e9e525640 1 -- 172.21.15.93:0/4146431179 wait complete. 2023-11-04T01:36:03.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:03.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 Processor -- start 2023-11-04T01:36:03.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 -- start start 2023-11-04T01:36:03.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01a8153e60 0x7f01a815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f01a80b4880 0x7f01a80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80cde60 con 0x7f01a80cd6d0 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a8160f90 con 0x7f01a8153e60 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.655+0000 7f01ac8a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80b5200 con 0x7f01a80b4880 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01a8153e60 0x7f01a815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f019dd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f01a80cd6d0 0x7f01a8161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50128/0 (socket says 172.21.15.93:50128) 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f019dd9b640 1 -- 172.21.15.93:0/3265822494 learned_addr learned my addr 172.21.15.93:0/3265822494 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a659c640 1 -- 172.21.15.93:0/3265822494 >> v2:172.21.15.125:3300/0 conn(0x7f01a80b4880 msgr2=0x7f01a80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a659c640 1 --2- 172.21.15.93:0/3265822494 >> v2:172.21.15.125:3300/0 conn(0x7f01a80b4880 0x7f01a80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a659c640 1 -- 172.21.15.93:0/3265822494 >> v1:172.21.15.93:6789/0 conn(0x7f01a80cd6d0 legacy=0x7f01a8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a659c640 1 -- 172.21.15.93:0/3265822494 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a815e400 con 0x7f01a8153e60 2023-11-04T01:36:03.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.656+0000 7f01a5d9b640 1 -- 172.21.15.93:0/3265822494 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438720394 0 0) 0x7f01a80cde60 con 0x7f01a80cd6d0 2023-11-04T01:36:03.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01a659c640 1 --2- 172.21.15.93:0/3265822494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a815dec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b8f40 tx=0x7f019802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0326f1fbd75061f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01a5d9b640 1 -- 172.21.15.93:0/3265822494 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198031830 con 0x7f01a8153e60 2023-11-04T01:36:03.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01a5d9b640 1 -- 172.21.15.93:0/3265822494 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198031990 con 0x7f01a8153e60 2023-11-04T01:36:03.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01a5d9b640 1 -- 172.21.15.93:0/3265822494 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198031d20 con 0x7f01a8153e60 2023-11-04T01:36:03.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 -- 172.21.15.93:0/3265822494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 msgr2=0x7f01a815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/3265822494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a815dec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b8f40 tx=0x7f019802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 -- 172.21.15.93:0/3265822494 shutdown_connections 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/3265822494 >> v2:172.21.15.125:3300/0 conn(0x7f01a80b4880 0x7f01a80b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/3265822494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a815dec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 -- 172.21.15.93:0/3265822494 >> 172.21.15.93:0/3265822494 conn(0x7f01a80cf880 msgr2=0x7f01a80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 -- 172.21.15.93:0/3265822494 shutdown_connections 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.657+0000 7f01ac8a9640 1 -- 172.21.15.93:0/3265822494 wait complete. 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 Processor -- start 2023-11-04T01:36:03.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 -- start start 2023-11-04T01:36:03.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01a80b4880 0x7f01a81f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01a80cd6d0 0x7f01a8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f6e90 con 0x7f01a8153e60 2023-11-04T01:36:03.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80cc6b0 con 0x7f01a80cd6d0 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01ac8a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f65f0 con 0x7f01a80b4880 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.659+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33004/0 (socket says 172.21.15.93:33004) 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 -- 172.21.15.93:0/2694241044 learned_addr learned my addr 172.21.15.93:0/2694241044 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f019dd9b640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01a80cd6d0 0x7f01a8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a659c640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01a80b4880 0x7f01a81f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 -- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01a80b4880 msgr2=0x7f01a81f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01a80b4880 0x7f01a81f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 -- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01a80cd6d0 msgr2=0x7f01a8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01a80cd6d0 0x7f01a8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 -- 172.21.15.93:0/2694241044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009400 con 0x7f01a8153e60 2023-11-04T01:36:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01a6d9d640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01a000b970 tx=0x7f01a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000cb40 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000ccc0 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0014680 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81f68d0 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.660+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a81f2b30 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.661+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a81f2d50 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.662+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01a001d3b0 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.662+0000 7f019f7fe640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 0x7f018806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.662+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01a00898b0 con 0x7f01a8153e60 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.662+0000 7f01a659c640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 0x7f018806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.662+0000 7f01a659c640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 0x7f018806d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f019803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.666+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01a0054670 con 0x7f01a8153e60 2023-11-04T01:36:03.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.834+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01a8074290 con 0x7f01a8153e60 2023-11-04T01:36:03.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.834+0000 7f019f7fe640 1 -- 172.21.15.93:0/2694241044 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01a00190a0 con 0x7f01a8153e60 2023-11-04T01:36:03.836 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 msgr2=0x7f018806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 0x7f018806d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0198036000 tx=0x7f019803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 msgr2=0x7f01a8150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01a000b970 tx=0x7f01a000be30 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 shutdown_connections 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f018806ae70 0x7f018806d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01a8153e60 0x7f01a8150250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01a80cd6d0 0x7f01a8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 --2- 172.21.15.93:0/2694241044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01a80b4880 0x7f01a81f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 >> 172.21.15.93:0/2694241044 conn(0x7f01a80cf880 msgr2=0x7f01a815f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 shutdown_connections 2023-11-04T01:36:03.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.836+0000 7f01ac8a9640 1 -- 172.21.15.93:0/2694241044 wait complete. 2023-11-04T01:36:03.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:03.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.952+0000 7f02ddffb640 1 Processor -- start 2023-11-04T01:36:03.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.952+0000 7f02ddffb640 1 -- start start 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02ddffb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f02d8160430 0x7f02d80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02ddffb640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02d806c3a0 0x7f02d80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02ddffb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80b2fc0 con 0x7f02d80b2b60 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02ddffb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80cb580 con 0x7f02d8160430 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02ddffb640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d806c7d0 con 0x7f02d806c3a0 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d77fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f02d8160430 0x7f02d80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f02d80b2b60 0x7f02d806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50136/0 (socket says 172.21.15.93:50136) 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d6ffd640 1 -- 172.21.15.93:0/1980092566 learned_addr learned my addr 172.21.15.93:0/1980092566 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d7fff640 1 --2- 172.21.15.93:0/1980092566 >> v2:172.21.15.125:3300/0 conn(0x7f02d806c3a0 0x7f02d80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d77fe640 1 -- 172.21.15.93:0/1980092566 >> v2:172.21.15.125:3300/0 conn(0x7f02d806c3a0 msgr2=0x7f02d80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d77fe640 1 --2- 172.21.15.93:0/1980092566 >> v2:172.21.15.125:3300/0 conn(0x7f02d806c3a0 0x7f02d80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d77fe640 1 -- 172.21.15.93:0/1980092566 >> v1:172.21.15.93:6789/0 conn(0x7f02d80b2b60 legacy=0x7f02d806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.953+0000 7f02d77fe640 1 -- 172.21.15.93:0/1980092566 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d806ca40 con 0x7f02d8160430 2023-11-04T01:36:03.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02d77fe640 1 --2- 172.21.15.93:0/1980092566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d8160430 0x7f02d80b2620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f02d80c4600 tx=0x7f02c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67fb9f95d1aa02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02d67fc640 1 -- 172.21.15.93:0/1980092566 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8031830 con 0x7f02d8160430 2023-11-04T01:36:03.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02d67fc640 1 -- 172.21.15.93:0/1980092566 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8031990 con 0x7f02d8160430 2023-11-04T01:36:03.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02d67fc640 1 -- 172.21.15.93:0/1980092566 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8031d20 con 0x7f02d8160430 2023-11-04T01:36:03.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 -- 172.21.15.93:0/1980092566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d8160430 msgr2=0x7f02d80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 --2- 172.21.15.93:0/1980092566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d8160430 0x7f02d80b2620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f02d80c4600 tx=0x7f02c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 -- 172.21.15.93:0/1980092566 shutdown_connections 2023-11-04T01:36:03.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 --2- 172.21.15.93:0/1980092566 >> v2:172.21.15.125:3300/0 conn(0x7f02d806c3a0 0x7f02d80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 --2- 172.21.15.93:0/1980092566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d8160430 0x7f02d80b2620 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.954+0000 7f02ddffb640 1 -- 172.21.15.93:0/1980092566 >> 172.21.15.93:0/1980092566 conn(0x7f02d806ea20 msgr2=0x7f02d806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:03.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.955+0000 7f02ddffb640 1 -- 172.21.15.93:0/1980092566 shutdown_connections 2023-11-04T01:36:03.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.955+0000 7f02ddffb640 1 -- 172.21.15.93:0/1980092566 wait complete. 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.956+0000 7f02ddffb640 1 Processor -- start 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.956+0000 7f02ddffb640 1 -- start start 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.956+0000 7f02ddffb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.956+0000 7f02ddffb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d80b2b60 0x7f02d8152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d8160430 0x7f02d80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80b37c0 con 0x7f02d806c3a0 2023-11-04T01:36:03.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8155e60 con 0x7f02d80b2b60 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d8154cf0 con 0x7f02d8160430 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33020/0 (socket says 172.21.15.93:33020) 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 -- 172.21.15.93:0/41194844 learned_addr learned my addr 172.21.15.93:0/41194844 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d7fff640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d8160430 0x7f02d80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 -- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d8160430 msgr2=0x7f02d80c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d8160430 0x7f02d80c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 -- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d80b2b60 msgr2=0x7f02d8152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d6ffd640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d80b2b60 0x7f02d8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d80b2b60 0x7f02d8152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 -- 172.21.15.93:0/41194844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8009400 con 0x7f02d806c3a0 2023-11-04T01:36:03.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02d77fe640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c803aa60 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c803abe0 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d8154fd0 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80443f0 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.957+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d80b39d0 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.958+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d80b3bc0 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.959+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02c804d450 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.959+0000 7f02bffff640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 0x7f02c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.959+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02c80aba90 con 0x7f02d806c3a0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.959+0000 7f02d6ffd640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 0x7f02c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.960+0000 7f02d6ffd640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 0x7f02c406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02d80cd4c0 tx=0x7f02cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:03.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:03.963+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02c8076850 con 0x7f02d806c3a0 2023-11-04T01:36:04.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.133+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f02d8074290 con 0x7f02d806c3a0 2023-11-04T01:36:04.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.134+0000 7f02bffff640 1 -- 172.21.15.93:0/41194844 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02c8035020 con 0x7f02d806c3a0 2023-11-04T01:36:04.135 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:04.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 msgr2=0x7f02c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 0x7f02c406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02d80cd4c0 tx=0x7f02cc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 msgr2=0x7f02d80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 shutdown_connections 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02c406ae70 0x7f02c406d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02d8160430 0x7f02d80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02d80b2b60 0x7f02d8152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 --2- 172.21.15.93:0/41194844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02d806c3a0 0x7f02d80b61b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 >> 172.21.15.93:0/41194844 conn(0x7f02d806ea20 msgr2=0x7f02d80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 shutdown_connections 2023-11-04T01:36:04.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.136+0000 7f02ddffb640 1 -- 172.21.15.93:0/41194844 wait complete. 2023-11-04T01:36:04.148 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:04.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.249+0000 7f22659f5640 1 Processor -- start 2023-11-04T01:36:04.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.249+0000 7f22659f5640 1 -- start start 2023-11-04T01:36:04.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f22659f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f22659f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22600b4880 0x7f22600b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f22659f5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600cde60 con 0x7f22600cd6d0 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f22659f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22600b5230 con 0x7f22600b4880 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f22659f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2260160f90 con 0x7f2260153e60 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f225effd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f225f7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22600b4880 0x7f22600b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f225effd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:36206/0 (socket says 172.21.15.93:36206) 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.250+0000 7f225effd640 1 -- 172.21.15.93:0/2332560307 learned_addr learned my addr 172.21.15.93:0/2332560307 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.251+0000 7f225effd640 1 -- 172.21.15.93:0/2332560307 >> v2:172.21.15.125:3300/0 conn(0x7f22600b4880 msgr2=0x7f22600b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.251+0000 7f225effd640 1 --2- 172.21.15.93:0/2332560307 >> v2:172.21.15.125:3300/0 conn(0x7f22600b4880 0x7f22600b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.251+0000 7f225effd640 1 -- 172.21.15.93:0/2332560307 >> v1:172.21.15.125:6789/0 conn(0x7f22600cd6d0 legacy=0x7f2260161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.251+0000 7f225effd640 1 -- 172.21.15.93:0/2332560307 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226015e400 con 0x7f2260153e60 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.251+0000 7f225effd640 1 --2- 172.21.15.93:0/2332560307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2250009870 tx=0x7f225002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9f143b3957bfaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f225dffb640 1 -- 172.21.15.93:0/2332560307 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250030840 con 0x7f2260153e60 2023-11-04T01:36:04.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f225dffb640 1 -- 172.21.15.93:0/2332560307 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500309a0 con 0x7f2260153e60 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f225dffb640 1 -- 172.21.15.93:0/2332560307 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250030d30 con 0x7f2260153e60 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 -- 172.21.15.93:0/2332560307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 msgr2=0x7f226015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 --2- 172.21.15.93:0/2332560307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2250009870 tx=0x7f225002b980 comp rx=0 tx=0).stop 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 -- 172.21.15.93:0/2332560307 shutdown_connections 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 --2- 172.21.15.93:0/2332560307 >> v2:172.21.15.125:3300/0 conn(0x7f22600b4880 0x7f22600b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 --2- 172.21.15.93:0/2332560307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2260153e60 0x7f226015dec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 -- 172.21.15.93:0/2332560307 >> 172.21.15.93:0/2332560307 conn(0x7f22600cf880 msgr2=0x7f22600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 -- 172.21.15.93:0/2332560307 shutdown_connections 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.252+0000 7f22659f5640 1 -- 172.21.15.93:0/2332560307 wait complete. 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.253+0000 7f22659f5640 1 Processor -- start 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.253+0000 7f22659f5640 1 -- start start 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 0x7f22600c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22600cd6d0 0x7f2260156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22601568a0 con 0x7f2260153e60 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2260157200 con 0x7f22600cd6d0 2023-11-04T01:36:04.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f22659f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2260155c20 con 0x7f22600b4880 2023-11-04T01:36:04.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33034/0 (socket says 172.21.15.93:33034) 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f225effd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 0x7f22600c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f225f7fe640 1 -- 172.21.15.93:0/92910133 learned_addr learned my addr 172.21.15.93:0/92910133 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.254+0000 7f225e7fc640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22600cd6d0 0x7f2260156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 -- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 msgr2=0x7f22600c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 0x7f22600c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 -- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22600cd6d0 msgr2=0x7f2260156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22600cd6d0 0x7f2260156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 -- 172.21.15.93:0/92910133 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500094d0 con 0x7f2260153e60 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225effd640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 0x7f22600c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f225f7fe640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f225800efc0 tx=0x7f225800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258014480 con 0x7f2260153e60 2023-11-04T01:36:04.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800f040 con 0x7f2260153e60 2023-11-04T01:36:04.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2260155f00 con 0x7f2260153e60 2023-11-04T01:36:04.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258014820 con 0x7f2260153e60 2023-11-04T01:36:04.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.255+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22601564c0 con 0x7f2260153e60 2023-11-04T01:36:04.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.256+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22601569e0 con 0x7f2260153e60 2023-11-04T01:36:04.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.256+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2258014980 con 0x7f2260153e60 2023-11-04T01:36:04.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.257+0000 7f2247fff640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.257+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f225808a3f0 con 0x7f2260153e60 2023-11-04T01:36:04.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.257+0000 7f225effd640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.257+0000 7f225effd640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2250036000 tx=0x7f225003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.261+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22601569e0 con 0x7f2260153e60 2023-11-04T01:36:04.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.441+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22601569e0 con 0x7f2260153e60 2023-11-04T01:36:04.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.441+0000 7f2247fff640 1 -- 172.21.15.93:0/92910133 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f22601569e0 con 0x7f2260153e60 2023-11-04T01:36:04.443 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 msgr2=0x7f224c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2250036000 tx=0x7f225003b040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 msgr2=0x7f22600ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f225800efc0 tx=0x7f225800c490 comp rx=0 tx=0).stop 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 shutdown_connections 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2260153e60 0x7f22600ccc90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22600cd6d0 0x7f2260156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 --2- 172.21.15.93:0/92910133 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22600b4880 0x7f22600c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 >> 172.21.15.93:0/92910133 conn(0x7f22600cf880 msgr2=0x7f22600d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 shutdown_connections 2023-11-04T01:36:04.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.443+0000 7f22659f5640 1 -- 172.21.15.93:0/92910133 wait complete. 2023-11-04T01:36:04.459 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:04.460 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:04.477 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:04.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.615+0000 7fac19d0c640 1 Processor -- start 2023-11-04T01:36:04.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.615+0000 7fac19d0c640 1 -- start start 2023-11-04T01:36:04.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac19d0c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac1415aa30 0x7fac140c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac19d0c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 0x7fac140b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac19d0c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1415bc30 con 0x7fac140ca280 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac19d0c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1415bf10 con 0x7fac1415aa30 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac19d0c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c9540 con 0x7fac1406ce00 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac137fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac1415aa30 0x7fac140c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac137fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac1415aa30 0x7fac140c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33036/0 (socket says 172.21.15.93:33036) 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.616+0000 7fac137fe640 1 -- 172.21.15.93:0/3678191895 learned_addr learned my addr 172.21.15.93:0/3678191895 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac137fe640 1 -- 172.21.15.93:0/3678191895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 msgr2=0x7fac140b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac13fff640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 0x7fac140b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac137fe640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 0x7fac140b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac137fe640 1 -- 172.21.15.93:0/3678191895 >> v1:172.21.15.125:6789/0 conn(0x7fac140ca280 legacy=0x7fac1406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:04.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac137fe640 1 -- 172.21.15.93:0/3678191895 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140c9820 con 0x7fac1415aa30 2023-11-04T01:36:04.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac13fff640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 0x7fac140b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:04.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac137fe640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac1415aa30 0x7fac140c9d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac04009870 tx=0x7fac0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51217a20952d48b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac127fc640 1 -- 172.21.15.93:0/3678191895 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04031640 con 0x7fac1415aa30 2023-11-04T01:36:04.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac127fc640 1 -- 172.21.15.93:0/3678191895 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040317a0 con 0x7fac1415aa30 2023-11-04T01:36:04.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.617+0000 7fac127fc640 1 -- 172.21.15.93:0/3678191895 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04031b30 con 0x7fac1415aa30 2023-11-04T01:36:04.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 -- 172.21.15.93:0/3678191895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac1415aa30 msgr2=0x7fac140c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac1415aa30 0x7fac140c9d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac04009870 tx=0x7fac0402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 -- 172.21.15.93:0/3678191895 shutdown_connections 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac1406ce00 0x7fac140b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 --2- 172.21.15.93:0/3678191895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac1415aa30 0x7fac140c9d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 -- 172.21.15.93:0/3678191895 >> 172.21.15.93:0/3678191895 conn(0x7fac140cb7f0 msgr2=0x7fac140cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 -- 172.21.15.93:0/3678191895 shutdown_connections 2023-11-04T01:36:04.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.618+0000 7fac19d0c640 1 -- 172.21.15.93:0/3678191895 wait complete. 2023-11-04T01:36:04.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.619+0000 7fac19d0c640 1 Processor -- start 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.619+0000 7fac19d0c640 1 -- start start 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac1415aa30 0x7fac1414cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 0x7fac14070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14071470 con 0x7fac140c2bc0 2023-11-04T01:36:04.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1414d0b0 con 0x7fac1415aa30 2023-11-04T01:36:04.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac19d0c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c3580 con 0x7fac14070ab0 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33044/0 (socket says 172.21.15.93:33044) 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 -- 172.21.15.93:0/1525877318 learned_addr learned my addr 172.21.15.93:0/1525877318 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 -- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 msgr2=0x7fac14070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac12ffd640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 0x7fac14070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac137fe640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac1415aa30 0x7fac1414cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 0x7fac14070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 -- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac1415aa30 msgr2=0x7fac1414cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac1415aa30 0x7fac1414cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac13fff640 1 -- 172.21.15.93:0/1525877318 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040094d0 con 0x7fac140c2bc0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.620+0000 7fac12ffd640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 0x7fac14070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fac13fff640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cdd0 tx=0x7fac0c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00d840 con 0x7fac140c2bc0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00d9a0 con 0x7fac140c2bc0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac141f3b10 con 0x7fac140c2bc0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00dd90 con 0x7fac140c2bc0 2023-11-04T01:36:04.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.621+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac141f40d0 con 0x7fac140c2bc0 2023-11-04T01:36:04.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.622+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14150af0 con 0x7fac140c2bc0 2023-11-04T01:36:04.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.622+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac0c01e3b0 con 0x7fac140c2bc0 2023-11-04T01:36:04.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.623+0000 7fabfbfff640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 0x7fac0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.623+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac0c08a300 con 0x7fac140c2bc0 2023-11-04T01:36:04.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.623+0000 7fac137fe640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 0x7fac0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.623+0000 7fac137fe640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 0x7fac0006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac04036000 tx=0x7fac0403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.627+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac14150af0 con 0x7fac140c2bc0 2023-11-04T01:36:04.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.793+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac14150af0 con 0x7fac140c2bc0 2023-11-04T01:36:04.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.795+0000 7fabfbfff640 1 -- 172.21.15.93:0/1525877318 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fac14150af0 con 0x7fac140c2bc0 2023-11-04T01:36:04.798 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:04.798 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.796+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 msgr2=0x7fac0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.796+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 0x7fac0006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac04036000 tx=0x7fac0403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.796+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 msgr2=0x7fac140c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.796+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cdd0 tx=0x7fac0c00a710 comp rx=0 tx=0).stop 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 shutdown_connections 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fac0006ae70 0x7fac0006d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac140c2bc0 0x7fac140c3040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fac14070ab0 0x7fac14070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 --2- 172.21.15.93:0/1525877318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac1415aa30 0x7fac1414cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 >> 172.21.15.93:0/1525877318 conn(0x7fac140cb7f0 msgr2=0x7fac140b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 shutdown_connections 2023-11-04T01:36:04.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.797+0000 7fac19d0c640 1 -- 172.21.15.93:0/1525877318 wait complete. 2023-11-04T01:36:04.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:04.809 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:04.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.912+0000 7ff9db525640 1 Processor -- start 2023-11-04T01:36:04.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.912+0000 7ff9db525640 1 -- start start 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9db525640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9d40cccc0 0x7ff9d406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9db525640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d406ca40 con 0x7ff9d4160430 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9db525640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d406cd20 con 0x7ff9d40b2d30 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9db525640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d40cb580 con 0x7ff9d40cccc0 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d9ac2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9d40cccc0 0x7ff9d406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d92c1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff9d4160430 0x7ff9d40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50142/0 (socket says 172.21.15.93:50142) 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d92c1640 1 -- 172.21.15.93:0/3827101982 learned_addr learned my addr 172.21.15.93:0/3827101982 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d9ac2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9d40cccc0 0x7ff9d406c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33048/0 (socket says 172.21.15.93:33048) 2023-11-04T01:36:04.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/3827101982 >> v1:172.21.15.125:6789/0 conn(0x7ff9d40b2d30 legacy=0x7ff9d406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:04.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/3827101982 >> v1:172.21.15.93:6789/0 conn(0x7ff9d4160430 legacy=0x7ff9d40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/3827101982 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d406d000 con 0x7ff9d40cccc0 2023-11-04T01:36:04.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.913+0000 7ff9cbfff640 1 -- 172.21.15.93:0/3827101982 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945108491 0 0) 0x7ff9d406ca40 con 0x7ff9d4160430 2023-11-04T01:36:04.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.914+0000 7ff9d9ac2640 1 --2- 172.21.15.93:0/3827101982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40cccc0 0x7ff9d406c3a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009d90 tx=0x7ff9cc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05b2b3fc17f54a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.914+0000 7ff9cbfff640 1 -- 172.21.15.93:0/3827101982 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc02cc60 con 0x7ff9d40cccc0 2023-11-04T01:36:04.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.914+0000 7ff9cbfff640 1 -- 172.21.15.93:0/3827101982 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc02cdc0 con 0x7ff9d40cccc0 2023-11-04T01:36:04.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.914+0000 7ff9cbfff640 1 -- 172.21.15.93:0/3827101982 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc034660 con 0x7ff9d40cccc0 2023-11-04T01:36:04.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 -- 172.21.15.93:0/3827101982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40cccc0 msgr2=0x7ff9d406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 --2- 172.21.15.93:0/3827101982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40cccc0 0x7ff9d406c3a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009d90 tx=0x7ff9cc02beb0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 -- 172.21.15.93:0/3827101982 shutdown_connections 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 --2- 172.21.15.93:0/3827101982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d40cccc0 0x7ff9d406c3a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 -- 172.21.15.93:0/3827101982 >> 172.21.15.93:0/3827101982 conn(0x7ff9d406ea20 msgr2=0x7ff9d406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 -- 172.21.15.93:0/3827101982 shutdown_connections 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.915+0000 7ff9db525640 1 -- 172.21.15.93:0/3827101982 wait complete. 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.916+0000 7ff9db525640 1 Processor -- start 2023-11-04T01:36:04.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.916+0000 7ff9db525640 1 -- start start 2023-11-04T01:36:04.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40b2d30 0x7ff9d40c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d40cccc0 0x7ff9d414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40b06f0 con 0x7ff9d4160430 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d414dc60 con 0x7ff9d40cccc0 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40b0940 con 0x7ff9d40b2d30 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33060/0 (socket says 172.21.15.93:33060) 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/2691374285 learned_addr learned my addr 172.21.15.93:0/2691374285 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:04.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40b2d30 msgr2=0x7ff9d40c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40b2d30 0x7ff9d40c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d8ac0640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d40cccc0 0x7ff9d414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d40cccc0 msgr2=0x7ff9d414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d40cccc0 0x7ff9d414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 -- 172.21.15.93:0/2691374285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009a70 con 0x7ff9d4160430 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9d9ac2640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009d90 tx=0x7ff9cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc03e610 con 0x7ff9d4160430 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc03e790 con 0x7ff9d4160430 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d40b0c20 con 0x7ff9d4160430 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.917+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc03eb40 con 0x7ff9d4160430 2023-11-04T01:36:04.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.918+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40b11e0 con 0x7ff9d4160430 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.919+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40b1400 con 0x7ff9d4160430 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.919+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9cc03b050 con 0x7ff9d4160430 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.919+0000 7ff9c9ffb640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 0x7ff9b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.919+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9cc0ac370 con 0x7ff9d4160430 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.919+0000 7ff9d92c1640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 0x7ff9b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.920+0000 7ff9d92c1640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 0x7ff9b806d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0007fd0 tx=0x7ff9d0007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:04.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:04.923+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9cc077130 con 0x7ff9d4160430 2023-11-04T01:36:05.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.090+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9d4074290 con 0x7ff9d4160430 2023-11-04T01:36:05.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.090+0000 7ff9c9ffb640 1 -- 172.21.15.93:0/2691374285 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9cc07a750 con 0x7ff9d4160430 2023-11-04T01:36:05.092 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 msgr2=0x7ff9b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 0x7ff9b806d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0007fd0 tx=0x7ff9d0007960 comp rx=0 tx=0).stop 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 msgr2=0x7ff9d40ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009d90 tx=0x7ff9cc004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 shutdown_connections 2023-11-04T01:36:05.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9b806ae70 0x7ff9b806d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9d4160430 0x7ff9d40ca4f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d40cccc0 0x7ff9d414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 --2- 172.21.15.93:0/2691374285 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d40b2d30 0x7ff9d40c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 >> 172.21.15.93:0/2691374285 conn(0x7ff9d406ea20 msgr2=0x7ff9d406c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 shutdown_connections 2023-11-04T01:36:05.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.092+0000 7ff9db525640 1 -- 172.21.15.93:0/2691374285 wait complete. 2023-11-04T01:36:05.104 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:05.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.204+0000 7f7a3c355640 1 Processor -- start 2023-11-04T01:36:05.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.204+0000 7f7a3c355640 1 -- start start 2023-11-04T01:36:05.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3c355640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a34153e60 0x7f7a3415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3c355640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340cde60 con 0x7f7a340b4880 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3c355640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34160f90 con 0x7f7a340cd6d0 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3c355640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3415e400 con 0x7f7a34153e60 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3a8f2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7a340b4880 0x7f7a340d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50148/0 (socket says 172.21.15.93:50148) 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3a8f2640 1 -- 172.21.15.93:0/4232551270 learned_addr learned my addr 172.21.15.93:0/4232551270 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.205+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/4232551270 >> v2:172.21.15.125:3300/0 conn(0x7f7a34153e60 0x7f7a3415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074521411 0 0) 0x7f7a340cde60 con 0x7f7a340b4880 2023-11-04T01:36:05.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a20003520 con 0x7f7a340b4880 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096471837 0 0) 0x7f7a34160f90 con 0x7f7a340cd6d0 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a340cde60 con 0x7f7a340cd6d0 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 127061564 0 0) 0x7f7a20003520 con 0x7f7a340b4880 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 >> v2:172.21.15.125:3300/0 conn(0x7f7a34153e60 msgr2=0x7f7a3415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 --2- 172.21.15.93:0/4232551270 >> v2:172.21.15.125:3300/0 conn(0x7f7a34153e60 0x7f7a3415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 >> v1:172.21.15.125:6789/0 conn(0x7f7a340cd6d0 legacy=0x7f7a34161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340ce090 con 0x7f7a340b4880 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f7a2c001670 con 0x7f7a340b4880 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 >> v1:172.21.15.93:6789/0 conn(0x7f7a340b4880 legacy=0x7f7a340d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a20003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a200047c0 0x7f7a20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a20005180 0x7f7a2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3415e400 con 0x7f7a20003b00 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2000c000 con 0x7f7a200047c0 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2000c1c0 con 0x7f7a20005180 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a20003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a398f0640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a200047c0 0x7f7a20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a8f2640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a20005180 0x7f7a2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a20005180 msgr2=0x7f7a2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a20005180 0x7f7a2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a200047c0 msgr2=0x7f7a20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a200047c0 0x7f7a20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/4232551270 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a20003520 con 0x7f7a20003b00 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a8f2640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a20005180 0x7f7a2000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.206+0000 7f7a3a8f2640 1 -- 172.21.15.93:0/4232551270 reap_dead start 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.207+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a20003f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009fc0 tx=0x7f7a200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49d84add0702ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.207+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3002cbf0 con 0x7f7a20003b00 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.207+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3000f040 con 0x7f7a20003b00 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.207+0000 7f7a390ef640 1 -- 172.21.15.93:0/4232551270 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30034440 con 0x7f7a20003b00 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 -- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 msgr2=0x7f7a20003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a20003f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009fc0 tx=0x7f7a200057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 -- 172.21.15.93:0/4232551270 shutdown_connections 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 --2- 172.21.15.93:0/4232551270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a20003f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 -- 172.21.15.93:0/4232551270 >> 172.21.15.93:0/4232551270 conn(0x7f7a340cf880 msgr2=0x7f7a340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 -- 172.21.15.93:0/4232551270 shutdown_connections 2023-11-04T01:36:05.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.208+0000 7f7a3c355640 1 -- 172.21.15.93:0/4232551270 wait complete. 2023-11-04T01:36:05.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.209+0000 7f7a3c355640 1 Processor -- start 2023-11-04T01:36:05.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.209+0000 7f7a3c355640 1 -- start start 2023-11-04T01:36:05.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 0x7f7a340c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 0x7f7a340cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340cc460 con 0x7f7a20003b00 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c7310 con 0x7f7a340cbaa0 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c75f0 con 0x7f7a341f2310 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33076/0 (socket says 172.21.15.93:33076) 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/3787492277 learned_addr learned my addr 172.21.15.93:0/3787492277 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a8f2640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 0x7f7a340cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a398f0640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 0x7f7a340c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 msgr2=0x7f7a340c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 0x7f7a340c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 msgr2=0x7f7a340cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 0x7f7a340cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 -- 172.21.15.93:0/3787492277 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340c78d0 con 0x7f7a20003b00 2023-11-04T01:36:05.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a398f0640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 0x7f7a340c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:05.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a8f2640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 0x7f7a340cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:05.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3a0f1640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000e230 tx=0x7f7a30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30034c50 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30034dd0 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30003bd0 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a340c7bb0 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.210+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a340c8170 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.211+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34074290 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.212+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a30040450 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.212+0000 7f7a2affd640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 0x7f7a1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.212+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a300ac0e0 con 0x7f7a20003b00 2023-11-04T01:36:05.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.212+0000 7f7a398f0640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 0x7f7a1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.212+0000 7f7a398f0640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 0x7f7a1806d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a341f5c10 tx=0x7f7a24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.216+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a30076ea0 con 0x7f7a20003b00 2023-11-04T01:36:05.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.381+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a34154e70 con 0x7f7a20003b00 2023-11-04T01:36:05.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.381+0000 7f7a2affd640 1 -- 172.21.15.93:0/3787492277 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a3007a4c0 con 0x7f7a20003b00 2023-11-04T01:36:05.383 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:05.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 msgr2=0x7f7a1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 0x7f7a1806d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a341f5c10 tx=0x7f7a24009040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 msgr2=0x7f7a340c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000e230 tx=0x7f7a30009750 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 shutdown_connections 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a1806ae70 0x7f7a1806d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a340cbaa0 0x7f7a340cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a341f2310 0x7f7a340c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 --2- 172.21.15.93:0/3787492277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a20003b00 0x7f7a340c8e60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 >> 172.21.15.93:0/3787492277 conn(0x7f7a340cf880 msgr2=0x7f7a340cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 shutdown_connections 2023-11-04T01:36:05.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.383+0000 7f7a3c355640 1 -- 172.21.15.93:0/3787492277 wait complete. 2023-11-04T01:36:05.399 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:05.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.507+0000 7fc85aac9640 1 Processor -- start 2023-11-04T01:36:05.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.507+0000 7fc85aac9640 1 -- start start 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc85aac9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc8540b2d30 0x7fc85406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc85aac9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85406ca40 con 0x7fc854160430 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc85aac9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85406cd20 con 0x7fc85406c1d0 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc85aac9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8540cb580 con 0x7fc8540b2d30 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc858865640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc854160430 0x7fc8540b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50164/0 (socket says 172.21.15.93:50164) 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc858865640 1 -- 172.21.15.93:0/1191817327 learned_addr learned my addr 172.21.15.93:0/1191817327 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc853fff640 1 --2- 172.21.15.93:0/1191817327 >> v2:172.21.15.125:3300/0 conn(0x7fc8540b2d30 0x7fc85406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901479772 0 0) 0x7fc85406ca40 con 0x7fc854160430 2023-11-04T01:36:05.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc844003520 con 0x7fc854160430 2023-11-04T01:36:05.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc853fff640 1 -- 172.21.15.93:0/1191817327 >> v1:172.21.15.125:6789/0 conn(0x7fc85406c1d0 legacy=0x7fc8540cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810120132 0 0) 0x7fc85406cd20 con 0x7fc85406c1d0 2023-11-04T01:36:05.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc853fff640 1 -- 172.21.15.93:0/1191817327 >> v1:172.21.15.93:6789/0 conn(0x7fc854160430 legacy=0x7fc8540b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.508+0000 7fc853fff640 1 -- 172.21.15.93:0/1191817327 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85406d000 con 0x7fc8540b2d30 2023-11-04T01:36:05.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.509+0000 7fc853fff640 1 --2- 172.21.15.93:0/1191817327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc85406bc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8400097d0 tx=0x7fc84002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edfa02ed39c7e5bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.509+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840030610 con 0x7fc8540b2d30 2023-11-04T01:36:05.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.509+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840030770 con 0x7fc8540b2d30 2023-11-04T01:36:05.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.509+0000 7fc8537fe640 1 -- 172.21.15.93:0/1191817327 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840030ae0 con 0x7fc8540b2d30 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 -- 172.21.15.93:0/1191817327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 msgr2=0x7fc85406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 --2- 172.21.15.93:0/1191817327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc85406bc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8400097d0 tx=0x7fc84002b960 comp rx=0 tx=0).stop 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 -- 172.21.15.93:0/1191817327 shutdown_connections 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 --2- 172.21.15.93:0/1191817327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc85406bc90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 -- 172.21.15.93:0/1191817327 >> 172.21.15.93:0/1191817327 conn(0x7fc85406ea20 msgr2=0x7fc85406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 -- 172.21.15.93:0/1191817327 shutdown_connections 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.510+0000 7fc85aac9640 1 -- 172.21.15.93:0/1191817327 wait complete. 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.511+0000 7fc85aac9640 1 Processor -- start 2023-11-04T01:36:05.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.511+0000 7fc85aac9640 1 -- start start 2023-11-04T01:36:05.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc85406c1d0 0x7fc8541f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc854152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540c9760 con 0x7fc854160430 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc854152690 con 0x7fc8540b2d30 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc85aac9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540c7780 con 0x7fc85406c1d0 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33092/0 (socket says 172.21.15.93:33092) 2023-11-04T01:36:05.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 -- 172.21.15.93:0/2733700902 learned_addr learned my addr 172.21.15.93:0/2733700902 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc858865640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc85406c1d0 0x7fc8541f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc853fff640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc854152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 -- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc85406c1d0 msgr2=0x7fc8541f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc85406c1d0 0x7fc8541f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 -- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 msgr2=0x7fc854152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc854152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 -- 172.21.15.93:0/2733700902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840009400 con 0x7fc854160430 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.512+0000 7fc859066640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c760 tx=0x7fc84c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.513+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c003da0 con 0x7fc854160430 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.513+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00ce70 con 0x7fc854160430 2023-11-04T01:36:05.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.513+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8540c99d0 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.513+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c005290 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.513+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8540b3860 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.514+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc854074290 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.514+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc84c0053f0 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.514+0000 7fc8517fa640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 0x7fc83806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.515+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc84c089730 con 0x7fc854160430 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.515+0000 7fc858865640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 0x7fc83806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.515+0000 7fc858865640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 0x7fc83806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc848005880 tx=0x7fc848009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.519+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc84c0544f0 con 0x7fc854160430 2023-11-04T01:36:05.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.686+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8540b6880 con 0x7fc854160430 2023-11-04T01:36:05.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.686+0000 7fc8517fa640 1 -- 172.21.15.93:0/2733700902 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc84c057b10 con 0x7fc854160430 2023-11-04T01:36:05.688 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 msgr2=0x7fc83806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 0x7fc83806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc848005880 tx=0x7fc848009040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 msgr2=0x7fc8540c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c760 tx=0x7fc84c00cc20 comp rx=0 tx=0).stop 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 shutdown_connections 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc83806aea0 0x7fc83806d360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc854160430 0x7fc8540c7240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8540b2d30 0x7fc854152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 --2- 172.21.15.93:0/2733700902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc85406c1d0 0x7fc8541f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 >> 172.21.15.93:0/2733700902 conn(0x7fc85406ea20 msgr2=0x7fc8540b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 shutdown_connections 2023-11-04T01:36:05.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.688+0000 7fc85aac9640 1 -- 172.21.15.93:0/2733700902 wait complete. 2023-11-04T01:36:05.700 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:05.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.801+0000 7f6afe32c640 1 Processor -- start 2023-11-04T01:36:05.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.801+0000 7f6afe32c640 1 -- start start 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afe32c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6af8160430 0x7f6af80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afe32c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6af806c3a0 0x7f6af80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afe32c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af80b2fc0 con 0x7f6af80b2b60 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afe32c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af80cb580 con 0x7f6af8160430 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afe32c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af806c7d0 con 0x7f6af806c3a0 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6af8160430 0x7f6af80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6af80b2b60 0x7f6af806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50180/0 (socket says 172.21.15.93:50180) 2023-11-04T01:36:05.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af77fe640 1 -- 172.21.15.93:0/4095890165 learned_addr learned my addr 172.21.15.93:0/4095890165 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:05.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6afc8c9640 1 --2- 172.21.15.93:0/4095890165 >> v2:172.21.15.125:3300/0 conn(0x7f6af806c3a0 0x7f6af80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af7fff640 1 -- 172.21.15.93:0/4095890165 >> v2:172.21.15.125:3300/0 conn(0x7f6af806c3a0 msgr2=0x7f6af80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af7fff640 1 --2- 172.21.15.93:0/4095890165 >> v2:172.21.15.125:3300/0 conn(0x7f6af806c3a0 0x7f6af80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af7fff640 1 -- 172.21.15.93:0/4095890165 >> v1:172.21.15.93:6789/0 conn(0x7f6af80b2b60 legacy=0x7f6af806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.802+0000 7f6af7fff640 1 -- 172.21.15.93:0/4095890165 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af806ca40 con 0x7f6af8160430 2023-11-04T01:36:05.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.803+0000 7f6af7fff640 1 --2- 172.21.15.93:0/4095890165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af8160430 0x7f6af80b2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6af80c4600 tx=0x7f6ae802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8256eba827bbb6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.803+0000 7f6af6ffd640 1 -- 172.21.15.93:0/4095890165 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8031830 con 0x7f6af8160430 2023-11-04T01:36:05.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.803+0000 7f6af6ffd640 1 -- 172.21.15.93:0/4095890165 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8031990 con 0x7f6af8160430 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.803+0000 7f6af6ffd640 1 -- 172.21.15.93:0/4095890165 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8031d20 con 0x7f6af8160430 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 -- 172.21.15.93:0/4095890165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af8160430 msgr2=0x7f6af80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 --2- 172.21.15.93:0/4095890165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af8160430 0x7f6af80b2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6af80c4600 tx=0x7f6ae802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 -- 172.21.15.93:0/4095890165 shutdown_connections 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 --2- 172.21.15.93:0/4095890165 >> v2:172.21.15.125:3300/0 conn(0x7f6af806c3a0 0x7f6af80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 --2- 172.21.15.93:0/4095890165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af8160430 0x7f6af80b2620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 -- 172.21.15.93:0/4095890165 >> 172.21.15.93:0/4095890165 conn(0x7f6af806ea20 msgr2=0x7f6af806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 -- 172.21.15.93:0/4095890165 shutdown_connections 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.804+0000 7f6afe32c640 1 -- 172.21.15.93:0/4095890165 wait complete. 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.805+0000 7f6afe32c640 1 Processor -- start 2023-11-04T01:36:05.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.805+0000 7f6afe32c640 1 -- start start 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6af806c3a0 0x7f6af80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 0x7f6af80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80b37c0 con 0x7f6af80b2b60 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8155e60 con 0x7f6af8160430 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afe32c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8154cf0 con 0x7f6af806c3a0 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33114/0 (socket says 172.21.15.93:33114) 2023-11-04T01:36:05.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 -- 172.21.15.93:0/1574167672 learned_addr learned my addr 172.21.15.93:0/1574167672 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afc8c9640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 0x7f6af80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af7fff640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6af806c3a0 0x7f6af80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 -- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6af806c3a0 msgr2=0x7f6af80b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6af806c3a0 0x7f6af80b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 -- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 msgr2=0x7f6af80c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 0x7f6af80c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6af77fe640 1 -- 172.21.15.93:0/1574167672 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8009400 con 0x7f6af80b2b60 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.806+0000 7f6afc8c9640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 0x7f6af80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6af77fe640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c4a0 tx=0x7f6ae000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0005ce0 con 0x7f6af80b2b60 2023-11-04T01:36:05.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0005e40 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0007270 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af8154fd0 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.807+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af80b39d0 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.808+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af80b3bf0 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.808+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ae0007490 con 0x7f6af80b2b60 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.808+0000 7f6af4ff9640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 0x7f6ad806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.808+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ae0088d40 con 0x7f6af80b2b60 2023-11-04T01:36:05.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.809+0000 7f6af7fff640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 0x7f6ad806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.809+0000 7f6af7fff640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 0x7f6ad806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8036000 tx=0x7f6ae803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.813+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ae0053bb0 con 0x7f6af80b2b60 2023-11-04T01:36:05.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.977+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6af8074290 con 0x7f6af80b2b60 2023-11-04T01:36:05.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.977+0000 7f6af4ff9640 1 -- 172.21.15.93:0/1574167672 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6ae0017020 con 0x7f6af80b2b60 2023-11-04T01:36:05.979 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:05.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 msgr2=0x7f6ad806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 0x7f6ad806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8036000 tx=0x7f6ae803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:05.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 msgr2=0x7f6af8152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000c4a0 tx=0x7f6ae000c960 comp rx=0 tx=0).stop 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 shutdown_connections 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ad806ae70 0x7f6ad806d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6af8160430 0x7f6af80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6af80b2b60 0x7f6af8152370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 --2- 172.21.15.93:0/1574167672 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6af806c3a0 0x7f6af80b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.979+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 >> 172.21.15.93:0/1574167672 conn(0x7f6af806ea20 msgr2=0x7f6af80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.980+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 shutdown_connections 2023-11-04T01:36:05.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:05.980+0000 7f6afe32c640 1 -- 172.21.15.93:0/1574167672 wait complete. 2023-11-04T01:36:05.992 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:06.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.091+0000 7fa813d6c640 1 Processor -- start 2023-11-04T01:36:06.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.091+0000 7fa813d6c640 1 -- start start 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa813d6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c1605b0 0x7fa80c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa813d6c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa80c06a830 0x7fa80c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa813d6c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c160990 con 0x7fa80c0b1a40 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa813d6c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0cc7c0 con 0x7fa80c06a830 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa813d6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cd750 con 0x7fa80c1605b0 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa80c06a830 0x7fa80c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa80c06a830 0x7fa80c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33122/0 (socket says 172.21.15.93:33122) 2023-11-04T01:36:06.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 -- 172.21.15.93:0/1637684093 learned_addr learned my addr 172.21.15.93:0/1637684093 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa811b08640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c1605b0 0x7fa80c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 -- 172.21.15.93:0/1637684093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c1605b0 msgr2=0x7fa80c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c1605b0 0x7fa80c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 -- 172.21.15.93:0/1637684093 >> v1:172.21.15.125:6789/0 conn(0x7fa80c0b1a40 legacy=0x7fa80c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.092+0000 7fa812309640 1 -- 172.21.15.93:0/1637684093 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0cc4e0 con 0x7fa80c06a830 2023-11-04T01:36:06.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.093+0000 7fa812309640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c06a830 0x7fa80c0cf9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa808009870 tx=0x7fa80802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe257330a0c935fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.093+0000 7fa810b06640 1 -- 172.21.15.93:0/1637684093 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080317c0 con 0x7fa80c06a830 2023-11-04T01:36:06.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.093+0000 7fa810b06640 1 -- 172.21.15.93:0/1637684093 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808031920 con 0x7fa80c06a830 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.093+0000 7fa810b06640 1 -- 172.21.15.93:0/1637684093 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031cb0 con 0x7fa80c06a830 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 -- 172.21.15.93:0/1637684093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c06a830 msgr2=0x7fa80c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c06a830 0x7fa80c0cf9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa808009870 tx=0x7fa80802b860 comp rx=0 tx=0).stop 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 -- 172.21.15.93:0/1637684093 shutdown_connections 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c06a830 0x7fa80c0cf9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 --2- 172.21.15.93:0/1637684093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c1605b0 0x7fa80c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 -- 172.21.15.93:0/1637684093 >> 172.21.15.93:0/1637684093 conn(0x7fa80c071820 msgr2=0x7fa80c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 -- 172.21.15.93:0/1637684093 shutdown_connections 2023-11-04T01:36:06.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.094+0000 7fa813d6c640 1 -- 172.21.15.93:0/1637684093 wait complete. 2023-11-04T01:36:06.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.095+0000 7fa813d6c640 1 Processor -- start 2023-11-04T01:36:06.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.095+0000 7fa813d6c640 1 -- start start 2023-11-04T01:36:06.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c06a830 0x7fa80c1f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa80c1605b0 0x7fa80c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0c64b0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0abbe0 con 0x7fa80c1605b0 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0abec0 con 0x7fa80c06a830 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33138/0 (socket says 172.21.15.93:33138) 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 -- 172.21.15.93:0/978626566 learned_addr learned my addr 172.21.15.93:0/978626566 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa811b08640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c06a830 0x7fa80c1f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa811307640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa80c1605b0 0x7fa80c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 -- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c06a830 msgr2=0x7fa80c1f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c06a830 0x7fa80c1f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 -- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa80c1605b0 msgr2=0x7fa80c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa80c1605b0 0x7fa80c14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 -- 172.21.15.93:0/978626566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080094d0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa812309640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa808009870 tx=0x7fa8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808032860 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080329e0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.096+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c0ac1a0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.097+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808032d90 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.097+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c14e150 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.098+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c0672a0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.098+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa80804e450 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.098+0000 7fa8027fc640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.098+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8080ab8c0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.099+0000 7fa811b08640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.099+0000 7fa811b08640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 0x7fa7f006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8040113e0 tx=0x7fa80400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.103+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8080767c0 con 0x7fa80c0c5b40 2023-11-04T01:36:06.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.280+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa80c0ac000 con 0x7fa80c0c5b40 2023-11-04T01:36:06.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.281+0000 7fa8027fc640 1 -- 172.21.15.93:0/978626566 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa80c0ac000 con 0x7fa80c0c5b40 2023-11-04T01:36:06.284 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:06.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.282+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 msgr2=0x7fa7f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 0x7fa7f006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8040113e0 tx=0x7fa80400b040 comp rx=0 tx=0).stop 2023-11-04T01:36:06.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 msgr2=0x7fa80c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa808009870 tx=0x7fa8080046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 shutdown_connections 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7f006ae70 0x7fa7f006d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa80c0c5b40 0x7fa80c0b07a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa80c1605b0 0x7fa80c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 --2- 172.21.15.93:0/978626566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa80c06a830 0x7fa80c1f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 >> 172.21.15.93:0/978626566 conn(0x7fa80c071820 msgr2=0x7fa80c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 shutdown_connections 2023-11-04T01:36:06.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.283+0000 7fa813d6c640 1 -- 172.21.15.93:0/978626566 wait complete. 2023-11-04T01:36:06.295 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:36:06.295 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:06.295 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:06.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:06.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi093.stderr:ceph-fuse[125359]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:06.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:06.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi093.stderr:2023-11-04T01:36:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:06.361 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:06.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:36:06.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:06.367 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-04T01:36:06.431 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:06.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.569+0000 7fc20a01f640 1 Processor -- start 2023-11-04T01:36:06.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.569+0000 7fc20a01f640 1 -- start start 2023-11-04T01:36:06.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc20a01f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc20415ad80 0x7fc20406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc20a01f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2040b42c0 0x7fc2040c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc20a01f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20406cd00 con 0x7fc2040c9c40 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc20a01f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040ca020 con 0x7fc20415ad80 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc20a01f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20406cfa0 con 0x7fc2040b42c0 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc2037fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc20415ad80 0x7fc20406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc2037fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc20415ad80 0x7fc20406c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33150/0 (socket says 172.21.15.93:33150) 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.570+0000 7fc2037fe640 1 -- 172.21.15.93:0/3112185865 learned_addr learned my addr 172.21.15.93:0/3112185865 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc202ffd640 1 --2- 172.21.15.93:0/3112185865 >> v2:172.21.15.125:3300/0 conn(0x7fc2040b42c0 0x7fc2040c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc2037fe640 1 -- 172.21.15.93:0/3112185865 >> v2:172.21.15.125:3300/0 conn(0x7fc2040b42c0 msgr2=0x7fc2040c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc2037fe640 1 --2- 172.21.15.93:0/3112185865 >> v2:172.21.15.125:3300/0 conn(0x7fc2040b42c0 0x7fc2040c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc2037fe640 1 -- 172.21.15.93:0/3112185865 >> v1:172.21.15.125:6789/0 conn(0x7fc2040c9c40 legacy=0x7fc204070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc2037fe640 1 -- 172.21.15.93:0/3112185865 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20406d280 con 0x7fc20415ad80 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.571+0000 7fc2037fe640 1 --2- 172.21.15.93:0/3112185865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc20406c7c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2040c8e50 tx=0x7fc1f402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49a08b746ffd61c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc2027fc640 1 -- 172.21.15.93:0/3112185865 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f402f850 con 0x7fc20415ad80 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc2027fc640 1 -- 172.21.15.93:0/3112185865 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f402f9b0 con 0x7fc20415ad80 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc2027fc640 1 -- 172.21.15.93:0/3112185865 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f402fd40 con 0x7fc20415ad80 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 -- 172.21.15.93:0/3112185865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 msgr2=0x7fc20406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3112185865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc20406c7c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2040c8e50 tx=0x7fc1f402ba30 comp rx=0 tx=0).stop 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 -- 172.21.15.93:0/3112185865 shutdown_connections 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3112185865 >> v2:172.21.15.125:3300/0 conn(0x7fc2040b42c0 0x7fc2040c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3112185865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc20406c7c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 -- 172.21.15.93:0/3112185865 >> 172.21.15.93:0/3112185865 conn(0x7fc2040ce950 msgr2=0x7fc2040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 -- 172.21.15.93:0/3112185865 shutdown_connections 2023-11-04T01:36:06.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.572+0000 7fc20a01f640 1 -- 172.21.15.93:0/3112185865 wait complete. 2023-11-04T01:36:06.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.573+0000 7fc20a01f640 1 Processor -- start 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.573+0000 7fc20a01f640 1 -- start start 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2040b42c0 0x7fc20414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2040c9c40 0x7fc204156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc204153c40 con 0x7fc20415ad80 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc204153380 con 0x7fc2040b42c0 2023-11-04T01:36:06.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc20a01f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2041535f0 con 0x7fc2040c9c40 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33160/0 (socket says 172.21.15.93:33160) 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 -- 172.21.15.93:0/3755546502 learned_addr learned my addr 172.21.15.93:0/3755546502 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc202ffd640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2040c9c40 0x7fc204156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 -- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2040c9c40 msgr2=0x7fc204156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc2037fe640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2040b42c0 0x7fc20414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2040c9c40 0x7fc204156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 -- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2040b42c0 msgr2=0x7fc20414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2040b42c0 0x7fc20414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.574+0000 7fc203fff640 1 -- 172.21.15.93:0/3755546502 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40094d0 con 0x7fc20415ad80 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc203fff640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c760 tx=0x7fc1fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc003b90 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc003cf0 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc003ea0 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2041538d0 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.575+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20414ffb0 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.576+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc204153df0 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.576+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1fc00aa90 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.577+0000 7fc1ebfff640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 0x7fc1f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.577+0000 7fc2037fe640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 0x7fc1f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.577+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1fc089700 con 0x7fc20415ad80 2023-11-04T01:36:06.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.577+0000 7fc2037fe640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 0x7fc1f006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4036000 tx=0x7fc1f4039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.581+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc204153df0 con 0x7fc20415ad80 2023-11-04T01:36:06.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.750+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc204153df0 con 0x7fc20415ad80 2023-11-04T01:36:06.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.751+0000 7fc1ebfff640 1 -- 172.21.15.93:0/3755546502 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fc204153df0 con 0x7fc20415ad80 2023-11-04T01:36:06.752 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:06.753 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 msgr2=0x7fc1f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 0x7fc1f006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4036000 tx=0x7fc1f4039040 comp rx=0 tx=0).stop 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 msgr2=0x7fc204156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c760 tx=0x7fc1fc00cc20 comp rx=0 tx=0).stop 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 shutdown_connections 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1f006ae40 0x7fc1f006d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc20415ad80 0x7fc204156f50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2040c9c40 0x7fc204156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 --2- 172.21.15.93:0/3755546502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2040b42c0 0x7fc20414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 >> 172.21.15.93:0/3755546502 conn(0x7fc2040ce950 msgr2=0x7fc204070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 shutdown_connections 2023-11-04T01:36:06.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.753+0000 7fc20a01f640 1 -- 172.21.15.93:0/3755546502 wait complete. 2023-11-04T01:36:06.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:06.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.867+0000 7fce2ea44640 1 Processor -- start 2023-11-04T01:36:06.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.867+0000 7fce2ea44640 1 -- start start 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 0x7fce2806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 0x7fce280c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce280c9c40 0x7fce28070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280ca070 con 0x7fce280c9c40 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2806cd00 con 0x7fce280b42c0 2023-11-04T01:36:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2ea44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2806cfa0 con 0x7fce2815ad80 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2cfe1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce280c9c40 0x7fce28070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2cfe1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce280c9c40 0x7fce28070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33176/0 (socket says 172.21.15.93:33176) 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce2cfe1640 1 -- 172.21.15.93:0/2089613012 learned_addr learned my addr 172.21.15.93:0/2089613012 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce27fff640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 0x7fce2806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.868+0000 7fce277fe640 1 --2- 172.21.15.93:0/2089613012 >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 0x7fce280c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 -- 172.21.15.93:0/2089613012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 msgr2=0x7fce2806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 0x7fce2806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 -- 172.21.15.93:0/2089613012 >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 msgr2=0x7fce280c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 --2- 172.21.15.93:0/2089613012 >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 0x7fce280c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 -- 172.21.15.93:0/2089613012 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2806d280 con 0x7fce280c9c40 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce27fff640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 0x7fce2806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce277fe640 1 --2- 172.21.15.93:0/2089613012 >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 0x7fce280c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce2cfe1640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce28070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce2806ec00 tx=0x7fce2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5315526fed848e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce26ffd640 1 -- 172.21.15.93:0/2089613012 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2002cb00 con 0x7fce280c9c40 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce26ffd640 1 -- 172.21.15.93:0/2089613012 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2002cc60 con 0x7fce280c9c40 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.869+0000 7fce26ffd640 1 -- 172.21.15.93:0/2089613012 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200343f0 con 0x7fce280c9c40 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 -- 172.21.15.93:0/2089613012 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 msgr2=0x7fce28070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce28070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce2806ec00 tx=0x7fce2002bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 -- 172.21.15.93:0/2089613012 shutdown_connections 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce28070630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 --2- 172.21.15.93:0/2089613012 >> v2:172.21.15.125:3300/0 conn(0x7fce280b42c0 0x7fce280c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 --2- 172.21.15.93:0/2089613012 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce2815ad80 0x7fce2806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 -- 172.21.15.93:0/2089613012 >> 172.21.15.93:0/2089613012 conn(0x7fce280ce950 msgr2=0x7fce280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 -- 172.21.15.93:0/2089613012 shutdown_connections 2023-11-04T01:36:06.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.870+0000 7fce2ea44640 1 -- 172.21.15.93:0/2089613012 wait complete. 2023-11-04T01:36:06.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.871+0000 7fce2ea44640 1 Processor -- start 2023-11-04T01:36:06.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.871+0000 7fce2ea44640 1 -- start start 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 0x7fce281f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 0x7fce280abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce281f2b40 con 0x7fce280c9c40 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280ac4a0 con 0x7fce2815ad80 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2ea44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280ac780 con 0x7fce280b42c0 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33184/0 (socket says 172.21.15.93:33184) 2023-11-04T01:36:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 -- 172.21.15.93:0/1468842720 learned_addr learned my addr 172.21.15.93:0/1468842720 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2cfe1640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 0x7fce280abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce27fff640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 0x7fce281f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 -- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 msgr2=0x7fce281f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 0x7fce281f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 -- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 msgr2=0x7fce280abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 0x7fce280abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce277fe640 1 -- 172.21.15.93:0/1468842720 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20009b30 con 0x7fce280c9c40 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce2cfe1640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 0x7fce280abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.872+0000 7fce27fff640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 0x7fce281f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce277fe640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c7f0 tx=0x7fce1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007820 con 0x7fce280c9c40 2023-11-04T01:36:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c007980 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280aca60 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007d30 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.873+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce280ad020 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.874+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce28074290 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.874+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce1c0113f0 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.874+0000 7fce24ff9640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.875+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce1c089c20 con 0x7fce280c9c40 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.875+0000 7fce27fff640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.875+0000 7fce27fff640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 0x7fce1406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce280ce1b0 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:06.879+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce1c0549f0 con 0x7fce280c9c40 2023-11-04T01:36:07.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.045+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce280b4880 con 0x7fce280c9c40 2023-11-04T01:36:07.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.046+0000 7fce24ff9640 1 -- 172.21.15.93:0/1468842720 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fce1c058010 con 0x7fce280c9c40 2023-11-04T01:36:07.047 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:07.048 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:07.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 msgr2=0x7fce1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 0x7fce1406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce280ce1b0 tx=0x7fce18008040 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 msgr2=0x7fce280ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c7f0 tx=0x7fce1c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 shutdown_connections 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce2815ad80 0x7fce280abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce280c9c40 0x7fce280ab8e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 --2- 172.21.15.93:0/1468842720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce280b42c0 0x7fce281f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 >> 172.21.15.93:0/1468842720 conn(0x7fce280ce950 msgr2=0x7fce28070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 shutdown_connections 2023-11-04T01:36:07.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.048+0000 7fce2ea44640 1 -- 172.21.15.93:0/1468842720 wait complete. 2023-11-04T01:36:07.060 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:36:07.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.168+0000 7f1369e0e640 1 Processor -- start 2023-11-04T01:36:07.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.168+0000 7f1369e0e640 1 -- start start 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1369e0e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f136406a830 0x7f13640ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1369e0e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f136415e590 0x7f13640722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1369e0e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640ca620 con 0x7f136415e1b0 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1369e0e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136406e7e0 con 0x7f136415e590 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1369e0e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640cb060 con 0x7f136406a830 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1363fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f136415e590 0x7f13640722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1363fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f136415e590 0x7f13640722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33198/0 (socket says 172.21.15.93:33198) 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f1363fff640 1 -- 172.21.15.93:0/135416744 learned_addr learned my addr 172.21.15.93:0/135416744 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.169+0000 7f13637fe640 1 --1- 172.21.15.93:0/135416744 >> v1:172.21.15.93:6789/0 conn(0x7f136415e1b0 0x7f136406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50184/0 (socket says 172.21.15.93:50184) 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f135affd640 1 --2- 172.21.15.93:0/135416744 >> v2:172.21.15.125:3300/0 conn(0x7f136406a830 0x7f13640ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1363fff640 1 -- 172.21.15.93:0/135416744 >> v2:172.21.15.125:3300/0 conn(0x7f136406a830 msgr2=0x7f13640ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:07.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1363fff640 1 --2- 172.21.15.93:0/135416744 >> v2:172.21.15.125:3300/0 conn(0x7f136406a830 0x7f13640ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1363fff640 1 -- 172.21.15.93:0/135416744 >> v1:172.21.15.93:6789/0 conn(0x7f136415e1b0 legacy=0x7f136406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1362ffd640 1 -- 172.21.15.93:0/135416744 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133456972 0 0) 0x7f13640ca620 con 0x7f136415e1b0 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1363fff640 1 -- 172.21.15.93:0/135416744 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640ca060 con 0x7f136415e590 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1363fff640 1 --2- 172.21.15.93:0/135416744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e590 0x7f13640722d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13640cb710 tx=0x7f135c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7091d2e9296d61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.170+0000 7f1362ffd640 1 -- 172.21.15.93:0/135416744 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c02ca80 con 0x7f136415e590 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1362ffd640 1 -- 172.21.15.93:0/135416744 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c02cbe0 con 0x7f136415e590 2023-11-04T01:36:07.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1362ffd640 1 -- 172.21.15.93:0/135416744 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0343f0 con 0x7f136415e590 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 -- 172.21.15.93:0/135416744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e590 msgr2=0x7f13640722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 --2- 172.21.15.93:0/135416744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e590 0x7f13640722d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13640cb710 tx=0x7f135c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 -- 172.21.15.93:0/135416744 shutdown_connections 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 --2- 172.21.15.93:0/135416744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e590 0x7f13640722d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 --2- 172.21.15.93:0/135416744 >> v2:172.21.15.125:3300/0 conn(0x7f136406a830 0x7f13640ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 -- 172.21.15.93:0/135416744 >> 172.21.15.93:0/135416744 conn(0x7f136406d800 msgr2=0x7f136406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 -- 172.21.15.93:0/135416744 shutdown_connections 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.171+0000 7f1369e0e640 1 -- 172.21.15.93:0/135416744 wait complete. 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.172+0000 7f1369e0e640 1 Processor -- start 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.172+0000 7f1369e0e640 1 -- start start 2023-11-04T01:36:07.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136406a830 0x7f13641f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136415e590 0x7f13640b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364150850 con 0x7f136415e1b0 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640aba80 con 0x7f136415e590 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1369e0e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640abd60 con 0x7f136406a830 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33206/0 (socket says 172.21.15.93:33206) 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 -- 172.21.15.93:0/1985711800 learned_addr learned my addr 172.21.15.93:0/1985711800 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 -- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136406a830 msgr2=0x7f13641f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136406a830 0x7f13641f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 -- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136415e590 msgr2=0x7f13640b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f1363fff640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136415e590 0x7f13640b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136415e590 0x7f13640b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.173+0000 7f135affd640 1 -- 172.21.15.93:0/1985711800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c009b30 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f135affd640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d5f0 tx=0x7f134c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0125f0 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c012750 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640ac040 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c012b00 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.174+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13641f23f0 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.175+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13640cbb60 con 0x7f136415e1b0 2023-11-04T01:36:07.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.175+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f134c012c60 con 0x7f136415e1b0 2023-11-04T01:36:07.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.176+0000 7f1360ff9640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 0x7f134406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.176+0000 7f13637fe640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 0x7f134406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.176+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f134c089df0 con 0x7f136415e1b0 2023-11-04T01:36:07.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.176+0000 7f13637fe640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 0x7f134406d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.180+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f134c054bb0 con 0x7f136415e1b0 2023-11-04T01:36:07.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:07.383+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1364072370 con 0x7f136415e1b0 2023-11-04T01:36:08.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.113+0000 7f1360ff9640 1 -- 172.21.15.93:0/1985711800 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f134c0581d0 con 0x7f136415e1b0 2023-11-04T01:36:08.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 msgr2=0x7f134406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 0x7f134406d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007920 comp rx=0 tx=0).stop 2023-11-04T01:36:08.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 msgr2=0x7f13640b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d5f0 tx=0x7f134c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 shutdown_connections 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f134406ae70 0x7f134406d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136415e590 0x7f13640b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f136415e1b0 0x7f13640b02d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 --2- 172.21.15.93:0/1985711800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f136406a830 0x7f13641f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 >> 172.21.15.93:0/1985711800 conn(0x7f136406d800 msgr2=0x7f136415bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 shutdown_connections 2023-11-04T01:36:08.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.115+0000 7f1369e0e640 1 -- 172.21.15.93:0/1985711800 wait complete. 2023-11-04T01:36:08.128 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-04T01:36:08.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:36:08.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.231+0000 7f0098b5e640 1 Processor -- start 2023-11-04T01:36:08.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.231+0000 7f0098b5e640 1 -- start start 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0098b5e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00940cd6d0 0x7f0094161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0098b5e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f00940b4880 0x7f00940b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0098b5e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940cde60 con 0x7f0094153e60 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0098b5e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0094160f90 con 0x7f00940b4880 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0098b5e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0094161960 con 0x7f00940cd6d0 2023-11-04T01:36:08.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f0092d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f00940b4880 0x7f00940b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f009259c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0094153e60 0x7f009415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50192/0 (socket says 172.21.15.93:50192) 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.232+0000 7f009259c640 1 -- 172.21.15.93:0/2136179274 learned_addr learned my addr 172.21.15.93:0/2136179274 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0091d9b640 1 --2- 172.21.15.93:0/2136179274 >> v2:172.21.15.125:3300/0 conn(0x7f00940cd6d0 0x7f0094161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0092d9d640 1 -- 172.21.15.93:0/2136179274 >> v2:172.21.15.125:3300/0 conn(0x7f00940cd6d0 msgr2=0x7f0094161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0092d9d640 1 --2- 172.21.15.93:0/2136179274 >> v2:172.21.15.125:3300/0 conn(0x7f00940cd6d0 0x7f0094161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0092d9d640 1 -- 172.21.15.93:0/2136179274 >> v1:172.21.15.93:6789/0 conn(0x7f0094153e60 legacy=0x7f009415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0092d9d640 1 -- 172.21.15.93:0/2136179274 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940b5220 con 0x7f00940b4880 2023-11-04T01:36:08.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f009159a640 1 -- 172.21.15.93:0/2136179274 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194354821 0 0) 0x7f00940cde60 con 0x7f0094153e60 2023-11-04T01:36:08.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f0092d9d640 1 --2- 172.21.15.93:0/2136179274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940b4880 0x7f00940b4ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00940c9e80 tx=0x7f008c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60372ed00d1db1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f009159a640 1 -- 172.21.15.93:0/2136179274 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c031830 con 0x7f00940b4880 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.233+0000 7f009159a640 1 -- 172.21.15.93:0/2136179274 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c031990 con 0x7f00940b4880 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f009159a640 1 -- 172.21.15.93:0/2136179274 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c031d20 con 0x7f00940b4880 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 -- 172.21.15.93:0/2136179274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940b4880 msgr2=0x7f00940b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 --2- 172.21.15.93:0/2136179274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940b4880 0x7f00940b4ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00940c9e80 tx=0x7f008c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 -- 172.21.15.93:0/2136179274 shutdown_connections 2023-11-04T01:36:08.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 --2- 172.21.15.93:0/2136179274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940b4880 0x7f00940b4ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 --2- 172.21.15.93:0/2136179274 >> v2:172.21.15.125:3300/0 conn(0x7f00940cd6d0 0x7f0094161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 -- 172.21.15.93:0/2136179274 >> 172.21.15.93:0/2136179274 conn(0x7f00940cf880 msgr2=0x7f00940cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 -- 172.21.15.93:0/2136179274 shutdown_connections 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.234+0000 7f0098b5e640 1 -- 172.21.15.93:0/2136179274 wait complete. 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.235+0000 7f0098b5e640 1 Processor -- start 2023-11-04T01:36:08.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 -- start start 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00940b4880 0x7f00940c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 0x7f0094154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009415aad0 con 0x7f00940cd6d0 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941548d0 con 0x7f00940b4880 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0098b5e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00940c82b0 con 0x7f0094153e60 2023-11-04T01:36:08.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0091d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0091d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33224/0 (socket says 172.21.15.93:33224) 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0091d9b640 1 -- 172.21.15.93:0/211400259 learned_addr learned my addr 172.21.15.93:0/211400259 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f009259c640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00940b4880 0x7f00940c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.236+0000 7f0092d9d640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 0x7f0094154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 -- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 msgr2=0x7f0094154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 0x7f0094154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 -- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00940b4880 msgr2=0x7f00940c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00940b4880 0x7f00940c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 -- 172.21.15.93:0/211400259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009400 con 0x7f00940cd6d0 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0092d9d640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 0x7f0094154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0091d9b640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f008800d830 tx=0x7f008800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:08.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800b6c0 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800b820 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00940c8c30 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800bbb0 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.237+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00940c7fd0 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.238+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00940c8a90 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.238+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f008801e460 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.239+0000 7f0082ffd640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 0x7f007406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.239+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0088089f70 con 0x7f00940cd6d0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.239+0000 7f009259c640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 0x7f007406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.239+0000 7f009259c640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 0x7f007406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00840012e0 tx=0x7f0084001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:08.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.243+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00880bcca0 con 0x7f00940cd6d0 2023-11-04T01:36:08.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:08.444+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0094074290 con 0x7f00940cd6d0 2023-11-04T01:36:09.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.119+0000 7f0082ffd640 1 -- 172.21.15.93:0/211400259 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00940c8a90 con 0x7f00940cd6d0 2023-11-04T01:36:09.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 msgr2=0x7f007406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 0x7f007406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00840012e0 tx=0x7f0084001630 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 msgr2=0x7f0094152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f008800d830 tx=0x7f008800dcf0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 shutdown_connections 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f007406ae70 0x7f007406d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0094153e60 0x7f0094154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00940cd6d0 0x7f0094152c20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 --2- 172.21.15.93:0/211400259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00940b4880 0x7f00940c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 >> 172.21.15.93:0/211400259 conn(0x7f00940cf880 msgr2=0x7f00940d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 shutdown_connections 2023-11-04T01:36:09.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.122+0000 7f0098b5e640 1 -- 172.21.15.93:0/211400259 wait complete. 2023-11-04T01:36:09.134 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:36:09.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:09.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.234+0000 7f6eebf0f640 1 Processor -- start 2023-11-04T01:36:09.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.234+0000 7f6eebf0f640 1 -- start start 2023-11-04T01:36:09.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eebf0f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6ee40cbea0 0x7f6ee406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eebf0f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40cc2b0 con 0x7f6ee415ab70 2023-11-04T01:36:09.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eebf0f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee406d310 con 0x7f6ee406a830 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eebf0f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee40cba70 con 0x7f6ee40cbea0 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eea4ac640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6ee40cbea0 0x7f6ee406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6ee9cab640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6ee415ab70 0x7f6ee406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50198/0 (socket says 172.21.15.93:50198) 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6ee9cab640 1 -- 172.21.15.93:0/2868036728 learned_addr learned my addr 172.21.15.93:0/2868036728 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eea4ac640 1 -- 172.21.15.93:0/2868036728 >> v1:172.21.15.125:6789/0 conn(0x7f6ee406a830 legacy=0x7f6ee40ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eea4ac640 1 -- 172.21.15.93:0/2868036728 >> v1:172.21.15.93:6789/0 conn(0x7f6ee415ab70 legacy=0x7f6ee406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6eea4ac640 1 -- 172.21.15.93:0/2868036728 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee415d860 con 0x7f6ee40cbea0 2023-11-04T01:36:09.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.235+0000 7f6ee8ca9640 1 -- 172.21.15.93:0/2868036728 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371528116 0 0) 0x7f6ee40cc2b0 con 0x7f6ee415ab70 2023-11-04T01:36:09.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6eea4ac640 1 --2- 172.21.15.93:0/2868036728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee40cbea0 0x7f6ee406eba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b545287cc9b87243 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6ee8ca9640 1 -- 172.21.15.93:0/2868036728 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc02cbd0 con 0x7f6ee40cbea0 2023-11-04T01:36:09.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6ee8ca9640 1 -- 172.21.15.93:0/2868036728 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc02cd30 con 0x7f6ee40cbea0 2023-11-04T01:36:09.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6ee8ca9640 1 -- 172.21.15.93:0/2868036728 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc02cea0 con 0x7f6ee40cbea0 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6eebf0f640 1 -- 172.21.15.93:0/2868036728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee40cbea0 msgr2=0x7f6ee406eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.236+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/2868036728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee40cbea0 0x7f6ee406eba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc02be20 comp rx=0 tx=0).stop 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.237+0000 7f6eebf0f640 1 -- 172.21.15.93:0/2868036728 shutdown_connections 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.237+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/2868036728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee40cbea0 0x7f6ee406eba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.237+0000 7f6eebf0f640 1 -- 172.21.15.93:0/2868036728 >> 172.21.15.93:0/2868036728 conn(0x7f6ee4098d40 msgr2=0x7f6ee40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.237+0000 7f6eebf0f640 1 -- 172.21.15.93:0/2868036728 shutdown_connections 2023-11-04T01:36:09.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.237+0000 7f6eebf0f640 1 -- 172.21.15.93:0/2868036728 wait complete. 2023-11-04T01:36:09.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 Processor -- start 2023-11-04T01:36:09.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 -- start start 2023-11-04T01:36:09.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ee40cbea0 0x7f6ee415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ee415ab70 0x7f6ee415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4161c50 con 0x7f6ee406a830 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40c42c0 con 0x7f6ee40cbea0 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6eebf0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40c3660 con 0x7f6ee415ab70 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.238+0000 7f6ee9cab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33230/0 (socket says 172.21.15.93:33230) 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 -- 172.21.15.93:0/797952644 learned_addr learned my addr 172.21.15.93:0/797952644 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eea4ac640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ee415ab70 0x7f6ee415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee94aa640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ee40cbea0 0x7f6ee415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 -- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ee415ab70 msgr2=0x7f6ee415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ee415ab70 0x7f6ee415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 -- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ee40cbea0 msgr2=0x7f6ee415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ee40cbea0 0x7f6ee415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 -- 172.21.15.93:0/797952644 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009a70 con 0x7f6ee406a830 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6ee9cab640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00010e0 tx=0x7f6ee000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0007480 con 0x7f6ee406a830 2023-11-04T01:36:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00075e0 con 0x7f6ee406a830 2023-11-04T01:36:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee40c3920 con 0x7f6ee406a830 2023-11-04T01:36:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00059c0 con 0x7f6ee406a830 2023-11-04T01:36:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.239+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee40c3ee0 con 0x7f6ee406a830 2023-11-04T01:36:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.240+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee4074290 con 0x7f6ee406a830 2023-11-04T01:36:09.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.240+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ee0005b20 con 0x7f6ee406a830 2023-11-04T01:36:09.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.241+0000 7f6eda7fc640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 0x7f6ec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.241+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ee0088f50 con 0x7f6ee406a830 2023-11-04T01:36:09.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.241+0000 7f6ee94aa640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 0x7f6ec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.241+0000 7f6ee94aa640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 0x7f6ec806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40b5610 tx=0x7f6ed4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.245+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ee0053c80 con 0x7f6ee406a830 2023-11-04T01:36:09.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.447+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ee40cb710 con 0x7f6ee406a830 2023-11-04T01:36:09.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.447+0000 7f6eda7fc640 1 -- 172.21.15.93:0/797952644 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f6ee0017030 con 0x7f6ee406a830 2023-11-04T01:36:09.449 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:09.449 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:09.449 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:36:09.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 msgr2=0x7f6ec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 0x7f6ec806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40b5610 tx=0x7f6ed4008040 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 msgr2=0x7f6ee41538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00010e0 tx=0x7f6ee000c9b0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 shutdown_connections 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6ec806ae70 0x7f6ec806d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ee415ab70 0x7f6ee415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ee40cbea0 0x7f6ee415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 --2- 172.21.15.93:0/797952644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ee406a830 0x7f6ee41538d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 >> 172.21.15.93:0/797952644 conn(0x7f6ee4098d40 msgr2=0x7f6ee406a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 shutdown_connections 2023-11-04T01:36:09.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.449+0000 7f6eebf0f640 1 -- 172.21.15.93:0/797952644 wait complete. 2023-11-04T01:36:09.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:09.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.560+0000 7fa7ad5f5640 1 Processor -- start 2023-11-04T01:36:09.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.560+0000 7fa7ad5f5640 1 -- start start 2023-11-04T01:36:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7ad5f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7a8159c70 0x7fa7a80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7ad5f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7ad5f5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80b4110 con 0x7fa7a80b0910 2023-11-04T01:36:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7ad5f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80b49b0 con 0x7fa7a8159c70 2023-11-04T01:36:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7ad5f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b0da0 con 0x7fa7a806db20 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7a67fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7a6ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7a8159c70 0x7fa7a80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7a67fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:36330/0 (socket says 172.21.15.93:36330) 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7a67fc640 1 -- 172.21.15.93:0/1717833551 learned_addr learned my addr 172.21.15.93:0/1717833551 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.561+0000 7fa7a77fe640 1 --1- 172.21.15.93:0/1717833551 >> v1:172.21.15.125:6789/0 conn(0x7fa7a80b0910 0x7fa7a815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:49900/0 (socket says 172.21.15.93:49900) 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a6ffd640 1 -- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 msgr2=0x7fa7a80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a6ffd640 1 -- 172.21.15.93:0/1717833551 >> v1:172.21.15.125:6789/0 conn(0x7fa7a80b0910 legacy=0x7fa7a815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a6ffd640 1 -- 172.21.15.93:0/1717833551 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80b43f0 con 0x7fa7a8159c70 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a5ffb640 1 -- 172.21.15.93:0/1717833551 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944238189 0 0) 0x7fa7a80b4110 con 0x7fa7a80b0910 2023-11-04T01:36:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.562+0000 7fa7a67fc640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a8159c70 0x7fa7a80ce370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa798009d90 tx=0x7fa79802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368ad2cfce021b5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7a5ffb640 1 -- 172.21.15.93:0/1717833551 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79802cc50 con 0x7fa7a8159c70 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7a5ffb640 1 -- 172.21.15.93:0/1717833551 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79802cdb0 con 0x7fa7a8159c70 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7a5ffb640 1 -- 172.21.15.93:0/1717833551 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798034660 con 0x7fa7a8159c70 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a8159c70 msgr2=0x7fa7a80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a8159c70 0x7fa7a80ce370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa798009d90 tx=0x7fa79802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/1717833551 shutdown_connections 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a806db20 0x7fa7a80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/1717833551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a8159c70 0x7fa7a80ce370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/1717833551 >> 172.21.15.93:0/1717833551 conn(0x7fa7a80ce950 msgr2=0x7fa7a80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/1717833551 shutdown_connections 2023-11-04T01:36:09.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.563+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/1717833551 wait complete. 2023-11-04T01:36:09.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 Processor -- start 2023-11-04T01:36:09.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 -- start start 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 0x7fa7a8148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a8159c70 0x7fa7a814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a81594a0 con 0x7fa7a80b0910 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a814b140 con 0x7fa7a806db20 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7ad5f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8147b80 con 0x7fa7a8159c70 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7a67fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7a67fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33242/0 (socket says 172.21.15.93:33242) 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.565+0000 7fa7a67fc640 1 -- 172.21.15.93:0/2630108754 learned_addr learned my addr 172.21.15.93:0/2630108754 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a77fe640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a8159c70 0x7fa7a814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 0x7fa7a8148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 -- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a8159c70 msgr2=0x7fa7a814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a8159c70 0x7fa7a814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 -- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 msgr2=0x7fa7a8148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 0x7fa7a8148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 -- 172.21.15.93:0/2630108754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0094d0 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 0x7fa7a8148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7a67fc640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00ea00 tx=0x7fa79c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00ca60 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00cbc0 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798009a70 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c013470 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.566+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a8148140 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.567+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a8074290 con 0x7fa7a80b0910 2023-11-04T01:36:09.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.567+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa79c0135d0 con 0x7fa7a80b0910 2023-11-04T01:36:09.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.568+0000 7fa78f7fe640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 0x7fa79406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.568+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa79c089c00 con 0x7fa7a80b0910 2023-11-04T01:36:09.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.568+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 0x7fa79406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.568+0000 7fa7a6ffd640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 0x7fa79406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa798036000 tx=0x7fa798030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.572+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa79c0549a0 con 0x7fa7a80b0910 2023-11-04T01:36:09.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.739+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a806d3f0 con 0x7fa7a80b0910 2023-11-04T01:36:09.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.740+0000 7fa78f7fe640 1 -- 172.21.15.93:0/2630108754 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fa79c017090 con 0x7fa7a80b0910 2023-11-04T01:36:09.742 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:09.742 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 msgr2=0x7fa79406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 0x7fa79406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa798036000 tx=0x7fa798030000 comp rx=0 tx=0).stop 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 msgr2=0x7fa7a8158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00ea00 tx=0x7fa79c00eec0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 shutdown_connections 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa79406ae70 0x7fa79406d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a8159c70 0x7fa7a814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a80b0910 0x7fa7a8158f60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 --2- 172.21.15.93:0/2630108754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7a806db20 0x7fa7a8148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 >> 172.21.15.93:0/2630108754 conn(0x7fa7a80ce950 msgr2=0x7fa7a8070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 shutdown_connections 2023-11-04T01:36:09.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.742+0000 7fa7ad5f5640 1 -- 172.21.15.93:0/2630108754 wait complete. 2023-11-04T01:36:09.755 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:36:09.755 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:09.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.853+0000 7f2b73464640 1 Processor -- start 2023-11-04T01:36:09.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.853+0000 7f2b73464640 1 -- start start 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b73464640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b6c15aa30 0x7f2b6c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b73464640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b73464640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c15bc30 con 0x7f2b6c0ca280 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b73464640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c15bf10 con 0x7f2b6c06ce00 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b73464640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c0c9540 con 0x7f2b6c15aa30 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b71a01640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b71a01640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33246/0 (socket says 172.21.15.93:33246) 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b71a01640 1 -- 172.21.15.93:0/329005759 learned_addr learned my addr 172.21.15.93:0/329005759 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.854+0000 7f2b71200640 1 --2- 172.21.15.93:0/329005759 >> v2:172.21.15.125:3300/0 conn(0x7f2b6c15aa30 0x7f2b6c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b71a01640 1 -- 172.21.15.93:0/329005759 >> v2:172.21.15.125:3300/0 conn(0x7f2b6c15aa30 msgr2=0x7f2b6c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b71a01640 1 --2- 172.21.15.93:0/329005759 >> v2:172.21.15.125:3300/0 conn(0x7f2b6c15aa30 0x7f2b6c0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b71a01640 1 -- 172.21.15.93:0/329005759 >> v1:172.21.15.125:6789/0 conn(0x7f2b6c0ca280 legacy=0x7f2b6c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b71a01640 1 -- 172.21.15.93:0/329005759 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c0c9820 con 0x7f2b6c06ce00 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b71a01640 1 --2- 172.21.15.93:0/329005759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0cc780 tx=0x7f2b6402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d849f8c45fc1894 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b63fff640 1 -- 172.21.15.93:0/329005759 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6402cb20 con 0x7f2b6c06ce00 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b63fff640 1 -- 172.21.15.93:0/329005759 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6402cc80 con 0x7f2b6c06ce00 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.855+0000 7f2b63fff640 1 -- 172.21.15.93:0/329005759 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640343f0 con 0x7f2b6c06ce00 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 -- 172.21.15.93:0/329005759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c06ce00 msgr2=0x7f2b6c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 --2- 172.21.15.93:0/329005759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0cc780 tx=0x7f2b6402bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:09.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 -- 172.21.15.93:0/329005759 shutdown_connections 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 --2- 172.21.15.93:0/329005759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c06ce00 0x7f2b6c0b07f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 --2- 172.21.15.93:0/329005759 >> v2:172.21.15.125:3300/0 conn(0x7f2b6c15aa30 0x7f2b6c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 -- 172.21.15.93:0/329005759 >> 172.21.15.93:0/329005759 conn(0x7f2b6c0cb7f0 msgr2=0x7f2b6c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 -- 172.21.15.93:0/329005759 shutdown_connections 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.856+0000 7f2b73464640 1 -- 172.21.15.93:0/329005759 wait complete. 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.857+0000 7f2b73464640 1 Processor -- start 2023-11-04T01:36:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.857+0000 7f2b73464640 1 -- start start 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 0x7f2b6c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 0x7f2b6c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c1548a0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c156410 con 0x7f2b6c1f0660 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b73464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c158a30 con 0x7f2b6c15aa30 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33258/0 (socket says 172.21.15.93:33258) 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 -- 172.21.15.93:0/1398629783 learned_addr learned my addr 172.21.15.93:0/1398629783 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:09.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b709ff640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 0x7f2b6c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71200640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 0x7f2b6c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 -- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 msgr2=0x7f2b6c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 0x7f2b6c154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 -- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 msgr2=0x7f2b6c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 0x7f2b6c1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71a01640 1 -- 172.21.15.93:0/1398629783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64009b30 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b71200640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 0x7f2b6c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.858+0000 7f2b709ff640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 0x7f2b6c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b71a01640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b64036040 tx=0x7f2b64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64009510 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6402c920 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6403e690 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c158d10 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.859+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c1592d0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.860+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c1594c0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.860+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b6403e7f0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.861+0000 7f2b61ffb640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 0x7f2b5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.861+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b640ac3c0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.861+0000 7f2b71200640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 0x7f2b5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.861+0000 7f2b71200640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 0x7f2b5006d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009af0 tx=0x7f2b68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:09.865+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b640770e0 con 0x7f2b6c1f0ae0 2023-11-04T01:36:10.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.030+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b6c0b0d30 con 0x7f2b5006aea0 2023-11-04T01:36:10.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.039+0000 7f2b61ffb640 1 -- 172.21.15.93:0/1398629783 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7f2b680119b0 con 0x7f2b5006aea0 2023-11-04T01:36:10.044 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:10.046 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:36:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 msgr2=0x7f2b5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 0x7f2b5006d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009af0 tx=0x7f2b68008040 comp rx=0 tx=0).stop 2023-11-04T01:36:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 msgr2=0x7f2b6c0c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b64036040 tx=0x7f2b64004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 shutdown_connections 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2b5006aea0 0x7f2b5006d360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b6c1f0ae0 0x7f2b6c0c6c30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b6c1f0660 0x7f2b6c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 --2- 172.21.15.93:0/1398629783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2b6c15aa30 0x7f2b6c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 >> 172.21.15.93:0/1398629783 conn(0x7f2b6c0cb7f0 msgr2=0x7f2b6c15ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 shutdown_connections 2023-11-04T01:36:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.043+0000 7f2b73464640 1 -- 172.21.15.93:0/1398629783 wait complete. 2023-11-04T01:36:10.055 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:09.329012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3276800,"data_stored":1986032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002375"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082757+0000","last_change":"2023-11-04T01:35:51.059593+0000","last_active":"2023-11-04T01:35:56.082757+0000","last_peered":"2023-11-04T01:35:56.082757+0000","last_clean":"2023-11-04T01:35:56.082757+0000","last_became_active":"2023-11-04T01:35:51.059276+0000","last_became_peered":"2023-11-04T01:35:51.059276+0000","last_unstale":"2023-11-04T01:35:56.082757+0000","last_undegraded":"2023-11-04T01:35:56.082757+0000","last_fullsized":"2023-11-04T01:35:56.082757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085660+0000","last_change":"2023-11-04T01:35:52.029967+0000","last_active":"2023-11-04T01:35:56.085660+0000","last_peered":"2023-11-04T01:35:56.085660+0000","last_clean":"2023-11-04T01:35:56.085660+0000","last_became_active":"2023-11-04T01:35:52.029678+0000","last_became_peered":"2023-11-04T01:35:52.029678+0000","last_unstale":"2023-11-04T01:35:56.085660+0000","last_undegraded":"2023-11-04T01:35:56.085660+0000","last_fullsized":"2023-11-04T01:35:56.085660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018192+0000","last_change":"2023-11-04T01:35:56.127497+0000","last_active":"2023-11-04T01:35:57.018192+0000","last_peered":"2023-11-04T01:35:57.018192+0000","last_clean":"2023-11-04T01:35:57.018192+0000","last_became_active":"2023-11-04T01:35:56.127104+0000","last_became_peered":"2023-11-04T01:35:56.127104+0000","last_unstale":"2023-11-04T01:35:57.018192+0000","last_undegraded":"2023-11-04T01:35:57.018192+0000","last_fullsized":"2023-11-04T01:35:57.018192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:04.310871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085827+0000","last_change":"2023-11-04T01:35:51.062804+0000","last_active":"2023-11-04T01:35:56.085827+0000","last_peered":"2023-11-04T01:35:56.085827+0000","last_clean":"2023-11-04T01:35:56.085827+0000","last_became_active":"2023-11-04T01:35:51.062550+0000","last_became_peered":"2023-11-04T01:35:51.062550+0000","last_unstale":"2023-11-04T01:35:56.085827+0000","last_undegraded":"2023-11-04T01:35:56.085827+0000","last_fullsized":"2023-11-04T01:35:56.085827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082497+0000","last_change":"2023-11-04T01:35:52.028642+0000","last_active":"2023-11-04T01:35:56.082497+0000","last_peered":"2023-11-04T01:35:56.082497+0000","last_clean":"2023-11-04T01:35:56.082497+0000","last_became_active":"2023-11-04T01:35:52.028335+0000","last_became_peered":"2023-11-04T01:35:52.028335+0000","last_unstale":"2023-11-04T01:35:56.082497+0000","last_undegraded":"2023-11-04T01:35:56.082497+0000","last_fullsized":"2023-11-04T01:35:56.082497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018823+0000","last_change":"2023-11-04T01:35:56.097973+0000","last_active":"2023-11-04T01:35:57.018823+0000","last_peered":"2023-11-04T01:35:57.018823+0000","last_clean":"2023-11-04T01:35:57.018823+0000","last_became_active":"2023-11-04T01:35:56.097592+0000","last_became_peered":"2023-11-04T01:35:56.097592+0000","last_unstale":"2023-11-04T01:35:57.018823+0000","last_undegraded":"2023-11-04T01:35:57.018823+0000","last_fullsized":"2023-11-04T01:35:57.018823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:59.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124753+0000","last_change":"2023-11-04T01:35:51.064359+0000","last_active":"2023-11-04T01:35:56.124753+0000","last_peered":"2023-11-04T01:35:56.124753+0000","last_clean":"2023-11-04T01:35:56.124753+0000","last_became_active":"2023-11-04T01:35:51.064086+0000","last_became_peered":"2023-11-04T01:35:51.064086+0000","last_unstale":"2023-11-04T01:35:56.124753+0000","last_undegraded":"2023-11-04T01:35:56.124753+0000","last_fullsized":"2023-11-04T01:35:56.124753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:04.967632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083843+0000","last_change":"2023-11-04T01:35:52.027845+0000","last_active":"2023-11-04T01:35:56.083843+0000","last_peered":"2023-11-04T01:35:56.083843+0000","last_clean":"2023-11-04T01:35:56.083843+0000","last_became_active":"2023-11-04T01:35:52.024155+0000","last_became_peered":"2023-11-04T01:35:52.024155+0000","last_unstale":"2023-11-04T01:35:56.083843+0000","last_undegraded":"2023-11-04T01:35:56.083843+0000","last_fullsized":"2023-11-04T01:35:56.083843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019534+0000","last_change":"2023-11-04T01:35:56.100849+0000","last_active":"2023-11-04T01:35:57.019534+0000","last_peered":"2023-11-04T01:35:57.019534+0000","last_clean":"2023-11-04T01:35:57.019534+0000","last_became_active":"2023-11-04T01:35:56.099083+0000","last_became_peered":"2023-11-04T01:35:56.099083+0000","last_unstale":"2023-11-04T01:35:57.019534+0000","last_undegraded":"2023-11-04T01:35:57.019534+0000","last_fullsized":"2023-11-04T01:35:57.019534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123310+0000","last_change":"2023-11-04T01:35:51.062659+0000","last_active":"2023-11-04T01:35:56.123310+0000","last_peered":"2023-11-04T01:35:56.123310+0000","last_clean":"2023-11-04T01:35:56.123310+0000","last_became_active":"2023-11-04T01:35:51.062258+0000","last_became_peered":"2023-11-04T01:35:51.062258+0000","last_unstale":"2023-11-04T01:35:56.123310+0000","last_undegraded":"2023-11-04T01:35:56.123310+0000","last_fullsized":"2023-11-04T01:35:56.123310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083932+0000","last_change":"2023-11-04T01:35:52.028671+0000","last_active":"2023-11-04T01:35:56.083932+0000","last_peered":"2023-11-04T01:35:56.083932+0000","last_clean":"2023-11-04T01:35:56.083932+0000","last_became_active":"2023-11-04T01:35:52.028245+0000","last_became_peered":"2023-11-04T01:35:52.028245+0000","last_unstale":"2023-11-04T01:35:56.083932+0000","last_undegraded":"2023-11-04T01:35:56.083932+0000","last_fullsized":"2023-11-04T01:35:56.083932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018071+0000","last_change":"2023-11-04T01:35:56.100779+0000","last_active":"2023-11-04T01:35:57.018071+0000","last_peered":"2023-11-04T01:35:57.018071+0000","last_clean":"2023-11-04T01:35:57.018071+0000","last_became_active":"2023-11-04T01:35:56.100333+0000","last_became_peered":"2023-11-04T01:35:56.100333+0000","last_unstale":"2023-11-04T01:35:57.018071+0000","last_undegraded":"2023-11-04T01:35:57.018071+0000","last_fullsized":"2023-11-04T01:35:57.018071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:48.170680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090642+0000","last_change":"2023-11-04T01:35:52.025166+0000","last_active":"2023-11-04T01:35:56.090642+0000","last_peered":"2023-11-04T01:35:56.090642+0000","last_clean":"2023-11-04T01:35:56.090642+0000","last_became_active":"2023-11-04T01:35:52.024875+0000","last_became_peered":"2023-11-04T01:35:52.024875+0000","last_unstale":"2023-11-04T01:35:56.090642+0000","last_undegraded":"2023-11-04T01:35:56.090642+0000","last_fullsized":"2023-11-04T01:35:56.090642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123232+0000","last_change":"2023-11-04T01:35:51.060056+0000","last_active":"2023-11-04T01:35:56.123232+0000","last_peered":"2023-11-04T01:35:56.123232+0000","last_clean":"2023-11-04T01:35:56.123232+0000","last_became_active":"2023-11-04T01:35:51.059746+0000","last_became_peered":"2023-11-04T01:35:51.059746+0000","last_unstale":"2023-11-04T01:35:56.123232+0000","last_undegraded":"2023-11-04T01:35:56.123232+0000","last_fullsized":"2023-11-04T01:35:56.123232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:07.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018852+0000","last_change":"2023-11-04T01:35:56.099872+0000","last_active":"2023-11-04T01:35:57.018852+0000","last_peered":"2023-11-04T01:35:57.018852+0000","last_clean":"2023-11-04T01:35:57.018852+0000","last_became_active":"2023-11-04T01:35:56.098782+0000","last_became_peered":"2023-11-04T01:35:56.098782+0000","last_unstale":"2023-11-04T01:35:57.018852+0000","last_undegraded":"2023-11-04T01:35:57.018852+0000","last_fullsized":"2023-11-04T01:35:57.018852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:26.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085943+0000","last_change":"2023-11-04T01:35:52.030864+0000","last_active":"2023-11-04T01:35:56.085943+0000","last_peered":"2023-11-04T01:35:56.085943+0000","last_clean":"2023-11-04T01:35:56.085943+0000","last_became_active":"2023-11-04T01:35:52.030586+0000","last_became_peered":"2023-11-04T01:35:52.030586+0000","last_unstale":"2023-11-04T01:35:56.085943+0000","last_undegraded":"2023-11-04T01:35:56.085943+0000","last_fullsized":"2023-11-04T01:35:56.085943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.077121+0000","last_change":"2023-11-04T01:35:51.063222+0000","last_active":"2023-11-04T01:35:56.077121+0000","last_peered":"2023-11-04T01:35:56.077121+0000","last_clean":"2023-11-04T01:35:56.077121+0000","last_became_active":"2023-11-04T01:35:51.062838+0000","last_became_peered":"2023-11-04T01:35:51.062838+0000","last_unstale":"2023-11-04T01:35:56.077121+0000","last_undegraded":"2023-11-04T01:35:56.077121+0000","last_fullsized":"2023-11-04T01:35:56.077121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019259+0000","last_change":"2023-11-04T01:35:56.100298+0000","last_active":"2023-11-04T01:35:57.019259+0000","last_peered":"2023-11-04T01:35:57.019259+0000","last_clean":"2023-11-04T01:35:57.019259+0000","last_became_active":"2023-11-04T01:35:56.098558+0000","last_became_peered":"2023-11-04T01:35:56.098558+0000","last_unstale":"2023-11-04T01:35:57.019259+0000","last_undegraded":"2023-11-04T01:35:57.019259+0000","last_fullsized":"2023-11-04T01:35:57.019259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086341+0000","last_change":"2023-11-04T01:35:52.021071+0000","last_active":"2023-11-04T01:35:56.086341+0000","last_peered":"2023-11-04T01:35:56.086341+0000","last_clean":"2023-11-04T01:35:56.086341+0000","last_became_active":"2023-11-04T01:35:52.020796+0000","last_became_peered":"2023-11-04T01:35:52.020796+0000","last_unstale":"2023-11-04T01:35:56.086341+0000","last_undegraded":"2023-11-04T01:35:56.086341+0000","last_fullsized":"2023-11-04T01:35:56.086341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076204+0000","last_change":"2023-11-04T01:35:51.060835+0000","last_active":"2023-11-04T01:35:56.076204+0000","last_peered":"2023-11-04T01:35:56.076204+0000","last_clean":"2023-11-04T01:35:56.076204+0000","last_became_active":"2023-11-04T01:35:51.060542+0000","last_became_peered":"2023-11-04T01:35:51.060542+0000","last_unstale":"2023-11-04T01:35:56.076204+0000","last_undegraded":"2023-11-04T01:35:56.076204+0000","last_fullsized":"2023-11-04T01:35:56.076204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018863+0000","last_change":"2023-11-04T01:35:56.127539+0000","last_active":"2023-11-04T01:35:57.018863+0000","last_peered":"2023-11-04T01:35:57.018863+0000","last_clean":"2023-11-04T01:35:57.018863+0000","last_became_active":"2023-11-04T01:35:56.127142+0000","last_became_peered":"2023-11-04T01:35:56.127142+0000","last_unstale":"2023-11-04T01:35:57.018863+0000","last_undegraded":"2023-11-04T01:35:57.018863+0000","last_fullsized":"2023-11-04T01:35:57.018863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090298+0000","last_change":"2023-11-04T01:35:52.023442+0000","last_active":"2023-11-04T01:35:56.090298+0000","last_peered":"2023-11-04T01:35:56.090298+0000","last_clean":"2023-11-04T01:35:56.090298+0000","last_became_active":"2023-11-04T01:35:52.021531+0000","last_became_peered":"2023-11-04T01:35:52.021531+0000","last_unstale":"2023-11-04T01:35:56.090298+0000","last_undegraded":"2023-11-04T01:35:56.090298+0000","last_fullsized":"2023-11-04T01:35:56.090298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:00.840333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122631+0000","last_change":"2023-11-04T01:35:51.063175+0000","last_active":"2023-11-04T01:35:56.122631+0000","last_peered":"2023-11-04T01:35:56.122631+0000","last_clean":"2023-11-04T01:35:56.122631+0000","last_became_active":"2023-11-04T01:35:51.062652+0000","last_became_peered":"2023-11-04T01:35:51.062652+0000","last_unstale":"2023-11-04T01:35:56.122631+0000","last_undegraded":"2023-11-04T01:35:56.122631+0000","last_fullsized":"2023-11-04T01:35:56.122631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018125+0000","last_change":"2023-11-04T01:35:56.099302+0000","last_active":"2023-11-04T01:35:57.018125+0000","last_peered":"2023-11-04T01:35:57.018125+0000","last_clean":"2023-11-04T01:35:57.018125+0000","last_became_active":"2023-11-04T01:35:56.098724+0000","last_became_peered":"2023-11-04T01:35:56.098724+0000","last_unstale":"2023-11-04T01:35:57.018125+0000","last_undegraded":"2023-11-04T01:35:57.018125+0000","last_fullsized":"2023-11-04T01:35:57.018125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:35.534588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082788+0000","last_change":"2023-11-04T01:35:52.017381+0000","last_active":"2023-11-04T01:35:56.082788+0000","last_peered":"2023-11-04T01:35:56.082788+0000","last_clean":"2023-11-04T01:35:56.082788+0000","last_became_active":"2023-11-04T01:35:52.017133+0000","last_became_peered":"2023-11-04T01:35:52.017133+0000","last_unstale":"2023-11-04T01:35:56.082788+0000","last_undegraded":"2023-11-04T01:35:56.082788+0000","last_fullsized":"2023-11-04T01:35:56.082788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092559+0000","last_change":"2023-11-04T01:35:51.059644+0000","last_active":"2023-11-04T01:35:56.092559+0000","last_peered":"2023-11-04T01:35:56.092559+0000","last_clean":"2023-11-04T01:35:56.092559+0000","last_became_active":"2023-11-04T01:35:51.059424+0000","last_became_peered":"2023-11-04T01:35:51.059424+0000","last_unstale":"2023-11-04T01:35:56.092559+0000","last_undegraded":"2023-11-04T01:35:56.092559+0000","last_fullsized":"2023-11-04T01:35:56.092559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019002+0000","last_change":"2023-11-04T01:35:56.124305+0000","last_active":"2023-11-04T01:35:57.019002+0000","last_peered":"2023-11-04T01:35:57.019002+0000","last_clean":"2023-11-04T01:35:57.019002+0000","last_became_active":"2023-11-04T01:35:56.123918+0000","last_became_peered":"2023-11-04T01:35:56.123918+0000","last_unstale":"2023-11-04T01:35:57.019002+0000","last_undegraded":"2023-11-04T01:35:57.019002+0000","last_fullsized":"2023-11-04T01:35:57.019002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086137+0000","last_change":"2023-11-04T01:35:52.030623+0000","last_active":"2023-11-04T01:35:56.086137+0000","last_peered":"2023-11-04T01:35:56.086137+0000","last_clean":"2023-11-04T01:35:56.086137+0000","last_became_active":"2023-11-04T01:35:52.030382+0000","last_became_peered":"2023-11-04T01:35:52.030382+0000","last_unstale":"2023-11-04T01:35:56.086137+0000","last_undegraded":"2023-11-04T01:35:56.086137+0000","last_fullsized":"2023-11-04T01:35:56.086137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076551+0000","last_change":"2023-11-04T01:35:51.062101+0000","last_active":"2023-11-04T01:35:56.076551+0000","last_peered":"2023-11-04T01:35:56.076551+0000","last_clean":"2023-11-04T01:35:56.076551+0000","last_became_active":"2023-11-04T01:35:51.061786+0000","last_became_peered":"2023-11-04T01:35:51.061786+0000","last_unstale":"2023-11-04T01:35:56.076551+0000","last_undegraded":"2023-11-04T01:35:56.076551+0000","last_fullsized":"2023-11-04T01:35:56.076551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017814+0000","last_change":"2023-11-04T01:35:56.128280+0000","last_active":"2023-11-04T01:35:57.017814+0000","last_peered":"2023-11-04T01:35:57.017814+0000","last_clean":"2023-11-04T01:35:57.017814+0000","last_became_active":"2023-11-04T01:35:56.127952+0000","last_became_peered":"2023-11-04T01:35:56.127952+0000","last_unstale":"2023-11-04T01:35:57.017814+0000","last_undegraded":"2023-11-04T01:35:57.017814+0000","last_fullsized":"2023-11-04T01:35:57.017814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076313+0000","last_change":"2023-11-04T01:35:52.019477+0000","last_active":"2023-11-04T01:35:56.076313+0000","last_peered":"2023-11-04T01:35:56.076313+0000","last_clean":"2023-11-04T01:35:56.076313+0000","last_became_active":"2023-11-04T01:35:52.019211+0000","last_became_peered":"2023-11-04T01:35:52.019211+0000","last_unstale":"2023-11-04T01:35:56.076313+0000","last_undegraded":"2023-11-04T01:35:56.076313+0000","last_fullsized":"2023-11-04T01:35:56.076313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125013+0000","last_change":"2023-11-04T01:35:51.061973+0000","last_active":"2023-11-04T01:35:56.125013+0000","last_peered":"2023-11-04T01:35:56.125013+0000","last_clean":"2023-11-04T01:35:56.125013+0000","last_became_active":"2023-11-04T01:35:51.061720+0000","last_became_peered":"2023-11-04T01:35:51.061720+0000","last_unstale":"2023-11-04T01:35:56.125013+0000","last_undegraded":"2023-11-04T01:35:56.125013+0000","last_fullsized":"2023-11-04T01:35:56.125013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009703+0000","last_change":"2023-11-04T01:35:56.124910+0000","last_active":"2023-11-04T01:35:57.009703+0000","last_peered":"2023-11-04T01:35:57.009703+0000","last_clean":"2023-11-04T01:35:57.009703+0000","last_became_active":"2023-11-04T01:35:56.124304+0000","last_became_peered":"2023-11-04T01:35:56.124304+0000","last_unstale":"2023-11-04T01:35:57.009703+0000","last_undegraded":"2023-11-04T01:35:57.009703+0000","last_fullsized":"2023-11-04T01:35:57.009703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084153+0000","last_change":"2023-11-04T01:35:52.027735+0000","last_active":"2023-11-04T01:35:56.084153+0000","last_peered":"2023-11-04T01:35:56.084153+0000","last_clean":"2023-11-04T01:35:56.084153+0000","last_became_active":"2023-11-04T01:35:52.027488+0000","last_became_peered":"2023-11-04T01:35:52.027488+0000","last_unstale":"2023-11-04T01:35:56.084153+0000","last_undegraded":"2023-11-04T01:35:56.084153+0000","last_fullsized":"2023-11-04T01:35:56.084153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076787+0000","last_change":"2023-11-04T01:35:51.060397+0000","last_active":"2023-11-04T01:35:56.076787+0000","last_peered":"2023-11-04T01:35:56.076787+0000","last_clean":"2023-11-04T01:35:56.076787+0000","last_became_active":"2023-11-04T01:35:51.060049+0000","last_became_peered":"2023-11-04T01:35:51.060049+0000","last_unstale":"2023-11-04T01:35:56.076787+0000","last_undegraded":"2023-11-04T01:35:56.076787+0000","last_fullsized":"2023-11-04T01:35:56.076787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018210+0000","last_change":"2023-11-04T01:35:56.097613+0000","last_active":"2023-11-04T01:35:57.018210+0000","last_peered":"2023-11-04T01:35:57.018210+0000","last_clean":"2023-11-04T01:35:57.018210+0000","last_became_active":"2023-11-04T01:35:56.095376+0000","last_became_peered":"2023-11-04T01:35:56.095376+0000","last_unstale":"2023-11-04T01:35:57.018210+0000","last_undegraded":"2023-11-04T01:35:57.018210+0000","last_fullsized":"2023-11-04T01:35:57.018210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091651+0000","last_change":"2023-11-04T01:35:52.022798+0000","last_active":"2023-11-04T01:35:56.091651+0000","last_peered":"2023-11-04T01:35:56.091651+0000","last_clean":"2023-11-04T01:35:56.091651+0000","last_became_active":"2023-11-04T01:35:52.021870+0000","last_became_peered":"2023-11-04T01:35:52.021870+0000","last_unstale":"2023-11-04T01:35:56.091651+0000","last_undegraded":"2023-11-04T01:35:56.091651+0000","last_fullsized":"2023-11-04T01:35:56.091651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083334+0000","last_change":"2023-11-04T01:35:51.058423+0000","last_active":"2023-11-04T01:35:56.083334+0000","last_peered":"2023-11-04T01:35:56.083334+0000","last_clean":"2023-11-04T01:35:56.083334+0000","last_became_active":"2023-11-04T01:35:51.057183+0000","last_became_peered":"2023-11-04T01:35:51.057183+0000","last_unstale":"2023-11-04T01:35:56.083334+0000","last_undegraded":"2023-11-04T01:35:56.083334+0000","last_fullsized":"2023-11-04T01:35:56.083334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018340+0000","last_change":"2023-11-04T01:35:56.093770+0000","last_active":"2023-11-04T01:35:57.018340+0000","last_peered":"2023-11-04T01:35:57.018340+0000","last_clean":"2023-11-04T01:35:57.018340+0000","last_became_active":"2023-11-04T01:35:56.092689+0000","last_became_peered":"2023-11-04T01:35:56.092689+0000","last_unstale":"2023-11-04T01:35:57.018340+0000","last_undegraded":"2023-11-04T01:35:57.018340+0000","last_fullsized":"2023-11-04T01:35:57.018340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076140+0000","last_change":"2023-11-04T01:35:52.019825+0000","last_active":"2023-11-04T01:35:56.076140+0000","last_peered":"2023-11-04T01:35:56.076140+0000","last_clean":"2023-11-04T01:35:56.076140+0000","last_became_active":"2023-11-04T01:35:52.019580+0000","last_became_peered":"2023-11-04T01:35:52.019580+0000","last_unstale":"2023-11-04T01:35:56.076140+0000","last_undegraded":"2023-11-04T01:35:56.076140+0000","last_fullsized":"2023-11-04T01:35:56.076140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090217+0000","last_change":"2023-11-04T01:35:51.058035+0000","last_active":"2023-11-04T01:35:56.090217+0000","last_peered":"2023-11-04T01:35:56.090217+0000","last_clean":"2023-11-04T01:35:56.090217+0000","last_became_active":"2023-11-04T01:35:51.057768+0000","last_became_peered":"2023-11-04T01:35:51.057768+0000","last_unstale":"2023-11-04T01:35:56.090217+0000","last_undegraded":"2023-11-04T01:35:56.090217+0000","last_fullsized":"2023-11-04T01:35:56.090217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018891+0000","last_change":"2023-11-04T01:35:56.094677+0000","last_active":"2023-11-04T01:35:57.018891+0000","last_peered":"2023-11-04T01:35:57.018891+0000","last_clean":"2023-11-04T01:35:57.018891+0000","last_became_active":"2023-11-04T01:35:56.094348+0000","last_became_peered":"2023-11-04T01:35:56.094348+0000","last_unstale":"2023-11-04T01:35:57.018891+0000","last_undegraded":"2023-11-04T01:35:57.018891+0000","last_fullsized":"2023-11-04T01:35:57.018891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082079+0000","last_change":"2023-11-04T01:35:52.020101+0000","last_active":"2023-11-04T01:35:56.082079+0000","last_peered":"2023-11-04T01:35:56.082079+0000","last_clean":"2023-11-04T01:35:56.082079+0000","last_became_active":"2023-11-04T01:35:52.019047+0000","last_became_peered":"2023-11-04T01:35:52.019047+0000","last_unstale":"2023-11-04T01:35:56.082079+0000","last_undegraded":"2023-11-04T01:35:56.082079+0000","last_fullsized":"2023-11-04T01:35:56.082079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:34.129560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122640+0000","last_change":"2023-11-04T01:35:51.063768+0000","last_active":"2023-11-04T01:35:56.122640+0000","last_peered":"2023-11-04T01:35:56.122640+0000","last_clean":"2023-11-04T01:35:56.122640+0000","last_became_active":"2023-11-04T01:35:51.063462+0000","last_became_peered":"2023-11-04T01:35:51.063462+0000","last_unstale":"2023-11-04T01:35:56.122640+0000","last_undegraded":"2023-11-04T01:35:56.122640+0000","last_fullsized":"2023-11-04T01:35:56.122640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010123+0000","last_change":"2023-11-04T01:35:56.124045+0000","last_active":"2023-11-04T01:35:57.010123+0000","last_peered":"2023-11-04T01:35:57.010123+0000","last_clean":"2023-11-04T01:35:57.010123+0000","last_became_active":"2023-11-04T01:35:56.123678+0000","last_became_peered":"2023-11-04T01:35:56.123678+0000","last_unstale":"2023-11-04T01:35:57.010123+0000","last_undegraded":"2023-11-04T01:35:57.010123+0000","last_fullsized":"2023-11-04T01:35:57.010123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:19.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085654+0000","last_change":"2023-11-04T01:35:52.029814+0000","last_active":"2023-11-04T01:35:56.085654+0000","last_peered":"2023-11-04T01:35:56.085654+0000","last_clean":"2023-11-04T01:35:56.085654+0000","last_became_active":"2023-11-04T01:35:52.029549+0000","last_became_peered":"2023-11-04T01:35:52.029549+0000","last_unstale":"2023-11-04T01:35:56.085654+0000","last_undegraded":"2023-11-04T01:35:56.085654+0000","last_fullsized":"2023-11-04T01:35:56.085654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083481+0000","last_change":"2023-11-04T01:35:51.062041+0000","last_active":"2023-11-04T01:35:56.083481+0000","last_peered":"2023-11-04T01:35:56.083481+0000","last_clean":"2023-11-04T01:35:56.083481+0000","last_became_active":"2023-11-04T01:35:51.061551+0000","last_became_peered":"2023-11-04T01:35:51.061551+0000","last_unstale":"2023-11-04T01:35:56.083481+0000","last_undegraded":"2023-11-04T01:35:56.083481+0000","last_fullsized":"2023-11-04T01:35:56.083481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122962+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:35:56.122962+0000","last_peered":"2023-11-04T01:35:56.122962+0000","last_clean":"2023-11-04T01:35:56.122962+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:35:56.122962+0000","last_undegraded":"2023-11-04T01:35:56.122962+0000","last_fullsized":"2023-11-04T01:35:56.122962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010896+0000","last_change":"2023-11-04T01:35:56.126128+0000","last_active":"2023-11-04T01:35:57.010896+0000","last_peered":"2023-11-04T01:35:57.010896+0000","last_clean":"2023-11-04T01:35:57.010896+0000","last_became_active":"2023-11-04T01:35:56.125726+0000","last_became_peered":"2023-11-04T01:35:56.125726+0000","last_unstale":"2023-11-04T01:35:57.010896+0000","last_undegraded":"2023-11-04T01:35:57.010896+0000","last_fullsized":"2023-11-04T01:35:57.010896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123390+0000","last_change":"2023-11-04T01:35:52.030372+0000","last_active":"2023-11-04T01:35:56.123390+0000","last_peered":"2023-11-04T01:35:56.123390+0000","last_clean":"2023-11-04T01:35:56.123390+0000","last_became_active":"2023-11-04T01:35:52.029960+0000","last_became_peered":"2023-11-04T01:35:52.029960+0000","last_unstale":"2023-11-04T01:35:56.123390+0000","last_undegraded":"2023-11-04T01:35:56.123390+0000","last_fullsized":"2023-11-04T01:35:56.123390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090234+0000","last_change":"2023-11-04T01:35:51.059763+0000","last_active":"2023-11-04T01:35:56.090234+0000","last_peered":"2023-11-04T01:35:56.090234+0000","last_clean":"2023-11-04T01:35:56.090234+0000","last_became_active":"2023-11-04T01:35:51.059484+0000","last_became_peered":"2023-11-04T01:35:51.059484+0000","last_unstale":"2023-11-04T01:35:56.090234+0000","last_undegraded":"2023-11-04T01:35:56.090234+0000","last_fullsized":"2023-11-04T01:35:56.090234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:04.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010432+0000","last_change":"2023-11-04T01:35:56.123907+0000","last_active":"2023-11-04T01:35:57.010432+0000","last_peered":"2023-11-04T01:35:57.010432+0000","last_clean":"2023-11-04T01:35:57.010432+0000","last_became_active":"2023-11-04T01:35:56.123459+0000","last_became_peered":"2023-11-04T01:35:56.123459+0000","last_unstale":"2023-11-04T01:35:57.010432+0000","last_undegraded":"2023-11-04T01:35:57.010432+0000","last_fullsized":"2023-11-04T01:35:57.010432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083693+0000","last_change":"2023-11-04T01:35:52.024998+0000","last_active":"2023-11-04T01:35:56.083693+0000","last_peered":"2023-11-04T01:35:56.083693+0000","last_clean":"2023-11-04T01:35:56.083693+0000","last_became_active":"2023-11-04T01:35:52.024327+0000","last_became_peered":"2023-11-04T01:35:52.024327+0000","last_unstale":"2023-11-04T01:35:56.083693+0000","last_undegraded":"2023-11-04T01:35:56.083693+0000","last_fullsized":"2023-11-04T01:35:56.083693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076586+0000","last_change":"2023-11-04T01:35:51.059209+0000","last_active":"2023-11-04T01:35:56.076586+0000","last_peered":"2023-11-04T01:35:56.076586+0000","last_clean":"2023-11-04T01:35:56.076586+0000","last_became_active":"2023-11-04T01:35:51.058773+0000","last_became_peered":"2023-11-04T01:35:51.058773+0000","last_unstale":"2023-11-04T01:35:56.076586+0000","last_undegraded":"2023-11-04T01:35:56.076586+0000","last_fullsized":"2023-11-04T01:35:56.076586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009806+0000","last_change":"2023-11-04T01:35:56.094757+0000","last_active":"2023-11-04T01:35:57.009806+0000","last_peered":"2023-11-04T01:35:57.009806+0000","last_clean":"2023-11-04T01:35:57.009806+0000","last_became_active":"2023-11-04T01:35:56.094419+0000","last_became_peered":"2023-11-04T01:35:56.094419+0000","last_unstale":"2023-11-04T01:35:57.009806+0000","last_undegraded":"2023-11-04T01:35:57.009806+0000","last_fullsized":"2023-11-04T01:35:57.009806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125099+0000","last_change":"2023-11-04T01:35:52.032768+0000","last_active":"2023-11-04T01:35:56.125099+0000","last_peered":"2023-11-04T01:35:56.125099+0000","last_clean":"2023-11-04T01:35:56.125099+0000","last_became_active":"2023-11-04T01:35:52.031366+0000","last_became_peered":"2023-11-04T01:35:52.031366+0000","last_unstale":"2023-11-04T01:35:56.125099+0000","last_undegraded":"2023-11-04T01:35:56.125099+0000","last_fullsized":"2023-11-04T01:35:56.125099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090446+0000","last_change":"2023-11-04T01:35:51.058795+0000","last_active":"2023-11-04T01:35:56.090446+0000","last_peered":"2023-11-04T01:35:56.090446+0000","last_clean":"2023-11-04T01:35:56.090446+0000","last_became_active":"2023-11-04T01:35:51.058543+0000","last_became_peered":"2023-11-04T01:35:51.058543+0000","last_unstale":"2023-11-04T01:35:56.090446+0000","last_undegraded":"2023-11-04T01:35:56.090446+0000","last_fullsized":"2023-11-04T01:35:56.090446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017774+0000","last_change":"2023-11-04T01:35:56.124194+0000","last_active":"2023-11-04T01:35:57.017774+0000","last_peered":"2023-11-04T01:35:57.017774+0000","last_clean":"2023-11-04T01:35:57.017774+0000","last_became_active":"2023-11-04T01:35:56.123794+0000","last_became_peered":"2023-11-04T01:35:56.123794+0000","last_unstale":"2023-11-04T01:35:57.017774+0000","last_undegraded":"2023-11-04T01:35:57.017774+0000","last_fullsized":"2023-11-04T01:35:57.017774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124176+0000","last_change":"2023-11-04T01:35:52.028162+0000","last_active":"2023-11-04T01:35:56.124176+0000","last_peered":"2023-11-04T01:35:56.124176+0000","last_clean":"2023-11-04T01:35:56.124176+0000","last_became_active":"2023-11-04T01:35:52.026689+0000","last_became_peered":"2023-11-04T01:35:52.026689+0000","last_unstale":"2023-11-04T01:35:56.124176+0000","last_undegraded":"2023-11-04T01:35:56.124176+0000","last_fullsized":"2023-11-04T01:35:56.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088966+0000","last_change":"2023-11-04T01:35:51.052770+0000","last_active":"2023-11-04T01:35:56.088966+0000","last_peered":"2023-11-04T01:35:56.088966+0000","last_clean":"2023-11-04T01:35:56.088966+0000","last_became_active":"2023-11-04T01:35:51.052476+0000","last_became_peered":"2023-11-04T01:35:51.052476+0000","last_unstale":"2023-11-04T01:35:56.088966+0000","last_undegraded":"2023-11-04T01:35:56.088966+0000","last_fullsized":"2023-11-04T01:35:56.088966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018926+0000","last_change":"2023-11-04T01:35:56.099158+0000","last_active":"2023-11-04T01:35:57.018926+0000","last_peered":"2023-11-04T01:35:57.018926+0000","last_clean":"2023-11-04T01:35:57.018926+0000","last_became_active":"2023-11-04T01:35:56.098426+0000","last_became_peered":"2023-11-04T01:35:56.098426+0000","last_unstale":"2023-11-04T01:35:57.018926+0000","last_undegraded":"2023-11-04T01:35:57.018926+0000","last_fullsized":"2023-11-04T01:35:57.018926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123073+0000","last_change":"2023-11-04T01:35:52.027681+0000","last_active":"2023-11-04T01:35:56.123073+0000","last_peered":"2023-11-04T01:35:56.123073+0000","last_clean":"2023-11-04T01:35:56.123073+0000","last_became_active":"2023-11-04T01:35:52.027391+0000","last_became_peered":"2023-11-04T01:35:52.027391+0000","last_unstale":"2023-11-04T01:35:56.123073+0000","last_undegraded":"2023-11-04T01:35:56.123073+0000","last_fullsized":"2023-11-04T01:35:56.123073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088329+0000","last_change":"2023-11-04T01:35:51.055489+0000","last_active":"2023-11-04T01:35:56.088329+0000","last_peered":"2023-11-04T01:35:56.088329+0000","last_clean":"2023-11-04T01:35:56.088329+0000","last_became_active":"2023-11-04T01:35:51.055183+0000","last_became_peered":"2023-11-04T01:35:51.055183+0000","last_unstale":"2023-11-04T01:35:56.088329+0000","last_undegraded":"2023-11-04T01:35:56.088329+0000","last_fullsized":"2023-11-04T01:35:56.088329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010094+0000","last_change":"2023-11-04T01:35:56.093191+0000","last_active":"2023-11-04T01:35:57.010094+0000","last_peered":"2023-11-04T01:35:57.010094+0000","last_clean":"2023-11-04T01:35:57.010094+0000","last_became_active":"2023-11-04T01:35:56.092827+0000","last_became_peered":"2023-11-04T01:35:56.092827+0000","last_unstale":"2023-11-04T01:35:57.010094+0000","last_undegraded":"2023-11-04T01:35:57.010094+0000","last_fullsized":"2023-11-04T01:35:57.010094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090655+0000","last_change":"2023-11-04T01:35:52.030977+0000","last_active":"2023-11-04T01:35:56.090655+0000","last_peered":"2023-11-04T01:35:56.090655+0000","last_clean":"2023-11-04T01:35:56.090655+0000","last_became_active":"2023-11-04T01:35:52.030636+0000","last_became_peered":"2023-11-04T01:35:52.030636+0000","last_unstale":"2023-11-04T01:35:56.090655+0000","last_undegraded":"2023-11-04T01:35:56.090655+0000","last_fullsized":"2023-11-04T01:35:56.090655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090474+0000","last_change":"2023-11-04T01:35:51.053345+0000","last_active":"2023-11-04T01:35:56.090474+0000","last_peered":"2023-11-04T01:35:56.090474+0000","last_clean":"2023-11-04T01:35:56.090474+0000","last_became_active":"2023-11-04T01:35:51.053075+0000","last_became_peered":"2023-11-04T01:35:51.053075+0000","last_unstale":"2023-11-04T01:35:56.090474+0000","last_undegraded":"2023-11-04T01:35:56.090474+0000","last_fullsized":"2023-11-04T01:35:56.090474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019088+0000","last_change":"2023-11-04T01:35:56.127666+0000","last_active":"2023-11-04T01:35:57.019088+0000","last_peered":"2023-11-04T01:35:57.019088+0000","last_clean":"2023-11-04T01:35:57.019088+0000","last_became_active":"2023-11-04T01:35:56.127269+0000","last_became_peered":"2023-11-04T01:35:56.127269+0000","last_unstale":"2023-11-04T01:35:57.019088+0000","last_undegraded":"2023-11-04T01:35:57.019088+0000","last_fullsized":"2023-11-04T01:35:57.019088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:21.238628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123188+0000","last_change":"2023-11-04T01:35:52.029517+0000","last_active":"2023-11-04T01:35:56.123188+0000","last_peered":"2023-11-04T01:35:56.123188+0000","last_clean":"2023-11-04T01:35:56.123188+0000","last_became_active":"2023-11-04T01:35:52.028417+0000","last_became_peered":"2023-11-04T01:35:52.028417+0000","last_unstale":"2023-11-04T01:35:56.123188+0000","last_undegraded":"2023-11-04T01:35:56.123188+0000","last_fullsized":"2023-11-04T01:35:56.123188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083242+0000","last_change":"2023-11-04T01:35:51.060407+0000","last_active":"2023-11-04T01:35:56.083242+0000","last_peered":"2023-11-04T01:35:56.083242+0000","last_clean":"2023-11-04T01:35:56.083242+0000","last_became_active":"2023-11-04T01:35:51.059918+0000","last_became_peered":"2023-11-04T01:35:51.059918+0000","last_unstale":"2023-11-04T01:35:56.083242+0000","last_undegraded":"2023-11-04T01:35:56.083242+0000","last_fullsized":"2023-11-04T01:35:56.083242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018639+0000","last_change":"2023-11-04T01:35:56.124269+0000","last_active":"2023-11-04T01:35:57.018639+0000","last_peered":"2023-11-04T01:35:57.018639+0000","last_clean":"2023-11-04T01:35:57.018639+0000","last_became_active":"2023-11-04T01:35:56.123412+0000","last_became_peered":"2023-11-04T01:35:56.123412+0000","last_unstale":"2023-11-04T01:35:57.018639+0000","last_undegraded":"2023-11-04T01:35:57.018639+0000","last_fullsized":"2023-11-04T01:35:57.018639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:48.271158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082167+0000","last_change":"2023-11-04T01:35:52.023713+0000","last_active":"2023-11-04T01:35:56.082167+0000","last_peered":"2023-11-04T01:35:56.082167+0000","last_clean":"2023-11-04T01:35:56.082167+0000","last_became_active":"2023-11-04T01:35:52.023417+0000","last_became_peered":"2023-11-04T01:35:52.023417+0000","last_unstale":"2023-11-04T01:35:56.082167+0000","last_undegraded":"2023-11-04T01:35:56.082167+0000","last_fullsized":"2023-11-04T01:35:56.082167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083357+0000","last_change":"2023-11-04T01:35:51.051189+0000","last_active":"2023-11-04T01:35:56.083357+0000","last_peered":"2023-11-04T01:35:56.083357+0000","last_clean":"2023-11-04T01:35:56.083357+0000","last_became_active":"2023-11-04T01:35:51.050893+0000","last_became_peered":"2023-11-04T01:35:51.050893+0000","last_unstale":"2023-11-04T01:35:56.083357+0000","last_undegraded":"2023-11-04T01:35:56.083357+0000","last_fullsized":"2023-11-04T01:35:56.083357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018804+0000","last_change":"2023-11-04T01:35:56.126113+0000","last_active":"2023-11-04T01:35:57.018804+0000","last_peered":"2023-11-04T01:35:57.018804+0000","last_clean":"2023-11-04T01:35:57.018804+0000","last_became_active":"2023-11-04T01:35:56.125732+0000","last_became_peered":"2023-11-04T01:35:56.125732+0000","last_unstale":"2023-11-04T01:35:57.018804+0000","last_undegraded":"2023-11-04T01:35:57.018804+0000","last_fullsized":"2023-11-04T01:35:57.018804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123721+0000","last_change":"2023-11-04T01:35:52.028845+0000","last_active":"2023-11-04T01:35:56.123721+0000","last_peered":"2023-11-04T01:35:56.123721+0000","last_clean":"2023-11-04T01:35:56.123721+0000","last_became_active":"2023-11-04T01:35:52.026621+0000","last_became_peered":"2023-11-04T01:35:52.026621+0000","last_unstale":"2023-11-04T01:35:56.123721+0000","last_undegraded":"2023-11-04T01:35:56.123721+0000","last_fullsized":"2023-11-04T01:35:56.123721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:00.959402+0000","last_change":"2023-11-04T01:35:51.059172+0000","last_active":"2023-11-04T01:36:00.959402+0000","last_peered":"2023-11-04T01:36:00.959402+0000","last_clean":"2023-11-04T01:36:00.959402+0000","last_became_active":"2023-11-04T01:35:51.058907+0000","last_became_peered":"2023-11-04T01:35:51.058907+0000","last_unstale":"2023-11-04T01:36:00.959402+0000","last_undegraded":"2023-11-04T01:36:00.959402+0000","last_fullsized":"2023-11-04T01:36:00.959402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018253+0000","last_change":"2023-11-04T01:35:56.093416+0000","last_active":"2023-11-04T01:35:57.018253+0000","last_peered":"2023-11-04T01:35:57.018253+0000","last_clean":"2023-11-04T01:35:57.018253+0000","last_became_active":"2023-11-04T01:35:56.092225+0000","last_became_peered":"2023-11-04T01:35:56.092225+0000","last_unstale":"2023-11-04T01:35:57.018253+0000","last_undegraded":"2023-11-04T01:35:57.018253+0000","last_fullsized":"2023-11-04T01:35:57.018253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090174+0000","last_change":"2023-11-04T01:35:52.020324+0000","last_active":"2023-11-04T01:35:56.090174+0000","last_peered":"2023-11-04T01:35:56.090174+0000","last_clean":"2023-11-04T01:35:56.090174+0000","last_became_active":"2023-11-04T01:35:52.020031+0000","last_became_peered":"2023-11-04T01:35:52.020031+0000","last_unstale":"2023-11-04T01:35:56.090174+0000","last_undegraded":"2023-11-04T01:35:56.090174+0000","last_fullsized":"2023-11-04T01:35:56.090174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:14.232121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076494+0000","last_change":"2023-11-04T01:35:51.063507+0000","last_active":"2023-11-04T01:35:56.076494+0000","last_peered":"2023-11-04T01:35:56.076494+0000","last_clean":"2023-11-04T01:35:56.076494+0000","last_became_active":"2023-11-04T01:35:51.062548+0000","last_became_peered":"2023-11-04T01:35:51.062548+0000","last_unstale":"2023-11-04T01:35:56.076494+0000","last_undegraded":"2023-11-04T01:35:56.076494+0000","last_fullsized":"2023-11-04T01:35:56.076494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019702+0000","last_change":"2023-11-04T01:35:56.100663+0000","last_active":"2023-11-04T01:35:57.019702+0000","last_peered":"2023-11-04T01:35:57.019702+0000","last_clean":"2023-11-04T01:35:57.019702+0000","last_became_active":"2023-11-04T01:35:56.099543+0000","last_became_peered":"2023-11-04T01:35:56.099543+0000","last_unstale":"2023-11-04T01:35:57.019702+0000","last_undegraded":"2023-11-04T01:35:57.019702+0000","last_fullsized":"2023-11-04T01:35:57.019702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082599+0000","last_change":"2023-11-04T01:35:52.028518+0000","last_active":"2023-11-04T01:35:56.082599+0000","last_peered":"2023-11-04T01:35:56.082599+0000","last_clean":"2023-11-04T01:35:56.082599+0000","last_became_active":"2023-11-04T01:35:52.028243+0000","last_became_peered":"2023-11-04T01:35:52.028243+0000","last_unstale":"2023-11-04T01:35:56.082599+0000","last_undegraded":"2023-11-04T01:35:56.082599+0000","last_fullsized":"2023-11-04T01:35:56.082599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083875+0000","last_change":"2023-11-04T01:35:51.064570+0000","last_active":"2023-11-04T01:35:56.083875+0000","last_peered":"2023-11-04T01:35:56.083875+0000","last_clean":"2023-11-04T01:35:56.083875+0000","last_became_active":"2023-11-04T01:35:51.064236+0000","last_became_peered":"2023-11-04T01:35:51.064236+0000","last_unstale":"2023-11-04T01:35:56.083875+0000","last_undegraded":"2023-11-04T01:35:56.083875+0000","last_fullsized":"2023-11-04T01:35:56.083875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:58.299230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017951+0000","last_change":"2023-11-04T01:35:56.096122+0000","last_active":"2023-11-04T01:35:57.017951+0000","last_peered":"2023-11-04T01:35:57.017951+0000","last_clean":"2023-11-04T01:35:57.017951+0000","last_became_active":"2023-11-04T01:35:56.095763+0000","last_became_peered":"2023-11-04T01:35:56.095763+0000","last_unstale":"2023-11-04T01:35:57.017951+0000","last_undegraded":"2023-11-04T01:35:57.017951+0000","last_fullsized":"2023-11-04T01:35:57.017951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083789+0000","last_change":"2023-11-04T01:35:52.033716+0000","last_active":"2023-11-04T01:35:56.083789+0000","last_peered":"2023-11-04T01:35:56.083789+0000","last_clean":"2023-11-04T01:35:56.083789+0000","last_became_active":"2023-11-04T01:35:52.033366+0000","last_became_peered":"2023-11-04T01:35:52.033366+0000","last_unstale":"2023-11-04T01:35:56.083789+0000","last_undegraded":"2023-11-04T01:35:56.083789+0000","last_fullsized":"2023-11-04T01:35:56.083789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092435+0000","last_change":"2023-11-04T01:35:51.061737+0000","last_active":"2023-11-04T01:35:56.092435+0000","last_peered":"2023-11-04T01:35:56.092435+0000","last_clean":"2023-11-04T01:35:56.092435+0000","last_became_active":"2023-11-04T01:35:51.061470+0000","last_became_peered":"2023-11-04T01:35:51.061470+0000","last_unstale":"2023-11-04T01:35:56.092435+0000","last_undegraded":"2023-11-04T01:35:56.092435+0000","last_fullsized":"2023-11-04T01:35:56.092435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018337+0000","last_change":"2023-11-04T01:35:56.127670+0000","last_active":"2023-11-04T01:35:57.018337+0000","last_peered":"2023-11-04T01:35:57.018337+0000","last_clean":"2023-11-04T01:35:57.018337+0000","last_became_active":"2023-11-04T01:35:56.127256+0000","last_became_peered":"2023-11-04T01:35:56.127256+0000","last_unstale":"2023-11-04T01:35:57.018337+0000","last_undegraded":"2023-11-04T01:35:57.018337+0000","last_fullsized":"2023-11-04T01:35:57.018337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:16.877043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010009+0000","last_change":"2023-11-04T01:35:56.125573+0000","last_active":"2023-11-04T01:35:57.010009+0000","last_peered":"2023-11-04T01:35:57.010009+0000","last_clean":"2023-11-04T01:35:57.010009+0000","last_became_active":"2023-11-04T01:35:56.125207+0000","last_became_peered":"2023-11-04T01:35:56.125207+0000","last_unstale":"2023-11-04T01:35:57.010009+0000","last_undegraded":"2023-11-04T01:35:57.010009+0000","last_fullsized":"2023-11-04T01:35:57.010009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076102+0000","last_change":"2023-11-04T01:35:52.023725+0000","last_active":"2023-11-04T01:35:56.076102+0000","last_peered":"2023-11-04T01:35:56.076102+0000","last_clean":"2023-11-04T01:35:56.076102+0000","last_became_active":"2023-11-04T01:35:52.023469+0000","last_became_peered":"2023-11-04T01:35:52.023469+0000","last_unstale":"2023-11-04T01:35:56.076102+0000","last_undegraded":"2023-11-04T01:35:56.076102+0000","last_fullsized":"2023-11-04T01:35:56.076102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082991+0000","last_change":"2023-11-04T01:35:51.059113+0000","last_active":"2023-11-04T01:35:56.082991+0000","last_peered":"2023-11-04T01:35:56.082991+0000","last_clean":"2023-11-04T01:35:56.082991+0000","last_became_active":"2023-11-04T01:35:51.058837+0000","last_became_peered":"2023-11-04T01:35:51.058837+0000","last_unstale":"2023-11-04T01:35:56.082991+0000","last_undegraded":"2023-11-04T01:35:56.082991+0000","last_fullsized":"2023-11-04T01:35:56.082991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010915+0000","last_change":"2023-11-04T01:35:56.102617+0000","last_active":"2023-11-04T01:35:57.010915+0000","last_peered":"2023-11-04T01:35:57.010915+0000","last_clean":"2023-11-04T01:35:57.010915+0000","last_became_active":"2023-11-04T01:35:56.102162+0000","last_became_peered":"2023-11-04T01:35:56.102162+0000","last_unstale":"2023-11-04T01:35:57.010915+0000","last_undegraded":"2023-11-04T01:35:57.010915+0000","last_fullsized":"2023-11-04T01:35:57.010915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086285+0000","last_change":"2023-11-04T01:35:52.031363+0000","last_active":"2023-11-04T01:35:56.086285+0000","last_peered":"2023-11-04T01:35:56.086285+0000","last_clean":"2023-11-04T01:35:56.086285+0000","last_became_active":"2023-11-04T01:35:52.031088+0000","last_became_peered":"2023-11-04T01:35:52.031088+0000","last_unstale":"2023-11-04T01:35:56.086285+0000","last_undegraded":"2023-11-04T01:35:56.086285+0000","last_fullsized":"2023-11-04T01:35:56.086285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085566+0000","last_change":"2023-11-04T01:35:51.065071+0000","last_active":"2023-11-04T01:35:56.085566+0000","last_peered":"2023-11-04T01:35:56.085566+0000","last_clean":"2023-11-04T01:35:56.085566+0000","last_became_active":"2023-11-04T01:35:51.064790+0000","last_became_peered":"2023-11-04T01:35:51.064790+0000","last_unstale":"2023-11-04T01:35:56.085566+0000","last_undegraded":"2023-11-04T01:35:56.085566+0000","last_fullsized":"2023-11-04T01:35:56.085566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090769+0000","last_change":"2023-11-04T01:35:51.057559+0000","last_active":"2023-11-04T01:35:56.090769+0000","last_peered":"2023-11-04T01:35:56.090769+0000","last_clean":"2023-11-04T01:35:56.090769+0000","last_became_active":"2023-11-04T01:35:51.056993+0000","last_became_peered":"2023-11-04T01:35:51.056993+0000","last_unstale":"2023-11-04T01:35:56.090769+0000","last_undegraded":"2023-11-04T01:35:56.090769+0000","last_fullsized":"2023-11-04T01:35:56.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082667+0000","last_change":"2023-11-04T01:35:52.022126+0000","last_active":"2023-11-04T01:35:56.082667+0000","last_peered":"2023-11-04T01:35:56.082667+0000","last_clean":"2023-11-04T01:35:56.082667+0000","last_became_active":"2023-11-04T01:35:52.021875+0000","last_became_peered":"2023-11-04T01:35:52.021875+0000","last_unstale":"2023-11-04T01:35:56.082667+0000","last_undegraded":"2023-11-04T01:35:56.082667+0000","last_fullsized":"2023-11-04T01:35:56.082667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010633+0000","last_change":"2023-11-04T01:35:56.099022+0000","last_active":"2023-11-04T01:35:57.010633+0000","last_peered":"2023-11-04T01:35:57.010633+0000","last_clean":"2023-11-04T01:35:57.010633+0000","last_became_active":"2023-11-04T01:35:56.098634+0000","last_became_peered":"2023-11-04T01:35:56.098634+0000","last_unstale":"2023-11-04T01:35:57.010633+0000","last_undegraded":"2023-11-04T01:35:57.010633+0000","last_fullsized":"2023-11-04T01:35:57.010633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:18.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086027+0000","last_change":"2023-11-04T01:35:51.061727+0000","last_active":"2023-11-04T01:35:56.086027+0000","last_peered":"2023-11-04T01:35:56.086027+0000","last_clean":"2023-11-04T01:35:56.086027+0000","last_became_active":"2023-11-04T01:35:51.061215+0000","last_became_peered":"2023-11-04T01:35:51.061215+0000","last_unstale":"2023-11-04T01:35:56.086027+0000","last_undegraded":"2023-11-04T01:35:56.086027+0000","last_fullsized":"2023-11-04T01:35:56.086027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090923+0000","last_change":"2023-11-04T01:35:52.020181+0000","last_active":"2023-11-04T01:35:56.090923+0000","last_peered":"2023-11-04T01:35:56.090923+0000","last_clean":"2023-11-04T01:35:56.090923+0000","last_became_active":"2023-11-04T01:35:52.019904+0000","last_became_peered":"2023-11-04T01:35:52.019904+0000","last_unstale":"2023-11-04T01:35:56.090923+0000","last_undegraded":"2023-11-04T01:35:56.090923+0000","last_fullsized":"2023-11-04T01:35:56.090923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018207+0000","last_change":"2023-11-04T01:35:56.096018+0000","last_active":"2023-11-04T01:35:57.018207+0000","last_peered":"2023-11-04T01:35:57.018207+0000","last_clean":"2023-11-04T01:35:57.018207+0000","last_became_active":"2023-11-04T01:35:56.094855+0000","last_became_peered":"2023-11-04T01:35:56.094855+0000","last_unstale":"2023-11-04T01:35:57.018207+0000","last_undegraded":"2023-11-04T01:35:57.018207+0000","last_fullsized":"2023-11-04T01:35:57.018207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:11.437390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090519+0000","last_change":"2023-11-04T01:35:52.031578+0000","last_active":"2023-11-04T01:35:56.090519+0000","last_peered":"2023-11-04T01:35:56.090519+0000","last_clean":"2023-11-04T01:35:56.090519+0000","last_became_active":"2023-11-04T01:35:52.031324+0000","last_became_peered":"2023-11-04T01:35:52.031324+0000","last_unstale":"2023-11-04T01:35:56.090519+0000","last_undegraded":"2023-11-04T01:35:56.090519+0000","last_fullsized":"2023-11-04T01:35:56.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090127+0000","last_change":"2023-11-04T01:35:52.021615+0000","last_active":"2023-11-04T01:35:56.090127+0000","last_peered":"2023-11-04T01:35:56.090127+0000","last_clean":"2023-11-04T01:35:56.090127+0000","last_became_active":"2023-11-04T01:35:52.021344+0000","last_became_peered":"2023-11-04T01:35:52.021344+0000","last_unstale":"2023-11-04T01:35:56.090127+0000","last_undegraded":"2023-11-04T01:35:56.090127+0000","last_fullsized":"2023-11-04T01:35:56.090127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083431+0000","last_change":"2023-11-04T01:35:52.027223+0000","last_active":"2023-11-04T01:35:56.083431+0000","last_peered":"2023-11-04T01:35:56.083431+0000","last_clean":"2023-11-04T01:35:56.083431+0000","last_became_active":"2023-11-04T01:35:52.026929+0000","last_became_peered":"2023-11-04T01:35:52.026929+0000","last_unstale":"2023-11-04T01:35:56.083431+0000","last_undegraded":"2023-11-04T01:35:56.083431+0000","last_fullsized":"2023-11-04T01:35:56.083431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082587+0000","last_change":"2023-11-04T01:35:52.023823+0000","last_active":"2023-11-04T01:35:56.082587+0000","last_peered":"2023-11-04T01:35:56.082587+0000","last_clean":"2023-11-04T01:35:56.082587+0000","last_became_active":"2023-11-04T01:35:52.023555+0000","last_became_peered":"2023-11-04T01:35:52.023555+0000","last_unstale":"2023-11-04T01:35:56.082587+0000","last_undegraded":"2023-11-04T01:35:56.082587+0000","last_fullsized":"2023-11-04T01:35:56.082587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086368+0000","last_change":"2023-11-04T01:35:52.023538+0000","last_active":"2023-11-04T01:35:56.086368+0000","last_peered":"2023-11-04T01:35:56.086368+0000","last_clean":"2023-11-04T01:35:56.086368+0000","last_became_active":"2023-11-04T01:35:52.023231+0000","last_became_peered":"2023-11-04T01:35:52.023231+0000","last_unstale":"2023-11-04T01:35:56.086368+0000","last_undegraded":"2023-11-04T01:35:56.086368+0000","last_fullsized":"2023-11-04T01:35:56.086368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076403+0000","last_change":"2023-11-04T01:35:52.020500+0000","last_active":"2023-11-04T01:35:56.076403+0000","last_peered":"2023-11-04T01:35:56.076403+0000","last_clean":"2023-11-04T01:35:56.076403+0000","last_became_active":"2023-11-04T01:35:52.020215+0000","last_became_peered":"2023-11-04T01:35:52.020215+0000","last_unstale":"2023-11-04T01:35:56.076403+0000","last_undegraded":"2023-11-04T01:35:56.076403+0000","last_fullsized":"2023-11-04T01:35:56.076403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092296+0000","last_change":"2023-11-04T01:35:52.032684+0000","last_active":"2023-11-04T01:35:56.092296+0000","last_peered":"2023-11-04T01:35:56.092296+0000","last_clean":"2023-11-04T01:35:56.092296+0000","last_became_active":"2023-11-04T01:35:52.032419+0000","last_became_peered":"2023-11-04T01:35:52.032419+0000","last_unstale":"2023-11-04T01:35:56.092296+0000","last_undegraded":"2023-11-04T01:35:56.092296+0000","last_fullsized":"2023-11-04T01:35:56.092296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086117+0000","last_change":"2023-11-04T01:35:52.022740+0000","last_active":"2023-11-04T01:35:56.086117+0000","last_peered":"2023-11-04T01:35:56.086117+0000","last_clean":"2023-11-04T01:35:56.086117+0000","last_became_active":"2023-11-04T01:35:52.022487+0000","last_became_peered":"2023-11-04T01:35:52.022487+0000","last_unstale":"2023-11-04T01:35:56.086117+0000","last_undegraded":"2023-11-04T01:35:56.086117+0000","last_fullsized":"2023-11-04T01:35:56.086117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082907+0000","last_change":"2023-11-04T01:35:52.026431+0000","last_active":"2023-11-04T01:35:56.082907+0000","last_peered":"2023-11-04T01:35:56.082907+0000","last_clean":"2023-11-04T01:35:56.082907+0000","last_became_active":"2023-11-04T01:35:52.025267+0000","last_became_peered":"2023-11-04T01:35:52.025267+0000","last_unstale":"2023-11-04T01:35:56.082907+0000","last_undegraded":"2023-11-04T01:35:56.082907+0000","last_fullsized":"2023-11-04T01:35:56.082907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085429+0000","last_change":"2023-11-04T01:35:52.025059+0000","last_active":"2023-11-04T01:35:56.085429+0000","last_peered":"2023-11-04T01:35:56.085429+0000","last_clean":"2023-11-04T01:35:56.085429+0000","last_became_active":"2023-11-04T01:35:52.024772+0000","last_became_peered":"2023-11-04T01:35:52.024772+0000","last_unstale":"2023-11-04T01:35:56.085429+0000","last_undegraded":"2023-11-04T01:35:56.085429+0000","last_fullsized":"2023-11-04T01:35:56.085429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083117+0000","last_change":"2023-11-04T01:35:52.033100+0000","last_active":"2023-11-04T01:35:56.083117+0000","last_peered":"2023-11-04T01:35:56.083117+0000","last_clean":"2023-11-04T01:35:56.083117+0000","last_became_active":"2023-11-04T01:35:52.032826+0000","last_became_peered":"2023-11-04T01:35:52.032826+0000","last_unstale":"2023-11-04T01:35:56.083117+0000","last_undegraded":"2023-11-04T01:35:56.083117+0000","last_fullsized":"2023-11-04T01:35:56.083117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082484+0000","last_change":"2023-11-04T01:35:52.024693+0000","last_active":"2023-11-04T01:35:56.082484+0000","last_peered":"2023-11-04T01:35:56.082484+0000","last_clean":"2023-11-04T01:35:56.082484+0000","last_became_active":"2023-11-04T01:35:52.024003+0000","last_became_peered":"2023-11-04T01:35:52.024003+0000","last_unstale":"2023-11-04T01:35:56.082484+0000","last_undegraded":"2023-11-04T01:35:56.082484+0000","last_fullsized":"2023-11-04T01:35:56.082484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091592+0000","last_change":"2023-11-04T01:35:52.025240+0000","last_active":"2023-11-04T01:35:56.091592+0000","last_peered":"2023-11-04T01:35:56.091592+0000","last_clean":"2023-11-04T01:35:56.091592+0000","last_became_active":"2023-11-04T01:35:52.024964+0000","last_became_peered":"2023-11-04T01:35:52.024964+0000","last_unstale":"2023-11-04T01:35:56.091592+0000","last_undegraded":"2023-11-04T01:35:56.091592+0000","last_fullsized":"2023-11-04T01:35:56.091592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124893+0000","last_change":"2023-11-04T01:35:52.032089+0000","last_active":"2023-11-04T01:35:56.124893+0000","last_peered":"2023-11-04T01:35:56.124893+0000","last_clean":"2023-11-04T01:35:56.124893+0000","last_became_active":"2023-11-04T01:35:52.030222+0000","last_became_peered":"2023-11-04T01:35:52.030222+0000","last_unstale":"2023-11-04T01:35:56.124893+0000","last_undegraded":"2023-11-04T01:35:56.124893+0000","last_fullsized":"2023-11-04T01:35:56.124893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090324+0000","last_change":"2023-11-04T01:35:52.027792+0000","last_active":"2023-11-04T01:35:56.090324+0000","last_peered":"2023-11-04T01:35:56.090324+0000","last_clean":"2023-11-04T01:35:56.090324+0000","last_became_active":"2023-11-04T01:35:52.027473+0000","last_became_peered":"2023-11-04T01:35:52.027473+0000","last_unstale":"2023-11-04T01:35:56.090324+0000","last_undegraded":"2023-11-04T01:35:56.090324+0000","last_fullsized":"2023-11-04T01:35:56.090324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084262+0000","last_change":"2023-11-04T01:35:52.034363+0000","last_active":"2023-11-04T01:35:56.084262+0000","last_peered":"2023-11-04T01:35:56.084262+0000","last_clean":"2023-11-04T01:35:56.084262+0000","last_became_active":"2023-11-04T01:35:52.034096+0000","last_became_peered":"2023-11-04T01:35:52.034096+0000","last_unstale":"2023-11-04T01:35:56.084262+0000","last_undegraded":"2023-11-04T01:35:56.084262+0000","last_fullsized":"2023-11-04T01:35:56.084262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082886+0000","last_change":"2023-11-04T01:35:52.033024+0000","last_active":"2023-11-04T01:35:56.082886+0000","last_peered":"2023-11-04T01:35:56.082886+0000","last_clean":"2023-11-04T01:35:56.082886+0000","last_became_active":"2023-11-04T01:35:52.032614+0000","last_became_peered":"2023-11-04T01:35:52.032614+0000","last_unstale":"2023-11-04T01:35:56.082886+0000","last_undegraded":"2023-11-04T01:35:56.082886+0000","last_fullsized":"2023-11-04T01:35:56.082886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076111+0000","last_change":"2023-11-04T01:35:52.021303+0000","last_active":"2023-11-04T01:35:56.076111+0000","last_peered":"2023-11-04T01:35:56.076111+0000","last_clean":"2023-11-04T01:35:56.076111+0000","last_became_active":"2023-11-04T01:35:52.021044+0000","last_became_peered":"2023-11-04T01:35:52.021044+0000","last_unstale":"2023-11-04T01:35:56.076111+0000","last_undegraded":"2023-11-04T01:35:56.076111+0000","last_fullsized":"2023-11-04T01:35:56.076111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082084+0000","last_change":"2023-11-04T01:35:52.016825+0000","last_active":"2023-11-04T01:35:56.082084+0000","last_peered":"2023-11-04T01:35:56.082084+0000","last_clean":"2023-11-04T01:35:56.082084+0000","last_became_active":"2023-11-04T01:35:52.016549+0000","last_became_peered":"2023-11-04T01:35:52.016549+0000","last_unstale":"2023-11-04T01:35:56.082084+0000","last_undegraded":"2023-11-04T01:35:56.082084+0000","last_fullsized":"2023-11-04T01:35:56.082084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085869+0000","last_change":"2023-11-04T01:35:52.027711+0000","last_active":"2023-11-04T01:35:56.085869+0000","last_peered":"2023-11-04T01:35:56.085869+0000","last_clean":"2023-11-04T01:35:56.085869+0000","last_became_active":"2023-11-04T01:35:52.027452+0000","last_became_peered":"2023-11-04T01:35:52.027452+0000","last_unstale":"2023-11-04T01:35:56.085869+0000","last_undegraded":"2023-11-04T01:35:56.085869+0000","last_fullsized":"2023-11-04T01:35:56.085869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090100+0000","last_change":"2023-11-04T01:35:52.026105+0000","last_active":"2023-11-04T01:35:56.090100+0000","last_peered":"2023-11-04T01:35:56.090100+0000","last_clean":"2023-11-04T01:35:56.090100+0000","last_became_active":"2023-11-04T01:35:52.025848+0000","last_became_peered":"2023-11-04T01:35:52.025848+0000","last_unstale":"2023-11-04T01:35:56.090100+0000","last_undegraded":"2023-11-04T01:35:56.090100+0000","last_fullsized":"2023-11-04T01:35:56.090100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:57.470566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091791+0000","last_change":"2023-11-04T01:35:52.028295+0000","last_active":"2023-11-04T01:35:56.091791+0000","last_peered":"2023-11-04T01:35:56.091791+0000","last_clean":"2023-11-04T01:35:56.091791+0000","last_became_active":"2023-11-04T01:35:52.027999+0000","last_became_peered":"2023-11-04T01:35:52.027999+0000","last_unstale":"2023-11-04T01:35:56.091791+0000","last_undegraded":"2023-11-04T01:35:56.091791+0000","last_fullsized":"2023-11-04T01:35:56.091791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092276+0000","last_change":"2023-11-04T01:35:52.034087+0000","last_active":"2023-11-04T01:35:56.092276+0000","last_peered":"2023-11-04T01:35:56.092276+0000","last_clean":"2023-11-04T01:35:56.092276+0000","last_became_active":"2023-11-04T01:35:52.033825+0000","last_became_peered":"2023-11-04T01:35:52.033825+0000","last_unstale":"2023-11-04T01:35:56.092276+0000","last_undegraded":"2023-11-04T01:35:56.092276+0000","last_fullsized":"2023-11-04T01:35:56.092276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124669+0000","last_change":"2023-11-04T01:35:52.032966+0000","last_active":"2023-11-04T01:35:56.124669+0000","last_peered":"2023-11-04T01:35:56.124669+0000","last_clean":"2023-11-04T01:35:56.124669+0000","last_became_active":"2023-11-04T01:35:52.032247+0000","last_became_peered":"2023-11-04T01:35:52.032247+0000","last_unstale":"2023-11-04T01:35:56.124669+0000","last_undegraded":"2023-11-04T01:35:56.124669+0000","last_fullsized":"2023-11-04T01:35:56.124669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086247+0000","last_change":"2023-11-04T01:35:52.027992+0000","last_active":"2023-11-04T01:35:56.086247+0000","last_peered":"2023-11-04T01:35:56.086247+0000","last_clean":"2023-11-04T01:35:56.086247+0000","last_became_active":"2023-11-04T01:35:52.027698+0000","last_became_peered":"2023-11-04T01:35:52.027698+0000","last_unstale":"2023-11-04T01:35:56.086247+0000","last_undegraded":"2023-11-04T01:35:56.086247+0000","last_fullsized":"2023-11-04T01:35:56.086247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123016+0000","last_change":"2023-11-04T01:35:52.028491+0000","last_active":"2023-11-04T01:35:56.123016+0000","last_peered":"2023-11-04T01:35:56.123016+0000","last_clean":"2023-11-04T01:35:56.123016+0000","last_became_active":"2023-11-04T01:35:52.027844+0000","last_became_peered":"2023-11-04T01:35:52.027844+0000","last_unstale":"2023-11-04T01:35:56.123016+0000","last_undegraded":"2023-11-04T01:35:56.123016+0000","last_fullsized":"2023-11-04T01:35:56.123016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083120+0000","last_change":"2023-11-04T01:35:52.032551+0000","last_active":"2023-11-04T01:35:56.083120+0000","last_peered":"2023-11-04T01:35:56.083120+0000","last_clean":"2023-11-04T01:35:56.083120+0000","last_became_active":"2023-11-04T01:35:52.032243+0000","last_became_peered":"2023-11-04T01:35:52.032243+0000","last_unstale":"2023-11-04T01:35:56.083120+0000","last_undegraded":"2023-11-04T01:35:56.083120+0000","last_fullsized":"2023-11-04T01:35:56.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123005+0000","last_change":"2023-11-04T01:35:52.029489+0000","last_active":"2023-11-04T01:35:56.123005+0000","last_peered":"2023-11-04T01:35:56.123005+0000","last_clean":"2023-11-04T01:35:56.123005+0000","last_became_active":"2023-11-04T01:35:52.027332+0000","last_became_peered":"2023-11-04T01:35:52.027332+0000","last_unstale":"2023-11-04T01:35:56.123005+0000","last_undegraded":"2023-11-04T01:35:56.123005+0000","last_fullsized":"2023-11-04T01:35:56.123005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083593+0000","last_change":"2023-11-04T01:35:52.028505+0000","last_active":"2023-11-04T01:35:56.083593+0000","last_peered":"2023-11-04T01:35:56.083593+0000","last_clean":"2023-11-04T01:35:56.083593+0000","last_became_active":"2023-11-04T01:35:52.027029+0000","last_became_peered":"2023-11-04T01:35:52.027029+0000","last_unstale":"2023-11-04T01:35:56.083593+0000","last_undegraded":"2023-11-04T01:35:56.083593+0000","last_fullsized":"2023-11-04T01:35:56.083593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082243+0000","last_change":"2023-11-04T01:35:52.021387+0000","last_active":"2023-11-04T01:35:56.082243+0000","last_peered":"2023-11-04T01:35:56.082243+0000","last_clean":"2023-11-04T01:35:56.082243+0000","last_became_active":"2023-11-04T01:35:52.021111+0000","last_became_peered":"2023-11-04T01:35:52.021111+0000","last_unstale":"2023-11-04T01:35:56.082243+0000","last_undegraded":"2023-11-04T01:35:56.082243+0000","last_fullsized":"2023-11-04T01:35:56.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:05.972756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076467+0000","last_change":"2023-11-04T01:35:52.014538+0000","last_active":"2023-11-04T01:35:56.076467+0000","last_peered":"2023-11-04T01:35:56.076467+0000","last_clean":"2023-11-04T01:35:56.076467+0000","last_became_active":"2023-11-04T01:35:52.014284+0000","last_became_peered":"2023-11-04T01:35:52.014284+0000","last_unstale":"2023-11-04T01:35:56.076467+0000","last_undegraded":"2023-11-04T01:35:56.076467+0000","last_fullsized":"2023-11-04T01:35:56.076467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124311+0000","last_change":"2023-11-04T01:35:52.028638+0000","last_active":"2023-11-04T01:35:56.124311+0000","last_peered":"2023-11-04T01:35:56.124311+0000","last_clean":"2023-11-04T01:35:56.124311+0000","last_became_active":"2023-11-04T01:35:52.028172+0000","last_became_peered":"2023-11-04T01:35:52.028172+0000","last_unstale":"2023-11-04T01:35:56.124311+0000","last_undegraded":"2023-11-04T01:35:56.124311+0000","last_fullsized":"2023-11-04T01:35:56.124311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:10.069 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:10.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.194+0000 7fc20bb9e640 1 Processor -- start 2023-11-04T01:36:10.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.195+0000 7fc20bb9e640 1 -- start start 2023-11-04T01:36:10.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.195+0000 7fc20bb9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc2040cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.195+0000 7fc20bb9e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040cc450 con 0x7fc20415ae40 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.195+0000 7fc20bb9e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20415f400 con 0x7fc2040cd860 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.195+0000 7fc20bb9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20415b220 con 0x7fc20415bfb0 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc20993a640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc20415ae40 0x7fc2040cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50214/0 (socket says 172.21.15.93:50214) 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc20993a640 1 -- 172.21.15.93:0/2745516377 learned_addr learned my addr 172.21.15.93:0/2745516377 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc209139640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc2040cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020564691 0 0) 0x7fc200001110 con 0x7fc20415ae40 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f0003520 con 0x7fc20415ae40 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138128717 0 0) 0x7fc1f0003520 con 0x7fc20415ae40 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 msgr2=0x7fc2040cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc2040cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 >> v1:172.21.15.125:6789/0 conn(0x7fc2040cd860 legacy=0x7fc2040ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20415f890 con 0x7fc20415ae40 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fc200001800 con 0x7fc20415ae40 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 >> v1:172.21.15.93:6789/0 conn(0x7fc20415ae40 legacy=0x7fc2040cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc1f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f0003f20 0x7fc1f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1f0004d00 0x7fc1f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20415b220 con 0x7fc1f0004d00 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ba60 con 0x7fc1f0003f20 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000bc20 con 0x7fc20415bfb0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1f0004d00 0x7fc1f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc20993a640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc1f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.196+0000 7fc209139640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f0003f20 0x7fc1f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 -- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 msgr2=0x7fc1f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc20415bfb0 0x7fc1f00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 -- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f0003f20 msgr2=0x7fc1f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1f0003f20 0x7fc1f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 -- 172.21.15.93:0/2745516377 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0003520 con 0x7fc1f0004d00 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1f0004d00 0x7fc1f0005180 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001e50 tx=0x7fc1f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd68c66a9de0d81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc003b70 con 0x7fc1f0004d00 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc003cd0 con 0x7fc1f0004d00 2023-11-04T01:36:10.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.197+0000 7fc208938640 1 -- 172.21.15.93:0/2745516377 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc005310 con 0x7fc1f0004d00 2023-11-04T01:36:10.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2745516377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1f0004d00 msgr2=0x7fc1f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2745516377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1f0004d00 0x7fc1f0005180 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001e50 tx=0x7fc1f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20a13b640 1 -- 172.21.15.93:0/2745516377 reap_dead start 2023-11-04T01:36:10.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2745516377 shutdown_connections 2023-11-04T01:36:10.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2745516377 >> 172.21.15.93:0/2745516377 conn(0x7fc20406ea90 msgr2=0x7fc20406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2745516377 shutdown_connections 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.198+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2745516377 wait complete. 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.199+0000 7fc20bb9e640 1 Processor -- start 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.199+0000 7fc20bb9e640 1 -- start start 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f0004d00 0x7fc204152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 0x7fc2040ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2041f2010 con 0x7fc2040b0600 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c5240 con 0x7fc2041f1500 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20bb9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2041f1a50 con 0x7fc1f0004d00 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33266/0 (socket says 172.21.15.93:33266) 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 -- 172.21.15.93:0/2364794779 learned_addr learned my addr 172.21.15.93:0/2364794779 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20993a640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f0004d00 0x7fc204152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 -- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f0004d00 msgr2=0x7fc204152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 0x7fc2040ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f0004d00 0x7fc204152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 -- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 msgr2=0x7fc2040ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 0x7fc2040ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 -- 172.21.15.93:0/2364794779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2041f1d30 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc20a13b640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 0x7fc2040ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.200+0000 7fc209139640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40119a0 tx=0x7fc1f4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.201+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400faf0 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.201+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400fc50 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.201+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4014440 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.201+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040c54e0 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.201+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc204152670 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.202+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2040ce2d0 con 0x7fc2040b0600 2023-11-04T01:36:10.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.202+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1f40145a0 con 0x7fc2040b0600 2023-11-04T01:36:10.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.202+0000 7fc1fa7fc640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 0x7fc1e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.202+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1f408a170 con 0x7fc2040b0600 2023-11-04T01:36:10.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.202+0000 7fc20993a640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 0x7fc1e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.203+0000 7fc20993a640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 0x7fc1e806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc200001050 tx=0x7fc200009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.207+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1f4054f30 con 0x7fc2040b0600 2023-11-04T01:36:10.373 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.371+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc20415edb0 con 0x7fc1e806ae70 2023-11-04T01:36:10.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.379+0000 7fc1fa7fc640 1 -- 172.21.15.93:0/2364794779 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345271 (secure 0 0 0) 0x7fc200007770 con 0x7fc1e806ae70 2023-11-04T01:36:10.386 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:10.388 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:36:10.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 msgr2=0x7fc1e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 0x7fc1e806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc200001050 tx=0x7fc200009040 comp rx=0 tx=0).stop 2023-11-04T01:36:10.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 msgr2=0x7fc2041f0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40119a0 tx=0x7fc1f4011e60 comp rx=0 tx=0).stop 2023-11-04T01:36:10.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 shutdown_connections 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1e806ae70 0x7fc1e806d330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2041f1500 0x7fc2040ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2040b0600 0x7fc2041f0fc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 --2- 172.21.15.93:0/2364794779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1f0004d00 0x7fc204152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 >> 172.21.15.93:0/2364794779 conn(0x7fc20406ea90 msgr2=0x7fc20415e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 shutdown_connections 2023-11-04T01:36:10.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.383+0000 7fc20bb9e640 1 -- 172.21.15.93:0/2364794779 wait complete. 2023-11-04T01:36:10.396 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:09.329012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3276800,"data_stored":1986032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002375"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082757+0000","last_change":"2023-11-04T01:35:51.059593+0000","last_active":"2023-11-04T01:35:56.082757+0000","last_peered":"2023-11-04T01:35:56.082757+0000","last_clean":"2023-11-04T01:35:56.082757+0000","last_became_active":"2023-11-04T01:35:51.059276+0000","last_became_peered":"2023-11-04T01:35:51.059276+0000","last_unstale":"2023-11-04T01:35:56.082757+0000","last_undegraded":"2023-11-04T01:35:56.082757+0000","last_fullsized":"2023-11-04T01:35:56.082757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085660+0000","last_change":"2023-11-04T01:35:52.029967+0000","last_active":"2023-11-04T01:35:56.085660+0000","last_peered":"2023-11-04T01:35:56.085660+0000","last_clean":"2023-11-04T01:35:56.085660+0000","last_became_active":"2023-11-04T01:35:52.029678+0000","last_became_peered":"2023-11-04T01:35:52.029678+0000","last_unstale":"2023-11-04T01:35:56.085660+0000","last_undegraded":"2023-11-04T01:35:56.085660+0000","last_fullsized":"2023-11-04T01:35:56.085660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018192+0000","last_change":"2023-11-04T01:35:56.127497+0000","last_active":"2023-11-04T01:35:57.018192+0000","last_peered":"2023-11-04T01:35:57.018192+0000","last_clean":"2023-11-04T01:35:57.018192+0000","last_became_active":"2023-11-04T01:35:56.127104+0000","last_became_peered":"2023-11-04T01:35:56.127104+0000","last_unstale":"2023-11-04T01:35:57.018192+0000","last_undegraded":"2023-11-04T01:35:57.018192+0000","last_fullsized":"2023-11-04T01:35:57.018192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:04.310871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085827+0000","last_change":"2023-11-04T01:35:51.062804+0000","last_active":"2023-11-04T01:35:56.085827+0000","last_peered":"2023-11-04T01:35:56.085827+0000","last_clean":"2023-11-04T01:35:56.085827+0000","last_became_active":"2023-11-04T01:35:51.062550+0000","last_became_peered":"2023-11-04T01:35:51.062550+0000","last_unstale":"2023-11-04T01:35:56.085827+0000","last_undegraded":"2023-11-04T01:35:56.085827+0000","last_fullsized":"2023-11-04T01:35:56.085827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082497+0000","last_change":"2023-11-04T01:35:52.028642+0000","last_active":"2023-11-04T01:35:56.082497+0000","last_peered":"2023-11-04T01:35:56.082497+0000","last_clean":"2023-11-04T01:35:56.082497+0000","last_became_active":"2023-11-04T01:35:52.028335+0000","last_became_peered":"2023-11-04T01:35:52.028335+0000","last_unstale":"2023-11-04T01:35:56.082497+0000","last_undegraded":"2023-11-04T01:35:56.082497+0000","last_fullsized":"2023-11-04T01:35:56.082497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018823+0000","last_change":"2023-11-04T01:35:56.097973+0000","last_active":"2023-11-04T01:35:57.018823+0000","last_peered":"2023-11-04T01:35:57.018823+0000","last_clean":"2023-11-04T01:35:57.018823+0000","last_became_active":"2023-11-04T01:35:56.097592+0000","last_became_peered":"2023-11-04T01:35:56.097592+0000","last_unstale":"2023-11-04T01:35:57.018823+0000","last_undegraded":"2023-11-04T01:35:57.018823+0000","last_fullsized":"2023-11-04T01:35:57.018823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:59.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124753+0000","last_change":"2023-11-04T01:35:51.064359+0000","last_active":"2023-11-04T01:35:56.124753+0000","last_peered":"2023-11-04T01:35:56.124753+0000","last_clean":"2023-11-04T01:35:56.124753+0000","last_became_active":"2023-11-04T01:35:51.064086+0000","last_became_peered":"2023-11-04T01:35:51.064086+0000","last_unstale":"2023-11-04T01:35:56.124753+0000","last_undegraded":"2023-11-04T01:35:56.124753+0000","last_fullsized":"2023-11-04T01:35:56.124753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:04.967632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083843+0000","last_change":"2023-11-04T01:35:52.027845+0000","last_active":"2023-11-04T01:35:56.083843+0000","last_peered":"2023-11-04T01:35:56.083843+0000","last_clean":"2023-11-04T01:35:56.083843+0000","last_became_active":"2023-11-04T01:35:52.024155+0000","last_became_peered":"2023-11-04T01:35:52.024155+0000","last_unstale":"2023-11-04T01:35:56.083843+0000","last_undegraded":"2023-11-04T01:35:56.083843+0000","last_fullsized":"2023-11-04T01:35:56.083843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019534+0000","last_change":"2023-11-04T01:35:56.100849+0000","last_active":"2023-11-04T01:35:57.019534+0000","last_peered":"2023-11-04T01:35:57.019534+0000","last_clean":"2023-11-04T01:35:57.019534+0000","last_became_active":"2023-11-04T01:35:56.099083+0000","last_became_peered":"2023-11-04T01:35:56.099083+0000","last_unstale":"2023-11-04T01:35:57.019534+0000","last_undegraded":"2023-11-04T01:35:57.019534+0000","last_fullsized":"2023-11-04T01:35:57.019534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123310+0000","last_change":"2023-11-04T01:35:51.062659+0000","last_active":"2023-11-04T01:35:56.123310+0000","last_peered":"2023-11-04T01:35:56.123310+0000","last_clean":"2023-11-04T01:35:56.123310+0000","last_became_active":"2023-11-04T01:35:51.062258+0000","last_became_peered":"2023-11-04T01:35:51.062258+0000","last_unstale":"2023-11-04T01:35:56.123310+0000","last_undegraded":"2023-11-04T01:35:56.123310+0000","last_fullsized":"2023-11-04T01:35:56.123310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083932+0000","last_change":"2023-11-04T01:35:52.028671+0000","last_active":"2023-11-04T01:35:56.083932+0000","last_peered":"2023-11-04T01:35:56.083932+0000","last_clean":"2023-11-04T01:35:56.083932+0000","last_became_active":"2023-11-04T01:35:52.028245+0000","last_became_peered":"2023-11-04T01:35:52.028245+0000","last_unstale":"2023-11-04T01:35:56.083932+0000","last_undegraded":"2023-11-04T01:35:56.083932+0000","last_fullsized":"2023-11-04T01:35:56.083932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018071+0000","last_change":"2023-11-04T01:35:56.100779+0000","last_active":"2023-11-04T01:35:57.018071+0000","last_peered":"2023-11-04T01:35:57.018071+0000","last_clean":"2023-11-04T01:35:57.018071+0000","last_became_active":"2023-11-04T01:35:56.100333+0000","last_became_peered":"2023-11-04T01:35:56.100333+0000","last_unstale":"2023-11-04T01:35:57.018071+0000","last_undegraded":"2023-11-04T01:35:57.018071+0000","last_fullsized":"2023-11-04T01:35:57.018071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:48.170680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090642+0000","last_change":"2023-11-04T01:35:52.025166+0000","last_active":"2023-11-04T01:35:56.090642+0000","last_peered":"2023-11-04T01:35:56.090642+0000","last_clean":"2023-11-04T01:35:56.090642+0000","last_became_active":"2023-11-04T01:35:52.024875+0000","last_became_peered":"2023-11-04T01:35:52.024875+0000","last_unstale":"2023-11-04T01:35:56.090642+0000","last_undegraded":"2023-11-04T01:35:56.090642+0000","last_fullsized":"2023-11-04T01:35:56.090642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123232+0000","last_change":"2023-11-04T01:35:51.060056+0000","last_active":"2023-11-04T01:35:56.123232+0000","last_peered":"2023-11-04T01:35:56.123232+0000","last_clean":"2023-11-04T01:35:56.123232+0000","last_became_active":"2023-11-04T01:35:51.059746+0000","last_became_peered":"2023-11-04T01:35:51.059746+0000","last_unstale":"2023-11-04T01:35:56.123232+0000","last_undegraded":"2023-11-04T01:35:56.123232+0000","last_fullsized":"2023-11-04T01:35:56.123232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:07.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018852+0000","last_change":"2023-11-04T01:35:56.099872+0000","last_active":"2023-11-04T01:35:57.018852+0000","last_peered":"2023-11-04T01:35:57.018852+0000","last_clean":"2023-11-04T01:35:57.018852+0000","last_became_active":"2023-11-04T01:35:56.098782+0000","last_became_peered":"2023-11-04T01:35:56.098782+0000","last_unstale":"2023-11-04T01:35:57.018852+0000","last_undegraded":"2023-11-04T01:35:57.018852+0000","last_fullsized":"2023-11-04T01:35:57.018852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:26.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085943+0000","last_change":"2023-11-04T01:35:52.030864+0000","last_active":"2023-11-04T01:35:56.085943+0000","last_peered":"2023-11-04T01:35:56.085943+0000","last_clean":"2023-11-04T01:35:56.085943+0000","last_became_active":"2023-11-04T01:35:52.030586+0000","last_became_peered":"2023-11-04T01:35:52.030586+0000","last_unstale":"2023-11-04T01:35:56.085943+0000","last_undegraded":"2023-11-04T01:35:56.085943+0000","last_fullsized":"2023-11-04T01:35:56.085943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.077121+0000","last_change":"2023-11-04T01:35:51.063222+0000","last_active":"2023-11-04T01:35:56.077121+0000","last_peered":"2023-11-04T01:35:56.077121+0000","last_clean":"2023-11-04T01:35:56.077121+0000","last_became_active":"2023-11-04T01:35:51.062838+0000","last_became_peered":"2023-11-04T01:35:51.062838+0000","last_unstale":"2023-11-04T01:35:56.077121+0000","last_undegraded":"2023-11-04T01:35:56.077121+0000","last_fullsized":"2023-11-04T01:35:56.077121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019259+0000","last_change":"2023-11-04T01:35:56.100298+0000","last_active":"2023-11-04T01:35:57.019259+0000","last_peered":"2023-11-04T01:35:57.019259+0000","last_clean":"2023-11-04T01:35:57.019259+0000","last_became_active":"2023-11-04T01:35:56.098558+0000","last_became_peered":"2023-11-04T01:35:56.098558+0000","last_unstale":"2023-11-04T01:35:57.019259+0000","last_undegraded":"2023-11-04T01:35:57.019259+0000","last_fullsized":"2023-11-04T01:35:57.019259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086341+0000","last_change":"2023-11-04T01:35:52.021071+0000","last_active":"2023-11-04T01:35:56.086341+0000","last_peered":"2023-11-04T01:35:56.086341+0000","last_clean":"2023-11-04T01:35:56.086341+0000","last_became_active":"2023-11-04T01:35:52.020796+0000","last_became_peered":"2023-11-04T01:35:52.020796+0000","last_unstale":"2023-11-04T01:35:56.086341+0000","last_undegraded":"2023-11-04T01:35:56.086341+0000","last_fullsized":"2023-11-04T01:35:56.086341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076204+0000","last_change":"2023-11-04T01:35:51.060835+0000","last_active":"2023-11-04T01:35:56.076204+0000","last_peered":"2023-11-04T01:35:56.076204+0000","last_clean":"2023-11-04T01:35:56.076204+0000","last_became_active":"2023-11-04T01:35:51.060542+0000","last_became_peered":"2023-11-04T01:35:51.060542+0000","last_unstale":"2023-11-04T01:35:56.076204+0000","last_undegraded":"2023-11-04T01:35:56.076204+0000","last_fullsized":"2023-11-04T01:35:56.076204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018863+0000","last_change":"2023-11-04T01:35:56.127539+0000","last_active":"2023-11-04T01:35:57.018863+0000","last_peered":"2023-11-04T01:35:57.018863+0000","last_clean":"2023-11-04T01:35:57.018863+0000","last_became_active":"2023-11-04T01:35:56.127142+0000","last_became_peered":"2023-11-04T01:35:56.127142+0000","last_unstale":"2023-11-04T01:35:57.018863+0000","last_undegraded":"2023-11-04T01:35:57.018863+0000","last_fullsized":"2023-11-04T01:35:57.018863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090298+0000","last_change":"2023-11-04T01:35:52.023442+0000","last_active":"2023-11-04T01:35:56.090298+0000","last_peered":"2023-11-04T01:35:56.090298+0000","last_clean":"2023-11-04T01:35:56.090298+0000","last_became_active":"2023-11-04T01:35:52.021531+0000","last_became_peered":"2023-11-04T01:35:52.021531+0000","last_unstale":"2023-11-04T01:35:56.090298+0000","last_undegraded":"2023-11-04T01:35:56.090298+0000","last_fullsized":"2023-11-04T01:35:56.090298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:00.840333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122631+0000","last_change":"2023-11-04T01:35:51.063175+0000","last_active":"2023-11-04T01:35:56.122631+0000","last_peered":"2023-11-04T01:35:56.122631+0000","last_clean":"2023-11-04T01:35:56.122631+0000","last_became_active":"2023-11-04T01:35:51.062652+0000","last_became_peered":"2023-11-04T01:35:51.062652+0000","last_unstale":"2023-11-04T01:35:56.122631+0000","last_undegraded":"2023-11-04T01:35:56.122631+0000","last_fullsized":"2023-11-04T01:35:56.122631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018125+0000","last_change":"2023-11-04T01:35:56.099302+0000","last_active":"2023-11-04T01:35:57.018125+0000","last_peered":"2023-11-04T01:35:57.018125+0000","last_clean":"2023-11-04T01:35:57.018125+0000","last_became_active":"2023-11-04T01:35:56.098724+0000","last_became_peered":"2023-11-04T01:35:56.098724+0000","last_unstale":"2023-11-04T01:35:57.018125+0000","last_undegraded":"2023-11-04T01:35:57.018125+0000","last_fullsized":"2023-11-04T01:35:57.018125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:35.534588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082788+0000","last_change":"2023-11-04T01:35:52.017381+0000","last_active":"2023-11-04T01:35:56.082788+0000","last_peered":"2023-11-04T01:35:56.082788+0000","last_clean":"2023-11-04T01:35:56.082788+0000","last_became_active":"2023-11-04T01:35:52.017133+0000","last_became_peered":"2023-11-04T01:35:52.017133+0000","last_unstale":"2023-11-04T01:35:56.082788+0000","last_undegraded":"2023-11-04T01:35:56.082788+0000","last_fullsized":"2023-11-04T01:35:56.082788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092559+0000","last_change":"2023-11-04T01:35:51.059644+0000","last_active":"2023-11-04T01:35:56.092559+0000","last_peered":"2023-11-04T01:35:56.092559+0000","last_clean":"2023-11-04T01:35:56.092559+0000","last_became_active":"2023-11-04T01:35:51.059424+0000","last_became_peered":"2023-11-04T01:35:51.059424+0000","last_unstale":"2023-11-04T01:35:56.092559+0000","last_undegraded":"2023-11-04T01:35:56.092559+0000","last_fullsized":"2023-11-04T01:35:56.092559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019002+0000","last_change":"2023-11-04T01:35:56.124305+0000","last_active":"2023-11-04T01:35:57.019002+0000","last_peered":"2023-11-04T01:35:57.019002+0000","last_clean":"2023-11-04T01:35:57.019002+0000","last_became_active":"2023-11-04T01:35:56.123918+0000","last_became_peered":"2023-11-04T01:35:56.123918+0000","last_unstale":"2023-11-04T01:35:57.019002+0000","last_undegraded":"2023-11-04T01:35:57.019002+0000","last_fullsized":"2023-11-04T01:35:57.019002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086137+0000","last_change":"2023-11-04T01:35:52.030623+0000","last_active":"2023-11-04T01:35:56.086137+0000","last_peered":"2023-11-04T01:35:56.086137+0000","last_clean":"2023-11-04T01:35:56.086137+0000","last_became_active":"2023-11-04T01:35:52.030382+0000","last_became_peered":"2023-11-04T01:35:52.030382+0000","last_unstale":"2023-11-04T01:35:56.086137+0000","last_undegraded":"2023-11-04T01:35:56.086137+0000","last_fullsized":"2023-11-04T01:35:56.086137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076551+0000","last_change":"2023-11-04T01:35:51.062101+0000","last_active":"2023-11-04T01:35:56.076551+0000","last_peered":"2023-11-04T01:35:56.076551+0000","last_clean":"2023-11-04T01:35:56.076551+0000","last_became_active":"2023-11-04T01:35:51.061786+0000","last_became_peered":"2023-11-04T01:35:51.061786+0000","last_unstale":"2023-11-04T01:35:56.076551+0000","last_undegraded":"2023-11-04T01:35:56.076551+0000","last_fullsized":"2023-11-04T01:35:56.076551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017814+0000","last_change":"2023-11-04T01:35:56.128280+0000","last_active":"2023-11-04T01:35:57.017814+0000","last_peered":"2023-11-04T01:35:57.017814+0000","last_clean":"2023-11-04T01:35:57.017814+0000","last_became_active":"2023-11-04T01:35:56.127952+0000","last_became_peered":"2023-11-04T01:35:56.127952+0000","last_unstale":"2023-11-04T01:35:57.017814+0000","last_undegraded":"2023-11-04T01:35:57.017814+0000","last_fullsized":"2023-11-04T01:35:57.017814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076313+0000","last_change":"2023-11-04T01:35:52.019477+0000","last_active":"2023-11-04T01:35:56.076313+0000","last_peered":"2023-11-04T01:35:56.076313+0000","last_clean":"2023-11-04T01:35:56.076313+0000","last_became_active":"2023-11-04T01:35:52.019211+0000","last_became_peered":"2023-11-04T01:35:52.019211+0000","last_unstale":"2023-11-04T01:35:56.076313+0000","last_undegraded":"2023-11-04T01:35:56.076313+0000","last_fullsized":"2023-11-04T01:35:56.076313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125013+0000","last_change":"2023-11-04T01:35:51.061973+0000","last_active":"2023-11-04T01:35:56.125013+0000","last_peered":"2023-11-04T01:35:56.125013+0000","last_clean":"2023-11-04T01:35:56.125013+0000","last_became_active":"2023-11-04T01:35:51.061720+0000","last_became_peered":"2023-11-04T01:35:51.061720+0000","last_unstale":"2023-11-04T01:35:56.125013+0000","last_undegraded":"2023-11-04T01:35:56.125013+0000","last_fullsized":"2023-11-04T01:35:56.125013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009703+0000","last_change":"2023-11-04T01:35:56.124910+0000","last_active":"2023-11-04T01:35:57.009703+0000","last_peered":"2023-11-04T01:35:57.009703+0000","last_clean":"2023-11-04T01:35:57.009703+0000","last_became_active":"2023-11-04T01:35:56.124304+0000","last_became_peered":"2023-11-04T01:35:56.124304+0000","last_unstale":"2023-11-04T01:35:57.009703+0000","last_undegraded":"2023-11-04T01:35:57.009703+0000","last_fullsized":"2023-11-04T01:35:57.009703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084153+0000","last_change":"2023-11-04T01:35:52.027735+0000","last_active":"2023-11-04T01:35:56.084153+0000","last_peered":"2023-11-04T01:35:56.084153+0000","last_clean":"2023-11-04T01:35:56.084153+0000","last_became_active":"2023-11-04T01:35:52.027488+0000","last_became_peered":"2023-11-04T01:35:52.027488+0000","last_unstale":"2023-11-04T01:35:56.084153+0000","last_undegraded":"2023-11-04T01:35:56.084153+0000","last_fullsized":"2023-11-04T01:35:56.084153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076787+0000","last_change":"2023-11-04T01:35:51.060397+0000","last_active":"2023-11-04T01:35:56.076787+0000","last_peered":"2023-11-04T01:35:56.076787+0000","last_clean":"2023-11-04T01:35:56.076787+0000","last_became_active":"2023-11-04T01:35:51.060049+0000","last_became_peered":"2023-11-04T01:35:51.060049+0000","last_unstale":"2023-11-04T01:35:56.076787+0000","last_undegraded":"2023-11-04T01:35:56.076787+0000","last_fullsized":"2023-11-04T01:35:56.076787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018210+0000","last_change":"2023-11-04T01:35:56.097613+0000","last_active":"2023-11-04T01:35:57.018210+0000","last_peered":"2023-11-04T01:35:57.018210+0000","last_clean":"2023-11-04T01:35:57.018210+0000","last_became_active":"2023-11-04T01:35:56.095376+0000","last_became_peered":"2023-11-04T01:35:56.095376+0000","last_unstale":"2023-11-04T01:35:57.018210+0000","last_undegraded":"2023-11-04T01:35:57.018210+0000","last_fullsized":"2023-11-04T01:35:57.018210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091651+0000","last_change":"2023-11-04T01:35:52.022798+0000","last_active":"2023-11-04T01:35:56.091651+0000","last_peered":"2023-11-04T01:35:56.091651+0000","last_clean":"2023-11-04T01:35:56.091651+0000","last_became_active":"2023-11-04T01:35:52.021870+0000","last_became_peered":"2023-11-04T01:35:52.021870+0000","last_unstale":"2023-11-04T01:35:56.091651+0000","last_undegraded":"2023-11-04T01:35:56.091651+0000","last_fullsized":"2023-11-04T01:35:56.091651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083334+0000","last_change":"2023-11-04T01:35:51.058423+0000","last_active":"2023-11-04T01:35:56.083334+0000","last_peered":"2023-11-04T01:35:56.083334+0000","last_clean":"2023-11-04T01:35:56.083334+0000","last_became_active":"2023-11-04T01:35:51.057183+0000","last_became_peered":"2023-11-04T01:35:51.057183+0000","last_unstale":"2023-11-04T01:35:56.083334+0000","last_undegraded":"2023-11-04T01:35:56.083334+0000","last_fullsized":"2023-11-04T01:35:56.083334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018340+0000","last_change":"2023-11-04T01:35:56.093770+0000","last_active":"2023-11-04T01:35:57.018340+0000","last_peered":"2023-11-04T01:35:57.018340+0000","last_clean":"2023-11-04T01:35:57.018340+0000","last_became_active":"2023-11-04T01:35:56.092689+0000","last_became_peered":"2023-11-04T01:35:56.092689+0000","last_unstale":"2023-11-04T01:35:57.018340+0000","last_undegraded":"2023-11-04T01:35:57.018340+0000","last_fullsized":"2023-11-04T01:35:57.018340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076140+0000","last_change":"2023-11-04T01:35:52.019825+0000","last_active":"2023-11-04T01:35:56.076140+0000","last_peered":"2023-11-04T01:35:56.076140+0000","last_clean":"2023-11-04T01:35:56.076140+0000","last_became_active":"2023-11-04T01:35:52.019580+0000","last_became_peered":"2023-11-04T01:35:52.019580+0000","last_unstale":"2023-11-04T01:35:56.076140+0000","last_undegraded":"2023-11-04T01:35:56.076140+0000","last_fullsized":"2023-11-04T01:35:56.076140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090217+0000","last_change":"2023-11-04T01:35:51.058035+0000","last_active":"2023-11-04T01:35:56.090217+0000","last_peered":"2023-11-04T01:35:56.090217+0000","last_clean":"2023-11-04T01:35:56.090217+0000","last_became_active":"2023-11-04T01:35:51.057768+0000","last_became_peered":"2023-11-04T01:35:51.057768+0000","last_unstale":"2023-11-04T01:35:56.090217+0000","last_undegraded":"2023-11-04T01:35:56.090217+0000","last_fullsized":"2023-11-04T01:35:56.090217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018891+0000","last_change":"2023-11-04T01:35:56.094677+0000","last_active":"2023-11-04T01:35:57.018891+0000","last_peered":"2023-11-04T01:35:57.018891+0000","last_clean":"2023-11-04T01:35:57.018891+0000","last_became_active":"2023-11-04T01:35:56.094348+0000","last_became_peered":"2023-11-04T01:35:56.094348+0000","last_unstale":"2023-11-04T01:35:57.018891+0000","last_undegraded":"2023-11-04T01:35:57.018891+0000","last_fullsized":"2023-11-04T01:35:57.018891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082079+0000","last_change":"2023-11-04T01:35:52.020101+0000","last_active":"2023-11-04T01:35:56.082079+0000","last_peered":"2023-11-04T01:35:56.082079+0000","last_clean":"2023-11-04T01:35:56.082079+0000","last_became_active":"2023-11-04T01:35:52.019047+0000","last_became_peered":"2023-11-04T01:35:52.019047+0000","last_unstale":"2023-11-04T01:35:56.082079+0000","last_undegraded":"2023-11-04T01:35:56.082079+0000","last_fullsized":"2023-11-04T01:35:56.082079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:34.129560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122640+0000","last_change":"2023-11-04T01:35:51.063768+0000","last_active":"2023-11-04T01:35:56.122640+0000","last_peered":"2023-11-04T01:35:56.122640+0000","last_clean":"2023-11-04T01:35:56.122640+0000","last_became_active":"2023-11-04T01:35:51.063462+0000","last_became_peered":"2023-11-04T01:35:51.063462+0000","last_unstale":"2023-11-04T01:35:56.122640+0000","last_undegraded":"2023-11-04T01:35:56.122640+0000","last_fullsized":"2023-11-04T01:35:56.122640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010123+0000","last_change":"2023-11-04T01:35:56.124045+0000","last_active":"2023-11-04T01:35:57.010123+0000","last_peered":"2023-11-04T01:35:57.010123+0000","last_clean":"2023-11-04T01:35:57.010123+0000","last_became_active":"2023-11-04T01:35:56.123678+0000","last_became_peered":"2023-11-04T01:35:56.123678+0000","last_unstale":"2023-11-04T01:35:57.010123+0000","last_undegraded":"2023-11-04T01:35:57.010123+0000","last_fullsized":"2023-11-04T01:35:57.010123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:19.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085654+0000","last_change":"2023-11-04T01:35:52.029814+0000","last_active":"2023-11-04T01:35:56.085654+0000","last_peered":"2023-11-04T01:35:56.085654+0000","last_clean":"2023-11-04T01:35:56.085654+0000","last_became_active":"2023-11-04T01:35:52.029549+0000","last_became_peered":"2023-11-04T01:35:52.029549+0000","last_unstale":"2023-11-04T01:35:56.085654+0000","last_undegraded":"2023-11-04T01:35:56.085654+0000","last_fullsized":"2023-11-04T01:35:56.085654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083481+0000","last_change":"2023-11-04T01:35:51.062041+0000","last_active":"2023-11-04T01:35:56.083481+0000","last_peered":"2023-11-04T01:35:56.083481+0000","last_clean":"2023-11-04T01:35:56.083481+0000","last_became_active":"2023-11-04T01:35:51.061551+0000","last_became_peered":"2023-11-04T01:35:51.061551+0000","last_unstale":"2023-11-04T01:35:56.083481+0000","last_undegraded":"2023-11-04T01:35:56.083481+0000","last_fullsized":"2023-11-04T01:35:56.083481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122962+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:35:56.122962+0000","last_peered":"2023-11-04T01:35:56.122962+0000","last_clean":"2023-11-04T01:35:56.122962+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:35:56.122962+0000","last_undegraded":"2023-11-04T01:35:56.122962+0000","last_fullsized":"2023-11-04T01:35:56.122962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010896+0000","last_change":"2023-11-04T01:35:56.126128+0000","last_active":"2023-11-04T01:35:57.010896+0000","last_peered":"2023-11-04T01:35:57.010896+0000","last_clean":"2023-11-04T01:35:57.010896+0000","last_became_active":"2023-11-04T01:35:56.125726+0000","last_became_peered":"2023-11-04T01:35:56.125726+0000","last_unstale":"2023-11-04T01:35:57.010896+0000","last_undegraded":"2023-11-04T01:35:57.010896+0000","last_fullsized":"2023-11-04T01:35:57.010896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123390+0000","last_change":"2023-11-04T01:35:52.030372+0000","last_active":"2023-11-04T01:35:56.123390+0000","last_peered":"2023-11-04T01:35:56.123390+0000","last_clean":"2023-11-04T01:35:56.123390+0000","last_became_active":"2023-11-04T01:35:52.029960+0000","last_became_peered":"2023-11-04T01:35:52.029960+0000","last_unstale":"2023-11-04T01:35:56.123390+0000","last_undegraded":"2023-11-04T01:35:56.123390+0000","last_fullsized":"2023-11-04T01:35:56.123390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090234+0000","last_change":"2023-11-04T01:35:51.059763+0000","last_active":"2023-11-04T01:35:56.090234+0000","last_peered":"2023-11-04T01:35:56.090234+0000","last_clean":"2023-11-04T01:35:56.090234+0000","last_became_active":"2023-11-04T01:35:51.059484+0000","last_became_peered":"2023-11-04T01:35:51.059484+0000","last_unstale":"2023-11-04T01:35:56.090234+0000","last_undegraded":"2023-11-04T01:35:56.090234+0000","last_fullsized":"2023-11-04T01:35:56.090234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:04.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010432+0000","last_change":"2023-11-04T01:35:56.123907+0000","last_active":"2023-11-04T01:35:57.010432+0000","last_peered":"2023-11-04T01:35:57.010432+0000","last_clean":"2023-11-04T01:35:57.010432+0000","last_became_active":"2023-11-04T01:35:56.123459+0000","last_became_peered":"2023-11-04T01:35:56.123459+0000","last_unstale":"2023-11-04T01:35:57.010432+0000","last_undegraded":"2023-11-04T01:35:57.010432+0000","last_fullsized":"2023-11-04T01:35:57.010432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083693+0000","last_change":"2023-11-04T01:35:52.024998+0000","last_active":"2023-11-04T01:35:56.083693+0000","last_peered":"2023-11-04T01:35:56.083693+0000","last_clean":"2023-11-04T01:35:56.083693+0000","last_became_active":"2023-11-04T01:35:52.024327+0000","last_became_peered":"2023-11-04T01:35:52.024327+0000","last_unstale":"2023-11-04T01:35:56.083693+0000","last_undegraded":"2023-11-04T01:35:56.083693+0000","last_fullsized":"2023-11-04T01:35:56.083693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076586+0000","last_change":"2023-11-04T01:35:51.059209+0000","last_active":"2023-11-04T01:35:56.076586+0000","last_peered":"2023-11-04T01:35:56.076586+0000","last_clean":"2023-11-04T01:35:56.076586+0000","last_became_active":"2023-11-04T01:35:51.058773+0000","last_became_peered":"2023-11-04T01:35:51.058773+0000","last_unstale":"2023-11-04T01:35:56.076586+0000","last_undegraded":"2023-11-04T01:35:56.076586+0000","last_fullsized":"2023-11-04T01:35:56.076586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009806+0000","last_change":"2023-11-04T01:35:56.094757+0000","last_active":"2023-11-04T01:35:57.009806+0000","last_peered":"2023-11-04T01:35:57.009806+0000","last_clean":"2023-11-04T01:35:57.009806+0000","last_became_active":"2023-11-04T01:35:56.094419+0000","last_became_peered":"2023-11-04T01:35:56.094419+0000","last_unstale":"2023-11-04T01:35:57.009806+0000","last_undegraded":"2023-11-04T01:35:57.009806+0000","last_fullsized":"2023-11-04T01:35:57.009806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125099+0000","last_change":"2023-11-04T01:35:52.032768+0000","last_active":"2023-11-04T01:35:56.125099+0000","last_peered":"2023-11-04T01:35:56.125099+0000","last_clean":"2023-11-04T01:35:56.125099+0000","last_became_active":"2023-11-04T01:35:52.031366+0000","last_became_peered":"2023-11-04T01:35:52.031366+0000","last_unstale":"2023-11-04T01:35:56.125099+0000","last_undegraded":"2023-11-04T01:35:56.125099+0000","last_fullsized":"2023-11-04T01:35:56.125099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090446+0000","last_change":"2023-11-04T01:35:51.058795+0000","last_active":"2023-11-04T01:35:56.090446+0000","last_peered":"2023-11-04T01:35:56.090446+0000","last_clean":"2023-11-04T01:35:56.090446+0000","last_became_active":"2023-11-04T01:35:51.058543+0000","last_became_peered":"2023-11-04T01:35:51.058543+0000","last_unstale":"2023-11-04T01:35:56.090446+0000","last_undegraded":"2023-11-04T01:35:56.090446+0000","last_fullsized":"2023-11-04T01:35:56.090446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017774+0000","last_change":"2023-11-04T01:35:56.124194+0000","last_active":"2023-11-04T01:35:57.017774+0000","last_peered":"2023-11-04T01:35:57.017774+0000","last_clean":"2023-11-04T01:35:57.017774+0000","last_became_active":"2023-11-04T01:35:56.123794+0000","last_became_peered":"2023-11-04T01:35:56.123794+0000","last_unstale":"2023-11-04T01:35:57.017774+0000","last_undegraded":"2023-11-04T01:35:57.017774+0000","last_fullsized":"2023-11-04T01:35:57.017774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124176+0000","last_change":"2023-11-04T01:35:52.028162+0000","last_active":"2023-11-04T01:35:56.124176+0000","last_peered":"2023-11-04T01:35:56.124176+0000","last_clean":"2023-11-04T01:35:56.124176+0000","last_became_active":"2023-11-04T01:35:52.026689+0000","last_became_peered":"2023-11-04T01:35:52.026689+0000","last_unstale":"2023-11-04T01:35:56.124176+0000","last_undegraded":"2023-11-04T01:35:56.124176+0000","last_fullsized":"2023-11-04T01:35:56.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088966+0000","last_change":"2023-11-04T01:35:51.052770+0000","last_active":"2023-11-04T01:35:56.088966+0000","last_peered":"2023-11-04T01:35:56.088966+0000","last_clean":"2023-11-04T01:35:56.088966+0000","last_became_active":"2023-11-04T01:35:51.052476+0000","last_became_peered":"2023-11-04T01:35:51.052476+0000","last_unstale":"2023-11-04T01:35:56.088966+0000","last_undegraded":"2023-11-04T01:35:56.088966+0000","last_fullsized":"2023-11-04T01:35:56.088966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018926+0000","last_change":"2023-11-04T01:35:56.099158+0000","last_active":"2023-11-04T01:35:57.018926+0000","last_peered":"2023-11-04T01:35:57.018926+0000","last_clean":"2023-11-04T01:35:57.018926+0000","last_became_active":"2023-11-04T01:35:56.098426+0000","last_became_peered":"2023-11-04T01:35:56.098426+0000","last_unstale":"2023-11-04T01:35:57.018926+0000","last_undegraded":"2023-11-04T01:35:57.018926+0000","last_fullsized":"2023-11-04T01:35:57.018926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123073+0000","last_change":"2023-11-04T01:35:52.027681+0000","last_active":"2023-11-04T01:35:56.123073+0000","last_peered":"2023-11-04T01:35:56.123073+0000","last_clean":"2023-11-04T01:35:56.123073+0000","last_became_active":"2023-11-04T01:35:52.027391+0000","last_became_peered":"2023-11-04T01:35:52.027391+0000","last_unstale":"2023-11-04T01:35:56.123073+0000","last_undegraded":"2023-11-04T01:35:56.123073+0000","last_fullsized":"2023-11-04T01:35:56.123073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088329+0000","last_change":"2023-11-04T01:35:51.055489+0000","last_active":"2023-11-04T01:35:56.088329+0000","last_peered":"2023-11-04T01:35:56.088329+0000","last_clean":"2023-11-04T01:35:56.088329+0000","last_became_active":"2023-11-04T01:35:51.055183+0000","last_became_peered":"2023-11-04T01:35:51.055183+0000","last_unstale":"2023-11-04T01:35:56.088329+0000","last_undegraded":"2023-11-04T01:35:56.088329+0000","last_fullsized":"2023-11-04T01:35:56.088329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010094+0000","last_change":"2023-11-04T01:35:56.093191+0000","last_active":"2023-11-04T01:35:57.010094+0000","last_peered":"2023-11-04T01:35:57.010094+0000","last_clean":"2023-11-04T01:35:57.010094+0000","last_became_active":"2023-11-04T01:35:56.092827+0000","last_became_peered":"2023-11-04T01:35:56.092827+0000","last_unstale":"2023-11-04T01:35:57.010094+0000","last_undegraded":"2023-11-04T01:35:57.010094+0000","last_fullsized":"2023-11-04T01:35:57.010094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090655+0000","last_change":"2023-11-04T01:35:52.030977+0000","last_active":"2023-11-04T01:35:56.090655+0000","last_peered":"2023-11-04T01:35:56.090655+0000","last_clean":"2023-11-04T01:35:56.090655+0000","last_became_active":"2023-11-04T01:35:52.030636+0000","last_became_peered":"2023-11-04T01:35:52.030636+0000","last_unstale":"2023-11-04T01:35:56.090655+0000","last_undegraded":"2023-11-04T01:35:56.090655+0000","last_fullsized":"2023-11-04T01:35:56.090655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090474+0000","last_change":"2023-11-04T01:35:51.053345+0000","last_active":"2023-11-04T01:35:56.090474+0000","last_peered":"2023-11-04T01:35:56.090474+0000","last_clean":"2023-11-04T01:35:56.090474+0000","last_became_active":"2023-11-04T01:35:51.053075+0000","last_became_peered":"2023-11-04T01:35:51.053075+0000","last_unstale":"2023-11-04T01:35:56.090474+0000","last_undegraded":"2023-11-04T01:35:56.090474+0000","last_fullsized":"2023-11-04T01:35:56.090474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019088+0000","last_change":"2023-11-04T01:35:56.127666+0000","last_active":"2023-11-04T01:35:57.019088+0000","last_peered":"2023-11-04T01:35:57.019088+0000","last_clean":"2023-11-04T01:35:57.019088+0000","last_became_active":"2023-11-04T01:35:56.127269+0000","last_became_peered":"2023-11-04T01:35:56.127269+0000","last_unstale":"2023-11-04T01:35:57.019088+0000","last_undegraded":"2023-11-04T01:35:57.019088+0000","last_fullsized":"2023-11-04T01:35:57.019088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:21.238628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123188+0000","last_change":"2023-11-04T01:35:52.029517+0000","last_active":"2023-11-04T01:35:56.123188+0000","last_peered":"2023-11-04T01:35:56.123188+0000","last_clean":"2023-11-04T01:35:56.123188+0000","last_became_active":"2023-11-04T01:35:52.028417+0000","last_became_peered":"2023-11-04T01:35:52.028417+0000","last_unstale":"2023-11-04T01:35:56.123188+0000","last_undegraded":"2023-11-04T01:35:56.123188+0000","last_fullsized":"2023-11-04T01:35:56.123188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083242+0000","last_change":"2023-11-04T01:35:51.060407+0000","last_active":"2023-11-04T01:35:56.083242+0000","last_peered":"2023-11-04T01:35:56.083242+0000","last_clean":"2023-11-04T01:35:56.083242+0000","last_became_active":"2023-11-04T01:35:51.059918+0000","last_became_peered":"2023-11-04T01:35:51.059918+0000","last_unstale":"2023-11-04T01:35:56.083242+0000","last_undegraded":"2023-11-04T01:35:56.083242+0000","last_fullsized":"2023-11-04T01:35:56.083242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018639+0000","last_change":"2023-11-04T01:35:56.124269+0000","last_active":"2023-11-04T01:35:57.018639+0000","last_peered":"2023-11-04T01:35:57.018639+0000","last_clean":"2023-11-04T01:35:57.018639+0000","last_became_active":"2023-11-04T01:35:56.123412+0000","last_became_peered":"2023-11-04T01:35:56.123412+0000","last_unstale":"2023-11-04T01:35:57.018639+0000","last_undegraded":"2023-11-04T01:35:57.018639+0000","last_fullsized":"2023-11-04T01:35:57.018639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:48.271158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082167+0000","last_change":"2023-11-04T01:35:52.023713+0000","last_active":"2023-11-04T01:35:56.082167+0000","last_peered":"2023-11-04T01:35:56.082167+0000","last_clean":"2023-11-04T01:35:56.082167+0000","last_became_active":"2023-11-04T01:35:52.023417+0000","last_became_peered":"2023-11-04T01:35:52.023417+0000","last_unstale":"2023-11-04T01:35:56.082167+0000","last_undegraded":"2023-11-04T01:35:56.082167+0000","last_fullsized":"2023-11-04T01:35:56.082167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083357+0000","last_change":"2023-11-04T01:35:51.051189+0000","last_active":"2023-11-04T01:35:56.083357+0000","last_peered":"2023-11-04T01:35:56.083357+0000","last_clean":"2023-11-04T01:35:56.083357+0000","last_became_active":"2023-11-04T01:35:51.050893+0000","last_became_peered":"2023-11-04T01:35:51.050893+0000","last_unstale":"2023-11-04T01:35:56.083357+0000","last_undegraded":"2023-11-04T01:35:56.083357+0000","last_fullsized":"2023-11-04T01:35:56.083357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018804+0000","last_change":"2023-11-04T01:35:56.126113+0000","last_active":"2023-11-04T01:35:57.018804+0000","last_peered":"2023-11-04T01:35:57.018804+0000","last_clean":"2023-11-04T01:35:57.018804+0000","last_became_active":"2023-11-04T01:35:56.125732+0000","last_became_peered":"2023-11-04T01:35:56.125732+0000","last_unstale":"2023-11-04T01:35:57.018804+0000","last_undegraded":"2023-11-04T01:35:57.018804+0000","last_fullsized":"2023-11-04T01:35:57.018804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123721+0000","last_change":"2023-11-04T01:35:52.028845+0000","last_active":"2023-11-04T01:35:56.123721+0000","last_peered":"2023-11-04T01:35:56.123721+0000","last_clean":"2023-11-04T01:35:56.123721+0000","last_became_active":"2023-11-04T01:35:52.026621+0000","last_became_peered":"2023-11-04T01:35:52.026621+0000","last_unstale":"2023-11-04T01:35:56.123721+0000","last_undegraded":"2023-11-04T01:35:56.123721+0000","last_fullsized":"2023-11-04T01:35:56.123721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:00.959402+0000","last_change":"2023-11-04T01:35:51.059172+0000","last_active":"2023-11-04T01:36:00.959402+0000","last_peered":"2023-11-04T01:36:00.959402+0000","last_clean":"2023-11-04T01:36:00.959402+0000","last_became_active":"2023-11-04T01:35:51.058907+0000","last_became_peered":"2023-11-04T01:35:51.058907+0000","last_unstale":"2023-11-04T01:36:00.959402+0000","last_undegraded":"2023-11-04T01:36:00.959402+0000","last_fullsized":"2023-11-04T01:36:00.959402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018253+0000","last_change":"2023-11-04T01:35:56.093416+0000","last_active":"2023-11-04T01:35:57.018253+0000","last_peered":"2023-11-04T01:35:57.018253+0000","last_clean":"2023-11-04T01:35:57.018253+0000","last_became_active":"2023-11-04T01:35:56.092225+0000","last_became_peered":"2023-11-04T01:35:56.092225+0000","last_unstale":"2023-11-04T01:35:57.018253+0000","last_undegraded":"2023-11-04T01:35:57.018253+0000","last_fullsized":"2023-11-04T01:35:57.018253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090174+0000","last_change":"2023-11-04T01:35:52.020324+0000","last_active":"2023-11-04T01:35:56.090174+0000","last_peered":"2023-11-04T01:35:56.090174+0000","last_clean":"2023-11-04T01:35:56.090174+0000","last_became_active":"2023-11-04T01:35:52.020031+0000","last_became_peered":"2023-11-04T01:35:52.020031+0000","last_unstale":"2023-11-04T01:35:56.090174+0000","last_undegraded":"2023-11-04T01:35:56.090174+0000","last_fullsized":"2023-11-04T01:35:56.090174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:14.232121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076494+0000","last_change":"2023-11-04T01:35:51.063507+0000","last_active":"2023-11-04T01:35:56.076494+0000","last_peered":"2023-11-04T01:35:56.076494+0000","last_clean":"2023-11-04T01:35:56.076494+0000","last_became_active":"2023-11-04T01:35:51.062548+0000","last_became_peered":"2023-11-04T01:35:51.062548+0000","last_unstale":"2023-11-04T01:35:56.076494+0000","last_undegraded":"2023-11-04T01:35:56.076494+0000","last_fullsized":"2023-11-04T01:35:56.076494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019702+0000","last_change":"2023-11-04T01:35:56.100663+0000","last_active":"2023-11-04T01:35:57.019702+0000","last_peered":"2023-11-04T01:35:57.019702+0000","last_clean":"2023-11-04T01:35:57.019702+0000","last_became_active":"2023-11-04T01:35:56.099543+0000","last_became_peered":"2023-11-04T01:35:56.099543+0000","last_unstale":"2023-11-04T01:35:57.019702+0000","last_undegraded":"2023-11-04T01:35:57.019702+0000","last_fullsized":"2023-11-04T01:35:57.019702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082599+0000","last_change":"2023-11-04T01:35:52.028518+0000","last_active":"2023-11-04T01:35:56.082599+0000","last_peered":"2023-11-04T01:35:56.082599+0000","last_clean":"2023-11-04T01:35:56.082599+0000","last_became_active":"2023-11-04T01:35:52.028243+0000","last_became_peered":"2023-11-04T01:35:52.028243+0000","last_unstale":"2023-11-04T01:35:56.082599+0000","last_undegraded":"2023-11-04T01:35:56.082599+0000","last_fullsized":"2023-11-04T01:35:56.082599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083875+0000","last_change":"2023-11-04T01:35:51.064570+0000","last_active":"2023-11-04T01:35:56.083875+0000","last_peered":"2023-11-04T01:35:56.083875+0000","last_clean":"2023-11-04T01:35:56.083875+0000","last_became_active":"2023-11-04T01:35:51.064236+0000","last_became_peered":"2023-11-04T01:35:51.064236+0000","last_unstale":"2023-11-04T01:35:56.083875+0000","last_undegraded":"2023-11-04T01:35:56.083875+0000","last_fullsized":"2023-11-04T01:35:56.083875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:58.299230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017951+0000","last_change":"2023-11-04T01:35:56.096122+0000","last_active":"2023-11-04T01:35:57.017951+0000","last_peered":"2023-11-04T01:35:57.017951+0000","last_clean":"2023-11-04T01:35:57.017951+0000","last_became_active":"2023-11-04T01:35:56.095763+0000","last_became_peered":"2023-11-04T01:35:56.095763+0000","last_unstale":"2023-11-04T01:35:57.017951+0000","last_undegraded":"2023-11-04T01:35:57.017951+0000","last_fullsized":"2023-11-04T01:35:57.017951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083789+0000","last_change":"2023-11-04T01:35:52.033716+0000","last_active":"2023-11-04T01:35:56.083789+0000","last_peered":"2023-11-04T01:35:56.083789+0000","last_clean":"2023-11-04T01:35:56.083789+0000","last_became_active":"2023-11-04T01:35:52.033366+0000","last_became_peered":"2023-11-04T01:35:52.033366+0000","last_unstale":"2023-11-04T01:35:56.083789+0000","last_undegraded":"2023-11-04T01:35:56.083789+0000","last_fullsized":"2023-11-04T01:35:56.083789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092435+0000","last_change":"2023-11-04T01:35:51.061737+0000","last_active":"2023-11-04T01:35:56.092435+0000","last_peered":"2023-11-04T01:35:56.092435+0000","last_clean":"2023-11-04T01:35:56.092435+0000","last_became_active":"2023-11-04T01:35:51.061470+0000","last_became_peered":"2023-11-04T01:35:51.061470+0000","last_unstale":"2023-11-04T01:35:56.092435+0000","last_undegraded":"2023-11-04T01:35:56.092435+0000","last_fullsized":"2023-11-04T01:35:56.092435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018337+0000","last_change":"2023-11-04T01:35:56.127670+0000","last_active":"2023-11-04T01:35:57.018337+0000","last_peered":"2023-11-04T01:35:57.018337+0000","last_clean":"2023-11-04T01:35:57.018337+0000","last_became_active":"2023-11-04T01:35:56.127256+0000","last_became_peered":"2023-11-04T01:35:56.127256+0000","last_unstale":"2023-11-04T01:35:57.018337+0000","last_undegraded":"2023-11-04T01:35:57.018337+0000","last_fullsized":"2023-11-04T01:35:57.018337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:16.877043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010009+0000","last_change":"2023-11-04T01:35:56.125573+0000","last_active":"2023-11-04T01:35:57.010009+0000","last_peered":"2023-11-04T01:35:57.010009+0000","last_clean":"2023-11-04T01:35:57.010009+0000","last_became_active":"2023-11-04T01:35:56.125207+0000","last_became_peered":"2023-11-04T01:35:56.125207+0000","last_unstale":"2023-11-04T01:35:57.010009+0000","last_undegraded":"2023-11-04T01:35:57.010009+0000","last_fullsized":"2023-11-04T01:35:57.010009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076102+0000","last_change":"2023-11-04T01:35:52.023725+0000","last_active":"2023-11-04T01:35:56.076102+0000","last_peered":"2023-11-04T01:35:56.076102+0000","last_clean":"2023-11-04T01:35:56.076102+0000","last_became_active":"2023-11-04T01:35:52.023469+0000","last_became_peered":"2023-11-04T01:35:52.023469+0000","last_unstale":"2023-11-04T01:35:56.076102+0000","last_undegraded":"2023-11-04T01:35:56.076102+0000","last_fullsized":"2023-11-04T01:35:56.076102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082991+0000","last_change":"2023-11-04T01:35:51.059113+0000","last_active":"2023-11-04T01:35:56.082991+0000","last_peered":"2023-11-04T01:35:56.082991+0000","last_clean":"2023-11-04T01:35:56.082991+0000","last_became_active":"2023-11-04T01:35:51.058837+0000","last_became_peered":"2023-11-04T01:35:51.058837+0000","last_unstale":"2023-11-04T01:35:56.082991+0000","last_undegraded":"2023-11-04T01:35:56.082991+0000","last_fullsized":"2023-11-04T01:35:56.082991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010915+0000","last_change":"2023-11-04T01:35:56.102617+0000","last_active":"2023-11-04T01:35:57.010915+0000","last_peered":"2023-11-04T01:35:57.010915+0000","last_clean":"2023-11-04T01:35:57.010915+0000","last_became_active":"2023-11-04T01:35:56.102162+0000","last_became_peered":"2023-11-04T01:35:56.102162+0000","last_unstale":"2023-11-04T01:35:57.010915+0000","last_undegraded":"2023-11-04T01:35:57.010915+0000","last_fullsized":"2023-11-04T01:35:57.010915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086285+0000","last_change":"2023-11-04T01:35:52.031363+0000","last_active":"2023-11-04T01:35:56.086285+0000","last_peered":"2023-11-04T01:35:56.086285+0000","last_clean":"2023-11-04T01:35:56.086285+0000","last_became_active":"2023-11-04T01:35:52.031088+0000","last_became_peered":"2023-11-04T01:35:52.031088+0000","last_unstale":"2023-11-04T01:35:56.086285+0000","last_undegraded":"2023-11-04T01:35:56.086285+0000","last_fullsized":"2023-11-04T01:35:56.086285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085566+0000","last_change":"2023-11-04T01:35:51.065071+0000","last_active":"2023-11-04T01:35:56.085566+0000","last_peered":"2023-11-04T01:35:56.085566+0000","last_clean":"2023-11-04T01:35:56.085566+0000","last_became_active":"2023-11-04T01:35:51.064790+0000","last_became_peered":"2023-11-04T01:35:51.064790+0000","last_unstale":"2023-11-04T01:35:56.085566+0000","last_undegraded":"2023-11-04T01:35:56.085566+0000","last_fullsized":"2023-11-04T01:35:56.085566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090769+0000","last_change":"2023-11-04T01:35:51.057559+0000","last_active":"2023-11-04T01:35:56.090769+0000","last_peered":"2023-11-04T01:35:56.090769+0000","last_clean":"2023-11-04T01:35:56.090769+0000","last_became_active":"2023-11-04T01:35:51.056993+0000","last_became_peered":"2023-11-04T01:35:51.056993+0000","last_unstale":"2023-11-04T01:35:56.090769+0000","last_undegraded":"2023-11-04T01:35:56.090769+0000","last_fullsized":"2023-11-04T01:35:56.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082667+0000","last_change":"2023-11-04T01:35:52.022126+0000","last_active":"2023-11-04T01:35:56.082667+0000","last_peered":"2023-11-04T01:35:56.082667+0000","last_clean":"2023-11-04T01:35:56.082667+0000","last_became_active":"2023-11-04T01:35:52.021875+0000","last_became_peered":"2023-11-04T01:35:52.021875+0000","last_unstale":"2023-11-04T01:35:56.082667+0000","last_undegraded":"2023-11-04T01:35:56.082667+0000","last_fullsized":"2023-11-04T01:35:56.082667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010633+0000","last_change":"2023-11-04T01:35:56.099022+0000","last_active":"2023-11-04T01:35:57.010633+0000","last_peered":"2023-11-04T01:35:57.010633+0000","last_clean":"2023-11-04T01:35:57.010633+0000","last_became_active":"2023-11-04T01:35:56.098634+0000","last_became_peered":"2023-11-04T01:35:56.098634+0000","last_unstale":"2023-11-04T01:35:57.010633+0000","last_undegraded":"2023-11-04T01:35:57.010633+0000","last_fullsized":"2023-11-04T01:35:57.010633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:18.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086027+0000","last_change":"2023-11-04T01:35:51.061727+0000","last_active":"2023-11-04T01:35:56.086027+0000","last_peered":"2023-11-04T01:35:56.086027+0000","last_clean":"2023-11-04T01:35:56.086027+0000","last_became_active":"2023-11-04T01:35:51.061215+0000","last_became_peered":"2023-11-04T01:35:51.061215+0000","last_unstale":"2023-11-04T01:35:56.086027+0000","last_undegraded":"2023-11-04T01:35:56.086027+0000","last_fullsized":"2023-11-04T01:35:56.086027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090923+0000","last_change":"2023-11-04T01:35:52.020181+0000","last_active":"2023-11-04T01:35:56.090923+0000","last_peered":"2023-11-04T01:35:56.090923+0000","last_clean":"2023-11-04T01:35:56.090923+0000","last_became_active":"2023-11-04T01:35:52.019904+0000","last_became_peered":"2023-11-04T01:35:52.019904+0000","last_unstale":"2023-11-04T01:35:56.090923+0000","last_undegraded":"2023-11-04T01:35:56.090923+0000","last_fullsized":"2023-11-04T01:35:56.090923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018207+0000","last_change":"2023-11-04T01:35:56.096018+0000","last_active":"2023-11-04T01:35:57.018207+0000","last_peered":"2023-11-04T01:35:57.018207+0000","last_clean":"2023-11-04T01:35:57.018207+0000","last_became_active":"2023-11-04T01:35:56.094855+0000","last_became_peered":"2023-11-04T01:35:56.094855+0000","last_unstale":"2023-11-04T01:35:57.018207+0000","last_undegraded":"2023-11-04T01:35:57.018207+0000","last_fullsized":"2023-11-04T01:35:57.018207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:11.437390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090519+0000","last_change":"2023-11-04T01:35:52.031578+0000","last_active":"2023-11-04T01:35:56.090519+0000","last_peered":"2023-11-04T01:35:56.090519+0000","last_clean":"2023-11-04T01:35:56.090519+0000","last_became_active":"2023-11-04T01:35:52.031324+0000","last_became_peered":"2023-11-04T01:35:52.031324+0000","last_unstale":"2023-11-04T01:35:56.090519+0000","last_undegraded":"2023-11-04T01:35:56.090519+0000","last_fullsized":"2023-11-04T01:35:56.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090127+0000","last_change":"2023-11-04T01:35:52.021615+0000","last_active":"2023-11-04T01:35:56.090127+0000","last_peered":"2023-11-04T01:35:56.090127+0000","last_clean":"2023-11-04T01:35:56.090127+0000","last_became_active":"2023-11-04T01:35:52.021344+0000","last_became_peered":"2023-11-04T01:35:52.021344+0000","last_unstale":"2023-11-04T01:35:56.090127+0000","last_undegraded":"2023-11-04T01:35:56.090127+0000","last_fullsized":"2023-11-04T01:35:56.090127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083431+0000","last_change":"2023-11-04T01:35:52.027223+0000","last_active":"2023-11-04T01:35:56.083431+0000","last_peered":"2023-11-04T01:35:56.083431+0000","last_clean":"2023-11-04T01:35:56.083431+0000","last_became_active":"2023-11-04T01:35:52.026929+0000","last_became_peered":"2023-11-04T01:35:52.026929+0000","last_unstale":"2023-11-04T01:35:56.083431+0000","last_undegraded":"2023-11-04T01:35:56.083431+0000","last_fullsized":"2023-11-04T01:35:56.083431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082587+0000","last_change":"2023-11-04T01:35:52.023823+0000","last_active":"2023-11-04T01:35:56.082587+0000","last_peered":"2023-11-04T01:35:56.082587+0000","last_clean":"2023-11-04T01:35:56.082587+0000","last_became_active":"2023-11-04T01:35:52.023555+0000","last_became_peered":"2023-11-04T01:35:52.023555+0000","last_unstale":"2023-11-04T01:35:56.082587+0000","last_undegraded":"2023-11-04T01:35:56.082587+0000","last_fullsized":"2023-11-04T01:35:56.082587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086368+0000","last_change":"2023-11-04T01:35:52.023538+0000","last_active":"2023-11-04T01:35:56.086368+0000","last_peered":"2023-11-04T01:35:56.086368+0000","last_clean":"2023-11-04T01:35:56.086368+0000","last_became_active":"2023-11-04T01:35:52.023231+0000","last_became_peered":"2023-11-04T01:35:52.023231+0000","last_unstale":"2023-11-04T01:35:56.086368+0000","last_undegraded":"2023-11-04T01:35:56.086368+0000","last_fullsized":"2023-11-04T01:35:56.086368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076403+0000","last_change":"2023-11-04T01:35:52.020500+0000","last_active":"2023-11-04T01:35:56.076403+0000","last_peered":"2023-11-04T01:35:56.076403+0000","last_clean":"2023-11-04T01:35:56.076403+0000","last_became_active":"2023-11-04T01:35:52.020215+0000","last_became_peered":"2023-11-04T01:35:52.020215+0000","last_unstale":"2023-11-04T01:35:56.076403+0000","last_undegraded":"2023-11-04T01:35:56.076403+0000","last_fullsized":"2023-11-04T01:35:56.076403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092296+0000","last_change":"2023-11-04T01:35:52.032684+0000","last_active":"2023-11-04T01:35:56.092296+0000","last_peered":"2023-11-04T01:35:56.092296+0000","last_clean":"2023-11-04T01:35:56.092296+0000","last_became_active":"2023-11-04T01:35:52.032419+0000","last_became_peered":"2023-11-04T01:35:52.032419+0000","last_unstale":"2023-11-04T01:35:56.092296+0000","last_undegraded":"2023-11-04T01:35:56.092296+0000","last_fullsized":"2023-11-04T01:35:56.092296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086117+0000","last_change":"2023-11-04T01:35:52.022740+0000","last_active":"2023-11-04T01:35:56.086117+0000","last_peered":"2023-11-04T01:35:56.086117+0000","last_clean":"2023-11-04T01:35:56.086117+0000","last_became_active":"2023-11-04T01:35:52.022487+0000","last_became_peered":"2023-11-04T01:35:52.022487+0000","last_unstale":"2023-11-04T01:35:56.086117+0000","last_undegraded":"2023-11-04T01:35:56.086117+0000","last_fullsized":"2023-11-04T01:35:56.086117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082907+0000","last_change":"2023-11-04T01:35:52.026431+0000","last_active":"2023-11-04T01:35:56.082907+0000","last_peered":"2023-11-04T01:35:56.082907+0000","last_clean":"2023-11-04T01:35:56.082907+0000","last_became_active":"2023-11-04T01:35:52.025267+0000","last_became_peered":"2023-11-04T01:35:52.025267+0000","last_unstale":"2023-11-04T01:35:56.082907+0000","last_undegraded":"2023-11-04T01:35:56.082907+0000","last_fullsized":"2023-11-04T01:35:56.082907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085429+0000","last_change":"2023-11-04T01:35:52.025059+0000","last_active":"2023-11-04T01:35:56.085429+0000","last_peered":"2023-11-04T01:35:56.085429+0000","last_clean":"2023-11-04T01:35:56.085429+0000","last_became_active":"2023-11-04T01:35:52.024772+0000","last_became_peered":"2023-11-04T01:35:52.024772+0000","last_unstale":"2023-11-04T01:35:56.085429+0000","last_undegraded":"2023-11-04T01:35:56.085429+0000","last_fullsized":"2023-11-04T01:35:56.085429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083117+0000","last_change":"2023-11-04T01:35:52.033100+0000","last_active":"2023-11-04T01:35:56.083117+0000","last_peered":"2023-11-04T01:35:56.083117+0000","last_clean":"2023-11-04T01:35:56.083117+0000","last_became_active":"2023-11-04T01:35:52.032826+0000","last_became_peered":"2023-11-04T01:35:52.032826+0000","last_unstale":"2023-11-04T01:35:56.083117+0000","last_undegraded":"2023-11-04T01:35:56.083117+0000","last_fullsized":"2023-11-04T01:35:56.083117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082484+0000","last_change":"2023-11-04T01:35:52.024693+0000","last_active":"2023-11-04T01:35:56.082484+0000","last_peered":"2023-11-04T01:35:56.082484+0000","last_clean":"2023-11-04T01:35:56.082484+0000","last_became_active":"2023-11-04T01:35:52.024003+0000","last_became_peered":"2023-11-04T01:35:52.024003+0000","last_unstale":"2023-11-04T01:35:56.082484+0000","last_undegraded":"2023-11-04T01:35:56.082484+0000","last_fullsized":"2023-11-04T01:35:56.082484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091592+0000","last_change":"2023-11-04T01:35:52.025240+0000","last_active":"2023-11-04T01:35:56.091592+0000","last_peered":"2023-11-04T01:35:56.091592+0000","last_clean":"2023-11-04T01:35:56.091592+0000","last_became_active":"2023-11-04T01:35:52.024964+0000","last_became_peered":"2023-11-04T01:35:52.024964+0000","last_unstale":"2023-11-04T01:35:56.091592+0000","last_undegraded":"2023-11-04T01:35:56.091592+0000","last_fullsized":"2023-11-04T01:35:56.091592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124893+0000","last_change":"2023-11-04T01:35:52.032089+0000","last_active":"2023-11-04T01:35:56.124893+0000","last_peered":"2023-11-04T01:35:56.124893+0000","last_clean":"2023-11-04T01:35:56.124893+0000","last_became_active":"2023-11-04T01:35:52.030222+0000","last_became_peered":"2023-11-04T01:35:52.030222+0000","last_unstale":"2023-11-04T01:35:56.124893+0000","last_undegraded":"2023-11-04T01:35:56.124893+0000","last_fullsized":"2023-11-04T01:35:56.124893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090324+0000","last_change":"2023-11-04T01:35:52.027792+0000","last_active":"2023-11-04T01:35:56.090324+0000","last_peered":"2023-11-04T01:35:56.090324+0000","last_clean":"2023-11-04T01:35:56.090324+0000","last_became_active":"2023-11-04T01:35:52.027473+0000","last_became_peered":"2023-11-04T01:35:52.027473+0000","last_unstale":"2023-11-04T01:35:56.090324+0000","last_undegraded":"2023-11-04T01:35:56.090324+0000","last_fullsized":"2023-11-04T01:35:56.090324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084262+0000","last_change":"2023-11-04T01:35:52.034363+0000","last_active":"2023-11-04T01:35:56.084262+0000","last_peered":"2023-11-04T01:35:56.084262+0000","last_clean":"2023-11-04T01:35:56.084262+0000","last_became_active":"2023-11-04T01:35:52.034096+0000","last_became_peered":"2023-11-04T01:35:52.034096+0000","last_unstale":"2023-11-04T01:35:56.084262+0000","last_undegraded":"2023-11-04T01:35:56.084262+0000","last_fullsized":"2023-11-04T01:35:56.084262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082886+0000","last_change":"2023-11-04T01:35:52.033024+0000","last_active":"2023-11-04T01:35:56.082886+0000","last_peered":"2023-11-04T01:35:56.082886+0000","last_clean":"2023-11-04T01:35:56.082886+0000","last_became_active":"2023-11-04T01:35:52.032614+0000","last_became_peered":"2023-11-04T01:35:52.032614+0000","last_unstale":"2023-11-04T01:35:56.082886+0000","last_undegraded":"2023-11-04T01:35:56.082886+0000","last_fullsized":"2023-11-04T01:35:56.082886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076111+0000","last_change":"2023-11-04T01:35:52.021303+0000","last_active":"2023-11-04T01:35:56.076111+0000","last_peered":"2023-11-04T01:35:56.076111+0000","last_clean":"2023-11-04T01:35:56.076111+0000","last_became_active":"2023-11-04T01:35:52.021044+0000","last_became_peered":"2023-11-04T01:35:52.021044+0000","last_unstale":"2023-11-04T01:35:56.076111+0000","last_undegraded":"2023-11-04T01:35:56.076111+0000","last_fullsized":"2023-11-04T01:35:56.076111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082084+0000","last_change":"2023-11-04T01:35:52.016825+0000","last_active":"2023-11-04T01:35:56.082084+0000","last_peered":"2023-11-04T01:35:56.082084+0000","last_clean":"2023-11-04T01:35:56.082084+0000","last_became_active":"2023-11-04T01:35:52.016549+0000","last_became_peered":"2023-11-04T01:35:52.016549+0000","last_unstale":"2023-11-04T01:35:56.082084+0000","last_undegraded":"2023-11-04T01:35:56.082084+0000","last_fullsized":"2023-11-04T01:35:56.082084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085869+0000","last_change":"2023-11-04T01:35:52.027711+0000","last_active":"2023-11-04T01:35:56.085869+0000","last_peered":"2023-11-04T01:35:56.085869+0000","last_clean":"2023-11-04T01:35:56.085869+0000","last_became_active":"2023-11-04T01:35:52.027452+0000","last_became_peered":"2023-11-04T01:35:52.027452+0000","last_unstale":"2023-11-04T01:35:56.085869+0000","last_undegraded":"2023-11-04T01:35:56.085869+0000","last_fullsized":"2023-11-04T01:35:56.085869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090100+0000","last_change":"2023-11-04T01:35:52.026105+0000","last_active":"2023-11-04T01:35:56.090100+0000","last_peered":"2023-11-04T01:35:56.090100+0000","last_clean":"2023-11-04T01:35:56.090100+0000","last_became_active":"2023-11-04T01:35:52.025848+0000","last_became_peered":"2023-11-04T01:35:52.025848+0000","last_unstale":"2023-11-04T01:35:56.090100+0000","last_undegraded":"2023-11-04T01:35:56.090100+0000","last_fullsized":"2023-11-04T01:35:56.090100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:57.470566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091791+0000","last_change":"2023-11-04T01:35:52.028295+0000","last_active":"2023-11-04T01:35:56.091791+0000","last_peered":"2023-11-04T01:35:56.091791+0000","last_clean":"2023-11-04T01:35:56.091791+0000","last_became_active":"2023-11-04T01:35:52.027999+0000","last_became_peered":"2023-11-04T01:35:52.027999+0000","last_unstale":"2023-11-04T01:35:56.091791+0000","last_undegraded":"2023-11-04T01:35:56.091791+0000","last_fullsized":"2023-11-04T01:35:56.091791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092276+0000","last_change":"2023-11-04T01:35:52.034087+0000","last_active":"2023-11-04T01:35:56.092276+0000","last_peered":"2023-11-04T01:35:56.092276+0000","last_clean":"2023-11-04T01:35:56.092276+0000","last_became_active":"2023-11-04T01:35:52.033825+0000","last_became_peered":"2023-11-04T01:35:52.033825+0000","last_unstale":"2023-11-04T01:35:56.092276+0000","last_undegraded":"2023-11-04T01:35:56.092276+0000","last_fullsized":"2023-11-04T01:35:56.092276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124669+0000","last_change":"2023-11-04T01:35:52.032966+0000","last_active":"2023-11-04T01:35:56.124669+0000","last_peered":"2023-11-04T01:35:56.124669+0000","last_clean":"2023-11-04T01:35:56.124669+0000","last_became_active":"2023-11-04T01:35:52.032247+0000","last_became_peered":"2023-11-04T01:35:52.032247+0000","last_unstale":"2023-11-04T01:35:56.124669+0000","last_undegraded":"2023-11-04T01:35:56.124669+0000","last_fullsized":"2023-11-04T01:35:56.124669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086247+0000","last_change":"2023-11-04T01:35:52.027992+0000","last_active":"2023-11-04T01:35:56.086247+0000","last_peered":"2023-11-04T01:35:56.086247+0000","last_clean":"2023-11-04T01:35:56.086247+0000","last_became_active":"2023-11-04T01:35:52.027698+0000","last_became_peered":"2023-11-04T01:35:52.027698+0000","last_unstale":"2023-11-04T01:35:56.086247+0000","last_undegraded":"2023-11-04T01:35:56.086247+0000","last_fullsized":"2023-11-04T01:35:56.086247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123016+0000","last_change":"2023-11-04T01:35:52.028491+0000","last_active":"2023-11-04T01:35:56.123016+0000","last_peered":"2023-11-04T01:35:56.123016+0000","last_clean":"2023-11-04T01:35:56.123016+0000","last_became_active":"2023-11-04T01:35:52.027844+0000","last_became_peered":"2023-11-04T01:35:52.027844+0000","last_unstale":"2023-11-04T01:35:56.123016+0000","last_undegraded":"2023-11-04T01:35:56.123016+0000","last_fullsized":"2023-11-04T01:35:56.123016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083120+0000","last_change":"2023-11-04T01:35:52.032551+0000","last_active":"2023-11-04T01:35:56.083120+0000","last_peered":"2023-11-04T01:35:56.083120+0000","last_clean":"2023-11-04T01:35:56.083120+0000","last_became_active":"2023-11-04T01:35:52.032243+0000","last_became_peered":"2023-11-04T01:35:52.032243+0000","last_unstale":"2023-11-04T01:35:56.083120+0000","last_undegraded":"2023-11-04T01:35:56.083120+0000","last_fullsized":"2023-11-04T01:35:56.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123005+0000","last_change":"2023-11-04T01:35:52.029489+0000","last_active":"2023-11-04T01:35:56.123005+0000","last_peered":"2023-11-04T01:35:56.123005+0000","last_clean":"2023-11-04T01:35:56.123005+0000","last_became_active":"2023-11-04T01:35:52.027332+0000","last_became_peered":"2023-11-04T01:35:52.027332+0000","last_unstale":"2023-11-04T01:35:56.123005+0000","last_undegraded":"2023-11-04T01:35:56.123005+0000","last_fullsized":"2023-11-04T01:35:56.123005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083593+0000","last_change":"2023-11-04T01:35:52.028505+0000","last_active":"2023-11-04T01:35:56.083593+0000","last_peered":"2023-11-04T01:35:56.083593+0000","last_clean":"2023-11-04T01:35:56.083593+0000","last_became_active":"2023-11-04T01:35:52.027029+0000","last_became_peered":"2023-11-04T01:35:52.027029+0000","last_unstale":"2023-11-04T01:35:56.083593+0000","last_undegraded":"2023-11-04T01:35:56.083593+0000","last_fullsized":"2023-11-04T01:35:56.083593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082243+0000","last_change":"2023-11-04T01:35:52.021387+0000","last_active":"2023-11-04T01:35:56.082243+0000","last_peered":"2023-11-04T01:35:56.082243+0000","last_clean":"2023-11-04T01:35:56.082243+0000","last_became_active":"2023-11-04T01:35:52.021111+0000","last_became_peered":"2023-11-04T01:35:52.021111+0000","last_unstale":"2023-11-04T01:35:56.082243+0000","last_undegraded":"2023-11-04T01:35:56.082243+0000","last_fullsized":"2023-11-04T01:35:56.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:05.972756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076467+0000","last_change":"2023-11-04T01:35:52.014538+0000","last_active":"2023-11-04T01:35:56.076467+0000","last_peered":"2023-11-04T01:35:56.076467+0000","last_clean":"2023-11-04T01:35:56.076467+0000","last_became_active":"2023-11-04T01:35:52.014284+0000","last_became_peered":"2023-11-04T01:35:52.014284+0000","last_unstale":"2023-11-04T01:35:56.076467+0000","last_undegraded":"2023-11-04T01:35:56.076467+0000","last_fullsized":"2023-11-04T01:35:56.076467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124311+0000","last_change":"2023-11-04T01:35:52.028638+0000","last_active":"2023-11-04T01:35:56.124311+0000","last_peered":"2023-11-04T01:35:56.124311+0000","last_clean":"2023-11-04T01:35:56.124311+0000","last_became_active":"2023-11-04T01:35:52.028172+0000","last_became_peered":"2023-11-04T01:35:52.028172+0000","last_unstale":"2023-11-04T01:35:56.124311+0000","last_undegraded":"2023-11-04T01:35:56.124311+0000","last_fullsized":"2023-11-04T01:35:56.124311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:10.405 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:36:10.405 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:36:10.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:36:10.406 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:36:10.407 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:36:10.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.534+0000 7f84c3634640 1 Processor -- start 2023-11-04T01:36:10.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.534+0000 7f84c3634640 1 -- start start 2023-11-04T01:36:10.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c3634640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 0x7f84bc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c3634640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84bc06db20 0x7f84bc0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c3634640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0b4110 con 0x7f84bc0b0910 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c3634640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0b49b0 con 0x7f84bc06db20 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c3634640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b0da0 con 0x7f84bc159c70 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84bc06db20 0x7f84bc0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c1bd1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f84bc0b0910 0x7f84bc15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50226/0 (socket says 172.21.15.93:50226) 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c1bd1640 1 -- 172.21.15.93:0/2852699106 learned_addr learned my addr 172.21.15.93:0/2852699106 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84bc06db20 0x7f84bc0b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33270/0 (socket says 172.21.15.93:33270) 2023-11-04T01:36:10.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c13d0640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 0x7f84bc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2852699106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 msgr2=0x7f84bc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 0x7f84bc0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2852699106 >> v1:172.21.15.93:6789/0 conn(0x7f84bc0b0910 legacy=0x7f84bc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2852699106 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0b43f0 con 0x7f84bc06db20 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84b3fff640 1 -- 172.21.15.93:0/2852699106 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349925002 0 0) 0x7f84bc0b4110 con 0x7f84bc0b0910 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.535+0000 7f84c13d0640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 0x7f84bc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.536+0000 7f84c0bcf640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc06db20 0x7f84bc0b03d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00ba40 tx=0x7f84ac02e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c9739eb66ae19 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.536+0000 7f84b3fff640 1 -- 172.21.15.93:0/2852699106 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac02ee30 con 0x7f84bc06db20 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.536+0000 7f84b3fff640 1 -- 172.21.15.93:0/2852699106 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac036440 con 0x7f84bc06db20 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.536+0000 7f84b3fff640 1 -- 172.21.15.93:0/2852699106 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0367d0 con 0x7f84bc06db20 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 -- 172.21.15.93:0/2852699106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc06db20 msgr2=0x7f84bc0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc06db20 0x7f84bc0b03d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00ba40 tx=0x7f84ac02e080 comp rx=0 tx=0).stop 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 -- 172.21.15.93:0/2852699106 shutdown_connections 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc06db20 0x7f84bc0b03d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 --2- 172.21.15.93:0/2852699106 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc159c70 0x7f84bc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 -- 172.21.15.93:0/2852699106 >> 172.21.15.93:0/2852699106 conn(0x7f84bc0ce950 msgr2=0x7f84bc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 -- 172.21.15.93:0/2852699106 shutdown_connections 2023-11-04T01:36:10.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.537+0000 7f84c3634640 1 -- 172.21.15.93:0/2852699106 wait complete. 2023-11-04T01:36:10.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.538+0000 7f84c3634640 1 Processor -- start 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.538+0000 7f84c3634640 1 -- start start 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc06db20 0x7f84bc0a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84bc159c70 0x7f84bc0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0a87a0 con 0x7f84bc0b0910 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c5b30 con 0x7f84bc159c70 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c5e10 con 0x7f84bc06db20 2023-11-04T01:36:10.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33284/0 (socket says 172.21.15.93:33284) 2023-11-04T01:36:10.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2171847460 learned_addr learned my addr 172.21.15.93:0/2171847460 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:10.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c13d0640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc06db20 0x7f84bc0a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc06db20 msgr2=0x7f84bc0a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc06db20 0x7f84bc0a7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84bc159c70 msgr2=0x7f84bc0c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84bc159c70 0x7f84bc0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 -- 172.21.15.93:0/2171847460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac00b6a0 con 0x7f84bc0b0910 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c0bcf640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac004230 con 0x7f84bc0b0910 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac004390 con 0x7f84bc0b0910 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0c60f0 con 0x7f84bc0b0910 2023-11-04T01:36:10.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.539+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac034ba0 con 0x7f84bc0b0910 2023-11-04T01:36:10.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.540+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0a83e0 con 0x7f84bc0b0910 2023-11-04T01:36:10.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.541+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0a8570 con 0x7f84bc0b0910 2023-11-04T01:36:10.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.541+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84ac03d050 con 0x7f84bc0b0910 2023-11-04T01:36:10.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.541+0000 7f84b1ffb640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 0x7f84a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.541+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84ac0ae540 con 0x7f84bc0b0910 2023-11-04T01:36:10.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.541+0000 7f84c13d0640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 0x7f84a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.542+0000 7f84c13d0640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 0x7f84a006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84b800b840 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.546+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84ac079390 con 0x7f84bc0b0910 2023-11-04T01:36:10.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.759+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f84bc0c6610 con 0x7f84bc0b0910 2023-11-04T01:36:10.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.762+0000 7f84b1ffb640 1 -- 172.21.15.93:0/2171847460 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171032 (secure 0 0 0) 0x7f84bc0c6610 con 0x7f84bc0b0910 2023-11-04T01:36:10.768 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:10.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 msgr2=0x7f84a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 0x7f84a006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84b800b840 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:10.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 msgr2=0x7f84bc0a9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 shutdown_connections 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f84a006ae70 0x7f84a006d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84bc159c70 0x7f84bc0c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84bc0b0910 0x7f84bc0a9150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 --2- 172.21.15.93:0/2171847460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84bc06db20 0x7f84bc0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 >> 172.21.15.93:0/2171847460 conn(0x7f84bc0ce950 msgr2=0x7f84bc0b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 shutdown_connections 2023-11-04T01:36:10.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.765+0000 7f84c3634640 1 -- 172.21.15.93:0/2171847460 wait complete. 2023-11-04T01:36:10.777 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":4069824876},{"type":"v1","addr":"172.21.15.93:6833","nonce":4069824876}]},"active_addr":"172.21.15.93:6833/4069824876","active_change":"2023-11-04T01:35:31.317250+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2154153925}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":3629040437}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":3190267214}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2126490631}]}]} 2023-11-04T01:36:10.780 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:36:10.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:36:10.781 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:10.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.879+0000 7fdbb5990640 1 Processor -- start 2023-11-04T01:36:10.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.879+0000 7fdbb5990640 1 -- start start 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbb5990640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdbb00cde60 0x7fdbb015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbb5990640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb015e000 con 0x7fdbb015daa0 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbb5990640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb015e2e0 con 0x7fdbb00ce240 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbb5990640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb015e5c0 con 0x7fdbb00cde60 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdbb00cde60 0x7fdbb015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdbb00cde60 0x7fdbb015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33294/0 (socket says 172.21.15.93:33294) 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdba7fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdbb015daa0 0x7fdbb0157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50230/0 (socket says 172.21.15.93:50230) 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2293381020 learned_addr learned my addr 172.21.15.93:0/2293381020 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2293381020 >> v1:172.21.15.125:6789/0 conn(0x7fdbb00ce240 legacy=0x7fdbb00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2293381020 >> v1:172.21.15.93:6789/0 conn(0x7fdbb015daa0 legacy=0x7fdbb0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2293381020 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00d1120 con 0x7fdbb00cde60 2023-11-04T01:36:10.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.880+0000 7fdbae7fc640 1 -- 172.21.15.93:0/2293381020 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785234705 0 0) 0x7fdbb015e000 con 0x7fdbb015daa0 2023-11-04T01:36:10.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.881+0000 7fdbaeffd640 1 --2- 172.21.15.93:0/2293381020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb015d560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bc183d10c89175 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.881+0000 7fdbae7fc640 1 -- 172.21.15.93:0/2293381020 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba002f840 con 0x7fdbb00cde60 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.881+0000 7fdbae7fc640 1 -- 172.21.15.93:0/2293381020 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba002f9a0 con 0x7fdbb00cde60 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.881+0000 7fdbae7fc640 1 -- 172.21.15.93:0/2293381020 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba002fd30 con 0x7fdbb00cde60 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 -- 172.21.15.93:0/2293381020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 msgr2=0x7fdbb015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2293381020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb015d560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba002ba20 comp rx=0 tx=0).stop 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 -- 172.21.15.93:0/2293381020 shutdown_connections 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2293381020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb015d560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 -- 172.21.15.93:0/2293381020 >> 172.21.15.93:0/2293381020 conn(0x7fdbb0071f30 msgr2=0x7fdbb00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 -- 172.21.15.93:0/2293381020 shutdown_connections 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.882+0000 7fdbb5990640 1 -- 172.21.15.93:0/2293381020 wait complete. 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 Processor -- start 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 -- start start 2023-11-04T01:36:10.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 0x7fdbb00b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 0x7fdbb00b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01f6af0 con 0x7fdbb00cde60 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb014d5b0 con 0x7fdbb015daa0 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.883+0000 7fdbb5990640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01473c0 con 0x7fdbb00ce240 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33308/0 (socket says 172.21.15.93:33308) 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2671118950 learned_addr learned my addr 172.21.15.93:0/2671118950 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdba7fff640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 0x7fdbb00b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaf7fe640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 0x7fdbb00b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 msgr2=0x7fdbb00b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 0x7fdbb00b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 msgr2=0x7fdbb00b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 0x7fdbb00b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 -- 172.21.15.93:0/2671118950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00094d0 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdba7fff640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 0x7fdbb00b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaf7fe640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 0x7fdbb00b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbaeffd640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba002f7f0 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0041400 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01476a0 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00417b0 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.884+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb0147c60 con 0x7fdbb00cde60 2023-11-04T01:36:10.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.885+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb0074290 con 0x7fdbb00cde60 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.886+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdba0041910 con 0x7fdbb00cde60 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.886+0000 7fdbacff9640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 0x7fdb9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.886+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdba003c070 con 0x7fdbb00cde60 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.886+0000 7fdba7fff640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 0x7fdb9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.886+0000 7fdba7fff640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 0x7fdb9006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00b50e0 tx=0x7fdb98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:10.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:10.890+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdba00776a0 con 0x7fdbb00cde60 2023-11-04T01:36:11.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.056+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbb00b5110 con 0x7fdbb00cde60 2023-11-04T01:36:11.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.057+0000 7fdbacff9640 1 -- 172.21.15.93:0/2671118950 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fdba007acc0 con 0x7fdbb00cde60 2023-11-04T01:36:11.059 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:11.059 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:11.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 msgr2=0x7fdb9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 0x7fdb9006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00b50e0 tx=0x7fdb98009040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 msgr2=0x7fdbb014d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba0004730 comp rx=0 tx=0).stop 2023-11-04T01:36:11.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 shutdown_connections 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb9006ae70 0x7fdb9006d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbb015daa0 0x7fdbb00b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbb00ce240 0x7fdbb00b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 --2- 172.21.15.93:0/2671118950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbb00cde60 0x7fdbb014d070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 >> 172.21.15.93:0/2671118950 conn(0x7fdbb0071f30 msgr2=0x7fdbb00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 shutdown_connections 2023-11-04T01:36:11.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.059+0000 7fdbb5990640 1 -- 172.21.15.93:0/2671118950 wait complete. 2023-11-04T01:36:11.071 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:36:11.072 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.170+0000 7fedb3e87640 1 Processor -- start 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.170+0000 7fedb3e87640 1 -- start start 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb3e87640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fedac0cce10 0x7fedac0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb3e87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac06a830 0x7fedac15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb3e87640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac15e6e0 con 0x7fedac0b18b0 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb3e87640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac15dd10 con 0x7fedac0cce10 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb3e87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac15d720 con 0x7fedac06a830 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb1c23640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fedac0cce10 0x7fedac0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb1c23640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fedac0cce10 0x7fedac0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33322/0 (socket says 172.21.15.93:33322) 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.171+0000 7fedb1c23640 1 -- 172.21.15.93:0/1743748293 learned_addr learned my addr 172.21.15.93:0/1743748293 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb2424640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac06a830 0x7fedac15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb1c23640 1 -- 172.21.15.93:0/1743748293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac06a830 msgr2=0x7fedac15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb1c23640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac06a830 0x7fedac15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb1c23640 1 -- 172.21.15.93:0/1743748293 >> v1:172.21.15.125:6789/0 conn(0x7fedac0b18b0 legacy=0x7fedac06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb1c23640 1 -- 172.21.15.93:0/1743748293 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac06fe00 con 0x7fedac0cce10 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb1c23640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac0cce10 0x7fedac0b1fc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feda8009e50 tx=0x7feda802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7a3ec5e9793bf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.172+0000 7fedb0c21640 1 -- 172.21.15.93:0/1743748293 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda802c9e0 con 0x7fedac0cce10 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb0c21640 1 -- 172.21.15.93:0/1743748293 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda802cb40 con 0x7fedac0cce10 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb0c21640 1 -- 172.21.15.93:0/1743748293 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80343f0 con 0x7fedac0cce10 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 -- 172.21.15.93:0/1743748293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac0cce10 msgr2=0x7fedac0b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac0cce10 0x7fedac0b1fc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feda8009e50 tx=0x7feda802be40 comp rx=0 tx=0).stop 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 -- 172.21.15.93:0/1743748293 shutdown_connections 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac06a830 0x7fedac15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 --2- 172.21.15.93:0/1743748293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac0cce10 0x7fedac0b1fc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 -- 172.21.15.93:0/1743748293 >> 172.21.15.93:0/1743748293 conn(0x7fedac06d8b0 msgr2=0x7fedac06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 -- 172.21.15.93:0/1743748293 shutdown_connections 2023-11-04T01:36:11.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.173+0000 7fedb3e87640 1 -- 172.21.15.93:0/1743748293 wait complete. 2023-11-04T01:36:11.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.174+0000 7fedb3e87640 1 Processor -- start 2023-11-04T01:36:11.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.174+0000 7fedb3e87640 1 -- start start 2023-11-04T01:36:11.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac0b18b0 0x7fedac1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedac0cce10 0x7fedac1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c53e0 con 0x7fedac06a830 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c56c0 con 0x7fedac0cce10 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb3e87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c59a0 con 0x7fedac0b18b0 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:33338/0 (socket says 172.21.15.93:33338) 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 -- 172.21.15.93:0/2680260522 learned_addr learned my addr 172.21.15.93:0/2680260522 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1422640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac0b18b0 0x7fedac1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb2424640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedac0cce10 0x7fedac1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 -- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac0b18b0 msgr2=0x7fedac1f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac0b18b0 0x7fedac1f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 -- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedac0cce10 msgr2=0x7fedac1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedac0cce10 0x7fedac1f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.175+0000 7fedb1c23640 1 -- 172.21.15.93:0/2680260522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009b30 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7fedb1c23640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feda8000f80 tx=0x7feda8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8009510 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda803e450 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0c5c80 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda803e800 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.176+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac14f890 con 0x7fedac06a830 2023-11-04T01:36:11.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.177+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac14fa20 con 0x7fedac06a830 2023-11-04T01:36:11.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.177+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feda803e960 con 0x7fedac06a830 2023-11-04T01:36:11.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.178+0000 7feda27fc640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.178+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feda80ac6a0 con 0x7fedac06a830 2023-11-04T01:36:11.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.178+0000 7fedb1422640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.178+0000 7fedb1422640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 0x7fed9006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedac0c66d0 tx=0x7fed9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.182+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feda8077610 con 0x7fedac06a830 2023-11-04T01:36:11.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.354+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedac0674e0 con 0x7fedac06a830 2023-11-04T01:36:11.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.356+0000 7feda27fc640 1 -- 172.21.15.93:0/2680260522 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7feda807ac30 con 0x7fedac06a830 2023-11-04T01:36:11.357 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:11.358 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:11.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.357+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 msgr2=0x7fed9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.357+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 0x7fed9006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedac0c66d0 tx=0x7fed9c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.357+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 msgr2=0x7fedac148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.357+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feda8000f80 tx=0x7feda8004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 shutdown_connections 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fedac0cce10 0x7fedac1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fedac0b18b0 0x7fedac1f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 --2- 172.21.15.93:0/2680260522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedac06a830 0x7fedac148d20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 >> 172.21.15.93:0/2680260522 conn(0x7fedac06d8b0 msgr2=0x7fedac0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 shutdown_connections 2023-11-04T01:36:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.358+0000 7fedb3e87640 1 -- 172.21.15.93:0/2680260522 wait complete. 2023-11-04T01:36:11.373 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:36:11.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:36:11.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:36:11.375 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:36:11.376 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:36:11.376 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:36:11.376 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:36:11.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:36:11.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.548+0000 7f30cbed7640 1 Processor -- start 2023-11-04T01:36:11.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.548+0000 7f30cbed7640 1 -- start start 2023-11-04T01:36:11.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.549+0000 7f30cbed7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30c41612d0 0x7f30c40cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.549+0000 7f30cbed7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.549+0000 7f30cbed7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c41616b0 con 0x7f30c40c9040 2023-11-04T01:36:11.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.549+0000 7f30cbed7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40c9c00 con 0x7f30c41612d0 2023-11-04T01:36:11.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.549+0000 7f30cbed7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b00e0 con 0x7f30c40b1860 2023-11-04T01:36:11.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7fb68be4b640 1 Processor -- start 2023-11-04T01:36:11.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7f30c9472640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7f30c9472640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54530/0 (socket says 172.21.15.93:54530) 2023-11-04T01:36:11.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7f30c9472640 1 -- 172.21.15.93:0/1836884898 learned_addr learned my addr 172.21.15.93:0/1836884898 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7f30c9c73640 1 --2- 172.21.15.93:0/1836884898 >> v2:172.21.15.125:3300/0 conn(0x7f30c41612d0 0x7f30c40cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.550+0000 7fb68be4b640 1 -- start start 2023-11-04T01:36:11.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7f30c9472640 1 -- 172.21.15.93:0/1836884898 >> v2:172.21.15.125:3300/0 conn(0x7f30c41612d0 msgr2=0x7f30c40cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7f30c9472640 1 --2- 172.21.15.93:0/1836884898 >> v2:172.21.15.125:3300/0 conn(0x7f30c41612d0 0x7f30c40cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7f30c9472640 1 -- 172.21.15.93:0/1836884898 >> v1:172.21.15.125:6789/0 conn(0x7f30c40c9040 legacy=0x7f30c40c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7f30c9472640 1 -- 172.21.15.93:0/1836884898 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40af7b0 con 0x7f30c40b1860 2023-11-04T01:36:11.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7fb68be4b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb684072380 0x7fb684165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7f30c9472640 1 --2- 172.21.15.93:0/1836884898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009870 tx=0x7f30c002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b4c65fafc7436e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7fb68be4b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6840cdfb0 con 0x7fb6840b2010 2023-11-04T01:36:11.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7f30c8c71640 1 -- 172.21.15.93:0/1836884898 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0031640 con 0x7f30c40b1860 2023-11-04T01:36:11.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7f30c8c71640 1 -- 172.21.15.93:0/1836884898 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c00317a0 con 0x7f30c40b1860 2023-11-04T01:36:11.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7f30cbed7640 1 -- 172.21.15.93:0/1836884898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 msgr2=0x7f30c40cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7fb68be4b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68406ab00 con 0x7fb684071fa0 2023-11-04T01:36:11.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7f30cbed7640 1 --2- 172.21.15.93:0/1836884898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009870 tx=0x7f30c002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.551+0000 7fb68be4b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68406a830 con 0x7fb684072380 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.552+0000 7fb6893e6640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb6840b2010 0x7fb684165790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54262/0 (socket says 172.21.15.93:54262) 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.552+0000 7fb6893e6640 1 -- 172.21.15.93:0/2711053923 learned_addr learned my addr 172.21.15.93:0/2711053923 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.552+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380254466 0 0) 0x7fb6840cdfb0 con 0x7fb6840b2010 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.552+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb670003520 con 0x7fb6840b2010 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255229040 0 0) 0x7fb670003520 con 0x7fb6840b2010 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 >> v2:172.21.15.93:3300/0 conn(0x7fb684072380 msgr2=0x7fb684165ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.553+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> v2:172.21.15.93:3300/0 conn(0x7fb684072380 0x7fb684165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 --2- 172.21.15.93:0/2711053923 >> v2:172.21.15.93:3300/0 conn(0x7fb684072380 0x7fb684165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 -- 172.21.15.93:0/1836884898 shutdown_connections 2023-11-04T01:36:11.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 --2- 172.21.15.93:0/1836884898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c40b1860 0x7f30c40cb7c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 --2- 172.21.15.93:0/1836884898 >> v2:172.21.15.125:3300/0 conn(0x7f30c41612d0 0x7f30c40cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 -- 172.21.15.93:0/1836884898 >> 172.21.15.93:0/1836884898 conn(0x7f30c406c7a0 msgr2=0x7f30c406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 >> v1:172.21.15.125:6789/0 conn(0x7fb684071fa0 legacy=0x7fb68406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840cd680 con 0x7fb6840b2010 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fb67c0019f0 con 0x7fb6840b2010 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 >> v1:172.21.15.93:6789/0 conn(0x7fb6840b2010 legacy=0x7fb684165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb670003970 0x7fb670003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 0x7fb67000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68406a830 con 0x7fb6700051d0 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67000c120 con 0x7fb6700047c0 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67000c2e0 con 0x7fb670003970 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.554+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> v2:172.21.15.93:3300/0 conn(0x7fb684072380 0x7fb684165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:11.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7fb6893e6640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7fb689be7640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb670003970 0x7fb670003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 -- 172.21.15.93:0/1836884898 shutdown_connections 2023-11-04T01:36:11.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.555+0000 7f30cbed7640 1 -- 172.21.15.93:0/1836884898 wait complete. 2023-11-04T01:36:11.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.557+0000 7f30cbed7640 1 Processor -- start 2023-11-04T01:36:11.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 0x7fb67000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 -- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb670003970 msgr2=0x7fb670003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb670003970 0x7fb670003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 -- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700047c0 msgr2=0x7fb670004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.556+0000 7fb68a3e8640 1 -- 172.21.15.93:0/2711053923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840cd680 con 0x7fb6700051d0 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 0x7fb67000b980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb67400aa70 tx=0x7fb6700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd481116d797291e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fb68a3e8640 1 -- 172.21.15.93:0/2711053923 reap_dead start 2023-11-04T01:36:11.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.557+0000 7f30cbed7640 1 -- start start 2023-11-04T01:36:11.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fdc5a193640 1 Processor -- start 2023-11-04T01:36:11.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fdc5a193640 1 -- start start 2023-11-04T01:36:11.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 0x7f30c414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c40c9040 0x7f30c41391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c41612d0 0x7f30c4070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4142960 con 0x7f30c40c9040 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b0af0 con 0x7f30c40b1860 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7f30cbed7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4143900 con 0x7f30c41612d0 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7f30c9c73640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 0x7f30c414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7f30c9c73640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 0x7f30c414d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33368/0 (socket says 172.21.15.93:33368) 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7f30c9c73640 1 -- 172.21.15.93:0/1406277122 learned_addr learned my addr 172.21.15.93:0/1406277122 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7f30c9472640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c40c9040 0x7f30c41391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fdc5a193640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdc540aec00 0x7fdc540cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674004220 con 0x7fb6700051d0 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.558+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674004380 con 0x7fb6700051d0 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7fb68be4b640 1 -- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 msgr2=0x7fb67000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7fb688be5640 1 -- 172.21.15.93:0/2711053923 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674004220 con 0x7fb6700051d0 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.559+0000 7fb68be4b640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 0x7fb67000b980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb67400aa70 tx=0x7fb6700057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fb68be4b640 1 -- 172.21.15.93:0/2711053923 shutdown_connections 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fb68be4b640 1 --2- 172.21.15.93:0/2711053923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6700051d0 0x7fb67000b980 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fb68be4b640 1 -- 172.21.15.93:0/2711053923 >> 172.21.15.93:0/2711053923 conn(0x7fb68406d800 msgr2=0x7fb68406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fb68be4b640 1 -- 172.21.15.93:0/2711053923 shutdown_connections 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fb68be4b640 1 -- 172.21.15.93:0/2711053923 wait complete. 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9c73640 1 -- 172.21.15.93:0/1406277122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c41612d0 msgr2=0x7f30c4070d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9c73640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f30c41612d0 0x7f30c4070d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9c73640 1 -- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c40c9040 msgr2=0x7f30c41391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9c73640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c40c9040 0x7f30c41391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9c73640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00094d0 con 0x7f30c40b1860 2023-11-04T01:36:11.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7f30c9472640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c40c9040 0x7f30c41391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:11.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc59191640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdc54159b90 0x7fdc5415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:40498/0 (socket says 172.21.15.93:40498) 2023-11-04T01:36:11.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.560+0000 7fdc58990640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdc540aec00 0x7fdc540cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc58990640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdc540aec00 0x7fdc540cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48086/0 (socket says 172.21.15.93:48086) 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc59191640 1 -- 172.21.15.93:0/912514708 learned_addr learned my addr 172.21.15.93:0/912514708 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5415a080 con 0x7fdc5406f090 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5415dc70 con 0x7fdc54159b90 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.561+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540cb740 con 0x7fdc540aec00 2023-11-04T01:36:11.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7f30c9c73640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 0x7f30c414d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00eed0 tx=0x7f30bc00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fb68be4b640 1 Processor -- start 2023-11-04T01:36:11.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fb68be4b640 1 -- start start 2023-11-04T01:36:11.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fdc4bfff640 1 -- 172.21.15.93:0/912514708 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457407107 0 0) 0x7fdc5415a080 con 0x7fdc5406f090 2023-11-04T01:36:11.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fdc4bfff640 1 -- 172.21.15.93:0/912514708 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40003520 con 0x7fdc5406f090 2023-11-04T01:36:11.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb68be4b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700051d0 0x7fb6841e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fdc58990640 1 -- 172.21.15.93:0/912514708 >> v1:172.21.15.125:6789/0 conn(0x7fdc54159b90 legacy=0x7fdc5415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fdc58990640 1 -- 172.21.15.93:0/912514708 >> v1:172.21.15.93:6789/0 conn(0x7fdc5406f090 legacy=0x7fdc5415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.562+0000 7fdc58990640 1 -- 172.21.15.93:0/912514708 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540cba20 con 0x7fdc540aec00 2023-11-04T01:36:11.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb68be4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 0x7fb6840b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb689be7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700051d0 0x7fb6841e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fdc58990640 1 --2- 172.21.15.93:0/912514708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540cb140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097a0 tx=0x7fdc4402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e80d73bdf853cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb689be7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700051d0 0x7fb6841e8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33384/0 (socket says 172.21.15.93:33384) 2023-11-04T01:36:11.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb6893e6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 0x7fb6840b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fdc4bfff640 1 -- 172.21.15.93:0/912514708 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440317c0 con 0x7fdc540aec00 2023-11-04T01:36:11.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7fdc4bfff640 1 -- 172.21.15.93:0/912514708 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44031920 con 0x7fdc540aec00 2023-11-04T01:36:11.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc010040 con 0x7f30c40b1860 2023-11-04T01:36:11.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7fdc4bfff640 1 -- 172.21.15.93:0/912514708 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44031cf0 con 0x7fdc540aec00 2023-11-04T01:36:11.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.564+0000 7fb6893e6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 0x7fb6840b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54552/0 (socket says 172.21.15.93:54552) 2023-11-04T01:36:11.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7fb689be7640 1 -- 172.21.15.93:0/3098586699 learned_addr learned my addr 172.21.15.93:0/3098586699 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7f30cbed7640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c4142b40 con 0x7f30c40b1860 2023-11-04T01:36:11.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7f30cbed7640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c4143100 con 0x7f30c40b1860 2023-11-04T01:36:11.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc009e80 con 0x7f30c40b1860 2023-11-04T01:36:11.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc014600 con 0x7f30c40b1860 2023-11-04T01:36:11.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 msgr2=0x7fdc540cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.565+0000 7fdc5a193640 1 --2- 172.21.15.93:0/912514708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540cb140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc440097a0 tx=0x7fdc4402b860 comp rx=0 tx=0).stop 2023-11-04T01:36:11.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.566+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 shutdown_connections 2023-11-04T01:36:11.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.566+0000 7fdc5a193640 1 --2- 172.21.15.93:0/912514708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540cb140 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.566+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 >> 172.21.15.93:0/912514708 conn(0x7fdc540cf810 msgr2=0x7fdc540cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7fb68be4b640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6840b3c20 0x7fb6840b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b23f0 con 0x7fb6840b3c20 2023-11-04T01:36:11.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841e9460 con 0x7fb6700051d0 2023-11-04T01:36:11.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b2640 con 0x7fb6840c8bd0 2023-11-04T01:36:11.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7f30cbed7640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30ac000fc0 con 0x7f30c40b1860 2023-11-04T01:36:11.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.567+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6840b3c20 0x7fb6840b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb6893e6640 1 -- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700051d0 msgr2=0x7fb6841e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb6893e6640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6700051d0 0x7fb6841e8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb6893e6640 1 -- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6840b3c20 msgr2=0x7fb6840b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb6893e6640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6840b3c20 0x7fb6840b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb6893e6640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840b2920 con 0x7fb6840c8bd0 2023-11-04T01:36:11.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 shutdown_connections 2023-11-04T01:36:11.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fdc5a193640 1 -- 172.21.15.93:0/912514708 wait complete. 2023-11-04T01:36:11.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.568+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6840b3c20 0x7fb6840b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:11.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.569+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30bc014760 con 0x7f30c40b1860 2023-11-04T01:36:11.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb6893e6640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 0x7fb6840b36e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb67c001be0 tx=0x7fb67c00a700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb3a1a44640 1 Processor -- start 2023-11-04T01:36:11.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c007a80 con 0x7fb6840c8bd0 2023-11-04T01:36:11.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fdc5a193640 1 Processor -- start 2023-11-04T01:36:11.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840b2c00 con 0x7fb6840c8bd0 2023-11-04T01:36:11.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840b31c0 con 0x7fb6840c8bd0 2023-11-04T01:36:11.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0133f0 con 0x7fb6840c8bd0 2023-11-04T01:36:11.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fdc5a193640 1 -- start start 2023-11-04T01:36:11.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c013760 con 0x7fb6840c8bd0 2023-11-04T01:36:11.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7f30ba7fc640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30a806af40 0x7f30a806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc5a193640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 0x7fdc54150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.570+0000 7fb3a1a44640 1 -- start start 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb3a1a44640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb39c158c80 0x7fb39c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb3a1a44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb3a1a44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0cb1e0 con 0x7fb39c159060 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb3a1a44640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c1595d0 con 0x7fb39c158c80 2023-11-04T01:36:11.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb3a1a44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0caf00 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.571+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb66c000fc0 con 0x7fb6840c8bd0 2023-11-04T01:36:11.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc5a193640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f30c9472640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30a806af40 0x7f30a806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fb39b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fb39b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54568/0 (socket says 172.21.15.93:54568) 2023-11-04T01:36:11.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fb39b7fe640 1 -- 172.21.15.93:0/470872250 learned_addr learned my addr 172.21.15.93:0/470872250 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f6a3c8c3640 1 Processor -- start 2023-11-04T01:36:11.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc59191640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 0x7fdc54150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc59191640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 0x7fdc54150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33396/0 (socket says 172.21.15.93:33396) 2023-11-04T01:36:11.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fb39affd640 1 --2- 172.21.15.93:0/470872250 >> v2:172.21.15.93:3300/0 conn(0x7fb39c158c80 0x7fb39c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc58990640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc58990640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48104/0 (socket says 172.21.15.93:48104) 2023-11-04T01:36:11.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7fdc59191640 1 -- 172.21.15.93:0/933803248 learned_addr learned my addr 172.21.15.93:0/933803248 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fdc5a193640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc54159b90 0x7fdc54150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c53f0 con 0x7fdc540aec00 2023-11-04T01:36:11.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54150b60 con 0x7fdc5406f090 2023-11-04T01:36:11.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fdc59992640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc54159b90 0x7fdc54150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c6c00 con 0x7fdc54159b90 2023-11-04T01:36:11.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 -- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc54159b90 msgr2=0x7fdc54150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdc54159b90 0x7fdc54150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 -- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 msgr2=0x7fdc540c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc540aec00 0x7fdc540c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44009400 con 0x7fdc5406f090 2023-11-04T01:36:11.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fdc59191640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 0x7fdc54150620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c460 tx=0x7fdc5000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fb39b7fe640 1 -- 172.21.15.93:0/470872250 >> v2:172.21.15.93:3300/0 conn(0x7fb39c158c80 msgr2=0x7fb39c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/470872250 >> v2:172.21.15.93:3300/0 conn(0x7fb39c158c80 0x7fb39c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fb39b7fe640 1 -- 172.21.15.93:0/470872250 >> v1:172.21.15.93:6789/0 conn(0x7fb39c159060 legacy=0x7fb39c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7fb39b7fe640 1 -- 172.21.15.93:0/470872250 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c159870 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f6a3c8c3640 1 -- start start 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7f6a3c8c3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a30005ed0 0x7f6a30007470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7f6a377fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6a300df3f0 0x7f6a3004fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:40510/0 (socket says 172.21.15.93:40510) 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7f6a377fe640 1 -- 172.21.15.93:0/91448582 learned_addr learned my addr 172.21.15.93:0/91448582 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a300063d0 con 0x7f6a30050270 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a300066b0 con 0x7f6a300df3f0 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a300df7d0 con 0x7f6a30005ed0 2023-11-04T01:36:11.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176398197 0 0) 0x7f6a300066b0 con 0x7f6a300df3f0 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a28003520 con 0x7f6a300df3f0 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a37fff640 1 --2- 172.21.15.93:0/91448582 >> v2:172.21.15.125:3300/0 conn(0x7f6a30005ed0 0x7f6a30007470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30bc08a240 con 0x7f30c40b1860 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f30ba7fc640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] conn(0x7f30a8074580 0x7f30a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30a8077090 con 0x7f30a8074580 2023-11-04T01:36:11.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.572+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30bc08a5f0 con 0x7f30c40b1860 2023-11-04T01:36:11.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.573+0000 7f30ca474640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] conn(0x7f30a8074580 0x7f30a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fa497f1d640 1 Processor -- start 2023-11-04T01:36:11.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fa497f1d640 1 -- start start 2023-11-04T01:36:11.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb67c0138c0 con 0x7fb6840c8bd0 2023-11-04T01:36:11.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50005ce0 con 0x7fdc5406f090 2023-11-04T01:36:11.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50005e40 con 0x7fdc5406f090 2023-11-04T01:36:11.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.574+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366380498 0 0) 0x7f6a300063d0 con 0x7f6a30050270 2023-11-04T01:36:11.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a300066b0 con 0x7f6a30050270 2023-11-04T01:36:11.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc540c4770 con 0x7fdc5406f090 2023-11-04T01:36:11.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500072b0 con 0x7fdc5406f090 2023-11-04T01:36:11.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.1 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1955877466 0 0) 0x7f6a28003520 con 0x7f6a300df3f0 2023-11-04T01:36:11.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 >> v2:172.21.15.125:3300/0 conn(0x7f6a30005ed0 msgr2=0x7f6a30007470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 --2- 172.21.15.93:0/91448582 >> v2:172.21.15.125:3300/0 conn(0x7f6a30005ed0 0x7f6a30007470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 >> v1:172.21.15.93:6789/0 conn(0x7f6a30050270 legacy=0x7f6a300380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30006990 con 0x7f6a300df3f0 2023-11-04T01:36:11.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.1 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6a2c001670 con 0x7f6a300df3f0 2023-11-04T01:36:11.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 >> v1:172.21.15.125:6789/0 conn(0x7f6a300df3f0 legacy=0x7f6a3004fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 0x7f6a28003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300df7d0 con 0x7f6a280047c0 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800bec0 con 0x7f6a28005180 2023-11-04T01:36:11.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800c080 con 0x7f6a28003b00 2023-11-04T01:36:11.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540c4d30 con 0x7fdc5406f090 2023-11-04T01:36:11.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f30ca474640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] conn(0x7f30a8074580 0x7f30a80769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a377fe640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 0x7f6a28003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa490141e20 0x7fa4900ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa490142480 0x7fa4900caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4900cafb0 0x7fa4900c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900cc960 con 0x7fa490141e20 2023-11-04T01:36:11.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900ccc40 con 0x7fa490142480 2023-11-04T01:36:11.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa497f1d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900ccf20 con 0x7fa4900cafb0 2023-11-04T01:36:11.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa495cb9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa490141e20 0x7fa4900ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa495cb9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa490141e20 0x7fa4900ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48126/0 (socket says 172.21.15.93:48126) 2023-11-04T01:36:11.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7fa495cb9640 1 -- 172.21.15.93:0/3583712253 learned_addr learned my addr 172.21.15.93:0/3583712253 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa4964ba640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4900cafb0 0x7fa4900c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa495cb9640 1 -- 172.21.15.93:0/3583712253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4900cafb0 msgr2=0x7fa4900c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa495cb9640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4900cafb0 0x7fa4900c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa495cb9640 1 -- 172.21.15.93:0/3583712253 >> v2:172.21.15.125:3300/0 conn(0x7fa490142480 msgr2=0x7fa4900caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa495cb9640 1 --2- 172.21.15.93:0/3583712253 >> v2:172.21.15.125:3300/0 conn(0x7fa490142480 0x7fa4900caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fa495cb9640 1 -- 172.21.15.93:0/3583712253 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900cd200 con 0x7fa490141e20 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fb67a7fc640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb66806ae70 0x7fb66806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7fb689be7640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb66806ae70 0x7fb66806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.575+0000 7f6a36ffd640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f30c9472640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30a806af40 0x7f30a806d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f30c0036000 tx=0x7f30c003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7f6a377fe640 1 -- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a28005180 msgr2=0x7f6a2800b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:11.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7f6a377fe640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7f6a377fe640 1 -- 172.21.15.93:0/91448582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a280047c0 msgr2=0x7f6a28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7f6a377fe640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.576+0000 7f6a377fe640 1 -- 172.21.15.93:0/91448582 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30006990 con 0x7f6a28003b00 2023-11-04T01:36:11.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== osd.2 v2:172.21.15.93:6816/3080870995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f30a8077090 con 0x7f30a8074580 2023-11-04T01:36:11.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f6a377fe640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 0x7f6a28003f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009260 tx=0x7f6a280057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ac3eeb5fff23f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f8d7150c640 1 Processor -- start 2023-11-04T01:36:11.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f8d7150c640 1 -- start start 2023-11-04T01:36:11.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fb689be7640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb66806ae70 0x7fb66806d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb680001960 tx=0x7fb680009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb67c08abd0 con 0x7fb6840c8bd0 2023-11-04T01:36:11.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc540c66f0 con 0x7fdc5406f090 2023-11-04T01:36:11.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fa495cb9640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa490141e20 0x7fa4900ca530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa49006ff90 tx=0x7fa48c02fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33636cd8bb9c4eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fa494cb7640 1 -- 172.21.15.93:0/3583712253 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c007ce0 con 0x7fa490141e20 2023-11-04T01:36:11.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fa494cb7640 1 -- 172.21.15.93:0/3583712253 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c007e40 con 0x7fa490141e20 2023-11-04T01:36:11.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fa494cb7640 1 -- 172.21.15.93:0/3583712253 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0092f0 con 0x7fa490141e20 2023-11-04T01:36:11.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fb67a7fc640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] conn(0x7fb668074430 0x7fb668076870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb668076f40 con 0x7fb668074430 2023-11-04T01:36:11.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb67c03e070 con 0x7fb6840c8bd0 2023-11-04T01:36:11.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f6a37fff640 1 -- 172.21.15.93:0/91448582 reap_dead start 2023-11-04T01:36:11.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c005ad0 con 0x7f6a28003b00 2023-11-04T01:36:11.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c031050 con 0x7f6a28003b00 2023-11-04T01:36:11.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.577+0000 7f6a367fc640 1 -- 172.21.15.93:0/91448582 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c005e70 con 0x7f6a28003b00 2023-11-04T01:36:11.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/470872250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb394009e50 tx=0x7fb39402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5ef14a1ceeb618 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] conn(0x7fb668074430 0x7fb668076870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 -- 172.21.15.93:0/3583712253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa490141e20 msgr2=0x7fa4900ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa490141e20 0x7fa4900ca530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa49006ff90 tx=0x7fa48c02fcd0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d7150c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d7150c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d7150c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0b6e70 con 0x7f8d6c161430 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d7150c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c06c1c0 con 0x7f8d6c0cf130 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d7150c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0b7410 con 0x7f8d6c06b810 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 -- 172.21.15.93:0/3583712253 shutdown_connections 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4900cafb0 0x7fa4900c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 --2- 172.21.15.93:0/3583712253 >> v2:172.21.15.125:3300/0 conn(0x7fa490142480 0x7fa4900caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 --2- 172.21.15.93:0/3583712253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa490141e20 0x7fa4900ca530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fa497f1d640 1 -- 172.21.15.93:0/3583712253 >> 172.21.15.93:0/3583712253 conn(0x7fa49006a120 msgr2=0x7fa49006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 msgr2=0x7f6a28003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 0x7f6a28003f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009260 tx=0x7f6a280057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 shutdown_connections 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/91448582 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a28003b00 0x7f6a28003f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 >> 172.21.15.93:0/91448582 conn(0x7f6a30054b00 msgr2=0x7f6a30054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d6a7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7f8d6affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d6c161430 0x7f8d6c0d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54294/0 (socket says 172.21.15.93:54294) 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54598/0 (socket says 172.21.15.93:54598) 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 -- 172.21.15.93:0/3697538944 learned_addr learned my addr 172.21.15.93:0/3697538944 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6a7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48136/0 (socket says 172.21.15.93:48136) 2023-11-04T01:36:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fa497f1d640 1 -- 172.21.15.93:0/3583712253 shutdown_connections 2023-11-04T01:36:11.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fa497f1d640 1 -- 172.21.15.93:0/3583712253 wait complete. 2023-11-04T01:36:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 -- 172.21.15.93:0/3697538944 >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 msgr2=0x7f8d6c164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 --2- 172.21.15.93:0/3697538944 >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 -- 172.21.15.93:0/3697538944 >> v1:172.21.15.93:6789/0 conn(0x7f8d6c161430 legacy=0x7f8d6c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6b7fe640 1 -- 172.21.15.93:0/3697538944 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c165e00 con 0x7f8d6c06b810 2023-11-04T01:36:11.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7f8d6a7fc640 1 --2- 172.21.15.93:0/3697538944 >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fb399ffb640 1 -- 172.21.15.93:0/470872250 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39402ca80 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fb399ffb640 1 -- 172.21.15.93:0/470872250 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39402cbe0 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.578+0000 7fb399ffb640 1 -- 172.21.15.93:0/470872250 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3940343f0 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 -- 172.21.15.93:0/470872250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 msgr2=0x7fb39c15ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 --2- 172.21.15.93:0/470872250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb394009e50 tx=0x7fb39402bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 -- 172.21.15.93:0/470872250 shutdown_connections 2023-11-04T01:36:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 --2- 172.21.15.93:0/470872250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c15ca00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 --2- 172.21.15.93:0/470872250 >> v2:172.21.15.93:3300/0 conn(0x7fb39c158c80 0x7fb39c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fb3a1a44640 1 -- 172.21.15.93:0/470872250 >> 172.21.15.93:0/470872250 conn(0x7fb39c06a120 msgr2=0x7fb39c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.580+0000 7fb3a1a44640 1 -- 172.21.15.93:0/470872250 shutdown_connections 2023-11-04T01:36:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.580+0000 7fb3a1a44640 1 -- 172.21.15.93:0/470872250 wait complete. 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc50017070 con 0x7fdc5406f090 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc3806af70 0x7fdc3806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc5008d5c0 con 0x7fdc5406f090 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] conn(0x7fdc380745b0 0x7fdc380769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc380770c0 con 0x7fdc380745b0 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.579+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc5008d970 con 0x7fdc5406f090 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.580+0000 7fdc59992640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] conn(0x7fdc380745b0 0x7fdc380769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.580+0000 7fdc58990640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc3806af70 0x7fdc3806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.580+0000 7fb68a3e8640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] conn(0x7fb668074430 0x7fb668076870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7fa497f1d640 1 Processor -- start 2023-11-04T01:36:11.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7fa497f1d640 1 -- start start 2023-11-04T01:36:11.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7fdc59992640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] conn(0x7fdc380745b0 0x7fdc380769f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7fb3a1a44640 1 Processor -- start 2023-11-04T01:36:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7fdc58990640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc3806af70 0x7fdc3806d430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc44036000 tx=0x7fdc4403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 0x7fa49006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa490141e20 0x7fa4901edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa490142480 0x7fa4900b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa490149080 con 0x7fa4900cafb0 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa495cb9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 0x7fa49006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa495cb9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 0x7fa49006d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48150/0 (socket says 172.21.15.93:48150) 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa495cb9640 1 -- 172.21.15.93:0/2680647148 learned_addr learned my addr 172.21.15.93:0/2680647148 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49006e1f0 con 0x7fa490142480 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49006e4d0 con 0x7fa490141e20 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7f8d6b7fe640 1 --2- 172.21.15.93:0/3697538944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009870 tx=0x7f8d6002b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5552d2300f2a3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7f8d69ffb640 1 -- 172.21.15.93:0/3697538944 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60030710 con 0x7f8d6c06b810 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7f8d69ffb640 1 -- 172.21.15.93:0/3697538944 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6002e050 con 0x7f8d6c06b810 2023-11-04T01:36:11.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7f8d69ffb640 1 -- 172.21.15.93:0/3697538944 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60030a90 con 0x7f8d6c06b810 2023-11-04T01:36:11.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 shutdown_connections 2023-11-04T01:36:11.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.581+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/91448582 wait complete. 2023-11-04T01:36:11.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== osd.5 v2:172.21.15.125:6805/2630302118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fb668076f40 con 0x7fb668074430 2023-11-04T01:36:11.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 -- 172.21.15.93:0/2680647148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa490141e20 msgr2=0x7fa4901edc60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:11.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa490141e20 0x7fa4901edc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 -- 172.21.15.93:0/2680647148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa490142480 msgr2=0x7fa4900b19f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa490142480 0x7fa4900b19f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c00d040 con 0x7fa4900cafb0 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa495cb9640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 0x7fa49006d9a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007130 tx=0x7fa48c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c030b40 con 0x7fa4900cafb0 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c030ca0 con 0x7fa4900cafb0 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 -- 172.21.15.93:0/3697538944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 msgr2=0x7f8d6c06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 --2- 172.21.15.93:0/3697538944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009870 tx=0x7f8d6002b7d0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 -- 172.21.15.93:0/3697538944 shutdown_connections 2023-11-04T01:36:11.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 --2- 172.21.15.93:0/3697538944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c06b810 0x7f8d6c06bc80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 --2- 172.21.15.93:0/3697538944 >> v2:172.21.15.93:3300/0 conn(0x7f8d6c0cf130 0x7f8d6c164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7f8d7150c640 1 -- 172.21.15.93:0/3697538944 >> 172.21.15.93:0/3697538944 conn(0x7f8d6c0d2e20 msgr2=0x7f8d6c0d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c043660 con 0x7fa4900cafb0 2023-11-04T01:36:11.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49006e7b0 con 0x7fa4900cafb0 2023-11-04T01:36:11.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7f6a3c8c3640 1 Processor -- start 2023-11-04T01:36:11.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7f6a3c8c3640 1 -- start start 2023-11-04T01:36:11.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49006dee0 con 0x7fa4900cafb0 2023-11-04T01:36:11.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.582+0000 7fb3a1a44640 1 -- start start 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb39c158c80 0x7fb39c14e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb39c159060 0x7fb39c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c152cf0 con 0x7fb39c158c80 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c14d570 con 0x7fb39c159060 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb3a1a44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c0c8130 con 0x7fb39c0ce4c0 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb39affd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.585+0000 7f8d7150c640 1 -- 172.21.15.93:0/3697538944 shutdown_connections 2023-11-04T01:36:11.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb39affd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54614/0 (socket says 172.21.15.93:54614) 2023-11-04T01:36:11.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb39affd640 1 -- 172.21.15.93:0/2949573818 learned_addr learned my addr 172.21.15.93:0/2949573818 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.583+0000 7fb39a7fc640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb39c158c80 0x7fb39c14e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb39c159060 0x7fb39c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7fb39b7fe640 1 -- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 msgr2=0x7fb39c14cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb39c0ce4c0 0x7fb39c14cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.584+0000 7fb39b7fe640 1 -- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb39c158c80 msgr2=0x7fb39c14e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.585+0000 7f8d7150c640 1 -- 172.21.15.93:0/3697538944 wait complete. 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.586+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa48c0437c0 con 0x7fa4900cafb0 2023-11-04T01:36:11.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.586+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4900703d0 con 0x7fa4900cafb0 2023-11-04T01:36:11.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.586+0000 7f6a3c8c3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 0x7f6a300dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.586+0000 7fa4867fc640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa47406af40 0x7fa47406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.586+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa48c0b0360 con 0x7fa4900cafb0 2023-11-04T01:36:11.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a377fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 0x7f6a300dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fa4954b8640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa47406af40 0x7fa47406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fa4867fc640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] conn(0x7fa474074580 0x7fa4740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa474077090 con 0x7fa474074580 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa48c0b28c0 con 0x7fa4900cafb0 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb39c158c80 0x7fb39c14e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fb39b7fe640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394009b30 con 0x7fb39c159060 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a377fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 0x7f6a300dd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48164/0 (socket says 172.21.15.93:48164) 2023-11-04T01:36:11.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a377fe640 1 -- 172.21.15.93:0/3672917941 learned_addr learned my addr 172.21.15.93:0/3672917941 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a30048610 0x7f6a300dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fb39a7fc640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb39c158c80 0x7fb39c14e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:11.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f8d7150c640 1 Processor -- start 2023-11-04T01:36:11.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a300cb850 0x7f6a300cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30049670 con 0x7f6a28003b00 2023-11-04T01:36:11.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3004bbd0 con 0x7f6a300cb850 2023-11-04T01:36:11.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300cf9b0 con 0x7f6a30048610 2023-11-04T01:36:11.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fa4964ba640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] conn(0x7fa474074580 0x7fa4740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fb39b7fe640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb39c159060 0x7fb39c0b38a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0cb040 tx=0x7fb394004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7f8d7150c640 1 -- start start 2023-11-04T01:36:11.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 -- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a30048610 msgr2=0x7f6a300dd7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:11.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6a30048610 0x7f6a300dd7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 -- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a300cb850 msgr2=0x7f6a300cbd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a300cb850 0x7f6a300cbd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30048af0 con 0x7f6a28003b00 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a377fe640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 0x7f6a300dd260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c007f70 tx=0x7f6a2c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.588+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00ae30 con 0x7f6a28003b00 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7fa4964ba640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] conn(0x7fa474074580 0x7fa4740769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0070d0 con 0x7f6a28003b00 2023-11-04T01:36:11.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7fa4954b8640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa47406af40 0x7fa47406d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa490159400 tx=0x7fa480006c20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c007460 con 0x7f6a28003b00 2023-11-04T01:36:11.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7f8d7150c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 0x7f8d6c0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a30048dd0 con 0x7f6a28003b00 2023-11-04T01:36:11.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.587+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== osd.0 v2:172.21.15.93:6808/3068021929 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fdc380770c0 con 0x7fdc380745b0 2023-11-04T01:36:11.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39403e450 con 0x7fb39c159060 2023-11-04T01:36:11.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7fb3a1a44640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c0c8410 con 0x7fb39c159060 2023-11-04T01:36:11.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7fb3a1a44640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c15c950 con 0x7fb39c159060 2023-11-04T01:36:11.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.590+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39403e5b0 con 0x7fb39c159060 2023-11-04T01:36:11.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.589+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a30049390 con 0x7f6a28003b00 2023-11-04T01:36:11.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.591+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39403e940 con 0x7fb39c159060 2023-11-04T01:36:11.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb37c000fc0 con 0x7fb39c159060 2023-11-04T01:36:11.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.592+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a2c03c040 con 0x7f6a28003b00 2023-11-04T01:36:11.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.591+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== osd.3 v2:172.21.15.93:6824/4011119730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fa474077090 con 0x7fa474074580 2023-11-04T01:36:11.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d7150c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c0cf130 0x7f8d6c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d7150c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d6c161430 0x7f8d6c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 0x7f8d6c0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 0x7f8d6c0c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48170/0 (socket says 172.21.15.93:48170) 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d6affd640 1 -- 172.21.15.93:0/1714001999 learned_addr learned my addr 172.21.15.93:0/1714001999 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0c9610 con 0x7f8d6c06b810 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0c9330 con 0x7f8d6c161430 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c154520 con 0x7f8d6c0cf130 2023-11-04T01:36:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.592+0000 7f6a23fff640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6a1c06aea0 0x7f6a1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d6a7fc640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c0cf130 0x7f8d6c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a2c0aa9e0 con 0x7f6a28003b00 2023-11-04T01:36:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.593+0000 7f8d6b7fe640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d6c161430 0x7f8d6c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb39402cd50 con 0x7fb39c159060 2023-11-04T01:36:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7fb383fff640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb38806af40 0x7fb38806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f8d6affd640 1 -- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c0cf130 msgr2=0x7f8d6c0b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f8d6affd640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6c0cf130 0x7f8d6c0b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f8d6affd640 1 -- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d6c161430 msgr2=0x7f8d6c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f8d6affd640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d6c161430 0x7f8d6c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f8d6affd640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009a70 con 0x7f8d6c06b810 2023-11-04T01:36:11.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3940ac3d0 con 0x7fb39c159060 2023-11-04T01:36:11.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7fb39affd640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb38806af40 0x7fb38806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7fb383fff640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] conn(0x7fb388074410 0x7fb388076850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb388076f20 con 0x7fb388074410 2023-11-04T01:36:11.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3940ae9f0 con 0x7fb39c159060 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f6a21ffb640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] conn(0x7f6a180015e0 0x7f6a18003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.594+0000 7f6a21ffb640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a18006b40 con 0x7f6a180015e0 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.595+0000 7f6a36ffd640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6a1c06aea0 0x7f6a1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f6a37fff640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] conn(0x7f6a180015e0 0x7f6a18003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7fb39a7fc640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] conn(0x7fb388074410 0x7fb388076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f8d6affd640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 0x7f8d6c0c5970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c5f0 tx=0x7f8d5c00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0074e0 con 0x7f8d6c06b810 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d600094d0 con 0x7f8d6c06b810 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c154ae0 con 0x7f8d6c06b810 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.596+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c007640 con 0x7f8d6c06b810 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.597+0000 7fb39a7fc640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] conn(0x7fb388074410 0x7fb388076850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.598+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c004a00 con 0x7f8d6c06b810 2023-11-04T01:36:11.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.598+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d4c000fc0 con 0x7f8d6c06b810 2023-11-04T01:36:11.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.598+0000 7f6a36ffd640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6a1c06aea0 0x7f6a1c06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a3804fc70 tx=0x7f6a38066f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.598+0000 7fb39affd640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb38806af40 0x7fb38806d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb390006fd0 tx=0x7fb390008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.598+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== osd.4 v2:172.21.15.125:6800/3102287272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fb388076f20 con 0x7fb388074410 2023-11-04T01:36:11.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.600+0000 7f6a37fff640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] conn(0x7f6a180015e0 0x7f6a18003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.600+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d5c004b60 con 0x7f8d6c06b810 2023-11-04T01:36:11.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.600+0000 7f8d537fe640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d5806aea0 0x7f8d5806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== osd.7 v2:172.21.15.125:6824/2987748688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f6a18006b40 con 0x7f6a180015e0 2023-11-04T01:36:11.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d5c089170 con 0x7f8d6c06b810 2023-11-04T01:36:11.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d537fe640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] conn(0x7f8d580744e0 0x7f8d58076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d58076ff0 con 0x7f8d580744e0 2023-11-04T01:36:11.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d5c089520 con 0x7f8d6c06b810 2023-11-04T01:36:11.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d6b7fe640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] conn(0x7f8d580744e0 0x7f8d58076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.601+0000 7f8d6a7fc640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d5806aea0 0x7f8d5806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.603+0000 7f8d6a7fc640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d5806aea0 0x7f8d5806d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009fd0 tx=0x7f8d6400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.608+0000 7f8d6b7fe640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] conn(0x7f8d580744e0 0x7f8d58076920 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.609+0000 7f30cbed7640 1 -- 172.21.15.93:0/1406277122 --> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30ac002ca0 con 0x7f30a8074580 2023-11-04T01:36:11.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.609+0000 7f30ba7fc640 1 -- 172.21.15.93:0/1406277122 <== osd.2 v2:172.21.15.93:6816/3080870995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30ac002ca0 con 0x7f30a8074580 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] conn(0x7f30a8074580 msgr2=0x7f30a80769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6816/3080870995,v1:172.21.15.93:6817/3080870995] conn(0x7f30a8074580 0x7f30a80769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30a806af40 msgr2=0x7f30a806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30a806af40 0x7f30a806d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f30c0036000 tx=0x7f30c003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 msgr2=0x7f30c414d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30a7fff640 1 --2- 172.21.15.93:0/1406277122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30c40b1860 0x7f30c414d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00eed0 tx=0x7f30bc00b480 comp rx=0 tx=0).stop 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.610+0000 7f30ca474640 1 -- 172.21.15.93:0/1406277122 reap_dead start 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.611+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 shutdown_connections 2023-11-04T01:36:11.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.611+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 >> 172.21.15.93:0/1406277122 conn(0x7f30c406c7a0 msgr2=0x7f30c4071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.609+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== osd.6 v2:172.21.15.125:6816/4082567317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f8d58076ff0 con 0x7f8d580744e0 2023-11-04T01:36:11.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.612+0000 7f7687bee640 1 Processor -- start 2023-11-04T01:36:11.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.612+0000 7f7687bee640 1 -- start start 2023-11-04T01:36:11.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.613+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 shutdown_connections 2023-11-04T01:36:11.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.613+0000 7f30a7fff640 1 -- 172.21.15.93:0/1406277122 wait complete. 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.613+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 --> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb66c002cb0 con 0x7fb668074430 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7687bee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7687bee640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f76800cd3b0 0x7f76800cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7687bee640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76800d01f0 con 0x7f768015af20 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7687bee640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76800cc380 con 0x7f76800cd3b0 2023-11-04T01:36:11.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7687bee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800cdd80 con 0x7f76800b64c0 2023-11-04T01:36:11.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.615+0000 7fdc5a193640 1 -- 172.21.15.93:0/933803248 --> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc540cbfe0 con 0x7fdc380745b0 2023-11-04T01:36:11.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fdc49ffb640 1 -- 172.21.15.93:0/933803248 <== osd.0 v2:172.21.15.93:6808/3068021929 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc4c001a20 con 0x7fdc380745b0 2023-11-04T01:36:11.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] conn(0x7fdc380745b0 msgr2=0x7fdc380769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6808/3068021929,v1:172.21.15.93:6809/3068021929] conn(0x7fdc380745b0 0x7fdc380769f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc3806af70 msgr2=0x7fdc3806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc3806af70 0x7fdc3806d430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc44036000 tx=0x7fdc4403d040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 msgr2=0x7fdc54150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc3f7fe640 1 --2- 172.21.15.93:0/933803248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc5406f090 0x7fdc54150620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c460 tx=0x7fdc5000c920 comp rx=0 tx=0).stop 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fdc59992640 1 -- 172.21.15.93:0/933803248 reap_dead start 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54656/0 (socket says 172.21.15.93:54656) 2023-11-04T01:36:11.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 -- 172.21.15.93:0/3000007129 learned_addr learned my addr 172.21.15.93:0/3000007129 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 -- 172.21.15.93:0/3000007129 >> v2:172.21.15.93:3300/0 conn(0x7f76800cd3b0 msgr2=0x7f76800cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 --2- 172.21.15.93:0/3000007129 >> v2:172.21.15.93:3300/0 conn(0x7f76800cd3b0 0x7f76800cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 -- 172.21.15.93:0/3000007129 >> v1:172.21.15.125:6789/0 conn(0x7f768015af20 legacy=0x7f76800cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:11.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7f7685189640 1 -- 172.21.15.93:0/3000007129 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800b6a40 con 0x7f76800b64c0 2023-11-04T01:36:11.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.614+0000 7fb67a7fc640 1 -- 172.21.15.93:0/3098586699 <== osd.5 v2:172.21.15.125:6805/2630302118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb66c002cb0 con 0x7fb668074430 2023-11-04T01:36:11.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] conn(0x7fb668074430 msgr2=0x7fb668076870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:6805/2630302118,v1:172.21.15.125:6807/2630302118] conn(0x7fb668074430 0x7fb668076870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb66806ae70 msgr2=0x7fb66806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb66806ae70 0x7fb66806d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb680001960 tx=0x7fb680009040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 msgr2=0x7fb6840b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 --2- 172.21.15.93:0/3098586699 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6840c8bd0 0x7fb6840b36e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb67c001be0 tx=0x7fb67c00a700 comp rx=0 tx=0).stop 2023-11-04T01:36:11.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68a3e8640 1 -- 172.21.15.93:0/3098586699 reap_dead start 2023-11-04T01:36:11.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 shutdown_connections 2023-11-04T01:36:11.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.616+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 >> 172.21.15.93:0/3098586699 conn(0x7fb68406d800 msgr2=0x7fb6840ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 shutdown_connections 2023-11-04T01:36:11.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.617+0000 7fb68be4b640 1 -- 172.21.15.93:0/3098586699 wait complete. 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.618+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 shutdown_connections 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.618+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 >> 172.21.15.93:0/933803248 conn(0x7fdc540cf810 msgr2=0x7fdc540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.619+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 shutdown_connections 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.619+0000 7fdc3f7fe640 1 -- 172.21.15.93:0/933803248 wait complete. 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.620+0000 7fa497f1d640 1 -- 172.21.15.93:0/2680647148 --> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4900703d0 con 0x7fa474074580 2023-11-04T01:36:11.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.621+0000 7fa4867fc640 1 -- 172.21.15.93:0/2680647148 <== osd.3 v2:172.21.15.93:6824/4011119730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4900703d0 con 0x7fa474074580 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.622+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] conn(0x7fa474074580 msgr2=0x7fa4740769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.622+0000 7fa473fff640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6824/4011119730,v1:172.21.15.93:6825/4011119730] conn(0x7fa474074580 0x7fa4740769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.622+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa47406af40 msgr2=0x7fa47406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.622+0000 7fa473fff640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa47406af40 0x7fa47406d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa490159400 tx=0x7fa480006c20 comp rx=0 tx=0).stop 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 msgr2=0x7fa49006d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 --2- 172.21.15.93:0/2680647148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4900cafb0 0x7fa49006d9a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007130 tx=0x7fa48c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa4964ba640 1 -- 172.21.15.93:0/2680647148 reap_dead start 2023-11-04T01:36:11.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 shutdown_connections 2023-11-04T01:36:11.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 >> 172.21.15.93:0/2680647148 conn(0x7fa49006a120 msgr2=0x7fa49013e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 shutdown_connections 2023-11-04T01:36:11.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.623+0000 7fa473fff640 1 -- 172.21.15.93:0/2680647148 wait complete. 2023-11-04T01:36:11.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.624+0000 7f7685189640 1 --2- 172.21.15.93:0/3000007129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30541df603a63ffb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.627+0000 7f7684988640 1 -- 172.21.15.93:0/3000007129 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670031640 con 0x7f76800b64c0 2023-11-04T01:36:11.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.627+0000 7f7684988640 1 -- 172.21.15.93:0/3000007129 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700317a0 con 0x7f76800b64c0 2023-11-04T01:36:11.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.627+0000 7f7684988640 1 -- 172.21.15.93:0/3000007129 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670031640 con 0x7f76800b64c0 2023-11-04T01:36:11.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.628+0000 7f6a21ffb640 1 -- 172.21.15.93:0/3672917941 --> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a18005bc0 con 0x7f6a180015e0 2023-11-04T01:36:11.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 -- 172.21.15.93:0/3000007129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 msgr2=0x7f76800b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 --2- 172.21.15.93:0/3000007129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:11.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f6a23fff640 1 -- 172.21.15.93:0/3672917941 <== osd.7 v2:172.21.15.125:6824/2987748688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a18005bc0 con 0x7f6a180015e0 2023-11-04T01:36:11.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 -- 172.21.15.93:0/3000007129 shutdown_connections 2023-11-04T01:36:11.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 --2- 172.21.15.93:0/3000007129 >> v2:172.21.15.93:3300/0 conn(0x7f76800cd3b0 0x7f76800cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 --2- 172.21.15.93:0/3000007129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f76800b64c0 0x7f76800b3cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.629+0000 7f7687bee640 1 -- 172.21.15.93:0/3000007129 >> 172.21.15.93:0/3000007129 conn(0x7f768006ea20 msgr2=0x7f768006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.630+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] conn(0x7f6a180015e0 msgr2=0x7f6a18003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.630+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.125:6824/2987748688,v1:172.21.15.125:6825/2987748688] conn(0x7f6a180015e0 0x7f6a18003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.631+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6a1c06aea0 msgr2=0x7f6a1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.631+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6a1c06aea0 0x7f6a1c06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6a3804fc70 tx=0x7f6a38066f00 comp rx=0 tx=0).stop 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.631+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 msgr2=0x7f6a300dd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.631+0000 7f6a3c8c3640 1 --2- 172.21.15.93:0/3672917941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a28003b00 0x7f6a300dd260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c007f70 tx=0x7f6a2c001930 comp rx=0 tx=0).stop 2023-11-04T01:36:11.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.631+0000 7f6a37fff640 1 -- 172.21.15.93:0/3672917941 reap_dead start 2023-11-04T01:36:11.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f7687bee640 1 -- 172.21.15.93:0/3000007129 shutdown_connections 2023-11-04T01:36:11.728 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:11.729 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:11.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f7687bee640 1 -- 172.21.15.93:0/3000007129 wait complete. 2023-11-04T01:36:11.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 shutdown_connections 2023-11-04T01:36:11.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 >> 172.21.15.93:0/3672917941 conn(0x7f6a30054b00 msgr2=0x7f6a300db020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 shutdown_connections 2023-11-04T01:36:11.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.632+0000 7f6a3c8c3640 1 -- 172.21.15.93:0/3672917941 wait complete. 2023-11-04T01:36:11.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.634+0000 7f7687bee640 1 Processor -- start 2023-11-04T01:36:11.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.634+0000 7f7687bee640 1 -- start start 2023-11-04T01:36:11.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.635+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 --> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb37c002ca0 con 0x7fb388074410 2023-11-04T01:36:11.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.635+0000 7f7687bee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 0x7f768014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.635+0000 7f7687bee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76800cd3b0 0x7f76800ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.635+0000 7f7687bee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f768015af20 0x7f76800c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 0x7f768014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 0x7f768014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33464/0 (socket says 172.21.15.93:33464) 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 -- 172.21.15.93:0/2112658057 learned_addr learned my addr 172.21.15.93:0/2112658057 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768618b640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f768015af20 0x7f76800c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c6c10 con 0x7f76800cd3b0 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c6650 con 0x7f76800b64c0 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c6930 con 0x7f768015af20 2023-11-04T01:36:11.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7fb383fff640 1 -- 172.21.15.93:0/2949573818 <== osd.4 v2:172.21.15.125:6800/3102287272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb37c002ca0 con 0x7fb388074410 2023-11-04T01:36:11.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f7685189640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76800cd3b0 0x7f76800ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] conn(0x7fb388074410 msgr2=0x7fb388076850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7fb381ffb640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:6800/3102287272,v1:172.21.15.125:6801/3102287272] conn(0x7fb388074410 0x7fb388076850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 -- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f768015af20 msgr2=0x7f76800c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f768015af20 0x7f76800c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 -- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76800cd3b0 msgr2=0x7f76800ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76800cd3b0 0x7f76800ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.636+0000 7f768598a640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700094d0 con 0x7f76800b64c0 2023-11-04T01:36:11.739 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:11.740 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:11.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb38806af40 msgr2=0x7fb38806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb38806af40 0x7fb38806d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb390006fd0 tx=0x7fb390008040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7f768598a640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 0x7f768014e560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f767800ba50 tx=0x7f767800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb39c159060 msgr2=0x7fb39c0b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 --2- 172.21.15.93:0/2949573818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb39c159060 0x7fb39c0b38a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0cb040 tx=0x7fb394004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:11.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb39b7fe640 1 -- 172.21.15.93:0/2949573818 reap_dead start 2023-11-04T01:36:11.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800cbe0 con 0x7f76800b64c0 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 shutdown_connections 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 >> 172.21.15.93:0/2949573818 conn(0x7fb39c06a120 msgr2=0x7fb39c155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800b06e0 con 0x7f76800b64c0 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800cd80 con 0x7f76800b64c0 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768014eac0 con 0x7f76800b64c0 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 shutdown_connections 2023-11-04T01:36:11.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.637+0000 7fb381ffb640 1 -- 172.21.15.93:0/2949573818 wait complete. 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.638+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678014680 con 0x7f76800b64c0 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.639+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76780148a0 con 0x7f76800b64c0 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.639+0000 7f76767fc640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f766406aec0 0x7f766406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76800d0790 con 0x7f76800b64c0 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7678089650 con 0x7f76800b64c0 2023-11-04T01:36:11.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f7685189640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f766406aec0 0x7f766406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.748 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:11.749 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:11.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f76767fc640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] conn(0x7f7664074310 0x7f7664076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:11.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7664076e20 con 0x7f7664074310 2023-11-04T01:36:11.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7678009930 con 0x7f76800b64c0 2023-11-04T01:36:11.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.640+0000 7f768618b640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] conn(0x7f7664074310 0x7f7664076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:11.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.641+0000 7f7685189640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f766406aec0 0x7f766406d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f7670008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.641+0000 7f768618b640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] conn(0x7f7664074310 0x7f7664076750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:11.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.642+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== osd.1 v2:172.21.15.93:6800/2623679104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f7664076e20 con 0x7f7664074310 2023-11-04T01:36:11.760 INFO:teuthology.orchestra.run.smithi093.stdout:55834574859 2023-11-04T01:36:11.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.643+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 --> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d4c002ca0 con 0x7f8d580744e0 2023-11-04T01:36:11.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.644+0000 7f8d537fe640 1 -- 172.21.15.93:0/1714001999 <== osd.6 v2:172.21.15.125:6816/4082567317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d4c002ca0 con 0x7f8d580744e0 2023-11-04T01:36:11.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.644+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] conn(0x7f8d580744e0 msgr2=0x7f8d58076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.644+0000 7f8d7150c640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.125:6816/4082567317,v1:172.21.15.125:6817/4082567317] conn(0x7f8d580744e0 0x7f8d58076920 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d5806aea0 msgr2=0x7f8d5806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d5806aea0 0x7f8d5806d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009fd0 tx=0x7f8d6400b040 comp rx=0 tx=0).stop 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 msgr2=0x7f8d6c0c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 --2- 172.21.15.93:0/1714001999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6c06b810 0x7f8d6c0c5970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c5f0 tx=0x7f8d5c00cab0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d6b7fe640 1 -- 172.21.15.93:0/1714001999 reap_dead start 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 shutdown_connections 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 >> 172.21.15.93:0/1714001999 conn(0x7f8d6c0d2e20 msgr2=0x7f8d6c1640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 shutdown_connections 2023-11-04T01:36:11.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.645+0000 7f8d7150c640 1 -- 172.21.15.93:0/1714001999 wait complete. 2023-11-04T01:36:11.764 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:11.773 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:11.775 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:11.778 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:11.779 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:11.779 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:11.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.657+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 --> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76800d04b0 con 0x7f7664074310 2023-11-04T01:36:11.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f76767fc640 1 -- 172.21.15.93:0/2112658057 <== osd.1 v2:172.21.15.93:6800/2623679104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f767c009550 con 0x7f7664074310 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] conn(0x7f7664074310 msgr2=0x7f7664076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6800/2623679104,v1:172.21.15.93:6801/2623679104] conn(0x7f7664074310 0x7f7664076750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f766406aec0 msgr2=0x7f766406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f766406aec0 0x7f766406d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f7670008030 comp rx=0 tx=0).stop 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 msgr2=0x7f768014e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:11.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 --2- 172.21.15.93:0/2112658057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f76800b64c0 0x7f768014e560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f767800ba50 tx=0x7f767800bf10 comp rx=0 tx=0).stop 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f768618b640 1 -- 172.21.15.93:0/2112658057 reap_dead start 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 shutdown_connections 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 >> 172.21.15.93:0/2112658057 conn(0x7f768006ea20 msgr2=0x7f76800cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 shutdown_connections 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.658+0000 7f7687bee640 1 -- 172.21.15.93:0/2112658057 wait complete. 2023-11-04T01:36:11.783 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:11.784 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.993+0000 7fc7c2505640 1 Processor -- start 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.993+0000 7fc7c2505640 1 -- start start 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.995+0000 7fc7c2505640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.995+0000 7fc7c2505640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc0cbcc0 0x7fc7bc1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.995+0000 7fc7c2505640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc14aa80 con 0x7fc7bc164db0 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.995+0000 7fc7c2505640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc0cb290 con 0x7fc7bc14a6a0 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.995+0000 7fc7c2505640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc165900 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.996+0000 7fc7bbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.996+0000 7fc7bbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48190/0 (socket says 172.21.15.93:48190) 2023-11-04T01:36:12.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.996+0000 7fc7bbfff640 1 -- 172.21.15.93:0/1466308293 learned_addr learned my addr 172.21.15.93:0/1466308293 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.996+0000 7f3aef59e640 1 Processor -- start 2023-11-04T01:36:12.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7f3aef59e640 1 -- start start 2023-11-04T01:36:12.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7fc7baffd640 1 -- 172.21.15.93:0/1466308293 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470489631 0 0) 0x7fc7bc14aa80 con 0x7fc7bc164db0 2023-11-04T01:36:12.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7fc7bbfff640 1 -- 172.21.15.93:0/1466308293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc0cbcc0 msgr2=0x7fc7bc1651f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:12.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7fc7bbfff640 1 --2- 172.21.15.93:0/1466308293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc0cbcc0 0x7fc7bc1651f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7fc7bbfff640 1 -- 172.21.15.93:0/1466308293 >> v1:172.21.15.93:6789/0 conn(0x7fc7bc164db0 legacy=0x7fc7bc0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aef59e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3af0161110 0x7f3af00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aef59e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 0x7f3af00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aef59e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af0164de0 con 0x7f3af01614f0 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aef59e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af006ccc0 con 0x7f3af00c1dd0 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aef59e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00cf5d0 con 0x7f3af0161110 2023-11-04T01:36:12.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.997+0000 7fc7bbfff640 1 -- 172.21.15.93:0/1466308293 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc165be0 con 0x7fc7bc14a6a0 2023-11-04T01:36:12.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aedd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3af01614f0 0x7f3af006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54310/0 (socket says 172.21.15.93:54310) 2023-11-04T01:36:12.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7f3aedd9b640 1 -- 172.21.15.93:0/362236985 learned_addr learned my addr 172.21.15.93:0/362236985 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:12.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aee59c640 1 --2- 172.21.15.93:0/362236985 >> v2:172.21.15.125:3300/0 conn(0x7f3af0161110 0x7f3af00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286316265 0 0) 0x7f3af0164de0 con 0x7f3af01614f0 2023-11-04T01:36:12.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad8003520 con 0x7f3af01614f0 2023-11-04T01:36:12.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7fc7bbfff640 1 --2- 172.21.15.93:0/1466308293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009870 tx=0x7fc7ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6003ae09a320d5fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aee59c640 1 -- 172.21.15.93:0/362236985 >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 msgr2=0x7f3af00cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aeed9d640 1 --2- 172.21.15.93:0/362236985 >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 0x7f3af00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7fc7baffd640 1 -- 172.21.15.93:0/1466308293 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac030860 con 0x7fc7bc14a6a0 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7efc174e5640 1 Processor -- start 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.998+0000 7efc174e5640 1 -- start start 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aee59c640 1 --2- 172.21.15.93:0/362236985 >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 0x7f3af00cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aee59c640 1 -- 172.21.15.93:0/362236985 >> v1:172.21.15.93:6789/0 conn(0x7f3af01614f0 legacy=0x7f3af006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aee59c640 1 -- 172.21.15.93:0/362236985 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0070da0 con 0x7f3af0161110 2023-11-04T01:36:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823871060 0 0) 0x7f3ad8003520 con 0x7f3af01614f0 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7efc174e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc100cad50 0x7efc100cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7efc174e5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc100cbaf0 0x7efc100cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7efc174e5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1014aa80 con 0x7efc1014a6a0 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7efc174e5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc100cbf80 con 0x7efc100cbaf0 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:11.999+0000 7efc174e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc10165900 con 0x7efc100cad50 2023-11-04T01:36:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7f0cc54fc640 1 Processor -- start 2023-11-04T01:36:12.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7fc7baffd640 1 -- 172.21.15.93:0/1466308293 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0309c0 con 0x7fc7bc14a6a0 2023-11-04T01:36:12.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc100cbaf0 0x7efc100cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc100cbaf0 0x7efc100cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48214/0 (socket says 172.21.15.93:48214) 2023-11-04T01:36:12.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 -- 172.21.15.93:0/124823308 learned_addr learned my addr 172.21.15.93:0/124823308 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7f3aeed9d640 1 --2- 172.21.15.93:0/362236985 >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 0x7f3af00cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7fc7c2505640 1 -- 172.21.15.93:0/1466308293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc14a6a0 msgr2=0x7fc7bc0cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7fc7c2505640 1 --2- 172.21.15.93:0/1466308293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009870 tx=0x7fc7ac02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 -- 172.21.15.93:0/124823308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc100cad50 msgr2=0x7efc100cb5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:12.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 --2- 172.21.15.93:0/124823308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc100cad50 0x7efc100cb5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 -- 172.21.15.93:0/124823308 >> v1:172.21.15.125:6789/0 conn(0x7efc1014a6a0 legacy=0x7efc10164db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:12.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7efc15a82640 1 -- 172.21.15.93:0/124823308 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10165be0 con 0x7efc100cbaf0 2023-11-04T01:36:12.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f3aee59c640 1 --2- 172.21.15.93:0/362236985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0161110 0x7f3af00cf090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3af006b010 tx=0x7f3ae002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a467880481e0ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7efc15a82640 1 --2- 172.21.15.93:0/124823308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc100cc520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc08009e50 tx=0x7efc0802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab9752d80aff1e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.000+0000 7f0cc54fc640 1 -- start start 2023-11-04T01:36:12.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00317c0 con 0x7f3af0161110 2023-11-04T01:36:12.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7efc07fff640 1 -- 172.21.15.93:0/124823308 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0802caa0 con 0x7efc100cbaf0 2023-11-04T01:36:12.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7efc07fff640 1 -- 172.21.15.93:0/124823308 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0802cc00 con 0x7efc100cbaf0 2023-11-04T01:36:12.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7efc07fff640 1 -- 172.21.15.93:0/124823308 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080343f0 con 0x7efc100cbaf0 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cc54fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0cc0164760 0x7f0cc00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cc54fc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00ccc90 con 0x7f0cc00cc520 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cbeffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0cc0164760 0x7f0cc00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cbeffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0cc0164760 0x7f0cc00c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48228/0 (socket says 172.21.15.93:48228) 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cbeffd640 1 -- 172.21.15.93:0/3122792581 learned_addr learned my addr 172.21.15.93:0/3122792581 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00ccf70 con 0x7f0cc0070710 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.001+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc0164b40 con 0x7f0cc0164760 2023-11-04T01:36:12.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0031920 con 0x7f3af0161110 2023-11-04T01:36:12.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f3aed59a640 1 -- 172.21.15.93:0/362236985 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0031c90 con 0x7f3af0161110 2023-11-04T01:36:12.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f0cbeffd640 1 -- 172.21.15.93:0/3122792581 >> v1:172.21.15.125:6789/0 conn(0x7f0cc0070710 legacy=0x7f0cc00cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f0cbeffd640 1 -- 172.21.15.93:0/3122792581 >> v1:172.21.15.93:6789/0 conn(0x7f0cc00cc520 legacy=0x7f0cc00b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.002+0000 7f0cbeffd640 1 -- 172.21.15.93:0/3122792581 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00cd250 con 0x7f0cc0164760 2023-11-04T01:36:12.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 -- 172.21.15.93:0/362236985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0161110 msgr2=0x7f3af00cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 -- 172.21.15.93:0/1466308293 shutdown_connections 2023-11-04T01:36:12.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 --2- 172.21.15.93:0/1466308293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc0cbcc0 0x7fc7bc1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 --2- 172.21.15.93:0/1466308293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc0cad50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 -- 172.21.15.93:0/1466308293 >> 172.21.15.93:0/1466308293 conn(0x7fc7bc06a120 msgr2=0x7fc7bc06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 --2- 172.21.15.93:0/362236985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0161110 0x7f3af00cf090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3af006b010 tx=0x7f3ae002b860 comp rx=0 tx=0).stop 2023-11-04T01:36:12.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 -- 172.21.15.93:0/1466308293 shutdown_connections 2023-11-04T01:36:12.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 -- 172.21.15.93:0/362236985 shutdown_connections 2023-11-04T01:36:12.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 -- 172.21.15.93:0/124823308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 msgr2=0x7efc100cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 --2- 172.21.15.93:0/124823308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc100cc520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc08009e50 tx=0x7efc0802bf00 comp rx=0 tx=0).stop 2023-11-04T01:36:12.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 -- 172.21.15.93:0/124823308 shutdown_connections 2023-11-04T01:36:12.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 --2- 172.21.15.93:0/124823308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc100cc520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 --2- 172.21.15.93:0/124823308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc100cad50 0x7efc100cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 -- 172.21.15.93:0/124823308 >> 172.21.15.93:0/124823308 conn(0x7efc1006a120 msgr2=0x7efc1006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 --2- 172.21.15.93:0/362236985 >> v2:172.21.15.93:3300/0 conn(0x7f3af00c1dd0 0x7f3af00cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 --2- 172.21.15.93:0/362236985 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0161110 0x7f3af00cf090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 -- 172.21.15.93:0/362236985 >> 172.21.15.93:0/362236985 conn(0x7f3af006a120 msgr2=0x7f3af006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 -- 172.21.15.93:0/362236985 shutdown_connections 2023-11-04T01:36:12.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7f3aef59e640 1 -- 172.21.15.93:0/362236985 wait complete. 2023-11-04T01:36:12.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7efc174e5640 1 -- 172.21.15.93:0/124823308 shutdown_connections 2023-11-04T01:36:12.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7f3aef59e640 1 Processor -- start 2023-11-04T01:36:12.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.004+0000 7efc174e5640 1 -- 172.21.15.93:0/124823308 wait complete. 2023-11-04T01:36:12.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7efc174e5640 1 Processor -- start 2023-11-04T01:36:12.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7efc174e5640 1 -- start start 2023-11-04T01:36:12.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7f0cbeffd640 1 --2- 172.21.15.93:0/3122792581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc0164760 0x7f0cc00c4690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009870 tx=0x7f0cb002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bbba11967d155b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 0x7efc100b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc1016d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c7fc0 con 0x7efc100cbaf0 2023-11-04T01:36:12.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c83e0 con 0x7efc100cad50 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f0cbdffb640 1 -- 172.21.15.93:0/3122792581 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0031860 con 0x7f0cc0164760 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f0cbdffb640 1 -- 172.21.15.93:0/3122792581 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00319c0 con 0x7f0cc0164760 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f0cbdffb640 1 -- 172.21.15.93:0/3122792581 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0031d50 con 0x7f0cc0164760 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.003+0000 7fc7c2505640 1 -- 172.21.15.93:0/1466308293 wait complete. 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7fc7c2505640 1 Processor -- start 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7fc7c2505640 1 -- start start 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 0x7fc7bc0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 0x7fc7bc1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13e360 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13e600 con 0x7fc7bc14a6a0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7fc7c2505640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13e8e0 con 0x7fc7bc164db0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.006+0000 7efc174e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c7620 con 0x7efc1014a6a0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54694/0 (socket says 172.21.15.93:54694) 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 -- 172.21.15.93:0/746420710 learned_addr learned my addr 172.21.15.93:0/746420710 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15281640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 0x7efc100b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 -- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 msgr2=0x7efc100b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 0x7efc100b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 -- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 msgr2=0x7efc1016d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc1016d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15a82640 1 -- 172.21.15.93:0/746420710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009b30 con 0x7efc1014a6a0 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7efc15281640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 0x7efc100b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efc15a82640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc08036040 tx=0x7efc08004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 0x7fc7bc0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7c0aa2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 0x7fc7bc1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7c0aa2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 0x7fc7bc1608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54708/0 (socket says 172.21.15.93:54708) 2023-11-04T01:36:12.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7c0aa2640 1 -- 172.21.15.93:0/838869645 learned_addr learned my addr 172.21.15.93:0/838869645 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bb7fe640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 -- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 msgr2=0x7fc7bc1608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 0x7fc7bc1608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 -- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7bc14a6a0 msgr2=0x7fc7bc13de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc13de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7fc7bbfff640 1 -- 172.21.15.93:0/838869645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0094d0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7fc7bbfff640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 0x7fc7bc0b32a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac033000 tx=0x7fc7ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.005+0000 7f3aef59e640 1 -- start start 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 0x7f3af0161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3af0161110 0x7f3af00c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 0x7f3af0162a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c4970 con 0x7f3af00c1dd0 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c5210 con 0x7f3af0162580 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aef59e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af01621d0 con 0x7f3af0161110 2023-11-04T01:36:12.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aedd9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3af0161110 0x7f3af00c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aeed9d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 0x7f3af0162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aee59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 0x7f3af0161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aeed9d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 0x7f3af0162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33498/0 (socket says 172.21.15.93:33498) 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.007+0000 7f3aeed9d640 1 -- 172.21.15.93:0/538313540 learned_addr learned my addr 172.21.15.93:0/538313540 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 -- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3af0161110 msgr2=0x7f3af00c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3af0161110 0x7f3af00c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 -- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 msgr2=0x7f3af0162a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 0x7f3af0162a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 -- 172.21.15.93:0/538313540 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0009400 con 0x7f3af00c1dd0 2023-11-04T01:36:12.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc0164760 msgr2=0x7f0cc00c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f0cc54fc640 1 --2- 172.21.15.93:0/3122792581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc0164760 0x7f0cc00c4690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009870 tx=0x7f0cb002b900 comp rx=0 tx=0).stop 2023-11-04T01:36:12.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0803e450 con 0x7efc1014a6a0 2023-11-04T01:36:12.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 shutdown_connections 2023-11-04T01:36:12.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f0cc54fc640 1 --2- 172.21.15.93:0/3122792581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc0164760 0x7f0cc00c4690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 >> 172.21.15.93:0/3122792581 conn(0x7f0cc00ce950 msgr2=0x7f0cc00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc100c7900 con 0x7efc1014a6a0 2023-11-04T01:36:12.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.009+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 shutdown_connections 2023-11-04T01:36:12.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.009+0000 7f0cc54fc640 1 -- 172.21.15.93:0/3122792581 wait complete. 2023-11-04T01:36:12.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7f3aee59c640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 0x7f3af0161bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0033000 tx=0x7f3ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0803e5b0 con 0x7efc1014a6a0 2023-11-04T01:36:12.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0803e920 con 0x7efc1014a6a0 2023-11-04T01:36:12.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.009+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc10160cd0 con 0x7efc1014a6a0 2023-11-04T01:36:12.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac047070 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.008+0000 7efe34f6a640 1 Processor -- start 2023-11-04T01:36:12.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc13ebc0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7f0cc54fc640 1 Processor -- start 2023-11-04T01:36:12.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7f0cc54fc640 1 -- start start 2023-11-04T01:36:12.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc160de0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac043400 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac043790 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c005250 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf0005250 con 0x7efc1014a6a0 2023-11-04T01:36:12.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0003810 con 0x7f3af00c1dd0 2023-11-04T01:36:12.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.010+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0040070 con 0x7f3af00c1dd0 2023-11-04T01:36:12.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.011+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0003bb0 con 0x7f3af00c1dd0 2023-11-04T01:36:12.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.012+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af00c4bc0 con 0x7f3af00c1dd0 2023-11-04T01:36:12.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.012+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af00c2960 con 0x7f3af00c1dd0 2023-11-04T01:36:12.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc00cc520 0x7f0cc013cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af004ece0 con 0x7f3af00c1dd0 2023-11-04T01:36:12.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc0164760 0x7f0cc00b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00b35f0 con 0x7f0cc00cc520 2023-11-04T01:36:12.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.012+0000 7efe34f6a640 1 -- start start 2023-11-04T01:36:12.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0139200 con 0x7f0cc0164760 2023-11-04T01:36:12.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f6bbb59e640 1 Processor -- start 2023-11-04T01:36:12.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f0cc54fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00b2970 con 0x7f0cc0070710 2023-11-04T01:36:12.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7f6bbb59e640 1 -- start start 2023-11-04T01:36:12.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe34f6a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe28054e20 0x7efe28051d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe34f6a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe28050370 con 0x7efe28008d30 2023-11-04T01:36:12.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc0803ea80 con 0x7efc1014a6a0 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe34f6a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280505c0 con 0x7efe28054990 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe34f6a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280508a0 con 0x7efe28054e20 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe2ffff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe28054e20 0x7efe28051d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe2ffff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe28054e20 0x7efe28051d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33504/0 (socket says 172.21.15.93:33504) 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.013+0000 7efe2ffff640 1 -- 172.21.15.93:0/3424600031 learned_addr learned my addr 172.21.15.93:0/3424600031 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7efe2ffff640 1 -- 172.21.15.93:0/3424600031 >> v1:172.21.15.125:6789/0 conn(0x7efe28054990 legacy=0x7efe28051660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7efe2ffff640 1 -- 172.21.15.93:0/3424600031 >> v1:172.21.15.93:6789/0 conn(0x7efe28008d30 legacy=0x7efe28009110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7efe2ffff640 1 -- 172.21.15.93:0/3424600031 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28050b80 con 0x7efe28054e20 2023-11-04T01:36:12.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7efc05ffb640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 0x7efbfc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7f6bbb59e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6bb40542b0 0x7f6bb4039ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7f6bbb59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbb59e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb4055490 con 0x7f6bb40e11e0 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54728/0 (socket says 172.21.15.93:54728) 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 -- 172.21.15.93:0/1451771165 learned_addr learned my addr 172.21.15.93:0/1451771165 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb4056930 con 0x7f6bb40542b0 2023-11-04T01:36:12.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40552a0 con 0x7f6bb4038ea0 2023-11-04T01:36:12.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.014+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc080ac9c0 con 0x7efc1014a6a0 2023-11-04T01:36:12.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54722/0 (socket says 172.21.15.93:54722) 2023-11-04T01:36:12.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7efc15281640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 0x7efbfc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 -- 172.21.15.93:0/4253487714 learned_addr learned my addr 172.21.15.93:0/4253487714 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bb9d9b640 1 --2- 172.21.15.93:0/1451771165 >> v2:172.21.15.93:3300/0 conn(0x7f6bb40542b0 0x7f6bb4039ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbe7fc640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc00cc520 0x7f0cc013cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7efe2ffff640 1 --2- 172.21.15.93:0/3424600031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054e20 0x7efe28051d70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f25d63b5dc0f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbf7fe640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc0164760 0x7f0cc00b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 -- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc0164760 msgr2=0x7f0cc00b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc0164760 0x7f0cc00b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7ac04c410 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 -- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc00cc520 msgr2=0x7f0cc013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc00cc520 0x7f0cc013cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f0cbeffd640 1 -- 172.21.15.93:0/4253487714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00094d0 con 0x7f0cc0070710 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 -- 172.21.15.93:0/1451771165 >> v2:172.21.15.93:3300/0 conn(0x7f6bb40542b0 msgr2=0x7f6bb4039ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 --2- 172.21.15.93:0/1451771165 >> v2:172.21.15.93:3300/0 conn(0x7f6bb40542b0 0x7f6bb4039ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.015+0000 7f6bbad9d640 1 -- 172.21.15.93:0/1451771165 >> v1:172.21.15.125:6789/0 conn(0x7f6bb40e11e0 legacy=0x7f6bb4038790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7f6bbad9d640 1 -- 172.21.15.93:0/1451771165 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4056550 con 0x7f6bb4038ea0 2023-11-04T01:36:12.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7efc15281640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 0x7efbfc06d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00a860 tx=0x7efc0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7f0cbeffd640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00090b0 tx=0x7f0cb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7fc7b8ff9640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 0x7fc7a806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7f62e2cc2640 1 Processor -- start 2023-11-04T01:36:12.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7f62e2cc2640 1 -- start start 2023-11-04T01:36:12.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ae0003d10 con 0x7f3af00c1dd0 2023-11-04T01:36:12.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7efe2e7fc640 1 -- 172.21.15.93:0/3424600031 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24031870 con 0x7efe28054e20 2023-11-04T01:36:12.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7efe2e7fc640 1 -- 172.21.15.93:0/3424600031 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe240319d0 con 0x7efe28054e20 2023-11-04T01:36:12.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7efe2e7fc640 1 -- 172.21.15.93:0/3424600031 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24031d60 con 0x7efe28054e20 2023-11-04T01:36:12.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f3adeffd640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 0x7f3ad006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.016+0000 7fc7bb7fe640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 0x7fc7a806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7ac03e070 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f6bbad9d640 1 --2- 172.21.15.93:0/1451771165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc02cce0 tx=0x7f6bbc0a60a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f7aea91ffa4a52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7fc7bb7fe640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 0x7fc7a806d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4007fd0 tx=0x7fc7b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7efe34f6a640 1 -- 172.21.15.93:0/3424600031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054e20 msgr2=0x7efe28051d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7efe34f6a640 1 --2- 172.21.15.93:0/3424600031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054e20 0x7efe28051d70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:12.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e2cc2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 0x7f62dc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e2cc2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62dc0b4f90 0x7f62dc164e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e2cc2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62dc1653c0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e2cc2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc165e90 con 0x7f62dc0b4f90 2023-11-04T01:36:12.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e2cc2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc0b60b0 con 0x7f62dc161150 2023-11-04T01:36:12.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e125f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62dc0b4f90 0x7f62dc164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e125f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62dc0b4f90 0x7f62dc164e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48278/0 (socket says 172.21.15.93:48278) 2023-11-04T01:36:12.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e0a5e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 0x7f62dc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f62e125f640 1 -- 172.21.15.93:0/1628250086 learned_addr learned my addr 172.21.15.93:0/1628250086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.069 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7f3aedd9b640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 0x7f3ad006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7efe34f6a640 1 -- 172.21.15.93:0/3424600031 shutdown_connections 2023-11-04T01:36:12.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7efe34f6a640 1 --2- 172.21.15.93:0/3424600031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054e20 0x7efe28051d70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.017+0000 7efe34f6a640 1 -- 172.21.15.93:0/3424600031 >> 172.21.15.93:0/3424600031 conn(0x7efe28055d20 msgr2=0x7efe28056130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7efe34f6a640 1 -- 172.21.15.93:0/3424600031 shutdown_connections 2023-11-04T01:36:12.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7efe34f6a640 1 -- 172.21.15.93:0/3424600031 wait complete. 2023-11-04T01:36:12.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f3aedd9b640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 0x7f3ad006d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3af00c66a0 tx=0x7f3ae8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62e125f640 1 -- 172.21.15.93:0/1628250086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 msgr2=0x7f62dc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62e125f640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 0x7f62dc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62e125f640 1 -- 172.21.15.93:0/1628250086 >> v1:172.21.15.125:6789/0 conn(0x7f62dc0b5c50 legacy=0x7f62dc0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62db7fe640 1 -- 172.21.15.93:0/1628250086 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889375090 0 0) 0x7f62dc1653c0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62e125f640 1 -- 172.21.15.93:0/1628250086 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc1655f0 con 0x7f62dc0b4f90 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f62e0a5e640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 0x7f62dc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb003adf0 con 0x7f0cc0070710 2023-11-04T01:36:12.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00443f0 con 0x7f0cc0070710 2023-11-04T01:36:12.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.018+0000 7f0cc54fc640 1 -- 172.21.15.93:0/4253487714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00b2c50 con 0x7f0cc0070710 2023-11-04T01:36:12.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f0cc54fc640 1 -- 172.21.15.93:0/4253487714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00b3210 con 0x7f0cc0070710 2023-11-04T01:36:12.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f6bb959a640 1 -- 172.21.15.93:0/1451771165 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a6c80 con 0x7f6bb4038ea0 2023-11-04T01:36:12.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc080777f0 con 0x7efc1014a6a0 2023-11-04T01:36:12.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00447a0 con 0x7f0cc0070710 2023-11-04T01:36:12.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f6bb959a640 1 -- 172.21.15.93:0/1451771165 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0a6e60 con 0x7f6bb4038ea0 2023-11-04T01:36:12.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f6bb959a640 1 -- 172.21.15.93:0/1451771165 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0ae640 con 0x7f6bb4038ea0 2023-11-04T01:36:12.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7f62e125f640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc0b4f90 0x7f62dc164e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009e50 tx=0x7f62d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeabc28c6267dd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.019+0000 7efe34f6a640 1 Processor -- start 2023-11-04T01:36:12.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 msgr2=0x7f6bb403a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7efe34f6a640 1 -- start start 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/1451771165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc02cce0 tx=0x7f6bbc0a60a0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 shutdown_connections 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/1451771165 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb4038ea0 0x7f6bb403a530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/1451771165 >> v2:172.21.15.93:3300/0 conn(0x7f6bb40542b0 0x7f6bb4039ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 >> 172.21.15.93:0/1451771165 conn(0x7f6bb4053790 msgr2=0x7f6bb4053ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.020+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 shutdown_connections 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7f6bbb59e640 1 -- 172.21.15.93:0/1451771165 wait complete. 2023-11-04T01:36:12.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7f0cc54fc640 1 -- 172.21.15.93:0/4253487714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00b3730 con 0x7f0cc0070710 2023-11-04T01:36:12.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe28008d30 0x7efe28038c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe28054e20 0x7efe280ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2804e0f0 con 0x7efe28054e20 2023-11-04T01:36:12.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280ce000 con 0x7efe28054990 2023-11-04T01:36:12.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe34f6a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe280e7cb0 con 0x7efe28008d30 2023-11-04T01:36:12.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cb004d450 con 0x7f0cc0070710 2023-11-04T01:36:12.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7f0ca77fe640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 0x7f0cac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.021+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe28008d30 0x7efe28038c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7f0cbe7fc640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 0x7f0cac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33520/0 (socket says 172.21.15.93:33520) 2023-11-04T01:36:12.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 -- 172.21.15.93:0/551522253 learned_addr learned my addr 172.21.15.93:0/551522253 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cb007b010 con 0x7f0cc0070710 2023-11-04T01:36:12.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 -- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe28008d30 msgr2=0x7efe28038c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7f0cbe7fc640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 0x7f0cac06d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4007fd0 tx=0x7f0cb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe28008d30 0x7efe28038c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 -- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe28054e20 msgr2=0x7efe280ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe28054e20 0x7efe280ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 -- 172.21.15.93:0/551522253 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240094d0 con 0x7efe28054990 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.022+0000 7efe2effd640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00b3e0 tx=0x7efe1c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c011830 con 0x7efe28054990 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0119b0 con 0x7efe28054990 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c011d60 con 0x7efe28054990 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe280e7f90 con 0x7efe28054990 2023-11-04T01:36:12.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2804dc80 con 0x7efe28054990 2023-11-04T01:36:12.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.023+0000 7f6bbb59e640 1 Processor -- start 2023-11-04T01:36:12.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.024+0000 7f6bbb59e640 1 -- start start 2023-11-04T01:36:12.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.024+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7ac077cb0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.024+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe28048cc0 con 0x7efe28054990 2023-11-04T01:36:12.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.024+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ae0042070 con 0x7f3af00c1dd0 2023-11-04T01:36:12.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f62db7fe640 1 -- 172.21.15.93:0/1628250086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d402ca70 con 0x7f62dc0b4f90 2023-11-04T01:36:12.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe1c01a400 con 0x7efe28054990 2023-11-04T01:36:12.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40e11e0 0x7f6bb404c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40dcdf0 0x7f6bb404cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7efe1bfff640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 0x7efe1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cc9c0 con 0x7f6bb40e11e0 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cbdb0 con 0x7f6bb4038ea0 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.025+0000 7f6bbb59e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cc090 con 0x7f6bb40dcdf0 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33526/0 (socket says 172.21.15.93:33526) 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 -- 172.21.15.93:0/2325372282 learned_addr learned my addr 172.21.15.93:0/2325372282 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe1c089a00 con 0x7efe28054990 2023-11-04T01:36:12.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7efe2f7fe640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 0x7efe1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bb9d9b640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40e11e0 0x7f6bb404c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bbad9d640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40dcdf0 0x7f6bb404cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 -- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40dcdf0 msgr2=0x7f6bb404cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40dcdf0 0x7f6bb404cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 -- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40e11e0 msgr2=0x7f6bb404c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40e11e0 0x7f6bb404c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 -- 172.21.15.93:0/2325372282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc04ea00 con 0x7f6bb4038ea0 2023-11-04T01:36:12.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7efe2f7fe640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 0x7efe1406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe3004f240 tx=0x7efe30073b10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.026+0000 7f6bba59c640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c570 tx=0x7f6bac00ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.029+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cb00773e0 con 0x7f0cc0070710 2023-11-04T01:36:12.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.032+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac005480 con 0x7f6bb4038ea0 2023-11-04T01:36:12.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.032+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac011680 con 0x7f6bb4038ea0 2023-11-04T01:36:12.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.032+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac011a30 con 0x7f6bb4038ea0 2023-11-04T01:36:12.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.032+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40cc370 con 0x7f6bb4038ea0 2023-11-04T01:36:12.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.032+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40dd600 con 0x7f6bb4038ea0 2023-11-04T01:36:12.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.033+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe1c054720 con 0x7efe28054990 2023-11-04T01:36:12.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.034+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bac017070 con 0x7f6bb4038ea0 2023-11-04T01:36:12.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f6baaffd640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 0x7f6b9c075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6bac089110 con 0x7f6bb4038ea0 2023-11-04T01:36:12.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f6bb9d9b640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 0x7f6b9c075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.036+0000 7f6bb9d9b640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 0x7f6b9c075c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40dd2f0 tx=0x7f6bb0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.034+0000 7f62db7fe640 1 -- 172.21.15.93:0/1628250086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d402cbd0 con 0x7f62dc0b4f90 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 -- 172.21.15.93:0/1628250086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc0b4f90 msgr2=0x7f62dc164e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62db7fe640 1 -- 172.21.15.93:0/1628250086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d402ca70 con 0x7f62dc0b4f90 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc0b4f90 0x7f62dc164e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009e50 tx=0x7f62d402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 -- 172.21.15.93:0/1628250086 shutdown_connections 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc0b4f90 0x7f62dc164e80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/1628250086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc161150 0x7f62dc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.035+0000 7f62e2cc2640 1 -- 172.21.15.93:0/1628250086 >> 172.21.15.93:0/1628250086 conn(0x7f62dc0cf880 msgr2=0x7f62dc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.034+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ae0077280 con 0x7f3af00c1dd0 2023-11-04T01:36:12.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.036+0000 7f62e2cc2640 1 -- 172.21.15.93:0/1628250086 shutdown_connections 2023-11-04T01:36:12.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.037+0000 7f62e2cc2640 1 -- 172.21.15.93:0/1628250086 wait complete. 2023-11-04T01:36:12.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.038+0000 7f62e2cc2640 1 Processor -- start 2023-11-04T01:36:12.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.039+0000 7f62e2cc2640 1 -- start start 2023-11-04T01:36:12.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc0b4f90 0x7f62dc155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc161150 0x7f62dc15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc162620 con 0x7f62dc161150 2023-11-04T01:36:12.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc161aa0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.040+0000 7f62e2cc2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc161d80 con 0x7f62dc0b4f90 2023-11-04T01:36:12.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.041+0000 7f62e125f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc161150 0x7f62dc15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.041+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.041+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33530/0 (socket says 172.21.15.93:33530) 2023-11-04T01:36:12.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.041+0000 7f62dbfff640 1 -- 172.21.15.93:0/2866697227 learned_addr learned my addr 172.21.15.93:0/2866697227 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4005790 con 0x7f6bb4038ea0 2023-11-04T01:36:12.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62e0a5e640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc0b4f90 0x7f62dc155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 -- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc0b4f90 msgr2=0x7f62dc155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc0b4f90 0x7f62dc155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 -- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc161150 msgr2=0x7f62dc15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc161150 0x7f62dc15c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 -- 172.21.15.93:0/2866697227 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4009b30 con 0x7f62dc0b5c50 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.042+0000 7f62dbfff640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c4b0 tx=0x7f62d000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.047+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0005480 con 0x7f62dc0b5c50 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.047+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc162060 con 0x7f62dc0b5c50 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.047+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62dc163870 con 0x7f62dc0b5c50 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.047+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d00035f0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.047+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00039c0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.049+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bac057940 con 0x7f6bb4038ea0 2023-11-04T01:36:12.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.049+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc005250 con 0x7f62dc0b5c50 2023-11-04T01:36:12.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.050+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62d0003b20 con 0x7f62dc0b5c50 2023-11-04T01:36:12.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.051+0000 7f62d97fa640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 0x7f62c806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.051+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62d0088e80 con 0x7f62dc0b5c50 2023-11-04T01:36:12.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.051+0000 7f62e0a5e640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 0x7f62c806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.052+0000 7f62e0a5e640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 0x7f62c806d400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00d8b0 tx=0x7f62cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.066+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62d0053d60 con 0x7f62dc0b5c50 2023-11-04T01:36:12.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.089+0000 7f64b1026640 1 Processor -- start 2023-11-04T01:36:12.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.090+0000 7f64b1026640 1 -- start start 2023-11-04T01:36:12.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.091+0000 7f64b1026640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.091+0000 7f64b1026640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0cb1e0 con 0x7f64ac158c80 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.091+0000 7f64b1026640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac1595d0 con 0x7f64ac159060 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.091+0000 7f64b1026640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0cad00 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.092+0000 7f64ab59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.092+0000 7f64ab59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54782/0 (socket says 172.21.15.93:54782) 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.092+0000 7f64ab59e640 1 -- 172.21.15.93:0/3848237013 learned_addr learned my addr 172.21.15.93:0/3848237013 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.093+0000 7f64a9d9b640 1 -- 172.21.15.93:0/3848237013 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805095743 0 0) 0x7f64ac1595d0 con 0x7f64ac159060 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.093+0000 7f64a9d9b640 1 -- 172.21.15.93:0/3848237013 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6494003520 con 0x7f64ac159060 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.093+0000 7f64ab59e640 1 -- 172.21.15.93:0/3848237013 >> v1:172.21.15.125:6789/0 conn(0x7f64ac159060 legacy=0x7f64ac0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.093+0000 7f64ab59e640 1 -- 172.21.15.93:0/3848237013 >> v1:172.21.15.93:6789/0 conn(0x7f64ac158c80 legacy=0x7f64ac0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.093+0000 7f64ab59e640 1 -- 172.21.15.93:0/3848237013 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0caf00 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.099+0000 7f64ab59e640 1 --2- 172.21.15.93:0/3848237013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009d50 tx=0x7f64a40348f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f517c046026f5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.100+0000 7f64a9d9b640 1 -- 172.21.15.93:0/3848237013 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a403c650 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.100+0000 7f64a9d9b640 1 -- 172.21.15.93:0/3848237013 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a403c7b0 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.100+0000 7f64a9d9b640 1 -- 172.21.15.93:0/3848237013 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a403cb40 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.101+0000 7f64b1026640 1 -- 172.21.15.93:0/3848237013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 msgr2=0x7f64ac163d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.101+0000 7f64b1026640 1 --2- 172.21.15.93:0/3848237013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009d50 tx=0x7f64a40348f0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.102+0000 7f64b1026640 1 -- 172.21.15.93:0/3848237013 shutdown_connections 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.102+0000 7f64b1026640 1 --2- 172.21.15.93:0/3848237013 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac0ce4c0 0x7f64ac163d90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.102+0000 7f64b1026640 1 -- 172.21.15.93:0/3848237013 >> 172.21.15.93:0/3848237013 conn(0x7f64ac06a120 msgr2=0x7f64ac06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.107+0000 7f64b1026640 1 -- 172.21.15.93:0/3848237013 shutdown_connections 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.110+0000 7f64b1026640 1 -- 172.21.15.93:0/3848237013 wait complete. 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.112+0000 7f64b1026640 1 Processor -- start 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.118+0000 7f64b1026640 1 -- start start 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 0x7f64ac1f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 0x7f64ac156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c6b40 con 0x7f64ac0ce4c0 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c7930 con 0x7f64ac159060 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.119+0000 7f64b1026640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c6d20 con 0x7f64ac158c80 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54796/0 (socket says 172.21.15.93:54796) 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 -- 172.21.15.93:0/3391964660 learned_addr learned my addr 172.21.15.93:0/3391964660 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64ab59e640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 0x7f64ac156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 -- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 msgr2=0x7f64ac156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 0x7f64ac156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aa59c640 1 -- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 msgr2=0x7f64ac1f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.120+0000 7f64aad9d640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 0x7f64ac1f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.121+0000 7f64aa59c640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 0x7f64ac1f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.121+0000 7f64aa59c640 1 -- 172.21.15.93:0/3391964660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4007790 con 0x7f64ac158c80 2023-11-04T01:36:12.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.121+0000 7f64ab59e640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 0x7f64ac156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:12.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.121+0000 7f64aad9d640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 0x7f64ac1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:12.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.126+0000 7f64aa59c640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c460 tx=0x7f64a000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.130+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00052d0 con 0x7f64ac158c80 2023-11-04T01:36:12.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.130+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a0005450 con 0x7f64ac158c80 2023-11-04T01:36:12.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.130+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0012870 con 0x7f64ac158c80 2023-11-04T01:36:12.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.130+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0c7000 con 0x7f64ac158c80 2023-11-04T01:36:12.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.130+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0c75c0 con 0x7f64ac158c80 2023-11-04T01:36:12.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.137+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64a00129d0 con 0x7f64ac158c80 2023-11-04T01:36:12.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.137+0000 7f64937fe640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 0x7f649806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:12.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.137+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64a0089380 con 0x7f64ac158c80 2023-11-04T01:36:12.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.138+0000 7f64aad9d640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 0x7f649806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:12.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.139+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c005250 con 0x7f64ac158c80 2023-11-04T01:36:12.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.139+0000 7f64aad9d640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 0x7f649806d430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f649c007fd0 tx=0x7f649c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:12.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.153+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64a00541b0 con 0x7f64ac158c80 2023-11-04T01:36:12.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.423+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efbf00057d0 con 0x7efc1014a6a0 2023-11-04T01:36:12.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.427+0000 7f0cc54fc640 1 -- 172.21.15.93:0/4253487714 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cc00b3730 con 0x7f0cc0070710 2023-11-04T01:36:12.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.428+0000 7f0ca77fe640 1 -- 172.21.15.93:0/4253487714 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cc00b3730 con 0x7f0cc0070710 2023-11-04T01:36:12.432 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:12.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.431+0000 7efc05ffb640 1 -- 172.21.15.93:0/746420710 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc0807ae10 con 0x7efc1014a6a0 2023-11-04T01:36:12.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.431+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe280e84b0 con 0x7efe28054990 2023-11-04T01:36:12.433 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.432+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 msgr2=0x7f0cac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.432+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 0x7f0cac06d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4007fd0 tx=0x7f0cb4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.432+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 msgr2=0x7f0cc0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.432+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00090b0 tx=0x7f0cb00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.432+0000 7efe1bfff640 1 -- 172.21.15.93:0/551522253 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe1c057d40 con 0x7efe28054990 2023-11-04T01:36:12.434 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:12.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3af00c5350 con 0x7f3af00c1dd0 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 shutdown_connections 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cac06ae70 0x7f0cac06d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cc0164760 0x7f0cc00b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0cc00cc520 0x7f0cc013cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 --2- 172.21.15.93:0/4253487714 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0cc0070710 0x7f0cc0138cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 >> 172.21.15.93:0/4253487714 conn(0x7f0cc00ce950 msgr2=0x7f0cc006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 shutdown_connections 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7f0ca57fa640 1 -- 172.21.15.93:0/4253487714 wait complete. 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 msgr2=0x7efbfc06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 0x7efbfc06d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00a860 tx=0x7efc0c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 msgr2=0x7efc1016d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.434+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc08036040 tx=0x7efc08004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 shutdown_connections 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbfc06b0a0 0x7efbfc06d560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc1014a6a0 0x7efc1016d600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc100cbaf0 0x7efc1016d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 --2- 172.21.15.93:0/746420710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc100cad50 0x7efc100b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 >> 172.21.15.93:0/746420710 conn(0x7efc1006a120 msgr2=0x7efc101462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.435+0000 7f3adeffd640 1 -- 172.21.15.93:0/538313540 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ae007a8a0 con 0x7f3af00c1dd0 2023-11-04T01:36:12.439 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:12.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.436+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 msgr2=0x7efe1406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.436+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 0x7efe1406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe3004f240 tx=0x7efe30073b10 comp rx=0 tx=0).stop 2023-11-04T01:36:12.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.436+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 msgr2=0x7efe280cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.436+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 shutdown_connections 2023-11-04T01:36:12.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.436+0000 7efc174e5640 1 -- 172.21.15.93:0/746420710 wait complete. 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00b3e0 tx=0x7efe1c00b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 shutdown_connections 2023-11-04T01:36:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 msgr2=0x7f3ad006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efe1406aea0 0x7efe1406d360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 0x7f3ad006d3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3af00c66a0 tx=0x7f3ae8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe28054e20 0x7efe280ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28054990 0x7efe280cdac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 --2- 172.21.15.93:0/551522253 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efe28008d30 0x7efe28038c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 >> 172.21.15.93:0/551522253 conn(0x7efe28055d20 msgr2=0x7efe280554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 msgr2=0x7f3af0161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.438+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 0x7f3af0161bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0033000 tx=0x7f3ae00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 shutdown_connections 2023-11-04T01:36:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ad006aef0 0x7f3ad006d3b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3af0162580 0x7f3af0162a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 shutdown_connections 2023-11-04T01:36:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3af0161110 0x7f3af00c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 --2- 172.21.15.93:0/538313540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3af00c1dd0 0x7f3af0161bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 >> 172.21.15.93:0/538313540 conn(0x7f3af006a120 msgr2=0x7f3af00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7efe34f6a640 1 -- 172.21.15.93:0/551522253 wait complete. 2023-11-04T01:36:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 shutdown_connections 2023-11-04T01:36:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.439+0000 7f3aef59e640 1 -- 172.21.15.93:0/538313540 wait complete. 2023-11-04T01:36:12.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.449+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc79c0057d0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.451+0000 7fc7b8ff9640 1 -- 172.21.15.93:0/838869645 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7ac07b2d0 con 0x7fc7bc0cbcc0 2023-11-04T01:36:12.454 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:12.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-11-04T01:36:12.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.456+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 msgr2=0x7fc7a806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.456+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 0x7fc7a806d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4007fd0 tx=0x7fc7b4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.456+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 msgr2=0x7fc7bc0b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.456+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 0x7fc7bc0b32a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac033000 tx=0x7fc7ac004730 comp rx=0 tx=0).stop 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 shutdown_connections 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc7a806af40 0x7fc7a806d400 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc7bc164db0 0x7fc7bc1608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7bc14a6a0 0x7fc7bc13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 --2- 172.21.15.93:0/838869645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc7bc0cbcc0 0x7fc7bc0b32a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 >> 172.21.15.93:0/838869645 conn(0x7fc7bc06a120 msgr2=0x7fc7bc0cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 shutdown_connections 2023-11-04T01:36:12.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.457+0000 7fc7c2505640 1 -- 172.21.15.93:0/838869645 wait complete. 2023-11-04T01:36:12.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-11-04T01:36:12.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-04T01:36:12.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-11-04T01:36:12.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-04T01:36:12.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.490+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6bb40e47f0 con 0x7f6bb4038ea0 2023-11-04T01:36:12.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.490+0000 7f6baaffd640 1 -- 172.21.15.93:0/2325372282 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bac0574d0 con 0x7f6bb4038ea0 2023-11-04T01:36:12.492 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:12.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 msgr2=0x7f6b9c075c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 0x7f6b9c075c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40dd2f0 tx=0x7f6bb0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 msgr2=0x7f6bb40cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c570 tx=0x7f6bac00ca30 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 shutdown_connections 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b9c073780 0x7f6b9c075c40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bb40dcdf0 0x7f6bb404cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40e11e0 0x7f6bb404c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 --2- 172.21.15.93:0/2325372282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb4038ea0 0x7f6bb40cf200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 >> 172.21.15.93:0/2325372282 conn(0x7f6bb4053790 msgr2=0x7f6bb4036da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 shutdown_connections 2023-11-04T01:36:12.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.493+0000 7f6bbb59e640 1 -- 172.21.15.93:0/2325372282 wait complete. 2023-11-04T01:36:12.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.501+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f62bc0057d0 con 0x7f62dc0b5c50 2023-11-04T01:36:12.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.502+0000 7f62d97fa640 1 -- 172.21.15.93:0/2866697227 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62d0017070 con 0x7f62dc0b5c50 2023-11-04T01:36:12.503 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:12.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-11-04T01:36:12.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 msgr2=0x7f62c806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 0x7f62c806d400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00d8b0 tx=0x7f62cc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 msgr2=0x7f62dc163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c4b0 tx=0x7f62d000c970 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 shutdown_connections 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62c806af40 0x7f62c806d400 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62dc161150 0x7f62dc15c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62dc0b5c50 0x7f62dc163330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 --2- 172.21.15.93:0/2866697227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62dc0b4f90 0x7f62dc155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 >> 172.21.15.93:0/2866697227 conn(0x7f62dc0cf880 msgr2=0x7f62dc0b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 shutdown_connections 2023-11-04T01:36:12.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.504+0000 7f62e2cc2640 1 -- 172.21.15.93:0/2866697227 wait complete. 2023-11-04T01:36:12.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-04T01:36:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.589+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f648c005500 con 0x7f64ac158c80 2023-11-04T01:36:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.590+0000 7f64937fe640 1 -- 172.21.15.93:0/3391964660 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64a0001130 con 0x7f64ac158c80 2023-11-04T01:36:12.591 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 msgr2=0x7f649806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 0x7f649806d430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f649c007fd0 tx=0x7f649c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 msgr2=0x7f64ac0c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c460 tx=0x7f64a000c920 comp rx=0 tx=0).stop 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 shutdown_connections 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f649806af70 0x7f649806d430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64ac159060 0x7f64ac156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f64ac158c80 0x7f64ac0c7dc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 --2- 172.21.15.93:0/3391964660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ac0ce4c0 0x7f64ac1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 >> 172.21.15.93:0/3391964660 conn(0x7f64ac06a120 msgr2=0x7f64ac0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 shutdown_connections 2023-11-04T01:36:12.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:12.592+0000 7f64b1026640 1 -- 172.21.15.93:0/3391964660 wait complete. 2023-11-04T01:36:12.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-04T01:36:13.459 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:13.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:13.463 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:13.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:13.473 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:13.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:13.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:13.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.578+0000 7fd17b91d640 1 Processor -- start 2023-11-04T01:36:13.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fdb8e397640 1 Processor -- start 2023-11-04T01:36:13.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.579+0000 7fd17b91d640 1 -- start start 2023-11-04T01:36:13.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd17b91d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd1740ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fdb8e397640 1 -- start start 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd17b91d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1740ce4c0 0x7fd17415d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd17b91d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740cb1e0 con 0x7fd174159060 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd1796b9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd1740ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd179eba640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1740ce4c0 0x7fd17415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd1796b9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd1740ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54798/0 (socket says 172.21.15.93:54798) 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd1796b9640 1 -- 172.21.15.93:0/1217525085 learned_addr learned my addr 172.21.15.93:0/1217525085 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.580+0000 7fd17b91d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1741595d0 con 0x7fd1740ce4c0 2023-11-04T01:36:13.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740caf00 con 0x7fd174158c80 2023-11-04T01:36:13.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb8e397640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 0x7fdb880ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb8e397640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdb88067090 0x7fdb880cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb8e397640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb880cc960 con 0x7fdb88142480 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb8e397640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb880ccc40 con 0x7fdb88067090 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb8e397640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb880ccf20 con 0x7fdb88141e20 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb87fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 0x7fdb880ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb87fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 0x7fdb880ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54814/0 (socket says 172.21.15.93:54814) 2023-11-04T01:36:13.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fdb87fff640 1 -- 172.21.15.93:0/2420671670 learned_addr learned my addr 172.21.15.93:0/2420671670 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd16bfff640 1 -- 172.21.15.93:0/1217525085 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680187008 0 0) 0x7fd1740cb1e0 con 0x7fd174159060 2023-11-04T01:36:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd179eba640 1 -- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 msgr2=0x7fd1740ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd179eba640 1 --2- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd1740ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd179eba640 1 -- 172.21.15.93:0/1217525085 >> v1:172.21.15.125:6789/0 conn(0x7fd174159060 legacy=0x7fd1740cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.581+0000 7fd179eba640 1 -- 172.21.15.93:0/1217525085 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174159870 con 0x7fd1740ce4c0 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.582+0000 7fdb86ffd640 1 -- 172.21.15.93:0/2420671670 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568668093 0 0) 0x7fdb880cc960 con 0x7fdb88142480 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.582+0000 7fdb8c934640 1 --2- 172.21.15.93:0/2420671670 >> v2:172.21.15.125:3300/0 conn(0x7fdb88067090 0x7fdb880cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.582+0000 7fdb86ffd640 1 -- 172.21.15.93:0/2420671670 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb74003520 con 0x7fdb88142480 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.582+0000 7fd179eba640 1 --2- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd17415d290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00f370 tx=0x7fd16c0302a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0df905c678180cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fd16bfff640 1 -- 172.21.15.93:0/1217525085 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00d2d0 con 0x7fd1740ce4c0 2023-11-04T01:36:13.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fd16bfff640 1 -- 172.21.15.93:0/1217525085 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c00d430 con 0x7fd1740ce4c0 2023-11-04T01:36:13.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fdb8c934640 1 -- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 msgr2=0x7fdb880ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fdb8c934640 1 --2- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 0x7fdb880ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fdb8c934640 1 -- 172.21.15.93:0/2420671670 >> v1:172.21.15.93:6789/0 conn(0x7fdb88142480 legacy=0x7fdb880caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fdb8c934640 1 -- 172.21.15.93:0/2420671670 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880cd200 con 0x7fdb88067090 2023-11-04T01:36:13.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.583+0000 7fd16bfff640 1 -- 172.21.15.93:0/1217525085 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00b960 con 0x7fd1740ce4c0 2023-11-04T01:36:13.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fdb8c934640 1 --2- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88067090 0x7fdb880cdfb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befbf9f525c1b28f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 msgr2=0x7fd17415d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 --2- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd17415d290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00f370 tx=0x7fd16c0302a0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fdb86ffd640 1 -- 172.21.15.93:0/2420671670 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70031780 con 0x7fdb88067090 2023-11-04T01:36:13.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fdb86ffd640 1 -- 172.21.15.93:0/2420671670 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700318e0 con 0x7fdb88067090 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 shutdown_connections 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 --2- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd17415d290 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 --2- 172.21.15.93:0/1217525085 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd1740ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 >> 172.21.15.93:0/1217525085 conn(0x7fd17406a120 msgr2=0x7fd17406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 shutdown_connections 2023-11-04T01:36:13.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.584+0000 7fd17b91d640 1 -- 172.21.15.93:0/1217525085 wait complete. 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb86ffd640 1 -- 172.21.15.93:0/2420671670 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70031c70 con 0x7fdb88067090 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 -- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88067090 msgr2=0x7fdb880cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 --2- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88067090 0x7fdb880cdfb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b820 comp rx=0 tx=0).stop 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 -- 172.21.15.93:0/2420671670 shutdown_connections 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 --2- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88067090 0x7fdb880cdfb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 --2- 172.21.15.93:0/2420671670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88141e20 0x7fdb880ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.585+0000 7fdb8e397640 1 -- 172.21.15.93:0/2420671670 >> 172.21.15.93:0/2420671670 conn(0x7fdb8806a120 msgr2=0x7fdb8806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.586+0000 7fdb8e397640 1 -- 172.21.15.93:0/2420671670 shutdown_connections 2023-11-04T01:36:13.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.586+0000 7fdb8e397640 1 -- 172.21.15.93:0/2420671670 wait complete. 2023-11-04T01:36:13.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.586+0000 7fd17b91d640 1 Processor -- start 2023-11-04T01:36:13.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.586+0000 7fd17b91d640 1 -- start start 2023-11-04T01:36:13.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd174157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd174159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd174159060 0x7fd17415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741518a0 con 0x7fd174159060 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd174158150 con 0x7fd1740ce4c0 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd17b91d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c61a0 con 0x7fd174158c80 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd1796b9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd174157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.587+0000 7fd178eb8640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd174159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd1796b9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd174157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33564/0 (socket says 172.21.15.93:33564) 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd1796b9640 1 -- 172.21.15.93:0/663767929 learned_addr learned my addr 172.21.15.93:0/663767929 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd179eba640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd174159060 0x7fd17415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fdb8e397640 1 Processor -- start 2023-11-04T01:36:13.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fdb8e397640 1 -- start start 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 -- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 msgr2=0x7fd174157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd174157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 -- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd174159060 msgr2=0x7fd17415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd174159060 0x7fd17415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 -- 172.21.15.93:0/663767929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c00f050 con 0x7fd174158c80 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.588+0000 7fd178eb8640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd174159f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c3e0 tx=0x7fd17000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.589+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170007030 con 0x7fd174158c80 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.589+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170007190 con 0x7fd174158c80 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.589+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170007580 con 0x7fd174158c80 2023-11-04T01:36:13.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.589+0000 7fd17b91d640 1 -- 172.21.15.93:0/663767929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd174157410 con 0x7fd174158c80 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88067090 0x7fdb8815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 0x7fdb881596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb877fe640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 0x7fdb881596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb877fe640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 0x7fdb881596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33574/0 (socket says 172.21.15.93:33574) 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb877fe640 1 -- 172.21.15.93:0/960703729 learned_addr learned my addr 172.21.15.93:0/960703729 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 0x7fdb8813e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.589+0000 7fd17b91d640 1 -- 172.21.15.93:0/663767929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1740c5b50 con 0x7fd174158c80 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8815ad10 con 0x7fdb88142480 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8815a190 con 0x7fdb88141e20 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8c934640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 0x7fdb8813e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.590+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8815a470 con 0x7fdb88067090 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1740c6330 con 0x7fd174158c80 2023-11-04T01:36:13.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb87fff640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88067090 0x7fdb8815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1700067b0 con 0x7fd174158c80 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb8c934640 1 -- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88067090 msgr2=0x7fdb8815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb8c934640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88067090 0x7fdb8815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb8c934640 1 -- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 msgr2=0x7fdb881596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb8c934640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 0x7fdb881596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.591+0000 7fdb8c934640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009400 con 0x7fdb88142480 2023-11-04T01:36:13.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:13.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fd169ffb640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd170088cc0 con 0x7fd174158c80 2023-11-04T01:36:13.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fd1796b9640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fdb8c934640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 0x7fdb8813e960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb70033000 tx=0x7fdb700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fd1796b9640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 0x7fd15806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1640094a0 tx=0x7fd164009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70032820 con 0x7fdb88142480 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70032980 con 0x7fdb88142480 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.592+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8815a750 con 0x7fdb88142480 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.593+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb880b4440 con 0x7fdb88142480 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.593+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70032d30 con 0x7fdb88142480 2023-11-04T01:36:13.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.594+0000 7faa60305640 1 Processor -- start 2023-11-04T01:36:13.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.594+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb7004d3f0 con 0x7fdb88142480 2023-11-04T01:36:13.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.594+0000 7faa60305640 1 -- start start 2023-11-04T01:36:13.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.595+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c005250 con 0x7fdb88142480 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.595+0000 7faa60305640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 0x7faa580cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.595+0000 7faa60305640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580b1cc0 con 0x7faa5815add0 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.595+0000 7faa60305640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5815a2f0 con 0x7faa58071f90 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.595+0000 7faa60305640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580b1fa0 con 0x7faa58072400 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7faa5e0a1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7faa5815add0 0x7faa580b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54358/0 (socket says 172.21.15.93:54358) 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7faa5e0a1640 1 -- 172.21.15.93:0/4116833612 learned_addr learned my addr 172.21.15.93:0/4116833612 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:13.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7faa5e8a2640 1 --2- 172.21.15.93:0/4116833612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 0x7faa580cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7fdb84ff9640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 0x7fdb6806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb700ab390 con 0x7fdb88142480 2023-11-04T01:36:13.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd17008f080 con 0x7fd174158c80 2023-11-04T01:36:13.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.596+0000 7fdb87fff640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 0x7fdb6806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.597+0000 7faa5e8a2640 1 -- 172.21.15.93:0/4116833612 >> v1:172.21.15.125:6789/0 conn(0x7faa58071f90 legacy=0x7faa580cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.597+0000 7faa5e8a2640 1 -- 172.21.15.93:0/4116833612 >> v1:172.21.15.93:6789/0 conn(0x7faa5815add0 legacy=0x7faa580b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.597+0000 7faa5e8a2640 1 -- 172.21.15.93:0/4116833612 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5815a5d0 con 0x7faa58072400 2023-11-04T01:36:13.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.598+0000 7fdb87fff640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 0x7fdb6806d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009440 tx=0x7fdb80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.598+0000 7faa5e8a2640 1 --2- 172.21.15.93:0/4116833612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 0x7faa580cf3d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa50009dc0 tx=0x7faa5002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8a656565f25a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.598+0000 7faa5d09f640 1 -- 172.21.15.93:0/4116833612 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5002caa0 con 0x7faa58072400 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.599+0000 7faa5d09f640 1 -- 172.21.15.93:0/4116833612 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5002cc00 con 0x7faa58072400 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.599+0000 7faa60305640 1 -- 172.21.15.93:0/4116833612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 msgr2=0x7faa580cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 --2- 172.21.15.93:0/4116833612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 0x7faa580cf3d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa50009dc0 tx=0x7faa5002bd70 comp rx=0 tx=0).stop 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 -- 172.21.15.93:0/4116833612 shutdown_connections 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 --2- 172.21.15.93:0/4116833612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58072400 0x7faa580cf3d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 -- 172.21.15.93:0/4116833612 >> 172.21.15.93:0/4116833612 conn(0x7faa5806d800 msgr2=0x7faa5806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 -- 172.21.15.93:0/4116833612 shutdown_connections 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.600+0000 7faa60305640 1 -- 172.21.15.93:0/4116833612 wait complete. 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.602+0000 7faa60305640 1 Processor -- start 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.602+0000 7faa60305640 1 -- start start 2023-11-04T01:36:13.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.603+0000 7faa60305640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 0x7faa581488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.603+0000 7faa60305640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 0x7faa58153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5e0a1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 0x7faa581488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb70076130 con 0x7fdb88142480 2023-11-04T01:36:13.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5e0a1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 0x7faa581488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54838/0 (socket says 172.21.15.93:54838) 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5d8a0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 0x7faa58153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5d8a0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 0x7faa58153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33576/0 (socket says 172.21.15.93:33576) 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa60305640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5e8a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.604+0000 7faa5e8a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48360/0 (socket says 172.21.15.93:48360) 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e0a1640 1 -- 172.21.15.93:0/3760970893 learned_addr learned my addr 172.21.15.93:0/3760970893 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa60305640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580c61c0 con 0x7faa5815add0 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa60305640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580c36e0 con 0x7faa58072400 2023-11-04T01:36:13.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa60305640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580c39c0 con 0x7faa58071f90 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e8a2640 1 -- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 msgr2=0x7faa581488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e8a2640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 0x7faa581488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e8a2640 1 -- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 msgr2=0x7faa58153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e8a2640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 0x7faa58153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.605+0000 7faa5e8a2640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50009a70 con 0x7faa5815add0 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.606+0000 7faa5e8a2640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa50033000 tx=0x7faa50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.606+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004370 con 0x7faa5815add0 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.607+0000 7faa60305640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa580c3ca0 con 0x7faa5815add0 2023-11-04T01:36:13.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.607+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa500044d0 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.607+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004880 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.608+0000 7faa60305640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa580c4260 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.609+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa5003b070 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.610+0000 7faa4effd640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.610+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa580c43f0 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.610+0000 7faa5e0a1640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.611+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa500ab260 con 0x7faa5815add0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.611+0000 7faa5e0a1640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 0x7faa3c06d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa48004e90 tx=0x7faa48007f10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.619+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa500b0060 con 0x7faa5815add0 2023-11-04T01:36:13.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.667+0000 7f4e6b9cc640 1 Processor -- start 2023-11-04T01:36:13.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.667+0000 7f4e6b9cc640 1 -- start start 2023-11-04T01:36:13.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.668+0000 7f4e6b9cc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e640af610 0x7f4e64169b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.668+0000 7f4e6b9cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.668+0000 7f4e6b9cc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e64089c90 con 0x7f4e640ca1b0 2023-11-04T01:36:13.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.668+0000 7f4e6b9cc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640af9f0 con 0x7f4e640af610 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.668+0000 7f4e6b9cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640cd000 con 0x7f4e640892f0 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54850/0 (socket says 172.21.15.93:54850) 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 -- 172.21.15.93:0/1475375781 learned_addr learned my addr 172.21.15.93:0/1475375781 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e69768640 1 --2- 172.21.15.93:0/1475375781 >> v2:172.21.15.125:3300/0 conn(0x7f4e640af610 0x7f4e64169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f604c35e640 1 Processor -- start 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 -- 172.21.15.93:0/1475375781 >> v2:172.21.15.125:3300/0 conn(0x7f4e640af610 msgr2=0x7f4e64169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 --2- 172.21.15.93:0/1475375781 >> v2:172.21.15.125:3300/0 conn(0x7f4e640af610 0x7f4e64169b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 -- 172.21.15.93:0/1475375781 >> v1:172.21.15.125:6789/0 conn(0x7f4e640ca1b0 legacy=0x7f4e640ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f4e68f67640 1 -- 172.21.15.93:0/1475375781 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640cad50 con 0x7f4e640892f0 2023-11-04T01:36:13.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.670+0000 7f7cc321a640 1 Processor -- start 2023-11-04T01:36:13.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.669+0000 7f604c35e640 1 -- start start 2023-11-04T01:36:13.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.670+0000 7f7cc321a640 1 -- start start 2023-11-04T01:36:13.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.670+0000 7f4e68f67640 1 --2- 172.21.15.93:0/1475375781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009870 tx=0x7f4e6002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a7d0e65068631cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f4e5bfff640 1 -- 172.21.15.93:0/1475375781 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031640 con 0x7f4e640892f0 2023-11-04T01:36:13.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f4e5bfff640 1 -- 172.21.15.93:0/1475375781 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e600317a0 con 0x7f4e640892f0 2023-11-04T01:36:13.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f4e5bfff640 1 -- 172.21.15.93:0/1475375781 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031b30 con 0x7f4e640892f0 2023-11-04T01:36:13.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604c35e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f604406ac10 0x7f6044158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604c35e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 0x7f60440cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604c35e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60440cb1e0 con 0x7f6044158bf0 2023-11-04T01:36:13.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604c35e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440cad00 con 0x7f604406ac10 2023-11-04T01:36:13.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604c35e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60441595d0 con 0x7f604415a070 2023-11-04T01:36:13.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604a0fa640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6044158bf0 0x7f60440ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54366/0 (socket says 172.21.15.93:54366) 2023-11-04T01:36:13.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604a0fa640 1 -- 172.21.15.93:0/1417444831 learned_addr learned my addr 172.21.15.93:0/1417444831 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f60498f9640 1 --2- 172.21.15.93:0/1417444831 >> v2:172.21.15.125:3300/0 conn(0x7f604406ac10 0x7f6044158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.671+0000 7f604a8fb640 1 --2- 172.21.15.93:0/1417444831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 0x7f60440cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc321a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 0x7f7cb4007c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f60490f8640 1 -- 172.21.15.93:0/1417444831 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955718873 0 0) 0x7f60440cb1e0 con 0x7f6044158bf0 2023-11-04T01:36:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc321a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40e02e0 con 0x7f7cb40dff00 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc321a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40543d0 con 0x7f7cb4055740 2023-11-04T01:36:13.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc321a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4055320 con 0x7f7cb403b9c0 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f60490f8640 1 -- 172.21.15.93:0/1417444831 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003520 con 0x7f6044158bf0 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc2218640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7cb40dff00 0x7f7cb4053cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54368/0 (socket says 172.21.15.93:54368) 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc2218640 1 -- 172.21.15.93:0/2115579354 learned_addr learned my addr 172.21.15.93:0/2115579354 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f7cc1a17640 1 --2- 172.21.15.93:0/2115579354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 0x7f7cb4007c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f7cc1216640 1 -- 172.21.15.93:0/2115579354 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960081497 0 0) 0x7f7cb40e02e0 con 0x7f7cb40dff00 2023-11-04T01:36:13.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f7cc1216640 1 -- 172.21.15.93:0/2115579354 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca8005730 con 0x7f7cb40dff00 2023-11-04T01:36:13.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f604a8fb640 1 -- 172.21.15.93:0/1417444831 >> v2:172.21.15.125:3300/0 conn(0x7f604406ac10 msgr2=0x7f6044158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f604a8fb640 1 --2- 172.21.15.93:0/1417444831 >> v2:172.21.15.125:3300/0 conn(0x7f604406ac10 0x7f6044158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f604a8fb640 1 -- 172.21.15.93:0/1417444831 >> v1:172.21.15.93:6789/0 conn(0x7f6044158bf0 legacy=0x7f60440ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.672+0000 7f604a8fb640 1 -- 172.21.15.93:0/1417444831 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440caf00 con 0x7f604415a070 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/1475375781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 msgr2=0x7f4e64089750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/1475375781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009870 tx=0x7f4e6002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f7cc1a17640 1 -- 172.21.15.93:0/2115579354 >> v1:172.21.15.125:6789/0 conn(0x7f7cb4055740 legacy=0x7f7cb4008140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f7cc1a17640 1 -- 172.21.15.93:0/2115579354 >> v1:172.21.15.93:6789/0 conn(0x7f7cb40dff00 legacy=0x7f7cb4053cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f7cc1a17640 1 -- 172.21.15.93:0/2115579354 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb40546a0 con 0x7f7cb403b9c0 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/1475375781 shutdown_connections 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/1475375781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640892f0 0x7f4e64089750 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/1475375781 >> v2:172.21.15.125:3300/0 conn(0x7f4e640af610 0x7f4e64169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.673+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/1475375781 >> 172.21.15.93:0/1475375781 conn(0x7f4e6406c7a0 msgr2=0x7f4e6406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f604a8fb640 1 --2- 172.21.15.93:0/1417444831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 0x7f60440cddb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f603c009d90 tx=0x7f603c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523194d4217edc30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f60490f8640 1 -- 172.21.15.93:0/1417444831 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c02cce0 con 0x7f604415a070 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f60490f8640 1 -- 172.21.15.93:0/1417444831 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c02ce40 con 0x7f604415a070 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/1475375781 shutdown_connections 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/1475375781 wait complete. 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f7cc1a17640 1 --2- 172.21.15.93:0/2115579354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 0x7f7cb4007c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009800 tx=0x7f7cac02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b0305dedaf73aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f7cc1216640 1 -- 172.21.15.93:0/2115579354 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac031890 con 0x7f7cb403b9c0 2023-11-04T01:36:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f7cc1216640 1 -- 172.21.15.93:0/2115579354 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0319f0 con 0x7f7cb403b9c0 2023-11-04T01:36:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.675+0000 7f7cc1216640 1 -- 172.21.15.93:0/2115579354 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac031890 con 0x7f7cb403b9c0 2023-11-04T01:36:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 -- 172.21.15.93:0/1417444831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 msgr2=0x7f60440cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 --2- 172.21.15.93:0/1417444831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 0x7f60440cddb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f603c009d90 tx=0x7f603c02bf30 comp rx=0 tx=0).stop 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 -- 172.21.15.93:0/1417444831 shutdown_connections 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 --2- 172.21.15.93:0/1417444831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f604415a070 0x7f60440cddb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 --2- 172.21.15.93:0/1417444831 >> v2:172.21.15.125:3300/0 conn(0x7f604406ac10 0x7f6044158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.676+0000 7f604c35e640 1 -- 172.21.15.93:0/1417444831 >> 172.21.15.93:0/1417444831 conn(0x7f604406a120 msgr2=0x7f604406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f7cc321a640 1 -- 172.21.15.93:0/2115579354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 msgr2=0x7f7cb4007c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f7cc321a640 1 --2- 172.21.15.93:0/2115579354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 0x7f7cb4007c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009800 tx=0x7f7cac02b930 comp rx=0 tx=0).stop 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f4e6b9cc640 1 Processor -- start 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f4e6b9cc640 1 -- start start 2023-11-04T01:36:13.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f604c35e640 1 -- 172.21.15.93:0/1417444831 shutdown_connections 2023-11-04T01:36:13.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f7cc321a640 1 -- 172.21.15.93:0/2115579354 shutdown_connections 2023-11-04T01:36:13.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f7cc321a640 1 --2- 172.21.15.93:0/2115579354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb403b9c0 0x7f7cb4007c00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f7cc321a640 1 -- 172.21.15.93:0/2115579354 >> 172.21.15.93:0/2115579354 conn(0x7f7cb4055c10 msgr2=0x7f7cb4056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.678+0000 7f7cc321a640 1 -- 172.21.15.93:0/2115579354 shutdown_connections 2023-11-04T01:36:13.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.678+0000 7f7cc321a640 1 -- 172.21.15.93:0/2115579354 wait complete. 2023-11-04T01:36:13.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.678+0000 7f4e6b9cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e69768640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e69768640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48362/0 (socket says 172.21.15.93:48362) 2023-11-04T01:36:13.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e69768640 1 -- 172.21.15.93:0/3876638686 learned_addr learned my addr 172.21.15.93:0/3876638686 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 0x7f4e6415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 0x7f4e6407f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64157990 con 0x7f4e640892f0 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e68f67640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 0x7f4e6415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e69f69640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 0x7f4e6407f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64156d10 con 0x7f4e640ca1b0 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64156ff0 con 0x7f4e640af610 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.677+0000 7f604c35e640 1 -- 172.21.15.93:0/1417444831 wait complete. 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f604c35e640 1 Processor -- start 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.679+0000 7f604c35e640 1 -- start start 2023-11-04T01:36:13.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f604c35e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 0x7f6044151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f604c35e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f604c35e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f604415a070 0x7f60440c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f7cc321a640 1 Processor -- start 2023-11-04T01:36:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f7cc321a640 1 -- start start 2023-11-04T01:36:13.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e69768640 1 -- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 msgr2=0x7f4e6415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f60498f9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f60498f9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54892/0 (socket says 172.21.15.93:54892) 2023-11-04T01:36:13.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e69768640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 0x7f4e6415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e69768640 1 -- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 msgr2=0x7f4e6407f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.680+0000 7f4e69768640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 0x7f4e6407f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f4e69768640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600094d0 con 0x7f4e640892f0 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f4e69768640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00ce10 tx=0x7f4e5c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f604a0fa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 0x7f6044151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f604a0fa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 0x7f6044151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48364/0 (socket says 172.21.15.93:48364) 2023-11-04T01:36:13.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f4e68f67640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 0x7f4e6415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f60498f9640 1 -- 172.21.15.93:0/3528240286 learned_addr learned my addr 172.21.15.93:0/3528240286 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440b2cf0 con 0x7f604406ac10 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440b3d00 con 0x7f604415a070 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.681+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60440b2f40 con 0x7f6044158bf0 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f604a8fb640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f604415a070 0x7f60440c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 -- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f604415a070 msgr2=0x7f60440c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f604415a070 0x7f60440c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 -- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 msgr2=0x7f6044151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 0x7f6044151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c009a70 con 0x7f6044158bf0 2023-11-04T01:36:13.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f60498f9640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f603400e980 tx=0x7f603400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc321a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 0x7f7cb40d6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc321a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 0x7f7cb40e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc321a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc321a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40d6460 con 0x7f7cb40d52e0 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc2a19640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc2a19640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48378/0 (socket says 172.21.15.93:48378) 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc2a19640 1 -- 172.21.15.93:0/159451581 learned_addr learned my addr 172.21.15.93:0/159451581 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40d4100 con 0x7f7cb40dff00 2023-11-04T01:36:13.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40d5850 con 0x7f7cb4055740 2023-11-04T01:36:13.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034009670 con 0x7f6044158bf0 2023-11-04T01:36:13.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60440b3220 con 0x7f6044158bf0 2023-11-04T01:36:13.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60440b37e0 con 0x7f6044158bf0 2023-11-04T01:36:13.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c003b90 con 0x7f4e640892f0 2023-11-04T01:36:13.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c003cf0 con 0x7f4e640892f0 2023-11-04T01:36:13.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.682+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c004220 con 0x7f4e640892f0 2023-11-04T01:36:13.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f4e69f69640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 0x7f4e6407f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:13.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400ca00 con 0x7f6044158bf0 2023-11-04T01:36:13.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400cd90 con 0x7f6044158bf0 2023-11-04T01:36:13.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e641572d0 con 0x7f4e640892f0 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f7cc2218640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 0x7f7cb40d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.683+0000 7f7cc1a17640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 0x7f7cb40e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 -- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 msgr2=0x7f7cb40d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 0x7f7cb40d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 -- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 msgr2=0x7f7cb40e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 0x7f7cb40e1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac009400 con 0x7f7cb40d52e0 2023-11-04T01:36:13.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e641582f0 con 0x7f4e640892f0 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.684+0000 7f7cc2a19640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c410 tx=0x7f7cb800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.685+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c005250 con 0x7f6044158bf0 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6034013470 con 0x7f6044158bf0 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8011790 con 0x7f7cb40d52e0 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cc2218640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 0x7f7cb40d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb40d5b30 con 0x7f7cb40d52e0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb40d60f0 con 0x7f7cb40d52e0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb80118f0 con 0x7f7cb40d52e0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.686+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8011c80 con 0x7f7cb40d52e0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.687+0000 7f603affd640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 0x7f602806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.687+0000 7f604a0fa640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 0x7f602806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.688+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6034089a30 con 0x7f6044158bf0 2023-11-04T01:36:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.688+0000 7f604a0fa640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 0x7f602806d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60400011e0 tx=0x7f6040007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.688+0000 7f7cc1a17640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 0x7f7cb40e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.688+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7cb801c460 con 0x7f7cb40d52e0 2023-11-04T01:36:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.689+0000 7f7cb2ffd640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 0x7f7ca006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.689+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4005250 con 0x7f7cb40d52e0 2023-11-04T01:36:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.689+0000 7f7cc2218640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 0x7f7ca006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.689+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7cb80897e0 con 0x7f7cb40d52e0 2023-11-04T01:36:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.690+0000 7f7cc2218640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 0x7f7ca006d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc02cce0 tx=0x7f7cbc075000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.689+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e5c004380 con 0x7f4e640892f0 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.690+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64157ad0 con 0x7f4e640892f0 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.690+0000 7f4e59ffb640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 0x7f4e4806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.690+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e5c012070 con 0x7f4e640892f0 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.690+0000 7f4e68f67640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 0x7f4e4806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.691+0000 7f4e68f67640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 0x7f4e4806d400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e60036000 tx=0x7f4e6003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.692+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6034054880 con 0x7f6044158bf0 2023-11-04T01:36:13.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.699+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7cb8054500 con 0x7f7cb40d52e0 2023-11-04T01:36:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.700+0000 7f138081a640 1 Processor -- start 2023-11-04T01:36:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.700+0000 7f138081a640 1 -- start start 2023-11-04T01:36:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.701+0000 7f138081a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f137c0b2010 0x7f137c165790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.701+0000 7f138081a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c0cdfb0 con 0x7f137c072380 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.701+0000 7f138081a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c06ab00 con 0x7f137c071fa0 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.701+0000 7f138081a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c06a830 con 0x7f137c0b2010 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f137c0b2010 0x7f137c165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f137c0b2010 0x7f137c165790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48392/0 (socket says 172.21.15.93:48392) 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 -- 172.21.15.93:0/1384962646 learned_addr learned my addr 172.21.15.93:0/1384962646 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 -- 172.21.15.93:0/1384962646 >> v1:172.21.15.125:6789/0 conn(0x7f137c071fa0 legacy=0x7f137c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 -- 172.21.15.93:0/1384962646 >> v1:172.21.15.93:6789/0 conn(0x7f137c072380 legacy=0x7f137c165cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.702+0000 7f1379d9b640 1 -- 172.21.15.93:0/1384962646 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0cd680 con 0x7f137c0b2010 2023-11-04T01:36:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.704+0000 7f1379d9b640 1 --2- 172.21.15.93:0/1384962646 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c0b2010 0x7f137c165790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c02ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0855ddde59ca94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.706+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e5c0550f0 con 0x7f4e640892f0 2023-11-04T01:36:13.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.707+0000 7f137959a640 1 -- 172.21.15.93:0/1384962646 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c02d840 con 0x7f137c0b2010 2023-11-04T01:36:13.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.707+0000 7f137959a640 1 -- 172.21.15.93:0/1384962646 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c02d9a0 con 0x7f137c0b2010 2023-11-04T01:36:13.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.707+0000 7f137959a640 1 -- 172.21.15.93:0/1384962646 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c02dd50 con 0x7f137c0b2010 2023-11-04T01:36:13.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.708+0000 7f138081a640 1 -- 172.21.15.93:0/1384962646 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c0b2010 msgr2=0x7f137c165790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.708+0000 7f138081a640 1 --2- 172.21.15.93:0/1384962646 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c0b2010 0x7f137c165790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c02ba80 comp rx=0 tx=0).stop 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.709+0000 7f138081a640 1 -- 172.21.15.93:0/1384962646 shutdown_connections 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.709+0000 7f138081a640 1 --2- 172.21.15.93:0/1384962646 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c0b2010 0x7f137c165790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.709+0000 7f138081a640 1 -- 172.21.15.93:0/1384962646 >> 172.21.15.93:0/1384962646 conn(0x7f137c06d800 msgr2=0x7f137c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.709+0000 7f138081a640 1 -- 172.21.15.93:0/1384962646 shutdown_connections 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.709+0000 7f138081a640 1 -- 172.21.15.93:0/1384962646 wait complete. 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.711+0000 7f138081a640 1 Processor -- start 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.711+0000 7f138081a640 1 -- start start 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 0x7f137c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 0x7f137c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f137c0b2010 0x7f137c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c7030 con 0x7f137c071fa0 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c7a70 con 0x7f137c0b2010 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f138081a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c7d50 con 0x7f137c072380 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f137a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 0x7f137c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f137a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 0x7f137c0b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48404/0 (socket says 172.21.15.93:48404) 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f137a59c640 1 -- 172.21.15.93:0/101484074 learned_addr learned my addr 172.21.15.93:0/101484074 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f1379d9b640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 0x7f137c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.713+0000 7f137ad9d640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f137c0b2010 0x7f137c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 -- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f137c0b2010 msgr2=0x7f137c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f137c0b2010 0x7f137c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 -- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 msgr2=0x7f137c0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 0x7f137c0b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 -- 172.21.15.93:0/101484074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0094d0 con 0x7f137c072380 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.714+0000 7f1379d9b640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 0x7f137c153c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f136c033000 tx=0x7f136c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.716+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c03b040 con 0x7f137c072380 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.716+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c003810 con 0x7f137c072380 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.716+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c003ba0 con 0x7f137c072380 2023-11-04T01:36:13.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.716+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0c8030 con 0x7f137c072380 2023-11-04T01:36:13.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.716+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c0c85f0 con 0x7f137c072380 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.720+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1360005250 con 0x7f137c072380 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.720+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f136c003d00 con 0x7f137c072380 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.721+0000 7f136affd640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 0x7f135c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.721+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f136c032070 con 0x7f137c072380 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.721+0000 7f137a59c640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 0x7f135c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.722+0000 7f137a59c640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 0x7f135c06d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1374001f90 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.734+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f136c076b80 con 0x7f137c072380 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.801+0000 7fb2a9193640 1 Processor -- start 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.801+0000 7fb2a9193640 1 -- start start 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.802+0000 7fb2a9193640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c008fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.802+0000 7fb2a9193640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29c050c70 0x7fb29c006af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.802+0000 7fb2a9193640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c053bf0 con 0x7fb29c007030 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.802+0000 7fb2a9193640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c0074c0 con 0x7fb29c050c70 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.802+0000 7fb2a9193640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c0511c0 con 0x7fb29c0e7570 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29c050c70 0x7fb29c006af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29c050c70 0x7fb29c006af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33628/0 (socket says 172.21.15.93:33628) 2023-11-04T01:36:13.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 -- 172.21.15.93:0/625730630 learned_addr learned my addr 172.21.15.93:0/625730630 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 -- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 msgr2=0x7fb29c008fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 --2- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c008fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 -- 172.21.15.93:0/625730630 >> v1:172.21.15.125:6789/0 conn(0x7fb29c007030 legacy=0x7fb29c0eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.803+0000 7fb2a37fe640 1 -- 172.21.15.93:0/625730630 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0514a0 con 0x7fb29c050c70 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.805+0000 7fb2a37fe640 1 --2- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c050c70 0x7fb29c006af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2a402cce0 tx=0x7fb2a40a6200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4f70b08ba455f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.805+0000 7fb2a2ffd640 1 -- 172.21.15.93:0/625730630 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40a6e60 con 0x7fb29c050c70 2023-11-04T01:36:13.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.805+0000 7fb2a2ffd640 1 -- 172.21.15.93:0/625730630 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a40ae440 con 0x7fb29c050c70 2023-11-04T01:36:13.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 -- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c050c70 msgr2=0x7fb29c006af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 --2- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c050c70 0x7fb29c006af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2a402cce0 tx=0x7fb2a40a6200 comp rx=0 tx=0).stop 2023-11-04T01:36:13.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 -- 172.21.15.93:0/625730630 shutdown_connections 2023-11-04T01:36:13.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 --2- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c050c70 0x7fb29c006af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 --2- 172.21.15.93:0/625730630 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c008fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.806+0000 7fb2a9193640 1 -- 172.21.15.93:0/625730630 >> 172.21.15.93:0/625730630 conn(0x7fb29c055c10 msgr2=0x7fb29c056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.807+0000 7fb2a9193640 1 -- 172.21.15.93:0/625730630 shutdown_connections 2023-11-04T01:36:13.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.807+0000 7fb2a9193640 1 -- 172.21.15.93:0/625730630 wait complete. 2023-11-04T01:36:13.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.808+0000 7fb2a9193640 1 Processor -- start 2023-11-04T01:36:13.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.809+0000 7fb2a9193640 1 -- start start 2023-11-04T01:36:13.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.810+0000 7fb2a9193640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c007030 0x7fb29c0e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.810+0000 7fb2a9193640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c04cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.810+0000 7fb2a9193640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.810+0000 7fb2a37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c04cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.810+0000 7fb2a37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c04cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54926/0 (socket says 172.21.15.93:54926) 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48408/0 (socket says 172.21.15.93:48408) 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a9193640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c04d510 con 0x7fb29c0d46a0 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a9193640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c04d7f0 con 0x7fb29c007030 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a9193640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c046690 con 0x7fb29c0e7570 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a37fe640 1 -- 172.21.15.93:0/3544496706 learned_addr learned my addr 172.21.15.93:0/3544496706 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 -- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 msgr2=0x7fb29c04cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c04cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 -- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c007030 msgr2=0x7fb29c0e4000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c007030 0x7fb29c0e4000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.811+0000 7fb2a8992640 1 -- 172.21.15.93:0/3544496706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a404ea00 con 0x7fb29c0d46a0 2023-11-04T01:36:13.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.812+0000 7fb2a8992640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c550 tx=0x7fb29000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.813+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2900126e0 con 0x7fb29c0d46a0 2023-11-04T01:36:13.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.813+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c046970 con 0x7fb29c0d46a0 2023-11-04T01:36:13.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.813+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c04d220 con 0x7fb29c0d46a0 2023-11-04T01:36:13.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.816+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290012860 con 0x7fb29c0d46a0 2023-11-04T01:36:13.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.816+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290012c10 con 0x7fb29c0d46a0 2023-11-04T01:36:13.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.816+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb29001b400 con 0x7fb29c0d46a0 2023-11-04T01:36:13.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.817+0000 7fb2a0ff9640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 0x7fb28806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:13.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.817+0000 7fb2a3fff640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 0x7fb28806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:13.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.817+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb290089ab0 con 0x7fb29c0d46a0 2023-11-04T01:36:13.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.818+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284005250 con 0x7fb29c0d46a0 2023-11-04T01:36:13.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.818+0000 7fb2a3fff640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 0x7fb28806d4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb2980095d0 tx=0x7fb298006b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:13.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.828+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb290016080 con 0x7fb29c0d46a0 2023-11-04T01:36:13.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.959+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb6c005500 con 0x7fdb88142480 2023-11-04T01:36:13.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.961+0000 7fdb84ff9640 1 -- 172.21.15.93:0/960703729 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb70079750 con 0x7fdb88142480 2023-11-04T01:36:13.964 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:13.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.963+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 msgr2=0x7fdb6806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 0x7fdb6806d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009440 tx=0x7fdb80009040 comp rx=0 tx=0).stop 2023-11-04T01:36:13.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 msgr2=0x7fdb8813e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 0x7fdb8813e960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb70033000 tx=0x7fdb700046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 shutdown_connections 2023-11-04T01:36:13.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb6806aec0 0x7fdb6806d380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb88142480 0x7fdb8813e960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb88141e20 0x7fdb881596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 --2- 172.21.15.93:0/960703729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdb88067090 0x7fdb8815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 >> 172.21.15.93:0/960703729 conn(0x7fdb8806a120 msgr2=0x7fdb880cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 shutdown_connections 2023-11-04T01:36:13.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.964+0000 7fdb8e397640 1 -- 172.21.15.93:0/960703729 wait complete. 2023-11-04T01:36:13.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-11-04T01:36:13.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.984+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd174074290 con 0x7fd174158c80 2023-11-04T01:36:13.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.985+0000 7fd169ffb640 1 -- 172.21.15.93:0/663767929 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd170053a90 con 0x7fd174158c80 2023-11-04T01:36:13.988 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.987+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 msgr2=0x7fd15806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.987+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 0x7fd15806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1640094a0 tx=0x7fd164009240 comp rx=0 tx=0).stop 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 msgr2=0x7fd174159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd174159f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c3e0 tx=0x7fd17000c8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 shutdown_connections 2023-11-04T01:36:13.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd174159060 0x7fd17415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd174158c80 0x7fd174159f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 --2- 172.21.15.93:0/663767929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740ce4c0 0x7fd174157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 >> 172.21.15.93:0/663767929 conn(0x7fd17406a120 msgr2=0x7fd174070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 shutdown_connections 2023-11-04T01:36:13.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:13.988+0000 7fd15f7fe640 1 -- 172.21.15.93:0/663767929 wait complete. 2023-11-04T01:36:14.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-11-04T01:36:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.007+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faa580b52d0 con 0x7faa5815add0 2023-11-04T01:36:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.008+0000 7faa4effd640 1 -- 172.21.15.93:0/3760970893 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa50039020 con 0x7faa5815add0 2023-11-04T01:36:14.010 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 msgr2=0x7faa3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 0x7faa3c06d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa48004e90 tx=0x7faa48007f10 comp rx=0 tx=0).stop 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 msgr2=0x7faa5806a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa50033000 tx=0x7faa50004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 shutdown_connections 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa5815add0 0x7faa5806a120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa58072400 0x7faa58153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 --2- 172.21.15.93:0/3760970893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa58071f90 0x7faa581488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 >> 172.21.15.93:0/3760970893 conn(0x7faa5806d800 msgr2=0x7faa5815cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 shutdown_connections 2023-11-04T01:36:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.011+0000 7faa4cff9640 1 -- 172.21.15.93:0/3760970893 wait complete. 2023-11-04T01:36:14.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-04T01:36:14.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.048+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1360005500 con 0x7f137c072380 2023-11-04T01:36:14.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.048+0000 7f136affd640 1 -- 172.21.15.93:0/101484074 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f136c07a1a0 con 0x7f137c072380 2023-11-04T01:36:14.049 INFO:teuthology.orchestra.run.smithi093.stdout:55834574856 2023-11-04T01:36:14.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.050+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7ca4005500 con 0x7f7cb40d52e0 2023-11-04T01:36:14.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.050+0000 7f7cb2ffd640 1 -- 172.21.15.93:0/159451581 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cb8057b20 con 0x7f7cb40d52e0 2023-11-04T01:36:14.052 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 msgr2=0x7f135c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 0x7f135c06d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1374001f90 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 msgr2=0x7f137c153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 0x7f137c153c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f136c033000 tx=0x7f136c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 shutdown_connections 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f135c06af40 0x7f135c06d400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f137c0b2010 0x7f137c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f137c072380 0x7f137c153c10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 --2- 172.21.15.93:0/101484074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f137c071fa0 0x7f137c0b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 >> 172.21.15.93:0/101484074 conn(0x7f137c06d800 msgr2=0x7f137c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 shutdown_connections 2023-11-04T01:36:14.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.051+0000 7f138081a640 1 -- 172.21.15.93:0/101484074 wait complete. 2023-11-04T01:36:14.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.052+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4e6404ece0 con 0x7f4e640892f0 2023-11-04T01:36:14.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.052+0000 7f4e59ffb640 1 -- 172.21.15.93:0/3876638686 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e5c003e60 con 0x7f4e640892f0 2023-11-04T01:36:14.054 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:14.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 msgr2=0x7f7ca006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 0x7f7ca006d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc02cce0 tx=0x7f7cbc075000 comp rx=0 tx=0).stop 2023-11-04T01:36:14.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 msgr2=0x7f7cb40e22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c410 tx=0x7f7cb800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 shutdown_connections 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7ca006aea0 0x7f7ca006d360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb40d52e0 0x7f7cb40e22a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cb40dff00 0x7f7cb40e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 --2- 172.21.15.93:0/159451581 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7cb4055740 0x7f7cb40d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 >> 172.21.15.93:0/159451581 conn(0x7f7cb4055c10 msgr2=0x7f7cb4008b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 shutdown_connections 2023-11-04T01:36:14.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.053+0000 7f7cc321a640 1 -- 172.21.15.93:0/159451581 wait complete. 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.054+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 msgr2=0x7f4e4806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.054+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 0x7f4e4806d400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e60036000 tx=0x7f4e6003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 msgr2=0x7f4e64157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00ce10 tx=0x7f4e5c00a660 comp rx=0 tx=0).stop 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 shutdown_connections 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4e4806af40 0x7f4e4806d400 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e640ca1b0 0x7f4e6407f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4e640af610 0x7f4e6415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 --2- 172.21.15.93:0/3876638686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e640892f0 0x7f4e64157db0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 >> 172.21.15.93:0/3876638686 conn(0x7f4e6406c7a0 msgr2=0x7f4e640cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 shutdown_connections 2023-11-04T01:36:14.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.055+0000 7f4e6b9cc640 1 -- 172.21.15.93:0/3876638686 wait complete. 2023-11-04T01:36:14.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-04T01:36:14.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-11-04T01:36:14.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-04T01:36:14.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.068+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f602c005500 con 0x7f6044158bf0 2023-11-04T01:36:14.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.069+0000 7f603affd640 1 -- 172.21.15.93:0/3528240286 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6034017020 con 0x7f6044158bf0 2023-11-04T01:36:14.071 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:14.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 msgr2=0x7f602806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 0x7f602806d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60400011e0 tx=0x7f6040007d30 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 msgr2=0x7f6044152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f603400e980 tx=0x7f603400ee40 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 shutdown_connections 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f602806af40 0x7f602806d400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f604415a070 0x7f60440c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6044158bf0 0x7f6044152360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 --2- 172.21.15.93:0/3528240286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f604406ac10 0x7f6044151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 >> 172.21.15.93:0/3528240286 conn(0x7f604406a120 msgr2=0x7f60440ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 shutdown_connections 2023-11-04T01:36:14.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.072+0000 7f604c35e640 1 -- 172.21.15.93:0/3528240286 wait complete. 2023-11-04T01:36:14.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-11-04T01:36:14.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.136+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb284005500 con 0x7fb29c0d46a0 2023-11-04T01:36:14.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.138+0000 7fb2a0ff9640 1 -- 172.21.15.93:0/3544496706 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb290054850 con 0x7fb29c0d46a0 2023-11-04T01:36:14.140 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 msgr2=0x7fb28806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 0x7fb28806d4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb2980095d0 tx=0x7fb298006b30 comp rx=0 tx=0).stop 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 msgr2=0x7fb29c048f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c550 tx=0x7fb29000ca10 comp rx=0 tx=0).stop 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 shutdown_connections 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb28806aff0 0x7fb28806d4b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb29c0d46a0 0x7fb29c048f10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29c0e7570 0x7fb29c04cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 --2- 172.21.15.93:0/3544496706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb29c007030 0x7fb29c0e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:14.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 >> 172.21.15.93:0/3544496706 conn(0x7fb29c055c10 msgr2=0x7fb29c0e7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:14.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 shutdown_connections 2023-11-04T01:36:14.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:14.140+0000 7fb2a9193640 1 -- 172.21.15.93:0/3544496706 wait complete. 2023-11-04T01:36:14.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-04T01:36:14.153 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:14.983 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:15.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:15.031 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:15.070 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:15.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:15.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:15.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:15.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.105+0000 7fdaecfe2640 1 Processor -- start 2023-11-04T01:36:15.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.105+0000 7fdaecfe2640 1 -- start start 2023-11-04T01:36:15.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdaecfe2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdae8071f90 0x7fdae80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdaecfe2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae815add0 0x7fdae80cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdaecfe2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80b1cc0 con 0x7fdae8072370 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdaecfe2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80b1fa0 con 0x7fdae8071f90 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdaecfe2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815a0e0 con 0x7fdae815add0 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdae6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdae8072370 0x7fdae80cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54386/0 (socket says 172.21.15.93:54386) 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdae6d9d640 1 -- 172.21.15.93:0/1256446142 learned_addr learned my addr 172.21.15.93:0/1256446142 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.107+0000 7fdae659c640 1 --2- 172.21.15.93:0/1256446142 >> v2:172.21.15.93:3300/0 conn(0x7fdae8071f90 0x7fdae80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.108+0000 7fdae659c640 1 -- 172.21.15.93:0/1256446142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae815add0 msgr2=0x7fdae80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.108+0000 7fdae659c640 1 --2- 172.21.15.93:0/1256446142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae815add0 0x7fdae80cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.108+0000 7fdae659c640 1 -- 172.21.15.93:0/1256446142 >> v1:172.21.15.93:6789/0 conn(0x7fdae8072370 legacy=0x7fdae80cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.108+0000 7fdae659c640 1 -- 172.21.15.93:0/1256446142 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae815a2f0 con 0x7fdae8071f90 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.109+0000 7fdae659c640 1 --2- 172.21.15.93:0/1256446142 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae80b1490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdad80097a0 tx=0x7fdad802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999d232c506e597a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.110+0000 7fdae559a640 1 -- 172.21.15.93:0/1256446142 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8031830 con 0x7fdae8071f90 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.110+0000 7fdae559a640 1 -- 172.21.15.93:0/1256446142 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad8031990 con 0x7fdae8071f90 2023-11-04T01:36:15.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.111+0000 7fdaecfe2640 1 -- 172.21.15.93:0/1256446142 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 msgr2=0x7fdae80b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.111+0000 7fdae559a640 1 -- 172.21.15.93:0/1256446142 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8031830 con 0x7fdae8071f90 2023-11-04T01:36:15.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.111+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/1256446142 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae80b1490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdad80097a0 tx=0x7fdad802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 -- 172.21.15.93:0/1256446142 shutdown_connections 2023-11-04T01:36:15.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/1256446142 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae815add0 0x7fdae80cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/1256446142 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae80b1490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 -- 172.21.15.93:0/1256446142 >> 172.21.15.93:0/1256446142 conn(0x7fdae806d800 msgr2=0x7fdae806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 -- 172.21.15.93:0/1256446142 shutdown_connections 2023-11-04T01:36:15.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.112+0000 7fdaecfe2640 1 -- 172.21.15.93:0/1256446142 wait complete. 2023-11-04T01:36:15.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.114+0000 7fdaecfe2640 1 Processor -- start 2023-11-04T01:36:15.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.115+0000 7fdaecfe2640 1 -- start start 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.116+0000 7fdaecfe2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.116+0000 7fdae659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.116+0000 7fdae659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48426/0 (socket says 172.21.15.93:48426) 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdae659c640 1 -- 172.21.15.93:0/260189531 learned_addr learned my addr 172.21.15.93:0/260189531 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8072370 0x7fdae80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 0x7fdae814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80afe30 con 0x7fdae8071f90 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b0060 con 0x7fdae815add0 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b0340 con 0x7fdae8072370 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdae5d9b640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8072370 0x7fdae80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.117+0000 7fdae6d9d640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 0x7fdae814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 -- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8072370 msgr2=0x7fdae80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8072370 0x7fdae80af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 -- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 msgr2=0x7fdae8150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad8009400 con 0x7fdae815add0 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae659c640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:15.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.118+0000 7fdae6d9d640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 0x7fdae814f7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdae000caa0 tx=0x7fdae000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.119+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ac00 con 0x7fdae815add0 2023-11-04T01:36:15.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.119+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000ad60 con 0x7fdae815add0 2023-11-04T01:36:15.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.119+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0012600 con 0x7fdae815add0 2023-11-04T01:36:15.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.119+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80b0620 con 0x7fdae815add0 2023-11-04T01:36:15.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.119+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80b0be0 con 0x7fdae815add0 2023-11-04T01:36:15.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.121+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc005250 con 0x7fdae815add0 2023-11-04T01:36:15.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.126+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdae0007070 con 0x7fdae815add0 2023-11-04T01:36:15.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.126+0000 7fdad6ffd640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 0x7fdac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.126+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdae0089670 con 0x7fdae815add0 2023-11-04T01:36:15.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.127+0000 7fdae659c640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 0x7fdac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.127+0000 7fdae659c640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 0x7fdac806d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdad802beb0 tx=0x7fdad8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.131+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdae00544e0 con 0x7fdae815add0 2023-11-04T01:36:15.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.157+0000 7f1fb84bb640 1 Processor -- start 2023-11-04T01:36:15.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.157+0000 7f1fb84bb640 1 -- start start 2023-11-04T01:36:15.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.158+0000 7f1fb84bb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.158+0000 7f1fb84bb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 0x7f1fb00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.158+0000 7f1fb84bb640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00cdfb0 con 0x7f1fb00b2010 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.158+0000 7f1fb84bb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb006ab00 con 0x7f1fb006a660 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.158+0000 7f1fb84bb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00cd680 con 0x7f1fb0071fa0 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6a58640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 0x7f1fb00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54944/0 (socket says 172.21.15.93:54944) 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 -- 172.21.15.93:0/3311197474 learned_addr learned my addr 172.21.15.93:0/3311197474 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 -- 172.21.15.93:0/3311197474 >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 msgr2=0x7f1fb00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 --2- 172.21.15.93:0/3311197474 >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 0x7f1fb00ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 -- 172.21.15.93:0/3311197474 >> v1:172.21.15.125:6789/0 conn(0x7f1fb00b2010 legacy=0x7f1fb00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6257640 1 -- 172.21.15.93:0/3311197474 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00cd960 con 0x7f1fb0071fa0 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.159+0000 7f1fb6a58640 1 --2- 172.21.15.93:0/3311197474 >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 0x7f1fb00ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.160+0000 7f1fb6257640 1 --2- 172.21.15.93:0/3311197474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009870 tx=0x7f1fac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea734b22c4ca2218 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.161+0000 7f1fb5255640 1 -- 172.21.15.93:0/3311197474 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac031640 con 0x7f1fb0071fa0 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.161+0000 7f1fb5255640 1 -- 172.21.15.93:0/3311197474 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0317a0 con 0x7f1fb0071fa0 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.161+0000 7f1fb5255640 1 -- 172.21.15.93:0/3311197474 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac031b30 con 0x7f1fb0071fa0 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3311197474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 msgr2=0x7f1fb006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3311197474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009870 tx=0x7f1fac02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3311197474 shutdown_connections 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3311197474 >> v2:172.21.15.93:3300/0 conn(0x7f1fb006a660 0x7f1fb00ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3311197474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb0071fa0 0x7f1fb006a120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3311197474 >> 172.21.15.93:0/3311197474 conn(0x7f1fb006d800 msgr2=0x7f1fb006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3311197474 shutdown_connections 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.162+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3311197474 wait complete. 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.164+0000 7f1fb84bb640 1 Processor -- start 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.164+0000 7f1fb84bb640 1 -- start start 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.165+0000 7f1fb84bb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.165+0000 7f1fb84bb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fb0071fa0 0x7f1fb00b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.165+0000 7f1fb84bb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1fb00b2010 0x7f1fb00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb84bb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c13d0 con 0x7f1fb00b2010 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb84bb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c16b0 con 0x7f1fb0071fa0 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb84bb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c1990 con 0x7f1fb006a660 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6a58640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1fb00b2010 0x7f1fb00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54960/0 (socket says 172.21.15.93:54960) 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 -- 172.21.15.93:0/3467489561 learned_addr learned my addr 172.21.15.93:0/3467489561 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb5a56640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fb0071fa0 0x7f1fb00b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 -- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fb0071fa0 msgr2=0x7f1fb00b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fb0071fa0 0x7f1fb00b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 -- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1fb00b2010 msgr2=0x7f1fb00b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1fb00b2010 0x7f1fb00b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 -- 172.21.15.93:0/3467489561 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8009a70 con 0x7f1fb006a660 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fb6257640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0090b0 tx=0x7f1fac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.166+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac03a930 con 0x7f1fb006a660 2023-11-04T01:36:15.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.167+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac03aab0 con 0x7f1fb006a660 2023-11-04T01:36:15.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.167+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac03ae60 con 0x7f1fb006a660 2023-11-04T01:36:15.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.167+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac0094d0 con 0x7f1fb006a660 2023-11-04T01:36:15.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.167+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb00c1f50 con 0x7f1fb006a660 2023-11-04T01:36:15.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.168+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb00674e0 con 0x7f1fb006a660 2023-11-04T01:36:15.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.169+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fac02f050 con 0x7f1fb006a660 2023-11-04T01:36:15.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.169+0000 7f1fa6ffd640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 0x7f1f9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.169+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fac0ab7d0 con 0x7f1fb006a660 2023-11-04T01:36:15.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.169+0000 7f1fb5a56640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 0x7f1f9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.170+0000 7f1fb5a56640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 0x7f1f9406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00726d0 tx=0x7f1fa0009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.174+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fac0764f0 con 0x7f1fb006a660 2023-11-04T01:36:15.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.174+0000 7fd193c00640 1 Processor -- start 2023-11-04T01:36:15.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.174+0000 7fd193c00640 1 -- start start 2023-11-04T01:36:15.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd193c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd18c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd193c00640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd18c0722a0 0x7fd18c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd193c00640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0cdf80 con 0x7fd18c06a660 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd193c00640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c0b19d0 con 0x7fd18c0722a0 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd193c00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c06aaf0 con 0x7fd18c1603d0 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd19199c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd18c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd19219d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd18c06a660 0x7fd18c160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54392/0 (socket says 172.21.15.93:54392) 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.176+0000 7fd19219d640 1 -- 172.21.15.93:0/4028395520 learned_addr learned my addr 172.21.15.93:0/4028395520 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.177+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787291306 0 0) 0x7fd18c0cdf80 con 0x7fd18c06a660 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.177+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd178003520 con 0x7fd18c06a660 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.177+0000 7fd19119b640 1 --2- 172.21.15.93:0/4028395520 >> v2:172.21.15.93:3300/0 conn(0x7fd18c0722a0 0x7fd18c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778757304 0 0) 0x7fd178003520 con 0x7fd18c06a660 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 msgr2=0x7fd18c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd18c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 >> v2:172.21.15.93:3300/0 conn(0x7fd18c0722a0 msgr2=0x7fd18c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 --2- 172.21.15.93:0/4028395520 >> v2:172.21.15.93:3300/0 conn(0x7fd18c0722a0 0x7fd18c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0ce6f0 con 0x7fd18c06a660 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fd1840019f0 con 0x7fd18c06a660 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 >> v1:172.21.15.93:6789/0 conn(0x7fd18c06a660 legacy=0x7fd18c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd178003970 0x7fd178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd1780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd178004d00 0x7fd178005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c06aaf0 con 0x7fd178004d00 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17800b980 con 0x7fd178003970 2023-11-04T01:36:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17800bac0 con 0x7fd18c1603d0 2023-11-04T01:36:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19119b640 1 --2- 172.21.15.93:0/4028395520 >> v2:172.21.15.93:3300/0 conn(0x7fd18c0722a0 0x7fd18c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19199c640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd178003970 0x7fd178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.178+0000 7fd19219d640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd178004d00 0x7fd178005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19119b640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd1780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19219d640 1 -- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 msgr2=0x7fd1780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19219d640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd1780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19219d640 1 -- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd178003970 msgr2=0x7fd178003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19219d640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd178003970 0x7fd178003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19219d640 1 -- 172.21.15.93:0/4028395520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0ce6f0 con 0x7fd178004d00 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.179+0000 7fd19119b640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c1603d0 0x7fd1780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.180+0000 7fd19219d640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd178004d00 0x7fd178005180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd18400ab30 tx=0x7fd1780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649fa05bc534dc68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.180+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184032620 con 0x7fd178004d00 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.181+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1840327c0 con 0x7fd178004d00 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd19099a640 1 -- 172.21.15.93:0/4028395520 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184032b70 con 0x7fd178004d00 2023-11-04T01:36:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 -- 172.21.15.93:0/4028395520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd178004d00 msgr2=0x7fd178005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 --2- 172.21.15.93:0/4028395520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd178004d00 0x7fd178005180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd18400ab30 tx=0x7fd1780057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd19219d640 1 -- 172.21.15.93:0/4028395520 reap_dead start 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 -- 172.21.15.93:0/4028395520 shutdown_connections 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 -- 172.21.15.93:0/4028395520 >> 172.21.15.93:0/4028395520 conn(0x7fd18c06d800 msgr2=0x7fd18c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 -- 172.21.15.93:0/4028395520 shutdown_connections 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.182+0000 7fd193c00640 1 -- 172.21.15.93:0/4028395520 wait complete. 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.184+0000 7fd193c00640 1 Processor -- start 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.185+0000 7fd193c00640 1 -- start start 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd193c00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd193c00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd18c0b3e10 0x7fd18c0be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd193c00640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 0x7fd18c1fa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd19199c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd19199c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54994/0 (socket says 172.21.15.93:54994) 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd19119b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd18c0b3e10 0x7fd18c0be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd19199c640 1 -- 172.21.15.93:0/1040560174 learned_addr learned my addr 172.21.15.93:0/1040560174 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd19219d640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 0x7fd18c1fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0bed80 con 0x7fd18c0be900 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.186+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c15cbb0 con 0x7fd18c0b3e10 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b45b0 con 0x7fd18c0b3a30 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19199c640 1 -- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd18c0b3e10 msgr2=0x7fd18c0be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19199c640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd18c0b3e10 0x7fd18c0be3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19199c640 1 -- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 msgr2=0x7fd18c1fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19199c640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 0x7fd18c1fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19199c640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0b4890 con 0x7fd18c0b3a30 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.187+0000 7fd19219d640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 0x7fd18c1fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd19199c640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1880119d0 tx=0x7fd188011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800faf0 con 0x7fd18c0b3a30 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18800fc50 con 0x7fd18c0b3a30 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188014440 con 0x7fd18c0b3a30 2023-11-04T01:36:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0b4b70 con 0x7fd18c0b3a30 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.188+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c1560b0 con 0x7fd18c0b3a30 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.190+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c0b5990 con 0x7fd18c0b3a30 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.191+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1880145a0 con 0x7fd18c0b3a30 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.191+0000 7fd1827fc640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 0x7fd17006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.191+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd18808a030 con 0x7fd18c0b3a30 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.191+0000 7fd19119b640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 0x7fd17006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.192+0000 7fd19119b640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 0x7fd17006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0b5580 tx=0x7fd17c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.196+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd188054e80 con 0x7fd18c0b3a30 2023-11-04T01:36:15.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.218+0000 7f79a2894640 1 Processor -- start 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.218+0000 7f79a2894640 1 -- start start 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a2894640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f799c072370 0x7f799c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a2894640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0b1cc0 con 0x7f799c15add0 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a2894640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c15a2f0 con 0x7f799c071f90 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a2894640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0b1fa0 con 0x7f799c072370 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a0e31640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f799c072370 0x7f799c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a0e31640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f799c072370 0x7f799c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48488/0 (socket says 172.21.15.93:48488) 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.219+0000 7f79a0e31640 1 -- 172.21.15.93:0/627314948 learned_addr learned my addr 172.21.15.93:0/627314948 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.220+0000 7f79a0e31640 1 -- 172.21.15.93:0/627314948 >> v1:172.21.15.125:6789/0 conn(0x7f799c071f90 legacy=0x7f799c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.220+0000 7f79a0e31640 1 -- 172.21.15.93:0/627314948 >> v1:172.21.15.93:6789/0 conn(0x7f799c15add0 legacy=0x7f799c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.220+0000 7f79a0e31640 1 -- 172.21.15.93:0/627314948 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c15a5d0 con 0x7f799c072370 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.221+0000 7f79a0e31640 1 --2- 172.21.15.93:0/627314948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c072370 0x7f799c0cf3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7994009e50 tx=0x7f799402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bb824bdbe30383 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.221+0000 7f799affd640 1 -- 172.21.15.93:0/627314948 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799402cb10 con 0x7f799c072370 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.221+0000 7f799affd640 1 -- 172.21.15.93:0/627314948 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799402cc70 con 0x7f799c072370 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.221+0000 7f799affd640 1 -- 172.21.15.93:0/627314948 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940343f0 con 0x7f799c072370 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.222+0000 7f79a2894640 1 -- 172.21.15.93:0/627314948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c072370 msgr2=0x7f799c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.222+0000 7f79a2894640 1 --2- 172.21.15.93:0/627314948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c072370 0x7f799c0cf3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7994009e50 tx=0x7f799402bf70 comp rx=0 tx=0).stop 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.222+0000 7f79a2894640 1 -- 172.21.15.93:0/627314948 shutdown_connections 2023-11-04T01:36:15.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.222+0000 7f79a2894640 1 --2- 172.21.15.93:0/627314948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c072370 0x7f799c0cf3d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.222+0000 7f79a2894640 1 -- 172.21.15.93:0/627314948 >> 172.21.15.93:0/627314948 conn(0x7f799c06d800 msgr2=0x7f799c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.223+0000 7f79a2894640 1 -- 172.21.15.93:0/627314948 shutdown_connections 2023-11-04T01:36:15.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.223+0000 7f79a2894640 1 -- 172.21.15.93:0/627314948 wait complete. 2023-11-04T01:36:15.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.224+0000 7f79a2894640 1 Processor -- start 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.225+0000 7f79a2894640 1 -- start start 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f799c072370 0x7f799c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 0x7f799c1424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c52f0 con 0x7f799c071f90 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c55d0 con 0x7f799c15add0 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a2894640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c58b0 con 0x7f799c072370 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f799bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f799bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48504/0 (socket says 172.21.15.93:48504) 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f799bfff640 1 -- 172.21.15.93:0/2792912770 learned_addr learned my addr 172.21.15.93:0/2792912770 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.226+0000 7f79a0e31640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 0x7f799c1424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 -- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f799c072370 msgr2=0x7f799c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f799c072370 0x7f799c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 -- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 msgr2=0x7f799c0c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 -- 172.21.15.93:0/2792912770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009b30 con 0x7f799c15add0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f799bfff640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f79a0e31640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 0x7f799c1424f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7994032000 tx=0x7f7994004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.227+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994009510 con 0x7f799c15add0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.228+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799403e450 con 0x7f799c15add0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.228+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799403e7c0 con 0x7f799c15add0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.228+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0c5b90 con 0x7f799c15add0 2023-11-04T01:36:15.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.228+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c0c4fc0 con 0x7f799c15add0 2023-11-04T01:36:15.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.229+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0c60b0 con 0x7f799c15add0 2023-11-04T01:36:15.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.231+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f799403e920 con 0x7f799c15add0 2023-11-04T01:36:15.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.232+0000 7f7998ff9640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.232+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79940ac890 con 0x7f799c15add0 2023-11-04T01:36:15.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.232+0000 7f799bfff640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.233+0000 7f799bfff640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 0x7f798806d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f798c009dd0 tx=0x7f798c009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.235+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79940776c0 con 0x7f799c15add0 2023-11-04T01:36:15.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.238+0000 7f551ba90640 1 Processor -- start 2023-11-04T01:36:15.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.238+0000 7f551ba90640 1 -- start start 2023-11-04T01:36:15.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551ba90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f55140cf180 0x7f551406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551ba90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140cea20 con 0x7f551415cfd0 2023-11-04T01:36:15.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551ba90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140cf610 con 0x7f55140cd570 2023-11-04T01:36:15.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551ba90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551415d3b0 con 0x7f55140cf180 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551902b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f55140cf180 0x7f551406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551982c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f551415cfd0 0x7f5514161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54400/0 (socket says 172.21.15.93:54400) 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551902b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f55140cf180 0x7f551406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48508/0 (socket says 172.21.15.93:48508) 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.239+0000 7f551982c640 1 -- 172.21.15.93:0/4169369724 learned_addr learned my addr 172.21.15.93:0/4169369724 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.240+0000 7f551882a640 1 -- 172.21.15.93:0/4169369724 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864561923 0 0) 0x7f55140cea20 con 0x7f551415cfd0 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.240+0000 7f551882a640 1 -- 172.21.15.93:0/4169369724 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5500003520 con 0x7f551415cfd0 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.240+0000 7f551902b640 1 -- 172.21.15.93:0/4169369724 >> v1:172.21.15.125:6789/0 conn(0x7f55140cd570 legacy=0x7f55140cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.240+0000 7f551902b640 1 -- 172.21.15.93:0/4169369724 >> v1:172.21.15.93:6789/0 conn(0x7f551415cfd0 legacy=0x7f5514161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.240+0000 7f551902b640 1 -- 172.21.15.93:0/4169369724 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140cf8f0 con 0x7f55140cf180 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.241+0000 7f551902b640 1 --2- 172.21.15.93:0/4169369724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cf180 0x7f551406c0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55040097a0 tx=0x7f550402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4467388e97fead5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.241+0000 7f551882a640 1 -- 172.21.15.93:0/4169369724 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504031640 con 0x7f55140cf180 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.242+0000 7f551882a640 1 -- 172.21.15.93:0/4169369724 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55040317a0 con 0x7f55140cf180 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.242+0000 7f551882a640 1 -- 172.21.15.93:0/4169369724 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504031b10 con 0x7f55140cf180 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 -- 172.21.15.93:0/4169369724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cf180 msgr2=0x7f551406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 --2- 172.21.15.93:0/4169369724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cf180 0x7f551406c0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55040097a0 tx=0x7f550402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 -- 172.21.15.93:0/4169369724 shutdown_connections 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 --2- 172.21.15.93:0/4169369724 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cf180 0x7f551406c0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 -- 172.21.15.93:0/4169369724 >> 172.21.15.93:0/4169369724 conn(0x7f551406ea20 msgr2=0x7f551406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 -- 172.21.15.93:0/4169369724 shutdown_connections 2023-11-04T01:36:15.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.243+0000 7f551ba90640 1 -- 172.21.15.93:0/4169369724 wait complete. 2023-11-04T01:36:15.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.245+0000 7f551ba90640 1 Processor -- start 2023-11-04T01:36:15.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.245+0000 7f551ba90640 1 -- start start 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f0de6b0f640 1 Processor -- start 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f0de6b0f640 1 -- start start 2023-11-04T01:36:15.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f551415cfd0 0x7f55140c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 0x7f55140c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551982c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551982c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48510/0 (socket says 172.21.15.93:48510) 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551982c640 1 -- 172.21.15.93:0/1354665921 learned_addr learned my addr 172.21.15.93:0/1354665921 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551902b640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f551415cfd0 0x7f55140c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551a02d640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 0x7f55140c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141f2960 con 0x7f55140cd570 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c76e0 con 0x7f551415cfd0 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.247+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55141f31a0 con 0x7f5514159a10 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551a02d640 1 -- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f551415cfd0 msgr2=0x7f55140c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551a02d640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f551415cfd0 0x7f55140c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de6b0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 0x7f0de00cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551a02d640 1 -- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 msgr2=0x7f55141f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de6b0f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0de0072370 0x7f0de00cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551a02d640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de6b0f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00b1cc0 con 0x7f0de0071f90 2023-11-04T01:36:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551a02d640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009400 con 0x7f5514159a10 2023-11-04T01:36:15.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f551982c640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de48ab640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0de0071f90 0x7f0de00b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54406/0 (socket says 172.21.15.93:54406) 2023-11-04T01:36:15.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de48ab640 1 -- 172.21.15.93:0/2728864660 learned_addr learned my addr 172.21.15.93:0/2728864660 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de50ac640 1 --2- 172.21.15.93:0/2728864660 >> v2:172.21.15.125:3300/0 conn(0x7f0de0072370 0x7f0de00cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.248+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00b1fa0 con 0x7f0de0072370 2023-11-04T01:36:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015a0e0 con 0x7f0de015add0 2023-11-04T01:36:15.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f551a02d640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 0x7f55140c6dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c700 tx=0x7f550c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0ddffff640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 0x7f0de00cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0ddf7fe640 1 -- 172.21.15.93:0/2728864660 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589296160 0 0) 0x7f0de00b1cc0 con 0x7f0de0071f90 2023-11-04T01:36:15.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0ddf7fe640 1 -- 172.21.15.93:0/2728864660 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd0005730 con 0x7f0de0071f90 2023-11-04T01:36:15.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c003b70 con 0x7f5514159a10 2023-11-04T01:36:15.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0de50ac640 1 -- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 msgr2=0x7f0de00cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:15.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0de50ac640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 0x7f0de00cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55140c7400 con 0x7f5514159a10 2023-11-04T01:36:15.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0de50ac640 1 -- 172.21.15.93:0/2728864660 >> v1:172.21.15.93:6789/0 conn(0x7f0de0071f90 legacy=0x7f0de00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0de50ac640 1 -- 172.21.15.93:0/2728864660 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de015a2f0 con 0x7f0de0072370 2023-11-04T01:36:15.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55141f2e30 con 0x7f5514159a10 2023-11-04T01:36:15.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.249+0000 7f0ddffff640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 0x7f0de00cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:15.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.250+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c003cd0 con 0x7f5514159a10 2023-11-04T01:36:15.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.251+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c005310 con 0x7f5514159a10 2023-11-04T01:36:15.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.251+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f550c0054f0 con 0x7f5514159a10 2023-11-04T01:36:15.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f0de50ac640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00cf200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a222bf5aa6003fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc005250 con 0x7f5514159a10 2023-11-04T01:36:15.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f0ddf7fe640 1 -- 172.21.15.93:0/2728864660 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd802cc50 con 0x7f0de0072370 2023-11-04T01:36:15.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f0ddf7fe640 1 -- 172.21.15.93:0/2728864660 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd802cdb0 con 0x7f0de0072370 2023-11-04T01:36:15.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f550a7fc640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 0x7f54f806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.252+0000 7f0ddf7fe640 1 -- 172.21.15.93:0/2728864660 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8034640 con 0x7f0de0072370 2023-11-04T01:36:15.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f551982c640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 0x7f54f806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 msgr2=0x7f0de00cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00cf200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 shutdown_connections 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00cf200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/2728864660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de015add0 0x7f0de00cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 >> 172.21.15.93:0/2728864660 conn(0x7f0de006d800 msgr2=0x7f0de006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 shutdown_connections 2023-11-04T01:36:15.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f0de6b0f640 1 -- 172.21.15.93:0/2728864660 wait complete. 2023-11-04T01:36:15.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f551982c640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 0x7f54f806d400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5510007b60 tx=0x7f5510007ab0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.253+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f550c0893e0 con 0x7f5514159a10 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.254+0000 7f0de6b0f640 1 Processor -- start 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.254+0000 7f0de6b0f640 1 -- start start 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de0071f90 0x7f0de0158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00ac4b0 con 0x7f0de015add0 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00c7550 con 0x7f0de0072370 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de6b0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00c7830 con 0x7f0de0071f90 2023-11-04T01:36:15.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de50ac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de50ac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48524/0 (socket says 172.21.15.93:48524) 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de50ac640 1 -- 172.21.15.93:0/1194547763 learned_addr learned my addr 172.21.15.93:0/1194547763 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0ddffff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.255+0000 7f0de48ab640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de0071f90 0x7f0de0158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 -- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de0071f90 msgr2=0x7f0de0158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de0071f90 0x7f0de0158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 -- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 msgr2=0x7f0de00b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 -- 172.21.15.93:0/1194547763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8009a70 con 0x7f0de0072370 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0de50ac640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddffff640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00c9030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c5e0 tx=0x7f0dcc00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011800 con 0x7f0de0072370 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.256+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de00c7b10 con 0x7f0de0072370 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.257+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00b44a0 con 0x7f0de0072370 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.257+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc011960 con 0x7f0de0072370 2023-11-04T01:36:15.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.257+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011d30 con 0x7f0de0072370 2023-11-04T01:36:15.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.257+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f550c054400 con 0x7f5514159a10 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.258+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc0005250 con 0x7f0de0072370 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.259+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dcc0233a0 con 0x7f0de0072370 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.260+0000 7f0ddd7fa640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 0x7f0dc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.260+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0dcc089c10 con 0x7f0de0072370 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.260+0000 7f0de48ab640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 0x7f0dc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.261+0000 7f0de48ab640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 0x7f0dc406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40011e0 tx=0x7f0dd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.265+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0dcc054a70 con 0x7f0de0072370 2023-11-04T01:36:15.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.269+0000 7f7a81d65640 1 Processor -- start 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.269+0000 7f7a81d65640 1 -- start start 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.270+0000 7f7a81d65640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a7c0cdd90 0x7f7a7c167e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.270+0000 7f7a7b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7a7c15ccc0 0x7f7a7c0b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54412/0 (socket says 172.21.15.93:54412) 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.270+0000 7f7a7bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a7c0cdd90 0x7f7a7c167e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.270+0000 7f7a7bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a7c0cdd90 0x7f7a7c167e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48532/0 (socket says 172.21.15.93:48532) 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.270+0000 7f7a7affd640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a7c0b4fb0 0x7f7a7c0cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:40658/0 (socket says 172.21.15.93:40658) 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a81d65640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c160df0 con 0x7f7a7c15ccc0 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7b7fe640 1 -- 172.21.15.93:0/490767087 learned_addr learned my addr 172.21.15.93:0/490767087 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0ce260 con 0x7f7a7c0b4fb0 2023-11-04T01:36:15.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0ce540 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394935072 0 0) 0x7f7a6c001110 con 0x7f7a7c15ccc0 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a64003520 con 0x7f7a7c15ccc0 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7bfff640 1 -- 172.21.15.93:0/490767087 >> v1:172.21.15.125:6789/0 conn(0x7f7a7c0b4fb0 legacy=0x7f7a7c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7bfff640 1 -- 172.21.15.93:0/490767087 >> v1:172.21.15.93:6789/0 conn(0x7f7a7c15ccc0 legacy=0x7f7a7c0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782912178 0 0) 0x7f7a64003520 con 0x7f7a7c15ccc0 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.271+0000 7f7a7bfff640 1 -- 172.21.15.93:0/490767087 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0d1050 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.273+0000 7f7a7bfff640 1 --2- 172.21.15.93:0/490767087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c167e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d90 tx=0x7f7a7402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828086bc7e1bb965 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.273+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c001800 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.273+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7402c970 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.273+0000 7f7a7a7fc640 1 -- 172.21.15.93:0/490767087 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7402cce0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.274+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c0cdd90 msgr2=0x7f7a7c167e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.274+0000 7f7a81d65640 1 --2- 172.21.15.93:0/490767087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c167e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d90 tx=0x7f7a7402be40 comp rx=0 tx=0).stop 2023-11-04T01:36:15.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.274+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 shutdown_connections 2023-11-04T01:36:15.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.274+0000 7f7a81d65640 1 --2- 172.21.15.93:0/490767087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c167e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.275+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 >> 172.21.15.93:0/490767087 conn(0x7f7a7c0cf8a0 msgr2=0x7f7a7c0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.275+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 shutdown_connections 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.275+0000 7f7a81d65640 1 -- 172.21.15.93:0/490767087 wait complete. 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.277+0000 7f7a81d65640 1 Processor -- start 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.277+0000 7f7a81d65640 1 -- start start 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.278+0000 7f7a81d65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 0x7f7a7c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.278+0000 7f7a81d65640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a81d65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 0x7f7a7c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 0x7f7a7c0c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:55034/0 (socket says 172.21.15.93:55034) 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:33732/0 (socket says 172.21.15.93:33732) 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48536/0 (socket says 172.21.15.93:48536) 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a7b7fe640 1 -- 172.21.15.93:0/2447589301 learned_addr learned my addr 172.21.15.93:0/2447589301 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1e66b0 con 0x7f7a7c15ccc0 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1e6900 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.279+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1e6be0 con 0x7f7a7c0b4fb0 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 -- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 msgr2=0x7f7a7c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 0x7f7a7c0c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 -- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 msgr2=0x7f7a7c0b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74009a70 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7bfff640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a7affd640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c400 tx=0x7f7a7000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700074e0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.280+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70007640 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.281+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70004a00 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.281+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c1e6ec0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.281+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c1e7480 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.283+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a70004b60 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.283+0000 7f7a63fff640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 0x7f7a6806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.283+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a700891f0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.284+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c0cf3f0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.284+0000 7f7a7b7fe640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 0x7f7a6806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.285+0000 7f7a7b7fe640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 0x7f7a6806d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c006b40 tx=0x7f7a6c0011d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.289+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a70053fc0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.402+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdacc0057d0 con 0x7fdae815add0 2023-11-04T01:36:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.403+0000 7fdad6ffd640 1 -- 172.21.15.93:0/260189531 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdae0057b00 con 0x7fdae815add0 2023-11-04T01:36:15.404 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:15.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 msgr2=0x7fdac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 0x7fdac806d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdad802beb0 tx=0x7fdad8008030 comp rx=0 tx=0).stop 2023-11-04T01:36:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 msgr2=0x7fdae814f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 0x7fdae814f7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdae000caa0 tx=0x7fdae000cf60 comp rx=0 tx=0).stop 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 shutdown_connections 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdac806ae70 0x7fdac806d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdae815add0 0x7fdae814f7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdae8072370 0x7fdae80af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 --2- 172.21.15.93:0/260189531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8071f90 0x7fdae8150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 >> 172.21.15.93:0/260189531 conn(0x7fdae806d800 msgr2=0x7fdae815c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 shutdown_connections 2023-11-04T01:36:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.406+0000 7fdaecfe2640 1 -- 172.21.15.93:0/260189531 wait complete. 2023-11-04T01:36:15.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-11-04T01:36:15.424 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.466+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fb0071900 con 0x7f1fb006a660 2023-11-04T01:36:15.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.467+0000 7f1fa6ffd640 1 -- 172.21.15.93:0/3467489561 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fac079b10 con 0x7f1fb006a660 2023-11-04T01:36:15.468 INFO:teuthology.orchestra.run.smithi093.stdout:55834574859 2023-11-04T01:36:15.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 msgr2=0x7f1f9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 0x7f1f9406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00726d0 tx=0x7f1fa0009060 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 msgr2=0x7f1fb01dabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0090b0 tx=0x7f1fac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 shutdown_connections 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f9406ae70 0x7f1f9406d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1fb00b2010 0x7f1fb00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1fb0071fa0 0x7f1fb00b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 --2- 172.21.15.93:0/3467489561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1fb006a660 0x7f1fb01dabb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.469+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 >> 172.21.15.93:0/3467489561 conn(0x7f1fb006d800 msgr2=0x7f1fb01ebe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.470+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 shutdown_connections 2023-11-04T01:36:15.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.470+0000 7f1fb84bb640 1 -- 172.21.15.93:0/3467489561 wait complete. 2023-11-04T01:36:15.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-11-04T01:36:15.491 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.512+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a7c067b60 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.513+0000 7f7a63fff640 1 -- 172.21.15.93:0/2447589301 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a700575e0 con 0x7f7a7c0cdd90 2023-11-04T01:36:15.514 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:15.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 msgr2=0x7f7a6806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 0x7f7a6806d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c006b40 tx=0x7f7a6c0011d0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 msgr2=0x7f7a7c0b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c400 tx=0x7f7a7000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 shutdown_connections 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a6806aec0 0x7f7a6806d380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a7c15ccc0 0x7f7a7c0b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a7c0cdd90 0x7f7a7c0b7570 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c400 tx=0x7f7a7000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 --2- 172.21.15.93:0/2447589301 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a7c0b4fb0 0x7f7a7c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 >> 172.21.15.93:0/2447589301 conn(0x7f7a7c0cf8a0 msgr2=0x7f7a7c0cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 shutdown_connections 2023-11-04T01:36:15.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.516+0000 7f7a81d65640 1 -- 172.21.15.93:0/2447589301 wait complete. 2023-11-04T01:36:15.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-11-04T01:36:15.533 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.569+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f799c0c60b0 con 0x7f799c15add0 2023-11-04T01:36:15.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.570+0000 7f7998ff9640 1 -- 172.21.15.93:0/2792912770 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7994043020 con 0x7f799c15add0 2023-11-04T01:36:15.571 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 msgr2=0x7f798806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 0x7f798806d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f798c009dd0 tx=0x7f798c009110 comp rx=0 tx=0).stop 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 msgr2=0x7f799c1424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 0x7f799c1424f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7994032000 tx=0x7f7994004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 shutdown_connections 2023-11-04T01:36:15.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c15add0 0x7f799c1424f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f799c072370 0x7f799c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 --2- 172.21.15.93:0/2792912770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f799c071f90 0x7f799c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 >> 172.21.15.93:0/2792912770 conn(0x7f799c06d800 msgr2=0x7f799c06a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 shutdown_connections 2023-11-04T01:36:15.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.572+0000 7f79a2894640 1 -- 172.21.15.93:0/2792912770 wait complete. 2023-11-04T01:36:15.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.578+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0dc0005500 con 0x7f0de0072370 2023-11-04T01:36:15.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.579+0000 7f0ddd7fa640 1 -- 172.21.15.93:0/1194547763 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0dcc01f090 con 0x7f0de0072370 2023-11-04T01:36:15.580 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:15.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 msgr2=0x7f0dc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 0x7f0dc406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40011e0 tx=0x7f0dd4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 msgr2=0x7f0de00c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00c9030 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c5e0 tx=0x7f0dcc00caa0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 shutdown_connections 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0dc406ae70 0x7f0dc406d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0de015add0 0x7f0de00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0de0072370 0x7f0de00c9030 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 --2- 172.21.15.93:0/1194547763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0de0071f90 0x7f0de0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 >> 172.21.15.93:0/1194547763 conn(0x7f0de006d800 msgr2=0x7f0de00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 shutdown_connections 2023-11-04T01:36:15.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.581+0000 7f0de6b0f640 1 -- 172.21.15.93:0/1194547763 wait complete. 2023-11-04T01:36:15.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-04T01:36:15.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.583+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd18c0cb280 con 0x7fd18c0b3a30 2023-11-04T01:36:15.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.583+0000 7fd1827fc640 1 -- 172.21.15.93:0/1040560174 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd188022090 con 0x7fd18c0b3a30 2023-11-04T01:36:15.585 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.585 INFO:teuthology.orchestra.run.smithi093.stdout:55834574857 2023-11-04T01:36:15.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 msgr2=0x7fd17006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 0x7fd17006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0b5580 tx=0x7fd17c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:15.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 msgr2=0x7fd18c156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1880119d0 tx=0x7fd188011e90 comp rx=0 tx=0).stop 2023-11-04T01:36:15.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 shutdown_connections 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd17006ae70 0x7fd17006d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd18c0be900 0x7fd18c1fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd18c0b3e10 0x7fd18c0be3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 --2- 172.21.15.93:0/1040560174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd18c0b3a30 0x7fd18c156360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 >> 172.21.15.93:0/1040560174 conn(0x7fd18c06d800 msgr2=0x7fd18c071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 shutdown_connections 2023-11-04T01:36:15.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.587+0000 7fd193c00640 1 -- 172.21.15.93:0/1040560174 wait complete. 2023-11-04T01:36:15.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-11-04T01:36:15.595 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-04T01:36:15.600 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.615+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f54fc005500 con 0x7f5514159a10 2023-11-04T01:36:15.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.615+0000 7f550a7fc640 1 -- 172.21.15.93:0/1354665921 <== mon.2 v2:172.21.15.125:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f550c057a20 con 0x7f5514159a10 2023-11-04T01:36:15.617 INFO:teuthology.orchestra.run.smithi093.stdout:55834574858 2023-11-04T01:36:15.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 msgr2=0x7f54f806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 0x7f54f806d400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5510007b60 tx=0x7f5510007ab0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 msgr2=0x7f55140c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 0x7f55140c6dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c700 tx=0x7f550c00cbc0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 shutdown_connections 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f54f806af40 0x7f54f806d400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5514159a10 0x7f55140c6dd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f551415cfd0 0x7f55140c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 --2- 172.21.15.93:0/1354665921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55140cd570 0x7f55141f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 >> 172.21.15.93:0/1354665921 conn(0x7f551406ea20 msgr2=0x7f551406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 shutdown_connections 2023-11-04T01:36:15.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.617+0000 7f551ba90640 1 -- 172.21.15.93:0/1354665921 wait complete. 2023-11-04T01:36:15.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-11-04T01:36:15.629 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:15.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:36:15.630 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:15.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.768+0000 7f5e32634640 1 Processor -- start 2023-11-04T01:36:15.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.768+0000 7f5e32634640 1 -- start start 2023-11-04T01:36:15.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e32634640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e32634640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0b1b80 con 0x7f5e2c15e1c0 2023-11-04T01:36:15.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e32634640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0b1e60 con 0x7f5e2c06a830 2023-11-04T01:36:15.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e32634640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c0b2140 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e30bd1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e2bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5e2c15e1c0 0x7f5e2c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54420/0 (socket says 172.21.15.93:54420) 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e2bfff640 1 -- 172.21.15.93:0/2243098699 learned_addr learned my addr 172.21.15.93:0/2243098699 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.769+0000 7f5e30bd1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48540/0 (socket says 172.21.15.93:48540) 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.770+0000 7f5e30bd1640 1 -- 172.21.15.93:0/2243098699 >> v1:172.21.15.125:6789/0 conn(0x7f5e2c06a830 legacy=0x7f5e2c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.770+0000 7f5e30bd1640 1 -- 172.21.15.93:0/2243098699 >> v1:172.21.15.93:6789/0 conn(0x7f5e2c15e1c0 legacy=0x7f5e2c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.770+0000 7f5e30bd1640 1 -- 172.21.15.93:0/2243098699 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0ca990 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.770+0000 7f5e2affd640 1 -- 172.21.15.93:0/2243098699 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280372255 0 0) 0x7f5e2c0b1b80 con 0x7f5e2c15e1c0 2023-11-04T01:36:15.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.770+0000 7f5e30bd1640 1 --2- 172.21.15.93:0/2243098699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc3921aae4e7a2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e2affd640 1 -- 172.21.15.93:0/2243098699 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2402cd00 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e2affd640 1 -- 172.21.15.93:0/2243098699 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2402ce60 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e2affd640 1 -- 172.21.15.93:0/2243098699 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24034660 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 -- 172.21.15.93:0/2243098699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c0b14a0 msgr2=0x7f5e2c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 --2- 172.21.15.93:0/2243098699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2402bf50 comp rx=0 tx=0).stop 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 -- 172.21.15.93:0/2243098699 shutdown_connections 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 --2- 172.21.15.93:0/2243098699 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c0b14a0 0x7f5e2c0b34a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 -- 172.21.15.93:0/2243098699 >> 172.21.15.93:0/2243098699 conn(0x7f5e2c06d8b0 msgr2=0x7f5e2c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 -- 172.21.15.93:0/2243098699 shutdown_connections 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.771+0000 7f5e32634640 1 -- 172.21.15.93:0/2243098699 wait complete. 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.772+0000 7f5e32634640 1 Processor -- start 2023-11-04T01:36:15.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.772+0000 7f5e32634640 1 -- start start 2023-11-04T01:36:15.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 0x7f5e2c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 0x7f5e2c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c1546f0 con 0x7f5e2c06a830 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c15a200 con 0x7f5e2c15e1c0 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e32634640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c153840 con 0x7f5e2c0b14a0 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e2bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e2bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48542/0 (socket says 172.21.15.93:48542) 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e2bfff640 1 -- 172.21.15.93:0/3997532897 learned_addr learned my addr 172.21.15.93:0/3997532897 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e30bd1640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 0x7f5e2c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.773+0000 7f5e2b7fe640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 0x7f5e2c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 -- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 msgr2=0x7f5e2c154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 0x7f5e2c154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 -- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 msgr2=0x7f5e2c159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 0x7f5e2c159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 -- 172.21.15.93:0/3997532897 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009a70 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2b7fe640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 0x7f5e2c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e30bd1640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 0x7f5e2c159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e2bfff640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c4d0 tx=0x7f5e1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0074e0 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c007640 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c153ae0 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c004a20 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.774+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c1540a0 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.775+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c0b10a0 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.775+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e1c004b80 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.775+0000 7f5e28ff9640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 0x7f5e1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.776+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e1c088ae0 con 0x7f5e2c06a830 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.776+0000 7f5e2b7fe640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 0x7f5e1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:15.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.776+0000 7f5e2b7fe640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 0x7f5e1806d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:15.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.780+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e1c053930 con 0x7f5e2c06a830 2023-11-04T01:36:15.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.944+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e2c0caf50 con 0x7f5e1806ae70 2023-11-04T01:36:15.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.952+0000 7f5e28ff9640 1 -- 172.21.15.93:0/3997532897 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345270 (secure 0 0 0) 0x7f5e20001c90 con 0x7f5e1806ae70 2023-11-04T01:36:15.957 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:15.961 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 msgr2=0x7f5e1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 0x7f5e1806d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20009040 comp rx=0 tx=0).stop 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 msgr2=0x7f5e2c145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c4d0 tx=0x7f5e1c00c990 comp rx=0 tx=0).stop 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 shutdown_connections 2023-11-04T01:36:15.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e1806ae70 0x7f5e1806d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c15e1c0 0x7f5e2c159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e2c0b14a0 0x7f5e2c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 --2- 172.21.15.93:0/3997532897 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e2c06a830 0x7f5e2c145a60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 >> 172.21.15.93:0/3997532897 conn(0x7f5e2c06d8b0 msgr2=0x7f5e2c0ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 shutdown_connections 2023-11-04T01:36:15.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:15.955+0000 7f5e32634640 1 -- 172.21.15.93:0/3997532897 wait complete. 2023-11-04T01:36:15.975 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:36:15.330668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3276800,"data_stored":1986314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002873"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082757+0000","last_change":"2023-11-04T01:35:51.059593+0000","last_active":"2023-11-04T01:35:56.082757+0000","last_peered":"2023-11-04T01:35:56.082757+0000","last_clean":"2023-11-04T01:35:56.082757+0000","last_became_active":"2023-11-04T01:35:51.059276+0000","last_became_peered":"2023-11-04T01:35:51.059276+0000","last_unstale":"2023-11-04T01:35:56.082757+0000","last_undegraded":"2023-11-04T01:35:56.082757+0000","last_fullsized":"2023-11-04T01:35:56.082757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085660+0000","last_change":"2023-11-04T01:35:52.029967+0000","last_active":"2023-11-04T01:35:56.085660+0000","last_peered":"2023-11-04T01:35:56.085660+0000","last_clean":"2023-11-04T01:35:56.085660+0000","last_became_active":"2023-11-04T01:35:52.029678+0000","last_became_peered":"2023-11-04T01:35:52.029678+0000","last_unstale":"2023-11-04T01:35:56.085660+0000","last_undegraded":"2023-11-04T01:35:56.085660+0000","last_fullsized":"2023-11-04T01:35:56.085660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018192+0000","last_change":"2023-11-04T01:35:56.127497+0000","last_active":"2023-11-04T01:35:57.018192+0000","last_peered":"2023-11-04T01:35:57.018192+0000","last_clean":"2023-11-04T01:35:57.018192+0000","last_became_active":"2023-11-04T01:35:56.127104+0000","last_became_peered":"2023-11-04T01:35:56.127104+0000","last_unstale":"2023-11-04T01:35:57.018192+0000","last_undegraded":"2023-11-04T01:35:57.018192+0000","last_fullsized":"2023-11-04T01:35:57.018192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:04.310871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085827+0000","last_change":"2023-11-04T01:35:51.062804+0000","last_active":"2023-11-04T01:35:56.085827+0000","last_peered":"2023-11-04T01:35:56.085827+0000","last_clean":"2023-11-04T01:35:56.085827+0000","last_became_active":"2023-11-04T01:35:51.062550+0000","last_became_peered":"2023-11-04T01:35:51.062550+0000","last_unstale":"2023-11-04T01:35:56.085827+0000","last_undegraded":"2023-11-04T01:35:56.085827+0000","last_fullsized":"2023-11-04T01:35:56.085827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082497+0000","last_change":"2023-11-04T01:35:52.028642+0000","last_active":"2023-11-04T01:35:56.082497+0000","last_peered":"2023-11-04T01:35:56.082497+0000","last_clean":"2023-11-04T01:35:56.082497+0000","last_became_active":"2023-11-04T01:35:52.028335+0000","last_became_peered":"2023-11-04T01:35:52.028335+0000","last_unstale":"2023-11-04T01:35:56.082497+0000","last_undegraded":"2023-11-04T01:35:56.082497+0000","last_fullsized":"2023-11-04T01:35:56.082497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018823+0000","last_change":"2023-11-04T01:35:56.097973+0000","last_active":"2023-11-04T01:35:57.018823+0000","last_peered":"2023-11-04T01:35:57.018823+0000","last_clean":"2023-11-04T01:35:57.018823+0000","last_became_active":"2023-11-04T01:35:56.097592+0000","last_became_peered":"2023-11-04T01:35:56.097592+0000","last_unstale":"2023-11-04T01:35:57.018823+0000","last_undegraded":"2023-11-04T01:35:57.018823+0000","last_fullsized":"2023-11-04T01:35:57.018823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:59.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124753+0000","last_change":"2023-11-04T01:35:51.064359+0000","last_active":"2023-11-04T01:35:56.124753+0000","last_peered":"2023-11-04T01:35:56.124753+0000","last_clean":"2023-11-04T01:35:56.124753+0000","last_became_active":"2023-11-04T01:35:51.064086+0000","last_became_peered":"2023-11-04T01:35:51.064086+0000","last_unstale":"2023-11-04T01:35:56.124753+0000","last_undegraded":"2023-11-04T01:35:56.124753+0000","last_fullsized":"2023-11-04T01:35:56.124753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:04.967632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083843+0000","last_change":"2023-11-04T01:35:52.027845+0000","last_active":"2023-11-04T01:35:56.083843+0000","last_peered":"2023-11-04T01:35:56.083843+0000","last_clean":"2023-11-04T01:35:56.083843+0000","last_became_active":"2023-11-04T01:35:52.024155+0000","last_became_peered":"2023-11-04T01:35:52.024155+0000","last_unstale":"2023-11-04T01:35:56.083843+0000","last_undegraded":"2023-11-04T01:35:56.083843+0000","last_fullsized":"2023-11-04T01:35:56.083843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019534+0000","last_change":"2023-11-04T01:35:56.100849+0000","last_active":"2023-11-04T01:35:57.019534+0000","last_peered":"2023-11-04T01:35:57.019534+0000","last_clean":"2023-11-04T01:35:57.019534+0000","last_became_active":"2023-11-04T01:35:56.099083+0000","last_became_peered":"2023-11-04T01:35:56.099083+0000","last_unstale":"2023-11-04T01:35:57.019534+0000","last_undegraded":"2023-11-04T01:35:57.019534+0000","last_fullsized":"2023-11-04T01:35:57.019534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123310+0000","last_change":"2023-11-04T01:35:51.062659+0000","last_active":"2023-11-04T01:35:56.123310+0000","last_peered":"2023-11-04T01:35:56.123310+0000","last_clean":"2023-11-04T01:35:56.123310+0000","last_became_active":"2023-11-04T01:35:51.062258+0000","last_became_peered":"2023-11-04T01:35:51.062258+0000","last_unstale":"2023-11-04T01:35:56.123310+0000","last_undegraded":"2023-11-04T01:35:56.123310+0000","last_fullsized":"2023-11-04T01:35:56.123310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083932+0000","last_change":"2023-11-04T01:35:52.028671+0000","last_active":"2023-11-04T01:35:56.083932+0000","last_peered":"2023-11-04T01:35:56.083932+0000","last_clean":"2023-11-04T01:35:56.083932+0000","last_became_active":"2023-11-04T01:35:52.028245+0000","last_became_peered":"2023-11-04T01:35:52.028245+0000","last_unstale":"2023-11-04T01:35:56.083932+0000","last_undegraded":"2023-11-04T01:35:56.083932+0000","last_fullsized":"2023-11-04T01:35:56.083932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018071+0000","last_change":"2023-11-04T01:35:56.100779+0000","last_active":"2023-11-04T01:35:57.018071+0000","last_peered":"2023-11-04T01:35:57.018071+0000","last_clean":"2023-11-04T01:35:57.018071+0000","last_became_active":"2023-11-04T01:35:56.100333+0000","last_became_peered":"2023-11-04T01:35:56.100333+0000","last_unstale":"2023-11-04T01:35:57.018071+0000","last_undegraded":"2023-11-04T01:35:57.018071+0000","last_fullsized":"2023-11-04T01:35:57.018071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:48.170680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090642+0000","last_change":"2023-11-04T01:35:52.025166+0000","last_active":"2023-11-04T01:35:56.090642+0000","last_peered":"2023-11-04T01:35:56.090642+0000","last_clean":"2023-11-04T01:35:56.090642+0000","last_became_active":"2023-11-04T01:35:52.024875+0000","last_became_peered":"2023-11-04T01:35:52.024875+0000","last_unstale":"2023-11-04T01:35:56.090642+0000","last_undegraded":"2023-11-04T01:35:56.090642+0000","last_fullsized":"2023-11-04T01:35:56.090642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123232+0000","last_change":"2023-11-04T01:35:51.060056+0000","last_active":"2023-11-04T01:35:56.123232+0000","last_peered":"2023-11-04T01:35:56.123232+0000","last_clean":"2023-11-04T01:35:56.123232+0000","last_became_active":"2023-11-04T01:35:51.059746+0000","last_became_peered":"2023-11-04T01:35:51.059746+0000","last_unstale":"2023-11-04T01:35:56.123232+0000","last_undegraded":"2023-11-04T01:35:56.123232+0000","last_fullsized":"2023-11-04T01:35:56.123232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:07.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018852+0000","last_change":"2023-11-04T01:35:56.099872+0000","last_active":"2023-11-04T01:35:57.018852+0000","last_peered":"2023-11-04T01:35:57.018852+0000","last_clean":"2023-11-04T01:35:57.018852+0000","last_became_active":"2023-11-04T01:35:56.098782+0000","last_became_peered":"2023-11-04T01:35:56.098782+0000","last_unstale":"2023-11-04T01:35:57.018852+0000","last_undegraded":"2023-11-04T01:35:57.018852+0000","last_fullsized":"2023-11-04T01:35:57.018852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:26.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085943+0000","last_change":"2023-11-04T01:35:52.030864+0000","last_active":"2023-11-04T01:35:56.085943+0000","last_peered":"2023-11-04T01:35:56.085943+0000","last_clean":"2023-11-04T01:35:56.085943+0000","last_became_active":"2023-11-04T01:35:52.030586+0000","last_became_peered":"2023-11-04T01:35:52.030586+0000","last_unstale":"2023-11-04T01:35:56.085943+0000","last_undegraded":"2023-11-04T01:35:56.085943+0000","last_fullsized":"2023-11-04T01:35:56.085943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.077121+0000","last_change":"2023-11-04T01:35:51.063222+0000","last_active":"2023-11-04T01:35:56.077121+0000","last_peered":"2023-11-04T01:35:56.077121+0000","last_clean":"2023-11-04T01:35:56.077121+0000","last_became_active":"2023-11-04T01:35:51.062838+0000","last_became_peered":"2023-11-04T01:35:51.062838+0000","last_unstale":"2023-11-04T01:35:56.077121+0000","last_undegraded":"2023-11-04T01:35:56.077121+0000","last_fullsized":"2023-11-04T01:35:56.077121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019259+0000","last_change":"2023-11-04T01:35:56.100298+0000","last_active":"2023-11-04T01:35:57.019259+0000","last_peered":"2023-11-04T01:35:57.019259+0000","last_clean":"2023-11-04T01:35:57.019259+0000","last_became_active":"2023-11-04T01:35:56.098558+0000","last_became_peered":"2023-11-04T01:35:56.098558+0000","last_unstale":"2023-11-04T01:35:57.019259+0000","last_undegraded":"2023-11-04T01:35:57.019259+0000","last_fullsized":"2023-11-04T01:35:57.019259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086341+0000","last_change":"2023-11-04T01:35:52.021071+0000","last_active":"2023-11-04T01:35:56.086341+0000","last_peered":"2023-11-04T01:35:56.086341+0000","last_clean":"2023-11-04T01:35:56.086341+0000","last_became_active":"2023-11-04T01:35:52.020796+0000","last_became_peered":"2023-11-04T01:35:52.020796+0000","last_unstale":"2023-11-04T01:35:56.086341+0000","last_undegraded":"2023-11-04T01:35:56.086341+0000","last_fullsized":"2023-11-04T01:35:56.086341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076204+0000","last_change":"2023-11-04T01:35:51.060835+0000","last_active":"2023-11-04T01:35:56.076204+0000","last_peered":"2023-11-04T01:35:56.076204+0000","last_clean":"2023-11-04T01:35:56.076204+0000","last_became_active":"2023-11-04T01:35:51.060542+0000","last_became_peered":"2023-11-04T01:35:51.060542+0000","last_unstale":"2023-11-04T01:35:56.076204+0000","last_undegraded":"2023-11-04T01:35:56.076204+0000","last_fullsized":"2023-11-04T01:35:56.076204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018863+0000","last_change":"2023-11-04T01:35:56.127539+0000","last_active":"2023-11-04T01:35:57.018863+0000","last_peered":"2023-11-04T01:35:57.018863+0000","last_clean":"2023-11-04T01:35:57.018863+0000","last_became_active":"2023-11-04T01:35:56.127142+0000","last_became_peered":"2023-11-04T01:35:56.127142+0000","last_unstale":"2023-11-04T01:35:57.018863+0000","last_undegraded":"2023-11-04T01:35:57.018863+0000","last_fullsized":"2023-11-04T01:35:57.018863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090298+0000","last_change":"2023-11-04T01:35:52.023442+0000","last_active":"2023-11-04T01:35:56.090298+0000","last_peered":"2023-11-04T01:35:56.090298+0000","last_clean":"2023-11-04T01:35:56.090298+0000","last_became_active":"2023-11-04T01:35:52.021531+0000","last_became_peered":"2023-11-04T01:35:52.021531+0000","last_unstale":"2023-11-04T01:35:56.090298+0000","last_undegraded":"2023-11-04T01:35:56.090298+0000","last_fullsized":"2023-11-04T01:35:56.090298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:00.840333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122631+0000","last_change":"2023-11-04T01:35:51.063175+0000","last_active":"2023-11-04T01:35:56.122631+0000","last_peered":"2023-11-04T01:35:56.122631+0000","last_clean":"2023-11-04T01:35:56.122631+0000","last_became_active":"2023-11-04T01:35:51.062652+0000","last_became_peered":"2023-11-04T01:35:51.062652+0000","last_unstale":"2023-11-04T01:35:56.122631+0000","last_undegraded":"2023-11-04T01:35:56.122631+0000","last_fullsized":"2023-11-04T01:35:56.122631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018125+0000","last_change":"2023-11-04T01:35:56.099302+0000","last_active":"2023-11-04T01:35:57.018125+0000","last_peered":"2023-11-04T01:35:57.018125+0000","last_clean":"2023-11-04T01:35:57.018125+0000","last_became_active":"2023-11-04T01:35:56.098724+0000","last_became_peered":"2023-11-04T01:35:56.098724+0000","last_unstale":"2023-11-04T01:35:57.018125+0000","last_undegraded":"2023-11-04T01:35:57.018125+0000","last_fullsized":"2023-11-04T01:35:57.018125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:35.534588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082788+0000","last_change":"2023-11-04T01:35:52.017381+0000","last_active":"2023-11-04T01:35:56.082788+0000","last_peered":"2023-11-04T01:35:56.082788+0000","last_clean":"2023-11-04T01:35:56.082788+0000","last_became_active":"2023-11-04T01:35:52.017133+0000","last_became_peered":"2023-11-04T01:35:52.017133+0000","last_unstale":"2023-11-04T01:35:56.082788+0000","last_undegraded":"2023-11-04T01:35:56.082788+0000","last_fullsized":"2023-11-04T01:35:56.082788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092559+0000","last_change":"2023-11-04T01:35:51.059644+0000","last_active":"2023-11-04T01:35:56.092559+0000","last_peered":"2023-11-04T01:35:56.092559+0000","last_clean":"2023-11-04T01:35:56.092559+0000","last_became_active":"2023-11-04T01:35:51.059424+0000","last_became_peered":"2023-11-04T01:35:51.059424+0000","last_unstale":"2023-11-04T01:35:56.092559+0000","last_undegraded":"2023-11-04T01:35:56.092559+0000","last_fullsized":"2023-11-04T01:35:56.092559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019002+0000","last_change":"2023-11-04T01:35:56.124305+0000","last_active":"2023-11-04T01:35:57.019002+0000","last_peered":"2023-11-04T01:35:57.019002+0000","last_clean":"2023-11-04T01:35:57.019002+0000","last_became_active":"2023-11-04T01:35:56.123918+0000","last_became_peered":"2023-11-04T01:35:56.123918+0000","last_unstale":"2023-11-04T01:35:57.019002+0000","last_undegraded":"2023-11-04T01:35:57.019002+0000","last_fullsized":"2023-11-04T01:35:57.019002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086137+0000","last_change":"2023-11-04T01:35:52.030623+0000","last_active":"2023-11-04T01:35:56.086137+0000","last_peered":"2023-11-04T01:35:56.086137+0000","last_clean":"2023-11-04T01:35:56.086137+0000","last_became_active":"2023-11-04T01:35:52.030382+0000","last_became_peered":"2023-11-04T01:35:52.030382+0000","last_unstale":"2023-11-04T01:35:56.086137+0000","last_undegraded":"2023-11-04T01:35:56.086137+0000","last_fullsized":"2023-11-04T01:35:56.086137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076551+0000","last_change":"2023-11-04T01:35:51.062101+0000","last_active":"2023-11-04T01:35:56.076551+0000","last_peered":"2023-11-04T01:35:56.076551+0000","last_clean":"2023-11-04T01:35:56.076551+0000","last_became_active":"2023-11-04T01:35:51.061786+0000","last_became_peered":"2023-11-04T01:35:51.061786+0000","last_unstale":"2023-11-04T01:35:56.076551+0000","last_undegraded":"2023-11-04T01:35:56.076551+0000","last_fullsized":"2023-11-04T01:35:56.076551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017814+0000","last_change":"2023-11-04T01:35:56.128280+0000","last_active":"2023-11-04T01:35:57.017814+0000","last_peered":"2023-11-04T01:35:57.017814+0000","last_clean":"2023-11-04T01:35:57.017814+0000","last_became_active":"2023-11-04T01:35:56.127952+0000","last_became_peered":"2023-11-04T01:35:56.127952+0000","last_unstale":"2023-11-04T01:35:57.017814+0000","last_undegraded":"2023-11-04T01:35:57.017814+0000","last_fullsized":"2023-11-04T01:35:57.017814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076313+0000","last_change":"2023-11-04T01:35:52.019477+0000","last_active":"2023-11-04T01:35:56.076313+0000","last_peered":"2023-11-04T01:35:56.076313+0000","last_clean":"2023-11-04T01:35:56.076313+0000","last_became_active":"2023-11-04T01:35:52.019211+0000","last_became_peered":"2023-11-04T01:35:52.019211+0000","last_unstale":"2023-11-04T01:35:56.076313+0000","last_undegraded":"2023-11-04T01:35:56.076313+0000","last_fullsized":"2023-11-04T01:35:56.076313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125013+0000","last_change":"2023-11-04T01:35:51.061973+0000","last_active":"2023-11-04T01:35:56.125013+0000","last_peered":"2023-11-04T01:35:56.125013+0000","last_clean":"2023-11-04T01:35:56.125013+0000","last_became_active":"2023-11-04T01:35:51.061720+0000","last_became_peered":"2023-11-04T01:35:51.061720+0000","last_unstale":"2023-11-04T01:35:56.125013+0000","last_undegraded":"2023-11-04T01:35:56.125013+0000","last_fullsized":"2023-11-04T01:35:56.125013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009703+0000","last_change":"2023-11-04T01:35:56.124910+0000","last_active":"2023-11-04T01:35:57.009703+0000","last_peered":"2023-11-04T01:35:57.009703+0000","last_clean":"2023-11-04T01:35:57.009703+0000","last_became_active":"2023-11-04T01:35:56.124304+0000","last_became_peered":"2023-11-04T01:35:56.124304+0000","last_unstale":"2023-11-04T01:35:57.009703+0000","last_undegraded":"2023-11-04T01:35:57.009703+0000","last_fullsized":"2023-11-04T01:35:57.009703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084153+0000","last_change":"2023-11-04T01:35:52.027735+0000","last_active":"2023-11-04T01:35:56.084153+0000","last_peered":"2023-11-04T01:35:56.084153+0000","last_clean":"2023-11-04T01:35:56.084153+0000","last_became_active":"2023-11-04T01:35:52.027488+0000","last_became_peered":"2023-11-04T01:35:52.027488+0000","last_unstale":"2023-11-04T01:35:56.084153+0000","last_undegraded":"2023-11-04T01:35:56.084153+0000","last_fullsized":"2023-11-04T01:35:56.084153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076787+0000","last_change":"2023-11-04T01:35:51.060397+0000","last_active":"2023-11-04T01:35:56.076787+0000","last_peered":"2023-11-04T01:35:56.076787+0000","last_clean":"2023-11-04T01:35:56.076787+0000","last_became_active":"2023-11-04T01:35:51.060049+0000","last_became_peered":"2023-11-04T01:35:51.060049+0000","last_unstale":"2023-11-04T01:35:56.076787+0000","last_undegraded":"2023-11-04T01:35:56.076787+0000","last_fullsized":"2023-11-04T01:35:56.076787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018210+0000","last_change":"2023-11-04T01:35:56.097613+0000","last_active":"2023-11-04T01:35:57.018210+0000","last_peered":"2023-11-04T01:35:57.018210+0000","last_clean":"2023-11-04T01:35:57.018210+0000","last_became_active":"2023-11-04T01:35:56.095376+0000","last_became_peered":"2023-11-04T01:35:56.095376+0000","last_unstale":"2023-11-04T01:35:57.018210+0000","last_undegraded":"2023-11-04T01:35:57.018210+0000","last_fullsized":"2023-11-04T01:35:57.018210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091651+0000","last_change":"2023-11-04T01:35:52.022798+0000","last_active":"2023-11-04T01:35:56.091651+0000","last_peered":"2023-11-04T01:35:56.091651+0000","last_clean":"2023-11-04T01:35:56.091651+0000","last_became_active":"2023-11-04T01:35:52.021870+0000","last_became_peered":"2023-11-04T01:35:52.021870+0000","last_unstale":"2023-11-04T01:35:56.091651+0000","last_undegraded":"2023-11-04T01:35:56.091651+0000","last_fullsized":"2023-11-04T01:35:56.091651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083334+0000","last_change":"2023-11-04T01:35:51.058423+0000","last_active":"2023-11-04T01:35:56.083334+0000","last_peered":"2023-11-04T01:35:56.083334+0000","last_clean":"2023-11-04T01:35:56.083334+0000","last_became_active":"2023-11-04T01:35:51.057183+0000","last_became_peered":"2023-11-04T01:35:51.057183+0000","last_unstale":"2023-11-04T01:35:56.083334+0000","last_undegraded":"2023-11-04T01:35:56.083334+0000","last_fullsized":"2023-11-04T01:35:56.083334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018340+0000","last_change":"2023-11-04T01:35:56.093770+0000","last_active":"2023-11-04T01:35:57.018340+0000","last_peered":"2023-11-04T01:35:57.018340+0000","last_clean":"2023-11-04T01:35:57.018340+0000","last_became_active":"2023-11-04T01:35:56.092689+0000","last_became_peered":"2023-11-04T01:35:56.092689+0000","last_unstale":"2023-11-04T01:35:57.018340+0000","last_undegraded":"2023-11-04T01:35:57.018340+0000","last_fullsized":"2023-11-04T01:35:57.018340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076140+0000","last_change":"2023-11-04T01:35:52.019825+0000","last_active":"2023-11-04T01:35:56.076140+0000","last_peered":"2023-11-04T01:35:56.076140+0000","last_clean":"2023-11-04T01:35:56.076140+0000","last_became_active":"2023-11-04T01:35:52.019580+0000","last_became_peered":"2023-11-04T01:35:52.019580+0000","last_unstale":"2023-11-04T01:35:56.076140+0000","last_undegraded":"2023-11-04T01:35:56.076140+0000","last_fullsized":"2023-11-04T01:35:56.076140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090217+0000","last_change":"2023-11-04T01:35:51.058035+0000","last_active":"2023-11-04T01:35:56.090217+0000","last_peered":"2023-11-04T01:35:56.090217+0000","last_clean":"2023-11-04T01:35:56.090217+0000","last_became_active":"2023-11-04T01:35:51.057768+0000","last_became_peered":"2023-11-04T01:35:51.057768+0000","last_unstale":"2023-11-04T01:35:56.090217+0000","last_undegraded":"2023-11-04T01:35:56.090217+0000","last_fullsized":"2023-11-04T01:35:56.090217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018891+0000","last_change":"2023-11-04T01:35:56.094677+0000","last_active":"2023-11-04T01:35:57.018891+0000","last_peered":"2023-11-04T01:35:57.018891+0000","last_clean":"2023-11-04T01:35:57.018891+0000","last_became_active":"2023-11-04T01:35:56.094348+0000","last_became_peered":"2023-11-04T01:35:56.094348+0000","last_unstale":"2023-11-04T01:35:57.018891+0000","last_undegraded":"2023-11-04T01:35:57.018891+0000","last_fullsized":"2023-11-04T01:35:57.018891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082079+0000","last_change":"2023-11-04T01:35:52.020101+0000","last_active":"2023-11-04T01:35:56.082079+0000","last_peered":"2023-11-04T01:35:56.082079+0000","last_clean":"2023-11-04T01:35:56.082079+0000","last_became_active":"2023-11-04T01:35:52.019047+0000","last_became_peered":"2023-11-04T01:35:52.019047+0000","last_unstale":"2023-11-04T01:35:56.082079+0000","last_undegraded":"2023-11-04T01:35:56.082079+0000","last_fullsized":"2023-11-04T01:35:56.082079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:34.129560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122640+0000","last_change":"2023-11-04T01:35:51.063768+0000","last_active":"2023-11-04T01:35:56.122640+0000","last_peered":"2023-11-04T01:35:56.122640+0000","last_clean":"2023-11-04T01:35:56.122640+0000","last_became_active":"2023-11-04T01:35:51.063462+0000","last_became_peered":"2023-11-04T01:35:51.063462+0000","last_unstale":"2023-11-04T01:35:56.122640+0000","last_undegraded":"2023-11-04T01:35:56.122640+0000","last_fullsized":"2023-11-04T01:35:56.122640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010123+0000","last_change":"2023-11-04T01:35:56.124045+0000","last_active":"2023-11-04T01:35:57.010123+0000","last_peered":"2023-11-04T01:35:57.010123+0000","last_clean":"2023-11-04T01:35:57.010123+0000","last_became_active":"2023-11-04T01:35:56.123678+0000","last_became_peered":"2023-11-04T01:35:56.123678+0000","last_unstale":"2023-11-04T01:35:57.010123+0000","last_undegraded":"2023-11-04T01:35:57.010123+0000","last_fullsized":"2023-11-04T01:35:57.010123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:19.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085654+0000","last_change":"2023-11-04T01:35:52.029814+0000","last_active":"2023-11-04T01:35:56.085654+0000","last_peered":"2023-11-04T01:35:56.085654+0000","last_clean":"2023-11-04T01:35:56.085654+0000","last_became_active":"2023-11-04T01:35:52.029549+0000","last_became_peered":"2023-11-04T01:35:52.029549+0000","last_unstale":"2023-11-04T01:35:56.085654+0000","last_undegraded":"2023-11-04T01:35:56.085654+0000","last_fullsized":"2023-11-04T01:35:56.085654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083481+0000","last_change":"2023-11-04T01:35:51.062041+0000","last_active":"2023-11-04T01:35:56.083481+0000","last_peered":"2023-11-04T01:35:56.083481+0000","last_clean":"2023-11-04T01:35:56.083481+0000","last_became_active":"2023-11-04T01:35:51.061551+0000","last_became_peered":"2023-11-04T01:35:51.061551+0000","last_unstale":"2023-11-04T01:35:56.083481+0000","last_undegraded":"2023-11-04T01:35:56.083481+0000","last_fullsized":"2023-11-04T01:35:56.083481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122962+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:35:56.122962+0000","last_peered":"2023-11-04T01:35:56.122962+0000","last_clean":"2023-11-04T01:35:56.122962+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:35:56.122962+0000","last_undegraded":"2023-11-04T01:35:56.122962+0000","last_fullsized":"2023-11-04T01:35:56.122962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010896+0000","last_change":"2023-11-04T01:35:56.126128+0000","last_active":"2023-11-04T01:35:57.010896+0000","last_peered":"2023-11-04T01:35:57.010896+0000","last_clean":"2023-11-04T01:35:57.010896+0000","last_became_active":"2023-11-04T01:35:56.125726+0000","last_became_peered":"2023-11-04T01:35:56.125726+0000","last_unstale":"2023-11-04T01:35:57.010896+0000","last_undegraded":"2023-11-04T01:35:57.010896+0000","last_fullsized":"2023-11-04T01:35:57.010896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123390+0000","last_change":"2023-11-04T01:35:52.030372+0000","last_active":"2023-11-04T01:35:56.123390+0000","last_peered":"2023-11-04T01:35:56.123390+0000","last_clean":"2023-11-04T01:35:56.123390+0000","last_became_active":"2023-11-04T01:35:52.029960+0000","last_became_peered":"2023-11-04T01:35:52.029960+0000","last_unstale":"2023-11-04T01:35:56.123390+0000","last_undegraded":"2023-11-04T01:35:56.123390+0000","last_fullsized":"2023-11-04T01:35:56.123390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090234+0000","last_change":"2023-11-04T01:35:51.059763+0000","last_active":"2023-11-04T01:35:56.090234+0000","last_peered":"2023-11-04T01:35:56.090234+0000","last_clean":"2023-11-04T01:35:56.090234+0000","last_became_active":"2023-11-04T01:35:51.059484+0000","last_became_peered":"2023-11-04T01:35:51.059484+0000","last_unstale":"2023-11-04T01:35:56.090234+0000","last_undegraded":"2023-11-04T01:35:56.090234+0000","last_fullsized":"2023-11-04T01:35:56.090234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:04.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010432+0000","last_change":"2023-11-04T01:35:56.123907+0000","last_active":"2023-11-04T01:35:57.010432+0000","last_peered":"2023-11-04T01:35:57.010432+0000","last_clean":"2023-11-04T01:35:57.010432+0000","last_became_active":"2023-11-04T01:35:56.123459+0000","last_became_peered":"2023-11-04T01:35:56.123459+0000","last_unstale":"2023-11-04T01:35:57.010432+0000","last_undegraded":"2023-11-04T01:35:57.010432+0000","last_fullsized":"2023-11-04T01:35:57.010432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083693+0000","last_change":"2023-11-04T01:35:52.024998+0000","last_active":"2023-11-04T01:35:56.083693+0000","last_peered":"2023-11-04T01:35:56.083693+0000","last_clean":"2023-11-04T01:35:56.083693+0000","last_became_active":"2023-11-04T01:35:52.024327+0000","last_became_peered":"2023-11-04T01:35:52.024327+0000","last_unstale":"2023-11-04T01:35:56.083693+0000","last_undegraded":"2023-11-04T01:35:56.083693+0000","last_fullsized":"2023-11-04T01:35:56.083693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076586+0000","last_change":"2023-11-04T01:35:51.059209+0000","last_active":"2023-11-04T01:35:56.076586+0000","last_peered":"2023-11-04T01:35:56.076586+0000","last_clean":"2023-11-04T01:35:56.076586+0000","last_became_active":"2023-11-04T01:35:51.058773+0000","last_became_peered":"2023-11-04T01:35:51.058773+0000","last_unstale":"2023-11-04T01:35:56.076586+0000","last_undegraded":"2023-11-04T01:35:56.076586+0000","last_fullsized":"2023-11-04T01:35:56.076586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009806+0000","last_change":"2023-11-04T01:35:56.094757+0000","last_active":"2023-11-04T01:35:57.009806+0000","last_peered":"2023-11-04T01:35:57.009806+0000","last_clean":"2023-11-04T01:35:57.009806+0000","last_became_active":"2023-11-04T01:35:56.094419+0000","last_became_peered":"2023-11-04T01:35:56.094419+0000","last_unstale":"2023-11-04T01:35:57.009806+0000","last_undegraded":"2023-11-04T01:35:57.009806+0000","last_fullsized":"2023-11-04T01:35:57.009806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125099+0000","last_change":"2023-11-04T01:35:52.032768+0000","last_active":"2023-11-04T01:35:56.125099+0000","last_peered":"2023-11-04T01:35:56.125099+0000","last_clean":"2023-11-04T01:35:56.125099+0000","last_became_active":"2023-11-04T01:35:52.031366+0000","last_became_peered":"2023-11-04T01:35:52.031366+0000","last_unstale":"2023-11-04T01:35:56.125099+0000","last_undegraded":"2023-11-04T01:35:56.125099+0000","last_fullsized":"2023-11-04T01:35:56.125099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090446+0000","last_change":"2023-11-04T01:35:51.058795+0000","last_active":"2023-11-04T01:35:56.090446+0000","last_peered":"2023-11-04T01:35:56.090446+0000","last_clean":"2023-11-04T01:35:56.090446+0000","last_became_active":"2023-11-04T01:35:51.058543+0000","last_became_peered":"2023-11-04T01:35:51.058543+0000","last_unstale":"2023-11-04T01:35:56.090446+0000","last_undegraded":"2023-11-04T01:35:56.090446+0000","last_fullsized":"2023-11-04T01:35:56.090446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017774+0000","last_change":"2023-11-04T01:35:56.124194+0000","last_active":"2023-11-04T01:35:57.017774+0000","last_peered":"2023-11-04T01:35:57.017774+0000","last_clean":"2023-11-04T01:35:57.017774+0000","last_became_active":"2023-11-04T01:35:56.123794+0000","last_became_peered":"2023-11-04T01:35:56.123794+0000","last_unstale":"2023-11-04T01:35:57.017774+0000","last_undegraded":"2023-11-04T01:35:57.017774+0000","last_fullsized":"2023-11-04T01:35:57.017774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124176+0000","last_change":"2023-11-04T01:35:52.028162+0000","last_active":"2023-11-04T01:35:56.124176+0000","last_peered":"2023-11-04T01:35:56.124176+0000","last_clean":"2023-11-04T01:35:56.124176+0000","last_became_active":"2023-11-04T01:35:52.026689+0000","last_became_peered":"2023-11-04T01:35:52.026689+0000","last_unstale":"2023-11-04T01:35:56.124176+0000","last_undegraded":"2023-11-04T01:35:56.124176+0000","last_fullsized":"2023-11-04T01:35:56.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088966+0000","last_change":"2023-11-04T01:35:51.052770+0000","last_active":"2023-11-04T01:35:56.088966+0000","last_peered":"2023-11-04T01:35:56.088966+0000","last_clean":"2023-11-04T01:35:56.088966+0000","last_became_active":"2023-11-04T01:35:51.052476+0000","last_became_peered":"2023-11-04T01:35:51.052476+0000","last_unstale":"2023-11-04T01:35:56.088966+0000","last_undegraded":"2023-11-04T01:35:56.088966+0000","last_fullsized":"2023-11-04T01:35:56.088966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018926+0000","last_change":"2023-11-04T01:35:56.099158+0000","last_active":"2023-11-04T01:35:57.018926+0000","last_peered":"2023-11-04T01:35:57.018926+0000","last_clean":"2023-11-04T01:35:57.018926+0000","last_became_active":"2023-11-04T01:35:56.098426+0000","last_became_peered":"2023-11-04T01:35:56.098426+0000","last_unstale":"2023-11-04T01:35:57.018926+0000","last_undegraded":"2023-11-04T01:35:57.018926+0000","last_fullsized":"2023-11-04T01:35:57.018926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123073+0000","last_change":"2023-11-04T01:35:52.027681+0000","last_active":"2023-11-04T01:35:56.123073+0000","last_peered":"2023-11-04T01:35:56.123073+0000","last_clean":"2023-11-04T01:35:56.123073+0000","last_became_active":"2023-11-04T01:35:52.027391+0000","last_became_peered":"2023-11-04T01:35:52.027391+0000","last_unstale":"2023-11-04T01:35:56.123073+0000","last_undegraded":"2023-11-04T01:35:56.123073+0000","last_fullsized":"2023-11-04T01:35:56.123073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088329+0000","last_change":"2023-11-04T01:35:51.055489+0000","last_active":"2023-11-04T01:35:56.088329+0000","last_peered":"2023-11-04T01:35:56.088329+0000","last_clean":"2023-11-04T01:35:56.088329+0000","last_became_active":"2023-11-04T01:35:51.055183+0000","last_became_peered":"2023-11-04T01:35:51.055183+0000","last_unstale":"2023-11-04T01:35:56.088329+0000","last_undegraded":"2023-11-04T01:35:56.088329+0000","last_fullsized":"2023-11-04T01:35:56.088329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010094+0000","last_change":"2023-11-04T01:35:56.093191+0000","last_active":"2023-11-04T01:35:57.010094+0000","last_peered":"2023-11-04T01:35:57.010094+0000","last_clean":"2023-11-04T01:35:57.010094+0000","last_became_active":"2023-11-04T01:35:56.092827+0000","last_became_peered":"2023-11-04T01:35:56.092827+0000","last_unstale":"2023-11-04T01:35:57.010094+0000","last_undegraded":"2023-11-04T01:35:57.010094+0000","last_fullsized":"2023-11-04T01:35:57.010094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090655+0000","last_change":"2023-11-04T01:35:52.030977+0000","last_active":"2023-11-04T01:35:56.090655+0000","last_peered":"2023-11-04T01:35:56.090655+0000","last_clean":"2023-11-04T01:35:56.090655+0000","last_became_active":"2023-11-04T01:35:52.030636+0000","last_became_peered":"2023-11-04T01:35:52.030636+0000","last_unstale":"2023-11-04T01:35:56.090655+0000","last_undegraded":"2023-11-04T01:35:56.090655+0000","last_fullsized":"2023-11-04T01:35:56.090655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090474+0000","last_change":"2023-11-04T01:35:51.053345+0000","last_active":"2023-11-04T01:35:56.090474+0000","last_peered":"2023-11-04T01:35:56.090474+0000","last_clean":"2023-11-04T01:35:56.090474+0000","last_became_active":"2023-11-04T01:35:51.053075+0000","last_became_peered":"2023-11-04T01:35:51.053075+0000","last_unstale":"2023-11-04T01:35:56.090474+0000","last_undegraded":"2023-11-04T01:35:56.090474+0000","last_fullsized":"2023-11-04T01:35:56.090474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019088+0000","last_change":"2023-11-04T01:35:56.127666+0000","last_active":"2023-11-04T01:35:57.019088+0000","last_peered":"2023-11-04T01:35:57.019088+0000","last_clean":"2023-11-04T01:35:57.019088+0000","last_became_active":"2023-11-04T01:35:56.127269+0000","last_became_peered":"2023-11-04T01:35:56.127269+0000","last_unstale":"2023-11-04T01:35:57.019088+0000","last_undegraded":"2023-11-04T01:35:57.019088+0000","last_fullsized":"2023-11-04T01:35:57.019088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:21.238628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123188+0000","last_change":"2023-11-04T01:35:52.029517+0000","last_active":"2023-11-04T01:35:56.123188+0000","last_peered":"2023-11-04T01:35:56.123188+0000","last_clean":"2023-11-04T01:35:56.123188+0000","last_became_active":"2023-11-04T01:35:52.028417+0000","last_became_peered":"2023-11-04T01:35:52.028417+0000","last_unstale":"2023-11-04T01:35:56.123188+0000","last_undegraded":"2023-11-04T01:35:56.123188+0000","last_fullsized":"2023-11-04T01:35:56.123188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083242+0000","last_change":"2023-11-04T01:35:51.060407+0000","last_active":"2023-11-04T01:35:56.083242+0000","last_peered":"2023-11-04T01:35:56.083242+0000","last_clean":"2023-11-04T01:35:56.083242+0000","last_became_active":"2023-11-04T01:35:51.059918+0000","last_became_peered":"2023-11-04T01:35:51.059918+0000","last_unstale":"2023-11-04T01:35:56.083242+0000","last_undegraded":"2023-11-04T01:35:56.083242+0000","last_fullsized":"2023-11-04T01:35:56.083242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018639+0000","last_change":"2023-11-04T01:35:56.124269+0000","last_active":"2023-11-04T01:35:57.018639+0000","last_peered":"2023-11-04T01:35:57.018639+0000","last_clean":"2023-11-04T01:35:57.018639+0000","last_became_active":"2023-11-04T01:35:56.123412+0000","last_became_peered":"2023-11-04T01:35:56.123412+0000","last_unstale":"2023-11-04T01:35:57.018639+0000","last_undegraded":"2023-11-04T01:35:57.018639+0000","last_fullsized":"2023-11-04T01:35:57.018639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:48.271158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082167+0000","last_change":"2023-11-04T01:35:52.023713+0000","last_active":"2023-11-04T01:35:56.082167+0000","last_peered":"2023-11-04T01:35:56.082167+0000","last_clean":"2023-11-04T01:35:56.082167+0000","last_became_active":"2023-11-04T01:35:52.023417+0000","last_became_peered":"2023-11-04T01:35:52.023417+0000","last_unstale":"2023-11-04T01:35:56.082167+0000","last_undegraded":"2023-11-04T01:35:56.082167+0000","last_fullsized":"2023-11-04T01:35:56.082167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083357+0000","last_change":"2023-11-04T01:35:51.051189+0000","last_active":"2023-11-04T01:35:56.083357+0000","last_peered":"2023-11-04T01:35:56.083357+0000","last_clean":"2023-11-04T01:35:56.083357+0000","last_became_active":"2023-11-04T01:35:51.050893+0000","last_became_peered":"2023-11-04T01:35:51.050893+0000","last_unstale":"2023-11-04T01:35:56.083357+0000","last_undegraded":"2023-11-04T01:35:56.083357+0000","last_fullsized":"2023-11-04T01:35:56.083357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018804+0000","last_change":"2023-11-04T01:35:56.126113+0000","last_active":"2023-11-04T01:35:57.018804+0000","last_peered":"2023-11-04T01:35:57.018804+0000","last_clean":"2023-11-04T01:35:57.018804+0000","last_became_active":"2023-11-04T01:35:56.125732+0000","last_became_peered":"2023-11-04T01:35:56.125732+0000","last_unstale":"2023-11-04T01:35:57.018804+0000","last_undegraded":"2023-11-04T01:35:57.018804+0000","last_fullsized":"2023-11-04T01:35:57.018804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123721+0000","last_change":"2023-11-04T01:35:52.028845+0000","last_active":"2023-11-04T01:35:56.123721+0000","last_peered":"2023-11-04T01:35:56.123721+0000","last_clean":"2023-11-04T01:35:56.123721+0000","last_became_active":"2023-11-04T01:35:52.026621+0000","last_became_peered":"2023-11-04T01:35:52.026621+0000","last_unstale":"2023-11-04T01:35:56.123721+0000","last_undegraded":"2023-11-04T01:35:56.123721+0000","last_fullsized":"2023-11-04T01:35:56.123721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:02.562793+0000","last_change":"2023-11-04T01:35:51.059172+0000","last_active":"2023-11-04T01:36:02.562793+0000","last_peered":"2023-11-04T01:36:02.562793+0000","last_clean":"2023-11-04T01:36:02.562793+0000","last_became_active":"2023-11-04T01:35:51.058907+0000","last_became_peered":"2023-11-04T01:35:51.058907+0000","last_unstale":"2023-11-04T01:36:02.562793+0000","last_undegraded":"2023-11-04T01:36:02.562793+0000","last_fullsized":"2023-11-04T01:36:02.562793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018253+0000","last_change":"2023-11-04T01:35:56.093416+0000","last_active":"2023-11-04T01:35:57.018253+0000","last_peered":"2023-11-04T01:35:57.018253+0000","last_clean":"2023-11-04T01:35:57.018253+0000","last_became_active":"2023-11-04T01:35:56.092225+0000","last_became_peered":"2023-11-04T01:35:56.092225+0000","last_unstale":"2023-11-04T01:35:57.018253+0000","last_undegraded":"2023-11-04T01:35:57.018253+0000","last_fullsized":"2023-11-04T01:35:57.018253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090174+0000","last_change":"2023-11-04T01:35:52.020324+0000","last_active":"2023-11-04T01:35:56.090174+0000","last_peered":"2023-11-04T01:35:56.090174+0000","last_clean":"2023-11-04T01:35:56.090174+0000","last_became_active":"2023-11-04T01:35:52.020031+0000","last_became_peered":"2023-11-04T01:35:52.020031+0000","last_unstale":"2023-11-04T01:35:56.090174+0000","last_undegraded":"2023-11-04T01:35:56.090174+0000","last_fullsized":"2023-11-04T01:35:56.090174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:14.232121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076494+0000","last_change":"2023-11-04T01:35:51.063507+0000","last_active":"2023-11-04T01:35:56.076494+0000","last_peered":"2023-11-04T01:35:56.076494+0000","last_clean":"2023-11-04T01:35:56.076494+0000","last_became_active":"2023-11-04T01:35:51.062548+0000","last_became_peered":"2023-11-04T01:35:51.062548+0000","last_unstale":"2023-11-04T01:35:56.076494+0000","last_undegraded":"2023-11-04T01:35:56.076494+0000","last_fullsized":"2023-11-04T01:35:56.076494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019702+0000","last_change":"2023-11-04T01:35:56.100663+0000","last_active":"2023-11-04T01:35:57.019702+0000","last_peered":"2023-11-04T01:35:57.019702+0000","last_clean":"2023-11-04T01:35:57.019702+0000","last_became_active":"2023-11-04T01:35:56.099543+0000","last_became_peered":"2023-11-04T01:35:56.099543+0000","last_unstale":"2023-11-04T01:35:57.019702+0000","last_undegraded":"2023-11-04T01:35:57.019702+0000","last_fullsized":"2023-11-04T01:35:57.019702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082599+0000","last_change":"2023-11-04T01:35:52.028518+0000","last_active":"2023-11-04T01:35:56.082599+0000","last_peered":"2023-11-04T01:35:56.082599+0000","last_clean":"2023-11-04T01:35:56.082599+0000","last_became_active":"2023-11-04T01:35:52.028243+0000","last_became_peered":"2023-11-04T01:35:52.028243+0000","last_unstale":"2023-11-04T01:35:56.082599+0000","last_undegraded":"2023-11-04T01:35:56.082599+0000","last_fullsized":"2023-11-04T01:35:56.082599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083875+0000","last_change":"2023-11-04T01:35:51.064570+0000","last_active":"2023-11-04T01:35:56.083875+0000","last_peered":"2023-11-04T01:35:56.083875+0000","last_clean":"2023-11-04T01:35:56.083875+0000","last_became_active":"2023-11-04T01:35:51.064236+0000","last_became_peered":"2023-11-04T01:35:51.064236+0000","last_unstale":"2023-11-04T01:35:56.083875+0000","last_undegraded":"2023-11-04T01:35:56.083875+0000","last_fullsized":"2023-11-04T01:35:56.083875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:58.299230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017951+0000","last_change":"2023-11-04T01:35:56.096122+0000","last_active":"2023-11-04T01:35:57.017951+0000","last_peered":"2023-11-04T01:35:57.017951+0000","last_clean":"2023-11-04T01:35:57.017951+0000","last_became_active":"2023-11-04T01:35:56.095763+0000","last_became_peered":"2023-11-04T01:35:56.095763+0000","last_unstale":"2023-11-04T01:35:57.017951+0000","last_undegraded":"2023-11-04T01:35:57.017951+0000","last_fullsized":"2023-11-04T01:35:57.017951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083789+0000","last_change":"2023-11-04T01:35:52.033716+0000","last_active":"2023-11-04T01:35:56.083789+0000","last_peered":"2023-11-04T01:35:56.083789+0000","last_clean":"2023-11-04T01:35:56.083789+0000","last_became_active":"2023-11-04T01:35:52.033366+0000","last_became_peered":"2023-11-04T01:35:52.033366+0000","last_unstale":"2023-11-04T01:35:56.083789+0000","last_undegraded":"2023-11-04T01:35:56.083789+0000","last_fullsized":"2023-11-04T01:35:56.083789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092435+0000","last_change":"2023-11-04T01:35:51.061737+0000","last_active":"2023-11-04T01:35:56.092435+0000","last_peered":"2023-11-04T01:35:56.092435+0000","last_clean":"2023-11-04T01:35:56.092435+0000","last_became_active":"2023-11-04T01:35:51.061470+0000","last_became_peered":"2023-11-04T01:35:51.061470+0000","last_unstale":"2023-11-04T01:35:56.092435+0000","last_undegraded":"2023-11-04T01:35:56.092435+0000","last_fullsized":"2023-11-04T01:35:56.092435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018337+0000","last_change":"2023-11-04T01:35:56.127670+0000","last_active":"2023-11-04T01:35:57.018337+0000","last_peered":"2023-11-04T01:35:57.018337+0000","last_clean":"2023-11-04T01:35:57.018337+0000","last_became_active":"2023-11-04T01:35:56.127256+0000","last_became_peered":"2023-11-04T01:35:56.127256+0000","last_unstale":"2023-11-04T01:35:57.018337+0000","last_undegraded":"2023-11-04T01:35:57.018337+0000","last_fullsized":"2023-11-04T01:35:57.018337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:16.877043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010009+0000","last_change":"2023-11-04T01:35:56.125573+0000","last_active":"2023-11-04T01:35:57.010009+0000","last_peered":"2023-11-04T01:35:57.010009+0000","last_clean":"2023-11-04T01:35:57.010009+0000","last_became_active":"2023-11-04T01:35:56.125207+0000","last_became_peered":"2023-11-04T01:35:56.125207+0000","last_unstale":"2023-11-04T01:35:57.010009+0000","last_undegraded":"2023-11-04T01:35:57.010009+0000","last_fullsized":"2023-11-04T01:35:57.010009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076102+0000","last_change":"2023-11-04T01:35:52.023725+0000","last_active":"2023-11-04T01:35:56.076102+0000","last_peered":"2023-11-04T01:35:56.076102+0000","last_clean":"2023-11-04T01:35:56.076102+0000","last_became_active":"2023-11-04T01:35:52.023469+0000","last_became_peered":"2023-11-04T01:35:52.023469+0000","last_unstale":"2023-11-04T01:35:56.076102+0000","last_undegraded":"2023-11-04T01:35:56.076102+0000","last_fullsized":"2023-11-04T01:35:56.076102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082991+0000","last_change":"2023-11-04T01:35:51.059113+0000","last_active":"2023-11-04T01:35:56.082991+0000","last_peered":"2023-11-04T01:35:56.082991+0000","last_clean":"2023-11-04T01:35:56.082991+0000","last_became_active":"2023-11-04T01:35:51.058837+0000","last_became_peered":"2023-11-04T01:35:51.058837+0000","last_unstale":"2023-11-04T01:35:56.082991+0000","last_undegraded":"2023-11-04T01:35:56.082991+0000","last_fullsized":"2023-11-04T01:35:56.082991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010915+0000","last_change":"2023-11-04T01:35:56.102617+0000","last_active":"2023-11-04T01:35:57.010915+0000","last_peered":"2023-11-04T01:35:57.010915+0000","last_clean":"2023-11-04T01:35:57.010915+0000","last_became_active":"2023-11-04T01:35:56.102162+0000","last_became_peered":"2023-11-04T01:35:56.102162+0000","last_unstale":"2023-11-04T01:35:57.010915+0000","last_undegraded":"2023-11-04T01:35:57.010915+0000","last_fullsized":"2023-11-04T01:35:57.010915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086285+0000","last_change":"2023-11-04T01:35:52.031363+0000","last_active":"2023-11-04T01:35:56.086285+0000","last_peered":"2023-11-04T01:35:56.086285+0000","last_clean":"2023-11-04T01:35:56.086285+0000","last_became_active":"2023-11-04T01:35:52.031088+0000","last_became_peered":"2023-11-04T01:35:52.031088+0000","last_unstale":"2023-11-04T01:35:56.086285+0000","last_undegraded":"2023-11-04T01:35:56.086285+0000","last_fullsized":"2023-11-04T01:35:56.086285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085566+0000","last_change":"2023-11-04T01:35:51.065071+0000","last_active":"2023-11-04T01:35:56.085566+0000","last_peered":"2023-11-04T01:35:56.085566+0000","last_clean":"2023-11-04T01:35:56.085566+0000","last_became_active":"2023-11-04T01:35:51.064790+0000","last_became_peered":"2023-11-04T01:35:51.064790+0000","last_unstale":"2023-11-04T01:35:56.085566+0000","last_undegraded":"2023-11-04T01:35:56.085566+0000","last_fullsized":"2023-11-04T01:35:56.085566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090769+0000","last_change":"2023-11-04T01:35:51.057559+0000","last_active":"2023-11-04T01:35:56.090769+0000","last_peered":"2023-11-04T01:35:56.090769+0000","last_clean":"2023-11-04T01:35:56.090769+0000","last_became_active":"2023-11-04T01:35:51.056993+0000","last_became_peered":"2023-11-04T01:35:51.056993+0000","last_unstale":"2023-11-04T01:35:56.090769+0000","last_undegraded":"2023-11-04T01:35:56.090769+0000","last_fullsized":"2023-11-04T01:35:56.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082667+0000","last_change":"2023-11-04T01:35:52.022126+0000","last_active":"2023-11-04T01:35:56.082667+0000","last_peered":"2023-11-04T01:35:56.082667+0000","last_clean":"2023-11-04T01:35:56.082667+0000","last_became_active":"2023-11-04T01:35:52.021875+0000","last_became_peered":"2023-11-04T01:35:52.021875+0000","last_unstale":"2023-11-04T01:35:56.082667+0000","last_undegraded":"2023-11-04T01:35:56.082667+0000","last_fullsized":"2023-11-04T01:35:56.082667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010633+0000","last_change":"2023-11-04T01:35:56.099022+0000","last_active":"2023-11-04T01:35:57.010633+0000","last_peered":"2023-11-04T01:35:57.010633+0000","last_clean":"2023-11-04T01:35:57.010633+0000","last_became_active":"2023-11-04T01:35:56.098634+0000","last_became_peered":"2023-11-04T01:35:56.098634+0000","last_unstale":"2023-11-04T01:35:57.010633+0000","last_undegraded":"2023-11-04T01:35:57.010633+0000","last_fullsized":"2023-11-04T01:35:57.010633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:18.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086027+0000","last_change":"2023-11-04T01:35:51.061727+0000","last_active":"2023-11-04T01:35:56.086027+0000","last_peered":"2023-11-04T01:35:56.086027+0000","last_clean":"2023-11-04T01:35:56.086027+0000","last_became_active":"2023-11-04T01:35:51.061215+0000","last_became_peered":"2023-11-04T01:35:51.061215+0000","last_unstale":"2023-11-04T01:35:56.086027+0000","last_undegraded":"2023-11-04T01:35:56.086027+0000","last_fullsized":"2023-11-04T01:35:56.086027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090923+0000","last_change":"2023-11-04T01:35:52.020181+0000","last_active":"2023-11-04T01:35:56.090923+0000","last_peered":"2023-11-04T01:35:56.090923+0000","last_clean":"2023-11-04T01:35:56.090923+0000","last_became_active":"2023-11-04T01:35:52.019904+0000","last_became_peered":"2023-11-04T01:35:52.019904+0000","last_unstale":"2023-11-04T01:35:56.090923+0000","last_undegraded":"2023-11-04T01:35:56.090923+0000","last_fullsized":"2023-11-04T01:35:56.090923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018207+0000","last_change":"2023-11-04T01:35:56.096018+0000","last_active":"2023-11-04T01:35:57.018207+0000","last_peered":"2023-11-04T01:35:57.018207+0000","last_clean":"2023-11-04T01:35:57.018207+0000","last_became_active":"2023-11-04T01:35:56.094855+0000","last_became_peered":"2023-11-04T01:35:56.094855+0000","last_unstale":"2023-11-04T01:35:57.018207+0000","last_undegraded":"2023-11-04T01:35:57.018207+0000","last_fullsized":"2023-11-04T01:35:57.018207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:11.437390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090519+0000","last_change":"2023-11-04T01:35:52.031578+0000","last_active":"2023-11-04T01:35:56.090519+0000","last_peered":"2023-11-04T01:35:56.090519+0000","last_clean":"2023-11-04T01:35:56.090519+0000","last_became_active":"2023-11-04T01:35:52.031324+0000","last_became_peered":"2023-11-04T01:35:52.031324+0000","last_unstale":"2023-11-04T01:35:56.090519+0000","last_undegraded":"2023-11-04T01:35:56.090519+0000","last_fullsized":"2023-11-04T01:35:56.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090127+0000","last_change":"2023-11-04T01:35:52.021615+0000","last_active":"2023-11-04T01:35:56.090127+0000","last_peered":"2023-11-04T01:35:56.090127+0000","last_clean":"2023-11-04T01:35:56.090127+0000","last_became_active":"2023-11-04T01:35:52.021344+0000","last_became_peered":"2023-11-04T01:35:52.021344+0000","last_unstale":"2023-11-04T01:35:56.090127+0000","last_undegraded":"2023-11-04T01:35:56.090127+0000","last_fullsized":"2023-11-04T01:35:56.090127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083431+0000","last_change":"2023-11-04T01:35:52.027223+0000","last_active":"2023-11-04T01:35:56.083431+0000","last_peered":"2023-11-04T01:35:56.083431+0000","last_clean":"2023-11-04T01:35:56.083431+0000","last_became_active":"2023-11-04T01:35:52.026929+0000","last_became_peered":"2023-11-04T01:35:52.026929+0000","last_unstale":"2023-11-04T01:35:56.083431+0000","last_undegraded":"2023-11-04T01:35:56.083431+0000","last_fullsized":"2023-11-04T01:35:56.083431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082587+0000","last_change":"2023-11-04T01:35:52.023823+0000","last_active":"2023-11-04T01:35:56.082587+0000","last_peered":"2023-11-04T01:35:56.082587+0000","last_clean":"2023-11-04T01:35:56.082587+0000","last_became_active":"2023-11-04T01:35:52.023555+0000","last_became_peered":"2023-11-04T01:35:52.023555+0000","last_unstale":"2023-11-04T01:35:56.082587+0000","last_undegraded":"2023-11-04T01:35:56.082587+0000","last_fullsized":"2023-11-04T01:35:56.082587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086368+0000","last_change":"2023-11-04T01:35:52.023538+0000","last_active":"2023-11-04T01:35:56.086368+0000","last_peered":"2023-11-04T01:35:56.086368+0000","last_clean":"2023-11-04T01:35:56.086368+0000","last_became_active":"2023-11-04T01:35:52.023231+0000","last_became_peered":"2023-11-04T01:35:52.023231+0000","last_unstale":"2023-11-04T01:35:56.086368+0000","last_undegraded":"2023-11-04T01:35:56.086368+0000","last_fullsized":"2023-11-04T01:35:56.086368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076403+0000","last_change":"2023-11-04T01:35:52.020500+0000","last_active":"2023-11-04T01:35:56.076403+0000","last_peered":"2023-11-04T01:35:56.076403+0000","last_clean":"2023-11-04T01:35:56.076403+0000","last_became_active":"2023-11-04T01:35:52.020215+0000","last_became_peered":"2023-11-04T01:35:52.020215+0000","last_unstale":"2023-11-04T01:35:56.076403+0000","last_undegraded":"2023-11-04T01:35:56.076403+0000","last_fullsized":"2023-11-04T01:35:56.076403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092296+0000","last_change":"2023-11-04T01:35:52.032684+0000","last_active":"2023-11-04T01:35:56.092296+0000","last_peered":"2023-11-04T01:35:56.092296+0000","last_clean":"2023-11-04T01:35:56.092296+0000","last_became_active":"2023-11-04T01:35:52.032419+0000","last_became_peered":"2023-11-04T01:35:52.032419+0000","last_unstale":"2023-11-04T01:35:56.092296+0000","last_undegraded":"2023-11-04T01:35:56.092296+0000","last_fullsized":"2023-11-04T01:35:56.092296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086117+0000","last_change":"2023-11-04T01:35:52.022740+0000","last_active":"2023-11-04T01:35:56.086117+0000","last_peered":"2023-11-04T01:35:56.086117+0000","last_clean":"2023-11-04T01:35:56.086117+0000","last_became_active":"2023-11-04T01:35:52.022487+0000","last_became_peered":"2023-11-04T01:35:52.022487+0000","last_unstale":"2023-11-04T01:35:56.086117+0000","last_undegraded":"2023-11-04T01:35:56.086117+0000","last_fullsized":"2023-11-04T01:35:56.086117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082907+0000","last_change":"2023-11-04T01:35:52.026431+0000","last_active":"2023-11-04T01:35:56.082907+0000","last_peered":"2023-11-04T01:35:56.082907+0000","last_clean":"2023-11-04T01:35:56.082907+0000","last_became_active":"2023-11-04T01:35:52.025267+0000","last_became_peered":"2023-11-04T01:35:52.025267+0000","last_unstale":"2023-11-04T01:35:56.082907+0000","last_undegraded":"2023-11-04T01:35:56.082907+0000","last_fullsized":"2023-11-04T01:35:56.082907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085429+0000","last_change":"2023-11-04T01:35:52.025059+0000","last_active":"2023-11-04T01:35:56.085429+0000","last_peered":"2023-11-04T01:35:56.085429+0000","last_clean":"2023-11-04T01:35:56.085429+0000","last_became_active":"2023-11-04T01:35:52.024772+0000","last_became_peered":"2023-11-04T01:35:52.024772+0000","last_unstale":"2023-11-04T01:35:56.085429+0000","last_undegraded":"2023-11-04T01:35:56.085429+0000","last_fullsized":"2023-11-04T01:35:56.085429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083117+0000","last_change":"2023-11-04T01:35:52.033100+0000","last_active":"2023-11-04T01:35:56.083117+0000","last_peered":"2023-11-04T01:35:56.083117+0000","last_clean":"2023-11-04T01:35:56.083117+0000","last_became_active":"2023-11-04T01:35:52.032826+0000","last_became_peered":"2023-11-04T01:35:52.032826+0000","last_unstale":"2023-11-04T01:35:56.083117+0000","last_undegraded":"2023-11-04T01:35:56.083117+0000","last_fullsized":"2023-11-04T01:35:56.083117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082484+0000","last_change":"2023-11-04T01:35:52.024693+0000","last_active":"2023-11-04T01:35:56.082484+0000","last_peered":"2023-11-04T01:35:56.082484+0000","last_clean":"2023-11-04T01:35:56.082484+0000","last_became_active":"2023-11-04T01:35:52.024003+0000","last_became_peered":"2023-11-04T01:35:52.024003+0000","last_unstale":"2023-11-04T01:35:56.082484+0000","last_undegraded":"2023-11-04T01:35:56.082484+0000","last_fullsized":"2023-11-04T01:35:56.082484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091592+0000","last_change":"2023-11-04T01:35:52.025240+0000","last_active":"2023-11-04T01:35:56.091592+0000","last_peered":"2023-11-04T01:35:56.091592+0000","last_clean":"2023-11-04T01:35:56.091592+0000","last_became_active":"2023-11-04T01:35:52.024964+0000","last_became_peered":"2023-11-04T01:35:52.024964+0000","last_unstale":"2023-11-04T01:35:56.091592+0000","last_undegraded":"2023-11-04T01:35:56.091592+0000","last_fullsized":"2023-11-04T01:35:56.091592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124893+0000","last_change":"2023-11-04T01:35:52.032089+0000","last_active":"2023-11-04T01:35:56.124893+0000","last_peered":"2023-11-04T01:35:56.124893+0000","last_clean":"2023-11-04T01:35:56.124893+0000","last_became_active":"2023-11-04T01:35:52.030222+0000","last_became_peered":"2023-11-04T01:35:52.030222+0000","last_unstale":"2023-11-04T01:35:56.124893+0000","last_undegraded":"2023-11-04T01:35:56.124893+0000","last_fullsized":"2023-11-04T01:35:56.124893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090324+0000","last_change":"2023-11-04T01:35:52.027792+0000","last_active":"2023-11-04T01:35:56.090324+0000","last_peered":"2023-11-04T01:35:56.090324+0000","last_clean":"2023-11-04T01:35:56.090324+0000","last_became_active":"2023-11-04T01:35:52.027473+0000","last_became_peered":"2023-11-04T01:35:52.027473+0000","last_unstale":"2023-11-04T01:35:56.090324+0000","last_undegraded":"2023-11-04T01:35:56.090324+0000","last_fullsized":"2023-11-04T01:35:56.090324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084262+0000","last_change":"2023-11-04T01:35:52.034363+0000","last_active":"2023-11-04T01:35:56.084262+0000","last_peered":"2023-11-04T01:35:56.084262+0000","last_clean":"2023-11-04T01:35:56.084262+0000","last_became_active":"2023-11-04T01:35:52.034096+0000","last_became_peered":"2023-11-04T01:35:52.034096+0000","last_unstale":"2023-11-04T01:35:56.084262+0000","last_undegraded":"2023-11-04T01:35:56.084262+0000","last_fullsized":"2023-11-04T01:35:56.084262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082886+0000","last_change":"2023-11-04T01:35:52.033024+0000","last_active":"2023-11-04T01:35:56.082886+0000","last_peered":"2023-11-04T01:35:56.082886+0000","last_clean":"2023-11-04T01:35:56.082886+0000","last_became_active":"2023-11-04T01:35:52.032614+0000","last_became_peered":"2023-11-04T01:35:52.032614+0000","last_unstale":"2023-11-04T01:35:56.082886+0000","last_undegraded":"2023-11-04T01:35:56.082886+0000","last_fullsized":"2023-11-04T01:35:56.082886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076111+0000","last_change":"2023-11-04T01:35:52.021303+0000","last_active":"2023-11-04T01:35:56.076111+0000","last_peered":"2023-11-04T01:35:56.076111+0000","last_clean":"2023-11-04T01:35:56.076111+0000","last_became_active":"2023-11-04T01:35:52.021044+0000","last_became_peered":"2023-11-04T01:35:52.021044+0000","last_unstale":"2023-11-04T01:35:56.076111+0000","last_undegraded":"2023-11-04T01:35:56.076111+0000","last_fullsized":"2023-11-04T01:35:56.076111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082084+0000","last_change":"2023-11-04T01:35:52.016825+0000","last_active":"2023-11-04T01:35:56.082084+0000","last_peered":"2023-11-04T01:35:56.082084+0000","last_clean":"2023-11-04T01:35:56.082084+0000","last_became_active":"2023-11-04T01:35:52.016549+0000","last_became_peered":"2023-11-04T01:35:52.016549+0000","last_unstale":"2023-11-04T01:35:56.082084+0000","last_undegraded":"2023-11-04T01:35:56.082084+0000","last_fullsized":"2023-11-04T01:35:56.082084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085869+0000","last_change":"2023-11-04T01:35:52.027711+0000","last_active":"2023-11-04T01:35:56.085869+0000","last_peered":"2023-11-04T01:35:56.085869+0000","last_clean":"2023-11-04T01:35:56.085869+0000","last_became_active":"2023-11-04T01:35:52.027452+0000","last_became_peered":"2023-11-04T01:35:52.027452+0000","last_unstale":"2023-11-04T01:35:56.085869+0000","last_undegraded":"2023-11-04T01:35:56.085869+0000","last_fullsized":"2023-11-04T01:35:56.085869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090100+0000","last_change":"2023-11-04T01:35:52.026105+0000","last_active":"2023-11-04T01:35:56.090100+0000","last_peered":"2023-11-04T01:35:56.090100+0000","last_clean":"2023-11-04T01:35:56.090100+0000","last_became_active":"2023-11-04T01:35:52.025848+0000","last_became_peered":"2023-11-04T01:35:52.025848+0000","last_unstale":"2023-11-04T01:35:56.090100+0000","last_undegraded":"2023-11-04T01:35:56.090100+0000","last_fullsized":"2023-11-04T01:35:56.090100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:57.470566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091791+0000","last_change":"2023-11-04T01:35:52.028295+0000","last_active":"2023-11-04T01:35:56.091791+0000","last_peered":"2023-11-04T01:35:56.091791+0000","last_clean":"2023-11-04T01:35:56.091791+0000","last_became_active":"2023-11-04T01:35:52.027999+0000","last_became_peered":"2023-11-04T01:35:52.027999+0000","last_unstale":"2023-11-04T01:35:56.091791+0000","last_undegraded":"2023-11-04T01:35:56.091791+0000","last_fullsized":"2023-11-04T01:35:56.091791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092276+0000","last_change":"2023-11-04T01:35:52.034087+0000","last_active":"2023-11-04T01:35:56.092276+0000","last_peered":"2023-11-04T01:35:56.092276+0000","last_clean":"2023-11-04T01:35:56.092276+0000","last_became_active":"2023-11-04T01:35:52.033825+0000","last_became_peered":"2023-11-04T01:35:52.033825+0000","last_unstale":"2023-11-04T01:35:56.092276+0000","last_undegraded":"2023-11-04T01:35:56.092276+0000","last_fullsized":"2023-11-04T01:35:56.092276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124669+0000","last_change":"2023-11-04T01:35:52.032966+0000","last_active":"2023-11-04T01:35:56.124669+0000","last_peered":"2023-11-04T01:35:56.124669+0000","last_clean":"2023-11-04T01:35:56.124669+0000","last_became_active":"2023-11-04T01:35:52.032247+0000","last_became_peered":"2023-11-04T01:35:52.032247+0000","last_unstale":"2023-11-04T01:35:56.124669+0000","last_undegraded":"2023-11-04T01:35:56.124669+0000","last_fullsized":"2023-11-04T01:35:56.124669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086247+0000","last_change":"2023-11-04T01:35:52.027992+0000","last_active":"2023-11-04T01:35:56.086247+0000","last_peered":"2023-11-04T01:35:56.086247+0000","last_clean":"2023-11-04T01:35:56.086247+0000","last_became_active":"2023-11-04T01:35:52.027698+0000","last_became_peered":"2023-11-04T01:35:52.027698+0000","last_unstale":"2023-11-04T01:35:56.086247+0000","last_undegraded":"2023-11-04T01:35:56.086247+0000","last_fullsized":"2023-11-04T01:35:56.086247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123016+0000","last_change":"2023-11-04T01:35:52.028491+0000","last_active":"2023-11-04T01:35:56.123016+0000","last_peered":"2023-11-04T01:35:56.123016+0000","last_clean":"2023-11-04T01:35:56.123016+0000","last_became_active":"2023-11-04T01:35:52.027844+0000","last_became_peered":"2023-11-04T01:35:52.027844+0000","last_unstale":"2023-11-04T01:35:56.123016+0000","last_undegraded":"2023-11-04T01:35:56.123016+0000","last_fullsized":"2023-11-04T01:35:56.123016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083120+0000","last_change":"2023-11-04T01:35:52.032551+0000","last_active":"2023-11-04T01:35:56.083120+0000","last_peered":"2023-11-04T01:35:56.083120+0000","last_clean":"2023-11-04T01:35:56.083120+0000","last_became_active":"2023-11-04T01:35:52.032243+0000","last_became_peered":"2023-11-04T01:35:52.032243+0000","last_unstale":"2023-11-04T01:35:56.083120+0000","last_undegraded":"2023-11-04T01:35:56.083120+0000","last_fullsized":"2023-11-04T01:35:56.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123005+0000","last_change":"2023-11-04T01:35:52.029489+0000","last_active":"2023-11-04T01:35:56.123005+0000","last_peered":"2023-11-04T01:35:56.123005+0000","last_clean":"2023-11-04T01:35:56.123005+0000","last_became_active":"2023-11-04T01:35:52.027332+0000","last_became_peered":"2023-11-04T01:35:52.027332+0000","last_unstale":"2023-11-04T01:35:56.123005+0000","last_undegraded":"2023-11-04T01:35:56.123005+0000","last_fullsized":"2023-11-04T01:35:56.123005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083593+0000","last_change":"2023-11-04T01:35:52.028505+0000","last_active":"2023-11-04T01:35:56.083593+0000","last_peered":"2023-11-04T01:35:56.083593+0000","last_clean":"2023-11-04T01:35:56.083593+0000","last_became_active":"2023-11-04T01:35:52.027029+0000","last_became_peered":"2023-11-04T01:35:52.027029+0000","last_unstale":"2023-11-04T01:35:56.083593+0000","last_undegraded":"2023-11-04T01:35:56.083593+0000","last_fullsized":"2023-11-04T01:35:56.083593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082243+0000","last_change":"2023-11-04T01:35:52.021387+0000","last_active":"2023-11-04T01:35:56.082243+0000","last_peered":"2023-11-04T01:35:56.082243+0000","last_clean":"2023-11-04T01:35:56.082243+0000","last_became_active":"2023-11-04T01:35:52.021111+0000","last_became_peered":"2023-11-04T01:35:52.021111+0000","last_unstale":"2023-11-04T01:35:56.082243+0000","last_undegraded":"2023-11-04T01:35:56.082243+0000","last_fullsized":"2023-11-04T01:35:56.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:05.972756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076467+0000","last_change":"2023-11-04T01:35:52.014538+0000","last_active":"2023-11-04T01:35:56.076467+0000","last_peered":"2023-11-04T01:35:56.076467+0000","last_clean":"2023-11-04T01:35:56.076467+0000","last_became_active":"2023-11-04T01:35:52.014284+0000","last_became_peered":"2023-11-04T01:35:52.014284+0000","last_unstale":"2023-11-04T01:35:56.076467+0000","last_undegraded":"2023-11-04T01:35:56.076467+0000","last_fullsized":"2023-11-04T01:35:56.076467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124311+0000","last_change":"2023-11-04T01:35:52.028638+0000","last_active":"2023-11-04T01:35:56.124311+0000","last_peered":"2023-11-04T01:35:56.124311+0000","last_clean":"2023-11-04T01:35:56.124311+0000","last_became_active":"2023-11-04T01:35:52.028172+0000","last_became_peered":"2023-11-04T01:35:52.028172+0000","last_unstale":"2023-11-04T01:35:56.124311+0000","last_undegraded":"2023-11-04T01:35:56.124311+0000","last_fullsized":"2023-11-04T01:35:56.124311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:15.984 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.114+0000 7fe7dd490640 1 Processor -- start 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.114+0000 7fe7dd490640 1 -- start start 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7dd490640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe7d80cec10 0x7fe7d80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7dd490640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7d80b2b40 0x7fe7d80b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7dd490640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d80b3c10 con 0x7fe7d815ac70 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7dd490640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d80cf180 con 0x7fe7d80cec10 2023-11-04T01:36:16.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7dd490640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d80cf460 con 0x7fe7d80b2b40 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7d67fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe7d80cec10 0x7fe7d80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7d6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe7d815ac70 0x7fe7d80d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54432/0 (socket says 172.21.15.93:54432) 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7d67fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe7d80cec10 0x7fe7d80b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48558/0 (socket says 172.21.15.93:48558) 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.115+0000 7fe7d6ffd640 1 -- 172.21.15.93:0/1645518871 learned_addr learned my addr 172.21.15.93:0/1645518871 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d67fc640 1 -- 172.21.15.93:0/1645518871 >> v2:172.21.15.125:3300/0 conn(0x7fe7d80b2b40 msgr2=0x7fe7d80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d77fe640 1 --2- 172.21.15.93:0/1645518871 >> v2:172.21.15.125:3300/0 conn(0x7fe7d80b2b40 0x7fe7d80b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d67fc640 1 --2- 172.21.15.93:0/1645518871 >> v2:172.21.15.125:3300/0 conn(0x7fe7d80b2b40 0x7fe7d80b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d67fc640 1 -- 172.21.15.93:0/1645518871 >> v1:172.21.15.93:6789/0 conn(0x7fe7d815ac70 legacy=0x7fe7d80d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d5ffb640 1 -- 172.21.15.93:0/1645518871 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574724740 0 0) 0x7fe7d80b3c10 con 0x7fe7d815ac70 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d67fc640 1 -- 172.21.15.93:0/1645518871 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80b2fa0 con 0x7fe7d80cec10 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d67fc640 1 --2- 172.21.15.93:0/1645518871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80b2600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe7d806e550 tx=0x7fe7cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41c1105ccd67835 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.116+0000 7fe7d5ffb640 1 -- 172.21.15.93:0/1645518871 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc031830 con 0x7fe7d80cec10 2023-11-04T01:36:16.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7d5ffb640 1 -- 172.21.15.93:0/1645518871 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc031990 con 0x7fe7d80cec10 2023-11-04T01:36:16.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7d5ffb640 1 -- 172.21.15.93:0/1645518871 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc031d20 con 0x7fe7d80cec10 2023-11-04T01:36:16.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 -- 172.21.15.93:0/1645518871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 msgr2=0x7fe7d80b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 --2- 172.21.15.93:0/1645518871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80b2600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe7d806e550 tx=0x7fe7cc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 -- 172.21.15.93:0/1645518871 shutdown_connections 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 --2- 172.21.15.93:0/1645518871 >> v2:172.21.15.125:3300/0 conn(0x7fe7d80b2b40 0x7fe7d80b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 --2- 172.21.15.93:0/1645518871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80b2600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 -- 172.21.15.93:0/1645518871 >> 172.21.15.93:0/1645518871 conn(0x7fe7d80cd600 msgr2=0x7fe7d80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 -- 172.21.15.93:0/1645518871 shutdown_connections 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.117+0000 7fe7dd490640 1 -- 172.21.15.93:0/1645518871 wait complete. 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.118+0000 7fe7dd490640 1 Processor -- start 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.118+0000 7fe7dd490640 1 -- start start 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7d80b2b40 0x7fe7d81f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 0x7fe7d80c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80c9cf0 con 0x7fe7d80cec10 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81f15f0 con 0x7fe7d815ac70 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7dd490640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80c4be0 con 0x7fe7d80b2b40 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48564/0 (socket says 172.21.15.93:48564) 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7d67fc640 1 -- 172.21.15.93:0/309042439 learned_addr learned my addr 172.21.15.93:0/309042439 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7d77fe640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 0x7fe7d80c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.119+0000 7fe7d6ffd640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7d80b2b40 0x7fe7d81f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 -- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7d80b2b40 msgr2=0x7fe7d81f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7d80b2b40 0x7fe7d81f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 -- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 msgr2=0x7fe7d80c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 0x7fe7d80c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 -- 172.21.15.93:0/309042439 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009400 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d77fe640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 0x7fe7d80c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7d67fc640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc02bee0 tx=0x7fe7cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc03ba70 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc03bbf0 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d80c4ec0 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0433f0 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.120+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d80c5480 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.121+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d815c370 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.121+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7cc043550 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.121+0000 7fe7bf7fe640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 0x7fe7c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.122+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7cc0ab700 con 0x7fe7d80cec10 2023-11-04T01:36:16.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.122+0000 7fe7d6ffd640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 0x7fe7c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.122+0000 7fe7d6ffd640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 0x7fe7c406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80016e0 tx=0x7fe7c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.126+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7d815c370 con 0x7fe7d80cec10 2023-11-04T01:36:16.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.290+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7d80cfa20 con 0x7fe7c406ae70 2023-11-04T01:36:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.298+0000 7fe7bf7fe640 1 -- 172.21.15.93:0/309042439 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345270 (secure 0 0 0) 0x7fe7c8005b20 con 0x7fe7c406ae70 2023-11-04T01:36:16.307 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:16.309 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:36:16.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 msgr2=0x7fe7c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 0x7fe7c406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80016e0 tx=0x7fe7c8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 msgr2=0x7fe7d80c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc02bee0 tx=0x7fe7cc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 shutdown_connections 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe7c406ae70 0x7fe7c406d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7d815ac70 0x7fe7d80c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7d80cec10 0x7fe7d80c6570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 --2- 172.21.15.93:0/309042439 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe7d80b2b40 0x7fe7d81f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 >> 172.21.15.93:0/309042439 conn(0x7fe7d80cd600 msgr2=0x7fe7d815a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 shutdown_connections 2023-11-04T01:36:16.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.301+0000 7fe7dd490640 1 -- 172.21.15.93:0/309042439 wait complete. 2023-11-04T01:36:16.314 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:36:15.330668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3276800,"data_stored":1986314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002873"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082757+0000","last_change":"2023-11-04T01:35:51.059593+0000","last_active":"2023-11-04T01:35:56.082757+0000","last_peered":"2023-11-04T01:35:56.082757+0000","last_clean":"2023-11-04T01:35:56.082757+0000","last_became_active":"2023-11-04T01:35:51.059276+0000","last_became_peered":"2023-11-04T01:35:51.059276+0000","last_unstale":"2023-11-04T01:35:56.082757+0000","last_undegraded":"2023-11-04T01:35:56.082757+0000","last_fullsized":"2023-11-04T01:35:56.082757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085660+0000","last_change":"2023-11-04T01:35:52.029967+0000","last_active":"2023-11-04T01:35:56.085660+0000","last_peered":"2023-11-04T01:35:56.085660+0000","last_clean":"2023-11-04T01:35:56.085660+0000","last_became_active":"2023-11-04T01:35:52.029678+0000","last_became_peered":"2023-11-04T01:35:52.029678+0000","last_unstale":"2023-11-04T01:35:56.085660+0000","last_undegraded":"2023-11-04T01:35:56.085660+0000","last_fullsized":"2023-11-04T01:35:56.085660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018192+0000","last_change":"2023-11-04T01:35:56.127497+0000","last_active":"2023-11-04T01:35:57.018192+0000","last_peered":"2023-11-04T01:35:57.018192+0000","last_clean":"2023-11-04T01:35:57.018192+0000","last_became_active":"2023-11-04T01:35:56.127104+0000","last_became_peered":"2023-11-04T01:35:56.127104+0000","last_unstale":"2023-11-04T01:35:57.018192+0000","last_undegraded":"2023-11-04T01:35:57.018192+0000","last_fullsized":"2023-11-04T01:35:57.018192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:04.310871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085827+0000","last_change":"2023-11-04T01:35:51.062804+0000","last_active":"2023-11-04T01:35:56.085827+0000","last_peered":"2023-11-04T01:35:56.085827+0000","last_clean":"2023-11-04T01:35:56.085827+0000","last_became_active":"2023-11-04T01:35:51.062550+0000","last_became_peered":"2023-11-04T01:35:51.062550+0000","last_unstale":"2023-11-04T01:35:56.085827+0000","last_undegraded":"2023-11-04T01:35:56.085827+0000","last_fullsized":"2023-11-04T01:35:56.085827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082497+0000","last_change":"2023-11-04T01:35:52.028642+0000","last_active":"2023-11-04T01:35:56.082497+0000","last_peered":"2023-11-04T01:35:56.082497+0000","last_clean":"2023-11-04T01:35:56.082497+0000","last_became_active":"2023-11-04T01:35:52.028335+0000","last_became_peered":"2023-11-04T01:35:52.028335+0000","last_unstale":"2023-11-04T01:35:56.082497+0000","last_undegraded":"2023-11-04T01:35:56.082497+0000","last_fullsized":"2023-11-04T01:35:56.082497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018823+0000","last_change":"2023-11-04T01:35:56.097973+0000","last_active":"2023-11-04T01:35:57.018823+0000","last_peered":"2023-11-04T01:35:57.018823+0000","last_clean":"2023-11-04T01:35:57.018823+0000","last_became_active":"2023-11-04T01:35:56.097592+0000","last_became_peered":"2023-11-04T01:35:56.097592+0000","last_unstale":"2023-11-04T01:35:57.018823+0000","last_undegraded":"2023-11-04T01:35:57.018823+0000","last_fullsized":"2023-11-04T01:35:57.018823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:59.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124753+0000","last_change":"2023-11-04T01:35:51.064359+0000","last_active":"2023-11-04T01:35:56.124753+0000","last_peered":"2023-11-04T01:35:56.124753+0000","last_clean":"2023-11-04T01:35:56.124753+0000","last_became_active":"2023-11-04T01:35:51.064086+0000","last_became_peered":"2023-11-04T01:35:51.064086+0000","last_unstale":"2023-11-04T01:35:56.124753+0000","last_undegraded":"2023-11-04T01:35:56.124753+0000","last_fullsized":"2023-11-04T01:35:56.124753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:04.967632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083843+0000","last_change":"2023-11-04T01:35:52.027845+0000","last_active":"2023-11-04T01:35:56.083843+0000","last_peered":"2023-11-04T01:35:56.083843+0000","last_clean":"2023-11-04T01:35:56.083843+0000","last_became_active":"2023-11-04T01:35:52.024155+0000","last_became_peered":"2023-11-04T01:35:52.024155+0000","last_unstale":"2023-11-04T01:35:56.083843+0000","last_undegraded":"2023-11-04T01:35:56.083843+0000","last_fullsized":"2023-11-04T01:35:56.083843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019534+0000","last_change":"2023-11-04T01:35:56.100849+0000","last_active":"2023-11-04T01:35:57.019534+0000","last_peered":"2023-11-04T01:35:57.019534+0000","last_clean":"2023-11-04T01:35:57.019534+0000","last_became_active":"2023-11-04T01:35:56.099083+0000","last_became_peered":"2023-11-04T01:35:56.099083+0000","last_unstale":"2023-11-04T01:35:57.019534+0000","last_undegraded":"2023-11-04T01:35:57.019534+0000","last_fullsized":"2023-11-04T01:35:57.019534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123310+0000","last_change":"2023-11-04T01:35:51.062659+0000","last_active":"2023-11-04T01:35:56.123310+0000","last_peered":"2023-11-04T01:35:56.123310+0000","last_clean":"2023-11-04T01:35:56.123310+0000","last_became_active":"2023-11-04T01:35:51.062258+0000","last_became_peered":"2023-11-04T01:35:51.062258+0000","last_unstale":"2023-11-04T01:35:56.123310+0000","last_undegraded":"2023-11-04T01:35:56.123310+0000","last_fullsized":"2023-11-04T01:35:56.123310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083932+0000","last_change":"2023-11-04T01:35:52.028671+0000","last_active":"2023-11-04T01:35:56.083932+0000","last_peered":"2023-11-04T01:35:56.083932+0000","last_clean":"2023-11-04T01:35:56.083932+0000","last_became_active":"2023-11-04T01:35:52.028245+0000","last_became_peered":"2023-11-04T01:35:52.028245+0000","last_unstale":"2023-11-04T01:35:56.083932+0000","last_undegraded":"2023-11-04T01:35:56.083932+0000","last_fullsized":"2023-11-04T01:35:56.083932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018071+0000","last_change":"2023-11-04T01:35:56.100779+0000","last_active":"2023-11-04T01:35:57.018071+0000","last_peered":"2023-11-04T01:35:57.018071+0000","last_clean":"2023-11-04T01:35:57.018071+0000","last_became_active":"2023-11-04T01:35:56.100333+0000","last_became_peered":"2023-11-04T01:35:56.100333+0000","last_unstale":"2023-11-04T01:35:57.018071+0000","last_undegraded":"2023-11-04T01:35:57.018071+0000","last_fullsized":"2023-11-04T01:35:57.018071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:48.170680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090642+0000","last_change":"2023-11-04T01:35:52.025166+0000","last_active":"2023-11-04T01:35:56.090642+0000","last_peered":"2023-11-04T01:35:56.090642+0000","last_clean":"2023-11-04T01:35:56.090642+0000","last_became_active":"2023-11-04T01:35:52.024875+0000","last_became_peered":"2023-11-04T01:35:52.024875+0000","last_unstale":"2023-11-04T01:35:56.090642+0000","last_undegraded":"2023-11-04T01:35:56.090642+0000","last_fullsized":"2023-11-04T01:35:56.090642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123232+0000","last_change":"2023-11-04T01:35:51.060056+0000","last_active":"2023-11-04T01:35:56.123232+0000","last_peered":"2023-11-04T01:35:56.123232+0000","last_clean":"2023-11-04T01:35:56.123232+0000","last_became_active":"2023-11-04T01:35:51.059746+0000","last_became_peered":"2023-11-04T01:35:51.059746+0000","last_unstale":"2023-11-04T01:35:56.123232+0000","last_undegraded":"2023-11-04T01:35:56.123232+0000","last_fullsized":"2023-11-04T01:35:56.123232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:07.896717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018852+0000","last_change":"2023-11-04T01:35:56.099872+0000","last_active":"2023-11-04T01:35:57.018852+0000","last_peered":"2023-11-04T01:35:57.018852+0000","last_clean":"2023-11-04T01:35:57.018852+0000","last_became_active":"2023-11-04T01:35:56.098782+0000","last_became_peered":"2023-11-04T01:35:56.098782+0000","last_unstale":"2023-11-04T01:35:57.018852+0000","last_undegraded":"2023-11-04T01:35:57.018852+0000","last_fullsized":"2023-11-04T01:35:57.018852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:26.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085943+0000","last_change":"2023-11-04T01:35:52.030864+0000","last_active":"2023-11-04T01:35:56.085943+0000","last_peered":"2023-11-04T01:35:56.085943+0000","last_clean":"2023-11-04T01:35:56.085943+0000","last_became_active":"2023-11-04T01:35:52.030586+0000","last_became_peered":"2023-11-04T01:35:52.030586+0000","last_unstale":"2023-11-04T01:35:56.085943+0000","last_undegraded":"2023-11-04T01:35:56.085943+0000","last_fullsized":"2023-11-04T01:35:56.085943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.077121+0000","last_change":"2023-11-04T01:35:51.063222+0000","last_active":"2023-11-04T01:35:56.077121+0000","last_peered":"2023-11-04T01:35:56.077121+0000","last_clean":"2023-11-04T01:35:56.077121+0000","last_became_active":"2023-11-04T01:35:51.062838+0000","last_became_peered":"2023-11-04T01:35:51.062838+0000","last_unstale":"2023-11-04T01:35:56.077121+0000","last_undegraded":"2023-11-04T01:35:56.077121+0000","last_fullsized":"2023-11-04T01:35:56.077121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019259+0000","last_change":"2023-11-04T01:35:56.100298+0000","last_active":"2023-11-04T01:35:57.019259+0000","last_peered":"2023-11-04T01:35:57.019259+0000","last_clean":"2023-11-04T01:35:57.019259+0000","last_became_active":"2023-11-04T01:35:56.098558+0000","last_became_peered":"2023-11-04T01:35:56.098558+0000","last_unstale":"2023-11-04T01:35:57.019259+0000","last_undegraded":"2023-11-04T01:35:57.019259+0000","last_fullsized":"2023-11-04T01:35:57.019259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086341+0000","last_change":"2023-11-04T01:35:52.021071+0000","last_active":"2023-11-04T01:35:56.086341+0000","last_peered":"2023-11-04T01:35:56.086341+0000","last_clean":"2023-11-04T01:35:56.086341+0000","last_became_active":"2023-11-04T01:35:52.020796+0000","last_became_peered":"2023-11-04T01:35:52.020796+0000","last_unstale":"2023-11-04T01:35:56.086341+0000","last_undegraded":"2023-11-04T01:35:56.086341+0000","last_fullsized":"2023-11-04T01:35:56.086341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076204+0000","last_change":"2023-11-04T01:35:51.060835+0000","last_active":"2023-11-04T01:35:56.076204+0000","last_peered":"2023-11-04T01:35:56.076204+0000","last_clean":"2023-11-04T01:35:56.076204+0000","last_became_active":"2023-11-04T01:35:51.060542+0000","last_became_peered":"2023-11-04T01:35:51.060542+0000","last_unstale":"2023-11-04T01:35:56.076204+0000","last_undegraded":"2023-11-04T01:35:56.076204+0000","last_fullsized":"2023-11-04T01:35:56.076204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018863+0000","last_change":"2023-11-04T01:35:56.127539+0000","last_active":"2023-11-04T01:35:57.018863+0000","last_peered":"2023-11-04T01:35:57.018863+0000","last_clean":"2023-11-04T01:35:57.018863+0000","last_became_active":"2023-11-04T01:35:56.127142+0000","last_became_peered":"2023-11-04T01:35:56.127142+0000","last_unstale":"2023-11-04T01:35:57.018863+0000","last_undegraded":"2023-11-04T01:35:57.018863+0000","last_fullsized":"2023-11-04T01:35:57.018863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090298+0000","last_change":"2023-11-04T01:35:52.023442+0000","last_active":"2023-11-04T01:35:56.090298+0000","last_peered":"2023-11-04T01:35:56.090298+0000","last_clean":"2023-11-04T01:35:56.090298+0000","last_became_active":"2023-11-04T01:35:52.021531+0000","last_became_peered":"2023-11-04T01:35:52.021531+0000","last_unstale":"2023-11-04T01:35:56.090298+0000","last_undegraded":"2023-11-04T01:35:56.090298+0000","last_fullsized":"2023-11-04T01:35:56.090298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:00.840333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122631+0000","last_change":"2023-11-04T01:35:51.063175+0000","last_active":"2023-11-04T01:35:56.122631+0000","last_peered":"2023-11-04T01:35:56.122631+0000","last_clean":"2023-11-04T01:35:56.122631+0000","last_became_active":"2023-11-04T01:35:51.062652+0000","last_became_peered":"2023-11-04T01:35:51.062652+0000","last_unstale":"2023-11-04T01:35:56.122631+0000","last_undegraded":"2023-11-04T01:35:56.122631+0000","last_fullsized":"2023-11-04T01:35:56.122631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018125+0000","last_change":"2023-11-04T01:35:56.099302+0000","last_active":"2023-11-04T01:35:57.018125+0000","last_peered":"2023-11-04T01:35:57.018125+0000","last_clean":"2023-11-04T01:35:57.018125+0000","last_became_active":"2023-11-04T01:35:56.098724+0000","last_became_peered":"2023-11-04T01:35:56.098724+0000","last_unstale":"2023-11-04T01:35:57.018125+0000","last_undegraded":"2023-11-04T01:35:57.018125+0000","last_fullsized":"2023-11-04T01:35:57.018125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:35.534588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082788+0000","last_change":"2023-11-04T01:35:52.017381+0000","last_active":"2023-11-04T01:35:56.082788+0000","last_peered":"2023-11-04T01:35:56.082788+0000","last_clean":"2023-11-04T01:35:56.082788+0000","last_became_active":"2023-11-04T01:35:52.017133+0000","last_became_peered":"2023-11-04T01:35:52.017133+0000","last_unstale":"2023-11-04T01:35:56.082788+0000","last_undegraded":"2023-11-04T01:35:56.082788+0000","last_fullsized":"2023-11-04T01:35:56.082788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092559+0000","last_change":"2023-11-04T01:35:51.059644+0000","last_active":"2023-11-04T01:35:56.092559+0000","last_peered":"2023-11-04T01:35:56.092559+0000","last_clean":"2023-11-04T01:35:56.092559+0000","last_became_active":"2023-11-04T01:35:51.059424+0000","last_became_peered":"2023-11-04T01:35:51.059424+0000","last_unstale":"2023-11-04T01:35:56.092559+0000","last_undegraded":"2023-11-04T01:35:56.092559+0000","last_fullsized":"2023-11-04T01:35:56.092559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019002+0000","last_change":"2023-11-04T01:35:56.124305+0000","last_active":"2023-11-04T01:35:57.019002+0000","last_peered":"2023-11-04T01:35:57.019002+0000","last_clean":"2023-11-04T01:35:57.019002+0000","last_became_active":"2023-11-04T01:35:56.123918+0000","last_became_peered":"2023-11-04T01:35:56.123918+0000","last_unstale":"2023-11-04T01:35:57.019002+0000","last_undegraded":"2023-11-04T01:35:57.019002+0000","last_fullsized":"2023-11-04T01:35:57.019002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086137+0000","last_change":"2023-11-04T01:35:52.030623+0000","last_active":"2023-11-04T01:35:56.086137+0000","last_peered":"2023-11-04T01:35:56.086137+0000","last_clean":"2023-11-04T01:35:56.086137+0000","last_became_active":"2023-11-04T01:35:52.030382+0000","last_became_peered":"2023-11-04T01:35:52.030382+0000","last_unstale":"2023-11-04T01:35:56.086137+0000","last_undegraded":"2023-11-04T01:35:56.086137+0000","last_fullsized":"2023-11-04T01:35:56.086137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076551+0000","last_change":"2023-11-04T01:35:51.062101+0000","last_active":"2023-11-04T01:35:56.076551+0000","last_peered":"2023-11-04T01:35:56.076551+0000","last_clean":"2023-11-04T01:35:56.076551+0000","last_became_active":"2023-11-04T01:35:51.061786+0000","last_became_peered":"2023-11-04T01:35:51.061786+0000","last_unstale":"2023-11-04T01:35:56.076551+0000","last_undegraded":"2023-11-04T01:35:56.076551+0000","last_fullsized":"2023-11-04T01:35:56.076551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017814+0000","last_change":"2023-11-04T01:35:56.128280+0000","last_active":"2023-11-04T01:35:57.017814+0000","last_peered":"2023-11-04T01:35:57.017814+0000","last_clean":"2023-11-04T01:35:57.017814+0000","last_became_active":"2023-11-04T01:35:56.127952+0000","last_became_peered":"2023-11-04T01:35:56.127952+0000","last_unstale":"2023-11-04T01:35:57.017814+0000","last_undegraded":"2023-11-04T01:35:57.017814+0000","last_fullsized":"2023-11-04T01:35:57.017814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076313+0000","last_change":"2023-11-04T01:35:52.019477+0000","last_active":"2023-11-04T01:35:56.076313+0000","last_peered":"2023-11-04T01:35:56.076313+0000","last_clean":"2023-11-04T01:35:56.076313+0000","last_became_active":"2023-11-04T01:35:52.019211+0000","last_became_peered":"2023-11-04T01:35:52.019211+0000","last_unstale":"2023-11-04T01:35:56.076313+0000","last_undegraded":"2023-11-04T01:35:56.076313+0000","last_fullsized":"2023-11-04T01:35:56.076313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125013+0000","last_change":"2023-11-04T01:35:51.061973+0000","last_active":"2023-11-04T01:35:56.125013+0000","last_peered":"2023-11-04T01:35:56.125013+0000","last_clean":"2023-11-04T01:35:56.125013+0000","last_became_active":"2023-11-04T01:35:51.061720+0000","last_became_peered":"2023-11-04T01:35:51.061720+0000","last_unstale":"2023-11-04T01:35:56.125013+0000","last_undegraded":"2023-11-04T01:35:56.125013+0000","last_fullsized":"2023-11-04T01:35:56.125013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009703+0000","last_change":"2023-11-04T01:35:56.124910+0000","last_active":"2023-11-04T01:35:57.009703+0000","last_peered":"2023-11-04T01:35:57.009703+0000","last_clean":"2023-11-04T01:35:57.009703+0000","last_became_active":"2023-11-04T01:35:56.124304+0000","last_became_peered":"2023-11-04T01:35:56.124304+0000","last_unstale":"2023-11-04T01:35:57.009703+0000","last_undegraded":"2023-11-04T01:35:57.009703+0000","last_fullsized":"2023-11-04T01:35:57.009703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084153+0000","last_change":"2023-11-04T01:35:52.027735+0000","last_active":"2023-11-04T01:35:56.084153+0000","last_peered":"2023-11-04T01:35:56.084153+0000","last_clean":"2023-11-04T01:35:56.084153+0000","last_became_active":"2023-11-04T01:35:52.027488+0000","last_became_peered":"2023-11-04T01:35:52.027488+0000","last_unstale":"2023-11-04T01:35:56.084153+0000","last_undegraded":"2023-11-04T01:35:56.084153+0000","last_fullsized":"2023-11-04T01:35:56.084153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076787+0000","last_change":"2023-11-04T01:35:51.060397+0000","last_active":"2023-11-04T01:35:56.076787+0000","last_peered":"2023-11-04T01:35:56.076787+0000","last_clean":"2023-11-04T01:35:56.076787+0000","last_became_active":"2023-11-04T01:35:51.060049+0000","last_became_peered":"2023-11-04T01:35:51.060049+0000","last_unstale":"2023-11-04T01:35:56.076787+0000","last_undegraded":"2023-11-04T01:35:56.076787+0000","last_fullsized":"2023-11-04T01:35:56.076787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:25:59.835210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018210+0000","last_change":"2023-11-04T01:35:56.097613+0000","last_active":"2023-11-04T01:35:57.018210+0000","last_peered":"2023-11-04T01:35:57.018210+0000","last_clean":"2023-11-04T01:35:57.018210+0000","last_became_active":"2023-11-04T01:35:56.095376+0000","last_became_peered":"2023-11-04T01:35:56.095376+0000","last_unstale":"2023-11-04T01:35:57.018210+0000","last_undegraded":"2023-11-04T01:35:57.018210+0000","last_fullsized":"2023-11-04T01:35:57.018210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091651+0000","last_change":"2023-11-04T01:35:52.022798+0000","last_active":"2023-11-04T01:35:56.091651+0000","last_peered":"2023-11-04T01:35:56.091651+0000","last_clean":"2023-11-04T01:35:56.091651+0000","last_became_active":"2023-11-04T01:35:52.021870+0000","last_became_peered":"2023-11-04T01:35:52.021870+0000","last_unstale":"2023-11-04T01:35:56.091651+0000","last_undegraded":"2023-11-04T01:35:56.091651+0000","last_fullsized":"2023-11-04T01:35:56.091651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083334+0000","last_change":"2023-11-04T01:35:51.058423+0000","last_active":"2023-11-04T01:35:56.083334+0000","last_peered":"2023-11-04T01:35:56.083334+0000","last_clean":"2023-11-04T01:35:56.083334+0000","last_became_active":"2023-11-04T01:35:51.057183+0000","last_became_peered":"2023-11-04T01:35:51.057183+0000","last_unstale":"2023-11-04T01:35:56.083334+0000","last_undegraded":"2023-11-04T01:35:56.083334+0000","last_fullsized":"2023-11-04T01:35:56.083334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018340+0000","last_change":"2023-11-04T01:35:56.093770+0000","last_active":"2023-11-04T01:35:57.018340+0000","last_peered":"2023-11-04T01:35:57.018340+0000","last_clean":"2023-11-04T01:35:57.018340+0000","last_became_active":"2023-11-04T01:35:56.092689+0000","last_became_peered":"2023-11-04T01:35:56.092689+0000","last_unstale":"2023-11-04T01:35:57.018340+0000","last_undegraded":"2023-11-04T01:35:57.018340+0000","last_fullsized":"2023-11-04T01:35:57.018340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076140+0000","last_change":"2023-11-04T01:35:52.019825+0000","last_active":"2023-11-04T01:35:56.076140+0000","last_peered":"2023-11-04T01:35:56.076140+0000","last_clean":"2023-11-04T01:35:56.076140+0000","last_became_active":"2023-11-04T01:35:52.019580+0000","last_became_peered":"2023-11-04T01:35:52.019580+0000","last_unstale":"2023-11-04T01:35:56.076140+0000","last_undegraded":"2023-11-04T01:35:56.076140+0000","last_fullsized":"2023-11-04T01:35:56.076140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090217+0000","last_change":"2023-11-04T01:35:51.058035+0000","last_active":"2023-11-04T01:35:56.090217+0000","last_peered":"2023-11-04T01:35:56.090217+0000","last_clean":"2023-11-04T01:35:56.090217+0000","last_became_active":"2023-11-04T01:35:51.057768+0000","last_became_peered":"2023-11-04T01:35:51.057768+0000","last_unstale":"2023-11-04T01:35:56.090217+0000","last_undegraded":"2023-11-04T01:35:56.090217+0000","last_fullsized":"2023-11-04T01:35:56.090217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018891+0000","last_change":"2023-11-04T01:35:56.094677+0000","last_active":"2023-11-04T01:35:57.018891+0000","last_peered":"2023-11-04T01:35:57.018891+0000","last_clean":"2023-11-04T01:35:57.018891+0000","last_became_active":"2023-11-04T01:35:56.094348+0000","last_became_peered":"2023-11-04T01:35:56.094348+0000","last_unstale":"2023-11-04T01:35:57.018891+0000","last_undegraded":"2023-11-04T01:35:57.018891+0000","last_fullsized":"2023-11-04T01:35:57.018891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082079+0000","last_change":"2023-11-04T01:35:52.020101+0000","last_active":"2023-11-04T01:35:56.082079+0000","last_peered":"2023-11-04T01:35:56.082079+0000","last_clean":"2023-11-04T01:35:56.082079+0000","last_became_active":"2023-11-04T01:35:52.019047+0000","last_became_peered":"2023-11-04T01:35:52.019047+0000","last_unstale":"2023-11-04T01:35:56.082079+0000","last_undegraded":"2023-11-04T01:35:56.082079+0000","last_fullsized":"2023-11-04T01:35:56.082079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:34.129560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122640+0000","last_change":"2023-11-04T01:35:51.063768+0000","last_active":"2023-11-04T01:35:56.122640+0000","last_peered":"2023-11-04T01:35:56.122640+0000","last_clean":"2023-11-04T01:35:56.122640+0000","last_became_active":"2023-11-04T01:35:51.063462+0000","last_became_peered":"2023-11-04T01:35:51.063462+0000","last_unstale":"2023-11-04T01:35:56.122640+0000","last_undegraded":"2023-11-04T01:35:56.122640+0000","last_fullsized":"2023-11-04T01:35:56.122640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010123+0000","last_change":"2023-11-04T01:35:56.124045+0000","last_active":"2023-11-04T01:35:57.010123+0000","last_peered":"2023-11-04T01:35:57.010123+0000","last_clean":"2023-11-04T01:35:57.010123+0000","last_became_active":"2023-11-04T01:35:56.123678+0000","last_became_peered":"2023-11-04T01:35:56.123678+0000","last_unstale":"2023-11-04T01:35:57.010123+0000","last_undegraded":"2023-11-04T01:35:57.010123+0000","last_fullsized":"2023-11-04T01:35:57.010123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:19.133387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085654+0000","last_change":"2023-11-04T01:35:52.029814+0000","last_active":"2023-11-04T01:35:56.085654+0000","last_peered":"2023-11-04T01:35:56.085654+0000","last_clean":"2023-11-04T01:35:56.085654+0000","last_became_active":"2023-11-04T01:35:52.029549+0000","last_became_peered":"2023-11-04T01:35:52.029549+0000","last_unstale":"2023-11-04T01:35:56.085654+0000","last_undegraded":"2023-11-04T01:35:56.085654+0000","last_fullsized":"2023-11-04T01:35:56.085654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083481+0000","last_change":"2023-11-04T01:35:51.062041+0000","last_active":"2023-11-04T01:35:56.083481+0000","last_peered":"2023-11-04T01:35:56.083481+0000","last_clean":"2023-11-04T01:35:56.083481+0000","last_became_active":"2023-11-04T01:35:51.061551+0000","last_became_peered":"2023-11-04T01:35:51.061551+0000","last_unstale":"2023-11-04T01:35:56.083481+0000","last_undegraded":"2023-11-04T01:35:56.083481+0000","last_fullsized":"2023-11-04T01:35:56.083481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.122962+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:35:56.122962+0000","last_peered":"2023-11-04T01:35:56.122962+0000","last_clean":"2023-11-04T01:35:56.122962+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:35:56.122962+0000","last_undegraded":"2023-11-04T01:35:56.122962+0000","last_fullsized":"2023-11-04T01:35:56.122962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010896+0000","last_change":"2023-11-04T01:35:56.126128+0000","last_active":"2023-11-04T01:35:57.010896+0000","last_peered":"2023-11-04T01:35:57.010896+0000","last_clean":"2023-11-04T01:35:57.010896+0000","last_became_active":"2023-11-04T01:35:56.125726+0000","last_became_peered":"2023-11-04T01:35:56.125726+0000","last_unstale":"2023-11-04T01:35:57.010896+0000","last_undegraded":"2023-11-04T01:35:57.010896+0000","last_fullsized":"2023-11-04T01:35:57.010896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:22.322616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123390+0000","last_change":"2023-11-04T01:35:52.030372+0000","last_active":"2023-11-04T01:35:56.123390+0000","last_peered":"2023-11-04T01:35:56.123390+0000","last_clean":"2023-11-04T01:35:56.123390+0000","last_became_active":"2023-11-04T01:35:52.029960+0000","last_became_peered":"2023-11-04T01:35:52.029960+0000","last_unstale":"2023-11-04T01:35:56.123390+0000","last_undegraded":"2023-11-04T01:35:56.123390+0000","last_fullsized":"2023-11-04T01:35:56.123390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090234+0000","last_change":"2023-11-04T01:35:51.059763+0000","last_active":"2023-11-04T01:35:56.090234+0000","last_peered":"2023-11-04T01:35:56.090234+0000","last_clean":"2023-11-04T01:35:56.090234+0000","last_became_active":"2023-11-04T01:35:51.059484+0000","last_became_peered":"2023-11-04T01:35:51.059484+0000","last_unstale":"2023-11-04T01:35:56.090234+0000","last_undegraded":"2023-11-04T01:35:56.090234+0000","last_fullsized":"2023-11-04T01:35:56.090234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:04.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010432+0000","last_change":"2023-11-04T01:35:56.123907+0000","last_active":"2023-11-04T01:35:57.010432+0000","last_peered":"2023-11-04T01:35:57.010432+0000","last_clean":"2023-11-04T01:35:57.010432+0000","last_became_active":"2023-11-04T01:35:56.123459+0000","last_became_peered":"2023-11-04T01:35:56.123459+0000","last_unstale":"2023-11-04T01:35:57.010432+0000","last_undegraded":"2023-11-04T01:35:57.010432+0000","last_fullsized":"2023-11-04T01:35:57.010432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083693+0000","last_change":"2023-11-04T01:35:52.024998+0000","last_active":"2023-11-04T01:35:56.083693+0000","last_peered":"2023-11-04T01:35:56.083693+0000","last_clean":"2023-11-04T01:35:56.083693+0000","last_became_active":"2023-11-04T01:35:52.024327+0000","last_became_peered":"2023-11-04T01:35:52.024327+0000","last_unstale":"2023-11-04T01:35:56.083693+0000","last_undegraded":"2023-11-04T01:35:56.083693+0000","last_fullsized":"2023-11-04T01:35:56.083693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:01.101220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076586+0000","last_change":"2023-11-04T01:35:51.059209+0000","last_active":"2023-11-04T01:35:56.076586+0000","last_peered":"2023-11-04T01:35:56.076586+0000","last_clean":"2023-11-04T01:35:56.076586+0000","last_became_active":"2023-11-04T01:35:51.058773+0000","last_became_peered":"2023-11-04T01:35:51.058773+0000","last_unstale":"2023-11-04T01:35:56.076586+0000","last_undegraded":"2023-11-04T01:35:56.076586+0000","last_fullsized":"2023-11-04T01:35:56.076586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:03.909042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.009806+0000","last_change":"2023-11-04T01:35:56.094757+0000","last_active":"2023-11-04T01:35:57.009806+0000","last_peered":"2023-11-04T01:35:57.009806+0000","last_clean":"2023-11-04T01:35:57.009806+0000","last_became_active":"2023-11-04T01:35:56.094419+0000","last_became_peered":"2023-11-04T01:35:56.094419+0000","last_unstale":"2023-11-04T01:35:57.009806+0000","last_undegraded":"2023-11-04T01:35:57.009806+0000","last_fullsized":"2023-11-04T01:35:57.009806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.125099+0000","last_change":"2023-11-04T01:35:52.032768+0000","last_active":"2023-11-04T01:35:56.125099+0000","last_peered":"2023-11-04T01:35:56.125099+0000","last_clean":"2023-11-04T01:35:56.125099+0000","last_became_active":"2023-11-04T01:35:52.031366+0000","last_became_peered":"2023-11-04T01:35:52.031366+0000","last_unstale":"2023-11-04T01:35:56.125099+0000","last_undegraded":"2023-11-04T01:35:56.125099+0000","last_fullsized":"2023-11-04T01:35:56.125099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090446+0000","last_change":"2023-11-04T01:35:51.058795+0000","last_active":"2023-11-04T01:35:56.090446+0000","last_peered":"2023-11-04T01:35:56.090446+0000","last_clean":"2023-11-04T01:35:56.090446+0000","last_became_active":"2023-11-04T01:35:51.058543+0000","last_became_peered":"2023-11-04T01:35:51.058543+0000","last_unstale":"2023-11-04T01:35:56.090446+0000","last_undegraded":"2023-11-04T01:35:56.090446+0000","last_fullsized":"2023-11-04T01:35:56.090446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:29.397552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017774+0000","last_change":"2023-11-04T01:35:56.124194+0000","last_active":"2023-11-04T01:35:57.017774+0000","last_peered":"2023-11-04T01:35:57.017774+0000","last_clean":"2023-11-04T01:35:57.017774+0000","last_became_active":"2023-11-04T01:35:56.123794+0000","last_became_peered":"2023-11-04T01:35:56.123794+0000","last_unstale":"2023-11-04T01:35:57.017774+0000","last_undegraded":"2023-11-04T01:35:57.017774+0000","last_fullsized":"2023-11-04T01:35:57.017774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:47.295577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124176+0000","last_change":"2023-11-04T01:35:52.028162+0000","last_active":"2023-11-04T01:35:56.124176+0000","last_peered":"2023-11-04T01:35:56.124176+0000","last_clean":"2023-11-04T01:35:56.124176+0000","last_became_active":"2023-11-04T01:35:52.026689+0000","last_became_peered":"2023-11-04T01:35:52.026689+0000","last_unstale":"2023-11-04T01:35:56.124176+0000","last_undegraded":"2023-11-04T01:35:56.124176+0000","last_fullsized":"2023-11-04T01:35:56.124176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088966+0000","last_change":"2023-11-04T01:35:51.052770+0000","last_active":"2023-11-04T01:35:56.088966+0000","last_peered":"2023-11-04T01:35:56.088966+0000","last_clean":"2023-11-04T01:35:56.088966+0000","last_became_active":"2023-11-04T01:35:51.052476+0000","last_became_peered":"2023-11-04T01:35:51.052476+0000","last_unstale":"2023-11-04T01:35:56.088966+0000","last_undegraded":"2023-11-04T01:35:56.088966+0000","last_fullsized":"2023-11-04T01:35:56.088966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:14.175765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018926+0000","last_change":"2023-11-04T01:35:56.099158+0000","last_active":"2023-11-04T01:35:57.018926+0000","last_peered":"2023-11-04T01:35:57.018926+0000","last_clean":"2023-11-04T01:35:57.018926+0000","last_became_active":"2023-11-04T01:35:56.098426+0000","last_became_peered":"2023-11-04T01:35:56.098426+0000","last_unstale":"2023-11-04T01:35:57.018926+0000","last_undegraded":"2023-11-04T01:35:57.018926+0000","last_fullsized":"2023-11-04T01:35:57.018926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:54.987011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123073+0000","last_change":"2023-11-04T01:35:52.027681+0000","last_active":"2023-11-04T01:35:56.123073+0000","last_peered":"2023-11-04T01:35:56.123073+0000","last_clean":"2023-11-04T01:35:56.123073+0000","last_became_active":"2023-11-04T01:35:52.027391+0000","last_became_peered":"2023-11-04T01:35:52.027391+0000","last_unstale":"2023-11-04T01:35:56.123073+0000","last_undegraded":"2023-11-04T01:35:56.123073+0000","last_fullsized":"2023-11-04T01:35:56.123073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.088329+0000","last_change":"2023-11-04T01:35:51.055489+0000","last_active":"2023-11-04T01:35:56.088329+0000","last_peered":"2023-11-04T01:35:56.088329+0000","last_clean":"2023-11-04T01:35:56.088329+0000","last_became_active":"2023-11-04T01:35:51.055183+0000","last_became_peered":"2023-11-04T01:35:51.055183+0000","last_unstale":"2023-11-04T01:35:56.088329+0000","last_undegraded":"2023-11-04T01:35:56.088329+0000","last_fullsized":"2023-11-04T01:35:56.088329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010094+0000","last_change":"2023-11-04T01:35:56.093191+0000","last_active":"2023-11-04T01:35:57.010094+0000","last_peered":"2023-11-04T01:35:57.010094+0000","last_clean":"2023-11-04T01:35:57.010094+0000","last_became_active":"2023-11-04T01:35:56.092827+0000","last_became_peered":"2023-11-04T01:35:56.092827+0000","last_unstale":"2023-11-04T01:35:57.010094+0000","last_undegraded":"2023-11-04T01:35:57.010094+0000","last_fullsized":"2023-11-04T01:35:57.010094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:08.274673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090655+0000","last_change":"2023-11-04T01:35:52.030977+0000","last_active":"2023-11-04T01:35:56.090655+0000","last_peered":"2023-11-04T01:35:56.090655+0000","last_clean":"2023-11-04T01:35:56.090655+0000","last_became_active":"2023-11-04T01:35:52.030636+0000","last_became_peered":"2023-11-04T01:35:52.030636+0000","last_unstale":"2023-11-04T01:35:56.090655+0000","last_undegraded":"2023-11-04T01:35:56.090655+0000","last_fullsized":"2023-11-04T01:35:56.090655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090474+0000","last_change":"2023-11-04T01:35:51.053345+0000","last_active":"2023-11-04T01:35:56.090474+0000","last_peered":"2023-11-04T01:35:56.090474+0000","last_clean":"2023-11-04T01:35:56.090474+0000","last_became_active":"2023-11-04T01:35:51.053075+0000","last_became_peered":"2023-11-04T01:35:51.053075+0000","last_unstale":"2023-11-04T01:35:56.090474+0000","last_undegraded":"2023-11-04T01:35:56.090474+0000","last_fullsized":"2023-11-04T01:35:56.090474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:52.913669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019088+0000","last_change":"2023-11-04T01:35:56.127666+0000","last_active":"2023-11-04T01:35:57.019088+0000","last_peered":"2023-11-04T01:35:57.019088+0000","last_clean":"2023-11-04T01:35:57.019088+0000","last_became_active":"2023-11-04T01:35:56.127269+0000","last_became_peered":"2023-11-04T01:35:56.127269+0000","last_unstale":"2023-11-04T01:35:57.019088+0000","last_undegraded":"2023-11-04T01:35:57.019088+0000","last_fullsized":"2023-11-04T01:35:57.019088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:21.238628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123188+0000","last_change":"2023-11-04T01:35:52.029517+0000","last_active":"2023-11-04T01:35:56.123188+0000","last_peered":"2023-11-04T01:35:56.123188+0000","last_clean":"2023-11-04T01:35:56.123188+0000","last_became_active":"2023-11-04T01:35:52.028417+0000","last_became_peered":"2023-11-04T01:35:52.028417+0000","last_unstale":"2023-11-04T01:35:56.123188+0000","last_undegraded":"2023-11-04T01:35:56.123188+0000","last_fullsized":"2023-11-04T01:35:56.123188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083242+0000","last_change":"2023-11-04T01:35:51.060407+0000","last_active":"2023-11-04T01:35:56.083242+0000","last_peered":"2023-11-04T01:35:56.083242+0000","last_clean":"2023-11-04T01:35:56.083242+0000","last_became_active":"2023-11-04T01:35:51.059918+0000","last_became_peered":"2023-11-04T01:35:51.059918+0000","last_unstale":"2023-11-04T01:35:56.083242+0000","last_undegraded":"2023-11-04T01:35:56.083242+0000","last_fullsized":"2023-11-04T01:35:56.083242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018639+0000","last_change":"2023-11-04T01:35:56.124269+0000","last_active":"2023-11-04T01:35:57.018639+0000","last_peered":"2023-11-04T01:35:57.018639+0000","last_clean":"2023-11-04T01:35:57.018639+0000","last_became_active":"2023-11-04T01:35:56.123412+0000","last_became_peered":"2023-11-04T01:35:56.123412+0000","last_unstale":"2023-11-04T01:35:57.018639+0000","last_undegraded":"2023-11-04T01:35:57.018639+0000","last_fullsized":"2023-11-04T01:35:57.018639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:48.271158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082167+0000","last_change":"2023-11-04T01:35:52.023713+0000","last_active":"2023-11-04T01:35:56.082167+0000","last_peered":"2023-11-04T01:35:56.082167+0000","last_clean":"2023-11-04T01:35:56.082167+0000","last_became_active":"2023-11-04T01:35:52.023417+0000","last_became_peered":"2023-11-04T01:35:52.023417+0000","last_unstale":"2023-11-04T01:35:56.082167+0000","last_undegraded":"2023-11-04T01:35:56.082167+0000","last_fullsized":"2023-11-04T01:35:56.082167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083357+0000","last_change":"2023-11-04T01:35:51.051189+0000","last_active":"2023-11-04T01:35:56.083357+0000","last_peered":"2023-11-04T01:35:56.083357+0000","last_clean":"2023-11-04T01:35:56.083357+0000","last_became_active":"2023-11-04T01:35:51.050893+0000","last_became_peered":"2023-11-04T01:35:51.050893+0000","last_unstale":"2023-11-04T01:35:56.083357+0000","last_undegraded":"2023-11-04T01:35:56.083357+0000","last_fullsized":"2023-11-04T01:35:56.083357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018804+0000","last_change":"2023-11-04T01:35:56.126113+0000","last_active":"2023-11-04T01:35:57.018804+0000","last_peered":"2023-11-04T01:35:57.018804+0000","last_clean":"2023-11-04T01:35:57.018804+0000","last_became_active":"2023-11-04T01:35:56.125732+0000","last_became_peered":"2023-11-04T01:35:56.125732+0000","last_unstale":"2023-11-04T01:35:57.018804+0000","last_undegraded":"2023-11-04T01:35:57.018804+0000","last_fullsized":"2023-11-04T01:35:57.018804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123721+0000","last_change":"2023-11-04T01:35:52.028845+0000","last_active":"2023-11-04T01:35:56.123721+0000","last_peered":"2023-11-04T01:35:56.123721+0000","last_clean":"2023-11-04T01:35:56.123721+0000","last_became_active":"2023-11-04T01:35:52.026621+0000","last_became_peered":"2023-11-04T01:35:52.026621+0000","last_unstale":"2023-11-04T01:35:56.123721+0000","last_undegraded":"2023-11-04T01:35:56.123721+0000","last_fullsized":"2023-11-04T01:35:56.123721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:02.562793+0000","last_change":"2023-11-04T01:35:51.059172+0000","last_active":"2023-11-04T01:36:02.562793+0000","last_peered":"2023-11-04T01:36:02.562793+0000","last_clean":"2023-11-04T01:36:02.562793+0000","last_became_active":"2023-11-04T01:35:51.058907+0000","last_became_peered":"2023-11-04T01:35:51.058907+0000","last_unstale":"2023-11-04T01:36:02.562793+0000","last_undegraded":"2023-11-04T01:36:02.562793+0000","last_fullsized":"2023-11-04T01:36:02.562793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018253+0000","last_change":"2023-11-04T01:35:56.093416+0000","last_active":"2023-11-04T01:35:57.018253+0000","last_peered":"2023-11-04T01:35:57.018253+0000","last_clean":"2023-11-04T01:35:57.018253+0000","last_became_active":"2023-11-04T01:35:56.092225+0000","last_became_peered":"2023-11-04T01:35:56.092225+0000","last_unstale":"2023-11-04T01:35:57.018253+0000","last_undegraded":"2023-11-04T01:35:57.018253+0000","last_fullsized":"2023-11-04T01:35:57.018253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:16.158675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090174+0000","last_change":"2023-11-04T01:35:52.020324+0000","last_active":"2023-11-04T01:35:56.090174+0000","last_peered":"2023-11-04T01:35:56.090174+0000","last_clean":"2023-11-04T01:35:56.090174+0000","last_became_active":"2023-11-04T01:35:52.020031+0000","last_became_peered":"2023-11-04T01:35:52.020031+0000","last_unstale":"2023-11-04T01:35:56.090174+0000","last_undegraded":"2023-11-04T01:35:56.090174+0000","last_fullsized":"2023-11-04T01:35:56.090174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:14.232121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076494+0000","last_change":"2023-11-04T01:35:51.063507+0000","last_active":"2023-11-04T01:35:56.076494+0000","last_peered":"2023-11-04T01:35:56.076494+0000","last_clean":"2023-11-04T01:35:56.076494+0000","last_became_active":"2023-11-04T01:35:51.062548+0000","last_became_peered":"2023-11-04T01:35:51.062548+0000","last_unstale":"2023-11-04T01:35:56.076494+0000","last_undegraded":"2023-11-04T01:35:56.076494+0000","last_fullsized":"2023-11-04T01:35:56.076494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:56.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.019702+0000","last_change":"2023-11-04T01:35:56.100663+0000","last_active":"2023-11-04T01:35:57.019702+0000","last_peered":"2023-11-04T01:35:57.019702+0000","last_clean":"2023-11-04T01:35:57.019702+0000","last_became_active":"2023-11-04T01:35:56.099543+0000","last_became_peered":"2023-11-04T01:35:56.099543+0000","last_unstale":"2023-11-04T01:35:57.019702+0000","last_undegraded":"2023-11-04T01:35:57.019702+0000","last_fullsized":"2023-11-04T01:35:57.019702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:42:05.131014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082599+0000","last_change":"2023-11-04T01:35:52.028518+0000","last_active":"2023-11-04T01:35:56.082599+0000","last_peered":"2023-11-04T01:35:56.082599+0000","last_clean":"2023-11-04T01:35:56.082599+0000","last_became_active":"2023-11-04T01:35:52.028243+0000","last_became_peered":"2023-11-04T01:35:52.028243+0000","last_unstale":"2023-11-04T01:35:56.082599+0000","last_undegraded":"2023-11-04T01:35:56.082599+0000","last_fullsized":"2023-11-04T01:35:56.082599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083875+0000","last_change":"2023-11-04T01:35:51.064570+0000","last_active":"2023-11-04T01:35:56.083875+0000","last_peered":"2023-11-04T01:35:56.083875+0000","last_clean":"2023-11-04T01:35:56.083875+0000","last_became_active":"2023-11-04T01:35:51.064236+0000","last_became_peered":"2023-11-04T01:35:51.064236+0000","last_unstale":"2023-11-04T01:35:56.083875+0000","last_undegraded":"2023-11-04T01:35:56.083875+0000","last_fullsized":"2023-11-04T01:35:56.083875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:58.299230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.017951+0000","last_change":"2023-11-04T01:35:56.096122+0000","last_active":"2023-11-04T01:35:57.017951+0000","last_peered":"2023-11-04T01:35:57.017951+0000","last_clean":"2023-11-04T01:35:57.017951+0000","last_became_active":"2023-11-04T01:35:56.095763+0000","last_became_peered":"2023-11-04T01:35:56.095763+0000","last_unstale":"2023-11-04T01:35:57.017951+0000","last_undegraded":"2023-11-04T01:35:57.017951+0000","last_fullsized":"2023-11-04T01:35:57.017951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:47.638273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083789+0000","last_change":"2023-11-04T01:35:52.033716+0000","last_active":"2023-11-04T01:35:56.083789+0000","last_peered":"2023-11-04T01:35:56.083789+0000","last_clean":"2023-11-04T01:35:56.083789+0000","last_became_active":"2023-11-04T01:35:52.033366+0000","last_became_peered":"2023-11-04T01:35:52.033366+0000","last_unstale":"2023-11-04T01:35:56.083789+0000","last_undegraded":"2023-11-04T01:35:56.083789+0000","last_fullsized":"2023-11-04T01:35:56.083789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092435+0000","last_change":"2023-11-04T01:35:51.061737+0000","last_active":"2023-11-04T01:35:56.092435+0000","last_peered":"2023-11-04T01:35:56.092435+0000","last_clean":"2023-11-04T01:35:56.092435+0000","last_became_active":"2023-11-04T01:35:51.061470+0000","last_became_peered":"2023-11-04T01:35:51.061470+0000","last_unstale":"2023-11-04T01:35:56.092435+0000","last_undegraded":"2023-11-04T01:35:56.092435+0000","last_fullsized":"2023-11-04T01:35:56.092435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:33.994258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018337+0000","last_change":"2023-11-04T01:35:56.127670+0000","last_active":"2023-11-04T01:35:57.018337+0000","last_peered":"2023-11-04T01:35:57.018337+0000","last_clean":"2023-11-04T01:35:57.018337+0000","last_became_active":"2023-11-04T01:35:56.127256+0000","last_became_peered":"2023-11-04T01:35:56.127256+0000","last_unstale":"2023-11-04T01:35:57.018337+0000","last_undegraded":"2023-11-04T01:35:57.018337+0000","last_fullsized":"2023-11-04T01:35:57.018337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:16.877043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010009+0000","last_change":"2023-11-04T01:35:56.125573+0000","last_active":"2023-11-04T01:35:57.010009+0000","last_peered":"2023-11-04T01:35:57.010009+0000","last_clean":"2023-11-04T01:35:57.010009+0000","last_became_active":"2023-11-04T01:35:56.125207+0000","last_became_peered":"2023-11-04T01:35:56.125207+0000","last_unstale":"2023-11-04T01:35:57.010009+0000","last_undegraded":"2023-11-04T01:35:57.010009+0000","last_fullsized":"2023-11-04T01:35:57.010009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:44.415859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076102+0000","last_change":"2023-11-04T01:35:52.023725+0000","last_active":"2023-11-04T01:35:56.076102+0000","last_peered":"2023-11-04T01:35:56.076102+0000","last_clean":"2023-11-04T01:35:56.076102+0000","last_became_active":"2023-11-04T01:35:52.023469+0000","last_became_peered":"2023-11-04T01:35:52.023469+0000","last_unstale":"2023-11-04T01:35:56.076102+0000","last_undegraded":"2023-11-04T01:35:56.076102+0000","last_fullsized":"2023-11-04T01:35:56.076102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082991+0000","last_change":"2023-11-04T01:35:51.059113+0000","last_active":"2023-11-04T01:35:56.082991+0000","last_peered":"2023-11-04T01:35:56.082991+0000","last_clean":"2023-11-04T01:35:56.082991+0000","last_became_active":"2023-11-04T01:35:51.058837+0000","last_became_peered":"2023-11-04T01:35:51.058837+0000","last_unstale":"2023-11-04T01:35:56.082991+0000","last_undegraded":"2023-11-04T01:35:56.082991+0000","last_fullsized":"2023-11-04T01:35:56.082991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:03.193221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010915+0000","last_change":"2023-11-04T01:35:56.102617+0000","last_active":"2023-11-04T01:35:57.010915+0000","last_peered":"2023-11-04T01:35:57.010915+0000","last_clean":"2023-11-04T01:35:57.010915+0000","last_became_active":"2023-11-04T01:35:56.102162+0000","last_became_peered":"2023-11-04T01:35:56.102162+0000","last_unstale":"2023-11-04T01:35:57.010915+0000","last_undegraded":"2023-11-04T01:35:57.010915+0000","last_fullsized":"2023-11-04T01:35:57.010915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:57.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086285+0000","last_change":"2023-11-04T01:35:52.031363+0000","last_active":"2023-11-04T01:35:56.086285+0000","last_peered":"2023-11-04T01:35:56.086285+0000","last_clean":"2023-11-04T01:35:56.086285+0000","last_became_active":"2023-11-04T01:35:52.031088+0000","last_became_peered":"2023-11-04T01:35:52.031088+0000","last_unstale":"2023-11-04T01:35:56.086285+0000","last_undegraded":"2023-11-04T01:35:56.086285+0000","last_fullsized":"2023-11-04T01:35:56.086285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:19.846758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085566+0000","last_change":"2023-11-04T01:35:51.065071+0000","last_active":"2023-11-04T01:35:56.085566+0000","last_peered":"2023-11-04T01:35:56.085566+0000","last_clean":"2023-11-04T01:35:56.085566+0000","last_became_active":"2023-11-04T01:35:51.064790+0000","last_became_peered":"2023-11-04T01:35:51.064790+0000","last_unstale":"2023-11-04T01:35:56.085566+0000","last_undegraded":"2023-11-04T01:35:56.085566+0000","last_fullsized":"2023-11-04T01:35:56.085566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:13.226997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090769+0000","last_change":"2023-11-04T01:35:51.057559+0000","last_active":"2023-11-04T01:35:56.090769+0000","last_peered":"2023-11-04T01:35:56.090769+0000","last_clean":"2023-11-04T01:35:56.090769+0000","last_became_active":"2023-11-04T01:35:51.056993+0000","last_became_peered":"2023-11-04T01:35:51.056993+0000","last_unstale":"2023-11-04T01:35:56.090769+0000","last_undegraded":"2023-11-04T01:35:56.090769+0000","last_fullsized":"2023-11-04T01:35:56.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:35.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082667+0000","last_change":"2023-11-04T01:35:52.022126+0000","last_active":"2023-11-04T01:35:56.082667+0000","last_peered":"2023-11-04T01:35:56.082667+0000","last_clean":"2023-11-04T01:35:56.082667+0000","last_became_active":"2023-11-04T01:35:52.021875+0000","last_became_peered":"2023-11-04T01:35:52.021875+0000","last_unstale":"2023-11-04T01:35:56.082667+0000","last_undegraded":"2023-11-04T01:35:56.082667+0000","last_fullsized":"2023-11-04T01:35:56.082667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.010633+0000","last_change":"2023-11-04T01:35:56.099022+0000","last_active":"2023-11-04T01:35:57.010633+0000","last_peered":"2023-11-04T01:35:57.010633+0000","last_clean":"2023-11-04T01:35:57.010633+0000","last_became_active":"2023-11-04T01:35:56.098634+0000","last_became_peered":"2023-11-04T01:35:56.098634+0000","last_unstale":"2023-11-04T01:35:57.010633+0000","last_undegraded":"2023-11-04T01:35:57.010633+0000","last_fullsized":"2023-11-04T01:35:57.010633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:18.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086027+0000","last_change":"2023-11-04T01:35:51.061727+0000","last_active":"2023-11-04T01:35:56.086027+0000","last_peered":"2023-11-04T01:35:56.086027+0000","last_clean":"2023-11-04T01:35:56.086027+0000","last_became_active":"2023-11-04T01:35:51.061215+0000","last_became_peered":"2023-11-04T01:35:51.061215+0000","last_unstale":"2023-11-04T01:35:56.086027+0000","last_undegraded":"2023-11-04T01:35:56.086027+0000","last_fullsized":"2023-11-04T01:35:56.086027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:50.033951+0000","last_clean_scrub_stamp":"2023-11-04T01:35:50.033951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:33.124437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090923+0000","last_change":"2023-11-04T01:35:52.020181+0000","last_active":"2023-11-04T01:35:56.090923+0000","last_peered":"2023-11-04T01:35:56.090923+0000","last_clean":"2023-11-04T01:35:56.090923+0000","last_became_active":"2023-11-04T01:35:52.019904+0000","last_became_peered":"2023-11-04T01:35:52.019904+0000","last_unstale":"2023-11-04T01:35:56.090923+0000","last_undegraded":"2023-11-04T01:35:56.090923+0000","last_fullsized":"2023-11-04T01:35:56.090923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:35:57.018207+0000","last_change":"2023-11-04T01:35:56.096018+0000","last_active":"2023-11-04T01:35:57.018207+0000","last_peered":"2023-11-04T01:35:57.018207+0000","last_clean":"2023-11-04T01:35:57.018207+0000","last_became_active":"2023-11-04T01:35:56.094855+0000","last_became_peered":"2023-11-04T01:35:56.094855+0000","last_unstale":"2023-11-04T01:35:57.018207+0000","last_undegraded":"2023-11-04T01:35:57.018207+0000","last_fullsized":"2023-11-04T01:35:57.018207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:55.068869+0000","last_clean_scrub_stamp":"2023-11-04T01:35:55.068869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:11.437390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090519+0000","last_change":"2023-11-04T01:35:52.031578+0000","last_active":"2023-11-04T01:35:56.090519+0000","last_peered":"2023-11-04T01:35:56.090519+0000","last_clean":"2023-11-04T01:35:56.090519+0000","last_became_active":"2023-11-04T01:35:52.031324+0000","last_became_peered":"2023-11-04T01:35:52.031324+0000","last_unstale":"2023-11-04T01:35:56.090519+0000","last_undegraded":"2023-11-04T01:35:56.090519+0000","last_fullsized":"2023-11-04T01:35:56.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090127+0000","last_change":"2023-11-04T01:35:52.021615+0000","last_active":"2023-11-04T01:35:56.090127+0000","last_peered":"2023-11-04T01:35:56.090127+0000","last_clean":"2023-11-04T01:35:56.090127+0000","last_became_active":"2023-11-04T01:35:52.021344+0000","last_became_peered":"2023-11-04T01:35:52.021344+0000","last_unstale":"2023-11-04T01:35:56.090127+0000","last_undegraded":"2023-11-04T01:35:56.090127+0000","last_fullsized":"2023-11-04T01:35:56.090127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:20.277845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083431+0000","last_change":"2023-11-04T01:35:52.027223+0000","last_active":"2023-11-04T01:35:56.083431+0000","last_peered":"2023-11-04T01:35:56.083431+0000","last_clean":"2023-11-04T01:35:56.083431+0000","last_became_active":"2023-11-04T01:35:52.026929+0000","last_became_peered":"2023-11-04T01:35:52.026929+0000","last_unstale":"2023-11-04T01:35:56.083431+0000","last_undegraded":"2023-11-04T01:35:56.083431+0000","last_fullsized":"2023-11-04T01:35:56.083431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:53.868301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082587+0000","last_change":"2023-11-04T01:35:52.023823+0000","last_active":"2023-11-04T01:35:56.082587+0000","last_peered":"2023-11-04T01:35:56.082587+0000","last_clean":"2023-11-04T01:35:56.082587+0000","last_became_active":"2023-11-04T01:35:52.023555+0000","last_became_peered":"2023-11-04T01:35:52.023555+0000","last_unstale":"2023-11-04T01:35:56.082587+0000","last_undegraded":"2023-11-04T01:35:56.082587+0000","last_fullsized":"2023-11-04T01:35:56.082587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086368+0000","last_change":"2023-11-04T01:35:52.023538+0000","last_active":"2023-11-04T01:35:56.086368+0000","last_peered":"2023-11-04T01:35:56.086368+0000","last_clean":"2023-11-04T01:35:56.086368+0000","last_became_active":"2023-11-04T01:35:52.023231+0000","last_became_peered":"2023-11-04T01:35:52.023231+0000","last_unstale":"2023-11-04T01:35:56.086368+0000","last_undegraded":"2023-11-04T01:35:56.086368+0000","last_fullsized":"2023-11-04T01:35:56.086368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076403+0000","last_change":"2023-11-04T01:35:52.020500+0000","last_active":"2023-11-04T01:35:56.076403+0000","last_peered":"2023-11-04T01:35:56.076403+0000","last_clean":"2023-11-04T01:35:56.076403+0000","last_became_active":"2023-11-04T01:35:52.020215+0000","last_became_peered":"2023-11-04T01:35:52.020215+0000","last_unstale":"2023-11-04T01:35:56.076403+0000","last_undegraded":"2023-11-04T01:35:56.076403+0000","last_fullsized":"2023-11-04T01:35:56.076403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092296+0000","last_change":"2023-11-04T01:35:52.032684+0000","last_active":"2023-11-04T01:35:56.092296+0000","last_peered":"2023-11-04T01:35:56.092296+0000","last_clean":"2023-11-04T01:35:56.092296+0000","last_became_active":"2023-11-04T01:35:52.032419+0000","last_became_peered":"2023-11-04T01:35:52.032419+0000","last_unstale":"2023-11-04T01:35:56.092296+0000","last_undegraded":"2023-11-04T01:35:56.092296+0000","last_fullsized":"2023-11-04T01:35:56.092296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:44.140887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086117+0000","last_change":"2023-11-04T01:35:52.022740+0000","last_active":"2023-11-04T01:35:56.086117+0000","last_peered":"2023-11-04T01:35:56.086117+0000","last_clean":"2023-11-04T01:35:56.086117+0000","last_became_active":"2023-11-04T01:35:52.022487+0000","last_became_peered":"2023-11-04T01:35:52.022487+0000","last_unstale":"2023-11-04T01:35:56.086117+0000","last_undegraded":"2023-11-04T01:35:56.086117+0000","last_fullsized":"2023-11-04T01:35:56.086117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082907+0000","last_change":"2023-11-04T01:35:52.026431+0000","last_active":"2023-11-04T01:35:56.082907+0000","last_peered":"2023-11-04T01:35:56.082907+0000","last_clean":"2023-11-04T01:35:56.082907+0000","last_became_active":"2023-11-04T01:35:52.025267+0000","last_became_peered":"2023-11-04T01:35:52.025267+0000","last_unstale":"2023-11-04T01:35:56.082907+0000","last_undegraded":"2023-11-04T01:35:56.082907+0000","last_fullsized":"2023-11-04T01:35:56.082907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:22.357315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085429+0000","last_change":"2023-11-04T01:35:52.025059+0000","last_active":"2023-11-04T01:35:56.085429+0000","last_peered":"2023-11-04T01:35:56.085429+0000","last_clean":"2023-11-04T01:35:56.085429+0000","last_became_active":"2023-11-04T01:35:52.024772+0000","last_became_peered":"2023-11-04T01:35:52.024772+0000","last_unstale":"2023-11-04T01:35:56.085429+0000","last_undegraded":"2023-11-04T01:35:56.085429+0000","last_fullsized":"2023-11-04T01:35:56.085429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083117+0000","last_change":"2023-11-04T01:35:52.033100+0000","last_active":"2023-11-04T01:35:56.083117+0000","last_peered":"2023-11-04T01:35:56.083117+0000","last_clean":"2023-11-04T01:35:56.083117+0000","last_became_active":"2023-11-04T01:35:52.032826+0000","last_became_peered":"2023-11-04T01:35:52.032826+0000","last_unstale":"2023-11-04T01:35:56.083117+0000","last_undegraded":"2023-11-04T01:35:56.083117+0000","last_fullsized":"2023-11-04T01:35:56.083117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:31.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082484+0000","last_change":"2023-11-04T01:35:52.024693+0000","last_active":"2023-11-04T01:35:56.082484+0000","last_peered":"2023-11-04T01:35:56.082484+0000","last_clean":"2023-11-04T01:35:56.082484+0000","last_became_active":"2023-11-04T01:35:52.024003+0000","last_became_peered":"2023-11-04T01:35:52.024003+0000","last_unstale":"2023-11-04T01:35:56.082484+0000","last_undegraded":"2023-11-04T01:35:56.082484+0000","last_fullsized":"2023-11-04T01:35:56.082484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091592+0000","last_change":"2023-11-04T01:35:52.025240+0000","last_active":"2023-11-04T01:35:56.091592+0000","last_peered":"2023-11-04T01:35:56.091592+0000","last_clean":"2023-11-04T01:35:56.091592+0000","last_became_active":"2023-11-04T01:35:52.024964+0000","last_became_peered":"2023-11-04T01:35:52.024964+0000","last_unstale":"2023-11-04T01:35:56.091592+0000","last_undegraded":"2023-11-04T01:35:56.091592+0000","last_fullsized":"2023-11-04T01:35:56.091592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:53.011483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124893+0000","last_change":"2023-11-04T01:35:52.032089+0000","last_active":"2023-11-04T01:35:56.124893+0000","last_peered":"2023-11-04T01:35:56.124893+0000","last_clean":"2023-11-04T01:35:56.124893+0000","last_became_active":"2023-11-04T01:35:52.030222+0000","last_became_peered":"2023-11-04T01:35:52.030222+0000","last_unstale":"2023-11-04T01:35:56.124893+0000","last_undegraded":"2023-11-04T01:35:56.124893+0000","last_fullsized":"2023-11-04T01:35:56.124893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:40.386065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090324+0000","last_change":"2023-11-04T01:35:52.027792+0000","last_active":"2023-11-04T01:35:56.090324+0000","last_peered":"2023-11-04T01:35:56.090324+0000","last_clean":"2023-11-04T01:35:56.090324+0000","last_became_active":"2023-11-04T01:35:52.027473+0000","last_became_peered":"2023-11-04T01:35:52.027473+0000","last_unstale":"2023-11-04T01:35:56.090324+0000","last_undegraded":"2023-11-04T01:35:56.090324+0000","last_fullsized":"2023-11-04T01:35:56.090324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:34.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.084262+0000","last_change":"2023-11-04T01:35:52.034363+0000","last_active":"2023-11-04T01:35:56.084262+0000","last_peered":"2023-11-04T01:35:56.084262+0000","last_clean":"2023-11-04T01:35:56.084262+0000","last_became_active":"2023-11-04T01:35:52.034096+0000","last_became_peered":"2023-11-04T01:35:52.034096+0000","last_unstale":"2023-11-04T01:35:56.084262+0000","last_undegraded":"2023-11-04T01:35:56.084262+0000","last_fullsized":"2023-11-04T01:35:56.084262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:12.128881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082886+0000","last_change":"2023-11-04T01:35:52.033024+0000","last_active":"2023-11-04T01:35:56.082886+0000","last_peered":"2023-11-04T01:35:56.082886+0000","last_clean":"2023-11-04T01:35:56.082886+0000","last_became_active":"2023-11-04T01:35:52.032614+0000","last_became_peered":"2023-11-04T01:35:52.032614+0000","last_unstale":"2023-11-04T01:35:56.082886+0000","last_undegraded":"2023-11-04T01:35:56.082886+0000","last_fullsized":"2023-11-04T01:35:56.082886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076111+0000","last_change":"2023-11-04T01:35:52.021303+0000","last_active":"2023-11-04T01:35:56.076111+0000","last_peered":"2023-11-04T01:35:56.076111+0000","last_clean":"2023-11-04T01:35:56.076111+0000","last_became_active":"2023-11-04T01:35:52.021044+0000","last_became_peered":"2023-11-04T01:35:52.021044+0000","last_unstale":"2023-11-04T01:35:56.076111+0000","last_undegraded":"2023-11-04T01:35:56.076111+0000","last_fullsized":"2023-11-04T01:35:56.076111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.304353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082084+0000","last_change":"2023-11-04T01:35:52.016825+0000","last_active":"2023-11-04T01:35:56.082084+0000","last_peered":"2023-11-04T01:35:56.082084+0000","last_clean":"2023-11-04T01:35:56.082084+0000","last_became_active":"2023-11-04T01:35:52.016549+0000","last_became_peered":"2023-11-04T01:35:52.016549+0000","last_unstale":"2023-11-04T01:35:56.082084+0000","last_undegraded":"2023-11-04T01:35:56.082084+0000","last_fullsized":"2023-11-04T01:35:56.082084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:08:52.005309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.085869+0000","last_change":"2023-11-04T01:35:52.027711+0000","last_active":"2023-11-04T01:35:56.085869+0000","last_peered":"2023-11-04T01:35:56.085869+0000","last_clean":"2023-11-04T01:35:56.085869+0000","last_became_active":"2023-11-04T01:35:52.027452+0000","last_became_peered":"2023-11-04T01:35:52.027452+0000","last_unstale":"2023-11-04T01:35:56.085869+0000","last_undegraded":"2023-11-04T01:35:56.085869+0000","last_fullsized":"2023-11-04T01:35:56.085869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.090100+0000","last_change":"2023-11-04T01:35:52.026105+0000","last_active":"2023-11-04T01:35:56.090100+0000","last_peered":"2023-11-04T01:35:56.090100+0000","last_clean":"2023-11-04T01:35:56.090100+0000","last_became_active":"2023-11-04T01:35:52.025848+0000","last_became_peered":"2023-11-04T01:35:52.025848+0000","last_unstale":"2023-11-04T01:35:56.090100+0000","last_undegraded":"2023-11-04T01:35:56.090100+0000","last_fullsized":"2023-11-04T01:35:56.090100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:57.470566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.091791+0000","last_change":"2023-11-04T01:35:52.028295+0000","last_active":"2023-11-04T01:35:56.091791+0000","last_peered":"2023-11-04T01:35:56.091791+0000","last_clean":"2023-11-04T01:35:56.091791+0000","last_became_active":"2023-11-04T01:35:52.027999+0000","last_became_peered":"2023-11-04T01:35:52.027999+0000","last_unstale":"2023-11-04T01:35:56.091791+0000","last_undegraded":"2023-11-04T01:35:56.091791+0000","last_fullsized":"2023-11-04T01:35:56.091791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.092276+0000","last_change":"2023-11-04T01:35:52.034087+0000","last_active":"2023-11-04T01:35:56.092276+0000","last_peered":"2023-11-04T01:35:56.092276+0000","last_clean":"2023-11-04T01:35:56.092276+0000","last_became_active":"2023-11-04T01:35:52.033825+0000","last_became_peered":"2023-11-04T01:35:52.033825+0000","last_unstale":"2023-11-04T01:35:56.092276+0000","last_undegraded":"2023-11-04T01:35:56.092276+0000","last_fullsized":"2023-11-04T01:35:56.092276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124669+0000","last_change":"2023-11-04T01:35:52.032966+0000","last_active":"2023-11-04T01:35:56.124669+0000","last_peered":"2023-11-04T01:35:56.124669+0000","last_clean":"2023-11-04T01:35:56.124669+0000","last_became_active":"2023-11-04T01:35:52.032247+0000","last_became_peered":"2023-11-04T01:35:52.032247+0000","last_unstale":"2023-11-04T01:35:56.124669+0000","last_undegraded":"2023-11-04T01:35:56.124669+0000","last_fullsized":"2023-11-04T01:35:56.124669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:18.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.086247+0000","last_change":"2023-11-04T01:35:52.027992+0000","last_active":"2023-11-04T01:35:56.086247+0000","last_peered":"2023-11-04T01:35:56.086247+0000","last_clean":"2023-11-04T01:35:56.086247+0000","last_became_active":"2023-11-04T01:35:52.027698+0000","last_became_peered":"2023-11-04T01:35:52.027698+0000","last_unstale":"2023-11-04T01:35:56.086247+0000","last_undegraded":"2023-11-04T01:35:56.086247+0000","last_fullsized":"2023-11-04T01:35:56.086247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:04.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123016+0000","last_change":"2023-11-04T01:35:52.028491+0000","last_active":"2023-11-04T01:35:56.123016+0000","last_peered":"2023-11-04T01:35:56.123016+0000","last_clean":"2023-11-04T01:35:56.123016+0000","last_became_active":"2023-11-04T01:35:52.027844+0000","last_became_peered":"2023-11-04T01:35:52.027844+0000","last_unstale":"2023-11-04T01:35:56.123016+0000","last_undegraded":"2023-11-04T01:35:56.123016+0000","last_fullsized":"2023-11-04T01:35:56.123016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083120+0000","last_change":"2023-11-04T01:35:52.032551+0000","last_active":"2023-11-04T01:35:56.083120+0000","last_peered":"2023-11-04T01:35:56.083120+0000","last_clean":"2023-11-04T01:35:56.083120+0000","last_became_active":"2023-11-04T01:35:52.032243+0000","last_became_peered":"2023-11-04T01:35:52.032243+0000","last_unstale":"2023-11-04T01:35:56.083120+0000","last_undegraded":"2023-11-04T01:35:56.083120+0000","last_fullsized":"2023-11-04T01:35:56.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:37.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.123005+0000","last_change":"2023-11-04T01:35:52.029489+0000","last_active":"2023-11-04T01:35:56.123005+0000","last_peered":"2023-11-04T01:35:56.123005+0000","last_clean":"2023-11-04T01:35:56.123005+0000","last_became_active":"2023-11-04T01:35:52.027332+0000","last_became_peered":"2023-11-04T01:35:52.027332+0000","last_unstale":"2023-11-04T01:35:56.123005+0000","last_undegraded":"2023-11-04T01:35:56.123005+0000","last_fullsized":"2023-11-04T01:35:56.123005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.083593+0000","last_change":"2023-11-04T01:35:52.028505+0000","last_active":"2023-11-04T01:35:56.083593+0000","last_peered":"2023-11-04T01:35:56.083593+0000","last_clean":"2023-11-04T01:35:56.083593+0000","last_became_active":"2023-11-04T01:35:52.027029+0000","last_became_peered":"2023-11-04T01:35:52.027029+0000","last_unstale":"2023-11-04T01:35:56.083593+0000","last_undegraded":"2023-11-04T01:35:56.083593+0000","last_fullsized":"2023-11-04T01:35:56.083593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:50.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.082243+0000","last_change":"2023-11-04T01:35:52.021387+0000","last_active":"2023-11-04T01:35:56.082243+0000","last_peered":"2023-11-04T01:35:56.082243+0000","last_clean":"2023-11-04T01:35:56.082243+0000","last_became_active":"2023-11-04T01:35:52.021111+0000","last_became_peered":"2023-11-04T01:35:52.021111+0000","last_unstale":"2023-11-04T01:35:56.082243+0000","last_undegraded":"2023-11-04T01:35:56.082243+0000","last_fullsized":"2023-11-04T01:35:56.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:05.972756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.076467+0000","last_change":"2023-11-04T01:35:52.014538+0000","last_active":"2023-11-04T01:35:56.076467+0000","last_peered":"2023-11-04T01:35:56.076467+0000","last_clean":"2023-11-04T01:35:56.076467+0000","last_became_active":"2023-11-04T01:35:52.014284+0000","last_became_peered":"2023-11-04T01:35:52.014284+0000","last_unstale":"2023-11-04T01:35:56.076467+0000","last_undegraded":"2023-11-04T01:35:56.076467+0000","last_fullsized":"2023-11-04T01:35:56.076467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:08.901841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:35:56.124311+0000","last_change":"2023-11-04T01:35:52.028638+0000","last_active":"2023-11-04T01:35:56.124311+0000","last_peered":"2023-11-04T01:35:56.124311+0000","last_clean":"2023-11-04T01:35:56.124311+0000","last_became_active":"2023-11-04T01:35:52.028172+0000","last_became_peered":"2023-11-04T01:35:52.028172+0000","last_unstale":"2023-11-04T01:35:56.124311+0000","last_undegraded":"2023-11-04T01:35:56.124311+0000","last_fullsized":"2023-11-04T01:35:56.124311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:51.039075+0000","last_clean_scrub_stamp":"2023-11-04T01:35:51.039075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:55.638609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":102615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:16.321 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:36:16.321 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:36:16.321 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:36:16.321 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:36:16.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.459+0000 7fe6f0056640 1 Processor -- start 2023-11-04T01:36:16.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.459+0000 7fe6f0056640 1 -- start start 2023-11-04T01:36:16.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6f0056640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6e815bfb0 0x7fe6e80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6f0056640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe6e80cd860 0x7fe6e80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6f0056640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80cc450 con 0x7fe6e815ae40 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6f0056640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e815f400 con 0x7fe6e80cd860 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6f0056640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e815b220 con 0x7fe6e815bfb0 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe6e80cd860 0x7fe6e80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe6e80cd860 0x7fe6e80ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48566/0 (socket says 172.21.15.93:48566) 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 -- 172.21.15.93:0/2677362010 learned_addr learned my addr 172.21.15.93:0/2677362010 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 -- 172.21.15.93:0/2677362010 >> v2:172.21.15.125:3300/0 conn(0x7fe6e815bfb0 msgr2=0x7fe6e80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ed5f1640 1 --2- 172.21.15.93:0/2677362010 >> v2:172.21.15.125:3300/0 conn(0x7fe6e815bfb0 0x7fe6e80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 --2- 172.21.15.93:0/2677362010 >> v2:172.21.15.125:3300/0 conn(0x7fe6e815bfb0 0x7fe6e80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 -- 172.21.15.93:0/2677362010 >> v1:172.21.15.125:6789/0 conn(0x7fe6e815ae40 legacy=0x7fe6e80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.460+0000 7fe6ee5f3640 1 -- 172.21.15.93:0/2677362010 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e815f890 con 0x7fe6e80cd860 2023-11-04T01:36:16.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.461+0000 7fe6ee5f3640 1 --2- 172.21.15.93:0/2677362010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e80ced70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80b05d0 tx=0x7fe6e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a256405b114246 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.461+0000 7fe6ecdf0640 1 -- 172.21.15.93:0/2677362010 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e002ca80 con 0x7fe6e80cd860 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.461+0000 7fe6ecdf0640 1 -- 172.21.15.93:0/2677362010 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e002cbe0 con 0x7fe6e80cd860 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.461+0000 7fe6ecdf0640 1 -- 172.21.15.93:0/2677362010 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00343f0 con 0x7fe6e80cd860 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 -- 172.21.15.93:0/2677362010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 msgr2=0x7fe6e80ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 --2- 172.21.15.93:0/2677362010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e80ced70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80b05d0 tx=0x7fe6e002bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 -- 172.21.15.93:0/2677362010 shutdown_connections 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 --2- 172.21.15.93:0/2677362010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e80ced70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 --2- 172.21.15.93:0/2677362010 >> v2:172.21.15.125:3300/0 conn(0x7fe6e815bfb0 0x7fe6e80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 -- 172.21.15.93:0/2677362010 >> 172.21.15.93:0/2677362010 conn(0x7fe6e806ea90 msgr2=0x7fe6e806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 -- 172.21.15.93:0/2677362010 shutdown_connections 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.462+0000 7fe6f0056640 1 -- 172.21.15.93:0/2677362010 wait complete. 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.463+0000 7fe6f0056640 1 Processor -- start 2023-11-04T01:36:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.463+0000 7fe6f0056640 1 -- start start 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e815ae40 0x7fe6e80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 0x7fe6e81e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c9430 con 0x7fe6e80cd860 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c8820 con 0x7fe6e815bfb0 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6f0056640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c8b00 con 0x7fe6e815ae40 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48572/0 (socket says 172.21.15.93:48572) 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 -- 172.21.15.93:0/1953253460 learned_addr learned my addr 172.21.15.93:0/1953253460 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:16.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6ee5f3640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 0x7fe6e81e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6ed5f1640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e815ae40 0x7fe6e80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 -- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e815ae40 msgr2=0x7fe6e80ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e815ae40 0x7fe6e80ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 -- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 msgr2=0x7fe6e81e6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 0x7fe6e81e6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 -- 172.21.15.93:0/1953253460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009b30 con 0x7fe6e80cd860 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6ee5f3640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 0x7fe6e81e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6eddf2640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c410 tx=0x7fe6e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.464+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40035f0 con 0x7fe6e80cd860 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.465+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4003750 con 0x7fe6e80cd860 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.465+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4003b40 con 0x7fe6e80cd860 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.465+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80c8de0 con 0x7fe6e80cd860 2023-11-04T01:36:16.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.465+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e80ca630 con 0x7fe6e80cd860 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.465+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e80ce2d0 con 0x7fe6e80cd860 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.466+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6e4003ca0 con 0x7fe6e80cd860 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.466+0000 7fe6de7fc640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 0x7fe6cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.466+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6e4088b00 con 0x7fe6e80cd860 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.466+0000 7fe6ed5f1640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 0x7fe6cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.467+0000 7fe6ed5f1640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 0x7fe6cc06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8006fd0 tx=0x7fe6d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.471+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6e40538c0 con 0x7fe6e80cd860 2023-11-04T01:36:16.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.675+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe6e8074290 con 0x7fe6e80cd860 2023-11-04T01:36:16.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.675+0000 7fe6de7fc640 1 -- 172.21.15.93:0/1953253460 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe6e4056ee0 con 0x7fe6e80cd860 2023-11-04T01:36:16.676 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:16.676 INFO:teuthology.orchestra.run.smithi093.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 msgr2=0x7fe6cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 0x7fe6cc06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8006fd0 tx=0x7fe6d8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 msgr2=0x7fe6e814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c410 tx=0x7fe6e400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 shutdown_connections 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6cc06ae70 0x7fe6cc06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6e815bfb0 0x7fe6e81e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6e815ae40 0x7fe6e80ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 --2- 172.21.15.93:0/1953253460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6e80cd860 0x7fe6e814e660 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 >> 172.21.15.93:0/1953253460 conn(0x7fe6e806ea90 msgr2=0x7fe6e80b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 shutdown_connections 2023-11-04T01:36:16.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.677+0000 7fe6f0056640 1 -- 172.21.15.93:0/1953253460 wait complete. 2023-11-04T01:36:16.689 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:36:16.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:16.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.787+0000 7fb0e1d65640 1 Processor -- start 2023-11-04T01:36:16.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.787+0000 7fb0e1d65640 1 -- start start 2023-11-04T01:36:16.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0e1d65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0e1d65640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb0dc0cd860 0x7fb0dc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0e1d65640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0cc450 con 0x7fb0dc15ae40 2023-11-04T01:36:16.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0e1d65640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc15f400 con 0x7fb0dc0cd860 2023-11-04T01:36:16.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0e1d65640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc15b220 con 0x7fb0dc15bfb0 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0db7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb0dc15ae40 0x7fb0dc0cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54436/0 (socket says 172.21.15.93:54436) 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0dbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb0dc0cd860 0x7fb0dc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.788+0000 7fb0db7fe640 1 -- 172.21.15.93:0/1150130360 learned_addr learned my addr 172.21.15.93:0/1150130360 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0daffd640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0dbfff640 1 -- 172.21.15.93:0/1150130360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 msgr2=0x7fb0dc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0dbfff640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0dbfff640 1 -- 172.21.15.93:0/1150130360 >> v1:172.21.15.93:6789/0 conn(0x7fb0dc15ae40 legacy=0x7fb0dc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0dbfff640 1 -- 172.21.15.93:0/1150130360 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc15f890 con 0x7fb0dc0cd860 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0dbfff640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc0ced70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2afa4dd682572f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0da7fc640 1 -- 172.21.15.93:0/1150130360 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d402cc50 con 0x7fb0dc0cd860 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0da7fc640 1 -- 172.21.15.93:0/1150130360 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d402cdb0 con 0x7fb0dc0cd860 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.789+0000 7fb0da7fc640 1 -- 172.21.15.93:0/1150130360 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4034660 con 0x7fb0dc0cd860 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 -- 172.21.15.93:0/1150130360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 msgr2=0x7fb0dc0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc0ced70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 -- 172.21.15.93:0/1150130360 shutdown_connections 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc0ced70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/1150130360 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 -- 172.21.15.93:0/1150130360 >> 172.21.15.93:0/1150130360 conn(0x7fb0dc06ea90 msgr2=0x7fb0dc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 -- 172.21.15.93:0/1150130360 shutdown_connections 2023-11-04T01:36:16.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.790+0000 7fb0e1d65640 1 -- 172.21.15.93:0/1150130360 wait complete. 2023-11-04T01:36:16.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.791+0000 7fb0e1d65640 1 Processor -- start 2023-11-04T01:36:16.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.791+0000 7fb0e1d65640 1 -- start start 2023-11-04T01:36:16.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 0x7fb0dc0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0c5870 con 0x7fb0dc0cd860 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0c5b50 con 0x7fb0dc15ae40 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0e1d65640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0c5e30 con 0x7fb0dc15bfb0 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48590/0 (socket says 172.21.15.93:48590) 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 -- 172.21.15.93:0/3603555597 learned_addr learned my addr 172.21.15.93:0/3603555597 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0dbfff640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0daffd640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 0x7fb0dc0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 -- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 msgr2=0x7fb0dc0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 -- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 msgr2=0x7fb0dc0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 0x7fb0dc0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0db7fe640 1 -- 172.21.15.93:0/3603555597 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4009a70 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.792+0000 7fb0daffd640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 0x7fb0dc0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0db7fe640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c4a0 tx=0x7fb0cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005ce0 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc005e40 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc0c6110 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc007270 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.793+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc0ca6d0 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.794+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc0ce2d0 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.794+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0cc007490 con 0x7fb0dc0cd860 2023-11-04T01:36:16.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.794+0000 7fb0c3fff640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 0x7fb0c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.794+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0cc088b10 con 0x7fb0dc0cd860 2023-11-04T01:36:16.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.794+0000 7fb0daffd640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 0x7fb0c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.795+0000 7fb0daffd640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 0x7fb0c806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0c76b0 tx=0x7fb0d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.799+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0cc053a10 con 0x7fb0dc0cd860 2023-11-04T01:36:16.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.966+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0dc0cc450 con 0x7fb0dc0cd860 2023-11-04T01:36:16.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.967+0000 7fb0c3fff640 1 -- 172.21.15.93:0/3603555597 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fb0dc0cc450 con 0x7fb0dc0cd860 2023-11-04T01:36:16.971 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:16.971 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:16.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 msgr2=0x7fb0c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 0x7fb0c806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0c76b0 tx=0x7fb0d0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 msgr2=0x7fb0dc14f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c4a0 tx=0x7fb0cc00c960 comp rx=0 tx=0).stop 2023-11-04T01:36:16.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 shutdown_connections 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0c806ae70 0x7fb0c806d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb0dc15bfb0 0x7fb0dc0c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0dc15ae40 0x7fb0dc0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 --2- 172.21.15.93:0/3603555597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb0dc0cd860 0x7fb0dc14f290 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.969+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 >> 172.21.15.93:0/3603555597 conn(0x7fb0dc06ea90 msgr2=0x7fb0dc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.970+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 shutdown_connections 2023-11-04T01:36:16.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:16.970+0000 7fb0e1d65640 1 -- 172.21.15.93:0/3603555597 wait complete. 2023-11-04T01:36:16.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:16.982 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:17.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 Processor -- start 2023-11-04T01:36:17.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 -- start start 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71bc06a830 0x7f71bc0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71bc0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc0ca620 con 0x7f71bc15e1b0 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc06e7e0 con 0x7f71bc06a830 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.085+0000 7f71c08cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0cb060 con 0x7f71bc15e590 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f71bc15e1b0 0x7f71bc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54440/0 (socket says 172.21.15.93:54440) 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 -- 172.21.15.93:0/3168812240 learned_addr learned my addr 172.21.15.93:0/3168812240 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71bad9d640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71bc0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830978641 0 0) 0x7f71bc0ca620 con 0x7f71bc15e1b0 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a8003520 con 0x7f71bc15e1b0 2023-11-04T01:36:17.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b3fff640 1 --2- 172.21.15.93:0/3168812240 >> v2:172.21.15.125:3300/0 conn(0x7f71bc06a830 0x7f71bc0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169700842 0 0) 0x7f71a8003520 con 0x7f71bc15e1b0 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 msgr2=0x7f71bc0722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71bc0722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 >> v2:172.21.15.125:3300/0 conn(0x7f71bc06a830 msgr2=0x7f71bc0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 --2- 172.21.15.93:0/3168812240 >> v2:172.21.15.125:3300/0 conn(0x7f71bc06a830 0x7f71bc0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc0ca060 con 0x7f71bc15e1b0 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f71ac001670 con 0x7f71bc15e1b0 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 >> v1:172.21.15.93:6789/0 conn(0x7f71bc15e1b0 legacy=0x7f71bc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71a8003970 0x7f71a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71a8004d00 0x7f71a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc06e7e0 con 0x7f71a8003970 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0cb060 con 0x7f71a8004d00 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800b980 con 0x7f71bc15e590 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71a8003970 0x7f71a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71b3fff640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71bad9d640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71a8004d00 0x7f71a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 -- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 msgr2=0x7f71a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71bc15e590 0x7f71a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 -- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71a8004d00 msgr2=0x7f71a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71a8004d00 0x7f71a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.086+0000 7f71ba59c640 1 -- 172.21.15.93:0/3168812240 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8003520 con 0x7f71a8003970 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.087+0000 7f71ba59c640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71a8003970 0x7f71a8003d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c210 tx=0x7f71a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474107695f982f09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.087+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac02cb00 con 0x7f71a8003970 2023-11-04T01:36:17.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.087+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac02cc80 con 0x7f71a8003970 2023-11-04T01:36:17.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.087+0000 7f71b9d9b640 1 -- 172.21.15.93:0/3168812240 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0058d0 con 0x7f71a8003970 2023-11-04T01:36:17.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 -- 172.21.15.93:0/3168812240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71a8003970 msgr2=0x7f71a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 --2- 172.21.15.93:0/3168812240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71a8003970 0x7f71a8003d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c210 tx=0x7f71a80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71bad9d640 1 -- 172.21.15.93:0/3168812240 reap_dead start 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 -- 172.21.15.93:0/3168812240 shutdown_connections 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 -- 172.21.15.93:0/3168812240 >> 172.21.15.93:0/3168812240 conn(0x7f71bc06d800 msgr2=0x7f71bc06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 -- 172.21.15.93:0/3168812240 shutdown_connections 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.088+0000 7f71c08cf640 1 -- 172.21.15.93:0/3168812240 wait complete. 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.089+0000 7f71c08cf640 1 Processor -- start 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.089+0000 7f71c08cf640 1 -- start start 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 0x7f71bc0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71bc15a280 0x7f71bc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0acad0 con 0x7f71bc0acf60 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc150520 con 0x7f71bc15a280 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71c08cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0abec0 con 0x7f71a8003970 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48608/0 (socket says 172.21.15.93:48608) 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 -- 172.21.15.93:0/626050974 learned_addr learned my addr 172.21.15.93:0/626050974 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71ba59c640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 0x7f71bc0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71b3fff640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71bc15a280 0x7f71bc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 -- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 msgr2=0x7f71bc0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 0x7f71bc0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 -- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71bc15a280 msgr2=0x7f71bc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71bc15a280 0x7f71bc0c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71bad9d640 1 -- 172.21.15.93:0/626050974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc0ac1a0 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.090+0000 7f71ba59c640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 0x7f71bc0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71bad9d640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0b2910 tx=0x7f71b400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400e040 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400f040 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4003bf0 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc0ac480 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.091+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc0c9880 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.092+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc0b2d70 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.092+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71b4003d50 con 0x7f71bc0acf60 2023-11-04T01:36:17.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.092+0000 7f71b2ffd640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 0x7f719c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.093+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71b408a100 con 0x7f71bc0acf60 2023-11-04T01:36:17.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.093+0000 7f71ba59c640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 0x7f719c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.093+0000 7f71ba59c640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 0x7f719c06d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001eb0 tx=0x7f71ac037040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.097+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71b40589e0 con 0x7f71bc0acf60 2023-11-04T01:36:17.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.263+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71bc0674e0 con 0x7f71bc0acf60 2023-11-04T01:36:17.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.264+0000 7f71b2ffd640 1 -- 172.21.15.93:0/626050974 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71b4058570 con 0x7f71bc0acf60 2023-11-04T01:36:17.265 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 msgr2=0x7f719c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 0x7f719c06d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001eb0 tx=0x7f71ac037040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 msgr2=0x7f71bc0ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0b2910 tx=0x7f71b400f580 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 shutdown_connections 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f719c06aea0 0x7f719c06d360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71bc0acf60 0x7f71bc0ad3e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71bc15a280 0x7f71bc0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 --2- 172.21.15.93:0/626050974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f71a8003970 0x7f71bc0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 >> 172.21.15.93:0/626050974 conn(0x7f71bc06d800 msgr2=0x7f71bc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 shutdown_connections 2023-11-04T01:36:17.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.266+0000 7f71c08cf640 1 -- 172.21.15.93:0/626050974 wait complete. 2023-11-04T01:36:17.286 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:17.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 Processor -- start 2023-11-04T01:36:17.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 -- start start 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4c415ad40 0x7ff4c406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 0x7ff4c4070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4065df0 con 0x7ff4c415b120 2023-11-04T01:36:17.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c406bc40 con 0x7ff4c415ad40 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.387+0000 7ff4cad68640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4066040 con 0x7ff4c40c9b60 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c8b04640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4c415ad40 0x7ff4c406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff4c415b120 0x7ff4c415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54452/0 (socket says 172.21.15.93:54452) 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c3fff640 1 -- 172.21.15.93:0/4144674442 learned_addr learned my addr 172.21.15.93:0/4144674442 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c9305640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 0x7ff4c4070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c8b04640 1 -- 172.21.15.93:0/4144674442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 msgr2=0x7ff4c4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 0x7ff4c4070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c8b04640 1 -- 172.21.15.93:0/4144674442 >> v1:172.21.15.93:6789/0 conn(0x7ff4c415b120 legacy=0x7ff4c415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c8b04640 1 -- 172.21.15.93:0/4144674442 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4066320 con 0x7ff4c415ad40 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c37fe640 1 -- 172.21.15.93:0/4144674442 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825404297 0 0) 0x7ff4c4065df0 con 0x7ff4c415b120 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.388+0000 7ff4c9305640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 0x7ff4c4070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c406b700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80097a0 tx=0x7ff4b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd3ffd5f1363aec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4c37fe640 1 -- 172.21.15.93:0/4144674442 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8031830 con 0x7ff4c415ad40 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4c37fe640 1 -- 172.21.15.93:0/4144674442 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8031990 con 0x7ff4c415ad40 2023-11-04T01:36:17.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4c37fe640 1 -- 172.21.15.93:0/4144674442 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8031d20 con 0x7ff4c415ad40 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 -- 172.21.15.93:0/4144674442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 msgr2=0x7ff4c406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c406b700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80097a0 tx=0x7ff4b802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 -- 172.21.15.93:0/4144674442 shutdown_connections 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c40c9b60 0x7ff4c4070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 --2- 172.21.15.93:0/4144674442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c406b700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 -- 172.21.15.93:0/4144674442 >> 172.21.15.93:0/4144674442 conn(0x7ff4c40cbc90 msgr2=0x7ff4c40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 -- 172.21.15.93:0/4144674442 shutdown_connections 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.389+0000 7ff4cad68640 1 -- 172.21.15.93:0/4144674442 wait complete. 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 Processor -- start 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 -- start start 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 0x7ff4c40b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 0x7ff4c4154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40cce90 con 0x7ff4c415ad40 2023-11-04T01:36:17.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b0630 con 0x7ff4c40c9b60 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.391+0000 7ff4cad68640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4154960 con 0x7ff4c415b120 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48624/0 (socket says 172.21.15.93:48624) 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 -- 172.21.15.93:0/2827689621 learned_addr learned my addr 172.21.15.93:0/2827689621 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c9305640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 0x7ff4c4154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 0x7ff4c40b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 -- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 msgr2=0x7ff4c4154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 0x7ff4c4154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 -- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 msgr2=0x7ff4c40b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 0x7ff4c40b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 -- 172.21.15.93:0/2827689621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009400 con 0x7ff4c415ad40 2023-11-04T01:36:17.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c9305640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 0x7ff4c4154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 0x7ff4c40b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c3fff640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c410 tx=0x7ff4b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00074e0 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0007660 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40cd0e0 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0004a20 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.392+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c40cd6a0 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.393+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c4074290 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.394+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4b0004b80 con 0x7ff4c415ad40 2023-11-04T01:36:17.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.394+0000 7ff4c17fa640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.394+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4b00896e0 con 0x7ff4c415ad40 2023-11-04T01:36:17.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.394+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.394+0000 7ff4c8b04640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 0x7ff4a806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8036000 tx=0x7ff4b803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.398+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4b0057f30 con 0x7ff4c415ad40 2023-11-04T01:36:17.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.563+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4c40ccac0 con 0x7ff4c415ad40 2023-11-04T01:36:17.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.563+0000 7ff4c17fa640 1 -- 172.21.15.93:0/2827689621 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4b0057ac0 con 0x7ff4c415ad40 2023-11-04T01:36:17.565 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:17.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 msgr2=0x7ff4a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 0x7ff4a806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8036000 tx=0x7ff4b803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 msgr2=0x7ff4c4153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c410 tx=0x7ff4b000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 shutdown_connections 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4c415b120 0x7ff4c4154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4c415ad40 0x7ff4c4153ee0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 --2- 172.21.15.93:0/2827689621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4c40c9b60 0x7ff4c40b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 >> 172.21.15.93:0/2827689621 conn(0x7ff4c40cbc90 msgr2=0x7ff4c415de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 shutdown_connections 2023-11-04T01:36:17.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.565+0000 7ff4cad68640 1 -- 172.21.15.93:0/2827689621 wait complete. 2023-11-04T01:36:17.577 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:17.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.678+0000 7fbea4e87640 1 Processor -- start 2023-11-04T01:36:17.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.678+0000 7fbea4e87640 1 -- start start 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbea4e87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea00b1a40 0x7fbea00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbea4e87640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbea006a830 0x7fbea00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbea4e87640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea0160990 con 0x7fbea01605b0 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbea4e87640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00cc7c0 con 0x7fbea006a830 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbea4e87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00cd750 con 0x7fbea00b1a40 2023-11-04T01:36:17.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbe9e59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbea01605b0 0x7fbea006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54468/0 (socket says 172.21.15.93:54468) 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbe9e59c640 1 -- 172.21.15.93:0/2681156048 learned_addr learned my addr 172.21.15.93:0/2681156048 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/2681156048 >> v2:172.21.15.125:3300/0 conn(0x7fbea006a830 0x7fbea00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.679+0000 7fbe95d9b640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea00b1a40 0x7fbea00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9dd9b640 1 -- 172.21.15.93:0/2681156048 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167454640 0 0) 0x7fbea0160990 con 0x7fbea01605b0 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9dd9b640 1 -- 172.21.15.93:0/2681156048 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe8c003520 con 0x7fbea01605b0 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea00b1a40 msgr2=0x7fbea00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea00b1a40 0x7fbea00ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/2681156048 >> v1:172.21.15.93:6789/0 conn(0x7fbea01605b0 legacy=0x7fbea006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.680+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/2681156048 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00cc4e0 con 0x7fbea006a830 2023-11-04T01:36:17.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00cf9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe9802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=203eb43668585dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbe9dd9b640 1 -- 172.21.15.93:0/2681156048 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9802cb30 con 0x7fbea006a830 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbe9dd9b640 1 -- 172.21.15.93:0/2681156048 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9802cc90 con 0x7fbea006a830 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbe9dd9b640 1 -- 172.21.15.93:0/2681156048 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98034440 con 0x7fbea006a830 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 -- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 msgr2=0x7fbea00cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00cf9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe9802bd80 comp rx=0 tx=0).stop 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 -- 172.21.15.93:0/2681156048 shutdown_connections 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00cf9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 --2- 172.21.15.93:0/2681156048 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea00b1a40 0x7fbea00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 -- 172.21.15.93:0/2681156048 >> 172.21.15.93:0/2681156048 conn(0x7fbea0071820 msgr2=0x7fbea0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 -- 172.21.15.93:0/2681156048 shutdown_connections 2023-11-04T01:36:17.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.681+0000 7fbea4e87640 1 -- 172.21.15.93:0/2681156048 wait complete. 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 Processor -- start 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 -- start start 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea01605b0 0x7fbea00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00b4e70 con 0x7fbea01f69f0 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea015a840 con 0x7fbea006a830 2023-11-04T01:36:17.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.683+0000 7fbea4e87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00b41f0 con 0x7fbea01605b0 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48638/0 (socket says 172.21.15.93:48638) 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/4135468241 learned_addr learned my addr 172.21.15.93:0/4135468241 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe95d9b640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea01605b0 0x7fbea00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9e59c640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea01605b0 msgr2=0x7fbea00ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea01605b0 0x7fbea00ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 msgr2=0x7fbea00b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 -- 172.21.15.93:0/4135468241 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a70 con 0x7fbea01f69f0 2023-11-04T01:36:17.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe9ed9d640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98009450 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98040450 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00b44d0 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98040800 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.684+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea00b4a90 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.685+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea00672a0 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.686+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe98040960 con 0x7fbea01f69f0 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.686+0000 7fbe977fe640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.686+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe980ac330 con 0x7fbea01f69f0 2023-11-04T01:36:17.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.686+0000 7fbe9e59c640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.686+0000 7fbe9e59c640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 0x7fbe8006d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe900011e0 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.690+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe98077180 con 0x7fbea01f69f0 2023-11-04T01:36:17.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.861+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbea00b4fb0 con 0x7fbea01f69f0 2023-11-04T01:36:17.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.861+0000 7fbe977fe640 1 -- 172.21.15.93:0/4135468241 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbea00b4fb0 con 0x7fbea01f69f0 2023-11-04T01:36:17.863 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 msgr2=0x7fbe8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 0x7fbe8006d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe900011e0 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 msgr2=0x7fbea015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe98004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 shutdown_connections 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe8006ae70 0x7fbe8006d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbea01f69f0 0x7fbea015dba0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbea01605b0 0x7fbea00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 --2- 172.21.15.93:0/4135468241 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbea006a830 0x7fbea00b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 >> 172.21.15.93:0/4135468241 conn(0x7fbea0071820 msgr2=0x7fbea00cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 shutdown_connections 2023-11-04T01:36:17.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.863+0000 7fbea4e87640 1 -- 172.21.15.93:0/4135468241 wait complete. 2023-11-04T01:36:17.875 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.979+0000 7f33edc44640 1 Processor -- start 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.979+0000 7f33edc44640 1 -- start start 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33edc44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33e8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33edc44640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33e80cc9a0 0x7f33e80714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33edc44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80c3860 con 0x7f33e8153850 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33edc44640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e80c9250 con 0x7f33e80cc9a0 2023-11-04T01:36:17.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33edc44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8153c30 con 0x7f33e80cc520 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f33e8153850 0x7f33e815a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54474/0 (socket says 172.21.15.93:54474) 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e77fe640 1 -- 172.21.15.93:0/3753111465 learned_addr learned my addr 172.21.15.93:0/3753111465 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e7fff640 1 --2- 172.21.15.93:0/3753111465 >> v2:172.21.15.125:3300/0 conn(0x7f33e80cc9a0 0x7f33e80714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e6ffd640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33e8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354905689 0 0) 0x7f33e80c3860 con 0x7f33e8153850 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.980+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d0003520 con 0x7f33e8153850 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820797645 0 0) 0x7f33d0003520 con 0x7f33e8153850 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 msgr2=0x7f33e8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33e8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 >> v2:172.21.15.125:3300/0 conn(0x7f33e80cc9a0 msgr2=0x7f33e80714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 --2- 172.21.15.93:0/3753111465 >> v2:172.21.15.125:3300/0 conn(0x7f33e80cc9a0 0x7f33e80714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80ce590 con 0x7f33e8153850 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f33d8001670 con 0x7f33e8153850 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 >> v1:172.21.15.93:6789/0 conn(0x7f33e8153850 legacy=0x7f33e815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33d0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33d0003ef0 0x7f33d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33d0004d00 0x7f33d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80c9250 con 0x7f33d0004d00 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8153c30 con 0x7f33d0003ef0 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d000b980 con 0x7f33e80cc520 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e7fff640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33d0004d00 0x7f33d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33d0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e6ffd640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33d0003ef0 0x7f33d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 -- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33d0003ef0 msgr2=0x7f33d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33d0003ef0 0x7f33d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 -- 172.21.15.93:0/3753111465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33d0004d00 msgr2=0x7f33d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33d0004d00 0x7f33d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e77fe640 1 -- 172.21.15.93:0/3753111465 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0003520 con 0x7f33e80cc520 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.981+0000 7f33e7fff640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33d0004d00 0x7f33d0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.982+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33d0003970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f33d800c240 tx=0x7f33d00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d420e59ca704ded1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.982+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d802cb00 con 0x7f33e80cc520 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.982+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d802cc60 con 0x7f33e80cc520 2023-11-04T01:36:17.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.982+0000 7f33e67fc640 1 -- 172.21.15.93:0/3753111465 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8005b10 con 0x7f33e80cc520 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 -- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 msgr2=0x7f33d0003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 --2- 172.21.15.93:0/3753111465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e80cc520 0x7f33d0003970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f33d800c240 tx=0x7f33d00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33e7fff640 1 -- 172.21.15.93:0/3753111465 reap_dead start 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 -- 172.21.15.93:0/3753111465 shutdown_connections 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 -- 172.21.15.93:0/3753111465 >> 172.21.15.93:0/3753111465 conn(0x7f33e80ce950 msgr2=0x7f33e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 -- 172.21.15.93:0/3753111465 shutdown_connections 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.983+0000 7f33edc44640 1 -- 172.21.15.93:0/3753111465 wait complete. 2023-11-04T01:36:17.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.984+0000 7f33edc44640 1 Processor -- start 2023-11-04T01:36:17.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.984+0000 7f33edc44640 1 -- start start 2023-11-04T01:36:17.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 0x7f33e80b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:17.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 0x7f33e814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8155020 con 0x7f33e8146400 2023-11-04T01:36:18.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8154730 con 0x7f33e80cc520 2023-11-04T01:36:18.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8152a80 con 0x7f33e8152510 2023-11-04T01:36:18.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48656/0 (socket says 172.21.15.93:48656) 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 -- 172.21.15.93:0/3603336488 learned_addr learned my addr 172.21.15.93:0/3603336488 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e7fff640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 0x7f33e814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 0x7f33e80b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 -- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 msgr2=0x7f33e814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 0x7f33e814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 -- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 msgr2=0x7f33e80b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 0x7f33e80b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 -- 172.21.15.93:0/3603336488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e81549d0 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 0x7f33e80b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e7fff640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 0x7f33e814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33e6ffd640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33dc003840 tx=0x7f33dc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc009cd0 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc015040 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e8154cb0 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc01b680 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.985+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e8145e20 con 0x7f33e8146400 2023-11-04T01:36:18.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.986+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e8146100 con 0x7f33e8146400 2023-11-04T01:36:18.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.987+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33dc01b7e0 con 0x7f33e8146400 2023-11-04T01:36:18.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.987+0000 7f33cffff640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 0x7f33d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.987+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33dc08e280 con 0x7f33e8146400 2023-11-04T01:36:18.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.987+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 0x7f33d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.988+0000 7f33e77fe640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 0x7f33d406d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d8007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:17.991+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33dc059040 con 0x7f33e8146400 2023-11-04T01:36:18.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.158+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f33e8074290 con 0x7f33e8146400 2023-11-04T01:36:18.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.158+0000 7f33cffff640 1 -- 172.21.15.93:0/3603336488 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f33dc05c660 con 0x7f33e8146400 2023-11-04T01:36:18.160 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 msgr2=0x7f33d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 0x7f33d406d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d8007000 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 msgr2=0x7f33e814e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33dc003840 tx=0x7f33dc003d00 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 shutdown_connections 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f33d406ae70 0x7f33d406d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f33e8152510 0x7f33e814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33e8146400 0x7f33e814e760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 --2- 172.21.15.93:0/3603336488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33e80cc520 0x7f33e80b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 >> 172.21.15.93:0/3603336488 conn(0x7f33e80ce950 msgr2=0x7f33e8070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 shutdown_connections 2023-11-04T01:36:18.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.160+0000 7f33edc44640 1 -- 172.21.15.93:0/3603336488 wait complete. 2023-11-04T01:36:18.173 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:18.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.271+0000 7f736931d640 1 Processor -- start 2023-11-04T01:36:18.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.271+0000 7f736931d640 1 -- start start 2023-11-04T01:36:18.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f736931d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f736415cd20 0x7f73641613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f736931d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736406c650 con 0x7f736406cae0 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f736931d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73641618f0 con 0x7f73640b2d10 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f736931d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736406b830 con 0x7f736415cd20 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f7362ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f736415cd20 0x7f73641613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f7362ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f736415cd20 0x7f73641613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48672/0 (socket says 172.21.15.93:48672) 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f7362ffd640 1 -- 172.21.15.93:0/954813590 learned_addr learned my addr 172.21.15.93:0/954813590 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.272+0000 7f73627fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f736406cae0 0x7f73640b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54478/0 (socket says 172.21.15.93:54478) 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7362ffd640 1 -- 172.21.15.93:0/954813590 >> v1:172.21.15.125:6789/0 conn(0x7f73640b2d10 legacy=0x7f73640cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7362ffd640 1 -- 172.21.15.93:0/954813590 >> v1:172.21.15.93:6789/0 conn(0x7f736406cae0 legacy=0x7f73640b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7362ffd640 1 -- 172.21.15.93:0/954813590 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736406ba40 con 0x7f736415cd20 2023-11-04T01:36:18.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7362ffd640 1 --2- 172.21.15.93:0/954813590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736415cd20 0x7f73641613b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7354009ea0 tx=0x7f735402bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1a828a6e7a0076 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7361ffb640 1 -- 172.21.15.93:0/954813590 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735402c910 con 0x7f736415cd20 2023-11-04T01:36:18.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7361ffb640 1 -- 172.21.15.93:0/954813590 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735402ca70 con 0x7f736415cd20 2023-11-04T01:36:18.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.273+0000 7f7361ffb640 1 -- 172.21.15.93:0/954813590 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735402ce00 con 0x7f736415cd20 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 -- 172.21.15.93:0/954813590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736415cd20 msgr2=0x7f73641613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 --2- 172.21.15.93:0/954813590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736415cd20 0x7f73641613b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7354009ea0 tx=0x7f735402bdf0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 -- 172.21.15.93:0/954813590 shutdown_connections 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 --2- 172.21.15.93:0/954813590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736415cd20 0x7f73641613b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 -- 172.21.15.93:0/954813590 >> 172.21.15.93:0/954813590 conn(0x7f73640cd600 msgr2=0x7f73640cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 -- 172.21.15.93:0/954813590 shutdown_connections 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.274+0000 7f736931d640 1 -- 172.21.15.93:0/954813590 wait complete. 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.275+0000 7f736931d640 1 Processor -- start 2023-11-04T01:36:18.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.275+0000 7f736931d640 1 -- start start 2023-11-04T01:36:18.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 0x7f73640b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 0x7f73640b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c7c50 con 0x7f736406cae0 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736415a960 con 0x7f73640b2d10 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f736931d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c7e30 con 0x7f736415cd20 2023-11-04T01:36:18.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48682/0 (socket says 172.21.15.93:48682) 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 -- 172.21.15.93:0/1711406414 learned_addr learned my addr 172.21.15.93:0/1711406414 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f73627fc640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 0x7f73640b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f73637fe640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 0x7f73640b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 -- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 msgr2=0x7f73640b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 0x7f73640b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 -- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 msgr2=0x7f73640b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 0x7f73640b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f7362ffd640 1 -- 172.21.15.93:0/1711406414 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009b30 con 0x7f736406cae0 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f73627fc640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 0x7f73640b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.276+0000 7f73637fe640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 0x7f73640b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f7362ffd640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7354009ea0 tx=0x7f7354004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354007a30 con 0x7f736406cae0 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354007bb0 con 0x7f736406cae0 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735403e450 con 0x7f736406cae0 2023-11-04T01:36:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73640c8110 con 0x7f736406cae0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.277+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73640c86d0 con 0x7f736406cae0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.278+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736406d3c0 con 0x7f736406cae0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.278+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f735403e5b0 con 0x7f736406cae0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.278+0000 7f734b7fe640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 0x7f735006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.279+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73540ac3c0 con 0x7f736406cae0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.279+0000 7f73627fc640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 0x7f735006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.279+0000 7f73627fc640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 0x7f735006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73640b6a90 tx=0x7f7358009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.283+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7354077180 con 0x7f736406cae0 2023-11-04T01:36:18.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.483+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f736406d390 con 0x7f736406cae0 2023-11-04T01:36:18.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.483+0000 7f734b7fe640 1 -- 172.21.15.93:0/1711406414 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f735407a7a0 con 0x7f736406cae0 2023-11-04T01:36:18.485 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:18.485 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:18.485 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 msgr2=0x7f735006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 0x7f735006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73640b6a90 tx=0x7f7358009040 comp rx=0 tx=0).stop 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 msgr2=0x7f73640c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7354009ea0 tx=0x7f7354004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 shutdown_connections 2023-11-04T01:36:18.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735006ae70 0x7f735006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f736415cd20 0x7f73640b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73640b2d10 0x7f73640b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 --2- 172.21.15.93:0/1711406414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f736406cae0 0x7f73640c9e50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.485+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 >> 172.21.15.93:0/1711406414 conn(0x7f73640cd600 msgr2=0x7f736415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.486+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 shutdown_connections 2023-11-04T01:36:18.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.486+0000 7f736931d640 1 -- 172.21.15.93:0/1711406414 wait complete. 2023-11-04T01:36:18.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.596+0000 7f02cbebb640 1 Processor -- start 2023-11-04T01:36:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.596+0000 7f02cbebb640 1 -- start start 2023-11-04T01:36:18.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02cbebb640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02c4160b10 0x7f02c4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02cbebb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c406bf00 con 0x7f02c415ce60 2023-11-04T01:36:18.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02cbebb640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c41615d0 con 0x7f02c40cf160 2023-11-04T01:36:18.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02cbebb640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40cbde0 con 0x7f02c4160b10 2023-11-04T01:36:18.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c9c57640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f02c415ce60 0x7f02c406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54486/0 (socket says 172.21.15.93:54486) 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c9c57640 1 -- 172.21.15.93:0/672889553 learned_addr learned my addr 172.21.15.93:0/672889553 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c9456640 1 --2- 172.21.15.93:0/672889553 >> v2:172.21.15.125:3300/0 conn(0x7f02c4160b10 0x7f02c4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451215858 0 0) 0x7f02c406bf00 con 0x7f02c415ce60 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b0003520 con 0x7f02c415ce60 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859343442 0 0) 0x7f02b0003520 con 0x7f02c415ce60 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 >> v2:172.21.15.125:3300/0 conn(0x7f02c4160b10 msgr2=0x7f02c4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 --2- 172.21.15.93:0/672889553 >> v2:172.21.15.125:3300/0 conn(0x7f02c4160b10 0x7f02c4160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 >> v1:172.21.15.125:6789/0 conn(0x7f02c40cf160 legacy=0x7f02c40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c41618b0 con 0x7f02c415ce60 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.597+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f02c0001670 con 0x7f02c415ce60 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 >> v1:172.21.15.93:6789/0 conn(0x7f02c415ce60 legacy=0x7f02c406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b0003970 0x7f02b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b00047c0 0x7f02b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40cbde0 con 0x7f02b0005180 2023-11-04T01:36:18.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000c020 con 0x7f02b00047c0 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000c1e0 con 0x7f02b0003970 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c9c57640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b0003970 0x7f02b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02c9456640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b00047c0 0x7f02b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 -- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b0003970 msgr2=0x7f02b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b0003970 0x7f02b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 -- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b00047c0 msgr2=0x7f02b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b00047c0 0x7f02b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.598+0000 7f02ca458640 1 -- 172.21.15.93:0/672889553 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0003520 con 0x7f02b0005180 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02ca458640 1 -- 172.21.15.93:0/672889553 reap_dead start 2023-11-04T01:36:18.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02ca458640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02b000b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001e50 tx=0x7f02b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157fc09d967e9dbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc003b70 con 0x7f02b0005180 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc003d10 con 0x7f02b0005180 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02c8c55640 1 -- 172.21.15.93:0/672889553 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc005310 con 0x7f02b0005180 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 -- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 msgr2=0x7f02b000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02b000b980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001e50 tx=0x7f02b00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 -- 172.21.15.93:0/672889553 shutdown_connections 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 --2- 172.21.15.93:0/672889553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02b000b980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 -- 172.21.15.93:0/672889553 >> 172.21.15.93:0/672889553 conn(0x7f02c406ea90 msgr2=0x7f02c406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 -- 172.21.15.93:0/672889553 shutdown_connections 2023-11-04T01:36:18.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.599+0000 7f02cbebb640 1 -- 172.21.15.93:0/672889553 wait complete. 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 Processor -- start 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 -- start start 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c40b5e60 0x7f02c40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 0x7f02c40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4151150 con 0x7f02b0005180 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40b6800 con 0x7f02c40c7c70 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02cbebb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40c8630 con 0x7f02c40b5e60 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02c9c57640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02c9c57640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48702/0 (socket says 172.21.15.93:48702) 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02c9c57640 1 -- 172.21.15.93:0/4166512696 learned_addr learned my addr 172.21.15.93:0/4166512696 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.601+0000 7f02c9456640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c40b5e60 0x7f02c40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02ca458640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 0x7f02c40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 -- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c40b5e60 msgr2=0x7f02c40b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c40b5e60 0x7f02c40b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 -- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 msgr2=0x7f02c40c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 0x7f02c40c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 -- 172.21.15.93:0/4166512696 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40c88a0 con 0x7f02b0005180 2023-11-04T01:36:18.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02ca458640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 0x7f02c40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02c9c57640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02c00072c0 tx=0x7f02c00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0004ea0 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000f9c0 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c40c8b80 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000fd50 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.602+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40b3770 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.603+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c4074290 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.603+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02c001e3b0 con 0x7f02b0005180 2023-11-04T01:36:18.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.604+0000 7f02ba7fc640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 0x7f02a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.604+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02c00893c0 con 0x7f02b0005180 2023-11-04T01:36:18.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.604+0000 7f02c9456640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 0x7f02a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.604+0000 7f02c9456640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 0x7f02a806d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c40c98f0 tx=0x7f02b4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.608+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02c0054180 con 0x7f02b0005180 2023-11-04T01:36:18.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.776+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02c406b3e0 con 0x7f02b0005180 2023-11-04T01:36:18.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.777+0000 7f02ba7fc640 1 -- 172.21.15.93:0/4166512696 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f02c00577a0 con 0x7f02b0005180 2023-11-04T01:36:18.779 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:18.780 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:18.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 msgr2=0x7f02a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 0x7f02a806d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c40c98f0 tx=0x7f02b4009190 comp rx=0 tx=0).stop 2023-11-04T01:36:18.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 msgr2=0x7f02c41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02c00072c0 tx=0x7f02c00076c0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 shutdown_connections 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02a806aea0 0x7f02a806d360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02c40c7c70 0x7f02c40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c40b5e60 0x7f02c40b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 --2- 172.21.15.93:0/4166512696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b0005180 0x7f02c41505f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 >> 172.21.15.93:0/4166512696 conn(0x7f02c406ea90 msgr2=0x7f02c406b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 shutdown_connections 2023-11-04T01:36:18.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.779+0000 7f02cbebb640 1 -- 172.21.15.93:0/4166512696 wait complete. 2023-11-04T01:36:18.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:18.792 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:18.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.895+0000 7f9fb27e7640 1 Processor -- start 2023-11-04T01:36:18.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.895+0000 7f9fb27e7640 1 -- start start 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.895+0000 7f9fb27e7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9fac153e60 0x7f9fac15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb27e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 0x7f9fac161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb27e7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0cde60 con 0x7f9fac0b4880 2023-11-04T01:36:18.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb27e7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac160f90 con 0x7f9fac153e60 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb27e7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac15e400 con 0x7f9fac0cd6d0 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fabfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9fac153e60 0x7f9fac15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb0d84640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9fac0b4880 0x7f9fac06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54494/0 (socket says 172.21.15.93:54494) 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fb0d84640 1 -- 172.21.15.93:0/383935337 learned_addr learned my addr 172.21.15.93:0/383935337 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fabfff640 1 -- 172.21.15.93:0/383935337 >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 msgr2=0x7f9fac161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fab7fe640 1 --2- 172.21.15.93:0/383935337 >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 0x7f9fac161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fabfff640 1 --2- 172.21.15.93:0/383935337 >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 0x7f9fac161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fabfff640 1 -- 172.21.15.93:0/383935337 >> v1:172.21.15.93:6789/0 conn(0x7f9fac0b4880 legacy=0x7f9fac06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fabfff640 1 -- 172.21.15.93:0/383935337 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac161960 con 0x7f9fac153e60 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9faaffd640 1 -- 172.21.15.93:0/383935337 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966181096 0 0) 0x7f9fac0cde60 con 0x7f9fac0b4880 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.896+0000 7f9fab7fe640 1 --2- 172.21.15.93:0/383935337 >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 0x7f9fac161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fabfff640 1 --2- 172.21.15.93:0/383935337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac15dec0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c9e80 tx=0x7f9f9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fe76ee466deae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9faaffd640 1 -- 172.21.15.93:0/383935337 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c031830 con 0x7f9fac153e60 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9faaffd640 1 -- 172.21.15.93:0/383935337 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c031990 con 0x7f9fac153e60 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9faaffd640 1 -- 172.21.15.93:0/383935337 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c031d20 con 0x7f9fac153e60 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 -- 172.21.15.93:0/383935337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 msgr2=0x7f9fac15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/383935337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac15dec0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c9e80 tx=0x7f9f9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 -- 172.21.15.93:0/383935337 shutdown_connections 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/383935337 >> v2:172.21.15.125:3300/0 conn(0x7f9fac0cd6d0 0x7f9fac161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/383935337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac15dec0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 -- 172.21.15.93:0/383935337 >> 172.21.15.93:0/383935337 conn(0x7f9fac0cf880 msgr2=0x7f9fac0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 -- 172.21.15.93:0/383935337 shutdown_connections 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.897+0000 7f9fb27e7640 1 -- 172.21.15.93:0/383935337 wait complete. 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 Processor -- start 2023-11-04T01:36:18.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 -- start start 2023-11-04T01:36:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 0x7f9fac1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 0x7f9fac152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1584b0 con 0x7f9fac153e60 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f3340 con 0x7f9fac0cd6d0 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.899+0000 7f9fb27e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f6880 con 0x7f9fac0b4880 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48712/0 (socket says 172.21.15.93:48712) 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 -- 172.21.15.93:0/1083905911 learned_addr learned my addr 172.21.15.93:0/1083905911 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fabfff640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 0x7f9fac1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fab7fe640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 0x7f9fac152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 -- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 msgr2=0x7f9fac1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 0x7f9fac1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 -- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 msgr2=0x7f9fac152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:18.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 0x7f9fac152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 -- 172.21.15.93:0/1083905911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009400 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fabfff640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 0x7f9fac1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fab7fe640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 0x7f9fac152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb0d84640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c7e0 tx=0x7f9fa400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400a5e0 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400a760 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac153390 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400ab10 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.900+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac1f65a0 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.901+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac1585f0 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.902+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fa400ac70 con 0x7f9fac153e60 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.902+0000 7f9fa8ff9640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 0x7f9f9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.902+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fa4088df0 con 0x7f9fac153e60 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.902+0000 7f9fabfff640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 0x7f9f9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.902+0000 7f9fabfff640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 0x7f9f9806d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c036000 tx=0x7f9f9c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:18.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:18.906+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9fac1585f0 con 0x7f9fac153e60 2023-11-04T01:36:19.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.072+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fac1585f0 con 0x7f9fac153e60 2023-11-04T01:36:19.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.073+0000 7f9fa8ff9640 1 -- 172.21.15.93:0/1083905911 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fac1585f0 con 0x7f9fac153e60 2023-11-04T01:36:19.074 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 msgr2=0x7f9f9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 0x7f9f9806d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c036000 tx=0x7f9f9c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 msgr2=0x7f9fac1f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c7e0 tx=0x7f9fa400cca0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 shutdown_connections 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f9806ae70 0x7f9f9806d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9fac153e60 0x7f9fac1f5900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fac0cd6d0 0x7f9fac152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 --2- 172.21.15.93:0/1083905911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9fac0b4880 0x7f9fac1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 >> 172.21.15.93:0/1083905911 conn(0x7f9fac0cf880 msgr2=0x7f9fac0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 shutdown_connections 2023-11-04T01:36:19.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.075+0000 7f9fb27e7640 1 -- 172.21.15.93:0/1083905911 wait complete. 2023-11-04T01:36:19.090 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.192+0000 7f11497c9640 1 Processor -- start 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.192+0000 7f11497c9640 1 -- start start 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f11497c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11440cd6d0 0x7f1144161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f11497c9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440cde60 con 0x7f1144153e60 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f11497c9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1144160f90 con 0x7f11440b4880 2023-11-04T01:36:19.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f11497c9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1144161960 con 0x7f11440cd6d0 2023-11-04T01:36:19.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1142ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1144153e60 0x7f114415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54500/0 (socket says 172.21.15.93:54500) 2023-11-04T01:36:19.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1142ffd640 1 -- 172.21.15.93:0/3637562207 learned_addr learned my addr 172.21.15.93:0/3637562207 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:19.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f11427fc640 1 --2- 172.21.15.93:0/3637562207 >> v2:172.21.15.125:3300/0 conn(0x7f11440cd6d0 0x7f1144161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207677414 0 0) 0x7f11440cde60 con 0x7f1144153e60 2023-11-04T01:36:19.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f112c003520 con 0x7f1144153e60 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624353690 0 0) 0x7f112c003520 con 0x7f1144153e60 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 >> v2:172.21.15.125:3300/0 conn(0x7f11440cd6d0 msgr2=0x7f1144161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 --2- 172.21.15.93:0/3637562207 >> v2:172.21.15.125:3300/0 conn(0x7f11440cd6d0 0x7f1144161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 >> v1:172.21.15.125:6789/0 conn(0x7f11440b4880 legacy=0x7f11440d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440ce090 con 0x7f1144153e60 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1134001670 con 0x7f1144153e60 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.193+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 >> v1:172.21.15.93:6789/0 conn(0x7f1144153e60 legacy=0x7f114415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112c003970 0x7f112c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112c005180 0x7f112c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144161960 con 0x7f112c0047c0 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00c020 con 0x7f112c003970 2023-11-04T01:36:19.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00c1e0 con 0x7f112c005180 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f1142ffd640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112c003970 0x7f112c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11437fe640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112c005180 0x7f112c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 -- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112c005180 msgr2=0x7f112c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f112c005180 0x7f112c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 -- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112c003970 msgr2=0x7f112c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f112c003970 0x7f112c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11427fc640 1 -- 172.21.15.93:0/3637562207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c003520 con 0x7f112c0047c0 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.194+0000 7f11437fe640 1 -- 172.21.15.93:0/3637562207 reap_dead start 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11427fc640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1138009ac0 tx=0x7f112c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7067ecb3ac698d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113802c6b0 con 0x7f112c0047c0 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113802c810 con 0x7f112c0047c0 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f1141ffb640 1 -- 172.21.15.93:0/3637562207 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113802cba0 con 0x7f112c0047c0 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 -- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 msgr2=0x7f112c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1138009ac0 tx=0x7f112c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 -- 172.21.15.93:0/3637562207 shutdown_connections 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 --2- 172.21.15.93:0/3637562207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 -- 172.21.15.93:0/3637562207 >> 172.21.15.93:0/3637562207 conn(0x7f11440cf880 msgr2=0x7f11440cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 -- 172.21.15.93:0/3637562207 shutdown_connections 2023-11-04T01:36:19.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.195+0000 7f11497c9640 1 -- 172.21.15.93:0/3637562207 wait complete. 2023-11-04T01:36:19.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 Processor -- start 2023-11-04T01:36:19.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 -- start start 2023-11-04T01:36:19.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 0x7f11440b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 0x7f11440b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11441461c0 con 0x7f112c0047c0 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cbb40 con 0x7f11440c9100 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f11497c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cd050 con 0x7f11440c9560 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f1142ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f1142ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48732/0 (socket says 172.21.15.93:48732) 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.197+0000 7f1142ffd640 1 -- 172.21.15.93:0/2596162950 learned_addr learned my addr 172.21.15.93:0/2596162950 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11437fe640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 0x7f11440b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11427fc640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 0x7f11440b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 -- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 msgr2=0x7f11440b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 0x7f11440b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 -- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 msgr2=0x7f11440b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 0x7f11440b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 -- 172.21.15.93:0/2596162950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440cc680 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11437fe640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 0x7f11440b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11427fc640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 0x7f11440b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f1142ffd640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11340072c0 tx=0x7f1134007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134001500 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113400f9c0 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400fd70 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1144142d50 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.198+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11440cc030 con 0x7f112c0047c0 2023-11-04T01:36:19.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.199+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144074290 con 0x7f112c0047c0 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.199+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f113401d460 con 0x7f112c0047c0 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.200+0000 7f112b7fe640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 0x7f113006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.200+0000 7f11427fc640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 0x7f113006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.200+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1134089b90 con 0x7f112c0047c0 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.200+0000 7f11427fc640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 0x7f113006d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1138036000 tx=0x7f1138030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.204+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11340548c0 con 0x7f112c0047c0 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.371+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11440d0b80 con 0x7f112c0047c0 2023-11-04T01:36:19.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.371+0000 7f112b7fe640 1 -- 172.21.15.93:0/2596162950 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1134057ee0 con 0x7f112c0047c0 2023-11-04T01:36:19.373 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:19.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 msgr2=0x7f113006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 0x7f113006d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1138036000 tx=0x7f1138030000 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 msgr2=0x7f11440ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11340072c0 tx=0x7f1134007780 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 shutdown_connections 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f113006aea0 0x7f113006d360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11440c9560 0x7f11440b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11440c9100 0x7f11440b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 --2- 172.21.15.93:0/2596162950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f112c0047c0 0x7f11440ccb10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 >> 172.21.15.93:0/2596162950 conn(0x7f11440cf880 msgr2=0x7f11440d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 shutdown_connections 2023-11-04T01:36:19.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.373+0000 7f11497c9640 1 -- 172.21.15.93:0/2596162950 wait complete. 2023-11-04T01:36:19.389 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:19.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.490+0000 7f3139397640 1 Processor -- start 2023-11-04T01:36:19.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.490+0000 7f3139397640 1 -- start start 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3139397640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31340cd6d0 0x7f3134161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3139397640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31340cde60 con 0x7f3134153e60 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3139397640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3134160f90 con 0x7f31340b4880 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3139397640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3134161960 con 0x7f31340cd6d0 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3132ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3134153e60 0x7f313415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54514/0 (socket says 172.21.15.93:54514) 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3132ffd640 1 -- 172.21.15.93:0/1424476892 learned_addr learned my addr 172.21.15.93:0/1424476892 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799535443 0 0) 0x7f31340cde60 con 0x7f3134153e60 2023-11-04T01:36:19.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c003520 con 0x7f3134153e60 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f31327fc640 1 --2- 172.21.15.93:0/1424476892 >> v2:172.21.15.125:3300/0 conn(0x7f31340cd6d0 0x7f3134161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127742727 0 0) 0x7f311c003520 con 0x7f3134153e60 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 >> v2:172.21.15.125:3300/0 conn(0x7f31340cd6d0 msgr2=0x7f3134161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 --2- 172.21.15.93:0/1424476892 >> v2:172.21.15.125:3300/0 conn(0x7f31340cd6d0 0x7f3134161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 >> v1:172.21.15.125:6789/0 conn(0x7f31340b4880 legacy=0x7f31340d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340ce090 con 0x7f3134153e60 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3124001670 con 0x7f3134153e60 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 >> v1:172.21.15.93:6789/0 conn(0x7f3134153e60 legacy=0x7f313415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.491+0000 7f3131ffb640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3131ffb640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3131ffb640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f311c005180 0x7f311c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134161960 con 0x7f311c003970 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00c0d0 con 0x7f311c0047c0 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00c290 con 0x7f311c005180 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f31337fe640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f311c005180 0x7f311c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f31327fc640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 -- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f311c005180 msgr2=0x7f311c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f311c005180 0x7f311c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 -- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f311c0047c0 msgr2=0x7f311c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f3132ffd640 1 -- 172.21.15.93:0/1424476892 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c003520 con 0x7f311c003970 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f31337fe640 1 -- 172.21.15.93:0/1424476892 reap_dead start 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.492+0000 7f31327fc640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:19.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3132ffd640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f311c003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f312400c240 tx=0x7f311c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a63334666cc4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124005ad0 con 0x7f311c003970 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124005c30 con 0x7f311c003970 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3131ffb640 1 -- 172.21.15.93:0/1424476892 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312402caf0 con 0x7f311c003970 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 -- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 msgr2=0x7f311c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f311c003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f312400c240 tx=0x7f311c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 -- 172.21.15.93:0/1424476892 shutdown_connections 2023-11-04T01:36:19.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 --2- 172.21.15.93:0/1424476892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 -- 172.21.15.93:0/1424476892 >> 172.21.15.93:0/1424476892 conn(0x7f31340cf880 msgr2=0x7f31340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 -- 172.21.15.93:0/1424476892 shutdown_connections 2023-11-04T01:36:19.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.493+0000 7f3139397640 1 -- 172.21.15.93:0/1424476892 wait complete. 2023-11-04T01:36:19.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.494+0000 7f3139397640 1 Processor -- start 2023-11-04T01:36:19.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 -- start start 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31340c7ea0 0x7f31340cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31340c8300 0x7f31340cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341f5eb0 con 0x7f311c003970 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31341f2ec0 con 0x7f31340c8300 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3139397640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31341f31a0 con 0x7f31340c7ea0 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3132ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3132ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48756/0 (socket says 172.21.15.93:48756) 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f3132ffd640 1 -- 172.21.15.93:0/870606237 learned_addr learned my addr 172.21.15.93:0/870606237 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.495+0000 7f31327fc640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31340c7ea0 0x7f31340cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f31337fe640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31340c8300 0x7f31340cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 -- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31340c7ea0 msgr2=0x7f31340cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31340c7ea0 0x7f31340cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 -- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31340c8300 msgr2=0x7f31340cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31340c8300 0x7f31340cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 -- 172.21.15.93:0/870606237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31341f3480 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3132ffd640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f312402c450 tx=0x7f312402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312403c040 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312402cd40 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31341f3760 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124007290 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.496+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31341f63b0 con 0x7f311c003970 2023-11-04T01:36:19.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.497+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31341f32e0 con 0x7f311c003970 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.497+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3124032070 con 0x7f311c003970 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.498+0000 7f311b7fe640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.498+0000 7f31327fc640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.498+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31240aaa60 con 0x7f311c003970 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.498+0000 7f31327fc640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 0x7f312006d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f313415d050 tx=0x7f3128008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.502+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31341f32e0 con 0x7f311c003970 2023-11-04T01:36:19.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.668+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31341f32e0 con 0x7f311c003970 2023-11-04T01:36:19.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.669+0000 7f311b7fe640 1 -- 172.21.15.93:0/870606237 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31341f32e0 con 0x7f311c003970 2023-11-04T01:36:19.670 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:19.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 msgr2=0x7f312006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 0x7f312006d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f313415d050 tx=0x7f3128008040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 msgr2=0x7f3134154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f312402c450 tx=0x7f312402e070 comp rx=0 tx=0).stop 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 shutdown_connections 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31340c8300 0x7f31340cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31340c7ea0 0x7f31340cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 --2- 172.21.15.93:0/870606237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f311c003970 0x7f3134154700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 >> 172.21.15.93:0/870606237 conn(0x7f31340cf880 msgr2=0x7f31340d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 shutdown_connections 2023-11-04T01:36:19.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.671+0000 7f3139397640 1 -- 172.21.15.93:0/870606237 wait complete. 2023-11-04T01:36:19.683 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.783+0000 7fd718590640 1 Processor -- start 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.783+0000 7fd718590640 1 -- start start 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd718590640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd71015b120 0x7fd71006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd718590640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd710065df0 con 0x7fd71015ad40 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd718590640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd710066040 con 0x7fd7100c9b60 2023-11-04T01:36:19.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd718590640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71006bc40 con 0x7fd71015b120 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd71015b120 0x7fd71006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd71015b120 0x7fd71006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48762/0 (socket says 172.21.15.93:48762) 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd71632c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd71015ad40 0x7fd71015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54516/0 (socket says 172.21.15.93:54516) 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 -- 172.21.15.93:0/2554634499 learned_addr learned my addr 172.21.15.93:0/2554634499 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 -- 172.21.15.93:0/2554634499 >> v1:172.21.15.125:6789/0 conn(0x7fd7100c9b60 legacy=0x7fd710070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 -- 172.21.15.93:0/2554634499 >> v1:172.21.15.93:6789/0 conn(0x7fd71015ad40 legacy=0x7fd71015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd71532a640 1 -- 172.21.15.93:0/2554634499 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813686268 0 0) 0x7fd710065df0 con 0x7fd71015ad40 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.784+0000 7fd715b2b640 1 -- 172.21.15.93:0/2554634499 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710066320 con 0x7fd71015b120 2023-11-04T01:36:19.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.785+0000 7fd715b2b640 1 --2- 172.21.15.93:0/2554634499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015b120 0x7fd71006b700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69096104a95d0cc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.785+0000 7fd71532a640 1 -- 172.21.15.93:0/2554634499 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700030860 con 0x7fd71015b120 2023-11-04T01:36:19.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.785+0000 7fd71532a640 1 -- 172.21.15.93:0/2554634499 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000309c0 con 0x7fd71015b120 2023-11-04T01:36:19.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.785+0000 7fd71532a640 1 -- 172.21.15.93:0/2554634499 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700030d50 con 0x7fd71015b120 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 -- 172.21.15.93:0/2554634499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015b120 msgr2=0x7fd71006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 --2- 172.21.15.93:0/2554634499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015b120 0x7fd71006b700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 -- 172.21.15.93:0/2554634499 shutdown_connections 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 --2- 172.21.15.93:0/2554634499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015b120 0x7fd71006b700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 -- 172.21.15.93:0/2554634499 >> 172.21.15.93:0/2554634499 conn(0x7fd7100cbc90 msgr2=0x7fd7100cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 -- 172.21.15.93:0/2554634499 shutdown_connections 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.786+0000 7fd718590640 1 -- 172.21.15.93:0/2554634499 wait complete. 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.787+0000 7fd718590640 1 Processor -- start 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.787+0000 7fd718590640 1 -- start start 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 0x7fd7100c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd71015b120 0x7fd710155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cde40 con 0x7fd71015ad40 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cd880 con 0x7fd7100c9b60 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cdb60 con 0x7fd71015b120 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48764/0 (socket says 172.21.15.93:48764) 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 -- 172.21.15.93:0/801789778 learned_addr learned my addr 172.21.15.93:0/801789778 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 -- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd71015b120 msgr2=0x7fd710155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd71015b120 0x7fd710155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd71632c640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 0x7fd7100c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 -- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 msgr2=0x7fd7100c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 0x7fd7100c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 -- 172.21.15.93:0/801789778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000094d0 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd71632c640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 0x7fd7100c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd715b2b640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd700004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700030810 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700039d90 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700043630 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7100c6410 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.788+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7100cec80 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.789+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100c6930 con 0x7fd71015ad40 2023-11-04T01:36:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.790+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd70002f3b0 con 0x7fd71015ad40 2023-11-04T01:36:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.790+0000 7fd706ffd640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 0x7fd6f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.790+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7000abca0 con 0x7fd71015ad40 2023-11-04T01:36:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.790+0000 7fd71632c640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 0x7fd6f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.791+0000 7fd71632c640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 0x7fd6f406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd70c000f60 tx=0x7fd70c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.794+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7100c6930 con 0x7fd71015ad40 2023-11-04T01:36:19.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.961+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7100c6930 con 0x7fd71015ad40 2023-11-04T01:36:19.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.962+0000 7fd706ffd640 1 -- 172.21.15.93:0/801789778 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd700034020 con 0x7fd71015ad40 2023-11-04T01:36:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:19.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 msgr2=0x7fd6f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 0x7fd6f406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd70c000f60 tx=0x7fd70c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 msgr2=0x7fd7100ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd700004730 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 shutdown_connections 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd6f406ae70 0x7fd6f406d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd71015b120 0x7fd710155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd71015ad40 0x7fd7100ccde0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.963+0000 7fd718590640 1 --2- 172.21.15.93:0/801789778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7100c9b60 0x7fd7100c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:19.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.964+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 >> 172.21.15.93:0/801789778 conn(0x7fd7100cbc90 msgr2=0x7fd7101566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:19.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.964+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 shutdown_connections 2023-11-04T01:36:19.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:19.964+0000 7fd718590640 1 -- 172.21.15.93:0/801789778 wait complete. 2023-11-04T01:36:19.976 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:20.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.074+0000 7f395fd05640 1 Processor -- start 2023-11-04T01:36:20.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.074+0000 7f395fd05640 1 -- start start 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395fd05640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3958159c70 0x7f39580ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395fd05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f395806db20 0x7f39580b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395fd05640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39580b4110 con 0x7f39580b0910 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395fd05640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580b49b0 con 0x7f3958159c70 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395fd05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580b0da0 con 0x7f395806db20 2023-11-04T01:36:20.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3958159c70 0x7f39580ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3958159c70 0x7f39580ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48772/0 (socket says 172.21.15.93:48772) 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 -- 172.21.15.93:0/2011247963 learned_addr learned my addr 172.21.15.93:0/2011247963 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 -- 172.21.15.93:0/2011247963 >> v2:172.21.15.125:3300/0 conn(0x7f395806db20 msgr2=0x7f39580b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 --2- 172.21.15.93:0/2011247963 >> v2:172.21.15.125:3300/0 conn(0x7f395806db20 0x7f39580b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 -- 172.21.15.93:0/2011247963 >> v1:172.21.15.125:6789/0 conn(0x7f39580b0910 legacy=0x7f395815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.075+0000 7f395daa1640 1 -- 172.21.15.93:0/2011247963 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580b43f0 con 0x7f3958159c70 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395daa1640 1 --2- 172.21.15.93:0/2011247963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f39580ce370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f39580cf800 tx=0x7f395402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd55ff497c81db45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395ca9f640 1 -- 172.21.15.93:0/2011247963 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954031870 con 0x7f3958159c70 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395ca9f640 1 -- 172.21.15.93:0/2011247963 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540319d0 con 0x7f3958159c70 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395ca9f640 1 -- 172.21.15.93:0/2011247963 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954031d60 con 0x7f3958159c70 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 -- 172.21.15.93:0/2011247963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 msgr2=0x7f39580ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 --2- 172.21.15.93:0/2011247963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f39580ce370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f39580cf800 tx=0x7f395402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:20.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 -- 172.21.15.93:0/2011247963 shutdown_connections 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 --2- 172.21.15.93:0/2011247963 >> v2:172.21.15.125:3300/0 conn(0x7f395806db20 0x7f39580b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 --2- 172.21.15.93:0/2011247963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f39580ce370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 -- 172.21.15.93:0/2011247963 >> 172.21.15.93:0/2011247963 conn(0x7f39580ce950 msgr2=0x7f39580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 -- 172.21.15.93:0/2011247963 shutdown_connections 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.076+0000 7f395fd05640 1 -- 172.21.15.93:0/2011247963 wait complete. 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 Processor -- start 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 -- start start 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f395806db20 0x7f395814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39580b0910 0x7f3958152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958150e30 con 0x7f3958159c70 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395814fc10 con 0x7f39580b0910 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395fd05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3958153370 con 0x7f395806db20 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395e2a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395e2a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48786/0 (socket says 172.21.15.93:48786) 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395e2a2640 1 -- 172.21.15.93:0/1685905078 learned_addr learned my addr 172.21.15.93:0/1685905078 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395daa1640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f395806db20 0x7f395814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.078+0000 7f395d2a0640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39580b0910 0x7f3958152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 -- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f395806db20 msgr2=0x7f395814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f395806db20 0x7f395814f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 -- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39580b0910 msgr2=0x7f3958152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39580b0910 0x7f3958152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 -- 172.21.15.93:0/1685905078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540094d0 con 0x7f3958159c70 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395e2a2640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f395000c780 tx=0x7f395000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950003d80 con 0x7f3958159c70 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000ce90 con 0x7f3958159c70 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3958153650 con 0x7f3958159c70 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500052b0 con 0x7f3958159c70 2023-11-04T01:36:20.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.079+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3958151360 con 0x7f3958159c70 2023-11-04T01:36:20.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.080+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958153840 con 0x7f3958159c70 2023-11-04T01:36:20.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.080+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3950005410 con 0x7f3958159c70 2023-11-04T01:36:20.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.081+0000 7f394e7fc640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 0x7f393c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.081+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3950088d90 con 0x7f3958159c70 2023-11-04T01:36:20.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.081+0000 7f395daa1640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 0x7f393c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.081+0000 7f395daa1640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 0x7f393c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3954036000 tx=0x7f395403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.085+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3950053b70 con 0x7f3958159c70 2023-11-04T01:36:20.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.294+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3958151550 con 0x7f3958159c70 2023-11-04T01:36:20.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.294+0000 7f394e7fc640 1 -- 172.21.15.93:0/1685905078 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f3950017070 con 0x7f3958159c70 2023-11-04T01:36:20.296 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:20.296 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:20.296 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:36:20.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 msgr2=0x7f393c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 0x7f393c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3954036000 tx=0x7f395403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:20.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 msgr2=0x7f3958151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f395000c780 tx=0x7f395000cc40 comp rx=0 tx=0).stop 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 shutdown_connections 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f393c06ae70 0x7f393c06d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3958159c70 0x7f3958151880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39580b0910 0x7f3958152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 --2- 172.21.15.93:0/1685905078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f395806db20 0x7f395814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 >> 172.21.15.93:0/1685905078 conn(0x7f39580ce950 msgr2=0x7f3958158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 shutdown_connections 2023-11-04T01:36:20.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.296+0000 7f395fd05640 1 -- 172.21.15.93:0/1685905078 wait complete. 2023-11-04T01:36:20.308 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:20.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.406+0000 7fc072be7640 1 Processor -- start 2023-11-04T01:36:20.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.406+0000 7fc072be7640 1 -- start start 2023-11-04T01:36:20.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc072be7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc072be7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc06c0cf160 0x7fc06c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc072be7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c1615d0 con 0x7fc06c06bd30 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc072be7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0cbde0 con 0x7fc06c0cf160 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc072be7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0cfb50 con 0x7fc06c15ce60 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc06c0cf160 0x7fc06c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc06c0cf160 0x7fc06c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48796/0 (socket says 172.21.15.93:48796) 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 -- 172.21.15.93:0/1061548872 learned_addr learned my addr 172.21.15.93:0/1061548872 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 -- 172.21.15.93:0/1061548872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 msgr2=0x7fc06c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc070983640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 -- 172.21.15.93:0/1061548872 >> v1:172.21.15.125:6789/0 conn(0x7fc06c06bd30 legacy=0x7fc06c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc071184640 1 -- 172.21.15.93:0/1061548872 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c1618b0 con 0x7fc06c0cf160 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.407+0000 7fc070983640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c06b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.408+0000 7fc071184640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c0cf160 0x7fc06c0cf610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc064009e50 tx=0x7fc06402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f9efe7b80582c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.408+0000 7fc06b7fe640 1 -- 172.21.15.93:0/1061548872 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06402ca70 con 0x7fc06c0cf160 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.408+0000 7fc06b7fe640 1 -- 172.21.15.93:0/1061548872 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06402cbd0 con 0x7fc06c0cf160 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.408+0000 7fc06b7fe640 1 -- 172.21.15.93:0/1061548872 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640343f0 con 0x7fc06c0cf160 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 -- 172.21.15.93:0/1061548872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c0cf160 msgr2=0x7fc06c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c0cf160 0x7fc06c0cf610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc064009e50 tx=0x7fc06402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 -- 172.21.15.93:0/1061548872 shutdown_connections 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c0cf160 0x7fc06c0cf610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 --2- 172.21.15.93:0/1061548872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c06b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 -- 172.21.15.93:0/1061548872 >> 172.21.15.93:0/1061548872 conn(0x7fc06c06ea90 msgr2=0x7fc06c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 -- 172.21.15.93:0/1061548872 shutdown_connections 2023-11-04T01:36:20.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.409+0000 7fc072be7640 1 -- 172.21.15.93:0/1061548872 wait complete. 2023-11-04T01:36:20.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.410+0000 7fc072be7640 1 Processor -- start 2023-11-04T01:36:20.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.410+0000 7fc072be7640 1 -- start start 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc06c0cf160 0x7fc06c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c15fe90 con 0x7fc06c15e8b0 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c15ddd0 con 0x7fc06c0cf160 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc072be7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c15e0b0 con 0x7fc06c15ce60 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48812/0 (socket says 172.21.15.93:48812) 2023-11-04T01:36:20.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 -- 172.21.15.93:0/1926895990 learned_addr learned my addr 172.21.15.93:0/1926895990 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc06bfff640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc070983640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc06c0cf160 0x7fc06c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 -- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 msgr2=0x7fc06c0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 -- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc06c0cf160 msgr2=0x7fc06c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc06c0cf160 0x7fc06c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 -- 172.21.15.93:0/1926895990 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064009b30 con 0x7fc06c15e8b0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc071184640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc064036040 tx=0x7fc064004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06403e450 con 0x7fc06c15e8b0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.411+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06403e5d0 con 0x7fc06c15e8b0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.412+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c15e390 con 0x7fc06c15e8b0 2023-11-04T01:36:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.412+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06403e980 con 0x7fc06c15e8b0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.412+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c15b080 con 0x7fc06c15e8b0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.413+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c074290 con 0x7fc06c15e8b0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.413+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc06403eae0 con 0x7fc06c15e8b0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.413+0000 7fc0697fa640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 0x7fc05806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.414+0000 7fc070983640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 0x7fc05806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.414+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0640ac7c0 con 0x7fc06c15e8b0 2023-11-04T01:36:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.414+0000 7fc070983640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 0x7fc05806d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00a950 tx=0x7fc05c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.418+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc064077630 con 0x7fc06c15e8b0 2023-11-04T01:36:20.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.586+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc06c0ce940 con 0x7fc06c15e8b0 2023-11-04T01:36:20.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.587+0000 7fc0697fa640 1 -- 172.21.15.93:0/1926895990 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fc06407ac50 con 0x7fc06c15e8b0 2023-11-04T01:36:20.589 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:20.589 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":24,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:35:56.417982+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:20.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 msgr2=0x7fc05806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 0x7fc05806d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00a950 tx=0x7fc05c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:20.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 msgr2=0x7fc06c0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc064036040 tx=0x7fc064004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 shutdown_connections 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc05806ae70 0x7fc05806d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc06c15e8b0 0x7fc06c0ca310 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc06c15ce60 0x7fc06c0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 --2- 172.21.15.93:0/1926895990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc06c0cf160 0x7fc06c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 >> 172.21.15.93:0/1926895990 conn(0x7fc06c06ea90 msgr2=0x7fc06c15bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 shutdown_connections 2023-11-04T01:36:20.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.589+0000 7fc072be7640 1 -- 172.21.15.93:0/1926895990 wait complete. 2023-11-04T01:36:20.601 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:20.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.700+0000 7f878270f640 1 Processor -- start 2023-11-04T01:36:20.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.700+0000 7f878270f640 1 -- start start 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f878270f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f877c15ae40 0x7f877c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f878270f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f877c0cda30 0x7f877c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f878270f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c0cc450 con 0x7f877c0cbc00 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f878270f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c15f400 con 0x7f877c0cda30 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f878270f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c15b220 con 0x7f877c15ae40 2023-11-04T01:36:20.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f877c0cda30 0x7f877c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f877c0cda30 0x7f877c0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48816/0 (socket says 172.21.15.93:48816) 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 -- 172.21.15.93:0/3490382729 learned_addr learned my addr 172.21.15.93:0/3490382729 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f877bfff640 1 --2- 172.21.15.93:0/3490382729 >> v2:172.21.15.125:3300/0 conn(0x7f877c15ae40 0x7f877c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 -- 172.21.15.93:0/3490382729 >> v2:172.21.15.125:3300/0 conn(0x7f877c15ae40 msgr2=0x7f877c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 --2- 172.21.15.93:0/3490382729 >> v2:172.21.15.125:3300/0 conn(0x7f877c15ae40 0x7f877c15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 -- 172.21.15.93:0/3490382729 >> v1:172.21.15.125:6789/0 conn(0x7f877c0cbc00 legacy=0x7f877c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.701+0000 7f8780cac640 1 -- 172.21.15.93:0/3490382729 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c15f890 con 0x7f877c0cda30 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.702+0000 7f8780cac640 1 --2- 172.21.15.93:0/3490382729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cda30 0x7f877c0ced70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f877c06e580 tx=0x7f877402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bd01f922a65871 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.702+0000 7f877affd640 1 -- 172.21.15.93:0/3490382729 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877402ca80 con 0x7f877c0cda30 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.702+0000 7f877affd640 1 -- 172.21.15.93:0/3490382729 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877402cbe0 con 0x7f877c0cda30 2023-11-04T01:36:20.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.702+0000 7f877affd640 1 -- 172.21.15.93:0/3490382729 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740343f0 con 0x7f877c0cda30 2023-11-04T01:36:20.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 -- 172.21.15.93:0/3490382729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cda30 msgr2=0x7f877c0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 --2- 172.21.15.93:0/3490382729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cda30 0x7f877c0ced70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f877c06e580 tx=0x7f877402bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 -- 172.21.15.93:0/3490382729 shutdown_connections 2023-11-04T01:36:20.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 --2- 172.21.15.93:0/3490382729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cda30 0x7f877c0ced70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 --2- 172.21.15.93:0/3490382729 >> v2:172.21.15.125:3300/0 conn(0x7f877c15ae40 0x7f877c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 -- 172.21.15.93:0/3490382729 >> 172.21.15.93:0/3490382729 conn(0x7f877c06ea90 msgr2=0x7f877c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 -- 172.21.15.93:0/3490382729 shutdown_connections 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.703+0000 7f878270f640 1 -- 172.21.15.93:0/3490382729 wait complete. 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.704+0000 7f878270f640 1 Processor -- start 2023-11-04T01:36:20.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.704+0000 7f878270f640 1 -- start start 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f877c0cda30 0x7f877c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f877c15ae40 0x7f877c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0b0b40 con 0x7f877c0cbc00 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0c7c70 con 0x7f877c15ae40 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c06c3e0 con 0x7f877c0cda30 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48824/0 (socket says 172.21.15.93:48824) 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 -- 172.21.15.93:0/2712719353 learned_addr learned my addr 172.21.15.93:0/2712719353 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:20.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f8780cac640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f877c15ae40 0x7f877c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877b7fe640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f877c0cda30 0x7f877c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 -- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f877c0cda30 msgr2=0x7f877c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f877c0cda30 0x7f877c0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 -- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f877c15ae40 msgr2=0x7f877c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f877c15ae40 0x7f877c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 -- 172.21.15.93:0/2712719353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009b30 con 0x7f877c0cbc00 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f877bfff640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f876c00c7f0 tx=0x7f876c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c004220 con 0x7f877c0cbc00 2023-11-04T01:36:20.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c004380 con 0x7f877c0cbc00 2023-11-04T01:36:20.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c06c6c0 con 0x7f877c0cbc00 2023-11-04T01:36:20.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c007840 con 0x7f877c0cbc00 2023-11-04T01:36:20.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.705+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c0caa00 con 0x7f877c0cbc00 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.706+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c0ce2d0 con 0x7f877c0cbc00 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.707+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f876c0079a0 con 0x7f877c0cbc00 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.707+0000 7f8778ff9640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 0x7f876806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.707+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f876c089580 con 0x7f877c0cbc00 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.707+0000 7f877b7fe640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 0x7f876806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.707+0000 7f877b7fe640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 0x7f876806d360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f877c06f910 tx=0x7f8770009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:20.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.711+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f876c0543d0 con 0x7f877c0cbc00 2023-11-04T01:36:20.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:20.809 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.914+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f877c0d0410 con 0x7f877c0cbc00 2023-11-04T01:36:20.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.914+0000 7f8778ff9640 1 -- 172.21.15.93:0/2712719353 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f876c0579f0 con 0x7f877c0cbc00 2023-11-04T01:36:20.917 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:20.917 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:20.917 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 msgr2=0x7f876806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 0x7f876806d360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f877c06f910 tx=0x7f8770009040 comp rx=0 tx=0).stop 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 msgr2=0x7f877c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f876c00c7f0 tx=0x7f876c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 shutdown_connections 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876806aea0 0x7f876806d360 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f877c15ae40 0x7f877c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f877c0cda30 0x7f877c0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 --2- 172.21.15.93:0/2712719353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f877c0cbc00 0x7f877c0b30d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:20.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 >> 172.21.15.93:0/2712719353 conn(0x7f877c06ea90 msgr2=0x7f877c0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:20.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 shutdown_connections 2023-11-04T01:36:20.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:20.916+0000 7f878270f640 1 -- 172.21.15.93:0/2712719353 wait complete. 2023-11-04T01:36:21.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:35:51.391271+0000', 'modified': '2023-11-04T01:36:08.444963+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6835/2694324946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6834', 'nonce': 2694324946}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 2694324946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:36:21.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:36:21.332 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:36:21.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.430+0000 7f421f464640 1 Processor -- start 2023-11-04T01:36:21.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.431+0000 7f421f464640 1 -- start start 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.431+0000 7f421f464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42180b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.431+0000 7f421f464640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180cde60 con 0x7f42180cd6d0 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.431+0000 7f421f464640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4218160f90 con 0x7f4218153e60 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.431+0000 7f421f464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180b5200 con 0x7f42180b4880 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f421c9ff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f42180cd6d0 0x7f4218161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50206/0 (socket says 172.21.15.93:50206) 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f421c9ff640 1 -- 172.21.15.93:0/3791633635 learned_addr learned my addr 172.21.15.93:0/3791633635 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:21.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f421da01640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42180b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669590098 0 0) 0x7f42180cde60 con 0x7f42180cd6d0 2023-11-04T01:36:21.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4200003520 con 0x7f42180cd6d0 2023-11-04T01:36:21.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537227290 0 0) 0x7f4200003520 con 0x7f42180cd6d0 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 msgr2=0x7f42180b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42180b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 >> v1:172.21.15.125:6789/0 conn(0x7f4218153e60 legacy=0x7f421815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180ce090 con 0x7f42180cd6d0 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f420c001670 con 0x7f42180cd6d0 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 >> v1:172.21.15.93:6789/0 conn(0x7f42180cd6d0 legacy=0x7f4218161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f4200003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4200004d00 0x7f4200005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180b5200 con 0x7f42000039a0 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420000ba30 con 0x7f4200004d00 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420000bbc0 con 0x7f42180b4880 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f421d200640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f4200003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.432+0000 7f421c9ff640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421da01640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4200004d00 0x7f4200005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 -- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 msgr2=0x7f42000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42180b4880 0x7f42000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 -- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4200004d00 msgr2=0x7f4200005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4200004d00 0x7f4200005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 -- 172.21.15.93:0/3791633635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200003520 con 0x7f42000039a0 2023-11-04T01:36:21.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.433+0000 7f421d200640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f4200003d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4210001f90 tx=0x7f42000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bba4f1dba5d6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421002c710 con 0x7f42000039a0 2023-11-04T01:36:21.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421002c890 con 0x7f42000039a0 2023-11-04T01:36:21.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f4217fff640 1 -- 172.21.15.93:0/3791633635 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421002cc40 con 0x7f42000039a0 2023-11-04T01:36:21.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 -- 172.21.15.93:0/3791633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 msgr2=0x7f4200003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 --2- 172.21.15.93:0/3791633635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f4200003d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4210001f90 tx=0x7f42000057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421da01640 1 -- 172.21.15.93:0/3791633635 reap_dead start 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 -- 172.21.15.93:0/3791633635 shutdown_connections 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 -- 172.21.15.93:0/3791633635 >> 172.21.15.93:0/3791633635 conn(0x7f42180cf880 msgr2=0x7f42180cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 -- 172.21.15.93:0/3791633635 shutdown_connections 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.434+0000 7f421f464640 1 -- 172.21.15.93:0/3791633635 wait complete. 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.435+0000 7f421f464640 1 Processor -- start 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 -- start start 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4218156620 0x7f42180c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180c88f0 0x7f42180c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181f36b0 con 0x7f42000039a0 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c8d70 con 0x7f42180c88f0 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421f464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42181f2a30 con 0x7f4218156620 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34012/0 (socket says 172.21.15.93:34012) 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421d200640 1 -- 172.21.15.93:0/708701515 learned_addr learned my addr 172.21.15.93:0/708701515 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421da01640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180c88f0 0x7f42180c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.436+0000 7f421c9ff640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4218156620 0x7f42180c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 -- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4218156620 msgr2=0x7f42180c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4218156620 0x7f42180c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 -- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180c88f0 msgr2=0x7f42180c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180c88f0 0x7f42180c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 -- 172.21.15.93:0/708701515 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42181f2d10 con 0x7f42000039a0 2023-11-04T01:36:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421d200640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f421002c0b0 tx=0x7f42100015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f4215ffb640 1 -- 172.21.15.93:0/708701515 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421002ce80 con 0x7f42000039a0 2023-11-04T01:36:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f4215ffb640 1 -- 172.21.15.93:0/708701515 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210003970 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f4215ffb640 1 -- 172.21.15.93:0/708701515 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210003ce0 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42181f2ff0 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.437+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218156aa0 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.438+0000 7f4215ffb640 1 -- 172.21.15.93:0/708701515 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f421003b070 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.439+0000 7f4215ffb640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 0x7f420406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.439+0000 7f4215ffb640 1 -- 172.21.15.93:0/708701515 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42100aa770 con 0x7f42000039a0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.439+0000 7f421c9ff640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 0x7f420406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.439+0000 7f421c9ff640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 0x7f420406d360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4218161220 tx=0x7f420c001170 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.440+0000 7f4221ffa740 1 Processor -- start 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.440+0000 7f4221ffa740 1 -- start start 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e6625750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e6652c30 0x5646e66555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e6536740 con 0x5646e6625c90 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65988d0 con 0x5646e6652850 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646e6595fc0 con 0x5646e6652c30 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34028/0 (socket says 172.21.15.93:34028) 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 -- 172.21.15.93:0/1725763129 learned_addr learned my addr 172.21.15.93:0/1725763129 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421d200640 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e6625750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421c9ff640 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e6652c30 0x5646e66555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 -- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e6652c30 msgr2=0x5646e66555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e6652c30 0x5646e66555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 -- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 msgr2=0x5646e6625750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e6625750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 -- 172.21.15.93:0/1725763129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e6554ca0 con 0x5646e6625c90 2023-11-04T01:36:21.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f421da01640 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f42180c9e50 tx=0x7f4208009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d83e5f8c7053ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f41feffd640 1 -- 172.21.15.93:0/1725763129 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208014d00 con 0x5646e6625c90 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f41feffd640 1 -- 172.21.15.93:0/1725763129 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208014e60 con 0x5646e6625c90 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.441+0000 7f41feffd640 1 -- 172.21.15.93:0/1725763129 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420801d640 con 0x5646e6625c90 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 -- 172.21.15.93:0/1725763129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 msgr2=0x5646e6655b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f42180c9e50 tx=0x7f4208009e80 comp rx=0 tx=0).stop 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 -- 172.21.15.93:0/1725763129 shutdown_connections 2023-11-04T01:36:21.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6625c90 0x5646e6655b20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e6652c30 0x5646e66555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 --2- 172.21.15.93:0/1725763129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e6625750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 -- 172.21.15.93:0/1725763129 >> 172.21.15.93:0/1725763129 conn(0x5646e6627a60 msgr2=0x5646e66705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 -- 172.21.15.93:0/1725763129 shutdown_connections 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.442+0000 7f4221ffa740 1 -- 172.21.15.93:0/1725763129 wait complete. 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.443+0000 7f4221ffa740 1 -- start start 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.443+0000 7f4221ffa740 1 Processor -- start 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.443+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e66686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6668c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65918b0 con 0x5646e6652850 2023-11-04T01:36:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e654bc80 con 0x5646e6652c30 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646e654b920 con 0x5646e66594d0 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 10 client.0 _ll_register_callbacks cb 0x5646e62a3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34036/0 (socket says 172.21.15.93:34036) 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 -- 172.21.15.93:0/3932292615 learned_addr learned my addr 172.21.15.93:0/3932292615 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421da01640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6668c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421c9ff640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e66686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 -- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 msgr2=0x5646e6668c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6668c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 -- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 msgr2=0x5646e66686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e66686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 -- 172.21.15.93:0/3932292615 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208009720 con 0x5646e6652850 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f421d200640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4210001f90 tx=0x7f4210078d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0864d5fc07fb6c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f41f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421007d3d0 con 0x5646e6652850 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4210081580 con 0x5646e6652850 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e653dbf0 con 0x5646e6652850 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f421007d030 con 0x5646e6652850 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 10 client.4902 fetch_fsmap learned FSMap version 9 2023-11-04T01:36:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.444+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5646e658ff30 con 0x5646e6652850 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646e653dbf0 con 0x5646e6652850 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f4210078820 con 0x5646e6652850 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 10 client.4902 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 10 client.4902 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 20 client.4902 populate_metadata read hostname 'smithi093' 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e6658300 0x5646e66839b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 4 client.4902 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 --> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646e658a890 con 0x5646e6658300 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f421c9ff640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e6658300 0x5646e66839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f421c9ff640 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e6658300 0x5646e66839b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6595b6c2fa05f39 server_cookie=f5c2df9d42c60a41 in_seq=0 out_seq=0 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.445+0000 7f41f3fff640 10 client.4902 ms_handle_connect on v2:172.21.15.125:6834/2694324946 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f41f3fff640 1 -- 172.21.15.93:0/3932292615 <== mds.0 v2:172.21.15.125:6834/2694324946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5646e658a890 con 0x5646e6658300 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f41f3fff640 10 client.4902 handle_command_reply: tid=0 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 client.4902 shutdown 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 msgr2=0x5646e6643b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4210001f90 tx=0x7f4210078d00 comp rx=0 tx=0).stop 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 shutdown_connections 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e6658300 0x5646e66839b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6668c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e66686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f41f3fff640 0 client.4902 ms_handle_reset on v2:172.21.15.125:6834/2694324946 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 --2- 172.21.15.93:0/3932292615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643b80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 >> 172.21.15.93:0/3932292615 conn(0x5646e6625c90 msgr2=0x5646e6629600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 shutdown_connections 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 1 -- 172.21.15.93:0/3932292615 wait complete. 2023-11-04T01:36:21.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.446+0000 7f4221ffa740 20 client.4902 trim_cache size 0 max 16384 2023-11-04T01:36:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 Processor -- start 2023-11-04T01:36:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 -- start start 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6673af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e6511280 con 0x5646e6652850 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e662be60 con 0x5646e6652c30 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646e6669680 con 0x5646e66594d0 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.462+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34044/0 (socket says 172.21.15.93:34044) 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 -- 172.21.15.93:0/2122025062 learned_addr learned my addr 172.21.15.93:0/2122025062 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421da01640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6673af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421c9ff640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 -- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 msgr2=0x5646e6673af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6673af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 -- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 msgr2=0x5646e666b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 -- 172.21.15.93:0/2122025062 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e652dd10 con 0x5646e6652850 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421da01640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6673af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f421d200640 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4210037040 tx=0x7f421003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ec936cbdd6cc54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f41ff7fe640 1 -- 172.21.15.93:0/2122025062 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421007d1e0 con 0x5646e6652850 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f41ff7fe640 1 -- 172.21.15.93:0/2122025062 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210078e70 con 0x5646e6652850 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f41ff7fe640 1 -- 172.21.15.93:0/2122025062 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210003e40 con 0x5646e6652850 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f4221ffa740 1 -- 172.21.15.93:0/2122025062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 msgr2=0x5646e6643a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.463+0000 7f4221ffa740 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4210037040 tx=0x7f421003f000 comp rx=0 tx=0).stop 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 -- 172.21.15.93:0/2122025062 shutdown_connections 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e6673af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 --2- 172.21.15.93:0/2122025062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652850 0x5646e6643a30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 -- 172.21.15.93:0/2122025062 >> 172.21.15.93:0/2122025062 conn(0x5646e6625c90 msgr2=0x5646e6620c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 -- 172.21.15.93:0/2122025062 shutdown_connections 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 -- 172.21.15.93:0/2122025062 wait complete. 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 -- start start 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.464+0000 7f4221ffa740 1 Processor -- start 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e66db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e666bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e662a4f0 con 0x5646e6652c30 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e662a950 con 0x5646e6652850 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646e667ee30 con 0x5646e66594d0 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f4221ffa740 10 client.0 _ll_register_callbacks cb 0x7f4208009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34052/0 (socket says 172.21.15.93:34052) 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 -- 172.21.15.93:0/214685778 learned_addr learned my addr 172.21.15.93:0/214685778 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421da01640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e666bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421d200640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e66db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 -- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 msgr2=0x5646e666bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e666bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 -- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 msgr2=0x5646e66db0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e66db0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.465+0000 7f421c9ff640 1 -- 172.21.15.93:0/214685778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646e658ff30 con 0x5646e6652c30 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f421c9ff640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f420c0011e0 tx=0x7f420c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b461e3a23bdbe93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c01a040 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f420c02a490 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4208014e60 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f420c02a650 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 10 client.4908 fetch_fsmap learned FSMap version 9 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5646e6553500 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208014e60 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f420c020040 con 0x5646e6652c30 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 10 client.4908 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 10 client.4908 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 20 client.4908 populate_metadata read hostname 'smithi093' 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e66de4d0 0x5646e66461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 4 client.4908 mds_command: new command op to 4315 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 --> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5646e658a5b0 con 0x5646e66de4d0 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.466+0000 7f421d200640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e66de4d0 0x5646e66461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f41f3fff640 10 client.4908 ms_handle_connect on v2:172.21.15.125:6834/2694324946 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f421d200640 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e66de4d0 0x5646e66461b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb510839dcd7401 server_cookie=37a8e55f8432e87f in_seq=0 out_seq=0 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f41f3fff640 1 -- 172.21.15.93:0/214685778 <== mds.0 v2:172.21.15.125:6834/2694324946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5646e658a5b0 con 0x5646e66de4d0 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f41f3fff640 10 client.4908 handle_command_reply: tid=0 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 client.4908 shutdown 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 msgr2=0x5646e666b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f420c0011e0 tx=0x7f420c015000 comp rx=0 tx=0).stop 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 shutdown_connections 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:6834/2694324946,v1:172.21.15.125:6835/2694324946] conn(0x5646e66de4d0 0x5646e66461b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5646e66594d0 0x5646e666bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f41f3fff640 0 client.4908 ms_handle_reset on v2:172.21.15.125:6834/2694324946 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5646e6652c30 0x5646e666b570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 --2- 172.21.15.93:0/214685778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5646e6652850 0x5646e66db0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 >> 172.21.15.93:0/214685778 conn(0x5646e6625c90 msgr2=0x5646e6620c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 shutdown_connections 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 1 -- 172.21.15.93:0/214685778 wait complete. 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.467+0000 7f4221ffa740 20 client.4908 trim_cache size 0 max 16384 2023-11-04T01:36:21.481 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4315, 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 29.411468039999999, 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 9, 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 24, 2023-11-04T01:36:21.482 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:36:21.483 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 36.431242986000001 2023-11-04T01:36:21.483 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 msgr2=0x7f420406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 0x7f420406d360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4218161220 tx=0x7f420c001170 comp rx=0 tx=0).stop 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 msgr2=0x7f42181f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f421002c0b0 tx=0x7f42100015b0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 shutdown_connections 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f420406aea0 0x7f420406d360 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180c88f0 0x7f42180c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4218156620 0x7f42180c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 --2- 172.21.15.93:0/708701515 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000039a0 0x7f42181f69b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 >> 172.21.15.93:0/708701515 conn(0x7f42180cf880 msgr2=0x7f421815fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 shutdown_connections 2023-11-04T01:36:21.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.468+0000 7f421f464640 1 -- 172.21.15.93:0/708701515 wait complete. 2023-11-04T01:36:21.485 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:36:21.497 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:36:21.497 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:36:21.497 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:36:21.498 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:21.498 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:21.498 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:36:21.498 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:21.498 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:21.499 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:36:21.499 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:21.499 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:21.499 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:36:21.499 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:21.499 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:21.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:21.500 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-04T01:36:21.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:21.519 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-11-04T01:36:21.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:36:21.597 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2023-11-04T01:36:21.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:21.597 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:36:21.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-04T01:36:21.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:21.613 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:21.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:21.680 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-11-04T01:36:21.780 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:36:21.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:21.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.878+0000 7f2883b16640 1 Processor -- start 2023-11-04T01:36:21.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.879+0000 7f2883b16640 1 -- start start 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.879+0000 7f2883b16640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f287c0ce240 0x7f287c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.879+0000 7f2883b16640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c15e000 con 0x7f287c157540 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.879+0000 7f2883b16640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c15e2e0 con 0x7f287c0cde60 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.879+0000 7f2883b16640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c15e5c0 con 0x7f287c0ce240 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28810b1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f287c0ce240 0x7f287c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28820b3640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f287c157540 0x7f287c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50218/0 (socket says 172.21.15.93:50218) 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28820b3640 1 -- 172.21.15.93:0/581829093 learned_addr learned my addr 172.21.15.93:0/581829093 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28810b1640 1 -- 172.21.15.93:0/581829093 >> v1:172.21.15.125:6789/0 conn(0x7f287c0cde60 legacy=0x7f287c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28808b0640 1 -- 172.21.15.93:0/581829093 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109763356 0 0) 0x7f287c15e000 con 0x7f287c157540 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28810b1640 1 -- 172.21.15.93:0/581829093 >> v1:172.21.15.93:6789/0 conn(0x7f287c157540 legacy=0x7f287c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.880+0000 7f28810b1640 1 -- 172.21.15.93:0/581829093 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0d1120 con 0x7f287c0ce240 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f28810b1640 1 --2- 172.21.15.93:0/581829093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ce240 0x7f287c157000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6267aa46fe1b3ab5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f28808b0640 1 -- 172.21.15.93:0/581829093 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c031830 con 0x7f287c0ce240 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f28808b0640 1 -- 172.21.15.93:0/581829093 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c031990 con 0x7f287c0ce240 2023-11-04T01:36:21.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f28808b0640 1 -- 172.21.15.93:0/581829093 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c031d20 con 0x7f287c0ce240 2023-11-04T01:36:21.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 -- 172.21.15.93:0/581829093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ce240 msgr2=0x7f287c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 --2- 172.21.15.93:0/581829093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ce240 0x7f287c157000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 -- 172.21.15.93:0/581829093 shutdown_connections 2023-11-04T01:36:21.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 --2- 172.21.15.93:0/581829093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ce240 0x7f287c157000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 -- 172.21.15.93:0/581829093 >> 172.21.15.93:0/581829093 conn(0x7f287c071f30 msgr2=0x7f287c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:21.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 -- 172.21.15.93:0/581829093 shutdown_connections 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.881+0000 7f2883b16640 1 -- 172.21.15.93:0/581829093 wait complete. 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 Processor -- start 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 -- start start 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f287c0ce240 0x7f287c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287c157540 0x7f287c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c153830 con 0x7f287c0cde60 2023-11-04T01:36:21.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c152ff0 con 0x7f287c157540 2023-11-04T01:36:21.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f2883b16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c153270 con 0x7f287c0ce240 2023-11-04T01:36:21.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f28818b2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f28818b2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34074/0 (socket says 172.21.15.93:34074) 2023-11-04T01:36:21.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.883+0000 7f28818b2640 1 -- 172.21.15.93:0/3126392095 learned_addr learned my addr 172.21.15.93:0/3126392095 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:21.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28820b3640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287c157540 0x7f287c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28810b1640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f287c0ce240 0x7f287c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 -- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f287c0ce240 msgr2=0x7f287c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f287c0ce240 0x7f287c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 -- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287c157540 msgr2=0x7f287c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287c157540 0x7f287c155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 -- 172.21.15.93:0/3126392095 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009400 con 0x7f287c0cde60 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28818b2640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f287800c7f0 tx=0x7f287800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800aa50 con 0x7f287c0cde60 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800abb0 con 0x7f287c0cde60 2023-11-04T01:36:21.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878012420 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c153550 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.884+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1f20a0 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.885+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c0cb2b0 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.885+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2878012580 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.886+0000 7f28727fc640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 0x7f286006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.886+0000 7f28810b1640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 0x7f286006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.886+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28780897b0 con 0x7f287c0cde60 2023-11-04T01:36:21.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.886+0000 7f28810b1640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 0x7f286006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f286c036000 tx=0x7f286c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:21.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:21.890+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f287c0cb2b0 con 0x7f287c0cde60 2023-11-04T01:36:22.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.091+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f287c0cb2b0 con 0x7f287c0cde60 2023-11-04T01:36:22.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.091+0000 7f28727fc640 1 -- 172.21.15.93:0/3126392095 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2878016070 con 0x7f287c0cde60 2023-11-04T01:36:22.094 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:22.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.093+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 msgr2=0x7f286006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.093+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 0x7f286006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f286c036000 tx=0x7f286c008030 comp rx=0 tx=0).stop 2023-11-04T01:36:22.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.093+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 msgr2=0x7f287c1f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:22.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.093+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f287800c7f0 tx=0x7f287800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 shutdown_connections 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f286006ae70 0x7f286006d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287c157540 0x7f287c155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f287c0ce240 0x7f287c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 --2- 172.21.15.93:0/3126392095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0cde60 0x7f287c1f1b60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 >> 172.21.15.93:0/3126392095 conn(0x7f287c071f30 msgr2=0x7f287c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 shutdown_connections 2023-11-04T01:36:22.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:22.094+0000 7f2883b16640 1 -- 172.21.15.93:0/3126392095 wait complete. 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:22.108 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:36:22.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.108 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:36:22.124 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:22.124 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:22.124 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:22.124 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:22.124 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:22.125 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:22.126 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:22.126 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:22.126 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41818sec preferred_lft 41818sec 2023-11-04T01:36:22.126 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:36:22.126 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:22.126 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:22.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2023-11-04T01:36:22.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:22.128 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:22.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.232 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:22.258 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:36:22.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.259 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:36:22.315 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:36:22.315 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:22.315 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:22.315 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:22.315 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:22.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:22.316 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:22.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.413 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:36:22.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.427 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-11-04T01:36:22.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.482 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:22.482 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:22.482 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:22.482 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:36:22.482 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:22.564 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:36:22.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.564 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:36:22.565 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:22.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.690 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:22.690 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:22.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:36:22.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:22.690 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:22.732 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:36:22.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:22.733 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:22.791 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:36:22.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:22.792 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:22.851 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:22.909 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:22.909 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:22.909 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:22.909 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:22.910 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:22.910 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:22.910 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:22.910 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:22.910 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:22.915 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:22.916 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:22.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:22.917 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:22.963 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:22.964 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:36:23.006 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:23.024 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:23.025 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:23.026 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:23.027 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:23.027 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:23.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:23.027 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:23.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:36:23.098+0000 7ff50263f480 -1 init, newargv = 0x555d809a9fc0 newargc=15 2023-11-04T01:36:23.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[129133]: starting ceph client 2023-11-04T01:36:23.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[129133]: starting fuse 2023-11-04T01:36:24.181 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:24.201 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:24.202 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:24.203 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:24.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:24.204 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:24.259 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:36:24.259 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:36:24.260 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:36:24.261 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:36:24.388 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.129133.asok 2023-11-04T01:36:24.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:24.399 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.129133.asok 2023-11-04T01:36:24.399 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:24.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.129133.asok status 2023-11-04T01:36:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:24.568 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "129133", 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:24.569 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4923, 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 4923 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 918572292 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:24.570 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 918572292 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.4923 192.168.0.1:0/918572292", 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/918572292", 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 9, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 24, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:36:24.571 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:36:24.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:24.583 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.680+0000 7fcbe6dd0640 1 Processor -- start 2023-11-04T01:36:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.680+0000 7fcbe6dd0640 1 -- start start 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe6dd0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 0x7fcbe015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe6dd0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe6dd0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe015e000 con 0x7fcbe015daa0 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe6dd0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe015e5c0 con 0x7fcbe00ce240 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe6dd0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe015e2e0 con 0x7fcbe00cde60 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe536d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe536d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34076/0 (socket says 172.21.15.93:34076) 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.681+0000 7fcbe536d640 1 -- 172.21.15.93:0/3266923824 learned_addr learned my addr 172.21.15.93:0/3266923824 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe4b6c640 1 --2- 172.21.15.93:0/3266923824 >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 0x7fcbe015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe536d640 1 -- 172.21.15.93:0/3266923824 >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 msgr2=0x7fcbe015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe536d640 1 --2- 172.21.15.93:0/3266923824 >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 0x7fcbe015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe536d640 1 -- 172.21.15.93:0/3266923824 >> v1:172.21.15.125:6789/0 conn(0x7fcbe015daa0 legacy=0x7fcbe0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe536d640 1 -- 172.21.15.93:0/3266923824 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00d1120 con 0x7fcbe00ce240 2023-11-04T01:36:24.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe4b6c640 1 --2- 172.21.15.93:0/3266923824 >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 0x7fcbe015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:24.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.682+0000 7fcbe536d640 1 --2- 172.21.15.93:0/3266923824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b5550 tx=0x7fcbd802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99637faac119d150 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbdf7fe640 1 -- 172.21.15.93:0/3266923824 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd802ca80 con 0x7fcbe00ce240 2023-11-04T01:36:24.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbdf7fe640 1 -- 172.21.15.93:0/3266923824 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd802cbe0 con 0x7fcbe00ce240 2023-11-04T01:36:24.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbdf7fe640 1 -- 172.21.15.93:0/3266923824 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80343f0 con 0x7fcbe00ce240 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/3266923824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe00ce240 msgr2=0x7fcbe00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/3266923824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b5550 tx=0x7fcbd802bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/3266923824 shutdown_connections 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/3266923824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/3266923824 >> v2:172.21.15.125:3300/0 conn(0x7fcbe00cde60 0x7fcbe015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/3266923824 >> 172.21.15.93:0/3266923824 conn(0x7fcbe0071f30 msgr2=0x7fcbe00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/3266923824 shutdown_connections 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.683+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/3266923824 wait complete. 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.684+0000 7fcbe6dd0640 1 Processor -- start 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.684+0000 7fcbe6dd0640 1 -- start start 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe00cde60 0x7fcbe014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01f2db0 con 0x7fcbe015daa0 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01f27c0 con 0x7fcbe00ce240 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe6dd0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe014dd20 con 0x7fcbe00cde60 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34082/0 (socket says 172.21.15.93:34082) 2023-11-04T01:36:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 -- 172.21.15.93:0/2761814709 learned_addr learned my addr 172.21.15.93:0/2761814709 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe4b6c640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe00cde60 0x7fcbe014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbdffff640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 -- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe00cde60 msgr2=0x7fcbe014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe00cde60 0x7fcbe014d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.685+0000 7fcbe536d640 1 -- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe00ce240 msgr2=0x7fcbe00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbe536d640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbe536d640 1 -- 172.21.15.93:0/2761814709 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009b30 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbe536d640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009f40 tx=0x7fcbd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd803e450 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd803e5d0 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe01f2a40 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd803e980 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.686+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe014e000 con 0x7fcbe015daa0 2023-11-04T01:36:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.687+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe01f2f60 con 0x7fcbe015daa0 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.687+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbd802cd50 con 0x7fcbe015daa0 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.688+0000 7fcbdd7fa640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 0x7fcbcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.688+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbd80ac130 con 0x7fcbe015daa0 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.688+0000 7fcbe4b6c640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 0x7fcbcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.688+0000 7fcbe4b6c640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 0x7fcbcc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00d3f10 tx=0x7fcbd0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.692+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbe01f2f60 con 0x7fcbe015daa0 2023-11-04T01:36:24.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.892+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcbe01f2f60 con 0x7fcbe015daa0 2023-11-04T01:36:24.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.892+0000 7fcbdd7fa640 1 -- 172.21.15.93:0/2761814709 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcbe01f2f60 con 0x7fcbe015daa0 2023-11-04T01:36:24.895 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:24.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 msgr2=0x7fcbcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 0x7fcbcc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00d3f10 tx=0x7fcbd0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 msgr2=0x7fcbe00d1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009f40 tx=0x7fcbd8004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 shutdown_connections 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcbcc06aea0 0x7fcbcc06d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbe015daa0 0x7fcbe00d1e60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbe00ce240 0x7fcbe00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 --2- 172.21.15.93:0/2761814709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcbe00cde60 0x7fcbe014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 >> 172.21.15.93:0/2761814709 conn(0x7fcbe0071f30 msgr2=0x7fcbe00c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 shutdown_connections 2023-11-04T01:36:24.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:24.894+0000 7fcbe6dd0640 1 -- 172.21.15.93:0/2761814709 wait complete. 2023-11-04T01:36:24.907 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:24.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:24.907 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:36:24.907 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:36:24.907 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:24.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:24.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:24.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:24.908 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:36:24.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:24.908 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:24.925 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:24.926 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41815sec preferred_lft 41815sec 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:36:24.927 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:24.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:24.928 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:24.991 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:36:24.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:24.992 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:36:25.048 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:36:25.048 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:25.048 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:25.048 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:25.048 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:25.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:25.049 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:25.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.144 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:36:25.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:36:25.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.163 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-11-04T01:36:25.217 INFO:teuthology.orchestra.run.smithi093.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:36:25.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.220 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:25.220 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:25.220 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:25.220 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:36:25.220 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:25.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.300 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:25.367 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether fa:dd:2f:88:0e:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f8dd:2fff:fe88:ee5/64 scope link 2023-11-04T01:36:25.368 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:36:25.435 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:25.435 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:25.435 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:25.435 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.435 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether fa:dd:2f:88:0e:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f8dd:2fff:fe88:ee5/64 scope link 2023-11-04T01:36:25.436 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:25.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:36:25.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:36:25.438 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:25.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.562 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:36:25.562 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:36:25.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.1 up 2023-11-04T01:36:25.563 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:36:25.563 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:36:25.604 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:36:25.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:25.604 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:25.665 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:36:25.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:25.666 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:25.721 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:25.777 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:25.778 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:25.779 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:25.780 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:25.781 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:25.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.781 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:25.833 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:36:25.833 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-04T01:36:25.833 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:36:25.876 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:25.894 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:25.895 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:25.896 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:25.897 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:25.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:25.901 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:25.950 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:36:25.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:2023-11-04T01:36:25.963+0000 7f8402cbb480 -1 init, newargv = 0x5627e50b72b0 newargc=15 2023-11-04T01:36:25.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:ceph-fuse[129621]: starting ceph client 2023-11-04T01:36:25.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:ceph-fuse[129621]: starting fuse 2023-11-04T01:36:27.052 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:36:27.071 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:27.072 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:27.073 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:36:27.074 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:27.074 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:27.074 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:36:27.074 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:27.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.074 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:36:27.129 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:36:27.129 INFO:teuthology.orchestra.run.smithi093.stdout:44 2023-11-04T01:36:27.129 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-04T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.2")) 2023-11-04T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:36:27.254 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.2.129621.asok 2023-11-04T01:36:27.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:27.265 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.129621.asok 2023-11-04T01:36:27.265 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:27.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.129621.asok status 2023-11-04T01:36:27.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:27.433 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "2", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "129621", 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4935, 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 4935 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2370329879 2023-11-04T01:36:27.435 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2370329879 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.4935 192.168.0.2:0/2370329879", 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.2:0/2370329879", 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 9, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 24, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:27.436 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:36:27.437 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:36:27.437 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:36:27.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:27.448 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:27.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 Processor -- start 2023-11-04T01:36:27.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 -- start start 2023-11-04T01:36:27.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8dd00cda30 0x7f8dd0165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00cc450 con 0x7f8dd015ae40 2023-11-04T01:36:27.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd015f400 con 0x7f8dd015bfb0 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dd67cc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd015b220 con 0x7f8dd00cda30 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dcffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8dd015ae40 0x7f8dd00cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50222/0 (socket says 172.21.15.93:50222) 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.545+0000 7f8dcffff640 1 -- 172.21.15.93:0/4133018968 learned_addr learned my addr 172.21.15.93:0/4133018968 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dd4d69640 1 --2- 172.21.15.93:0/4133018968 >> v2:172.21.15.125:3300/0 conn(0x7f8dd00cda30 0x7f8dd0165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26659348 0 0) 0x7f8dc0001110 con 0x7f8dd015ae40 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db8003520 con 0x7f8dd015ae40 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531234485 0 0) 0x7f8db8003520 con 0x7f8dd015ae40 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dd4d69640 1 -- 172.21.15.93:0/4133018968 >> v1:172.21.15.125:6789/0 conn(0x7f8dd015bfb0 legacy=0x7f8dd00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dd4d69640 1 -- 172.21.15.93:0/4133018968 >> v1:172.21.15.93:6789/0 conn(0x7f8dd015ae40 legacy=0x7f8dd00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.546+0000 7f8dd4d69640 1 -- 172.21.15.93:0/4133018968 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd015f890 con 0x7f8dd00cda30 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dd4d69640 1 --2- 172.21.15.93:0/4133018968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd0165ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009d90 tx=0x7f8dc802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d1b6d4352d97c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0001800 con 0x7f8dd00cda30 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc802c940 con 0x7f8dd00cda30 2023-11-04T01:36:27.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dceffd640 1 -- 172.21.15.93:0/4133018968 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc802ccb0 con 0x7f8dd00cda30 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4133018968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 msgr2=0x7f8dd0165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.547+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4133018968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd0165ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009d90 tx=0x7f8dc802be10 comp rx=0 tx=0).stop 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.548+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4133018968 shutdown_connections 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.548+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4133018968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd0165ce0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.548+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4133018968 >> 172.21.15.93:0/4133018968 conn(0x7f8dd006ea90 msgr2=0x7f8dd006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.548+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4133018968 shutdown_connections 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.548+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4133018968 wait complete. 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.549+0000 7f8dd67cc640 1 Processor -- start 2023-11-04T01:36:27.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.549+0000 7f8dd67cc640 1 -- start start 2023-11-04T01:36:27.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd00c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dd015bfb0 0x7f8dd00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00c3d60 con 0x7f8dd015ae40 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00c4980 con 0x7f8dd00cda30 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00ca710 con 0x7f8dd015bfb0 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34094/0 (socket says 172.21.15.93:34094) 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 -- 172.21.15.93:0/4099505801 learned_addr learned my addr 172.21.15.93:0/4099505801 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd4d69640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dd015bfb0 0x7f8dd00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcffff640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd00c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 -- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dd015bfb0 msgr2=0x7f8dd00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dd015bfb0 0x7f8dd00c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 -- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 msgr2=0x7f8dd00c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd00c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 -- 172.21.15.93:0/4099505801 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8009a70 con 0x7f8dd015ae40 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dcf7fe640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c400 tx=0x7f8dc400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40052d0 con 0x7f8dd015ae40 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4005430 con 0x7f8dd015ae40 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00ca9f0 con 0x7f8dd015ae40 2023-11-04T01:36:27.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4003830 con 0x7f8dd015ae40 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.550+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd00c4f00 con 0x7f8dd015ae40 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.551+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd00c50c0 con 0x7f8dd015ae40 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.552+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dc4003990 con 0x7f8dd015ae40 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.552+0000 7f8dccff9640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 0x7f8dbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.552+0000 7f8dcffff640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 0x7f8dbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.552+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8dc4088e80 con 0x7f8dd015ae40 2023-11-04T01:36:27.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.553+0000 7f8dcffff640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 0x7f8dbc06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0005880 tx=0x7f8dc0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.557+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8dc4053c40 con 0x7f8dd015ae40 2023-11-04T01:36:27.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.758+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8dd00ce2d0 con 0x7f8dd015ae40 2023-11-04T01:36:27.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.759+0000 7f8dccff9640 1 -- 172.21.15.93:0/4099505801 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8dc4017070 con 0x7f8dd015ae40 2023-11-04T01:36:27.763 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 msgr2=0x7f8dbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 0x7f8dbc06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0005880 tx=0x7f8dc0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 msgr2=0x7f8dd00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c400 tx=0x7f8dc400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 shutdown_connections 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dbc06ae70 0x7f8dbc06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dd015bfb0 0x7f8dd00c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dd015ae40 0x7f8dd00c7c70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 --2- 172.21.15.93:0/4099505801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dd00cda30 0x7f8dd00c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 >> 172.21.15.93:0/4099505801 conn(0x7f8dd006ea90 msgr2=0x7f8dd00d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 shutdown_connections 2023-11-04T01:36:27.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:27.761+0000 7f8dd67cc640 1 -- 172.21.15.93:0/4099505801 wait complete. 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:27.774 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:36:27.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.775 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:27.794 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42478sec preferred_lft 42478sec 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-11-04T01:36:27.795 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:27.796 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:27.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:27.796 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:27.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:27.973 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:28.005 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-04T01:36:28.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.006 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-04T01:36:28.074 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-04T01:36:28.075 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:28.075 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:28.075 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:28.075 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:28.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.075 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:28.075 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:28.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:28.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:28.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:28.076 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:28.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.341 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-04T01:36:28.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.360 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-11-04T01:36:28.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.415 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:28.415 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:28.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:28.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:36:28.415 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:28.500 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:36:28.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:36:28.501 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:28.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.602 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:28.602 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:28.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-11-04T01:36:28.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:28.602 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:28.645 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:36:28.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:28.645 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:28.701 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:36:28.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:28.701 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:28.756 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:28.812 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:28.813 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:28.814 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:28.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.815 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:28.867 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:28.867 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:36:28.910 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:28.925 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:28.926 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:28.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:28.928 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:29.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:2023-11-04T01:36:29.010+0000 7ffa82cb3480 -1 init, newargv = 0x56344633aaa0 newargc=15 2023-11-04T01:36:29.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:ceph-fuse[93724]: starting ceph client 2023-11-04T01:36:29.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:ceph-fuse[93724]: starting fuse 2023-11-04T01:36:30.085 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:30.103 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:30.105 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:30.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.106 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:30.160 INFO:teuthology.orchestra.run.smithi125.stdout:41 2023-11-04T01:36:30.160 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:36:30.161 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:30.162 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:30.163 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.1")) 2023-11-04T01:36:30.163 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-04T01:36:30.283 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.1.93724.asok 2023-11-04T01:36:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:30.293 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.93724.asok 2023-11-04T01:36:30.293 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:30.293 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.93724.asok status 2023-11-04T01:36:30.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "1", 2023-11-04T01:36:30.461 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "93724", 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4568, 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4568 2023-11-04T01:36:30.462 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1053045232 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1053045232 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4568 192.168.0.1:0/1053045232", 2023-11-04T01:36:30.463 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/1053045232", 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 9, 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 24, 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-04T01:36:30.464 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-04T01:36:30.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:30.475 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:30.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.580+0000 7ff985aec640 1 Processor -- start 2023-11-04T01:36:30.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.580+0000 7ff985aec640 1 -- start start 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff985aec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9800b42c0 0x7ff9800c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff985aec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800c9c40 0x7ff9800b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff985aec640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9800ca090 con 0x7ff98015ad80 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff985aec640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98006cfa0 con 0x7ff9800b42c0 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff985aec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98006d280 con 0x7ff9800c9c40 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9800b42c0 0x7ff9800c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9800b42c0 0x7ff9800c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34100/0 (socket says 172.21.15.93:34100) 2023-11-04T01:36:30.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 -- 172.21.15.93:0/1316610958 learned_addr learned my addr 172.21.15.93:0/1316610958 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:30.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97ffff640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800c9c40 0x7ff9800b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 -- 172.21.15.93:0/1316610958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800c9c40 msgr2=0x7ff9800b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:30.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800c9c40 0x7ff9800b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.581+0000 7ff97effd640 1 -- 172.21.15.93:0/1316610958 >> v1:172.21.15.125:6789/0 conn(0x7ff98015ad80 legacy=0x7ff98006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.582+0000 7ff97effd640 1 -- 172.21.15.93:0/1316610958 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98006d560 con 0x7ff9800b42c0 2023-11-04T01:36:30.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.582+0000 7ff97effd640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9800b42c0 0x7ff9800c9700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff97402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dd5d743ad309f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.582+0000 7ff97e7fc640 1 -- 172.21.15.93:0/1316610958 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97402f840 con 0x7ff9800b42c0 2023-11-04T01:36:30.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.582+0000 7ff97e7fc640 1 -- 172.21.15.93:0/1316610958 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97402f9a0 con 0x7ff9800b42c0 2023-11-04T01:36:30.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.582+0000 7ff97e7fc640 1 -- 172.21.15.93:0/1316610958 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97402fd30 con 0x7ff9800b42c0 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 -- 172.21.15.93:0/1316610958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9800b42c0 msgr2=0x7ff9800c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9800b42c0 0x7ff9800c9700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff97402ba20 comp rx=0 tx=0).stop 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 -- 172.21.15.93:0/1316610958 shutdown_connections 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800c9c40 0x7ff9800b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 --2- 172.21.15.93:0/1316610958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9800b42c0 0x7ff9800c9700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 -- 172.21.15.93:0/1316610958 >> 172.21.15.93:0/1316610958 conn(0x7ff9800ce950 msgr2=0x7ff9800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 -- 172.21.15.93:0/1316610958 shutdown_connections 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.583+0000 7ff985aec640 1 -- 172.21.15.93:0/1316610958 wait complete. 2023-11-04T01:36:30.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.584+0000 7ff985aec640 1 Processor -- start 2023-11-04T01:36:30.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.584+0000 7ff985aec640 1 -- start start 2023-11-04T01:36:30.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800b42c0 0x7ff9800c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9800c9c40 0x7ff9801eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c7d40 con 0x7ff98015ad80 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c8020 con 0x7ff9800c9c40 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff985aec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c8300 con 0x7ff9800b42c0 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff97ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff97ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34104/0 (socket says 172.21.15.93:34104) 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff97ffff640 1 -- 172.21.15.93:0/3417654580 learned_addr learned my addr 172.21.15.93:0/3417654580 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff97effd640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9800c9c40 0x7ff9801eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.585+0000 7ff97f7fe640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800b42c0 0x7ff9800c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 -- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800b42c0 msgr2=0x7ff9800c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800b42c0 0x7ff9800c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 -- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9800c9c40 msgr2=0x7ff9801eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9800c9c40 0x7ff9801eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 -- 172.21.15.93:0/3417654580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740094d0 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff97ffff640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff97800efc0 tx=0x7ff97800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978014480 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800f040 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98015be90 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978014820 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.586+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9800c7930 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.587+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98015c3b0 con 0x7ff98015ad80 2023-11-04T01:36:30.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.587+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff978014980 con 0x7ff98015ad80 2023-11-04T01:36:30.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.588+0000 7ff967fff640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 0x7ff96c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.588+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff97808a350 con 0x7ff98015ad80 2023-11-04T01:36:30.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.588+0000 7ff97f7fe640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 0x7ff96c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.588+0000 7ff97f7fe640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 0x7ff96c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff980146710 tx=0x7ff970009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.592+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff98015c3b0 con 0x7ff98015ad80 2023-11-04T01:36:30.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.794+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff98015c3b0 con 0x7ff98015ad80 2023-11-04T01:36:30.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.795+0000 7ff967fff640 1 -- 172.21.15.93:0/3417654580 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff98015c3b0 con 0x7ff98015ad80 2023-11-04T01:36:30.797 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:30.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 msgr2=0x7ff96c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 0x7ff96c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff980146710 tx=0x7ff970009040 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 msgr2=0x7ff9801e33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff97800efc0 tx=0x7ff97800c490 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 shutdown_connections 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff96c06ae70 0x7ff96c06d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98015ad80 0x7ff9801e33f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9800c9c40 0x7ff9801eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 --2- 172.21.15.93:0/3417654580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9800b42c0 0x7ff9800c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 >> 172.21.15.93:0/3417654580 conn(0x7ff9800ce950 msgr2=0x7ff9800b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 shutdown_connections 2023-11-04T01:36:30.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:30.797+0000 7ff985aec640 1 -- 172.21.15.93:0/3417654580 wait complete. 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:30.810 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:36:30.811 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:30.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:30.811 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:36:30.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.811 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:30.827 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42475sec preferred_lft 42475sec 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-11-04T01:36:30.828 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether ae:af:ab:26:b1:5a brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::3847:aaff:fe3a:594f/64 scope link 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether ae:af:ab:26:b1:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::acaf:abff:fe26:b15a/64 scope link 2023-11-04T01:36:30.829 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:30.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.830 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:30.892 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-11-04T01:36:30.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.894 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:30.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:30.951 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:31.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.046 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-04T01:36:31.062 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:36:31.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.063 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-11-04T01:36:31.119 INFO:teuthology.orchestra.run.smithi125.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:36:31.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.120 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:31.120 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:31.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:31.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:36:31.120 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:31.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.201 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.267 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:31.268 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 36:cf:d0:08:ce:83 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:31.268 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:31.268 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.268 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::34cf:d0ff:fe08:ce83/64 scope link 2023-11-04T01:36:31.268 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.269 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:36:31.335 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 36:cf:d0:08:ce:83 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:36:31.336 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:36:31.336 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.336 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::34cf:d0ff:fe08:ce83/64 scope link 2023-11-04T01:36:31.336 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:31.337 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:36:31.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.337 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:31.337 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:31.337 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:36:31.337 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:31.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:36:31.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:36:31.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:36:31.338 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:31.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.461 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-11-04T01:36:31.461 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-11-04T01:36:31.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.1 up 2023-11-04T01:36:31.461 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:36:31.461 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-11-04T01:36:31.502 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:36:31.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:31.503 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:31.556 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:36:31.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:31.557 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:31.611 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:31.667 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:31.667 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:31.667 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:31.668 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.671 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:31.722 INFO:teuthology.orchestra.run.smithi125.stdout:41 2023-11-04T01:36:31.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-04T01:36:31.723 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:36:31.765 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:31.780 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:31.781 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:31.782 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:31.783 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:31.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:31.784 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:31.835 INFO:teuthology.orchestra.run.smithi125.stdout:41 2023-11-04T01:36:31.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:2023-11-04T01:36:31.854+0000 7fd003e45480 -1 init, newargv = 0x5629838de8f0 newargc=15 2023-11-04T01:36:31.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:ceph-fuse[94176]: starting ceph client 2023-11-04T01:36:31.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:ceph-fuse[94176]: starting fuse 2023-11-04T01:36:32.937 DEBUG:teuthology.orchestra.run.smithi125:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:32.956 INFO:teuthology.orchestra.run.smithi125.stdout:/proc 2023-11-04T01:36:32.956 INFO:teuthology.orchestra.run.smithi125.stdout:/sys 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/dev 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/security 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/shm 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/pts 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/run 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/cgroup 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/pstore 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/bpf 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/ 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/selinux 2023-11-04T01:36:32.957 INFO:teuthology.orchestra.run.smithi125.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/mqueue 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/dev/hugepages 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/debug 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/tracing 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/sys/kernel/config 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/run/user/1000 2023-11-04T01:36:32.958 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:32.959 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:32.960 INFO:teuthology.orchestra.run.smithi125.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:36:32.960 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:32.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:32.960 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-11-04T01:36:33.014 INFO:teuthology.orchestra.run.smithi125.stdout:41 2023-11-04T01:36:33.014 INFO:teuthology.orchestra.run.smithi125.stdout:44 2023-11-04T01:36:33.014 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-11-04T01:36:33.015 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.3")) 2023-11-04T01:36:33.016 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-11-04T01:36:33.140 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.3.94176.asok 2023-11-04T01:36:33.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.151 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94176.asok 2023-11-04T01:36:33.151 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.94176.asok status 2023-11-04T01:36:33.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "3", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "94176", 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-11-04T01:36:33.321 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4768, 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4768 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3737031464 2023-11-04T01:36:33.322 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3737031464 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4768 192.168.0.2:0/3737031464", 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.2:0/3737031464", 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 9, 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 24, 2023-11-04T01:36:33.323 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:33.324 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-11-04T01:36:33.324 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-11-04T01:36:33.324 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-11-04T01:36:33.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:33.334 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:33.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.402 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:36:33.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:33.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.411 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:33.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.478 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.478 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:33.478 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:33.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.536 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:36:33.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.545 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:33.545 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:33.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.611 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.611 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:33.611 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:33.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.673 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-04T01:36:33.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.680 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:33.680 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:33.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.745 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:33.745 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:33.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.803 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-11-04T01:36:33.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:33.810 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:33.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:33.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:33.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:33.876 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:36:33.888 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:36:33.888 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:36:33.888 DEBUG:teuthology.orchestra.run.smithi093:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:36:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.987+0000 7f35b3e21640 1 Processor -- start 2023-11-04T01:36:33.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.987+0000 7f35b3e21640 1 -- start start 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b3e21640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f35ac15d0d0 0x7f35ac0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b3e21640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f35ac15d4b0 0x7f35ac0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b3e21640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac06b450 con 0x7f35ac0c55d0 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b3e21640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0ce480 con 0x7f35ac15d4b0 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b3e21640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac06b6f0 con 0x7f35ac15d0d0 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f35ac15d4b0 0x7f35ac0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f35ac15d4b0 0x7f35ac0c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39142/0 (socket says 172.21.15.93:39142) 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 -- 172.21.15.93:0/2878846077 learned_addr learned my addr 172.21.15.93:0/2878846077 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b1bbd640 1 --2- 172.21.15.93:0/2878846077 >> v2:172.21.15.125:3300/0 conn(0x7f35ac15d0d0 0x7f35ac0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 -- 172.21.15.93:0/2878846077 >> v2:172.21.15.125:3300/0 conn(0x7f35ac15d0d0 msgr2=0x7f35ac0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 --2- 172.21.15.93:0/2878846077 >> v2:172.21.15.125:3300/0 conn(0x7f35ac15d0d0 0x7f35ac0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 -- 172.21.15.93:0/2878846077 >> v1:172.21.15.125:6789/0 conn(0x7f35ac0c55d0 legacy=0x7f35ac15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.988+0000 7f35b13bc640 1 -- 172.21.15.93:0/2878846077 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0ce760 con 0x7f35ac15d4b0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b13bc640 1 --2- 172.21.15.93:0/2878846077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d4b0 0x7f35ac0c9b20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0677d0 tx=0x7f359c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf048c588b277e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b0bbb640 1 -- 172.21.15.93:0/2878846077 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c030860 con 0x7f35ac15d4b0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b0bbb640 1 -- 172.21.15.93:0/2878846077 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0309c0 con 0x7f35ac15d4b0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b0bbb640 1 -- 172.21.15.93:0/2878846077 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c030d50 con 0x7f35ac15d4b0 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b3e21640 1 -- 172.21.15.93:0/2878846077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d4b0 msgr2=0x7f35ac0c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.989+0000 7f35b3e21640 1 --2- 172.21.15.93:0/2878846077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d4b0 0x7f35ac0c9b20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0677d0 tx=0x7f359c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 -- 172.21.15.93:0/2878846077 shutdown_connections 2023-11-04T01:36:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 --2- 172.21.15.93:0/2878846077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d4b0 0x7f35ac0c9b20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 --2- 172.21.15.93:0/2878846077 >> v2:172.21.15.125:3300/0 conn(0x7f35ac15d0d0 0x7f35ac0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 -- 172.21.15.93:0/2878846077 >> 172.21.15.93:0/2878846077 conn(0x7f35ac0ce9c0 msgr2=0x7f35ac0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 -- 172.21.15.93:0/2878846077 shutdown_connections 2023-11-04T01:36:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.990+0000 7f35b3e21640 1 -- 172.21.15.93:0/2878846077 wait complete. 2023-11-04T01:36:33.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 Processor -- start 2023-11-04T01:36:33.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 -- start start 2023-11-04T01:36:33.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35ac0c55d0 0x7f35ac0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 0x7f35ac144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0b3df0 con 0x7f35ac15d0d0 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac144c40 con 0x7f35ac15d4b0 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.991+0000 7f35b3e21640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0b3170 con 0x7f35ac0c55d0 2023-11-04T01:36:33.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39150/0 (socket says 172.21.15.93:39150) 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 -- 172.21.15.93:0/584663548 learned_addr learned my addr 172.21.15.93:0/584663548 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b1bbd640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35ac0c55d0 0x7f35ac0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 -- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35ac0c55d0 msgr2=0x7f35ac0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35ac0c55d0 0x7f35ac0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b23be640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 0x7f35ac144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 -- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 msgr2=0x7f35ac144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 0x7f35ac144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 -- 172.21.15.93:0/584663548 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0094d0 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b23be640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 0x7f35ac144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b13bc640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f359c02b9e0 tx=0x7f359c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c039b60 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c039ce0 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0b3450 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c043650 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.992+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0b3a10 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.993+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac0b3f30 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.994+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f359c04c3b0 con 0x7f35ac15d0d0 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.994+0000 7f35a27fc640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 0x7f359006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.994+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f359c0abf80 con 0x7f35ac15d0d0 2023-11-04T01:36:34.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.994+0000 7f35b1bbd640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 0x7f359006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.995+0000 7f35b1bbd640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 0x7f359006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:33.998+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35ac0b3f30 con 0x7f35ac15d0d0 2023-11-04T01:36:34.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.166+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f35ac0b3f30 con 0x7f35ac15d0d0 2023-11-04T01:36:34.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.169+0000 7f35a27fc640 1 -- 172.21.15.93:0/584663548 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f35ac0b3f30 con 0x7f35ac15d0d0 2023-11-04T01:36:34.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 msgr2=0x7f359006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 0x7f359006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:34.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 msgr2=0x7f35ac0b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f359c02b9e0 tx=0x7f359c004730 comp rx=0 tx=0).stop 2023-11-04T01:36:34.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 shutdown_connections 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f359006ae70 0x7f359006d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35ac15d4b0 0x7f35ac144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35ac15d0d0 0x7f35ac0b4210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 --2- 172.21.15.93:0/584663548 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35ac0c55d0 0x7f35ac0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.171+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 >> 172.21.15.93:0/584663548 conn(0x7f35ac0ce9c0 msgr2=0x7f35ac15a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.172+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 shutdown_connections 2023-11-04T01:36:34.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.172+0000 7f35b3e21640 1 -- 172.21.15.93:0/584663548 wait complete. 2023-11-04T01:36:34.185 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:36:34.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:34.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.298+0000 7f42490e0640 1 Processor -- start 2023-11-04T01:36:34.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.298+0000 7f42490e0640 1 -- start start 2023-11-04T01:36:34.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f42490e0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42440cde60 0x7f424415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f42490e0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 0x7f4244157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f42490e0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424415e000 con 0x7f42440ce240 2023-11-04T01:36:34.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f42490e0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424415e5c0 con 0x7f42440cde60 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f42490e0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424415e2e0 con 0x7f424415daa0 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f424359e640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f42440ce240 0x7f424406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54468/0 (socket says 172.21.15.93:54468) 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f424359e640 1 -- 172.21.15.93:0/3822167958 learned_addr learned my addr 172.21.15.93:0/3822167958 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f424259c640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 0x7f4244157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.299+0000 7f4242d9d640 1 --2- 172.21.15.93:0/3822167958 >> v2:172.21.15.125:3300/0 conn(0x7f42440cde60 0x7f424415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425155528 0 0) 0x7f424415e000 con 0x7f42440ce240 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f422c003520 con 0x7f42440ce240 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4242d9d640 1 -- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 msgr2=0x7f4244157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4242d9d640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 0x7f4244157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4242d9d640 1 -- 172.21.15.93:0/3822167958 >> v1:172.21.15.93:6789/0 conn(0x7f42440ce240 legacy=0x7f424406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265666626 0 0) 0x7f422c003520 con 0x7f42440ce240 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f4242d9d640 1 -- 172.21.15.93:0/3822167958 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440d1120 con 0x7f42440cde60 2023-11-04T01:36:34.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.300+0000 7f424259c640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 0x7f4244157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f4242d9d640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42440cde60 0x7f424415d560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4234009d90 tx=0x7f423402bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5721fe2c94e59e56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c001670 con 0x7f42440cde60 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423402c8a0 con 0x7f42440cde60 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f4241d9b640 1 -- 172.21.15.93:0/3822167958 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423402cc30 con 0x7f42440cde60 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 -- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42440cde60 msgr2=0x7f424415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42440cde60 0x7f424415d560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4234009d90 tx=0x7f423402bd70 comp rx=0 tx=0).stop 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 -- 172.21.15.93:0/3822167958 shutdown_connections 2023-11-04T01:36:34.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f424415daa0 0x7f4244157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 --2- 172.21.15.93:0/3822167958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42440cde60 0x7f424415d560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 -- 172.21.15.93:0/3822167958 >> 172.21.15.93:0/3822167958 conn(0x7f4244071f30 msgr2=0x7f42440cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 -- 172.21.15.93:0/3822167958 shutdown_connections 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.301+0000 7f42490e0640 1 -- 172.21.15.93:0/3822167958 wait complete. 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 Processor -- start 2023-11-04T01:36:34.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 -- start start 2023-11-04T01:36:34.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42440cde60 0x7f42441e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f424415daa0 0x7f4244151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441e7840 con 0x7f42440ce240 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244151ca0 con 0x7f424415daa0 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f42490e0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440cb260 con 0x7f42440cde60 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.303+0000 7f424259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39166/0 (socket says 172.21.15.93:39166) 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 -- 172.21.15.93:0/1970237812 learned_addr learned my addr 172.21.15.93:0/1970237812 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f4242d9d640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42440cde60 0x7f42441e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424359e640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f424415daa0 0x7f4244151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 -- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42440cde60 msgr2=0x7f42441e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42440cde60 0x7f42441e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 -- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f424415daa0 msgr2=0x7f4244151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f424415daa0 0x7f4244151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 -- 172.21.15.93:0/1970237812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238009400 con 0x7f42440ce240 2023-11-04T01:36:34.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f424259c640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f423800e960 tx=0x7f423800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800ca00 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800cb60 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4234009a70 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238013470 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.304+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440cb820 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.305+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440cffb0 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.306+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42380135d0 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.306+0000 7f422b7fe640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 0x7f423006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.306+0000 7f4242d9d640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 0x7f423006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.306+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4238089ac0 con 0x7f42440ce240 2023-11-04T01:36:34.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.307+0000 7f4242d9d640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 0x7f423006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4234036000 tx=0x7f4234030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.310+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42380548f0 con 0x7f42440ce240 2023-11-04T01:36:34.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.479+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4244074290 con 0x7f42440ce240 2023-11-04T01:36:34.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.480+0000 7f422b7fe640 1 -- 172.21.15.93:0/1970237812 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f4238017090 con 0x7f42440ce240 2023-11-04T01:36:34.483 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:34.483 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 msgr2=0x7f423006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 0x7f423006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4234036000 tx=0x7f4234030000 comp rx=0 tx=0).stop 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 msgr2=0x7f42441f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f423800e960 tx=0x7f423800ee20 comp rx=0 tx=0).stop 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 shutdown_connections 2023-11-04T01:36:34.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f423006ae70 0x7f423006d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f424415daa0 0x7f4244151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42440ce240 0x7f42441f2c70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 --2- 172.21.15.93:0/1970237812 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42440cde60 0x7f42441e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 >> 172.21.15.93:0/1970237812 conn(0x7f4244071f30 msgr2=0x7f42440d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 shutdown_connections 2023-11-04T01:36:34.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.482+0000 7f42490e0640 1 -- 172.21.15.93:0/1970237812 wait complete. 2023-11-04T01:36:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:34.496 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:34.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.595+0000 7f977027c640 1 Processor -- start 2023-11-04T01:36:34.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.595+0000 7f977027c640 1 -- start start 2023-11-04T01:36:34.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.596+0000 7f977027c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f976815e430 0x7f97680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.596+0000 7f977027c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97680cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.596+0000 7f977027c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680d0280 con 0x7f97680d0710 2023-11-04T01:36:34.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.596+0000 7f977027c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680cf670 con 0x7f976815e430 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.596+0000 7f977027c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680cf950 con 0x7f97680cf160 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e018640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f976815e430 0x7f97680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e819640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f97680d0710 0x7f97680b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54470/0 (socket says 172.21.15.93:54470) 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e819640 1 -- 172.21.15.93:0/1027781624 learned_addr learned my addr 172.21.15.93:0/1027781624 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e018640 1 -- 172.21.15.93:0/1027781624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 msgr2=0x7f97680cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976d817640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97680cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e018640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97680cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e018640 1 -- 172.21.15.93:0/1027781624 >> v1:172.21.15.93:6789/0 conn(0x7f97680d0710 legacy=0x7f97680b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976d016640 1 -- 172.21.15.93:0/1027781624 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085072853 0 0) 0x7f97680d0280 con 0x7f97680d0710 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976e018640 1 -- 172.21.15.93:0/1027781624 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cfc30 con 0x7f976815e430 2023-11-04T01:36:34.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.597+0000 7f976d817640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f976e018640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f976815e430 0x7f97680cec20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9764009d90 tx=0x7f976402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e743493a47efd9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f976d016640 1 -- 172.21.15.93:0/1027781624 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976402cc50 con 0x7f976815e430 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f976d016640 1 -- 172.21.15.93:0/1027781624 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976402cdb0 con 0x7f976815e430 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f976d016640 1 -- 172.21.15.93:0/1027781624 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764034660 con 0x7f976815e430 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 -- 172.21.15.93:0/1027781624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f976815e430 msgr2=0x7f97680cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f976815e430 0x7f97680cec20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9764009d90 tx=0x7f976402bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 -- 172.21.15.93:0/1027781624 shutdown_connections 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 --2- 172.21.15.93:0/1027781624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f976815e430 0x7f97680cec20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 -- 172.21.15.93:0/1027781624 >> 172.21.15.93:0/1027781624 conn(0x7f976806ea20 msgr2=0x7f976806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 -- 172.21.15.93:0/1027781624 shutdown_connections 2023-11-04T01:36:34.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.598+0000 7f977027c640 1 -- 172.21.15.93:0/1027781624 wait complete. 2023-11-04T01:36:34.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 Processor -- start 2023-11-04T01:36:34.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 -- start start 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97681e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f976815e430 0x7f97680b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b19b0 con 0x7f97680d0710 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976814c8a0 con 0x7f976815e430 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f977027c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b0b20 con 0x7f97680cf160 2023-11-04T01:36:34.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f976d817640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f976d817640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39184/0 (socket says 172.21.15.93:39184) 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.600+0000 7f976d817640 1 -- 172.21.15.93:0/3468234545 learned_addr learned my addr 172.21.15.93:0/3468234545 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976e018640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97681e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976e819640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f976815e430 0x7f97680b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 -- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 msgr2=0x7f97681e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97681e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 -- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f976815e430 msgr2=0x7f97680b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f976815e430 0x7f97680b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 -- 172.21.15.93:0/3468234545 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009a70 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976e018640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97681e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f976d817640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f975800c7f0 tx=0x7f975800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758007820 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758007980 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680b0da0 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758007d10 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.601+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97680b1360 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.602+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768074290 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.602+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97580113f0 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.603+0000 7f975effd640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.603+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9758089c90 con 0x7f97680d0710 2023-11-04T01:36:34.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.603+0000 7f976e018640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.603+0000 7f976e018640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 0x7f974c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9764036000 tx=0x7f9764030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.607+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9758054980 con 0x7f97680d0710 2023-11-04T01:36:34.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.771+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f976815c110 con 0x7f97680d0710 2023-11-04T01:36:34.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.772+0000 7f975effd640 1 -- 172.21.15.93:0/3468234545 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f975801f0a0 con 0x7f97680d0710 2023-11-04T01:36:34.774 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 msgr2=0x7f974c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 0x7f974c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9764036000 tx=0x7f9764030000 comp rx=0 tx=0).stop 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 msgr2=0x7f976806ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f975800c7f0 tx=0x7f975800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 shutdown_connections 2023-11-04T01:36:34.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f976815e430 0x7f97680b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97680d0710 0x7f976806ce70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 --2- 172.21.15.93:0/3468234545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97680cf160 0x7f97681e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 >> 172.21.15.93:0/3468234545 conn(0x7f976806ea20 msgr2=0x7f976815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 shutdown_connections 2023-11-04T01:36:34.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.774+0000 7f977027c640 1 -- 172.21.15.93:0/3468234545 wait complete. 2023-11-04T01:36:34.787 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:34.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.886+0000 7fbd614fc640 1 Processor -- start 2023-11-04T01:36:34.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.886+0000 7fbd614fc640 1 -- start start 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd614fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd614fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd5c0cd6d0 0x7fbd5c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd614fc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c0cde60 con 0x7fbd5c0b4880 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd614fc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c160f90 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd614fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15e400 con 0x7fbd5c153e60 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd5b7fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbd5c0b4880 0x7fbd5c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:43272/0 (socket says 172.21.15.93:43272) 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd5b7fe640 1 -- 172.21.15.93:0/1043804841 learned_addr learned my addr 172.21.15.93:0/1043804841 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd5affd640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.887+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/1043804841 >> v2:172.21.15.125:3300/0 conn(0x7fbd5c0cd6d0 0x7fbd5c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd59ffb640 1 -- 172.21.15.93:0/1043804841 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940489588 0 0) 0x7fbd5c0cde60 con 0x7fbd5c0b4880 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd59ffb640 1 -- 172.21.15.93:0/1043804841 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd44003520 con 0x7fbd5c0b4880 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd5a7fc640 1 -- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 msgr2=0x7fbd5c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:34.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd5a7fc640 1 -- 172.21.15.93:0/1043804841 >> v1:172.21.15.125:6789/0 conn(0x7fbd5c0b4880 legacy=0x7fbd5c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd5a7fc640 1 -- 172.21.15.93:0/1043804841 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c161960 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.888+0000 7fbd5affd640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c161420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74067a48da76c24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd59ffb640 1 -- 172.21.15.93:0/1043804841 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5002d040 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd59ffb640 1 -- 172.21.15.93:0/1043804841 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50031810 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd59ffb640 1 -- 172.21.15.93:0/1043804841 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50031ba0 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 -- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 msgr2=0x7fbd5c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c161420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 -- 172.21.15.93:0/1043804841 shutdown_connections 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c161420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 --2- 172.21.15.93:0/1043804841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 -- 172.21.15.93:0/1043804841 >> 172.21.15.93:0/1043804841 conn(0x7fbd5c0cf880 msgr2=0x7fbd5c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 -- 172.21.15.93:0/1043804841 shutdown_connections 2023-11-04T01:36:34.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.889+0000 7fbd614fc640 1 -- 172.21.15.93:0/1043804841 wait complete. 2023-11-04T01:36:34.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.890+0000 7fbd614fc640 1 Processor -- start 2023-11-04T01:36:34.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 -- start start 2023-11-04T01:36:34.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c1f3600 con 0x7fbd5c0b4880 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c1f29c0 con 0x7fbd5c0cd6d0 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd614fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c158220 con 0x7fbd5c153e60 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd5affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd5affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39188/0 (socket says 172.21.15.93:39188) 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd5affd640 1 -- 172.21.15.93:0/4135461806 learned_addr learned my addr 172.21.15.93:0/4135461806 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd5b7fe640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.891+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 -- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 msgr2=0x7fbd5c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 -- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 msgr2=0x7fbd5c15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 -- 172.21.15.93:0/4135461806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c009a70 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd5affd640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00efc0 tx=0x7fbd4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c014680 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c00f040 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50009400 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c014a00 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.892+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c1f2f40 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.893+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c074290 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.893+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd4c014b60 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.894+0000 7fbd437fe640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 0x7fbd4806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.894+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd4c08a7d0 con 0x7fbd5c0b4880 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.894+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 0x7fbd4806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.894+0000 7fbd5a7fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 0x7fbd4806d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd50036000 tx=0x7fbd5003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:34.898+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd4c055580 con 0x7fbd5c0b4880 2023-11-04T01:36:35.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.061+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd5c0d3c50 con 0x7fbd5c0b4880 2023-11-04T01:36:35.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.061+0000 7fbd437fe640 1 -- 172.21.15.93:0/4135461806 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd4c058ba0 con 0x7fbd5c0b4880 2023-11-04T01:36:35.064 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 msgr2=0x7fbd4806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 0x7fbd4806d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd50036000 tx=0x7fbd5003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 msgr2=0x7fbd5c150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00efc0 tx=0x7fbd4c00c490 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 shutdown_connections 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4806aea0 0x7fbd4806d360 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd5c153e60 0x7fbd5c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd5c0cd6d0 0x7fbd5c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 --2- 172.21.15.93:0/4135461806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd5c0b4880 0x7fbd5c150730 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 >> 172.21.15.93:0/4135461806 conn(0x7fbd5c0cf880 msgr2=0x7fbd5c15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 shutdown_connections 2023-11-04T01:36:35.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.063+0000 7fbd614fc640 1 -- 172.21.15.93:0/4135461806 wait complete. 2023-11-04T01:36:35.076 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:35.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.177+0000 7fa773b9e640 1 Processor -- start 2023-11-04T01:36:35.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.177+0000 7fa773b9e640 1 -- start start 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa773b9e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa76c160430 0x7fa76c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa773b9e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0b2fc0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa773b9e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c06c7d0 con 0x7fa76c06c3a0 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa773b9e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0cb580 con 0x7fa76c160430 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa77193a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa76c160430 0x7fa76c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa771139640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa76c0b2b60 0x7fa76c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54482/0 (socket says 172.21.15.93:54482) 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa771139640 1 -- 172.21.15.93:0/3170327485 learned_addr learned my addr 172.21.15.93:0/3170327485 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa77193a640 1 -- 172.21.15.93:0/3170327485 >> v1:172.21.15.125:6789/0 conn(0x7fa76c06c3a0 legacy=0x7fa76c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa77193a640 1 -- 172.21.15.93:0/3170327485 >> v1:172.21.15.93:6789/0 conn(0x7fa76c0b2b60 legacy=0x7fa76c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa77193a640 1 -- 172.21.15.93:0/3170327485 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c06ca40 con 0x7fa76c160430 2023-11-04T01:36:35.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.178+0000 7fa770938640 1 -- 172.21.15.93:0/3170327485 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864150372 0 0) 0x7fa76c0b2fc0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.179+0000 7fa77193a640 1 --2- 172.21.15.93:0/3170327485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c160430 0x7fa76c0b2620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa7680097a0 tx=0x7fa76802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d83b2922c7cd54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.179+0000 7fa770938640 1 -- 172.21.15.93:0/3170327485 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031830 con 0x7fa76c160430 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.179+0000 7fa770938640 1 -- 172.21.15.93:0/3170327485 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768031990 con 0x7fa76c160430 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.179+0000 7fa770938640 1 -- 172.21.15.93:0/3170327485 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031d20 con 0x7fa76c160430 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 -- 172.21.15.93:0/3170327485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c160430 msgr2=0x7fa76c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 --2- 172.21.15.93:0/3170327485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c160430 0x7fa76c0b2620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa7680097a0 tx=0x7fa76802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 -- 172.21.15.93:0/3170327485 shutdown_connections 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 --2- 172.21.15.93:0/3170327485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c160430 0x7fa76c0b2620 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 -- 172.21.15.93:0/3170327485 >> 172.21.15.93:0/3170327485 conn(0x7fa76c06ea20 msgr2=0x7fa76c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 -- 172.21.15.93:0/3170327485 shutdown_connections 2023-11-04T01:36:35.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.180+0000 7fa773b9e640 1 -- 172.21.15.93:0/3170327485 wait complete. 2023-11-04T01:36:35.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.181+0000 7fa773b9e640 1 Processor -- start 2023-11-04T01:36:35.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.181+0000 7fa773b9e640 1 -- start start 2023-11-04T01:36:35.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa76c06c3a0 0x7fa76c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa76c160430 0x7fa76c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b51e0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c152940 con 0x7fa76c06c3a0 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b45d0 con 0x7fa76c160430 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39200/0 (socket says 172.21.15.93:39200) 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 -- 172.21.15.93:0/978255748 learned_addr learned my addr 172.21.15.93:0/978255748 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 -- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa76c160430 msgr2=0x7fa76c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa76c160430 0x7fa76c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 -- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa76c06c3a0 msgr2=0x7fa76c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa76c06c3a0 0x7fa76c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 -- 172.21.15.93:0/978255748 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009400 con 0x7fa76c0b2b60 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa771139640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c500 tx=0x7fa75c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c007560 con 0x7fa76c0b2b60 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0047e0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.182+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c0b48b0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.183+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c004b90 con 0x7fa76c0b2b60 2023-11-04T01:36:35.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.183+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0b4e70 con 0x7fa76c0b2b60 2023-11-04T01:36:35.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.184+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c074290 con 0x7fa76c0b2b60 2023-11-04T01:36:35.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.184+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa75c004cf0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.184+0000 7fa7627fc640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 0x7fa75006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.185+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa75c088ec0 con 0x7fa76c0b2b60 2023-11-04T01:36:35.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.185+0000 7fa77193a640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 0x7fa75006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.185+0000 7fa77193a640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 0x7fa75006d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa768036000 tx=0x7fa768030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.189+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa75c053c40 con 0x7fa76c0b2b60 2023-11-04T01:36:35.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.354+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa76c0b5320 con 0x7fa76c0b2b60 2023-11-04T01:36:35.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.355+0000 7fa7627fc640 1 -- 172.21.15.93:0/978255748 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa75c018020 con 0x7fa76c0b2b60 2023-11-04T01:36:35.357 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:35.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.356+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 msgr2=0x7fa75006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.356+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 0x7fa75006d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa768036000 tx=0x7fa768030000 comp rx=0 tx=0).stop 2023-11-04T01:36:35.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.356+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 msgr2=0x7fa76c0c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.356+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c500 tx=0x7fa75c00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 shutdown_connections 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa75006ae70 0x7fa75006d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa76c160430 0x7fa76c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa76c0b2b60 0x7fa76c0c5f00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 --2- 172.21.15.93:0/978255748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa76c06c3a0 0x7fa76c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 >> 172.21.15.93:0/978255748 conn(0x7fa76c06ea20 msgr2=0x7fa76c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 shutdown_connections 2023-11-04T01:36:35.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.357+0000 7fa773b9e640 1 -- 172.21.15.93:0/978255748 wait complete. 2023-11-04T01:36:35.370 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:35.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.475+0000 7fc0bae56640 1 Processor -- start 2023-11-04T01:36:35.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.475+0000 7fc0bae56640 1 -- start start 2023-11-04T01:36:35.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.475+0000 7fc0bae56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0b406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0bae56640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b406ca40 con 0x7fc0b40b2d30 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0bae56640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b406cd20 con 0x7fc0b4160430 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0bae56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40cb580 con 0x7fc0b40cccc0 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc0b40b2d30 0x7fc0b406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54490/0 (socket says 172.21.15.93:54490) 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b3fff640 1 -- 172.21.15.93:0/1601751293 learned_addr learned my addr 172.21.15.93:0/1601751293 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0b406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342093666 0 0) 0x7fc0b406ca40 con 0x7fc0b40b2d30 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a0003520 con 0x7fc0b40b2d30 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416232555 0 0) 0x7fc0b406cd20 con 0x7fc0b4160430 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b406ca40 con 0x7fc0b4160430 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524601681 0 0) 0x7fc0a0003520 con 0x7fc0b40b2d30 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 msgr2=0x7fc0b406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0b406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 >> v1:172.21.15.125:6789/0 conn(0x7fc0b4160430 legacy=0x7fc0b40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b406d000 con 0x7fc0b40b2d30 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fc09c001670 con 0x7fc0b40b2d30 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 >> v1:172.21.15.93:6789/0 conn(0x7fc0b40b2d30 legacy=0x7fc0b406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0a0003b30 0x7fc0a0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40cb580 con 0x7fc0a0004d00 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a000bb10 con 0x7fc0a0003b30 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a000bca0 con 0x7fc0b40cccc0 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b3fff640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.476+0000 7fc0b8bf2640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0a0003b30 0x7fc0a0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 -- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 msgr2=0x7fc0a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40cccc0 0x7fc0a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 -- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0a0003b30 msgr2=0x7fc0a0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0a0003b30 0x7fc0a0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 -- 172.21.15.93:0/1601751293 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0003520 con 0x7fc0a0004d00 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b8bf2640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0a0003b30 0x7fc0a0003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009af0 tx=0x7fc0a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfe855b75d215f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402c6b0 con 0x7fc0a0004d00 2023-11-04T01:36:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a402c810 con 0x7fc0a0004d00 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.477+0000 7fc0b37fe640 1 -- 172.21.15.93:0/1601751293 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402cba0 con 0x7fc0a0004d00 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 -- 172.21.15.93:0/1601751293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 msgr2=0x7fc0a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 --2- 172.21.15.93:0/1601751293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0a0005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009af0 tx=0x7fc0a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0b93f3640 1 -- 172.21.15.93:0/1601751293 reap_dead start 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 -- 172.21.15.93:0/1601751293 shutdown_connections 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 -- 172.21.15.93:0/1601751293 >> 172.21.15.93:0/1601751293 conn(0x7fc0b406ea20 msgr2=0x7fc0b406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 -- 172.21.15.93:0/1601751293 shutdown_connections 2023-11-04T01:36:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.478+0000 7fc0bae56640 1 -- 172.21.15.93:0/1601751293 wait complete. 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.479+0000 7fc0bae56640 1 Processor -- start 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.479+0000 7fc0bae56640 1 -- start start 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40b3870 0x7fc0b40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0b4152c30 0x7fc0b41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b3d30 con 0x7fc0a0004d00 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b4010 con 0x7fc0b4152c30 2023-11-04T01:36:35.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0bae56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b42f0 con 0x7fc0b40b3870 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b8bf2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b8bf2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39220/0 (socket says 172.21.15.93:39220) 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b8bf2640 1 -- 172.21.15.93:0/526351604 learned_addr learned my addr 172.21.15.93:0/526351604 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b8bf2640 1 -- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40b3870 msgr2=0x7fc0b40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b3fff640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40b3870 0x7fc0b40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b93f3640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0b4152c30 0x7fc0b41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.480+0000 7fc0b8bf2640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40b3870 0x7fc0b40c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b8bf2640 1 -- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0b4152c30 msgr2=0x7fc0b41530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b8bf2640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0b4152c30 0x7fc0b41530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b8bf2640 1 -- 172.21.15.93:0/526351604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40b45d0 con 0x7fc0a0004d00 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b8bf2640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00eaf0 tx=0x7fc0ac002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac017070 con 0x7fc0a0004d00 2023-11-04T01:36:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac003b80 con 0x7fc0a0004d00 2023-11-04T01:36:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40b48b0 con 0x7fc0a0004d00 2023-11-04T01:36:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac003cf0 con 0x7fc0a0004d00 2023-11-04T01:36:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.481+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4151640 con 0x7fc0a0004d00 2023-11-04T01:36:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.482+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40b4af0 con 0x7fc0a0004d00 2023-11-04T01:36:35.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.482+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0ac006b50 con 0x7fc0a0004d00 2023-11-04T01:36:35.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.483+0000 7fc0b17fa640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 0x7fc09406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.483+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0ac089660 con 0x7fc0a0004d00 2023-11-04T01:36:35.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.483+0000 7fc0b3fff640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 0x7fc09406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.483+0000 7fc0b3fff640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 0x7fc09406d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40b56a0 tx=0x7fc09c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.487+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0ac054350 con 0x7fc0a0004d00 2023-11-04T01:36:35.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.652+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc0b40cb790 con 0x7fc0a0004d00 2023-11-04T01:36:35.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.652+0000 7fc0b17fa640 1 -- 172.21.15.93:0/526351604 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc0ac001a70 con 0x7fc0a0004d00 2023-11-04T01:36:35.655 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.654+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 msgr2=0x7fc09406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.654+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 0x7fc09406d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40b56a0 tx=0x7fc09c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.654+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 msgr2=0x7fc0b40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.654+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00eaf0 tx=0x7fc0ac002170 comp rx=0 tx=0).stop 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 shutdown_connections 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc09406ae70 0x7fc09406d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0b4152c30 0x7fc0b41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc0b40b3870 0x7fc0b40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 --2- 172.21.15.93:0/526351604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0a0004d00 0x7fc0b40b4dd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 >> 172.21.15.93:0/526351604 conn(0x7fc0b406ea20 msgr2=0x7fc0b40cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 shutdown_connections 2023-11-04T01:36:35.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.655+0000 7fc0bae56640 1 -- 172.21.15.93:0/526351604 wait complete. 2023-11-04T01:36:35.668 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:35.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.767+0000 7f21cf39e640 1 Processor -- start 2023-11-04T01:36:35.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 -- start start 2023-11-04T01:36:35.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21c80cec10 0x7f21c80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f21c80b2b40 0x7f21c80b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80b3c10 con 0x7f21c815ac70 2023-11-04T01:36:35.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cf180 con 0x7f21c80b2b40 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.768+0000 7f21cf39e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cf460 con 0x7f21c80cec10 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd93b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f21c80b2b40 0x7f21c80b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd13a640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f21c815ac70 0x7f21c80d0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54500/0 (socket says 172.21.15.93:54500) 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd13a640 1 -- 172.21.15.93:0/2642489919 learned_addr learned my addr 172.21.15.93:0/2642489919 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cc939640 1 --2- 172.21.15.93:0/2642489919 >> v2:172.21.15.125:3300/0 conn(0x7f21c80cec10 0x7f21c80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd93b640 1 -- 172.21.15.93:0/2642489919 >> v2:172.21.15.125:3300/0 conn(0x7f21c80cec10 msgr2=0x7f21c80b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd93b640 1 --2- 172.21.15.93:0/2642489919 >> v2:172.21.15.125:3300/0 conn(0x7f21c80cec10 0x7f21c80b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd93b640 1 -- 172.21.15.93:0/2642489919 >> v1:172.21.15.93:6789/0 conn(0x7f21c815ac70 legacy=0x7f21c80d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21bffff640 1 -- 172.21.15.93:0/2642489919 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136719153 0 0) 0x7f21c80b3c10 con 0x7f21c815ac70 2023-11-04T01:36:35.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.769+0000 7f21cd93b640 1 -- 172.21.15.93:0/2642489919 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80b2fa0 con 0x7f21c80b2b40 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cd93b640 1 --2- 172.21.15.93:0/2642489919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80b2b40 0x7f21c80b4080 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b3700 tx=0x7f21c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287e8395f1e87832 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21bffff640 1 -- 172.21.15.93:0/2642489919 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031830 con 0x7f21c80b2b40 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21bffff640 1 -- 172.21.15.93:0/2642489919 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4031990 con 0x7f21c80b2b40 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21bffff640 1 -- 172.21.15.93:0/2642489919 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031d20 con 0x7f21c80b2b40 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 -- 172.21.15.93:0/2642489919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80b2b40 msgr2=0x7f21c80b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2642489919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80b2b40 0x7f21c80b4080 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b3700 tx=0x7f21c402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 -- 172.21.15.93:0/2642489919 shutdown_connections 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2642489919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80b2b40 0x7f21c80b4080 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2642489919 >> v2:172.21.15.125:3300/0 conn(0x7f21c80cec10 0x7f21c80b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 -- 172.21.15.93:0/2642489919 >> 172.21.15.93:0/2642489919 conn(0x7f21c80cd600 msgr2=0x7f21c80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 -- 172.21.15.93:0/2642489919 shutdown_connections 2023-11-04T01:36:35.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.770+0000 7f21cf39e640 1 -- 172.21.15.93:0/2642489919 wait complete. 2023-11-04T01:36:35.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.771+0000 7f21cf39e640 1 Processor -- start 2023-11-04T01:36:35.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.771+0000 7f21cf39e640 1 -- start start 2023-11-04T01:36:35.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21c80b2b40 0x7f21c80c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21c815ac70 0x7f21c80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80c5750 con 0x7f21c80cec10 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8155840 con 0x7f21c80b2b40 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cf39e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80c68f0 con 0x7f21c815ac70 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cc939640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cc939640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39238/0 (socket says 172.21.15.93:39238) 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cc939640 1 -- 172.21.15.93:0/2804111471 learned_addr learned my addr 172.21.15.93:0/2804111471 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cd13a640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21c80b2b40 0x7f21c80c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cd93b640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21c815ac70 0x7f21c80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cc939640 1 -- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21c815ac70 msgr2=0x7f21c80c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.772+0000 7f21cc939640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21c815ac70 0x7f21c80c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cc939640 1 -- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21c80b2b40 msgr2=0x7f21c80c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cc939640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21c80b2b40 0x7f21c80c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cc939640 1 -- 172.21.15.93:0/2804111471 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009400 con 0x7f21c80cec10 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cc939640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d800 tx=0x7f21b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800b6c0 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800b820 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c8154f10 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800bbb0 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.773+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c81554d0 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.774+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c80b6b00 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.774+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21b800bd10 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.775+0000 7f21bdffb640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 0x7f21ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.775+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21b8089ea0 con 0x7f21c80cec10 2023-11-04T01:36:35.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.775+0000 7f21cd13a640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 0x7f21ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.775+0000 7f21cd13a640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 0x7f21ac06d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001460 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.779+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21b8054c20 con 0x7f21c80cec10 2023-11-04T01:36:35.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.947+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c80ccf80 con 0x7f21c80cec10 2023-11-04T01:36:35.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.948+0000 7f21bdffb640 1 -- 172.21.15.93:0/2804111471 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f21b8058240 con 0x7f21c80cec10 2023-11-04T01:36:35.951 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:35.951 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:35.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 msgr2=0x7f21ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 0x7f21ac06d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001460 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 msgr2=0x7f21c81f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21b800d800 tx=0x7f21b800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 shutdown_connections 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21ac06aea0 0x7f21ac06d360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f21c815ac70 0x7f21c80c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21c80cec10 0x7f21c81f0300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 --2- 172.21.15.93:0/2804111471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21c80b2b40 0x7f21c80c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 >> 172.21.15.93:0/2804111471 conn(0x7f21c80cd600 msgr2=0x7f21c815d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 shutdown_connections 2023-11-04T01:36:35.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:35.950+0000 7f21cf39e640 1 -- 172.21.15.93:0/2804111471 wait complete. 2023-11-04T01:36:35.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:35.964 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:36.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.065+0000 7fa7a82fc640 1 Processor -- start 2023-11-04T01:36:36.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.065+0000 7fa7a82fc640 1 -- start start 2023-11-04T01:36:36.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a82fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7a015b120 0x7fa7a006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a82fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa7a0070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a82fc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a0065df0 con 0x7fa7a015ad40 2023-11-04T01:36:36.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a82fc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a006bc40 con 0x7fa7a015b120 2023-11-04T01:36:36.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a82fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0066040 con 0x7fa7a00c9b60 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a6098640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa7a015ad40 0x7fa7a015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54518/0 (socket says 172.21.15.93:54518) 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a6098640 1 -- 172.21.15.93:0/1968802094 learned_addr learned my addr 172.21.15.93:0/1968802094 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054123991 0 0) 0x7fa7a0065df0 con 0x7fa7a015ad40 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c003520 con 0x7fa7a015ad40 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5897640 1 --2- 172.21.15.93:0/1968802094 >> v2:172.21.15.125:3300/0 conn(0x7fa7a015b120 0x7fa7a006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a6899640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa7a0070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348757881 0 0) 0x7fa78c003520 con 0x7fa7a015ad40 2023-11-04T01:36:36.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 msgr2=0x7fa7a0070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa7a0070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 >> v2:172.21.15.125:3300/0 conn(0x7fa7a015b120 msgr2=0x7fa7a006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 --2- 172.21.15.93:0/1968802094 >> v2:172.21.15.125:3300/0 conn(0x7fa7a015b120 0x7fa7a006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0066320 con 0x7fa7a015ad40 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa79c001670 con 0x7fa7a015ad40 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5897640 1 --2- 172.21.15.93:0/1968802094 >> v2:172.21.15.125:3300/0 conn(0x7fa7a015b120 0x7fa7a006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 >> v1:172.21.15.93:6789/0 conn(0x7fa7a015ad40 legacy=0x7fa7a015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.066+0000 7fa7a5096640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5096640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa78c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5096640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa78c004d00 0x7fa78c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006bc40 con 0x7fa78c004d00 2023-11-04T01:36:36.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0066040 con 0x7fa78c003970 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00ba30 con 0x7fa7a00c9b60 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa78c004d00 0x7fa78c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6098640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a5897640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa78c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 -- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 msgr2=0x7fa78c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a00c9b60 0x7fa78c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 -- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c003970 msgr2=0x7fa78c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.067+0000 7fa7a6899640 1 -- 172.21.15.93:0/1968802094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c003520 con 0x7fa78c004d00 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a6899640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa78c004d00 0x7fa78c005180 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa798007360 tx=0x7fa78c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d2904d96b7b7d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79802cc80 con 0x7fa78c004d00 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79802cde0 con 0x7fa78c004d00 2023-11-04T01:36:36.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a5096640 1 -- 172.21.15.93:0/1968802094 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798034680 con 0x7fa78c004d00 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 -- 172.21.15.93:0/1968802094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa78c004d00 msgr2=0x7fa78c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/1968802094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa78c004d00 0x7fa78c005180 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa798007360 tx=0x7fa78c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a6899640 1 -- 172.21.15.93:0/1968802094 reap_dead start 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 -- 172.21.15.93:0/1968802094 shutdown_connections 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 -- 172.21.15.93:0/1968802094 >> 172.21.15.93:0/1968802094 conn(0x7fa7a00cbc90 msgr2=0x7fa7a00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 -- 172.21.15.93:0/1968802094 shutdown_connections 2023-11-04T01:36:36.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.068+0000 7fa7a82fc640 1 -- 172.21.15.93:0/1968802094 wait complete. 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 Processor -- start 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 -- start start 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c004d00 0x7fa7a01544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 0x7fa7a015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a015e120 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00cedc0 con 0x7fa78c004d00 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a82fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a01549f0 con 0x7fa7a015d760 2023-11-04T01:36:36.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a5897640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a5897640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39262/0 (socket says 172.21.15.93:39262) 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a5897640 1 -- 172.21.15.93:0/2761425267 learned_addr learned my addr 172.21.15.93:0/2761425267 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a6098640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c004d00 0x7fa7a01544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.070+0000 7fa7a6899640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 0x7fa7a015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 -- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 msgr2=0x7fa7a015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 0x7fa7a015dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 -- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c004d00 msgr2=0x7fa7a01544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c004d00 0x7fa7a01544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 -- 172.21.15.93:0/2761425267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00ce240 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a6899640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 0x7fa7a015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a5897640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7900116d0 tx=0x7fa790011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79000c070 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790004220 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a00ce520 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790015670 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.071+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a00ceae0 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.072+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a0074290 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.072+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7900157d0 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.073+0000 7fa796ffd640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 0x7fa78406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.073+0000 7fa7a6098640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 0x7fa78406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.073+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7900899f0 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.073+0000 7fa7a6098640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 0x7fa78406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa79c007d90 tx=0x7fa79c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.077+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7900546e0 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.246+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7a00ccac0 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.247+0000 7fa796ffd640 1 -- 172.21.15.93:0/2761425267 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa790057d00 con 0x7fa7a00cd7f0 2023-11-04T01:36:36.249 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 msgr2=0x7fa78406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 0x7fa78406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa79c007d90 tx=0x7fa79c0078f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 msgr2=0x7fa7a00cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7900116d0 tx=0x7fa790011ad0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 shutdown_connections 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa78406ae70 0x7fa78406d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7a015d760 0x7fa7a015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7a00cd7f0 0x7fa7a00cdc50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 --2- 172.21.15.93:0/2761425267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa78c004d00 0x7fa7a01544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 >> 172.21.15.93:0/2761425267 conn(0x7fa7a00cbc90 msgr2=0x7fa7a015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 shutdown_connections 2023-11-04T01:36:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.249+0000 7fa7a82fc640 1 -- 172.21.15.93:0/2761425267 wait complete. 2023-11-04T01:36:36.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:36.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.363+0000 7f38b9161640 1 Processor -- start 2023-11-04T01:36:36.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.363+0000 7f38b9161640 1 -- start start 2023-11-04T01:36:36.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b9161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 0x7f38b415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b9161640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f38b40cd6d0 0x7f38b4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b9161640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40cde60 con 0x7f38b40b4880 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b9161640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b4160f90 con 0x7f38b40cd6d0 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b9161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415e400 con 0x7f38b4153e60 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f38b40cd6d0 0x7f38b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f38b40cd6d0 0x7f38b4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39270/0 (socket says 172.21.15.93:39270) 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 -- 172.21.15.93:0/2646513075 learned_addr learned my addr 172.21.15.93:0/2646513075 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 -- 172.21.15.93:0/2646513075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 msgr2=0x7f38b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b2d9d640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 0x7f38b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 0x7f38b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 -- 172.21.15.93:0/2646513075 >> v1:172.21.15.125:6789/0 conn(0x7f38b40b4880 legacy=0x7f38b406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b259c640 1 -- 172.21.15.93:0/2646513075 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4161960 con 0x7f38b40cd6d0 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.364+0000 7f38b2d9d640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 0x7f38b415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:36.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.365+0000 7f38b259c640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b40cd6d0 0x7f38b4161420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009870 tx=0x7f38a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84003b0dc64b4d58 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.365+0000 7f38b1d9b640 1 -- 172.21.15.93:0/2646513075 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031640 con 0x7f38b40cd6d0 2023-11-04T01:36:36.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.365+0000 7f38b1d9b640 1 -- 172.21.15.93:0/2646513075 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a80317a0 con 0x7f38b40cd6d0 2023-11-04T01:36:36.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.365+0000 7f38b1d9b640 1 -- 172.21.15.93:0/2646513075 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031b30 con 0x7f38b40cd6d0 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 -- 172.21.15.93:0/2646513075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b40cd6d0 msgr2=0x7f38b4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b40cd6d0 0x7f38b4161420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009870 tx=0x7f38a802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 -- 172.21.15.93:0/2646513075 shutdown_connections 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b40cd6d0 0x7f38b4161420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 --2- 172.21.15.93:0/2646513075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b4153e60 0x7f38b415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 -- 172.21.15.93:0/2646513075 >> 172.21.15.93:0/2646513075 conn(0x7f38b40cf880 msgr2=0x7f38b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 -- 172.21.15.93:0/2646513075 shutdown_connections 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.366+0000 7f38b9161640 1 -- 172.21.15.93:0/2646513075 wait complete. 2023-11-04T01:36:36.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.367+0000 7f38b9161640 1 Processor -- start 2023-11-04T01:36:36.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.367+0000 7f38b9161640 1 -- start start 2023-11-04T01:36:36.373 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b40b4880 0x7f38b41e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b40cd6d0 0x7f38b41e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415a9b0 con 0x7f38b4153e60 2023-11-04T01:36:36.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4159bc0 con 0x7f38b40b4880 2023-11-04T01:36:36.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b9161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40c7640 con 0x7f38b40cd6d0 2023-11-04T01:36:36.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39280/0 (socket says 172.21.15.93:39280) 2023-11-04T01:36:36.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 -- 172.21.15.93:0/418998126 learned_addr learned my addr 172.21.15.93:0/418998126 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 -- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b40cd6d0 msgr2=0x7f38b41e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b40cd6d0 0x7f38b41e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 -- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b40b4880 msgr2=0x7f38b41e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b2d9d640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b40b4880 0x7f38b41e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.368+0000 7f38b359e640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b40b4880 0x7f38b41e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f38b359e640 1 -- 172.21.15.93:0/418998126 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a80094d0 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f38b359e640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c410 tx=0x7f38ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011790 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac0118f0 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b40c7920 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011ce0 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.369+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b4159500 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.370+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b40c74a0 con 0x7f38b4153e60 2023-11-04T01:36:36.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.370+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38ac01c460 con 0x7f38b4153e60 2023-11-04T01:36:36.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.370+0000 7f389b7fe640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 0x7f38a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.371+0000 7f38b2d9d640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 0x7f38a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.371+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38ac089610 con 0x7f38b4153e60 2023-11-04T01:36:36.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.371+0000 7f38b2d9d640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 0x7f38a006d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f38a4008ee0 tx=0x7f38a4008430 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.375+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38b40c74a0 con 0x7f38b4153e60 2023-11-04T01:36:36.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.540+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38b40c74a0 con 0x7f38b4153e60 2023-11-04T01:36:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.540+0000 7f389b7fe640 1 -- 172.21.15.93:0/418998126 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38b40c74a0 con 0x7f38b4153e60 2023-11-04T01:36:36.543 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 msgr2=0x7f38a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 0x7f38a006d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f38a4008ee0 tx=0x7f38a4008430 comp rx=0 tx=0).stop 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 msgr2=0x7f38b4158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c410 tx=0x7f38ac00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 shutdown_connections 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f38a006ae70 0x7f38a006d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38b4153e60 0x7f38b4158fc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38b40cd6d0 0x7f38b41e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 --2- 172.21.15.93:0/418998126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38b40b4880 0x7f38b41e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 >> 172.21.15.93:0/418998126 conn(0x7f38b40cf880 msgr2=0x7f38b415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 shutdown_connections 2023-11-04T01:36:36.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.542+0000 7f38b9161640 1 -- 172.21.15.93:0/418998126 wait complete. 2023-11-04T01:36:36.555 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:36.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.660+0000 7fc662c56640 1 Processor -- start 2023-11-04T01:36:36.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 -- start start 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc65c153e60 0x7fc65c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc65c0cd6d0 0x7fc65c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0b4880 0x7fc65c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0cde60 con 0x7fc65c153e60 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0b5220 con 0x7fc65c0cd6d0 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc662c56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c160f90 con 0x7fc65c0b4880 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.661+0000 7fc6609f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc65c153e60 0x7fc65c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc65c153e60 0x7fc65c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39282/0 (socket says 172.21.15.93:39282) 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 -- 172.21.15.93:0/2432581351 learned_addr learned my addr 172.21.15.93:0/2432581351 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc65bfff640 1 --2- 172.21.15.93:0/2432581351 >> v2:172.21.15.125:3300/0 conn(0x7fc65c0cd6d0 0x7fc65c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6611f3640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0b4880 0x7fc65c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 -- 172.21.15.93:0/2432581351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0b4880 msgr2=0x7fc65c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0b4880 0x7fc65c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 -- 172.21.15.93:0/2432581351 >> v2:172.21.15.125:3300/0 conn(0x7fc65c0cd6d0 msgr2=0x7fc65c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 --2- 172.21.15.93:0/2432581351 >> v2:172.21.15.125:3300/0 conn(0x7fc65c0cd6d0 0x7fc65c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 -- 172.21.15.93:0/2432581351 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c15e400 con 0x7fc65c153e60 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.662+0000 7fc6609f2640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c15dec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0c9e80 tx=0x7fc64c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da80490cce7a3560 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc65b7fe640 1 -- 172.21.15.93:0/2432581351 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031640 con 0x7fc65c153e60 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc65b7fe640 1 -- 172.21.15.93:0/2432581351 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0317a0 con 0x7fc65c153e60 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc65b7fe640 1 -- 172.21.15.93:0/2432581351 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031b30 con 0x7fc65c153e60 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 -- 172.21.15.93:0/2432581351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 msgr2=0x7fc65c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c15dec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0c9e80 tx=0x7fc64c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 -- 172.21.15.93:0/2432581351 shutdown_connections 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0b4880 0x7fc65c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 --2- 172.21.15.93:0/2432581351 >> v2:172.21.15.125:3300/0 conn(0x7fc65c0cd6d0 0x7fc65c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 --2- 172.21.15.93:0/2432581351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c15dec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 -- 172.21.15.93:0/2432581351 >> 172.21.15.93:0/2432581351 conn(0x7fc65c0cf880 msgr2=0x7fc65c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 -- 172.21.15.93:0/2432581351 shutdown_connections 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.663+0000 7fc662c56640 1 -- 172.21.15.93:0/2432581351 wait complete. 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.664+0000 7fc662c56640 1 Processor -- start 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.664+0000 7fc662c56640 1 -- start start 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 0x7fc65c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 0x7fc65c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c1450d0 con 0x7fc65c153e60 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c1424b0 con 0x7fc65c0b4880 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc662c56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c142790 con 0x7fc65c0cd6d0 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc6611f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc6611f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39294/0 (socket says 172.21.15.93:39294) 2023-11-04T01:36:36.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.665+0000 7fc6611f3640 1 -- 172.21.15.93:0/378656496 learned_addr learned my addr 172.21.15.93:0/378656496 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6609f2640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 0x7fc65c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc65bfff640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 0x7fc65c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 -- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 msgr2=0x7fc65c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 0x7fc65c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 -- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 msgr2=0x7fc65c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 0x7fc65c144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 -- 172.21.15.93:0/378656496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0094d0 con 0x7fc65c153e60 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6609f2640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 0x7fc65c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc65bfff640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 0x7fc65c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6611f3640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc654007e60 tx=0x7fc65400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654014620 con 0x7fc65c153e60 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65400ee90 con 0x7fc65c153e60 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540149e0 con 0x7fc65c153e60 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c142a70 con 0x7fc65c153e60 2023-11-04T01:36:36.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.666+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c143030 con 0x7fc65c153e60 2023-11-04T01:36:36.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.667+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c143250 con 0x7fc65c153e60 2023-11-04T01:36:36.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.667+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc654014b40 con 0x7fc65c153e60 2023-11-04T01:36:36.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.668+0000 7fc6597fa640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 0x7fc64806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.668+0000 7fc6609f2640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 0x7fc64806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.668+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc65408a3c0 con 0x7fc65c153e60 2023-11-04T01:36:36.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.668+0000 7fc6609f2640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 0x7fc64806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc64c036000 tx=0x7fc64c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.672+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc654055020 con 0x7fc65c153e60 2023-11-04T01:36:36.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.837+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc65c074290 con 0x7fc65c153e60 2023-11-04T01:36:36.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.838+0000 7fc6597fa640 1 -- 172.21.15.93:0/378656496 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc654058640 con 0x7fc65c153e60 2023-11-04T01:36:36.840 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:36.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 msgr2=0x7fc64806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 0x7fc64806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc64c036000 tx=0x7fc64c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 msgr2=0x7fc65c155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc654007e60 tx=0x7fc65400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 shutdown_connections 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc64806ae70 0x7fc64806d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc65c153e60 0x7fc65c155290 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc65c0cd6d0 0x7fc65c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 --2- 172.21.15.93:0/378656496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc65c0b4880 0x7fc65c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 >> 172.21.15.93:0/378656496 conn(0x7fc65c0cf880 msgr2=0x7fc65c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 shutdown_connections 2023-11-04T01:36:36.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.840+0000 7fc662c56640 1 -- 172.21.15.93:0/378656496 wait complete. 2023-11-04T01:36:36.853 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:36.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.952+0000 7f45b13ee640 1 Processor -- start 2023-11-04T01:36:36.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.952+0000 7f45b13ee640 1 -- start start 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45b13ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f45ac0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45b13ee640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0cde60 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45b13ee640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac160f90 con 0x7f45ac153e60 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45b13ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b5200 con 0x7f45ac0b4880 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45aa7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f45ac0cd6d0 0x7f45ac161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54520/0 (socket says 172.21.15.93:54520) 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.953+0000 7f45aa7fc640 1 -- 172.21.15.93:0/1656951640 learned_addr learned my addr 172.21.15.93:0/1656951640 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45ab7fe640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f45ac0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243850925 0 0) 0x7f45ac0cde60 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4594003520 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955159746 0 0) 0x7f45ac160f90 con 0x7f45ac153e60 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ac0cde60 con 0x7f45ac153e60 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644787080 0 0) 0x7f4594003520 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 msgr2=0x7f45ac0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f45ac0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 >> v1:172.21.15.125:6789/0 conn(0x7f45ac153e60 legacy=0x7f45ac15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0ce090 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f45a00015f0 con 0x7f45ac0cd6d0 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 >> v1:172.21.15.93:6789/0 conn(0x7f45ac0cd6d0 legacy=0x7f45ac161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f4594003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594004d00 0x7f4594005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b5200 con 0x7f45940040e0 2023-11-04T01:36:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459400bac0 con 0x7f4594004d00 2023-11-04T01:36:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459400bc80 con 0x7f45ac0b4880 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aaffd640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f4594003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45ab7fe640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594004d00 0x7f4594005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 -- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 msgr2=0x7f4594003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f4594003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 -- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594004d00 msgr2=0x7f4594005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594004d00 0x7f4594005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aa7fc640 1 -- 172.21.15.93:0/1656951640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594003520 con 0x7f45940040e0 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45ab7fe640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4594004d00 0x7f4594005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.954+0000 7f45aaffd640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0b4880 0x7f4594003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.955+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45940047c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007ef0 tx=0x7f45940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663932125129604d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.955+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0005ad0 con 0x7f45940040e0 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.955+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a0005c50 con 0x7f45940040e0 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.955+0000 7f45a9ffb640 1 -- 172.21.15.93:0/1656951640 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0007070 con 0x7f45940040e0 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 -- 172.21.15.93:0/1656951640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 msgr2=0x7f45940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 --2- 172.21.15.93:0/1656951640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45940047c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007ef0 tx=0x7f45940057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45ab7fe640 1 -- 172.21.15.93:0/1656951640 reap_dead start 2023-11-04T01:36:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 -- 172.21.15.93:0/1656951640 shutdown_connections 2023-11-04T01:36:36.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 -- 172.21.15.93:0/1656951640 >> 172.21.15.93:0/1656951640 conn(0x7f45ac0cf880 msgr2=0x7f45ac0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 -- 172.21.15.93:0/1656951640 shutdown_connections 2023-11-04T01:36:36.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.956+0000 7f45b13ee640 1 -- 172.21.15.93:0/1656951640 wait complete. 2023-11-04T01:36:36.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.957+0000 7f45b13ee640 1 Processor -- start 2023-11-04T01:36:36.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.957+0000 7f45b13ee640 1 -- start start 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ac1f3200 0x7f45ac0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0c7660 0x7f45ac156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c6930 con 0x7f45940040e0 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c89b0 con 0x7f45ac1f3200 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45b13ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c6b80 con 0x7f45ac0c7660 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39308/0 (socket says 172.21.15.93:39308) 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 -- 172.21.15.93:0/83735723 learned_addr learned my addr 172.21.15.93:0/83735723 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 -- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0c7660 msgr2=0x7f45ac156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0c7660 0x7f45ac156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 -- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ac1f3200 msgr2=0x7f45ac0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ac1f3200 0x7f45ac0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 -- 172.21.15.93:0/83735723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0c6e60 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45aaffd640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f459c00eaa0 tx=0x7f459c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.958+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c017070 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.959+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c003b80 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.959+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c003d10 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.959+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0c7140 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.959+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0c85a0 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.959+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0c7330 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.960+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f459c006b50 con 0x7f45940040e0 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.960+0000 7f45937fe640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.960+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f459c089510 con 0x7f45940040e0 2023-11-04T01:36:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.960+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.961+0000 7f45aa7fc640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 0x7f459806d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45a0034000 tx=0x7f45a0007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:36.964+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f459c054290 con 0x7f45940040e0 2023-11-04T01:36:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.131+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45ac074290 con 0x7f45940040e0 2023-11-04T01:36:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.132+0000 7f45937fe640 1 -- 172.21.15.93:0/83735723 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f459c001a30 con 0x7f45940040e0 2023-11-04T01:36:37.134 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:37.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 msgr2=0x7f459806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 0x7f459806d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45a0034000 tx=0x7f45a0007000 comp rx=0 tx=0).stop 2023-11-04T01:36:37.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 msgr2=0x7f45ac150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f459c00eaa0 tx=0x7f459c00ef60 comp rx=0 tx=0).stop 2023-11-04T01:36:37.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 shutdown_connections 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45ac0c7660 0x7f45ac156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45ac1f3200 0x7f45ac0c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 --2- 172.21.15.93:0/83735723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45940040e0 0x7f45ac150570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 >> 172.21.15.93:0/83735723 conn(0x7f45ac0cf880 msgr2=0x7f45ac15ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 shutdown_connections 2023-11-04T01:36:37.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.134+0000 7f45b13ee640 1 -- 172.21.15.93:0/83735723 wait complete. 2023-11-04T01:36:37.147 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:37.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.245+0000 7f34f94da640 1 Processor -- start 2023-11-04T01:36:37.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.245+0000 7f34f94da640 1 -- start start 2023-11-04T01:36:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f94da640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34f415ac70 0x7f34f40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f94da640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34f40b2d10 0x7f34f40b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f94da640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f40b3c10 con 0x7f34f40cec10 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f94da640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f40cf180 con 0x7f34f40b2d10 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f94da640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f40cf460 con 0x7f34f415ac70 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34f40b2d10 0x7f34f40b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34f40b2d10 0x7f34f40b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39312/0 (socket says 172.21.15.93:39312) 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f37fe640 1 -- 172.21.15.93:0/2349284040 learned_addr learned my addr 172.21.15.93:0/2349284040 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.246+0000 7f34f2ffd640 1 --2- 172.21.15.93:0/2349284040 >> v2:172.21.15.125:3300/0 conn(0x7f34f415ac70 0x7f34f40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f37fe640 1 -- 172.21.15.93:0/2349284040 >> v2:172.21.15.125:3300/0 conn(0x7f34f415ac70 msgr2=0x7f34f40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f37fe640 1 --2- 172.21.15.93:0/2349284040 >> v2:172.21.15.125:3300/0 conn(0x7f34f415ac70 0x7f34f40d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f37fe640 1 -- 172.21.15.93:0/2349284040 >> v1:172.21.15.125:6789/0 conn(0x7f34f40cec10 legacy=0x7f34f40b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f37fe640 1 -- 172.21.15.93:0/2349284040 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40cf740 con 0x7f34f40b2d10 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f37fe640 1 --2- 172.21.15.93:0/2349284040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f40b2d10 0x7f34f40b4080 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f34f40cd560 tx=0x7f34ec02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6511d9d3d9a1e18d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f27fc640 1 -- 172.21.15.93:0/2349284040 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec02cb20 con 0x7f34f40b2d10 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f27fc640 1 -- 172.21.15.93:0/2349284040 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec02cc80 con 0x7f34f40b2d10 2023-11-04T01:36:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.247+0000 7f34f27fc640 1 -- 172.21.15.93:0/2349284040 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0343f0 con 0x7f34f40b2d10 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 -- 172.21.15.93:0/2349284040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f40b2d10 msgr2=0x7f34f40b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 --2- 172.21.15.93:0/2349284040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f40b2d10 0x7f34f40b4080 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f34f40cd560 tx=0x7f34ec02bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 -- 172.21.15.93:0/2349284040 shutdown_connections 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 --2- 172.21.15.93:0/2349284040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f40b2d10 0x7f34f40b4080 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 --2- 172.21.15.93:0/2349284040 >> v2:172.21.15.125:3300/0 conn(0x7f34f415ac70 0x7f34f40d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 -- 172.21.15.93:0/2349284040 >> 172.21.15.93:0/2349284040 conn(0x7f34f40cd600 msgr2=0x7f34f40cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 -- 172.21.15.93:0/2349284040 shutdown_connections 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.248+0000 7f34f94da640 1 -- 172.21.15.93:0/2349284040 wait complete. 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.249+0000 7f34f94da640 1 Processor -- start 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.249+0000 7f34f94da640 1 -- start start 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34f40b2d10 0x7f34f4151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 0x7f34f406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f415cf40 con 0x7f34f415ac70 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40c54e0 con 0x7f34f40b2d10 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f94da640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f415c610 con 0x7f34f40cec10 2023-11-04T01:36:37.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39324/0 (socket says 172.21.15.93:39324) 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 -- 172.21.15.93:0/1514047625 learned_addr learned my addr 172.21.15.93:0/1514047625 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f2ffd640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34f40b2d10 0x7f34f4151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34ebfff640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 0x7f34f406caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 -- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 msgr2=0x7f34f406caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 0x7f34f406caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 -- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34f40b2d10 msgr2=0x7f34f4151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34f40b2d10 0x7f34f4151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 -- 172.21.15.93:0/1514047625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009b30 con 0x7f34f415ac70 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34ebfff640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 0x7f34f406caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:37.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.250+0000 7f34f37fe640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f34ec036040 tx=0x7f34ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.251+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec007e70 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.251+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec009510 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.251+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec03e690 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.251+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f415c8f0 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.251+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f406d030 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.252+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f415d0b0 con 0x7f34f415ac70 2023-11-04T01:36:37.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.252+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34ec03e7f0 con 0x7f34f415ac70 2023-11-04T01:36:37.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.252+0000 7f34eb7fe640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 0x7f34d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.252+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34ec0ac550 con 0x7f34f415ac70 2023-11-04T01:36:37.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.252+0000 7f34f2ffd640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 0x7f34d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.253+0000 7f34f2ffd640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 0x7f34d406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c5c50 tx=0x7f34e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.257+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34ec077240 con 0x7f34f415ac70 2023-11-04T01:36:37.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.424+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34f40b6b00 con 0x7f34f415ac70 2023-11-04T01:36:37.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.425+0000 7f34eb7fe640 1 -- 172.21.15.93:0/1514047625 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f34ec07a860 con 0x7f34f415ac70 2023-11-04T01:36:37.429 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:37.429 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 msgr2=0x7f34d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 0x7f34d406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c5c50 tx=0x7f34e4008040 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 msgr2=0x7f34f40c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f34ec036040 tx=0x7f34ec004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 shutdown_connections 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34d406ae70 0x7f34d406d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34f415ac70 0x7f34f40c5f20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34f40cec10 0x7f34f406caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 --2- 172.21.15.93:0/1514047625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34f40b2d10 0x7f34f4151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 >> 172.21.15.93:0/1514047625 conn(0x7f34f40cd600 msgr2=0x7f34f40cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 shutdown_connections 2023-11-04T01:36:37.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.427+0000 7f34f94da640 1 -- 172.21.15.93:0/1514047625 wait complete. 2023-11-04T01:36:37.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:37.444 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:37.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.543+0000 7effa09fb640 1 Processor -- start 2023-11-04T01:36:37.546 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.543+0000 7effa09fb640 1 -- start start 2023-11-04T01:36:37.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.544+0000 7effa09fb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7eff9c153e60 0x7eff9c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.544+0000 7effa09fb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.544+0000 7effa09fb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0cde60 con 0x7eff9c0b4880 2023-11-04T01:36:37.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.544+0000 7effa09fb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c160f90 con 0x7eff9c153e60 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.544+0000 7effa09fb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c15e400 con 0x7eff9c0cd6d0 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7eff9c153e60 0x7eff9c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9ad9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7eff9c0b4880 0x7eff9c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54522/0 (socket says 172.21.15.93:54522) 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9ad9d640 1 -- 172.21.15.93:0/1149809064 learned_addr learned my addr 172.21.15.93:0/1149809064 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff99d9b640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9a59c640 1 -- 172.21.15.93:0/1149809064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 msgr2=0x7eff9c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9a59c640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9a59c640 1 -- 172.21.15.93:0/1149809064 >> v1:172.21.15.93:6789/0 conn(0x7eff9c0b4880 legacy=0x7eff9c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9a59c640 1 -- 172.21.15.93:0/1149809064 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c161960 con 0x7eff9c153e60 2023-11-04T01:36:37.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.545+0000 7eff9959a640 1 -- 172.21.15.93:0/1149809064 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835415580 0 0) 0x7eff9c0cde60 con 0x7eff9c0b4880 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7eff9a59c640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c15dec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff94009d90 tx=0x7eff9402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d148cdb4c055905 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7eff9959a640 1 -- 172.21.15.93:0/1149809064 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9402cc50 con 0x7eff9c153e60 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7eff9959a640 1 -- 172.21.15.93:0/1149809064 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9402cdb0 con 0x7eff9c153e60 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7eff9959a640 1 -- 172.21.15.93:0/1149809064 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94034660 con 0x7eff9c153e60 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 -- 172.21.15.93:0/1149809064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 msgr2=0x7eff9c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c15dec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff94009d90 tx=0x7eff9402bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 -- 172.21.15.93:0/1149809064 shutdown_connections 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 --2- 172.21.15.93:0/1149809064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c15dec0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.546+0000 7effa09fb640 1 -- 172.21.15.93:0/1149809064 >> 172.21.15.93:0/1149809064 conn(0x7eff9c0cf880 msgr2=0x7eff9c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.547+0000 7effa09fb640 1 -- 172.21.15.93:0/1149809064 shutdown_connections 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.547+0000 7effa09fb640 1 -- 172.21.15.93:0/1149809064 wait complete. 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.548+0000 7effa09fb640 1 Processor -- start 2023-11-04T01:36:37.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.548+0000 7effa09fb640 1 -- start start 2023-11-04T01:36:37.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff9c0b4880 0x7eff9c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c9780 con 0x7eff9c153e60 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c145c80 con 0x7eff9c0b4880 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c86e0 con 0x7eff9c0cd6d0 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39344/0 (socket says 172.21.15.93:39344) 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 -- 172.21.15.93:0/3624984761 learned_addr learned my addr 172.21.15.93:0/3624984761 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9a59c640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff9c0b4880 0x7eff9c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 -- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 msgr2=0x7eff9c145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 -- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff9c0b4880 msgr2=0x7eff9c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff9c0b4880 0x7eff9c0ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 -- 172.21.15.93:0/3624984761 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94009a70 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff9ad9d640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c450 tx=0x7eff8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0074e0 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c007660 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c0c89c0 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c004a20 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.549+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0c8f80 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.550+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c074290 con 0x7eff9c153e60 2023-11-04T01:36:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.551+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff8c004b80 con 0x7eff9c153e60 2023-11-04T01:36:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.551+0000 7eff8affd640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 0x7eff7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.551+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff8c088b50 con 0x7eff9c153e60 2023-11-04T01:36:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.551+0000 7eff9a59c640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 0x7eff7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.552+0000 7eff9a59c640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 0x7eff7c06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff94036000 tx=0x7eff94030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.555+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff8c0537c0 con 0x7eff9c153e60 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.721+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff9c0d0b80 con 0x7eff9c153e60 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.721+0000 7eff8affd640 1 -- 172.21.15.93:0/3624984761 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff8c0180a0 con 0x7eff9c153e60 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 msgr2=0x7eff7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 0x7eff7c06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff94036000 tx=0x7eff94030000 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 msgr2=0x7eff9c145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c450 tx=0x7eff8c00c910 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 shutdown_connections 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff7c06ae70 0x7eff7c06d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff9c153e60 0x7eff9c145740 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff9c0cd6d0 0x7eff9c145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 --2- 172.21.15.93:0/3624984761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff9c0b4880 0x7eff9c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 >> 172.21.15.93:0/3624984761 conn(0x7eff9c0cf880 msgr2=0x7eff9c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 shutdown_connections 2023-11-04T01:36:37.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.723+0000 7effa09fb640 1 -- 172.21.15.93:0/3624984761 wait complete. 2023-11-04T01:36:37.736 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:37.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.837+0000 7f2290573640 1 Processor -- start 2023-11-04T01:36:37.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.837+0000 7f2290573640 1 -- start start 2023-11-04T01:36:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2288160600 0x7f22880cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22880cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22880ccde0 0x7f22880c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228806e1a0 con 0x7f2288160600 2023-11-04T01:36:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880ce090 con 0x7f22880ccde0 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f2290573640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880cd330 con 0x7f22881609e0 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2288160600 0x7f22880cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2288160600 0x7f22880cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39360/0 (socket says 172.21.15.93:39360) 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 -- 172.21.15.93:0/3826306946 learned_addr learned my addr 172.21.15.93:0/3826306946 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228db0e640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22880cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228eb10640 1 --2- 172.21.15.93:0/3826306946 >> v2:172.21.15.125:3300/0 conn(0x7f22880ccde0 0x7f22880c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 -- 172.21.15.93:0/3826306946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 msgr2=0x7f22880cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22880cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 -- 172.21.15.93:0/3826306946 >> v2:172.21.15.125:3300/0 conn(0x7f22880ccde0 msgr2=0x7f22880c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 --2- 172.21.15.93:0/3826306946 >> v2:172.21.15.125:3300/0 conn(0x7f22880ccde0 0x7f22880c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.838+0000 7f228e30f640 1 -- 172.21.15.93:0/3826306946 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228806db50 con 0x7f2288160600 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.839+0000 7f228e30f640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2288160600 0x7f22880cd610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f228806faf0 tx=0x7f228402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b613c3433ea4c3f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.839+0000 7f228d30d640 1 -- 172.21.15.93:0/3826306946 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284030860 con 0x7f2288160600 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.839+0000 7f228d30d640 1 -- 172.21.15.93:0/3826306946 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22840309c0 con 0x7f2288160600 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.839+0000 7f228d30d640 1 -- 172.21.15.93:0/3826306946 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284030d50 con 0x7f2288160600 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 -- 172.21.15.93:0/3826306946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2288160600 msgr2=0x7f22880cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2288160600 0x7f22880cd610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f228806faf0 tx=0x7f228402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 -- 172.21.15.93:0/3826306946 shutdown_connections 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 --2- 172.21.15.93:0/3826306946 >> v2:172.21.15.125:3300/0 conn(0x7f22880ccde0 0x7f22880c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22880cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 --2- 172.21.15.93:0/3826306946 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2288160600 0x7f22880cd610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 -- 172.21.15.93:0/3826306946 >> 172.21.15.93:0/3826306946 conn(0x7f228806a120 msgr2=0x7f228806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 -- 172.21.15.93:0/3826306946 shutdown_connections 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.840+0000 7f2290573640 1 -- 172.21.15.93:0/3826306946 wait complete. 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.841+0000 7f2290573640 1 Processor -- start 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.841+0000 7f2290573640 1 -- start start 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 0x7f22880c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22881501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880c57c0 con 0x7f22880ccde0 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288150720 con 0x7f2288160600 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f2290573640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880c5fa0 con 0x7f22881609e0 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39364/0 (socket says 172.21.15.93:39364) 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 -- 172.21.15.93:0/3660559882 learned_addr learned my addr 172.21.15.93:0/3660559882 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228db0e640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 0x7f22880c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228eb10640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22881501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 -- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 msgr2=0x7f22881501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22881501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 -- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 msgr2=0x7f22880c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 0x7f22880c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 -- 172.21.15.93:0/3660559882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840094d0 con 0x7f22880ccde0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228db0e640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 0x7f22880c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.842+0000 7f228e30f640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2284000c00 tx=0x7f2284004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.843+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284039d60 con 0x7f22880ccde0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.843+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284043400 con 0x7f22880ccde0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.843+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22880c6280 con 0x7f22880ccde0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.843+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840437b0 con 0x7f22880ccde0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.843+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22880c73a0 con 0x7f22880ccde0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.844+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22880c7590 con 0x7f22880ccde0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.844+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2284043910 con 0x7f22880ccde0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.844+0000 7f227effd640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 0x7f226c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.844+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f228403e070 con 0x7f22880ccde0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.845+0000 7f228db0e640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 0x7f226c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.845+0000 7f228db0e640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 0x7f226c06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2278006fd0 tx=0x7f2278008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:37.849+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2284077b80 con 0x7f22880ccde0 2023-11-04T01:36:38.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.015+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2288074290 con 0x7f22880ccde0 2023-11-04T01:36:38.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.015+0000 7f227effd640 1 -- 172.21.15.93:0/3660559882 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f228407b1a0 con 0x7f22880ccde0 2023-11-04T01:36:38.018 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 msgr2=0x7f226c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 0x7f226c06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2278006fd0 tx=0x7f2278008040 comp rx=0 tx=0).stop 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 msgr2=0x7f22880c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2284000c00 tx=0x7f2284004730 comp rx=0 tx=0).stop 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 shutdown_connections 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226c06ae70 0x7f226c06d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22881609e0 0x7f22881501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2288160600 0x7f22880c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 --2- 172.21.15.93:0/3660559882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22880ccde0 0x7f22880c2650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 >> 172.21.15.93:0/3660559882 conn(0x7f228806a120 msgr2=0x7f22880ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 shutdown_connections 2023-11-04T01:36:38.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.017+0000 7f2290573640 1 -- 172.21.15.93:0/3660559882 wait complete. 2023-11-04T01:36:38.031 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:38.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.131+0000 7f1150597640 1 Processor -- start 2023-11-04T01:36:38.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.131+0000 7f1150597640 1 -- start start 2023-11-04T01:36:38.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1148153850 0x7f114815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11480cc9a0 0x7f11480714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480c3860 con 0x7f1148153850 2023-11-04T01:36:38.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480c9250 con 0x7f11480cc9a0 2023-11-04T01:36:38.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f1150597640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1148153c30 con 0x7f11480cc520 2023-11-04T01:36:38.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1148153850 0x7f114815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1148153850 0x7f114815a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39368/0 (socket says 172.21.15.93:39368) 2023-11-04T01:36:38.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 -- 172.21.15.93:0/3492702843 learned_addr learned my addr 172.21.15.93:0/3492702843 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:38.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114db32640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 -- 172.21.15.93:0/3492702843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 msgr2=0x7f1148070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 -- 172.21.15.93:0/3492702843 >> v2:172.21.15.125:3300/0 conn(0x7f11480cc9a0 msgr2=0x7f11480714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114eb34640 1 --2- 172.21.15.93:0/3492702843 >> v2:172.21.15.125:3300/0 conn(0x7f11480cc9a0 0x7f11480714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 --2- 172.21.15.93:0/3492702843 >> v2:172.21.15.125:3300/0 conn(0x7f11480cc9a0 0x7f11480714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.132+0000 7f114e333640 1 -- 172.21.15.93:0/3492702843 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114815a700 con 0x7f1148153850 2023-11-04T01:36:38.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.133+0000 7f114e333640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1148153850 0x7f114815a1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f11480cb380 tx=0x7f114402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda3cba502921297 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.133+0000 7f114d331640 1 -- 172.21.15.93:0/3492702843 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114402ca70 con 0x7f1148153850 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.133+0000 7f114d331640 1 -- 172.21.15.93:0/3492702843 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114402cbd0 con 0x7f1148153850 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.133+0000 7f114d331640 1 -- 172.21.15.93:0/3492702843 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11440343f0 con 0x7f1148153850 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 -- 172.21.15.93:0/3492702843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1148153850 msgr2=0x7f114815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1148153850 0x7f114815a1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f11480cb380 tx=0x7f114402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 -- 172.21.15.93:0/3492702843 shutdown_connections 2023-11-04T01:36:38.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 --2- 172.21.15.93:0/3492702843 >> v2:172.21.15.125:3300/0 conn(0x7f11480cc9a0 0x7f11480714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 --2- 172.21.15.93:0/3492702843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1148153850 0x7f114815a1c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 -- 172.21.15.93:0/3492702843 >> 172.21.15.93:0/3492702843 conn(0x7f11480ce950 msgr2=0x7f11480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 -- 172.21.15.93:0/3492702843 shutdown_connections 2023-11-04T01:36:38.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.134+0000 7f1150597640 1 -- 172.21.15.93:0/3492702843 wait complete. 2023-11-04T01:36:38.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.135+0000 7f1150597640 1 Processor -- start 2023-11-04T01:36:38.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.135+0000 7f1150597640 1 -- start start 2023-11-04T01:36:38.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1148153850 0x7f114814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11481505d0 con 0x7f11480cc9a0 2023-11-04T01:36:38.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114814ee50 con 0x7f1148153850 2023-11-04T01:36:38.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114814f130 con 0x7f11480cc520 2023-11-04T01:36:38.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39382/0 (socket says 172.21.15.93:39382) 2023-11-04T01:36:38.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 -- 172.21.15.93:0/1513686094 learned_addr learned my addr 172.21.15.93:0/1513686094 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:38.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114e333640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 -- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 msgr2=0x7f1148148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 -- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1148153850 msgr2=0x7f114814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114eb34640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1148153850 0x7f114814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1148153850 0x7f114814e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 -- 172.21.15.93:0/1513686094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009b30 con 0x7f11480cc9a0 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f114db32640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f113800c7f0 tx=0x7f113800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138004220 con 0x7f11480cc9a0 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380043a0 con 0x7f11480cc9a0 2023-11-04T01:36:38.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138007860 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1148150820 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.136+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1148148570 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.137+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1148074290 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.138+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1138007bd0 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.138+0000 7f113effd640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 0x7f112c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.138+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1138089890 con 0x7f11480cc9a0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.138+0000 7f114e333640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 0x7f112c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.139+0000 7f114e333640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 0x7f112c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1144035000 tx=0x7f1144030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.142+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1138054610 con 0x7f11480cc9a0 2023-11-04T01:36:38.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.310+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11480c5010 con 0x7f11480cc9a0 2023-11-04T01:36:38.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.310+0000 7f113effd640 1 -- 172.21.15.93:0/1513686094 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f113801e0a0 con 0x7f11480cc9a0 2023-11-04T01:36:38.313 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 msgr2=0x7f112c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 0x7f112c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1144035000 tx=0x7f1144030000 comp rx=0 tx=0).stop 2023-11-04T01:36:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 msgr2=0x7f1148151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f113800c7f0 tx=0x7f113800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 shutdown_connections 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f112c06ae70 0x7f112c06d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1148153850 0x7f114814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11480cc9a0 0x7f1148151000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 --2- 172.21.15.93:0/1513686094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11480cc520 0x7f1148148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 >> 172.21.15.93:0/1513686094 conn(0x7f11480ce950 msgr2=0x7f114815b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 shutdown_connections 2023-11-04T01:36:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.312+0000 7f1150597640 1 -- 172.21.15.93:0/1513686094 wait complete. 2023-11-04T01:36:38.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:38.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.425+0000 7f2693f2c640 1 Processor -- start 2023-11-04T01:36:38.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.425+0000 7f2693f2c640 1 -- start start 2023-11-04T01:36:38.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2693f2c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2693f2c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f268c0adac0 0x7f268c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2693f2c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c15aff0 con 0x7f268c159c00 2023-11-04T01:36:38.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2693f2c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c0ae450 con 0x7f268c0adac0 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2693f2c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15a3e0 con 0x7f268c0c4ff0 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f268c0adac0 0x7f268c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2691cc8640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f268c159c00 0x7f268c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:43324/0 (socket says 172.21.15.93:43324) 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f268c0adac0 0x7f268c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:36304/0 (socket says 172.21.15.93:36304) 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f2691cc8640 1 -- 172.21.15.93:0/808718555 learned_addr learned my addr 172.21.15.93:0/808718555 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:38.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26914c7640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 -- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 msgr2=0x7f268c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:38.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 -- 172.21.15.93:0/808718555 >> v1:172.21.15.125:6789/0 conn(0x7f268c159c00 legacy=0x7f268c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.426+0000 7f26924c9640 1 -- 172.21.15.93:0/808718555 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c15a6c0 con 0x7f268c0adac0 2023-11-04T01:36:38.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.427+0000 7f26914c7640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.427+0000 7f26924c9640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c0adac0 0x7f268c0adf10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f268400bfa0 tx=0x7f268402e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9c1ad5d2de1077 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.427+0000 7f2690cc6640 1 -- 172.21.15.93:0/808718555 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268402ea40 con 0x7f268c0adac0 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.427+0000 7f2690cc6640 1 -- 172.21.15.93:0/808718555 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268402eba0 con 0x7f268c0adac0 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.427+0000 7f2690cc6640 1 -- 172.21.15.93:0/808718555 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684009540 con 0x7f268c0adac0 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 -- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c0adac0 msgr2=0x7f268c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c0adac0 0x7f268c0adf10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f268400bfa0 tx=0x7f268402e0a0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 -- 172.21.15.93:0/808718555 shutdown_connections 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c0adac0 0x7f268c0adf10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 --2- 172.21.15.93:0/808718555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 -- 172.21.15.93:0/808718555 >> 172.21.15.93:0/808718555 conn(0x7f268c0ce950 msgr2=0x7f268c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 -- 172.21.15.93:0/808718555 shutdown_connections 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.428+0000 7f2693f2c640 1 -- 172.21.15.93:0/808718555 wait complete. 2023-11-04T01:36:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.429+0000 7f2693f2c640 1 Processor -- start 2023-11-04T01:36:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.429+0000 7f2693f2c640 1 -- start start 2023-11-04T01:36:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c159c00 0x7f268c1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c1569c0 con 0x7f268c0adac0 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c14fb50 con 0x7f268c159c00 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2693f2c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c14fe30 con 0x7f268c0c4ff0 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2691cc8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2691cc8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39384/0 (socket says 172.21.15.93:39384) 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f2691cc8640 1 -- 172.21.15.93:0/1058725570 learned_addr learned my addr 172.21.15.93:0/1058725570 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f26914c7640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.430+0000 7f26924c9640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c159c00 0x7f268c1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 -- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 msgr2=0x7f268c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 -- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c159c00 msgr2=0x7f268c1538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c159c00 0x7f268c1538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 -- 172.21.15.93:0/1058725570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c009400 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2691cc8640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f268800c480 tx=0x7f268800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688005ce0 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688005e40 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268400bc80 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26880072f0 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.431+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c150de0 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.432+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c0adf10 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.432+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2688007450 con 0x7f268c0adac0 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.433+0000 7f26827fc640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 0x7f267006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.433+0000 7f26914c7640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 0x7f267006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.433+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2688088dd0 con 0x7f268c0adac0 2023-11-04T01:36:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.433+0000 7f26914c7640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 0x7f267006d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f268c153120 tx=0x7f267c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.437+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2688053c00 con 0x7f268c0adac0 2023-11-04T01:36:38.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.604+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f268c074290 con 0x7f268c0adac0 2023-11-04T01:36:38.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.604+0000 7f26827fc640 1 -- 172.21.15.93:0/1058725570 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2688017020 con 0x7f268c0adac0 2023-11-04T01:36:38.606 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:38.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 msgr2=0x7f267006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 0x7f267006d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f268c153120 tx=0x7f267c009190 comp rx=0 tx=0).stop 2023-11-04T01:36:38.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 msgr2=0x7f268c1f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f268800c480 tx=0x7f268800c940 comp rx=0 tx=0).stop 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 shutdown_connections 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f267006aea0 0x7f267006d360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f268c159c00 0x7f268c1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f268c0c4ff0 0x7f268c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 --2- 172.21.15.93:0/1058725570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f268c0adac0 0x7f268c1f16f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 >> 172.21.15.93:0/1058725570 conn(0x7f268c0ce950 msgr2=0x7f268c0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 shutdown_connections 2023-11-04T01:36:38.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.606+0000 7f2693f2c640 1 -- 172.21.15.93:0/1058725570 wait complete. 2023-11-04T01:36:38.622 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:38.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 Processor -- start 2023-11-04T01:36:38.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 -- start start 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa1e80ce240 0x7fa1e8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e815e000 con 0x7fa1e80cde60 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e815e2e0 con 0x7fa1e8157540 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.720+0000 7fa1ef090640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e815e5c0 con 0x7fa1e80ce240 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1e7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa1e80ce240 0x7fa1e8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1ece2c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa1e80cde60 0x7fa1e815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54538/0 (socket says 172.21.15.93:54538) 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1ece2c640 1 -- 172.21.15.93:0/3602233786 learned_addr learned my addr 172.21.15.93:0/3602233786 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1e7fff640 1 -- 172.21.15.93:0/3602233786 >> v1:172.21.15.125:6789/0 conn(0x7fa1e8157540 legacy=0x7fa1e80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1e7fff640 1 -- 172.21.15.93:0/3602233786 >> v1:172.21.15.93:6789/0 conn(0x7fa1e80cde60 legacy=0x7fa1e815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.721+0000 7fa1e7fff640 1 -- 172.21.15.93:0/3602233786 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80d1120 con 0x7fa1e80ce240 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1e7fff640 1 --2- 172.21.15.93:0/3602233786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80ce240 0x7fa1e8157000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097a0 tx=0x7fa1d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad73bd485d538f91 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1e77fe640 1 -- 172.21.15.93:0/3602233786 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4031830 con 0x7fa1e80ce240 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1e77fe640 1 -- 172.21.15.93:0/3602233786 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4031990 con 0x7fa1e80ce240 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1e77fe640 1 -- 172.21.15.93:0/3602233786 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4031d20 con 0x7fa1e80ce240 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 -- 172.21.15.93:0/3602233786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80ce240 msgr2=0x7fa1e8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3602233786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80ce240 0x7fa1e8157000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097a0 tx=0x7fa1d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 -- 172.21.15.93:0/3602233786 shutdown_connections 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3602233786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80ce240 0x7fa1e8157000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 -- 172.21.15.93:0/3602233786 >> 172.21.15.93:0/3602233786 conn(0x7fa1e8071f30 msgr2=0x7fa1e80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 -- 172.21.15.93:0/3602233786 shutdown_connections 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.722+0000 7fa1ef090640 1 -- 172.21.15.93:0/3602233786 wait complete. 2023-11-04T01:36:38.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.723+0000 7fa1ef090640 1 Processor -- start 2023-11-04T01:36:38.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.723+0000 7fa1ef090640 1 -- start start 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 0x7fa1e80c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 0x7fa1e80c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e815b470 con 0x7fa1e80cde60 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e815a860 con 0x7fa1e8157540 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ef090640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e815ab40 con 0x7fa1e80ce240 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ece2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ece2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39388/0 (socket says 172.21.15.93:39388) 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.724+0000 7fa1ece2c640 1 -- 172.21.15.93:0/3156678749 learned_addr learned my addr 172.21.15.93:0/3156678749 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ed62d640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 0x7fa1e80c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1e7fff640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 0x7fa1e80c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 -- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 msgr2=0x7fa1e80c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 0x7fa1e80c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 -- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 msgr2=0x7fa1e80c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 0x7fa1e80c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 -- 172.21.15.93:0/3156678749 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009400 con 0x7fa1e80cde60 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ed62d640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 0x7fa1e80c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1e7fff640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 0x7fa1e80c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ece2c640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c480 tx=0x7fa1dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc005ce0 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc005e40 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e815ae20 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0072f0 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.725+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e8156230 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.726+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e815b5e0 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.726+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1dc007510 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.727+0000 7fa1e57fa640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.727+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa1dc088e00 con 0x7fa1e80cde60 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.727+0000 7fa1e7fff640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:38.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.727+0000 7fa1e7fff640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 0x7fa1cc06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:38.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.731+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1dc053c30 con 0x7fa1e80cde60 2023-11-04T01:36:38.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.897+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1e81563c0 con 0x7fa1e80cde60 2023-11-04T01:36:38.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.899+0000 7fa1e57fa640 1 -- 172.21.15.93:0/3156678749 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7fa1dc017020 con 0x7fa1e80cde60 2023-11-04T01:36:38.901 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:38.901 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:38.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.900+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 msgr2=0x7fa1cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.900+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 0x7fa1cc06d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:38.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.900+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 msgr2=0x7fa1e8155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.900+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c480 tx=0x7fa1dc00c940 comp rx=0 tx=0).stop 2023-11-04T01:36:38.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 shutdown_connections 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa1cc06ae70 0x7fa1cc06d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1e8157540 0x7fa1e80c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa1e80ce240 0x7fa1e80c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 --2- 172.21.15.93:0/3156678749 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1e80cde60 0x7fa1e8155cf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 >> 172.21.15.93:0/3156678749 conn(0x7fa1e8071f30 msgr2=0x7fa1e80b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 shutdown_connections 2023-11-04T01:36:38.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:38.901+0000 7fa1ef090640 1 -- 172.21.15.93:0/3156678749 wait complete. 2023-11-04T01:36:38.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:38.914 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:39.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.014+0000 7f134e553640 1 Processor -- start 2023-11-04T01:36:39.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.014+0000 7f134e553640 1 -- start start 2023-11-04T01:36:39.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f134e553640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1348159c00 0x7f13480cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f134e553640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134815aff0 con 0x7f13480c48e0 2023-11-04T01:36:39.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f134e553640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134815a3e0 con 0x7f13480ae1d0 2023-11-04T01:36:39.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f134e553640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134815a6c0 con 0x7f1348159c00 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f13477fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f13480c48e0 0x7f13480adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54550/0 (socket says 172.21.15.93:54550) 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f13477fe640 1 -- 172.21.15.93:0/206100474 learned_addr learned my addr 172.21.15.93:0/206100474 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318411981 0 0) 0x7f134815aff0 con 0x7f13480c48e0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1330003520 con 0x7f13480c48e0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.015+0000 7f1347fff640 1 --2- 172.21.15.93:0/206100474 >> v2:172.21.15.125:3300/0 conn(0x7f1348159c00 0x7f13480cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982992777 0 0) 0x7f1330003520 con 0x7f13480c48e0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 >> v2:172.21.15.125:3300/0 conn(0x7f1348159c00 msgr2=0x7f13480cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 --2- 172.21.15.93:0/206100474 >> v2:172.21.15.125:3300/0 conn(0x7f1348159c00 0x7f13480cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 >> v1:172.21.15.125:6789/0 conn(0x7f13480ae1d0 legacy=0x7f13480709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134815a9a0 con 0x7f13480c48e0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f133c001670 con 0x7f13480c48e0 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 >> v1:172.21.15.93:6789/0 conn(0x7f13480c48e0 legacy=0x7f13480adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 0x7f1330003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13300047c0 0x7f1330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330005180 0x7f133000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134815a6c0 con 0x7f1330003970 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133000c120 con 0x7f1330005180 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133000c2e0 con 0x7f13300047c0 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 0x7f1330003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f134caf0640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330005180 0x7f133000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f13477fe640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13300047c0 0x7f1330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 -- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13300047c0 msgr2=0x7f1330004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13300047c0 0x7f1330004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 -- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330005180 msgr2=0x7f133000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330005180 0x7f133000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f1347fff640 1 -- 172.21.15.93:0/206100474 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330003520 con 0x7f1330003970 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f134caf0640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330005180 0x7f133000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.016+0000 7f134caf0640 1 -- 172.21.15.93:0/206100474 reap_dead start 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f1347fff640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 0x7f1330003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1338009ac0 tx=0x7f13300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df62efe433641dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133802c6b0 con 0x7f1330003970 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133802c810 con 0x7f1330003970 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f1346ffd640 1 -- 172.21.15.93:0/206100474 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133802cba0 con 0x7f1330003970 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 -- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 msgr2=0x7f1330003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 0x7f1330003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1338009ac0 tx=0x7f13300057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 -- 172.21.15.93:0/206100474 shutdown_connections 2023-11-04T01:36:39.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 --2- 172.21.15.93:0/206100474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1330003970 0x7f1330003d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 -- 172.21.15.93:0/206100474 >> 172.21.15.93:0/206100474 conn(0x7f13480ce950 msgr2=0x7f13480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 -- 172.21.15.93:0/206100474 shutdown_connections 2023-11-04T01:36:39.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.017+0000 7f134e553640 1 -- 172.21.15.93:0/206100474 wait complete. 2023-11-04T01:36:39.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 Processor -- start 2023-11-04T01:36:39.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 -- start start 2023-11-04T01:36:39.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 0x7f1348153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13481537a0 0x7f13480c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480b3800 con 0x7f13480b3c20 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480a75d0 con 0x7f1330003970 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.019+0000 7f134e553640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480b2b80 con 0x7f13481537a0 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39416/0 (socket says 172.21.15.93:39416) 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 -- 172.21.15.93:0/608365921 learned_addr learned my addr 172.21.15.93:0/608365921 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f1347fff640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 0x7f1348153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f13477fe640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13481537a0 0x7f13480c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 -- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13481537a0 msgr2=0x7f13480c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13481537a0 0x7f13480c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 -- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 msgr2=0x7f1348153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 0x7f1348153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 -- 172.21.15.93:0/608365921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480b2e60 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f1347fff640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 0x7f1348153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134caf0640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f13480cb070 tx=0x7f134000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000eed0 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340003970 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13480b3140 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340003d20 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.020+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13480c7a40 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.021+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13480b3940 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.021+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13400050d0 con 0x7f13480b3c20 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.022+0000 7f1344ff9640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 0x7f133406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.022+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f13400896c0 con 0x7f13480b3c20 2023-11-04T01:36:39.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.022+0000 7f1347fff640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 0x7f133406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.022+0000 7f1347fff640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 0x7f133406d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1338036000 tx=0x7f1338030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.026+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13480b3940 con 0x7f13480b3c20 2023-11-04T01:36:39.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.193+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13480b3940 con 0x7f13480b3c20 2023-11-04T01:36:39.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.193+0000 7f1344ff9640 1 -- 172.21.15.93:0/608365921 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13480b3940 con 0x7f13480b3c20 2023-11-04T01:36:39.196 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 msgr2=0x7f133406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 0x7f133406d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1338036000 tx=0x7f1338030000 comp rx=0 tx=0).stop 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 msgr2=0x7f1348155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f13480cb070 tx=0x7f134000eb90 comp rx=0 tx=0).stop 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 shutdown_connections 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f133406aea0 0x7f133406d360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13480b3c20 0x7f1348155690 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f13481537a0 0x7f13480c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 --2- 172.21.15.93:0/608365921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1330003970 0x7f1348153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 >> 172.21.15.93:0/608365921 conn(0x7f13480ce950 msgr2=0x7f1348154010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 shutdown_connections 2023-11-04T01:36:39.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.195+0000 7f134e553640 1 -- 172.21.15.93:0/608365921 wait complete. 2023-11-04T01:36:39.208 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:39.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.308+0000 7fe325d01640 1 Processor -- start 2023-11-04T01:36:39.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 -- start start 2023-11-04T01:36:39.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe320160430 0x7fe3200b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe32006c3a0 0x7fe3200cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3200b2fc0 con 0x7fe3200b2b60 2023-11-04T01:36:39.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200cb580 con 0x7fe320160430 2023-11-04T01:36:39.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe325d01640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32006c7d0 con 0x7fe32006c3a0 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.309+0000 7fe31f7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe320160430 0x7fe3200b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe316ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe3200b2b60 0x7fe32006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54562/0 (socket says 172.21.15.93:54562) 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe316ffd640 1 -- 172.21.15.93:0/1847841153 learned_addr learned my addr 172.21.15.93:0/1847841153 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31f7fe640 1 -- 172.21.15.93:0/1847841153 >> v2:172.21.15.125:3300/0 conn(0x7fe32006c3a0 msgr2=0x7fe3200cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/1847841153 >> v2:172.21.15.125:3300/0 conn(0x7fe32006c3a0 0x7fe3200cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31f7fe640 1 -- 172.21.15.93:0/1847841153 >> v1:172.21.15.93:6789/0 conn(0x7fe3200b2b60 legacy=0x7fe32006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31f7fe640 1 -- 172.21.15.93:0/1847841153 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32006ca40 con 0x7fe320160430 2023-11-04T01:36:39.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31effd640 1 -- 172.21.15.93:0/1847841153 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380491701 0 0) 0x7fe3200b2fc0 con 0x7fe3200b2b60 2023-11-04T01:36:39.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.310+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/1847841153 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe320160430 0x7fe3200b2620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3200c4600 tx=0x7fe31002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91b8ce57b12e57e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe31effd640 1 -- 172.21.15.93:0/1847841153 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310031830 con 0x7fe320160430 2023-11-04T01:36:39.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe31effd640 1 -- 172.21.15.93:0/1847841153 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310031990 con 0x7fe320160430 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe31effd640 1 -- 172.21.15.93:0/1847841153 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310031d20 con 0x7fe320160430 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 -- 172.21.15.93:0/1847841153 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe320160430 msgr2=0x7fe3200b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 --2- 172.21.15.93:0/1847841153 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe320160430 0x7fe3200b2620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3200c4600 tx=0x7fe31002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 -- 172.21.15.93:0/1847841153 shutdown_connections 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 --2- 172.21.15.93:0/1847841153 >> v2:172.21.15.125:3300/0 conn(0x7fe32006c3a0 0x7fe3200cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 --2- 172.21.15.93:0/1847841153 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe320160430 0x7fe3200b2620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 -- 172.21.15.93:0/1847841153 >> 172.21.15.93:0/1847841153 conn(0x7fe32006ea20 msgr2=0x7fe32006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 -- 172.21.15.93:0/1847841153 shutdown_connections 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.311+0000 7fe325d01640 1 -- 172.21.15.93:0/1847841153 wait complete. 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.312+0000 7fe325d01640 1 Processor -- start 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.312+0000 7fe325d01640 1 -- start start 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 0x7fe320152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe320160430 0x7fe3200b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c4cc0 con 0x7fe3200b2b60 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b5e60 con 0x7fe32006c3a0 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe325d01640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b6140 con 0x7fe320160430 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39424/0 (socket says 172.21.15.93:39424) 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.313+0000 7fe316ffd640 1 -- 172.21.15.93:0/2865502158 learned_addr learned my addr 172.21.15.93:0/2865502158 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 0x7fe320152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31ffff640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe320160430 0x7fe3200b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 -- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe320160430 msgr2=0x7fe3200b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe320160430 0x7fe3200b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 -- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 msgr2=0x7fe320152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 0x7fe320152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 -- 172.21.15.93:0/2865502158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009400 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 0x7fe320152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe316ffd640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c4d0 tx=0x7fe30800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080074e0 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308007660 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3200c4670 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308004a20 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.314+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3201528b0 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.315+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3200c4e30 con 0x7fe3200b2b60 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.315+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe308004b80 con 0x7fe3200b2b60 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.316+0000 7fe31cff9640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 0x7fe30006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.316+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 0x7fe30006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.316+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe308088b40 con 0x7fe3200b2b60 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.316+0000 7fe31f7fe640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 0x7fe30006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe310036000 tx=0x7fe31003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.320+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3080538c0 con 0x7fe3200b2b60 2023-11-04T01:36:39.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.485+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe320074290 con 0x7fe3200b2b60 2023-11-04T01:36:39.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.486+0000 7fe31cff9640 1 -- 172.21.15.93:0/2865502158 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3080180a0 con 0x7fe3200b2b60 2023-11-04T01:36:39.488 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:39.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 msgr2=0x7fe30006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 0x7fe30006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe310036000 tx=0x7fe31003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:39.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 msgr2=0x7fe3200b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c4d0 tx=0x7fe30800c990 comp rx=0 tx=0).stop 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 shutdown_connections 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe30006ae70 0x7fe30006d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe320160430 0x7fe3200b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3200b2b60 0x7fe3200b5510 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.487+0000 7fe325d01640 1 --2- 172.21.15.93:0/2865502158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe32006c3a0 0x7fe320152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.488+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 >> 172.21.15.93:0/2865502158 conn(0x7fe32006ea20 msgr2=0x7fe3200cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.488+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 shutdown_connections 2023-11-04T01:36:39.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.488+0000 7fe325d01640 1 -- 172.21.15.93:0/2865502158 wait complete. 2023-11-04T01:36:39.501 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:39.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.600+0000 7fe5933b6640 1 Processor -- start 2023-11-04T01:36:39.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.600+0000 7fe5933b6640 1 -- start start 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe5933b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe5933b6640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 0x7fe58c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe5933b6640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c06ca40 con 0x7fe58c160430 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe5933b6640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c0cb580 con 0x7fe58c06c1d0 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe5933b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c06cd20 con 0x7fe58c0b2d30 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe591953640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 0x7fe58c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe591152640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe58c160430 0x7fe58c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:43344/0 (socket says 172.21.15.93:43344) 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe591152640 1 -- 172.21.15.93:0/577190323 learned_addr learned my addr 172.21.15.93:0/577190323 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.601+0000 7fe590951640 1 --2- 172.21.15.93:0/577190323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe590951640 1 -- 172.21.15.93:0/577190323 >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 msgr2=0x7fe58c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe590951640 1 --2- 172.21.15.93:0/577190323 >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 0x7fe58c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe590951640 1 -- 172.21.15.93:0/577190323 >> v1:172.21.15.125:6789/0 conn(0x7fe58c160430 legacy=0x7fe58c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe590951640 1 -- 172.21.15.93:0/577190323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c06d000 con 0x7fe58c0b2d30 2023-11-04T01:36:39.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe591953640 1 --2- 172.21.15.93:0/577190323 >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 0x7fe58c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.602+0000 7fe590951640 1 --2- 172.21.15.93:0/577190323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c06bc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0097a0 tx=0x7fe57c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2fb44c150d4afcf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe583fff640 1 -- 172.21.15.93:0/577190323 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031830 con 0x7fe58c0b2d30 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe583fff640 1 -- 172.21.15.93:0/577190323 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c031990 con 0x7fe58c0b2d30 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe583fff640 1 -- 172.21.15.93:0/577190323 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031d20 con 0x7fe58c0b2d30 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 -- 172.21.15.93:0/577190323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 msgr2=0x7fe58c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 --2- 172.21.15.93:0/577190323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c06bc90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0097a0 tx=0x7fe57c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 -- 172.21.15.93:0/577190323 shutdown_connections 2023-11-04T01:36:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 --2- 172.21.15.93:0/577190323 >> v2:172.21.15.125:3300/0 conn(0x7fe58c06c1d0 0x7fe58c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 --2- 172.21.15.93:0/577190323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c06bc90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 -- 172.21.15.93:0/577190323 >> 172.21.15.93:0/577190323 conn(0x7fe58c06ea20 msgr2=0x7fe58c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 -- 172.21.15.93:0/577190323 shutdown_connections 2023-11-04T01:36:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.603+0000 7fe5933b6640 1 -- 172.21.15.93:0/577190323 wait complete. 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.604+0000 7fe5933b6640 1 Processor -- start 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.604+0000 7fe5933b6640 1 -- start start 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe58c160430 0x7fe58c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c156150 con 0x7fe58c06c1d0 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0c5140 con 0x7fe58c160430 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe5933b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0c4810 con 0x7fe58c0b2d30 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe591152640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe591152640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39428/0 (socket says 172.21.15.93:39428) 2023-11-04T01:36:39.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe591152640 1 -- 172.21.15.93:0/478169399 learned_addr learned my addr 172.21.15.93:0/478169399 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe591953640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe58c160430 0x7fe58c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.605+0000 7fe590951640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 -- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 msgr2=0x7fe58c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c0b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 -- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe58c160430 msgr2=0x7fe58c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe58c160430 0x7fe58c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 -- 172.21.15.93:0/478169399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588009a70 con 0x7fe58c06c1d0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe590951640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe591152640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe58400c3f0 tx=0x7fe58400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584005ce0 con 0x7fe58c06c1d0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c009400 con 0x7fe58c06c1d0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584005e40 con 0x7fe58c06c1d0 2023-11-04T01:36:39.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840072f0 con 0x7fe58c06c1d0 2023-11-04T01:36:39.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.606+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c0c4dd0 con 0x7fe58c06c1d0 2023-11-04T01:36:39.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.607+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c074290 con 0x7fe58c06c1d0 2023-11-04T01:36:39.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.607+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe584007450 con 0x7fe58c06c1d0 2023-11-04T01:36:39.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.608+0000 7fe581ffb640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 0x7fe57006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.608+0000 7fe590951640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 0x7fe57006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.608+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe584088f50 con 0x7fe58c06c1d0 2023-11-04T01:36:39.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.608+0000 7fe590951640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 0x7fe57006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe57c036000 tx=0x7fe57c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.612+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe584053bc0 con 0x7fe58c06c1d0 2023-11-04T01:36:39.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.779+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe58c0b6b20 con 0x7fe58c06c1d0 2023-11-04T01:36:39.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.779+0000 7fe581ffb640 1 -- 172.21.15.93:0/478169399 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5840571e0 con 0x7fe58c06c1d0 2023-11-04T01:36:39.782 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 msgr2=0x7fe57006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 0x7fe57006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe57c036000 tx=0x7fe57c03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 msgr2=0x7fe58c0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe58400c3f0 tx=0x7fe58400c7f0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 shutdown_connections 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe57006ae70 0x7fe57006d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe58c160430 0x7fe58c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe58c0b2d30 0x7fe58c0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 --2- 172.21.15.93:0/478169399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe58c06c1d0 0x7fe58c0b6350 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 >> 172.21.15.93:0/478169399 conn(0x7fe58c06ea20 msgr2=0x7fe58c0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 shutdown_connections 2023-11-04T01:36:39.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.781+0000 7fe5933b6640 1 -- 172.21.15.93:0/478169399 wait complete. 2023-11-04T01:36:39.795 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:39.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.895+0000 7fb22eed7640 1 Processor -- start 2023-11-04T01:36:39.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.895+0000 7fb22eed7640 1 -- start start 2023-11-04T01:36:39.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22eed7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2280c4ff0 0x7fb2280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22eed7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2280adac0 0x7fb2280adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22eed7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22815aff0 con 0x7fb228159c00 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22eed7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280ae460 con 0x7fb2280c4ff0 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22eed7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22815a3e0 con 0x7fb2280adac0 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb227fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2280c4ff0 0x7fb2280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22cc73640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb228159c00 0x7fb2280c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54572/0 (socket says 172.21.15.93:54572) 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22cc73640 1 -- 172.21.15.93:0/1341867249 learned_addr learned my addr 172.21.15.93:0/1341867249 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb22d474640 1 --2- 172.21.15.93:0/1341867249 >> v2:172.21.15.125:3300/0 conn(0x7fb2280adac0 0x7fb2280adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb227fff640 1 -- 172.21.15.93:0/1341867249 >> v2:172.21.15.125:3300/0 conn(0x7fb2280adac0 msgr2=0x7fb2280adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb227fff640 1 --2- 172.21.15.93:0/1341867249 >> v2:172.21.15.125:3300/0 conn(0x7fb2280adac0 0x7fb2280adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb227fff640 1 -- 172.21.15.93:0/1341867249 >> v1:172.21.15.93:6789/0 conn(0x7fb228159c00 legacy=0x7fb2280c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb227fff640 1 -- 172.21.15.93:0/1341867249 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22815a6c0 con 0x7fb2280c4ff0 2023-11-04T01:36:39.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.896+0000 7fb2277fe640 1 -- 172.21.15.93:0/1341867249 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470395530 0 0) 0x7fb22815aff0 con 0x7fb228159c00 2023-11-04T01:36:39.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb227fff640 1 --2- 172.21.15.93:0/1341867249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280cc890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb2280c59a0 tx=0x7fb21402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5d6f7eef109468 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb2277fe640 1 -- 172.21.15.93:0/1341867249 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214031830 con 0x7fb2280c4ff0 2023-11-04T01:36:39.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb2277fe640 1 -- 172.21.15.93:0/1341867249 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214031990 con 0x7fb2280c4ff0 2023-11-04T01:36:39.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb2277fe640 1 -- 172.21.15.93:0/1341867249 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214031d20 con 0x7fb2280c4ff0 2023-11-04T01:36:39.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb22eed7640 1 -- 172.21.15.93:0/1341867249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 msgr2=0x7fb2280cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.897+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1341867249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280cc890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb2280c59a0 tx=0x7fb21402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 -- 172.21.15.93:0/1341867249 shutdown_connections 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1341867249 >> v2:172.21.15.125:3300/0 conn(0x7fb2280adac0 0x7fb2280adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1341867249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280cc890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 -- 172.21.15.93:0/1341867249 >> 172.21.15.93:0/1341867249 conn(0x7fb2280ce950 msgr2=0x7fb2280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 -- 172.21.15.93:0/1341867249 shutdown_connections 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.898+0000 7fb22eed7640 1 -- 172.21.15.93:0/1341867249 wait complete. 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.899+0000 7fb22eed7640 1 Processor -- start 2023-11-04T01:36:39.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.899+0000 7fb22eed7640 1 -- start start 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2280adac0 0x7fb2280af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 0x7fb2281ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280aed30 con 0x7fb2280c4ff0 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b2250 con 0x7fb228159c00 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b2500 con 0x7fb2280adac0 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39434/0 (socket says 172.21.15.93:39434) 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 -- 172.21.15.93:0/1528899554 learned_addr learned my addr 172.21.15.93:0/1528899554 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22cc73640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2280adac0 0x7fb2280af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22d474640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 0x7fb2281ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 -- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2280adac0 msgr2=0x7fb2280af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2280adac0 0x7fb2280af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 -- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 msgr2=0x7fb2281ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 0x7fb2281ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 -- 172.21.15.93:0/1528899554 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009400 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22d474640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 0x7fb2281ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb227fff640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb214009890 tx=0x7fb2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21403ba70 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21403bbf0 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2280ae6e0 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214045400 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.900+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2280b27e0 con 0x7fb2280c4ff0 2023-11-04T01:36:39.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.901+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228074290 con 0x7fb2280c4ff0 2023-11-04T01:36:39.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.902+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb21404e440 con 0x7fb2280c4ff0 2023-11-04T01:36:39.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.902+0000 7fb2257fa640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:39.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.902+0000 7fb22cc73640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:39.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.902+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb2140abbe0 con 0x7fb2280c4ff0 2023-11-04T01:36:39.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.903+0000 7fb22cc73640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 0x7fb20c06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb21c007fd0 tx=0x7fb21c007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:39.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:39.906+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2140768d0 con 0x7fb2280c4ff0 2023-11-04T01:36:40.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.075+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb2280cae30 con 0x7fb2280c4ff0 2023-11-04T01:36:40.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.076+0000 7fb2257fa640 1 -- 172.21.15.93:0/1528899554 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb2140350a0 con 0x7fb2280c4ff0 2023-11-04T01:36:40.078 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:40.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 msgr2=0x7fb20c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 0x7fb20c06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb21c007fd0 tx=0x7fb21c007de0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 msgr2=0x7fb2280b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb214009890 tx=0x7fb2140046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 shutdown_connections 2023-11-04T01:36:40.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb228159c00 0x7fb2281ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2280c4ff0 0x7fb2280b1d10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 --2- 172.21.15.93:0/1528899554 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb2280adac0 0x7fb2280af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 >> 172.21.15.93:0/1528899554 conn(0x7fb2280ce950 msgr2=0x7fb22806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 shutdown_connections 2023-11-04T01:36:40.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.078+0000 7fb22eed7640 1 -- 172.21.15.93:0/1528899554 wait complete. 2023-11-04T01:36:40.102 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:36:40.103 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:36:40.103 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:40.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.202+0000 7ffbe9961640 1 Processor -- start 2023-11-04T01:36:40.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 -- start start 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffbe4160440 0x7ffbe40b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffbe40b6160 0x7ffbe40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe40cd6e0 0x7ffbe40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40ce3a0 con 0x7ffbe40b6160 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40d1120 con 0x7ffbe4160440 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe9961640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40d1400 con 0x7ffbe40cd6e0 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe27fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffbe40b6160 0x7ffbe40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe27fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffbe40b6160 0x7ffbe40b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39446/0 (socket says 172.21.15.93:39446) 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.203+0000 7ffbe27fc640 1 -- 172.21.15.93:0/1614748341 learned_addr learned my addr 172.21.15.93:0/1614748341 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:40.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe2ffd640 1 --2- 172.21.15.93:0/1614748341 >> v2:172.21.15.125:3300/0 conn(0x7ffbe4160440 0x7ffbe40b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe37fe640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe40cd6e0 0x7ffbe40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 -- 172.21.15.93:0/1614748341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe40cd6e0 msgr2=0x7ffbe40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe40cd6e0 0x7ffbe40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 -- 172.21.15.93:0/1614748341 >> v2:172.21.15.125:3300/0 conn(0x7ffbe4160440 msgr2=0x7ffbe40b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 --2- 172.21.15.93:0/1614748341 >> v2:172.21.15.125:3300/0 conn(0x7ffbe4160440 0x7ffbe40b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 -- 172.21.15.93:0/1614748341 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40d16e0 con 0x7ffbe40b6160 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.204+0000 7ffbe27fc640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40b6160 0x7ffbe40b4e40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40d3f10 tx=0x7ffbd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0706c3387e16a27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe1ffb640 1 -- 172.21.15.93:0/1614748341 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8031870 con 0x7ffbe40b6160 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe1ffb640 1 -- 172.21.15.93:0/1614748341 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80319d0 con 0x7ffbe40b6160 2023-11-04T01:36:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe1ffb640 1 -- 172.21.15.93:0/1614748341 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8031d60 con 0x7ffbe40b6160 2023-11-04T01:36:40.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 -- 172.21.15.93:0/1614748341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40b6160 msgr2=0x7ffbe40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40b6160 0x7ffbe40b4e40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40d3f10 tx=0x7ffbd802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:40.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 -- 172.21.15.93:0/1614748341 shutdown_connections 2023-11-04T01:36:40.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40b6160 0x7ffbe40b4e40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 --2- 172.21.15.93:0/1614748341 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe40cd6e0 0x7ffbe40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 --2- 172.21.15.93:0/1614748341 >> v2:172.21.15.125:3300/0 conn(0x7ffbe4160440 0x7ffbe40b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 -- 172.21.15.93:0/1614748341 >> 172.21.15.93:0/1614748341 conn(0x7ffbe40cf900 msgr2=0x7ffbe40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 -- 172.21.15.93:0/1614748341 shutdown_connections 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.205+0000 7ffbe9961640 1 -- 172.21.15.93:0/1614748341 wait complete. 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.206+0000 7ffbe9961640 1 Processor -- start 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 -- start start 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe40cd6e0 0x7ffbe4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe4160440 0x7ffbe40c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c7e10 con 0x7ffbe40c7450 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41497c0 con 0x7ffbe40cd6e0 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe9961640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4149ce0 con 0x7ffbe4160440 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39462/0 (socket says 172.21.15.93:39462) 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe37fe640 1 -- 172.21.15.93:0/4051712966 learned_addr learned my addr 172.21.15.93:0/4051712966 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe2ffd640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe40cd6e0 0x7ffbe4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.207+0000 7ffbe27fc640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe4160440 0x7ffbe40c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 -- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe4160440 msgr2=0x7ffbe40c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe4160440 0x7ffbe40c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 -- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe40cd6e0 msgr2=0x7ffbe4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe40cd6e0 0x7ffbe4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 -- 172.21.15.93:0/4051712966 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80094d0 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe37fe640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d830 tx=0x7ffbdc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc009660 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0097e0 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe41f2890 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc009b90 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.208+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe415c1f0 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.209+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe4074290 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.209+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbdc014410 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.210+0000 7ffbcbfff640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.210+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbdc089ea0 con 0x7ffbe40c7450 2023-11-04T01:36:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.210+0000 7ffbe2ffd640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.210+0000 7ffbe2ffd640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 0x7ffbd006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4003aa0 tx=0x7ffbd4009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.214+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbdc054c40 con 0x7ffbe40c7450 2023-11-04T01:36:40.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.383+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbe40d0c30 con 0x7ffbe40c7450 2023-11-04T01:36:40.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.384+0000 7ffbcbfff640 1 -- 172.21.15.93:0/4051712966 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7ffbdc018090 con 0x7ffbe40c7450 2023-11-04T01:36:40.387 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:40.387 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 msgr2=0x7ffbd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 0x7ffbd006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4003aa0 tx=0x7ffbd4009830 comp rx=0 tx=0).stop 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 msgr2=0x7ffbe40c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d830 tx=0x7ffbdc00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 shutdown_connections 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffbd006ae70 0x7ffbd006d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe40c7450 0x7ffbe40c78d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffbe4160440 0x7ffbe40c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 --2- 172.21.15.93:0/4051712966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffbe40cd6e0 0x7ffbe4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.386+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 >> 172.21.15.93:0/4051712966 conn(0x7ffbe40cf900 msgr2=0x7ffbe41e73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.387+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 shutdown_connections 2023-11-04T01:36:40.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.387+0000 7ffbe9961640 1 -- 172.21.15.93:0/4051712966 wait complete. 2023-11-04T01:36:40.400 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:40.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.500+0000 7f8092533640 1 Processor -- start 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.500+0000 7f8092533640 1 -- start start 2023-11-04T01:36:40.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8092533640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f808c159e30 0x7f808c0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8092533640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f808c065df0 0x7f808c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8092533640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c06abf0 con 0x7f808c0cae30 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8092533640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0cd180 con 0x7f808c065df0 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8092533640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0cba80 con 0x7f808c159e30 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8090ad0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f808c065df0 0x7f808c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8090ad0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f808c065df0 0x7f808c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39470/0 (socket says 172.21.15.93:39470) 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f8090ad0640 1 -- 172.21.15.93:0/2770515475 learned_addr learned my addr 172.21.15.93:0/2770515475 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.501+0000 7f808b7fe640 1 --2- 172.21.15.93:0/2770515475 >> v2:172.21.15.125:3300/0 conn(0x7f808c159e30 0x7f808c0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f8090ad0640 1 -- 172.21.15.93:0/2770515475 >> v2:172.21.15.125:3300/0 conn(0x7f808c159e30 msgr2=0x7f808c0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f8090ad0640 1 --2- 172.21.15.93:0/2770515475 >> v2:172.21.15.125:3300/0 conn(0x7f808c159e30 0x7f808c0c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f8090ad0640 1 -- 172.21.15.93:0/2770515475 >> v1:172.21.15.125:6789/0 conn(0x7f808c0cae30 legacy=0x7f808c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f8090ad0640 1 -- 172.21.15.93:0/2770515475 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c06a2c0 con 0x7f808c065df0 2023-11-04T01:36:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f8090ad0640 1 --2- 172.21.15.93:0/2770515475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c065df0 0x7f808c06b080 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f808c15d670 tx=0x7f808402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29015558890fa271 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f808affd640 1 -- 172.21.15.93:0/2770515475 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808402ea90 con 0x7f808c065df0 2023-11-04T01:36:40.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f808affd640 1 -- 172.21.15.93:0/2770515475 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808402ebf0 con 0x7f808c065df0 2023-11-04T01:36:40.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.502+0000 7f808affd640 1 -- 172.21.15.93:0/2770515475 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084009600 con 0x7f808c065df0 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 -- 172.21.15.93:0/2770515475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c065df0 msgr2=0x7f808c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 --2- 172.21.15.93:0/2770515475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c065df0 0x7f808c06b080 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f808c15d670 tx=0x7f808402e0f0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 -- 172.21.15.93:0/2770515475 shutdown_connections 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 --2- 172.21.15.93:0/2770515475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c065df0 0x7f808c06b080 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 --2- 172.21.15.93:0/2770515475 >> v2:172.21.15.125:3300/0 conn(0x7f808c159e30 0x7f808c0c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 -- 172.21.15.93:0/2770515475 >> 172.21.15.93:0/2770515475 conn(0x7f808c0cbc90 msgr2=0x7f808c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 -- 172.21.15.93:0/2770515475 shutdown_connections 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.503+0000 7f8092533640 1 -- 172.21.15.93:0/2770515475 wait complete. 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.504+0000 7f8092533640 1 Processor -- start 2023-11-04T01:36:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.504+0000 7f8092533640 1 -- start start 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f808c065df0 0x7f808c0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 0x7f808c0af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c153580 con 0x7f808c0cae30 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c152970 con 0x7f808c159e30 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8092533640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c152c50 con 0x7f808c065df0 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39484/0 (socket says 172.21.15.93:39484) 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 -- 172.21.15.93:0/1288637499 learned_addr learned my addr 172.21.15.93:0/1288637499 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8090ad0640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 0x7f808c0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 -- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f808c065df0 msgr2=0x7f808c0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f808c065df0 0x7f808c0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 -- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 msgr2=0x7f808c0af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 0x7f808c0af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f808b7fe640 1 -- 172.21.15.93:0/1288637499 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808400bd40 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.505+0000 7f8090ad0640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 0x7f808c0af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f808b7fe640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f808000d5f0 tx=0x7f808000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80800125f0 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8080012750 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c152f30 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080012b00 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.506+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1524e0 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.507+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c152700 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.507+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8080012c60 con 0x7f808c0cae30 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.507+0000 7f8088ff9640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 0x7f807806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.507+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8080089e20 con 0x7f808c0cae30 2023-11-04T01:36:40.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.507+0000 7f808bfff640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 0x7f807806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.508+0000 7f808bfff640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 0x7f807806d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f807c003cc0 tx=0x7f807c0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.512+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8080054b10 con 0x7f808c0cae30 2023-11-04T01:36:40.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.676+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f808c074290 con 0x7f808c0cae30 2023-11-04T01:36:40.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.676+0000 7f8088ff9640 1 -- 172.21.15.93:0/1288637499 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8080058130 con 0x7f808c0cae30 2023-11-04T01:36:40.679 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 msgr2=0x7f807806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 0x7f807806d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f807c003cc0 tx=0x7f807c0079b0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 msgr2=0x7f808c0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f808000d5f0 tx=0x7f808000dab0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 shutdown_connections 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f807806aea0 0x7f807806d360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f808c159e30 0x7f808c0af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f808c0cae30 0x7f808c0c6c60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 --2- 172.21.15.93:0/1288637499 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f808c065df0 0x7f808c0c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 >> 172.21.15.93:0/1288637499 conn(0x7f808c0cbc90 msgr2=0x7f808c158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 shutdown_connections 2023-11-04T01:36:40.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.678+0000 7f8092533640 1 -- 172.21.15.93:0/1288637499 wait complete. 2023-11-04T01:36:40.691 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:40.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.791+0000 7efcff0da640 1 Processor -- start 2023-11-04T01:36:40.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.791+0000 7efcff0da640 1 -- start start 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcff0da640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 0x7efcf806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcff0da640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcf815b120 0x7efcf815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcff0da640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf8065df0 con 0x7efcf80c9b60 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcff0da640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf806bc40 con 0x7efcf815b120 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcff0da640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf815f910 con 0x7efcf815ad40 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcf815b120 0x7efcf815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcfd677640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7efcf80c9b60 0x7efcf8070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54582/0 (socket says 172.21.15.93:54582) 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcfd677640 1 -- 172.21.15.93:0/3947699988 learned_addr learned my addr 172.21.15.93:0/3947699988 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcfce76640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 0x7efcf806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf7fff640 1 -- 172.21.15.93:0/3947699988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 msgr2=0x7efcf806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:40.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf7fff640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 0x7efcf806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf7fff640 1 -- 172.21.15.93:0/3947699988 >> v1:172.21.15.93:6789/0 conn(0x7efcf80c9b60 legacy=0x7efcf8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf7fff640 1 -- 172.21.15.93:0/3947699988 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8066040 con 0x7efcf815b120 2023-11-04T01:36:40.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcf77fe640 1 -- 172.21.15.93:0/3947699988 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393534489 0 0) 0x7efcf8065df0 con 0x7efcf80c9b60 2023-11-04T01:36:40.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.792+0000 7efcfce76640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 0x7efcf806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.793+0000 7efcf7fff640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf815b120 0x7efcf815f3d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efce40097a0 tx=0x7efce402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98c876d8bf00043 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.793+0000 7efcf77fe640 1 -- 172.21.15.93:0/3947699988 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4031830 con 0x7efcf815b120 2023-11-04T01:36:40.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.793+0000 7efcf77fe640 1 -- 172.21.15.93:0/3947699988 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4031990 con 0x7efcf815b120 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.793+0000 7efcf77fe640 1 -- 172.21.15.93:0/3947699988 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4031d20 con 0x7efcf815b120 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 -- 172.21.15.93:0/3947699988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf815b120 msgr2=0x7efcf815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf815b120 0x7efcf815f3d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efce40097a0 tx=0x7efce402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 -- 172.21.15.93:0/3947699988 shutdown_connections 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf815b120 0x7efcf815f3d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 --2- 172.21.15.93:0/3947699988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815ad40 0x7efcf806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 -- 172.21.15.93:0/3947699988 >> 172.21.15.93:0/3947699988 conn(0x7efcf80cbc90 msgr2=0x7efcf80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 -- 172.21.15.93:0/3947699988 shutdown_connections 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.794+0000 7efcff0da640 1 -- 172.21.15.93:0/3947699988 wait complete. 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.795+0000 7efcff0da640 1 Processor -- start 2023-11-04T01:36:40.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.795+0000 7efcff0da640 1 -- start start 2023-11-04T01:36:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 0x7efcf814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 0x7efcf814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c9000 con 0x7efcf80c9b60 2023-11-04T01:36:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c8380 con 0x7efcf815ad40 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c8660 con 0x7efcf815b120 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39502/0 (socket says 172.21.15.93:39502) 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 -- 172.21.15.93:0/2255738872 learned_addr learned my addr 172.21.15.93:0/2255738872 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcf7fff640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 0x7efcf814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfd677640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 0x7efcf814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 -- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 msgr2=0x7efcf814cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 0x7efcf814cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 -- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 msgr2=0x7efcf814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 0x7efcf814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 -- 172.21.15.93:0/2255738872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009400 con 0x7efcf80c9b60 2023-11-04T01:36:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcf7fff640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 0x7efcf814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfd677640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 0x7efcf814cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcfce76640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c7f0 tx=0x7efcec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec007a30 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec007b90 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00ce40 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.796+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf80c8940 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.797+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf80c5c80 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.797+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf8074290 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.798+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcec0113f0 con 0x7efcf80c9b60 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.798+0000 7efcf57fa640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 0x7efcdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:40.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.798+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efcec089b70 con 0x7efcf80c9b60 2023-11-04T01:36:40.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.798+0000 7efcf7fff640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 0x7efcdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:40.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.799+0000 7efcf7fff640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 0x7efcdc06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efce4036000 tx=0x7efce403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:40.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.802+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcec054860 con 0x7efcf80c9b60 2023-11-04T01:36:40.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.967+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcf80b0b20 con 0x7efcf80c9b60 2023-11-04T01:36:40.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.967+0000 7efcf57fa640 1 -- 172.21.15.93:0/2255738872 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcec057e80 con 0x7efcf80c9b60 2023-11-04T01:36:40.969 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:40.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 msgr2=0x7efcdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 0x7efcdc06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efce4036000 tx=0x7efce403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 msgr2=0x7efcf80c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c7f0 tx=0x7efcec00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 shutdown_connections 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcdc06ae70 0x7efcdc06d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcf815b120 0x7efcf814cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcf815ad40 0x7efcf814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 --2- 172.21.15.93:0/2255738872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcf80c9b60 0x7efcf80c5740 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 >> 172.21.15.93:0/2255738872 conn(0x7efcf80cbc90 msgr2=0x7efcf8070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 shutdown_connections 2023-11-04T01:36:40.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:40.969+0000 7efcff0da640 1 -- 172.21.15.93:0/2255738872 wait complete. 2023-11-04T01:36:40.983 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:41.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.083+0000 7f1a65c94640 1 Processor -- start 2023-11-04T01:36:41.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.083+0000 7f1a65c94640 1 -- start start 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a65c94640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a600c4ff0 0x7f1a600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a65c94640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600adac0 0x7f1a600adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a65c94640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6015aff0 con 0x7f1a60159c00 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a65c94640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a600ae460 con 0x7f1a600c4ff0 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a65c94640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015a3e0 con 0x7f1a600adac0 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a600c4ff0 0x7f1a600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a600c4ff0 0x7f1a600cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39514/0 (socket says 172.21.15.93:39514) 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 -- 172.21.15.93:0/3397680050 learned_addr learned my addr 172.21.15.93:0/3397680050 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5ffff640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600adac0 0x7f1a600adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 -- 172.21.15.93:0/3397680050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600adac0 msgr2=0x7f1a600adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600adac0 0x7f1a600adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 -- 172.21.15.93:0/3397680050 >> v1:172.21.15.125:6789/0 conn(0x7f1a60159c00 legacy=0x7f1a600c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.084+0000 7f1a5effd640 1 -- 172.21.15.93:0/3397680050 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6015a6c0 con 0x7f1a600c4ff0 2023-11-04T01:36:41.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.085+0000 7f1a5effd640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600c4ff0 0x7f1a600cc890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400bb10 tx=0x7f1a5402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a7521e0d65dc24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.085+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/3397680050 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5402ee70 con 0x7f1a600c4ff0 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.085+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/3397680050 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54036440 con 0x7f1a600c4ff0 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.085+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/3397680050 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540367d0 con 0x7f1a600c4ff0 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 -- 172.21.15.93:0/3397680050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600c4ff0 msgr2=0x7f1a600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600c4ff0 0x7f1a600cc890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400bb10 tx=0x7f1a5402e0c0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 -- 172.21.15.93:0/3397680050 shutdown_connections 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600adac0 0x7f1a600adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3397680050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600c4ff0 0x7f1a600cc890 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 -- 172.21.15.93:0/3397680050 >> 172.21.15.93:0/3397680050 conn(0x7f1a600ce950 msgr2=0x7f1a600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 -- 172.21.15.93:0/3397680050 shutdown_connections 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.086+0000 7f1a65c94640 1 -- 172.21.15.93:0/3397680050 wait complete. 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.087+0000 7f1a65c94640 1 Processor -- start 2023-11-04T01:36:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.087+0000 7f1a65c94640 1 -- start start 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a600c4ff0 0x7f1a600c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60159c00 0x7f1a601e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c6e80 con 0x7f1a600adac0 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c7160 con 0x7f1a600c4ff0 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a65c94640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c7440 con 0x7f1a60159c00 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39524/0 (socket says 172.21.15.93:39524) 2023-11-04T01:36:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 -- 172.21.15.93:0/3450253209 learned_addr learned my addr 172.21.15.93:0/3450253209 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 -- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60159c00 msgr2=0x7f1a601e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60159c00 0x7f1a601e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 -- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a600c4ff0 msgr2=0x7f1a600c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a600c4ff0 0x7f1a600c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 -- 172.21.15.93:0/3450253209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5400b770 con 0x7f1a600adac0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.088+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000b3f0 tx=0x7f1a5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.089+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50011830 con 0x7f1a600adac0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.089+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50011990 con 0x7f1a600adac0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.089+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600c7720 con 0x7f1a600adac0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.089+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50011d40 con 0x7f1a600adac0 2023-11-04T01:36:41.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.089+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a601447e0 con 0x7f1a600adac0 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.090+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a60074290 con 0x7f1a600adac0 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.090+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a5001a400 con 0x7f1a600adac0 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.090+0000 7f1a47fff640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.091+0000 7f1a5effd640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.091+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a50089bd0 con 0x7f1a600adac0 2023-11-04T01:36:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.091+0000 7f1a5effd640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a54038000 tx=0x7f1a54030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.095+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a50054830 con 0x7f1a600adac0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.262+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a60156020 con 0x7f1a600adac0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.263+0000 7f1a47fff640 1 -- 172.21.15.93:0/3450253209 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a50015020 con 0x7f1a600adac0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 msgr2=0x7f1a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a54038000 tx=0x7f1a54030000 comp rx=0 tx=0).stop 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 msgr2=0x7f1a601442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000b3f0 tx=0x7f1a5000b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 shutdown_connections 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a60159c00 0x7f1a601e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a600c4ff0 0x7f1a600c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 --2- 172.21.15.93:0/3450253209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a600adac0 0x7f1a601442a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.264+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 >> 172.21.15.93:0/3450253209 conn(0x7f1a600ce950 msgr2=0x7f1a600c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.265+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 shutdown_connections 2023-11-04T01:36:41.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.265+0000 7f1a65c94640 1 -- 172.21.15.93:0/3450253209 wait complete. 2023-11-04T01:36:41.278 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:41.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.379+0000 7f102bd05640 1 Processor -- start 2023-11-04T01:36:41.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 -- start start 2023-11-04T01:36:41.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1024153e60 0x7f102415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f1024161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240cde60 con 0x7f10240b4880 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1024160f90 con 0x7f1024153e60 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.380+0000 7f102bd05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102415e400 con 0x7f10240cd6d0 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f102a2a2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f10240b4880 0x7f10240b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54586/0 (socket says 172.21.15.93:54586) 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f102a2a2640 1 -- 172.21.15.93:0/3127350496 learned_addr learned my addr 172.21.15.93:0/3127350496 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3127350496 >> v2:172.21.15.125:3300/0 conn(0x7f1024153e60 0x7f102415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f10292a0640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f1024161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834495226 0 0) 0x7f10240cde60 con 0x7f10240b4880 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1010003520 con 0x7f10240b4880 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 24623989 0 0) 0x7f1010003520 con 0x7f10240b4880 2023-11-04T01:36:41.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 msgr2=0x7f1024161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f1024161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 >> v2:172.21.15.125:3300/0 conn(0x7f1024153e60 msgr2=0x7f102415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 --2- 172.21.15.93:0/3127350496 >> v2:172.21.15.125:3300/0 conn(0x7f1024153e60 0x7f102415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024161960 con 0x7f10240b4880 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f101c0019f0 con 0x7f10240b4880 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3127350496 >> v2:172.21.15.125:3300/0 conn(0x7f1024153e60 0x7f102415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 >> v1:172.21.15.93:6789/0 conn(0x7f10240b4880 legacy=0x7f10240b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1010003970 0x7f1010003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f10100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1010004d00 0x7f1010005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024160f90 con 0x7f1010004d00 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102415e400 con 0x7f1010003970 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101000b980 con 0x7f10240cd6d0 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1010004d00 0x7f1010005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1010003970 0x7f1010003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.381+0000 7f10292a0640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f10100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 -- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 msgr2=0x7f10100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f10100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 -- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1010003970 msgr2=0x7f1010003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1010003970 0x7f1010003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 -- 172.21.15.93:0/3127350496 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010003520 con 0x7f1010004d00 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f10292a0640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10240cd6d0 0x7f10100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1010004d00 0x7f1010005180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f101c00a870 tx=0x7f10100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41a25b570e0e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.382+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c034630 con 0x7f1010004d00 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c02f070 con 0x7f1010004d00 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f1028a9f640 1 -- 172.21.15.93:0/3127350496 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0349f0 con 0x7f1010004d00 2023-11-04T01:36:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 -- 172.21.15.93:0/3127350496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1010004d00 msgr2=0x7f1010005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 --2- 172.21.15.93:0/3127350496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1010004d00 0x7f1010005180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f101c00a870 tx=0x7f10100057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102a2a2640 1 -- 172.21.15.93:0/3127350496 reap_dead start 2023-11-04T01:36:41.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 -- 172.21.15.93:0/3127350496 shutdown_connections 2023-11-04T01:36:41.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 -- 172.21.15.93:0/3127350496 >> 172.21.15.93:0/3127350496 conn(0x7f10240cf880 msgr2=0x7f10240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 -- 172.21.15.93:0/3127350496 shutdown_connections 2023-11-04T01:36:41.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.383+0000 7f102bd05640 1 -- 172.21.15.93:0/3127350496 wait complete. 2023-11-04T01:36:41.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.385+0000 7f102bd05640 1 Processor -- start 2023-11-04T01:36:41.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.385+0000 7f102bd05640 1 -- start start 2023-11-04T01:36:41.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1024152fe0 0x7f10240cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1024154c20 0x7f10240c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240c8f20 con 0x7f10240c8aa0 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241551c0 con 0x7f1024152fe0 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10241554a0 con 0x7f1024154c20 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39544/0 (socket says 172.21.15.93:39544) 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 -- 172.21.15.93:0/3892952226 learned_addr learned my addr 172.21.15.93:0/3892952226 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f10292a0640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1024154c20 0x7f10240c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1024152fe0 0x7f10240cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 -- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1024154c20 msgr2=0x7f10240c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1024154c20 0x7f10240c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 -- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1024152fe0 msgr2=0x7f10240cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1024152fe0 0x7f10240cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 -- 172.21.15.93:0/3892952226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024155780 con 0x7f10240c8aa0 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102a2a2640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f101c00a870 tx=0x7f10241610d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c034840 con 0x7f10240c8aa0 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0349a0 con 0x7f10240c8aa0 2023-11-04T01:36:41.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1024155a60 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c034d10 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.386+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10240ccdb0 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.387+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024074290 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.388+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f101c031030 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.388+0000 7f10167fc640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 0x7f100806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.388+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f101c0aba30 con 0x7f10240c8aa0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.388+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 0x7f100806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.389+0000 7f1029aa1640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 0x7f100806d360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10180093d0 tx=0x7f1018009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.396+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f101c0768f0 con 0x7f10240c8aa0 2023-11-04T01:36:41.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.570+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1024074290 con 0x7f10240c8aa0 2023-11-04T01:36:41.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.571+0000 7f10167fc640 1 -- 172.21.15.93:0/3892952226 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f101c001fb0 con 0x7f10240c8aa0 2023-11-04T01:36:41.573 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:41.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 msgr2=0x7f100806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 0x7f100806d360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10180093d0 tx=0x7f1018009190 comp rx=0 tx=0).stop 2023-11-04T01:36:41.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 msgr2=0x7f10241f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f101c00a870 tx=0x7f10241610d0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 shutdown_connections 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f100806aea0 0x7f100806d360 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10240c8aa0 0x7f10241f4e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1024154c20 0x7f10240c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 --2- 172.21.15.93:0/3892952226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1024152fe0 0x7f10240cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 >> 172.21.15.93:0/3892952226 conn(0x7f10240cf880 msgr2=0x7f102415fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 shutdown_connections 2023-11-04T01:36:41.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.573+0000 7f102bd05640 1 -- 172.21.15.93:0/3892952226 wait complete. 2023-11-04T01:36:41.588 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:36:41.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.688+0000 7f076fcd4640 1 Processor -- start 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 -- start start 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07680cde60 0x7f076815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07680ce240 0x7f07680d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076815e000 con 0x7f076815daa0 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076815e5c0 con 0x7f07680ce240 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.689+0000 7f076fcd4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076815e2e0 con 0x7f07680cde60 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07680ce240 0x7f07680d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07680ce240 0x7f07680d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42652/0 (socket says 172.21.15.93:42652) 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 -- 172.21.15.93:0/1310497332 learned_addr learned my addr 172.21.15.93:0/1310497332 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076da70640 1 --2- 172.21.15.93:0/1310497332 >> v2:172.21.15.125:3300/0 conn(0x7f07680cde60 0x7f076815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 -- 172.21.15.93:0/1310497332 >> v2:172.21.15.125:3300/0 conn(0x7f07680cde60 msgr2=0x7f076815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 --2- 172.21.15.93:0/1310497332 >> v2:172.21.15.125:3300/0 conn(0x7f07680cde60 0x7f076815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 -- 172.21.15.93:0/1310497332 >> v1:172.21.15.125:6789/0 conn(0x7f076815daa0 legacy=0x7f0768157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.690+0000 7f076e271640 1 -- 172.21.15.93:0/1310497332 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680d1120 con 0x7f07680ce240 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076e271640 1 --2- 172.21.15.93:0/1310497332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07680ce240 0x7f07680d1920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07680b5550 tx=0x7f076402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e024193344e5d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076ca6e640 1 -- 172.21.15.93:0/1310497332 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076402cb20 con 0x7f07680ce240 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076ca6e640 1 -- 172.21.15.93:0/1310497332 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076402cc80 con 0x7f07680ce240 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076ca6e640 1 -- 172.21.15.93:0/1310497332 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640343f0 con 0x7f07680ce240 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 -- 172.21.15.93:0/1310497332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07680ce240 msgr2=0x7f07680d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 --2- 172.21.15.93:0/1310497332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07680ce240 0x7f07680d1920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07680b5550 tx=0x7f076402bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 -- 172.21.15.93:0/1310497332 shutdown_connections 2023-11-04T01:36:41.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 --2- 172.21.15.93:0/1310497332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07680ce240 0x7f07680d1920 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 --2- 172.21.15.93:0/1310497332 >> v2:172.21.15.125:3300/0 conn(0x7f07680cde60 0x7f076815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.691+0000 7f076fcd4640 1 -- 172.21.15.93:0/1310497332 >> 172.21.15.93:0/1310497332 conn(0x7f0768071f30 msgr2=0x7f07680cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.692+0000 7f076fcd4640 1 -- 172.21.15.93:0/1310497332 shutdown_connections 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.692+0000 7f076fcd4640 1 -- 172.21.15.93:0/1310497332 wait complete. 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 Processor -- start 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 -- start start 2023-11-04T01:36:41.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07680cde60 0x7f0768154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07680ce240 0x7f0768154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.693+0000 7f076fcd4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681f61e0 con 0x7f076815daa0 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076fcd4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681f64c0 con 0x7f07680cde60 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076fcd4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07681f67a0 con 0x7f07680ce240 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42660/0 (socket says 172.21.15.93:42660) 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 -- 172.21.15.93:0/580638317 learned_addr learned my addr 172.21.15.93:0/580638317 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076da70640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07680cde60 0x7f0768154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076d26f640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07680ce240 0x7f0768154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 -- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07680ce240 msgr2=0x7f0768154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07680ce240 0x7f0768154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 -- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07680cde60 msgr2=0x7f0768154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07680cde60 0x7f0768154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 -- 172.21.15.93:0/580638317 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009b30 con 0x7f076815daa0 2023-11-04T01:36:41.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076e271640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0764036040 tx=0x7f0764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764007e70 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764009510 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076403e690 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.694+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681f6a80 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.695+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681554f0 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.696+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07681e52d0 con 0x7f076815daa0 2023-11-04T01:36:41.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.696+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f076403e7f0 con 0x7f076815daa0 2023-11-04T01:36:41.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.696+0000 7f075e7fc640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 0x7f074c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.697+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07640ac390 con 0x7f076815daa0 2023-11-04T01:36:41.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.697+0000 7f076da70640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 0x7f074c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.697+0000 7f076da70640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 0x7f074c06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0760006fd0 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.701+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07681e52d0 con 0x7f076815daa0 2023-11-04T01:36:41.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:41.938+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f07681e52d0 con 0x7f076815daa0 2023-11-04T01:36:42.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.190+0000 7f075e7fc640 1 -- 172.21.15.93:0/580638317 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v69) v1 ==== 176+0+0 (secure 0 0 0) 0x7f07681e52d0 con 0x7f076815daa0 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.192+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 msgr2=0x7f074c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.192+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 0x7f074c06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0760006fd0 tx=0x7f0760008040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 msgr2=0x7f07680cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0764036040 tx=0x7f0764004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 shutdown_connections 2023-11-04T01:36:42.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f074c06ae70 0x7f074c06d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f076815daa0 0x7f07680cbf00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07680ce240 0x7f0768154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 --2- 172.21.15.93:0/580638317 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07680cde60 0x7f0768154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 >> 172.21.15.93:0/580638317 conn(0x7f0768071f30 msgr2=0x7f07680cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 shutdown_connections 2023-11-04T01:36:42.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.193+0000 7f076fcd4640 1 -- 172.21.15.93:0/580638317 wait complete. 2023-11-04T01:36:42.206 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:36:42.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.307+0000 7f1921390640 1 Processor -- start 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 -- start start 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f191c1460c0 0x7f191c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 0x7f191c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c146950 con 0x7f191c0c37d0 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c1464a0 con 0x7f191c1460c0 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f1921390640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0c41a0 con 0x7f191c070e20 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f191affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f191c1460c0 0x7f191c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.308+0000 7f191a7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f191c0c37d0 0x7f191c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60626/0 (socket says 172.21.15.93:60626) 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191a7fc640 1 -- 172.21.15.93:0/4089643807 learned_addr learned my addr 172.21.15.93:0/4089643807 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191b7fe640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 0x7f191c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191affd640 1 -- 172.21.15.93:0/4089643807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 msgr2=0x7f191c0c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191affd640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 0x7f191c0c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191affd640 1 -- 172.21.15.93:0/4089643807 >> v1:172.21.15.93:6789/0 conn(0x7f191c0c37d0 legacy=0x7f191c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f1919ffb640 1 -- 172.21.15.93:0/4089643807 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041322048 0 0) 0x7f191c146950 con 0x7f191c0c37d0 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191affd640 1 -- 172.21.15.93:0/4089643807 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0cc5c0 con 0x7f191c1460c0 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.309+0000 7f191b7fe640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 0x7f191c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f191affd640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c0b1860 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f19100097a0 tx=0x7f191002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e465c9561ce45f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1919ffb640 1 -- 172.21.15.93:0/4089643807 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910031830 con 0x7f191c1460c0 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1919ffb640 1 -- 172.21.15.93:0/4089643807 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910031990 con 0x7f191c1460c0 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1919ffb640 1 -- 172.21.15.93:0/4089643807 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910031d20 con 0x7f191c1460c0 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 -- 172.21.15.93:0/4089643807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 msgr2=0x7f191c0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c0b1860 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f19100097a0 tx=0x7f191002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 -- 172.21.15.93:0/4089643807 shutdown_connections 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c070e20 0x7f191c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 --2- 172.21.15.93:0/4089643807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c0b1860 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 -- 172.21.15.93:0/4089643807 >> 172.21.15.93:0/4089643807 conn(0x7f191c0ce950 msgr2=0x7f191c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 -- 172.21.15.93:0/4089643807 shutdown_connections 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.310+0000 7f1921390640 1 -- 172.21.15.93:0/4089643807 wait complete. 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 Processor -- start 2023-11-04T01:36:42.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 -- start start 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f191c070e20 0x7f191c0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c0c37d0 0x7f191c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0b22a0 con 0x7f191c1460c0 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0c5f30 con 0x7f191c070e20 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f1921390640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0b24d0 con 0x7f191c0c37d0 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f191b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f191b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42678/0 (socket says 172.21.15.93:42678) 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.312+0000 7f191b7fe640 1 -- 172.21.15.93:0/418194416 learned_addr learned my addr 172.21.15.93:0/418194416 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 -- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c0c37d0 msgr2=0x7f191c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c0c37d0 0x7f191c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 -- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f191c070e20 msgr2=0x7f191c0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f191c070e20 0x7f191c0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 -- 172.21.15.93:0/418194416 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910009400 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f191b7fe640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f191400ce80 tx=0x7f191400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400d840 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400d9e0 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c0b27b0 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400dd90 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.313+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c15ccc0 con 0x7f191c1460c0 2023-11-04T01:36:42.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.314+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c0c5a20 con 0x7f191c1460c0 2023-11-04T01:36:42.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.314+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1914015440 con 0x7f191c1460c0 2023-11-04T01:36:42.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.315+0000 7f19037fe640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 0x7f190806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.315+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f191408a2d0 con 0x7f191c1460c0 2023-11-04T01:36:42.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.315+0000 7f191affd640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 0x7f190806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.315+0000 7f191affd640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 0x7f190806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1910036000 tx=0x7f1910030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.323+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f191c0c5a20 con 0x7f191c1460c0 2023-11-04T01:36:42.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.529+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f191c0c5a20 con 0x7f191c1460c0 2023-11-04T01:36:42.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.532+0000 7f19037fe640 1 -- 172.21.15.93:0/418194416 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f191c0c5a20 con 0x7f191c1460c0 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 msgr2=0x7f190806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 0x7f190806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1910036000 tx=0x7f1910030000 comp rx=0 tx=0).stop 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 msgr2=0x7f191c15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f191400ce80 tx=0x7f191400a710 comp rx=0 tx=0).stop 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 shutdown_connections 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f190806ae70 0x7f190806d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f191c1460c0 0x7f191c15c780 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f191c0c37d0 0x7f191c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 --2- 172.21.15.93:0/418194416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f191c070e20 0x7f191c0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 >> 172.21.15.93:0/418194416 conn(0x7f191c0ce950 msgr2=0x7f191c1e55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 shutdown_connections 2023-11-04T01:36:42.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.534+0000 7f1921390640 1 -- 172.21.15.93:0/418194416 wait complete. 2023-11-04T01:36:42.548 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:36:42.548 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:36:42.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:36:42.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:36:42.647 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:42.647 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:42.662 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:42.662 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:42.721 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:42.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:36:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.855+0000 7f0bae66b640 1 Processor -- start 2023-11-04T01:36:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.855+0000 7f0bae66b640 1 -- start start 2023-11-04T01:36:42.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0bae66b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0ba806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0bae66b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba806cd00 con 0x7f0ba80b42c0 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0bae66b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba806cfa0 con 0x7f0ba80c9e10 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0bae66b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba806d280 con 0x7f0ba815ad80 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0ba80b42c0 0x7f0ba80c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60638/0 (socket says 172.21.15.93:60638) 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba77fe640 1 -- 172.21.15.93:0/2430547836 learned_addr learned my addr 172.21.15.93:0/2430547836 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba7fff640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0ba806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395045169 0 0) 0x7f0ba806cd00 con 0x7f0ba80b42c0 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b90003520 con 0x7f0ba80b42c0 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719126958 0 0) 0x7f0b90003520 con 0x7f0ba80b42c0 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 msgr2=0x7f0ba806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0ba806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 >> v1:172.21.15.125:6789/0 conn(0x7f0ba80c9e10 legacy=0x7f0ba80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba806d560 con 0x7f0ba80b42c0 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f0b98001690 con 0x7f0ba80b42c0 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 >> v1:172.21.15.93:6789/0 conn(0x7f0ba80b42c0 legacy=0x7f0ba80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0b900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba806d280 con 0x7f0b90004d00 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9000bac0 con 0x7f0b900039a0 2023-11-04T01:36:42.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.856+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9000bc80 con 0x7f0ba815ad80 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0ba7fff640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0ba77fe640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0b900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 -- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 msgr2=0x7f0b900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba815ad80 0x7f0b900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 -- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b900039a0 msgr2=0x7f0b90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 -- 172.21.15.93:0/2430547836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90003520 con 0x7f0b90004d00 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.857+0000 7f0bacc08640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80c8e70 tx=0x7f0b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd36d98306e85e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0003b70 con 0x7f0b90004d00 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0003cd0 con 0x7f0b90004d00 2023-11-04T01:36:42.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0ba6ffd640 1 -- 172.21.15.93:0/2430547836 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0005310 con 0x7f0b90004d00 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 -- 172.21.15.93:0/2430547836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b90004d00 msgr2=0x7f0b90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 --2- 172.21.15.93:0/2430547836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80c8e70 tx=0x7f0b900057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bacc08640 1 -- 172.21.15.93:0/2430547836 reap_dead start 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 -- 172.21.15.93:0/2430547836 shutdown_connections 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 -- 172.21.15.93:0/2430547836 >> 172.21.15.93:0/2430547836 conn(0x7f0ba80ce950 msgr2=0x7f0ba80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 -- 172.21.15.93:0/2430547836 shutdown_connections 2023-11-04T01:36:42.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.858+0000 7f0bae66b640 1 -- 172.21.15.93:0/2430547836 wait complete. 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.859+0000 7f0bae66b640 1 Processor -- start 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 -- start start 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba814fcb0 0x7f0ba80ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba8150090 0x7f0ba80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80c5ea0 con 0x7f0ba815ccf0 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba815d6b0 con 0x7f0ba814fcb0 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bae66b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80ad0b0 con 0x7f0ba8150090 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bacc08640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bacc08640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42688/0 (socket says 172.21.15.93:42688) 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.860+0000 7f0bacc08640 1 -- 172.21.15.93:0/3096636050 learned_addr learned my addr 172.21.15.93:0/3096636050 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0ba77fe640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba8150090 0x7f0ba80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0ba7fff640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba814fcb0 0x7f0ba80ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 -- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba8150090 msgr2=0x7f0ba80ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba8150090 0x7f0ba80ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 -- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba814fcb0 msgr2=0x7f0ba80ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba814fcb0 0x7f0ba80ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 -- 172.21.15.93:0/3096636050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80ac830 con 0x7f0ba815ccf0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bacc08640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0ba002c020 tx=0x7f0ba00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba003e070 con 0x7f0ba815ccf0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0003e40 con 0x7f0ba815ccf0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0006d50 con 0x7f0ba815ccf0 2023-11-04T01:36:42.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba80acaf0 con 0x7f0ba815ccf0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.861+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba80c5ac0 con 0x7f0ba815ccf0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.862+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8074290 con 0x7f0ba815ccf0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.862+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ba0041070 con 0x7f0ba815ccf0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.863+0000 7f0ba4ff9640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 0x7f0b9406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.863+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ba00aa760 con 0x7f0ba815ccf0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.863+0000 7f0ba7fff640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 0x7f0b9406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.863+0000 7f0ba7fff640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 0x7f0b9406d360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0099e0 tx=0x7f0b9c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:42.867+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ba00754e0 con 0x7f0ba815ccf0 2023-11-04T01:36:43.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.033+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ba80adcb0 con 0x7f0ba815ccf0 2023-11-04T01:36:43.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.034+0000 7f0ba4ff9640 1 -- 172.21.15.93:0/3096636050 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f0ba0078b00 con 0x7f0ba815ccf0 2023-11-04T01:36:43.037 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:43.037 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:43.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 msgr2=0x7f0b9406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 0x7f0b9406d360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0099e0 tx=0x7f0b9c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:43.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 msgr2=0x7f0ba815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0ba002c020 tx=0x7f0ba00014a0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 shutdown_connections 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9406aea0 0x7f0b9406d360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba815ccf0 0x7f0ba815d170 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ba8150090 0x7f0ba80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 --2- 172.21.15.93:0/3096636050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba814fcb0 0x7f0ba80ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 >> 172.21.15.93:0/3096636050 conn(0x7f0ba80ce950 msgr2=0x7f0ba80af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 shutdown_connections 2023-11-04T01:36:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.036+0000 7f0bae66b640 1 -- 172.21.15.93:0/3096636050 wait complete. 2023-11-04T01:36:43.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:43.050 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.149+0000 7fc2a47c0640 1 Processor -- start 2023-11-04T01:36:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.149+0000 7fc2a47c0640 1 -- start start 2023-11-04T01:36:43.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.150+0000 7fc2a47c0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc29c15ad30 0x7fc29c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.150+0000 7fc2a47c0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc29c0ad730 0x7fc29c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.150+0000 7fc2a47c0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0c3900 con 0x7fc29c070c50 2023-11-04T01:36:43.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.150+0000 7fc2a47c0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0ae260 con 0x7fc29c15ad30 2023-11-04T01:36:43.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.150+0000 7fc2a47c0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c15f750 con 0x7fc29c0ad730 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a255c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc29c15ad30 0x7fc29c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a2d5d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc29c070c50 0x7fc29c0c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60650/0 (socket says 172.21.15.93:60650) 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a2d5d640 1 -- 172.21.15.93:0/51543568 learned_addr learned my addr 172.21.15.93:0/51543568 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a1d5b640 1 --2- 172.21.15.93:0/51543568 >> v2:172.21.15.125:3300/0 conn(0x7fc29c0ad730 0x7fc29c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a255c640 1 -- 172.21.15.93:0/51543568 >> v2:172.21.15.125:3300/0 conn(0x7fc29c0ad730 msgr2=0x7fc29c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a255c640 1 --2- 172.21.15.93:0/51543568 >> v2:172.21.15.125:3300/0 conn(0x7fc29c0ad730 0x7fc29c070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a255c640 1 -- 172.21.15.93:0/51543568 >> v1:172.21.15.93:6789/0 conn(0x7fc29c070c50 legacy=0x7fc29c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a255c640 1 -- 172.21.15.93:0/51543568 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0c3be0 con 0x7fc29c15ad30 2023-11-04T01:36:43.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.151+0000 7fc2a155a640 1 -- 172.21.15.93:0/51543568 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853491814 0 0) 0x7fc29c0c3900 con 0x7fc29c070c50 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a255c640 1 --2- 172.21.15.93:0/51543568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c15ad30 0x7fc29c0adc80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0ce7f0 tx=0x7fc28c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2707ca23c4b14418 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a155a640 1 -- 172.21.15.93:0/51543568 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c02cbf0 con 0x7fc29c15ad30 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a155a640 1 -- 172.21.15.93:0/51543568 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c02cd50 con 0x7fc29c15ad30 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a155a640 1 -- 172.21.15.93:0/51543568 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c034660 con 0x7fc29c15ad30 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 -- 172.21.15.93:0/51543568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c15ad30 msgr2=0x7fc29c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/51543568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c15ad30 0x7fc29c0adc80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0ce7f0 tx=0x7fc28c02be40 comp rx=0 tx=0).stop 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 -- 172.21.15.93:0/51543568 shutdown_connections 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/51543568 >> v2:172.21.15.125:3300/0 conn(0x7fc29c0ad730 0x7fc29c070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/51543568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c15ad30 0x7fc29c0adc80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 -- 172.21.15.93:0/51543568 >> 172.21.15.93:0/51543568 conn(0x7fc29c0ce950 msgr2=0x7fc29c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 -- 172.21.15.93:0/51543568 shutdown_connections 2023-11-04T01:36:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.152+0000 7fc2a47c0640 1 -- 172.21.15.93:0/51543568 wait complete. 2023-11-04T01:36:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.153+0000 7fc2a47c0640 1 Processor -- start 2023-11-04T01:36:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 -- start start 2023-11-04T01:36:43.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc29c070c50 0x7fc29c152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc29c15ad30 0x7fc29c1f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0ab8d0 con 0x7fc29c0ad730 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15c780 con 0x7fc29c15ad30 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a47c0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15ca60 con 0x7fc29c070c50 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a1d5b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a1d5b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42716/0 (socket says 172.21.15.93:42716) 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a1d5b640 1 -- 172.21.15.93:0/1181365726 learned_addr learned my addr 172.21.15.93:0/1181365726 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a255c640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc29c070c50 0x7fc29c152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.154+0000 7fc2a2d5d640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc29c15ad30 0x7fc29c1f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 -- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc29c070c50 msgr2=0x7fc29c152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc29c070c50 0x7fc29c152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 -- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc29c15ad30 msgr2=0x7fc29c1f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc29c15ad30 0x7fc29c1f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 -- 172.21.15.93:0/1181365726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c009a70 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a1d5b640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc29000d800 tx=0x7fc29000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000b6c0 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000b820 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c158740 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000bbb0 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.155+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c158d00 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.156+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c15e070 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.156+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc29000bd10 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.157+0000 7fc29affd640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.157+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc290089e40 con 0x7fc29c0ad730 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.157+0000 7fc2a255c640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.157+0000 7fc2a255c640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 0x7fc28806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc28c036000 tx=0x7fc28c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.161+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc29c15e070 con 0x7fc29c0ad730 2023-11-04T01:36:43.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.325+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc29c15e070 con 0x7fc29c0ad730 2023-11-04T01:36:43.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.326+0000 7fc29affd640 1 -- 172.21.15.93:0/1181365726 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc29c15e070 con 0x7fc29c0ad730 2023-11-04T01:36:43.328 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:43.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.327+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 msgr2=0x7fc28806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.327+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 0x7fc28806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc28c036000 tx=0x7fc28c030000 comp rx=0 tx=0).stop 2023-11-04T01:36:43.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 msgr2=0x7fc29c1f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc29000d800 tx=0x7fc29000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 shutdown_connections 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc29c15ad30 0x7fc29c1f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc29c0ad730 0x7fc29c1f5f10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 --2- 172.21.15.93:0/1181365726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc29c070c50 0x7fc29c152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 >> 172.21.15.93:0/1181365726 conn(0x7fc29c0ce950 msgr2=0x7fc29c155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 shutdown_connections 2023-11-04T01:36:43.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.328+0000 7fc2a47c0640 1 -- 172.21.15.93:0/1181365726 wait complete. 2023-11-04T01:36:43.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:43.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.440+0000 7f607f694640 1 Processor -- start 2023-11-04T01:36:43.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.440+0000 7f607f694640 1 -- start start 2023-11-04T01:36:43.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607f694640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60780cdc20 0x7f6078165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607f694640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780d0280 con 0x7f607815e430 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607f694640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780cf670 con 0x7f60780d0710 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607f694640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780cf950 con 0x7f60780cdc20 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607dc31640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60780cdc20 0x7f6078165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607d430640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f607815e430 0x7f60780cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60654/0 (socket says 172.21.15.93:60654) 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607d430640 1 -- 172.21.15.93:0/2918281372 learned_addr learned my addr 172.21.15.93:0/2918281372 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607dc31640 1 -- 172.21.15.93:0/2918281372 >> v1:172.21.15.125:6789/0 conn(0x7f60780d0710 legacy=0x7f60780cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607dc31640 1 -- 172.21.15.93:0/2918281372 >> v1:172.21.15.93:6789/0 conn(0x7f607815e430 legacy=0x7f60780cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.441+0000 7f607dc31640 1 -- 172.21.15.93:0/2918281372 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780cfc30 con 0x7f60780cdc20 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607dc31640 1 --2- 172.21.15.93:0/2918281372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780cdc20 0x7f6078165950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b8f72fdbf60b37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f606ffff640 1 -- 172.21.15.93:0/2918281372 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607002cab0 con 0x7f60780cdc20 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f606ffff640 1 -- 172.21.15.93:0/2918281372 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607002cc10 con 0x7f60780cdc20 2023-11-04T01:36:43.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f606ffff640 1 -- 172.21.15.93:0/2918281372 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070034440 con 0x7f60780cdc20 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607f694640 1 -- 172.21.15.93:0/2918281372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780cdc20 msgr2=0x7f6078165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607f694640 1 --2- 172.21.15.93:0/2918281372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780cdc20 0x7f6078165950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607002bd80 comp rx=0 tx=0).stop 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607f694640 1 -- 172.21.15.93:0/2918281372 shutdown_connections 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607f694640 1 --2- 172.21.15.93:0/2918281372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780cdc20 0x7f6078165950 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.442+0000 7f607f694640 1 -- 172.21.15.93:0/2918281372 >> 172.21.15.93:0/2918281372 conn(0x7f607806ea20 msgr2=0x7f607806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.443+0000 7f607f694640 1 -- 172.21.15.93:0/2918281372 shutdown_connections 2023-11-04T01:36:43.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.443+0000 7f607f694640 1 -- 172.21.15.93:0/2918281372 wait complete. 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 Processor -- start 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 -- start start 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60780cdc20 0x7f607814e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 0x7f60780ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607814e650 con 0x7f60780d0710 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781589d0 con 0x7f607815e430 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607f694640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780ca680 con 0x7f60780cdc20 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607cc2f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607cc2f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42738/0 (socket says 172.21.15.93:42738) 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.444+0000 7f607cc2f640 1 -- 172.21.15.93:0/3795353313 learned_addr learned my addr 172.21.15.93:0/3795353313 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607dc31640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 0x7f60780ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607d430640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60780cdc20 0x7f607814e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 -- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60780cdc20 msgr2=0x7f607814e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60780cdc20 0x7f607814e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 -- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 msgr2=0x7f60780ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 0x7f60780ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 -- 172.21.15.93:0/3795353313 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009a70 con 0x7f60780d0710 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607dc31640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 0x7f60780ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607cc2f640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f606800c4b0 tx=0x7f606800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680052d0 con 0x7f60780d0710 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068005430 con 0x7f60780d0710 2023-11-04T01:36:43.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068012870 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780ca8a0 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.445+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60780b0680 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.446+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6078074290 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.446+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60680129d0 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.447+0000 7f606dffb640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 0x7f605c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.447+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60680894c0 con 0x7f60780d0710 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.447+0000 7f607d430640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 0x7f605c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.447+0000 7f607d430640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 0x7f605c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6074007fd0 tx=0x7f6074007c20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.451+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60680541b0 con 0x7f60780d0710 2023-11-04T01:36:43.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.615+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f607815d9b0 con 0x7f60780d0710 2023-11-04T01:36:43.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.615+0000 7f606dffb640 1 -- 172.21.15.93:0/3795353313 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60680577d0 con 0x7f60780d0710 2023-11-04T01:36:43.618 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:43.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 msgr2=0x7f605c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 0x7f605c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6074007fd0 tx=0x7f6074007c20 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 msgr2=0x7f60780c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f606800c4b0 tx=0x7f606800c970 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 shutdown_connections 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f605c06ae70 0x7f605c06d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f607815e430 0x7f60780ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60780d0710 0x7f60780c9c00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 --2- 172.21.15.93:0/3795353313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f60780cdc20 0x7f607814e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 >> 172.21.15.93:0/3795353313 conn(0x7f607806ea20 msgr2=0x7f60780c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 shutdown_connections 2023-11-04T01:36:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.617+0000 7f607f694640 1 -- 172.21.15.93:0/3795353313 wait complete. 2023-11-04T01:36:43.631 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 Processor -- start 2023-11-04T01:36:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 -- start start 2023-11-04T01:36:43.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87800d0710 0x7f87800cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800cda50 0x7f87800b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800d0280 con 0x7f878015e430 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800cf670 con 0x7f87800d0710 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f8785ae7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cf950 con 0x7f87800cda50 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.731+0000 7f877effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87800d0710 0x7f87800cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87800d0710 0x7f87800cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42752/0 (socket says 172.21.15.93:42752) 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 -- 172.21.15.93:0/2759936408 learned_addr learned my addr 172.21.15.93:0/2759936408 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877ffff640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800cda50 0x7f87800b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 -- 172.21.15.93:0/2759936408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800cda50 msgr2=0x7f87800b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800cda50 0x7f87800b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 -- 172.21.15.93:0/2759936408 >> v1:172.21.15.125:6789/0 conn(0x7f878015e430 legacy=0x7f87800cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 -- 172.21.15.93:0/2759936408 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800cfc30 con 0x7f87800d0710 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.732+0000 7f877effd640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87800d0710 0x7f87800cd510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8774009870 tx=0x7f877402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cc2ee661094c4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f877e7fc640 1 -- 172.21.15.93:0/2759936408 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774030840 con 0x7f87800d0710 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f877e7fc640 1 -- 172.21.15.93:0/2759936408 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740309a0 con 0x7f87800d0710 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f877e7fc640 1 -- 172.21.15.93:0/2759936408 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774030d30 con 0x7f87800d0710 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 -- 172.21.15.93:0/2759936408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87800d0710 msgr2=0x7f87800cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87800d0710 0x7f87800cd510 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8774009870 tx=0x7f877402b980 comp rx=0 tx=0).stop 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 -- 172.21.15.93:0/2759936408 shutdown_connections 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800cda50 0x7f87800b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 --2- 172.21.15.93:0/2759936408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87800d0710 0x7f87800cd510 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 -- 172.21.15.93:0/2759936408 >> 172.21.15.93:0/2759936408 conn(0x7f878006ea20 msgr2=0x7f878006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 -- 172.21.15.93:0/2759936408 shutdown_connections 2023-11-04T01:36:43.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.733+0000 7f8785ae7640 1 -- 172.21.15.93:0/2759936408 wait complete. 2023-11-04T01:36:43.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.734+0000 7f8785ae7640 1 Processor -- start 2023-11-04T01:36:43.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 -- start start 2023-11-04T01:36:43.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87800cda50 0x7f87800adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800d0710 0x7f87800acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800aeb40 con 0x7f878015e430 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ae860 con 0x7f87800cda50 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f8785ae7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ac0e0 con 0x7f87800d0710 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f877ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f877ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42762/0 (socket says 172.21.15.93:42762) 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.735+0000 7f877ffff640 1 -- 172.21.15.93:0/1010526033 learned_addr learned my addr 172.21.15.93:0/1010526033 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877effd640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800d0710 0x7f87800acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877f7fe640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87800cda50 0x7f87800adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 -- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800d0710 msgr2=0x7f87800acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800d0710 0x7f87800acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 -- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87800cda50 msgr2=0x7f87800adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87800cda50 0x7f87800adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 -- 172.21.15.93:0/1010526033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740094d0 con 0x7f878015e430 2023-11-04T01:36:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f877ffff640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f877800efc0 tx=0x7f877800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778009ba0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800f040 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87800ac3c0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780146c0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.736+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87800ae4c0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.737+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800ac8e0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.737+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8778014820 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.738+0000 7f8767fff640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 0x7f876c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.738+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f877808a4b0 con 0x7f878015e430 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.738+0000 7f877f7fe640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 0x7f876c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.738+0000 7f877f7fe640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 0x7f876c06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8770000f60 tx=0x7f8770009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.742+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87800ac8e0 con 0x7f878015e430 2023-11-04T01:36:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.908+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87800ac8e0 con 0x7f878015e430 2023-11-04T01:36:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.908+0000 7f8767fff640 1 -- 172.21.15.93:0/1010526033 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87800ac8e0 con 0x7f878015e430 2023-11-04T01:36:43.911 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 msgr2=0x7f876c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 0x7f876c06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8770000f60 tx=0x7f8770009040 comp rx=0 tx=0).stop 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 msgr2=0x7f87801f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f877800efc0 tx=0x7f877800c490 comp rx=0 tx=0).stop 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 shutdown_connections 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f876c06ae70 0x7f876c06d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f878015e430 0x7f87801f3050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87800d0710 0x7f87800acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 --2- 172.21.15.93:0/1010526033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87800cda50 0x7f87800adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.910+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 >> 172.21.15.93:0/1010526033 conn(0x7f878006ea20 msgr2=0x7f87800b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.911+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 shutdown_connections 2023-11-04T01:36:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:43.911+0000 7f8785ae7640 1 -- 172.21.15.93:0/1010526033 wait complete. 2023-11-04T01:36:43.925 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:44.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.025+0000 7f4c3c4cf640 1 Processor -- start 2023-11-04T01:36:44.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.025+0000 7f4c3c4cf640 1 -- start start 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3c4cf640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c3415e3f0 0x7f4c340b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3c4cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c340ca0a0 0x7f4c340cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3c4cf640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c340caa20 con 0x7f4c340cc300 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3c4cf640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340cb230 con 0x7f4c3415e3f0 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3c4cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340ca530 con 0x7f4c340ca0a0 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3aa6c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4c340cc300 0x7f4c340b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60658/0 (socket says 172.21.15.93:60658) 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/732603114 learned_addr learned my addr 172.21.15.93:0/732603114 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c340ca0a0 0x7f4c340cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c3a26b640 1 --2- 172.21.15.93:0/732603114 >> v2:172.21.15.125:3300/0 conn(0x7f4c3415e3f0 0x7f4c340b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991165234 0 0) 0x7f4c340caa20 con 0x7f4c340cc300 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c20003520 con 0x7f4c340cc300 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447316641 0 0) 0x7f4c20003520 con 0x7f4c340cc300 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c340ca0a0 msgr2=0x7f4c340cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c340ca0a0 0x7f4c340cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 >> v2:172.21.15.125:3300/0 conn(0x7f4c3415e3f0 msgr2=0x7f4c340b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 --2- 172.21.15.93:0/732603114 >> v2:172.21.15.125:3300/0 conn(0x7f4c3415e3f0 0x7f4c340b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340cac70 con 0x7f4c340cc300 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4c2c0019f0 con 0x7f4c340cc300 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 >> v1:172.21.15.93:6789/0 conn(0x7f4c340cc300 legacy=0x7f4c340b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c20003970 0x7f4c20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c200047c0 0x7f4c20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c20005180 0x7f4c2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340cb230 con 0x7f4c200047c0 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340ca530 con 0x7f4c20003970 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.026+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20004560 con 0x7f4c20005180 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c200047c0 0x7f4c20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c3a26b640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c20003970 0x7f4c20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c3aa6c640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c20005180 0x7f4c2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 -- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c20005180 msgr2=0x7f4c2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c20005180 0x7f4c2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 -- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c20003970 msgr2=0x7f4c20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c20003970 0x7f4c20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.027+0000 7f4c39a6a640 1 -- 172.21.15.93:0/732603114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20003520 con 0x7f4c200047c0 2023-11-04T01:36:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c200047c0 0x7f4c20004c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009ac0 tx=0x7f4c200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147232ced902f376 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2402c6b0 con 0x7f4c200047c0 2023-11-04T01:36:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2402c810 con 0x7f4c200047c0 2023-11-04T01:36:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c39269640 1 -- 172.21.15.93:0/732603114 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2402cba0 con 0x7f4c200047c0 2023-11-04T01:36:44.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/732603114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c200047c0 msgr2=0x7f4c20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/732603114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c200047c0 0x7f4c20004c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009ac0 tx=0x7f4c200057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/732603114 reap_dead start 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/732603114 shutdown_connections 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/732603114 >> 172.21.15.93:0/732603114 conn(0x7f4c34071820 msgr2=0x7f4c34071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/732603114 shutdown_connections 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.028+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/732603114 wait complete. 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.029+0000 7f4c3c4cf640 1 Processor -- start 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 -- start start 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c200047c0 0x7f4c340b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c340adc80 0x7f4c340ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340afb40 con 0x7f4c340ae0e0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340cedf0 con 0x7f4c340adc80 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3c4cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340cf0d0 con 0x7f4c200047c0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3aa6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3aa6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42770/0 (socket says 172.21.15.93:42770) 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.030+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/942748410 learned_addr learned my addr 172.21.15.93:0/942748410 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c39a6a640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c340adc80 0x7f4c340ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3a26b640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c200047c0 0x7f4c340b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c200047c0 msgr2=0x7f4c340b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c200047c0 0x7f4c340b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c340adc80 msgr2=0x7f4c340ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c340adc80 0x7f4c340ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 -- 172.21.15.93:0/942748410 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340af4f0 con 0x7f4c340ae0e0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3aa6c640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0013d0 tx=0x7f4c2c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00ac80 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00ade0 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c340af7d0 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c013630 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.031+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c340c8b40 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.032+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c340afcb0 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.032+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c2c013790 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.033+0000 7f4c2affd640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 0x7f4c1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.033+0000 7f4c3a26b640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 0x7f4c1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.033+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c2c08a130 con 0x7f4c340ae0e0 2023-11-04T01:36:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.033+0000 7f4c3a26b640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 0x7f4c1806d360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009a60 tx=0x7f4c30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.037+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c2c054e20 con 0x7f4c340ae0e0 2023-11-04T01:36:44.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.209+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4c34074290 con 0x7f4c340ae0e0 2023-11-04T01:36:44.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.209+0000 7f4c2affd640 1 -- 172.21.15.93:0/942748410 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4c2c058440 con 0x7f4c340ae0e0 2023-11-04T01:36:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 msgr2=0x7f4c1806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 0x7f4c1806d360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009a60 tx=0x7f4c30008040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 msgr2=0x7f4c340abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0013d0 tx=0x7f4c2c007bd0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 shutdown_connections 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c1806aea0 0x7f4c1806d360 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c340ae0e0 0x7f4c340abe20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c340adc80 0x7f4c340ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 --2- 172.21.15.93:0/942748410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c200047c0 0x7f4c340b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 >> 172.21.15.93:0/942748410 conn(0x7f4c34071820 msgr2=0x7f4c34154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 shutdown_connections 2023-11-04T01:36:44.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.211+0000 7f4c3c4cf640 1 -- 172.21.15.93:0/942748410 wait complete. 2023-11-04T01:36:44.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:44.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 Processor -- start 2023-11-04T01:36:44.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 -- start start 2023-11-04T01:36:44.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6f4153e60 0x7ff6f415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6f40b4880 0x7ff6f40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40cde60 con 0x7ff6f40cd6d0 2023-11-04T01:36:44.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f4160f90 con 0x7ff6f40b4880 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.322+0000 7ff6f973c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40b5200 con 0x7ff6f4153e60 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6f40b4880 0x7ff6f40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f27fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff6f40cd6d0 0x7ff6f4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60672/0 (socket says 172.21.15.93:60672) 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f27fc640 1 -- 172.21.15.93:0/3639139965 learned_addr learned my addr 172.21.15.93:0/3639139965 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f37fe640 1 -- 172.21.15.93:0/3639139965 >> v2:172.21.15.125:3300/0 conn(0x7ff6f4153e60 msgr2=0x7ff6f415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f2ffd640 1 --2- 172.21.15.93:0/3639139965 >> v2:172.21.15.125:3300/0 conn(0x7ff6f4153e60 0x7ff6f415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f37fe640 1 --2- 172.21.15.93:0/3639139965 >> v2:172.21.15.125:3300/0 conn(0x7ff6f4153e60 0x7ff6f415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f37fe640 1 -- 172.21.15.93:0/3639139965 >> v1:172.21.15.93:6789/0 conn(0x7ff6f40cd6d0 legacy=0x7ff6f4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f1ffb640 1 -- 172.21.15.93:0/3639139965 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017309373 0 0) 0x7ff6f40cde60 con 0x7ff6f40cd6d0 2023-11-04T01:36:44.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.323+0000 7ff6f37fe640 1 -- 172.21.15.93:0/3639139965 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f415e400 con 0x7ff6f40b4880 2023-11-04T01:36:44.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f37fe640 1 --2- 172.21.15.93:0/3639139965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40b4cc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff6f408abe0 tx=0x7ff6ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4a179af78285d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f1ffb640 1 -- 172.21.15.93:0/3639139965 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec02cc80 con 0x7ff6f40b4880 2023-11-04T01:36:44.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f1ffb640 1 -- 172.21.15.93:0/3639139965 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec02cde0 con 0x7ff6f40b4880 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f1ffb640 1 -- 172.21.15.93:0/3639139965 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec034660 con 0x7ff6f40b4880 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 -- 172.21.15.93:0/3639139965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 msgr2=0x7ff6f40b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 --2- 172.21.15.93:0/3639139965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40b4cc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff6f408abe0 tx=0x7ff6ec02bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 -- 172.21.15.93:0/3639139965 shutdown_connections 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 --2- 172.21.15.93:0/3639139965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40b4cc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 --2- 172.21.15.93:0/3639139965 >> v2:172.21.15.125:3300/0 conn(0x7ff6f4153e60 0x7ff6f415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 -- 172.21.15.93:0/3639139965 >> 172.21.15.93:0/3639139965 conn(0x7ff6f40cf880 msgr2=0x7ff6f40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 -- 172.21.15.93:0/3639139965 shutdown_connections 2023-11-04T01:36:44.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.324+0000 7ff6f973c640 1 -- 172.21.15.93:0/3639139965 wait complete. 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 Processor -- start 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 -- start start 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f40cd6d0 0x7ff6f4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f4153e60 0x7ff6f40c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40c7f00 con 0x7ff6f40b4880 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40c7090 con 0x7ff6f40cd6d0 2023-11-04T01:36:44.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f973c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4158360 con 0x7ff6f4153e60 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42786/0 (socket says 172.21.15.93:42786) 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.326+0000 7ff6f2ffd640 1 -- 172.21.15.93:0/238298705 learned_addr learned my addr 172.21.15.93:0/238298705 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f27fc640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f40cd6d0 0x7ff6f4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 -- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f4153e60 msgr2=0x7ff6f40c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f4153e60 0x7ff6f40c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 -- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f40cd6d0 msgr2=0x7ff6f4157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f40cd6d0 0x7ff6f4157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 -- 172.21.15.93:0/238298705 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009a70 con 0x7ff6f40b4880 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f2ffd640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c820 tx=0x7ff6e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004020 con 0x7ff6f40b4880 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e4004180 con 0x7ff6f40b4880 2023-11-04T01:36:44.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f40c8860 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4007830 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.327+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f40c7560 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.328+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f4074290 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.328+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6e4007990 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.329+0000 7ff6db7fe640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 0x7ff6e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.329+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6e4089670 con 0x7ff6f40b4880 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.329+0000 7ff6f27fc640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 0x7ff6e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.329+0000 7ff6f27fc640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 0x7ff6e006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8007fd0 tx=0x7ff6e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.333+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6e4054360 con 0x7ff6f40b4880 2023-11-04T01:36:44.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.511+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6f40d0b80 con 0x7ff6f40b4880 2023-11-04T01:36:44.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.511+0000 7ff6db7fe640 1 -- 172.21.15.93:0/238298705 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6e4057980 con 0x7ff6f40b4880 2023-11-04T01:36:44.514 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 msgr2=0x7ff6e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 0x7ff6e006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8007fd0 tx=0x7ff6e8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 msgr2=0x7ff6f40c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c820 tx=0x7ff6e400cce0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 shutdown_connections 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e006ae70 0x7ff6e006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f4153e60 0x7ff6f40c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f40cd6d0 0x7ff6f4157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 --2- 172.21.15.93:0/238298705 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f40b4880 0x7ff6f40c6b50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 >> 172.21.15.93:0/238298705 conn(0x7ff6f40cf880 msgr2=0x7ff6f415fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 shutdown_connections 2023-11-04T01:36:44.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.513+0000 7ff6f973c640 1 -- 172.21.15.93:0/238298705 wait complete. 2023-11-04T01:36:44.527 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:44.527 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:44.542 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:44.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.680+0000 7f279fb7c640 1 Processor -- start 2023-11-04T01:36:44.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.680+0000 7f279fb7c640 1 -- start start 2023-11-04T01:36:44.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.680+0000 7f279fb7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f279806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279fb7c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27981615d0 con 0x7f279806bd30 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279fb7c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27981618b0 con 0x7f27980cf160 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279fb7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980cbde0 con 0x7f279815ce60 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279d117640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f279806bd30 0x7f2798160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60674/0 (socket says 172.21.15.93:60674) 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279d117640 1 -- 172.21.15.93:0/2162515082 learned_addr learned my addr 172.21.15.93:0/2162515082 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508923516 0 0) 0x7f27981615d0 con 0x7f279806bd30 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2784003520 con 0x7f279806bd30 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279d918640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f279806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098666126 0 0) 0x7f2784003520 con 0x7f279806bd30 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 msgr2=0x7f279806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f279806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 >> v1:172.21.15.125:6789/0 conn(0x7f27980cf160 legacy=0x7f27980cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27980cba00 con 0x7f279806bd30 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f2794001670 con 0x7f279806bd30 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 >> v1:172.21.15.93:6789/0 conn(0x7f279806bd30 legacy=0x7f2798160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27840039a0 0x7f2784003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f27840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2784004d00 0x7f2784005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980cbde0 con 0x7f27840039a0 2023-11-04T01:36:44.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278400bb10 con 0x7f2784004d00 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278400bca0 con 0x7f279815ce60 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279d918640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27840039a0 0x7f2784003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279d117640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f27840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.681+0000 7f279e119640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2784004d00 0x7f2784005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 -- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 msgr2=0x7f27840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f279815ce60 0x7f27840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 -- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2784004d00 msgr2=0x7f2784005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2784004d00 0x7f2784005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 -- 172.21.15.93:0/2162515082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784003520 con 0x7f27840039a0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279e119640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2784004d00 0x7f2784005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279d918640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27840039a0 0x7f2784003dc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f278800ba60 tx=0x7f27840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d292d64e02323f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788032630 con 0x7f27840039a0 2023-11-04T01:36:44.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788032790 con 0x7f27840039a0 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.682+0000 7f279c916640 1 -- 172.21.15.93:0/2162515082 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788032b20 con 0x7f27840039a0 2023-11-04T01:36:44.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 -- 172.21.15.93:0/2162515082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27840039a0 msgr2=0x7f2784003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 --2- 172.21.15.93:0/2162515082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27840039a0 0x7f2784003dc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f278800ba60 tx=0x7f27840057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279e119640 1 -- 172.21.15.93:0/2162515082 reap_dead start 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 -- 172.21.15.93:0/2162515082 shutdown_connections 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 -- 172.21.15.93:0/2162515082 >> 172.21.15.93:0/2162515082 conn(0x7f279806ea90 msgr2=0x7f279806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 -- 172.21.15.93:0/2162515082 shutdown_connections 2023-11-04T01:36:44.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.683+0000 7f279fb7c640 1 -- 172.21.15.93:0/2162515082 wait complete. 2023-11-04T01:36:44.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.684+0000 7f279fb7c640 1 Processor -- start 2023-11-04T01:36:44.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.684+0000 7f279fb7c640 1 -- start start 2023-11-04T01:36:44.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27840039a0 0x7f27980c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27980ca9c0 0x7f27980c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c9180 con 0x7f27980c9b50 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c8570 con 0x7f27980ca9c0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279fb7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c8850 con 0x7f27840039a0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42802/0 (socket says 172.21.15.93:42802) 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 -- 172.21.15.93:0/1519890560 learned_addr learned my addr 172.21.15.93:0/1519890560 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 -- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27840039a0 msgr2=0x7f27980c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27840039a0 0x7f27980c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 -- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27980ca9c0 msgr2=0x7f27980c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27980ca9c0 0x7f27980c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 -- 172.21.15.93:0/1519890560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27980c8b30 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f279e119640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f279806e960 tx=0x7f279000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790006d50 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.685+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790003970 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.686+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27980c8e10 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.686+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790003d60 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.686+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27981f22d0 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.686+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2798074290 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.687+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2790005070 con 0x7f27980c9b50 2023-11-04T01:36:44.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.687+0000 7f278e7fc640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 0x7f277c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.687+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2790089810 con 0x7f27980c9b50 2023-11-04T01:36:44.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.687+0000 7f279d918640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 0x7f277c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.688+0000 7f279d918640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 0x7f277c06d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f278800ba30 tx=0x7f2788032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.691+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2790054500 con 0x7f27980c9b50 2023-11-04T01:36:44.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.858+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27980c92c0 con 0x7f27980c9b50 2023-11-04T01:36:44.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.859+0000 7f278e7fc640 1 -- 172.21.15.93:0/1519890560 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f2790057b20 con 0x7f27980c9b50 2023-11-04T01:36:44.862 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:44.862 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 msgr2=0x7f277c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 0x7f277c06d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f278800ba30 tx=0x7f2788032000 comp rx=0 tx=0).stop 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 msgr2=0x7f279814e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f279806e960 tx=0x7f279000dc00 comp rx=0 tx=0).stop 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 shutdown_connections 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f277c06ae70 0x7f277c06d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27980c9b50 0x7f279814e940 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27980ca9c0 0x7f27980c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 --2- 172.21.15.93:0/1519890560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27840039a0 0x7f27980c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.861+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 >> 172.21.15.93:0/1519890560 conn(0x7f279806ea90 msgr2=0x7f27980c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.862+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 shutdown_connections 2023-11-04T01:36:44.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.862+0000 7f279fb7c640 1 -- 172.21.15.93:0/1519890560 wait complete. 2023-11-04T01:36:44.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:44.876 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:44.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.975+0000 7f3a4aac2640 1 Processor -- start 2023-11-04T01:36:44.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.975+0000 7f3a4aac2640 1 -- start start 2023-11-04T01:36:44.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a440b1a40 0x7f3a4406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3a440ca560 0x7f3a4406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a44160990 con 0x7f3a440b1a40 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a440cc7c0 con 0x7f3a440ca560 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4aac2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440cd750 con 0x7f3a441605b0 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a440b1a40 0x7f3a4406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a440b1a40 0x7f3a4406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42808/0 (socket says 172.21.15.93:42808) 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 -- 172.21.15.93:0/2905543313 learned_addr learned my addr 172.21.15.93:0/2905543313 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4885e640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4905f640 1 --2- 172.21.15.93:0/2905543313 >> v2:172.21.15.125:3300/0 conn(0x7f3a440ca560 0x7f3a4406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 -- 172.21.15.93:0/2905543313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 msgr2=0x7f3a440ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 -- 172.21.15.93:0/2905543313 >> v2:172.21.15.125:3300/0 conn(0x7f3a440ca560 msgr2=0x7f3a4406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 --2- 172.21.15.93:0/2905543313 >> v2:172.21.15.125:3300/0 conn(0x7f3a440ca560 0x7f3a4406a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a43fff640 1 -- 172.21.15.93:0/2905543313 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440cc4e0 con 0x7f3a440b1a40 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.976+0000 7f3a4885e640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a43fff640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440b1a40 0x7f3a4406a120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3a440d0b00 tx=0x7f3a3002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4494154399e381c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a437fe640 1 -- 172.21.15.93:0/2905543313 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30031750 con 0x7f3a440b1a40 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a437fe640 1 -- 172.21.15.93:0/2905543313 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a300318b0 con 0x7f3a440b1a40 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a437fe640 1 -- 172.21.15.93:0/2905543313 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30031c40 con 0x7f3a440b1a40 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a4aac2640 1 -- 172.21.15.93:0/2905543313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440b1a40 msgr2=0x7f3a4406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440b1a40 0x7f3a4406a120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3a440d0b00 tx=0x7f3a3002b7f0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a4aac2640 1 -- 172.21.15.93:0/2905543313 shutdown_connections 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440b1a40 0x7f3a4406a120 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.977+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/2905543313 >> v2:172.21.15.125:3300/0 conn(0x7f3a440ca560 0x7f3a4406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.978+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/2905543313 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.978+0000 7f3a4aac2640 1 -- 172.21.15.93:0/2905543313 >> 172.21.15.93:0/2905543313 conn(0x7f3a44071820 msgr2=0x7f3a44071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.978+0000 7f3a4aac2640 1 -- 172.21.15.93:0/2905543313 shutdown_connections 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.978+0000 7f3a4aac2640 1 -- 172.21.15.93:0/2905543313 wait complete. 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.979+0000 7f3a4aac2640 1 Processor -- start 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.979+0000 7f3a4aac2640 1 -- start start 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.979+0000 7f3a4aac2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a440ca560 0x7f3a440b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441595d0 con 0x7f3a440c5800 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b2f70 con 0x7f3a440ca560 2023-11-04T01:36:44.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b3250 con 0x7f3a441605b0 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42818/0 (socket says 172.21.15.93:42818) 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 -- 172.21.15.93:0/3554525362 learned_addr learned my addr 172.21.15.93:0/3554525362 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4885e640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a440ca560 0x7f3a440b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a43fff640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 -- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 msgr2=0x7f3a440abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 -- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a440ca560 msgr2=0x7f3a440b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a440ca560 0x7f3a440b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 -- 172.21.15.93:0/3554525362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300094d0 con 0x7f3a440c5800 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4905f640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c007d20 tx=0x7f3a3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c014420 con 0x7f3a440c5800 2023-11-04T01:36:44.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c0145a0 con 0x7f3a440c5800 2023-11-04T01:36:44.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a440b3530 con 0x7f3a440c5800 2023-11-04T01:36:44.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c014950 con 0x7f3a440c5800 2023-11-04T01:36:44.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.980+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440b3af0 con 0x7f3a440c5800 2023-11-04T01:36:44.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.981+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a440672a0 con 0x7f3a440c5800 2023-11-04T01:36:44.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.982+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a3c014ab0 con 0x7f3a440c5800 2023-11-04T01:36:44.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.982+0000 7f3a417fa640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 0x7f3a2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.982+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a3c08a280 con 0x7f3a440c5800 2023-11-04T01:36:44.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.982+0000 7f3a4885e640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 0x7f3a2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.983+0000 7f3a4885e640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 0x7f3a2806d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:44.986+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a3c054f70 con 0x7f3a440c5800 2023-11-04T01:36:45.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.152+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a440b3ce0 con 0x7f3a440c5800 2023-11-04T01:36:45.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.152+0000 7f3a417fa640 1 -- 172.21.15.93:0/3554525362 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a3c058590 con 0x7f3a440c5800 2023-11-04T01:36:45.155 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.154+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 msgr2=0x7f3a2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.154+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 0x7f3a2806d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38008040 comp rx=0 tx=0).stop 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.154+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 msgr2=0x7f3a440ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.154+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c007d20 tx=0x7f3a3c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 shutdown_connections 2023-11-04T01:36:45.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a2806ae70 0x7f3a2806d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a440c5800 0x7f3a440ac2e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a441605b0 0x7f3a440abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 --2- 172.21.15.93:0/3554525362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a440ca560 0x7f3a440b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 >> 172.21.15.93:0/3554525362 conn(0x7f3a44071820 msgr2=0x7f3a440b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 shutdown_connections 2023-11-04T01:36:45.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.155+0000 7f3a4aac2640 1 -- 172.21.15.93:0/3554525362 wait complete. 2023-11-04T01:36:45.168 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:45.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.268+0000 7fb1130c2640 1 Processor -- start 2023-11-04T01:36:45.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.268+0000 7fb1130c2640 1 -- start start 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb1130c2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb10c160430 0x7fb10c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb1130c2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb10c06c3a0 0x7fb10c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb1130c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0b2fc0 con 0x7fb10c0b2b60 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb1130c2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0cb580 con 0x7fb10c160430 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb1130c2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c06c7d0 con 0x7fb10c06c3a0 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb10c160430 0x7fb10c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb10c160430 0x7fb10c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42820/0 (socket says 172.21.15.93:42820) 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 -- 172.21.15.93:0/2557989808 learned_addr learned my addr 172.21.15.93:0/2557989808 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:45.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 -- 172.21.15.93:0/2557989808 >> v2:172.21.15.125:3300/0 conn(0x7fb10c06c3a0 msgr2=0x7fb10c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 --2- 172.21.15.93:0/2557989808 >> v2:172.21.15.125:3300/0 conn(0x7fb10c06c3a0 0x7fb10c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.269+0000 7fb110e5e640 1 -- 172.21.15.93:0/2557989808 >> v1:172.21.15.125:6789/0 conn(0x7fb10c0b2b60 legacy=0x7fb10c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.270+0000 7fb110e5e640 1 -- 172.21.15.93:0/2557989808 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c06ca40 con 0x7fb10c160430 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.270+0000 7fb110e5e640 1 --2- 172.21.15.93:0/2557989808 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c160430 0x7fb10c0b2620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0c4600 tx=0x7fb0fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982d12ab8d978fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.270+0000 7fb10b7fe640 1 -- 172.21.15.93:0/2557989808 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031870 con 0x7fb10c160430 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.270+0000 7fb10b7fe640 1 -- 172.21.15.93:0/2557989808 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0319d0 con 0x7fb10c160430 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.270+0000 7fb10b7fe640 1 -- 172.21.15.93:0/2557989808 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031d60 con 0x7fb10c160430 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 -- 172.21.15.93:0/2557989808 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c160430 msgr2=0x7fb10c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 --2- 172.21.15.93:0/2557989808 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c160430 0x7fb10c0b2620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0c4600 tx=0x7fb0fc02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 -- 172.21.15.93:0/2557989808 shutdown_connections 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 --2- 172.21.15.93:0/2557989808 >> v2:172.21.15.125:3300/0 conn(0x7fb10c06c3a0 0x7fb10c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 --2- 172.21.15.93:0/2557989808 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c160430 0x7fb10c0b2620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 -- 172.21.15.93:0/2557989808 >> 172.21.15.93:0/2557989808 conn(0x7fb10c06ea20 msgr2=0x7fb10c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 -- 172.21.15.93:0/2557989808 shutdown_connections 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.271+0000 7fb1130c2640 1 -- 172.21.15.93:0/2557989808 wait complete. 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.272+0000 7fb1130c2640 1 Processor -- start 2023-11-04T01:36:45.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.272+0000 7fb1130c2640 1 -- start start 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb10c0b2b60 0x7fb10c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb10c160430 0x7fb10c0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0c6d60 con 0x7fb10c06c3a0 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0c5e70 con 0x7fb10c0b2b60 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb1130c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0c6150 con 0x7fb10c160430 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42832/0 (socket says 172.21.15.93:42832) 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 -- 172.21.15.93:0/1050974121 learned_addr learned my addr 172.21.15.93:0/1050974121 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 -- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb10c160430 msgr2=0x7fb10c0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb10c160430 0x7fb10c0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 -- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb10c0b2b60 msgr2=0x7fb10c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb10c0b2b60 0x7fb10c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 -- 172.21.15.93:0/1050974121 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0094d0 con 0x7fb10c06c3a0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.273+0000 7fb110e5e640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000c00 tx=0x7fb0fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.274+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031840 con 0x7fb10c06c3a0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.274+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0443f0 con 0x7fb10c06c3a0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.274+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c0c6430 con 0x7fb10c06c3a0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.274+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0447c0 con 0x7fb10c06c3a0 2023-11-04T01:36:45.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.274+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c0c69f0 con 0x7fb10c06c3a0 2023-11-04T01:36:45.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.275+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c074290 con 0x7fb10c06c3a0 2023-11-04T01:36:45.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.275+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0fc04d450 con 0x7fb10c06c3a0 2023-11-04T01:36:45.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.276+0000 7fb1097fa640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 0x7fb0f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.276+0000 7fb10bfff640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 0x7fb0f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.276+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0fc02d040 con 0x7fb10c06c3a0 2023-11-04T01:36:45.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.276+0000 7fb10bfff640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 0x7fb0f806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b6290 tx=0x7fb100007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.280+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0fc076e20 con 0x7fb10c06c3a0 2023-11-04T01:36:45.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.445+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb10c0b6b20 con 0x7fb10c06c3a0 2023-11-04T01:36:45.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.445+0000 7fb1097fa640 1 -- 172.21.15.93:0/1050974121 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0fc07a440 con 0x7fb10c06c3a0 2023-11-04T01:36:45.448 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 msgr2=0x7fb0f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 0x7fb0f806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b6290 tx=0x7fb100007990 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 msgr2=0x7fb10c0c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc000c00 tx=0x7fb0fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 shutdown_connections 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb0f806aea0 0x7fb0f806d360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb10c160430 0x7fb10c0c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb10c0b2b60 0x7fb10c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 --2- 172.21.15.93:0/1050974121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb10c06c3a0 0x7fb10c0c71f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 >> 172.21.15.93:0/1050974121 conn(0x7fb10c06ea20 msgr2=0x7fb10c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 shutdown_connections 2023-11-04T01:36:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.447+0000 7fb1130c2640 1 -- 172.21.15.93:0/1050974121 wait complete. 2023-11-04T01:36:45.460 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:45.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.560+0000 7efce4d41640 1 Processor -- start 2023-11-04T01:36:45.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.560+0000 7efce4d41640 1 -- start start 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efce4d41640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efce00cdc80 0x7efce006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efce4d41640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00cea20 con 0x7efce00cf180 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efce4d41640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00cf610 con 0x7efce015cfd0 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efce4d41640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce015d3b0 con 0x7efce00cdc80 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efcddd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7efce00cf180 0x7efce00cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60686/0 (socket says 172.21.15.93:60686) 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efcded9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efce00cdc80 0x7efce006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.561+0000 7efcddd9b640 1 -- 172.21.15.93:0/4180416358 learned_addr learned my addr 172.21.15.93:0/4180416358 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.562+0000 7efcded9d640 1 -- 172.21.15.93:0/4180416358 >> v1:172.21.15.125:6789/0 conn(0x7efce015cfd0 legacy=0x7efce0161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.562+0000 7efcded9d640 1 -- 172.21.15.93:0/4180416358 >> v1:172.21.15.93:6789/0 conn(0x7efce00cf180 legacy=0x7efce00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.562+0000 7efcdd59a640 1 -- 172.21.15.93:0/4180416358 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029547682 0 0) 0x7efce00cea20 con 0x7efce00cf180 2023-11-04T01:36:45.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.562+0000 7efcded9d640 1 -- 172.21.15.93:0/4180416358 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00cf8f0 con 0x7efce00cdc80 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.562+0000 7efcded9d640 1 --2- 172.21.15.93:0/4180416358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce006c0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097a0 tx=0x7efcd802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc45677c901cc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efcdd59a640 1 -- 172.21.15.93:0/4180416358 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd802e070 con 0x7efce00cdc80 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efcdd59a640 1 -- 172.21.15.93:0/4180416358 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd80315a0 con 0x7efce00cdc80 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efcdd59a640 1 -- 172.21.15.93:0/4180416358 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8031930 con 0x7efce00cdc80 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 -- 172.21.15.93:0/4180416358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 msgr2=0x7efce006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 --2- 172.21.15.93:0/4180416358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce006c0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097a0 tx=0x7efcd802b840 comp rx=0 tx=0).stop 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 -- 172.21.15.93:0/4180416358 shutdown_connections 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 --2- 172.21.15.93:0/4180416358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce006c0a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 -- 172.21.15.93:0/4180416358 >> 172.21.15.93:0/4180416358 conn(0x7efce006ea20 msgr2=0x7efce006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 -- 172.21.15.93:0/4180416358 shutdown_connections 2023-11-04T01:36:45.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.563+0000 7efce4d41640 1 -- 172.21.15.93:0/4180416358 wait complete. 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 Processor -- start 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 -- start start 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 0x7efce01f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce01f2a10 0x7efce00c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00b3020 con 0x7efce00cdc80 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00cb010 con 0x7efce015cfd0 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efce4d41640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c5c30 con 0x7efce01f2a10 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efcde59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efcde59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42848/0 (socket says 172.21.15.93:42848) 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efcde59c640 1 -- 172.21.15.93:0/329065038 learned_addr learned my addr 172.21.15.93:0/329065038 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.565+0000 7efcddd9b640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 0x7efce01f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcded9d640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce01f2a10 0x7efce00c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 -- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce01f2a10 msgr2=0x7efce00c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce01f2a10 0x7efce00c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 -- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 msgr2=0x7efce01f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 0x7efce01f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 -- 172.21.15.93:0/329065038 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009400 con 0x7efce00cdc80 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcddd9b640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 0x7efce01f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcde59c640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efcd000ba50 tx=0x7efcd000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000cbe0 con 0x7efce00cdc80 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000cd80 con 0x7efce00cdc80 2023-11-04T01:36:45.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce00b2d40 con 0x7efce00cdc80 2023-11-04T01:36:45.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0014680 con 0x7efce00cdc80 2023-11-04T01:36:45.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.566+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce00c58c0 con 0x7efce00cdc80 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.567+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce006d3c0 con 0x7efce00cdc80 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.567+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcd00147e0 con 0x7efce00cdc80 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.568+0000 7efcceffd640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 0x7efcc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.568+0000 7efcddd9b640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 0x7efcc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.568+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efcd0089880 con 0x7efce00cdc80 2023-11-04T01:36:45.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.568+0000 7efcddd9b640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 0x7efcc006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efce00cb7b0 tx=0x7efcd4007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.572+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcd0054620 con 0x7efce00cdc80 2023-11-04T01:36:45.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.739+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efce00c5440 con 0x7efce00cdc80 2023-11-04T01:36:45.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.739+0000 7efcceffd640 1 -- 172.21.15.93:0/329065038 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcd00190a0 con 0x7efce00cdc80 2023-11-04T01:36:45.742 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:45.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 msgr2=0x7efcc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 0x7efcc006d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efce00cb7b0 tx=0x7efcd4007ca0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 msgr2=0x7efce00caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efcd000ba50 tx=0x7efcd000bf10 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 shutdown_connections 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efcc006ae70 0x7efcc006d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efce01f2a10 0x7efce00c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efce015cfd0 0x7efce01f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 --2- 172.21.15.93:0/329065038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efce00cdc80 0x7efce00caad0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 >> 172.21.15.93:0/329065038 conn(0x7efce006ea20 msgr2=0x7efce0154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 shutdown_connections 2023-11-04T01:36:45.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.741+0000 7efce4d41640 1 -- 172.21.15.93:0/329065038 wait complete. 2023-11-04T01:36:45.754 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:45.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 Processor -- start 2023-11-04T01:36:45.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 -- start start 2023-11-04T01:36:45.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 0x7f0f6c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0cde60 con 0x7f0f6c153e60 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c160f90 con 0x7f0f6c0cd6d0 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f71900640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b5200 con 0x7f0f6c0b4880 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.854+0000 7f0f6affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0f6c153e60 0x7f0f6c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60690/0 (socket says 172.21.15.93:60690) 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f6affd640 1 -- 172.21.15.93:0/1980685349 learned_addr learned my addr 172.21.15.93:0/1980685349 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f6b7fe640 1 --2- 172.21.15.93:0/1980685349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 0x7f0f6c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191530472 0 0) 0x7f0f6c0cde60 con 0x7f0f6c153e60 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f54003520 con 0x7f0f6c153e60 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206757189 0 0) 0x7f0f6c160f90 con 0x7f0f6c0cd6d0 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6c0cde60 con 0x7f0f6c0cd6d0 2023-11-04T01:36:45.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f6b7fe640 1 -- 172.21.15.93:0/1980685349 >> v1:172.21.15.125:6789/0 conn(0x7f0f6c0cd6d0 legacy=0x7f0f6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f6b7fe640 1 -- 172.21.15.93:0/1980685349 >> v1:172.21.15.93:6789/0 conn(0x7f0f6c153e60 legacy=0x7f0f6c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.855+0000 7f0f6b7fe640 1 -- 172.21.15.93:0/1980685349 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0ce090 con 0x7f0f6c0b4880 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f6b7fe640 1 --2- 172.21.15.93:0/1980685349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 0x7f0f6c0b4cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009dc0 tx=0x7f0f6402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6a81d9a33f878c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6402ccd0 con 0x7f0f6c0b4880 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6402ce30 con 0x7f0f6c0b4880 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f69ffb640 1 -- 172.21.15.93:0/1980685349 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64034640 con 0x7f0f6c0b4880 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f71900640 1 -- 172.21.15.93:0/1980685349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 msgr2=0x7f0f6c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f71900640 1 --2- 172.21.15.93:0/1980685349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 0x7f0f6c0b4cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009dc0 tx=0x7f0f6402bf20 comp rx=0 tx=0).stop 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f71900640 1 -- 172.21.15.93:0/1980685349 shutdown_connections 2023-11-04T01:36:45.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f71900640 1 --2- 172.21.15.93:0/1980685349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0b4880 0x7f0f6c0b4cc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.856+0000 7f0f71900640 1 -- 172.21.15.93:0/1980685349 >> 172.21.15.93:0/1980685349 conn(0x7f0f6c0cf880 msgr2=0x7f0f6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.857+0000 7f0f71900640 1 -- 172.21.15.93:0/1980685349 shutdown_connections 2023-11-04T01:36:45.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.857+0000 7f0f71900640 1 -- 172.21.15.93:0/1980685349 wait complete. 2023-11-04T01:36:45.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 Processor -- start 2023-11-04T01:36:45.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 -- start start 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0cd6d0 0x7f0f6c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f6c153e60 0x7f0f6c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c15a960 con 0x7f0f6c0b4880 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1561d0 con 0x7f0f6c153e60 2023-11-04T01:36:45.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.858+0000 7f0f71900640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1564b0 con 0x7f0f6c0cd6d0 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42864/0 (socket says 172.21.15.93:42864) 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 -- 172.21.15.93:0/2948247726 learned_addr learned my addr 172.21.15.93:0/2948247726 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6b7fe640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f6c153e60 0x7f0f6c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6a7fc640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0cd6d0 0x7f0f6c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 -- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0cd6d0 msgr2=0x7f0f6c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0cd6d0 0x7f0f6c152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 -- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f6c153e60 msgr2=0x7f0f6c0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f6c153e60 0x7f0f6c0c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 -- 172.21.15.93:0/2948247726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009a70 con 0x7f0f6c0b4880 2023-11-04T01:36:45.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f6affd640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c410 tx=0x7f0f5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c005ce0 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c005e40 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c156790 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0072d0 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.859+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c156d50 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.860+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c074290 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.861+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f5c007430 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.861+0000 7f0f53fff640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.861+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f5c088e70 con 0x7f0f6c0b4880 2023-11-04T01:36:45.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.861+0000 7f0f6a7fc640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.861+0000 7f0f6a7fc640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 0x7f0f5806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007fd0 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:45.865+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f5c053ca0 con 0x7f0f6c0b4880 2023-11-04T01:36:46.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.031+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f6c0d0b80 con 0x7f0f6c0b4880 2023-11-04T01:36:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.031+0000 7f0f53fff640 1 -- 172.21.15.93:0/2948247726 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0f5c0170a0 con 0x7f0f6c0b4880 2023-11-04T01:36:46.034 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:46.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 msgr2=0x7f0f5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 0x7f0f5806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f60007fd0 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 msgr2=0x7f0f6c15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c410 tx=0x7f0f5c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 shutdown_connections 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f6c153e60 0x7f0f6c0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f6c0cd6d0 0x7f0f6c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 --2- 172.21.15.93:0/2948247726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c0b4880 0x7f0f6c15a420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 >> 172.21.15.93:0/2948247726 conn(0x7f0f6c0cf880 msgr2=0x7f0f6c161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 shutdown_connections 2023-11-04T01:36:46.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.033+0000 7f0f71900640 1 -- 172.21.15.93:0/2948247726 wait complete. 2023-11-04T01:36:46.047 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.146+0000 7f9e69341640 1 Processor -- start 2023-11-04T01:36:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.146+0000 7f9e69341640 1 -- start start 2023-11-04T01:36:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e69341640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9e64160430 0x7f9e640b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e69341640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9e6406c3a0 0x7f9e640cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e69341640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e640b2fc0 con 0x7f9e640b2b60 2023-11-04T01:36:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e69341640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640cb580 con 0x7f9e64160430 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e69341640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6406c7d0 con 0x7f9e6406c3a0 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e62ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9e64160430 0x7f9e640b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e627fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9e640b2b60 0x7f9e6406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60704/0 (socket says 172.21.15.93:60704) 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e627fc640 1 -- 172.21.15.93:0/279302199 learned_addr learned my addr 172.21.15.93:0/279302199 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e637fe640 1 --2- 172.21.15.93:0/279302199 >> v2:172.21.15.125:3300/0 conn(0x7f9e6406c3a0 0x7f9e640cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e62ffd640 1 -- 172.21.15.93:0/279302199 >> v2:172.21.15.125:3300/0 conn(0x7f9e6406c3a0 msgr2=0x7f9e640cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e62ffd640 1 --2- 172.21.15.93:0/279302199 >> v2:172.21.15.125:3300/0 conn(0x7f9e6406c3a0 0x7f9e640cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e62ffd640 1 -- 172.21.15.93:0/279302199 >> v1:172.21.15.93:6789/0 conn(0x7f9e640b2b60 legacy=0x7f9e6406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e61ffb640 1 -- 172.21.15.93:0/279302199 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943464628 0 0) 0x7f9e640b2fc0 con 0x7f9e640b2b60 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.147+0000 7f9e62ffd640 1 -- 172.21.15.93:0/279302199 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6406ca40 con 0x7f9e64160430 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.148+0000 7f9e62ffd640 1 --2- 172.21.15.93:0/279302199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e64160430 0x7f9e640b2620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e640c4600 tx=0x7f9e5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580f05a6a43d7833 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.148+0000 7f9e61ffb640 1 -- 172.21.15.93:0/279302199 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54031830 con 0x7f9e64160430 2023-11-04T01:36:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.148+0000 7f9e61ffb640 1 -- 172.21.15.93:0/279302199 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54031990 con 0x7f9e64160430 2023-11-04T01:36:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.148+0000 7f9e61ffb640 1 -- 172.21.15.93:0/279302199 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54031d20 con 0x7f9e64160430 2023-11-04T01:36:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 -- 172.21.15.93:0/279302199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e64160430 msgr2=0x7f9e640b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 --2- 172.21.15.93:0/279302199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e64160430 0x7f9e640b2620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e640c4600 tx=0x7f9e5402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 -- 172.21.15.93:0/279302199 shutdown_connections 2023-11-04T01:36:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 --2- 172.21.15.93:0/279302199 >> v2:172.21.15.125:3300/0 conn(0x7f9e6406c3a0 0x7f9e640cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 --2- 172.21.15.93:0/279302199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e64160430 0x7f9e640b2620 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 -- 172.21.15.93:0/279302199 >> 172.21.15.93:0/279302199 conn(0x7f9e6406ea20 msgr2=0x7f9e6406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 -- 172.21.15.93:0/279302199 shutdown_connections 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.149+0000 7f9e69341640 1 -- 172.21.15.93:0/279302199 wait complete. 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.150+0000 7f9e69341640 1 Processor -- start 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.150+0000 7f9e69341640 1 -- start start 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640b2b60 0x7f9e640b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64160430 0x7f9e640c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64152690 con 0x7f9e6406c3a0 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640b40c0 con 0x7f9e64160430 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640b43a0 con 0x7f9e640b2b60 2023-11-04T01:36:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42880/0 (socket says 172.21.15.93:42880) 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 -- 172.21.15.93:0/3240817114 learned_addr learned my addr 172.21.15.93:0/3240817114 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 -- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640b2b60 msgr2=0x7f9e640b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640b2b60 0x7f9e640b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 -- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64160430 msgr2=0x7f9e640c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64160430 0x7f9e640c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 -- 172.21.15.93:0/3240817114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009400 con 0x7f9e6406c3a0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e62ffd640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000c00 tx=0x7f9e540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54004230 con 0x7f9e6406c3a0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54004390 con 0x7f9e6406c3a0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e640b4680 con 0x7f9e6406c3a0 2023-11-04T01:36:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5403a8f0 con 0x7f9e6406c3a0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.151+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e640b4c40 con 0x7f9e6406c3a0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.152+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e64074290 con 0x7f9e6406c3a0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.153+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e5403aa50 con 0x7f9e6406c3a0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.153+0000 7f9e4b7fe640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 0x7f9e5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.153+0000 7f9e627fc640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 0x7f9e5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.153+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e540abce0 con 0x7f9e6406c3a0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.154+0000 7f9e627fc640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 0x7f9e5006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007fd0 tx=0x7f9e58007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.157+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e540769d0 con 0x7f9e6406c3a0 2023-11-04T01:36:46.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.335+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e64074290 con 0x7f9e6406c3a0 2023-11-04T01:36:46.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.336+0000 7f9e4b7fe640 1 -- 172.21.15.93:0/3240817114 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e54035020 con 0x7f9e6406c3a0 2023-11-04T01:36:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 msgr2=0x7f9e5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 0x7f9e5006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007fd0 tx=0x7f9e58007920 comp rx=0 tx=0).stop 2023-11-04T01:36:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 msgr2=0x7f9e64152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000c00 tx=0x7f9e540046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 shutdown_connections 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e5006ae70 0x7f9e5006d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e64160430 0x7f9e640c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e640b2b60 0x7f9e640b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 --2- 172.21.15.93:0/3240817114 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e6406c3a0 0x7f9e64152150 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.337+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 >> 172.21.15.93:0/3240817114 conn(0x7f9e6406ea20 msgr2=0x7f9e640cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.338+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 shutdown_connections 2023-11-04T01:36:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.338+0000 7f9e69341640 1 -- 172.21.15.93:0/3240817114 wait complete. 2023-11-04T01:36:46.350 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:36:46.351 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:46.351 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:36:46.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:46.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[129133]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:46.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:46.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:46.417 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:46.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:36:46.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:46.423 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:36:46.478 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:46.479 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:46.497 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:46.498 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:46.556 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:46.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:2023-11-04T01:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:46.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.653+0000 7f9601a32640 1 Processor -- start 2023-11-04T01:36:46.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.653+0000 7f9601a32640 1 -- start start 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f9601a32640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f95fc0cde60 0x7f95fc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f9601a32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95fc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f9601a32640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc15e000 con 0x7f95fc15daa0 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f9601a32640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc15e5c0 con 0x7f95fc0cde60 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f9601a32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15e2e0 con 0x7f95fc0ce240 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f95fc15daa0 0x7f95fc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60708/0 (socket says 172.21.15.93:60708) 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1403039481 learned_addr learned my addr 172.21.15.93:0/1403039481 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695752686 0 0) 0x7f95fc15e000 con 0x7f95fc15daa0 2023-11-04T01:36:46.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e4003520 con 0x7f95fc15daa0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fb7fe640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95fc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95faffd640 1 --2- 172.21.15.93:0/1403039481 >> v2:172.21.15.125:3300/0 conn(0x7f95fc0cde60 0x7f95fc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766409770 0 0) 0x7f95e4003520 con 0x7f95fc15daa0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 msgr2=0x7f95fc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95fc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 >> v2:172.21.15.125:3300/0 conn(0x7f95fc0cde60 msgr2=0x7f95fc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 --2- 172.21.15.93:0/1403039481 >> v2:172.21.15.125:3300/0 conn(0x7f95fc0cde60 0x7f95fc15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0d1120 con 0x7f95fc15daa0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f95f0001670 con 0x7f95fc15daa0 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 >> v1:172.21.15.93:6789/0 conn(0x7f95fc15daa0 legacy=0x7f95fc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4003970 0x7f95e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95e40047c0 0x7f95e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15e5c0 con 0x7f95e40047c0 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15e2e0 con 0x7f95e4003970 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e400b980 con 0x7f95fc0ce240 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95e40047c0 0x7f95e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95faffd640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4003970 0x7f95e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fb7fe640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 msgr2=0x7f95e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4003970 msgr2=0x7f95e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e4003970 0x7f95e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1403039481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4003520 con 0x7f95e40047c0 2023-11-04T01:36:46.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.655+0000 7f95fb7fe640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0ce240 0x7f95e4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95e40047c0 0x7f95e4004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c210 tx=0x7f95e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb23fcad02b764c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005ad0 con 0x7f95e40047c0 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0005c30 con 0x7f95e40047c0 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f95f9ffb640 1 -- 172.21.15.93:0/1403039481 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f002c8d0 con 0x7f95e40047c0 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 -- 172.21.15.93:0/1403039481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95e40047c0 msgr2=0x7f95e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 --2- 172.21.15.93:0/1403039481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95e40047c0 0x7f95e4004c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c210 tx=0x7f95e40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f95fb7fe640 1 -- 172.21.15.93:0/1403039481 reap_dead start 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 -- 172.21.15.93:0/1403039481 shutdown_connections 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 -- 172.21.15.93:0/1403039481 >> 172.21.15.93:0/1403039481 conn(0x7f95fc071f30 msgr2=0x7f95fc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 -- 172.21.15.93:0/1403039481 shutdown_connections 2023-11-04T01:36:46.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.656+0000 7f9601a32640 1 -- 172.21.15.93:0/1403039481 wait complete. 2023-11-04T01:36:46.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 Processor -- start 2023-11-04T01:36:46.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 -- start start 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 0x7f95fc152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 0x7f95fc0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1f26c0 con 0x7f95fc1f1d40 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0b8100 con 0x7f95e40047c0 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f9601a32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1f2c10 con 0x7f95fc0b7740 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.658+0000 7f95fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42892/0 (socket says 172.21.15.93:42892) 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1250150219 learned_addr learned my addr 172.21.15.93:0/1250150219 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95faffd640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 0x7f95fc152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fb7fe640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 0x7f95fc0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 msgr2=0x7f95fc0b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 0x7f95fc0b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 msgr2=0x7f95fc152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 0x7f95fc152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 -- 172.21.15.93:0/1250150219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc152750 con 0x7f95fc1f1d40 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95faffd640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 0x7f95fc152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fb7fe640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 0x7f95fc0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95fa7fc640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c210 tx=0x7f95f0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0039030 con 0x7f95fc1f1d40 2023-11-04T01:36:46.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f002cce0 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc152a30 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f003c040 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.659+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc152460 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.660+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc074290 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.660+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95f0032070 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.661+0000 7f95e3fff640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 0x7f95e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.661+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95f00aad60 con 0x7f95fc1f1d40 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.661+0000 7f95faffd640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 0x7f95e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.661+0000 7f95faffd640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 0x7f95e806d360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009b40 tx=0x7f95ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.665+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95f0075ae0 con 0x7f95fc1f1d40 2023-11-04T01:36:46.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.833+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95fc1f2d50 con 0x7f95fc1f1d40 2023-11-04T01:36:46.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.834+0000 7f95e3fff640 1 -- 172.21.15.93:0/1250150219 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f95f0079100 con 0x7f95fc1f1d40 2023-11-04T01:36:46.839 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:46.840 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:46.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 msgr2=0x7f95e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 0x7f95e806d360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009b40 tx=0x7f95ec008040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 msgr2=0x7f95fc1f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c210 tx=0x7f95f0001a00 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 shutdown_connections 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95e806aea0 0x7f95e806d360 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95fc0b7740 0x7f95fc0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95fc1f1d40 0x7f95fc1f2180 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 --2- 172.21.15.93:0/1250150219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95e40047c0 0x7f95fc152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 >> 172.21.15.93:0/1250150219 conn(0x7f95fc071f30 msgr2=0x7f95fc0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 shutdown_connections 2023-11-04T01:36:46.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.836+0000 7f9601a32640 1 -- 172.21.15.93:0/1250150219 wait complete. 2023-11-04T01:36:46.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:46.850 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:46.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 Processor -- start 2023-11-04T01:36:46.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 -- start start 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 0x7f5f60161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f600b4880 0x7f5f600b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f600cde60 con 0x7f5f60153e60 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f60160f90 con 0x7f5f600b4880 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.951+0000 7f5f64d25640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600b51e0 con 0x7f5f600cd6d0 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5dd9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 0x7f5f60161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5ed9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f600b4880 0x7f5f600b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5e59c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5f60153e60 0x7f5f6015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:42820/0 (socket says 172.21.15.93:42820) 2023-11-04T01:36:46.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5e59c640 1 -- 172.21.15.93:0/3573635109 learned_addr learned my addr 172.21.15.93:0/3573635109 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:46.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3573635109 >> v2:172.21.15.125:3300/0 conn(0x7f5f600b4880 msgr2=0x7f5f600b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5dd9b640 1 --2- 172.21.15.93:0/3573635109 >> v2:172.21.15.125:3300/0 conn(0x7f5f600b4880 0x7f5f600b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3573635109 >> v1:172.21.15.125:6789/0 conn(0x7f5f60153e60 legacy=0x7f5f6015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.952+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3573635109 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60161960 con 0x7f5f600cd6d0 2023-11-04T01:36:46.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.953+0000 7f5f5dd9b640 1 --2- 172.21.15.93:0/3573635109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 0x7f5f60161420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f5002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4373ec0c514dab41 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.953+0000 7f5f5d59a640 1 -- 172.21.15.93:0/3573635109 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50031830 con 0x7f5f600cd6d0 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.953+0000 7f5f5d59a640 1 -- 172.21.15.93:0/3573635109 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50031990 con 0x7f5f600cd6d0 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.953+0000 7f5f5d59a640 1 -- 172.21.15.93:0/3573635109 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50031d20 con 0x7f5f600cd6d0 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 -- 172.21.15.93:0/3573635109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 msgr2=0x7f5f60161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3573635109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 0x7f5f60161420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f5002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 -- 172.21.15.93:0/3573635109 shutdown_connections 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3573635109 >> v2:172.21.15.125:3300/0 conn(0x7f5f600b4880 0x7f5f600b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3573635109 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f600cd6d0 0x7f5f60161420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 -- 172.21.15.93:0/3573635109 >> 172.21.15.93:0/3573635109 conn(0x7f5f600cf880 msgr2=0x7f5f600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 -- 172.21.15.93:0/3573635109 shutdown_connections 2023-11-04T01:36:46.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.954+0000 7f5f64d25640 1 -- 172.21.15.93:0/3573635109 wait complete. 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.955+0000 7f5f64d25640 1 Processor -- start 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.955+0000 7f5f64d25640 1 -- start start 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f600b4880 0x7f5f60153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f60153e60 0x7f5f600cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6015aa40 con 0x7f5f600cd6d0 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60156700 con 0x7f5f600b4880 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f64d25640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6015c650 con 0x7f5f60153e60 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42902/0 (socket says 172.21.15.93:42902) 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3600496256 learned_addr learned my addr 172.21.15.93:0/3600496256 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5ed9d640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f60153e60 0x7f5f600cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5e59c640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f600b4880 0x7f5f60153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f60153e60 msgr2=0x7f5f600cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f60153e60 0x7f5f600cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f600b4880 msgr2=0x7f5f60153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f600b4880 0x7f5f60153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 -- 172.21.15.93:0/3600496256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009400 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f5dd9b640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5f5002bee0 tx=0x7f5f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.956+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5003a6f0 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.957+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5003a870 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.957+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6015c930 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.957+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5003ac20 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.957+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f60157ef0 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.958+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f60066920 con 0x7f5f600cd6d0 2023-11-04T01:36:46.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.958+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f5004c3b0 con 0x7f5f600cd6d0 2023-11-04T01:36:46.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.958+0000 7f5f56ffd640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 0x7f5f4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.958+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f500ab460 con 0x7f5f600cd6d0 2023-11-04T01:36:46.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.958+0000 7f5f5e59c640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 0x7f5f4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.959+0000 7f5f5e59c640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 0x7f5f4006d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f48005880 tx=0x7f5f48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:46.963+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f50076290 con 0x7f5f600cd6d0 2023-11-04T01:36:47.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.132+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f600ce850 con 0x7f5f600cd6d0 2023-11-04T01:36:47.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.132+0000 7f5f56ffd640 1 -- 172.21.15.93:0/3600496256 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f500798b0 con 0x7f5f600cd6d0 2023-11-04T01:36:47.135 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 msgr2=0x7f5f4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 0x7f5f4006d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f48005880 tx=0x7f5f48009040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 msgr2=0x7f5f600cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5f5002bee0 tx=0x7f5f500046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 shutdown_connections 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f4006ae70 0x7f5f4006d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f60153e60 0x7f5f600cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f600cd6d0 0x7f5f600cc180 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 --2- 172.21.15.93:0/3600496256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f600b4880 0x7f5f60153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.134+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 >> 172.21.15.93:0/3600496256 conn(0x7f5f600cf880 msgr2=0x7f5f600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.135+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 shutdown_connections 2023-11-04T01:36:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.135+0000 7f5f64d25640 1 -- 172.21.15.93:0/3600496256 wait complete. 2023-11-04T01:36:47.148 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.248+0000 7f8e46d90640 1 Processor -- start 2023-11-04T01:36:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.248+0000 7f8e46d90640 1 -- start start 2023-11-04T01:36:47.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e46d90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8e400b2d30 0x7f8e4006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e46d90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e4006c1d0 0x7f8e400cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e46d90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4006ca40 con 0x7f8e40160430 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e46d90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400cb580 con 0x7f8e400b2d30 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e46d90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4006cd20 con 0x7f8e4006c1d0 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8e400b2d30 0x7f8e4006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8e400b2d30 0x7f8e4006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42912/0 (socket says 172.21.15.93:42912) 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 -- 172.21.15.93:0/3284912927 learned_addr learned my addr 172.21.15.93:0/3284912927 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e4532d640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e4006c1d0 0x7f8e400cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 -- 172.21.15.93:0/3284912927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e4006c1d0 msgr2=0x7f8e400cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e4006c1d0 0x7f8e400cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 -- 172.21.15.93:0/3284912927 >> v1:172.21.15.125:6789/0 conn(0x7f8e40160430 legacy=0x7f8e400b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.249+0000 7f8e3ffff640 1 -- 172.21.15.93:0/3284912927 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4006d000 con 0x7f8e400b2d30 2023-11-04T01:36:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.250+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e400b2d30 0x7f8e4006bc90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009870 tx=0x7f8e3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ee17a3eced829e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.250+0000 7f8e3f7fe640 1 -- 172.21.15.93:0/3284912927 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34030840 con 0x7f8e400b2d30 2023-11-04T01:36:47.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.250+0000 7f8e3f7fe640 1 -- 172.21.15.93:0/3284912927 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e340309a0 con 0x7f8e400b2d30 2023-11-04T01:36:47.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.250+0000 7f8e3f7fe640 1 -- 172.21.15.93:0/3284912927 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34030d30 con 0x7f8e400b2d30 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 -- 172.21.15.93:0/3284912927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e400b2d30 msgr2=0x7f8e4006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e400b2d30 0x7f8e4006bc90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009870 tx=0x7f8e3402b980 comp rx=0 tx=0).stop 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 -- 172.21.15.93:0/3284912927 shutdown_connections 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e4006c1d0 0x7f8e400cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3284912927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e400b2d30 0x7f8e4006bc90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 -- 172.21.15.93:0/3284912927 >> 172.21.15.93:0/3284912927 conn(0x7f8e4006ea20 msgr2=0x7f8e4006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 -- 172.21.15.93:0/3284912927 shutdown_connections 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.251+0000 7f8e46d90640 1 -- 172.21.15.93:0/3284912927 wait complete. 2023-11-04T01:36:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.252+0000 7f8e46d90640 1 Processor -- start 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.252+0000 7f8e46d90640 1 -- start start 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 0x7f8e400c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 0x7f8e400c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c5b00 con 0x7f8e4006c1d0 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40159700 con 0x7f8e40160430 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e46d90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c9570 con 0x7f8e400b2d30 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42924/0 (socket says 172.21.15.93:42924) 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 -- 172.21.15.93:0/3314903190 learned_addr learned my addr 172.21.15.93:0/3314903190 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e4532d640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 0x7f8e400c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 0x7f8e400c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 -- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 msgr2=0x7f8e400c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 0x7f8e400c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 -- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 msgr2=0x7f8e400c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 0x7f8e400c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e44b2c640 1 -- 172.21.15.93:0/3314903190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340094d0 con 0x7f8e4006c1d0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 0x7f8e400c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.253+0000 7f8e4532d640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 0x7f8e400c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e44b2c640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c400 tx=0x7f8e3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300052d0 con 0x7f8e4006c1d0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30005430 con 0x7f8e4006c1d0 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400c87b0 con 0x7f8e4006c1d0 2023-11-04T01:36:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30003830 con 0x7f8e4006c1d0 2023-11-04T01:36:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.254+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400c8d70 con 0x7f8e4006c1d0 2023-11-04T01:36:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.255+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e40074290 con 0x7f8e4006c1d0 2023-11-04T01:36:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.255+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e30003990 con 0x7f8e4006c1d0 2023-11-04T01:36:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.255+0000 7f8e3d7fa640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 0x7f8e2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.256+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8e30088ef0 con 0x7f8e4006c1d0 2023-11-04T01:36:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.256+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 0x7f8e2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.256+0000 7f8e3ffff640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 0x7f8e2c06d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e34036000 tx=0x7f8e34008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.261+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e30053be0 con 0x7f8e4006c1d0 2023-11-04T01:36:47.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.425+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e400b2b10 con 0x7f8e4006c1d0 2023-11-04T01:36:47.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.425+0000 7f8e3d7fa640 1 -- 172.21.15.93:0/3314903190 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e30057200 con 0x7f8e4006c1d0 2023-11-04T01:36:47.431 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 msgr2=0x7f8e2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 0x7f8e2c06d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e34036000 tx=0x7f8e34008030 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 msgr2=0x7f8e401591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c400 tx=0x7f8e3000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 shutdown_connections 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e2c06aea0 0x7f8e2c06d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e40160430 0x7f8e400c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e400b2d30 0x7f8e400c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 --2- 172.21.15.93:0/3314903190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e4006c1d0 0x7f8e401591c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 >> 172.21.15.93:0/3314903190 conn(0x7f8e4006ea20 msgr2=0x7f8e4015da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 shutdown_connections 2023-11-04T01:36:47.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.427+0000 7f8e46d90640 1 -- 172.21.15.93:0/3314903190 wait complete. 2023-11-04T01:36:47.441 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:47.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.541+0000 7f8e1799e640 1 Processor -- start 2023-11-04T01:36:47.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.541+0000 7f8e1799e640 1 -- start start 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e1799e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8e100b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e1799e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100b2fc0 con 0x7f8e1006c3a0 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e1799e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1006c810 con 0x7f8e100b2b60 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e1799e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100cb580 con 0x7f8e10160430 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e15f3b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8e1006c3a0 0x7f8e100cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60710/0 (socket says 172.21.15.93:60710) 2023-11-04T01:36:47.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e15f3b640 1 -- 172.21.15.93:0/14646312 learned_addr learned my addr 172.21.15.93:0/14646312 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e1573a640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8e100b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755091764 0 0) 0x7f8e100b2fc0 con 0x7f8e1006c3a0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.542+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dfc003520 con 0x7f8e1006c3a0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3177150 0 0) 0x7f8dfc003520 con 0x7f8e1006c3a0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 msgr2=0x7f8e100b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8e100b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 >> v1:172.21.15.125:6789/0 conn(0x7f8e100b2b60 legacy=0x7f8e1006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1006ca40 con 0x7f8e1006c3a0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8e0c001670 con 0x7f8e1006c3a0 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 >> v1:172.21.15.93:6789/0 conn(0x7f8e1006c3a0 legacy=0x7f8e100cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8dfc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc004350 0x7f8dfc004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8dfc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100cb580 con 0x7f8dfc0039a0 2023-11-04T01:36:47.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc00b980 con 0x7f8dfc004350 2023-11-04T01:36:47.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc00bb40 con 0x7f8e10160430 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8dfc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e14f39640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc004350 0x7f8dfc004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e15f3b640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8dfc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 -- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 msgr2=0x7f8dfc005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e10160430 0x7f8dfc005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 -- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc004350 msgr2=0x7f8dfc004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc004350 0x7f8dfc004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e1573a640 1 -- 172.21.15.93:0/14646312 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc003520 con 0x7f8dfc0039a0 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.543+0000 7f8e14f39640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dfc004350 0x7f8dfc004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1573a640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8dfc003d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009fc0 tx=0x7f8dfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7d266532d67a72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0802cc20 con 0x7f8dfc0039a0 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800f040 con 0x7f8dfc0039a0 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e07fff640 1 -- 172.21.15.93:0/14646312 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08034440 con 0x7f8dfc0039a0 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 -- 172.21.15.93:0/14646312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 msgr2=0x7f8dfc003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 --2- 172.21.15.93:0/14646312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8dfc003d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009fc0 tx=0x7f8dfc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e15f3b640 1 -- 172.21.15.93:0/14646312 reap_dead start 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 -- 172.21.15.93:0/14646312 shutdown_connections 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 -- 172.21.15.93:0/14646312 >> 172.21.15.93:0/14646312 conn(0x7f8e1006ea20 msgr2=0x7f8e1006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 -- 172.21.15.93:0/14646312 shutdown_connections 2023-11-04T01:36:47.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.544+0000 7f8e1799e640 1 -- 172.21.15.93:0/14646312 wait complete. 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 Processor -- start 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 -- start start 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e101f3d70 0x7f8e101f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 0x7f8e1015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e101f3b70 con 0x7f8dfc0039a0 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100b5230 con 0x7f8e10152030 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1799e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100b4c70 con 0x7f8e101f3d70 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1573a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1573a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42938/0 (socket says 172.21.15.93:42938) 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e1573a640 1 -- 172.21.15.93:0/3836518917 learned_addr learned my addr 172.21.15.93:0/3836518917 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e15f3b640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 0x7f8e1015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.546+0000 7f8e14f39640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e101f3d70 0x7f8e101f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 -- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e101f3d70 msgr2=0x7f8e101f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e101f3d70 0x7f8e101f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 -- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 msgr2=0x7f8e1015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 0x7f8e1015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 -- 172.21.15.93:0/3836518917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100b4f50 con 0x7f8dfc0039a0 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e15f3b640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 0x7f8e1015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:47.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1573a640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e0802c690 tx=0x7f8e08009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08034bd0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08034d50 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100c5f90 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08003bd0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.547+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e101524e0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.548+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100c5df0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.549+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e08040450 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.549+0000 7f8e05ffb640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 0x7f8df406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.549+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8e080ac010 con 0x7f8dfc0039a0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.549+0000 7f8e14f39640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 0x7f8df406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.550+0000 7f8e14f39640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 0x7f8df406d360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e1015f820 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.553+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e100c5df0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.720+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e100c5df0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.721+0000 7f8e05ffb640 1 -- 172.21.15.93:0/3836518917 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e100c5df0 con 0x7f8dfc0039a0 2023-11-04T01:36:47.722 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:47.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 msgr2=0x7f8df406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 0x7f8df406d360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e1015f820 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 msgr2=0x7f8e100b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e0802c690 tx=0x7f8e08009750 comp rx=0 tx=0).stop 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 shutdown_connections 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8df406aea0 0x7f8df406d360 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10152030 0x7f8e1015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e101f3d70 0x7f8e101f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 --2- 172.21.15.93:0/3836518917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dfc0039a0 0x7f8e100b4630 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 >> 172.21.15.93:0/3836518917 conn(0x7f8e1006ea20 msgr2=0x7f8e1006bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 shutdown_connections 2023-11-04T01:36:47.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.723+0000 7f8e1799e640 1 -- 172.21.15.93:0/3836518917 wait complete. 2023-11-04T01:36:47.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.835+0000 7f670be32640 1 Processor -- start 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.835+0000 7f670be32640 1 -- start start 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670be32640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f670415ad40 0x7f670406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670be32640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67040c9b60 0x7f6704070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670be32640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6704065df0 con 0x7f670415b120 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670be32640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670406bc40 con 0x7f67040c9b60 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670be32640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6704066040 con 0x7f670415ad40 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670a3cf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67040c9b60 0x7f6704070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670a3cf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67040c9b60 0x7f6704070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42944/0 (socket says 172.21.15.93:42944) 2023-11-04T01:36:47.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.836+0000 7f670a3cf640 1 -- 172.21.15.93:0/1941054367 learned_addr learned my addr 172.21.15.93:0/1941054367 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f6709bce640 1 --2- 172.21.15.93:0/1941054367 >> v2:172.21.15.125:3300/0 conn(0x7f670415ad40 0x7f670406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f670a3cf640 1 -- 172.21.15.93:0/1941054367 >> v2:172.21.15.125:3300/0 conn(0x7f670415ad40 msgr2=0x7f670406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f670a3cf640 1 --2- 172.21.15.93:0/1941054367 >> v2:172.21.15.125:3300/0 conn(0x7f670415ad40 0x7f670406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f670a3cf640 1 -- 172.21.15.93:0/1941054367 >> v1:172.21.15.125:6789/0 conn(0x7f670415b120 legacy=0x7f670415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f670a3cf640 1 -- 172.21.15.93:0/1941054367 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704066320 con 0x7f67040c9b60 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.837+0000 7f670a3cf640 1 --2- 172.21.15.93:0/1941054367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67040c9b60 0x7f6704070ff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f670406e030 tx=0x7f66fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5341edbecdb8d236 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f6708bcc640 1 -- 172.21.15.93:0/1941054367 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc031870 con 0x7f67040c9b60 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f6708bcc640 1 -- 172.21.15.93:0/1941054367 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc0319d0 con 0x7f67040c9b60 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f6708bcc640 1 -- 172.21.15.93:0/1941054367 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc031d60 con 0x7f67040c9b60 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 -- 172.21.15.93:0/1941054367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67040c9b60 msgr2=0x7f6704070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 --2- 172.21.15.93:0/1941054367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67040c9b60 0x7f6704070ff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f670406e030 tx=0x7f66fc02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 -- 172.21.15.93:0/1941054367 shutdown_connections 2023-11-04T01:36:47.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 --2- 172.21.15.93:0/1941054367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67040c9b60 0x7f6704070ff0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 --2- 172.21.15.93:0/1941054367 >> v2:172.21.15.125:3300/0 conn(0x7f670415ad40 0x7f670406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 -- 172.21.15.93:0/1941054367 >> 172.21.15.93:0/1941054367 conn(0x7f67040cbc90 msgr2=0x7f67040cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 -- 172.21.15.93:0/1941054367 shutdown_connections 2023-11-04T01:36:47.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.838+0000 7f670be32640 1 -- 172.21.15.93:0/1941054367 wait complete. 2023-11-04T01:36:47.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.839+0000 7f670be32640 1 Processor -- start 2023-11-04T01:36:47.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.839+0000 7f670be32640 1 -- start start 2023-11-04T01:36:47.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67040c9b60 0x7f67041486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f670415b120 0x7f67040c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c5f40 con 0x7f670415ad40 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6704148c10 con 0x7f670415b120 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670be32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c3800 con 0x7f67040c9b60 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42948/0 (socket says 172.21.15.93:42948) 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 -- 172.21.15.93:0/3954546773 learned_addr learned my addr 172.21.15.93:0/3954546773 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f670a3cf640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f670415b120 0x7f67040c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 -- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67040c9b60 msgr2=0x7f67041486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67040c9b60 0x7f67041486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 -- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f670415b120 msgr2=0x7f67040c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f670415b120 0x7f67040c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 -- 172.21.15.93:0/3954546773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0094d0 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.840+0000 7f67093cd640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66f400b3c0 tx=0x7f66f400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.841+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011830 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.841+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4011990 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.841+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040c3ae0 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.841+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011d80 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.841+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040c40a0 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.842+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6704074290 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.842+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66f401b460 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.842+0000 7f66fa7fc640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.842+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66f4089530 con 0x7f670415ad40 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.842+0000 7f6709bce640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.843+0000 7f6709bce640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 0x7f66e806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6700007e60 tx=0x7f6700007390 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:47.847+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66f4054220 con 0x7f670415ad40 2023-11-04T01:36:48.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.012+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f67040ccac0 con 0x7f670415ad40 2023-11-04T01:36:48.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.013+0000 7f66fa7fc640 1 -- 172.21.15.93:0/3954546773 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66f4057840 con 0x7f670415ad40 2023-11-04T01:36:48.014 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:48.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 msgr2=0x7f66e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 0x7f66e806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6700007e60 tx=0x7f6700007390 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 msgr2=0x7f67040c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66f400b3c0 tx=0x7f66f400b880 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 shutdown_connections 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f670415b120 0x7f67040c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f670415ad40 0x7f67040c48a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 --2- 172.21.15.93:0/3954546773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67040c9b60 0x7f67041486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 >> 172.21.15.93:0/3954546773 conn(0x7f67040cbc90 msgr2=0x7f67040b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 shutdown_connections 2023-11-04T01:36:48.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.015+0000 7f670be32640 1 -- 172.21.15.93:0/3954546773 wait complete. 2023-11-04T01:36:48.028 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:48.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.127+0000 7fe3ca40e640 1 Processor -- start 2023-11-04T01:36:48.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.127+0000 7fe3ca40e640 1 -- start start 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3ca40e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3c40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3ca40e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe3c40adac0 0x7fe3c40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3ca40e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c415aff0 con 0x7fe3c4159c00 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3ca40e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40ae450 con 0x7fe3c40adac0 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3ca40e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415a3e0 con 0x7fe3c40c4ff0 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe3c4159c00 0x7fe3c40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60726/0 (socket says 172.21.15.93:60726) 2023-11-04T01:36:48.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c3fff640 1 -- 172.21.15.93:0/4274647140 learned_addr learned my addr 172.21.15.93:0/4274647140 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229033386 0 0) 0x7fe3c415aff0 con 0x7fe3c4159c00 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ac003520 con 0x7fe3c4159c00 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/4274647140 >> v2:172.21.15.125:3300/0 conn(0x7fe3c40adac0 0x7fe3c40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3c40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056095377 0 0) 0x7fe3ac003520 con 0x7fe3c4159c00 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 msgr2=0x7fe3c40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3c40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 >> v2:172.21.15.125:3300/0 conn(0x7fe3c40adac0 msgr2=0x7fe3c40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 --2- 172.21.15.93:0/4274647140 >> v2:172.21.15.125:3300/0 conn(0x7fe3c40adac0 0x7fe3c40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c415a6c0 con 0x7fe3c4159c00 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fe3b4001670 con 0x7fe3c4159c00 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3c40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.128+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 >> v1:172.21.15.93:6789/0 conn(0x7fe3c4159c00 legacy=0x7fe3c40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3ac003f60 0x7fe3ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ae450 con 0x7fe3ac004d00 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415a3e0 con 0x7fe3ac003f60 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac00ba60 con 0x7fe3c40c4ff0 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3ac003f60 0x7fe3ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c3fff640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 -- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 msgr2=0x7fe3ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c4ff0 0x7fe3ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 -- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3ac003f60 msgr2=0x7fe3ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3ac003f60 0x7fe3ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.129+0000 7fe3c89ab640 1 -- 172.21.15.93:0/4274647140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac003520 con 0x7fe3ac004d00 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3ac005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc007360 tx=0x7fe3ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920c2d1ff29ecc9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc02ccf0 con 0x7fe3ac004d00 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc02ce50 con 0x7fe3ac004d00 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3c2ffd640 1 -- 172.21.15.93:0/4274647140 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc034660 con 0x7fe3ac004d00 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 -- 172.21.15.93:0/4274647140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 msgr2=0x7fe3ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/4274647140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3ac005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc007360 tx=0x7fe3ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3c89ab640 1 -- 172.21.15.93:0/4274647140 reap_dead start 2023-11-04T01:36:48.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 -- 172.21.15.93:0/4274647140 shutdown_connections 2023-11-04T01:36:48.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 -- 172.21.15.93:0/4274647140 >> 172.21.15.93:0/4274647140 conn(0x7fe3c40ce950 msgr2=0x7fe3c40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 -- 172.21.15.93:0/4274647140 shutdown_connections 2023-11-04T01:36:48.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.130+0000 7fe3ca40e640 1 -- 172.21.15.93:0/4274647140 wait complete. 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.131+0000 7fe3ca40e640 1 Processor -- start 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 -- start start 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c79f0 0x7fe3c40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3c40af590 0x7fe3c40afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c41f4570 con 0x7fe3ac004d00 2023-11-04T01:36:48.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40b01e0 con 0x7fe3c40af590 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3ca40e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40c8390 con 0x7fe3c40c79f0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42974/0 (socket says 172.21.15.93:42974) 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.132+0000 7fe3c3fff640 1 -- 172.21.15.93:0/2343610005 learned_addr learned my addr 172.21.15.93:0/2343610005 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c79f0 0x7fe3c40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c89ab640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3c40af590 0x7fe3c40afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 -- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c79f0 msgr2=0x7fe3c40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c79f0 0x7fe3c40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 -- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3c40af590 msgr2=0x7fe3c40afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3c40af590 0x7fe3c40afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 -- 172.21.15.93:0/2343610005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40aff50 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c3fff640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007370 tx=0x7fe3b4007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400fa20 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400fba0 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c41f0080 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40133f0 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.133+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c41f0620 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.134+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4074290 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.135+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3b4013550 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.135+0000 7fe3c0ff9640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 0x7fe3b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.135+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3b4089ca0 con 0x7fe3ac004d00 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.135+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 0x7fe3b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.135+0000 7fe3c37fe640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 0x7fe3b006d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3c41531d0 tx=0x7fe3b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.139+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3b4054a20 con 0x7fe3ac004d00 2023-11-04T01:36:48.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.319+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3c40ceed0 con 0x7fe3ac004d00 2023-11-04T01:36:48.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.320+0000 7fe3c0ff9640 1 -- 172.21.15.93:0/2343610005 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3b4058040 con 0x7fe3ac004d00 2023-11-04T01:36:48.322 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:48.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 msgr2=0x7fe3b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 0x7fe3b006d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3c41531d0 tx=0x7fe3b8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:48.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 msgr2=0x7fe3c4150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007370 tx=0x7fe3b4007830 comp rx=0 tx=0).stop 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 shutdown_connections 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3b006ae70 0x7fe3b006d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3c40af590 0x7fe3c40afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe3c40c79f0 0x7fe3c40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 --2- 172.21.15.93:0/2343610005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe3ac004d00 0x7fe3c4150400 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.321+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 >> 172.21.15.93:0/2343610005 conn(0x7fe3c40ce950 msgr2=0x7fe3c41545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.322+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 shutdown_connections 2023-11-04T01:36:48.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.322+0000 7fe3ca40e640 1 -- 172.21.15.93:0/2343610005 wait complete. 2023-11-04T01:36:48.334 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:48.334 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:48.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:48.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.451+0000 7fde5f7e7640 1 Processor -- start 2023-11-04T01:36:48.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.451+0000 7fde5f7e7640 1 -- start start 2023-11-04T01:36:48.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5f7e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde5806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5f7e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde580c9a40 0x7fde580c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5f7e7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5806cf60 con 0x7fde5815ad80 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5f7e7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580ca430 con 0x7fde580c9a40 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5f7e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5815b160 con 0x7fde5806a1b0 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5d583640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fde5815ad80 0x7fde580abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60742/0 (socket says 172.21.15.93:60742) 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5d583640 1 -- 172.21.15.93:0/4060421902 learned_addr learned my addr 172.21.15.93:0/4060421902 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5dd84640 1 --2- 172.21.15.93:0/4060421902 >> v2:172.21.15.125:3300/0 conn(0x7fde580c9a40 0x7fde580c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde5cd82640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde5806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552130478 0 0) 0x7fde5806cf60 con 0x7fde5815ad80 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde44003520 con 0x7fde5815ad80 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907120502 0 0) 0x7fde44003520 con 0x7fde5815ad80 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 msgr2=0x7fde5806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde5806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 >> v2:172.21.15.125:3300/0 conn(0x7fde580c9a40 msgr2=0x7fde580c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 --2- 172.21.15.93:0/4060421902 >> v2:172.21.15.125:3300/0 conn(0x7fde580c9a40 0x7fde580c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806b9b0 con 0x7fde5815ad80 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fde54001670 con 0x7fde5815ad80 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 >> v1:172.21.15.93:6789/0 conn(0x7fde5815ad80 legacy=0x7fde580abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde44003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.452+0000 7fde4ffff640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde4ffff640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde44004d00 0x7fde44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580ca430 con 0x7fde44003ef0 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5815b160 con 0x7fde44004d00 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4400b980 con 0x7fde5806a1b0 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5d583640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde44003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5dd84640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde44004d00 0x7fde44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 -- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 msgr2=0x7fde44003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde5806a1b0 0x7fde44003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 -- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde44004d00 msgr2=0x7fde44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde44004d00 0x7fde44005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.453+0000 7fde5cd82640 1 -- 172.21.15.93:0/4060421902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44003520 con 0x7fde44003ef0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5cd82640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde440047c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fde48009a90 tx=0x7fde440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f057716a3853cf4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4802c6b0 con 0x7fde44003ef0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4802c810 con 0x7fde44003ef0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde4ffff640 1 -- 172.21.15.93:0/4060421902 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4802cba0 con 0x7fde44003ef0 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 -- 172.21.15.93:0/4060421902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 msgr2=0x7fde440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/4060421902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde440047c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fde48009a90 tx=0x7fde440057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5dd84640 1 -- 172.21.15.93:0/4060421902 reap_dead start 2023-11-04T01:36:48.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 -- 172.21.15.93:0/4060421902 shutdown_connections 2023-11-04T01:36:48.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 -- 172.21.15.93:0/4060421902 >> 172.21.15.93:0/4060421902 conn(0x7fde580b0cd0 msgr2=0x7fde580b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 -- 172.21.15.93:0/4060421902 shutdown_connections 2023-11-04T01:36:48.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.454+0000 7fde5f7e7640 1 -- 172.21.15.93:0/4060421902 wait complete. 2023-11-04T01:36:48.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.455+0000 7fde5f7e7640 1 Processor -- start 2023-11-04T01:36:48.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 -- start start 2023-11-04T01:36:48.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde58152470 0x7fde581f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde581528f0 0x7fde581f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5814b7a0 con 0x7fde44003ef0 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c6920 con 0x7fde581528f0 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5f7e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c8a30 con 0x7fde58152470 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5d583640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5d583640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42988/0 (socket says 172.21.15.93:42988) 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5d583640 1 -- 172.21.15.93:0/518968777 learned_addr learned my addr 172.21.15.93:0/518968777 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:48.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5dd84640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde581528f0 0x7fde581f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.456+0000 7fde5cd82640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde58152470 0x7fde581f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 -- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde58152470 msgr2=0x7fde581f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde58152470 0x7fde581f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 -- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde581528f0 msgr2=0x7fde581f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde581528f0 0x7fde581f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 -- 172.21.15.93:0/518968777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580c8d10 con 0x7fde44003ef0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5d583640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fde54007310 tx=0x7fde540077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400f8e0 con 0x7fde44003ef0 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400fa80 con 0x7fde44003ef0 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580c8ff0 con 0x7fde44003ef0 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400fe30 con 0x7fde44003ef0 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.457+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580c97f0 con 0x7fde44003ef0 2023-11-04T01:36:48.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.458+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58074290 con 0x7fde44003ef0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.458+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde5401d460 con 0x7fde44003ef0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.459+0000 7fde4dffb640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 0x7fde3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.459+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde54089a20 con 0x7fde44003ef0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.459+0000 7fde5cd82640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 0x7fde3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.459+0000 7fde5cd82640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 0x7fde3c06d360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde48036000 tx=0x7fde48030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.463+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde540547a0 con 0x7fde44003ef0 2023-11-04T01:36:48.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.630+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde58066320 con 0x7fde44003ef0 2023-11-04T01:36:48.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.631+0000 7fde4dffb640 1 -- 172.21.15.93:0/518968777 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7fde54057dc0 con 0x7fde44003ef0 2023-11-04T01:36:48.633 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:48.633 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:48.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 msgr2=0x7fde3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 0x7fde3c06d360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde48036000 tx=0x7fde48030000 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 msgr2=0x7fde580c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fde54007310 tx=0x7fde540077d0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 shutdown_connections 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde3c06aea0 0x7fde3c06d360 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde581528f0 0x7fde581f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde58152470 0x7fde581f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 --2- 172.21.15.93:0/518968777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde44003ef0 0x7fde580c62b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 >> 172.21.15.93:0/518968777 conn(0x7fde580b0cd0 msgr2=0x7fde580ac590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 shutdown_connections 2023-11-04T01:36:48.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.633+0000 7fde5f7e7640 1 -- 172.21.15.93:0/518968777 wait complete. 2023-11-04T01:36:48.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:48.649 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:48.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.750+0000 7f520a3e2640 1 Processor -- start 2023-11-04T01:36:48.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.750+0000 7f520a3e2640 1 -- start start 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520a3e2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52040d0710 0x7f52040cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520a3e2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 0x7f52040b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520a3e2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040d0280 con 0x7f520415e430 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520a3e2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040cf670 con 0x7f52040d0710 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520a3e2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040cf950 con 0x7f52040cda50 2023-11-04T01:36:48.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52040d0710 0x7f52040cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52040d0710 0x7f52040cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42990/0 (socket says 172.21.15.93:42990) 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 -- 172.21.15.93:0/3267413117 learned_addr learned my addr 172.21.15.93:0/3267413117 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 -- 172.21.15.93:0/3267413117 >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 msgr2=0x7f52040b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520897f640 1 --2- 172.21.15.93:0/3267413117 >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 0x7f52040b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 --2- 172.21.15.93:0/3267413117 >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 0x7f52040b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 -- 172.21.15.93:0/3267413117 >> v1:172.21.15.125:6789/0 conn(0x7f520415e430 legacy=0x7f52040cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f52037fe640 1 -- 172.21.15.93:0/3267413117 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040cfc30 con 0x7f52040d0710 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.751+0000 7f520897f640 1 --2- 172.21.15.93:0/3267413117 >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 0x7f52040b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f52037fe640 1 --2- 172.21.15.93:0/3267413117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040d0710 0x7f52040cd510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f52040b6250 tx=0x7f51f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee47d965a50b258 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f5202ffd640 1 -- 172.21.15.93:0/3267413117 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8031870 con 0x7f52040d0710 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f5202ffd640 1 -- 172.21.15.93:0/3267413117 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80319d0 con 0x7f52040d0710 2023-11-04T01:36:48.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f5202ffd640 1 -- 172.21.15.93:0/3267413117 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8031d60 con 0x7f52040d0710 2023-11-04T01:36:48.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f520a3e2640 1 -- 172.21.15.93:0/3267413117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040d0710 msgr2=0x7f52040cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.752+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3267413117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040d0710 0x7f52040cd510 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f52040b6250 tx=0x7f51f802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:48.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 -- 172.21.15.93:0/3267413117 shutdown_connections 2023-11-04T01:36:48.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3267413117 >> v2:172.21.15.125:3300/0 conn(0x7f52040cda50 0x7f52040b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3267413117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040d0710 0x7f52040cd510 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 -- 172.21.15.93:0/3267413117 >> 172.21.15.93:0/3267413117 conn(0x7f520406ea20 msgr2=0x7f520406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 -- 172.21.15.93:0/3267413117 shutdown_connections 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.753+0000 7f520a3e2640 1 -- 172.21.15.93:0/3267413117 wait complete. 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.754+0000 7f520a3e2640 1 Processor -- start 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.754+0000 7f520a3e2640 1 -- start start 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52040d0710 0x7f52040b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 0x7f52040ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040c86b0 con 0x7f52040cda50 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b3010 con 0x7f520415e430 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b32f0 con 0x7f52040d0710 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43004/0 (socket says 172.21.15.93:43004) 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 -- 172.21.15.93:0/3085049859 learned_addr learned my addr 172.21.15.93:0/3085049859 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:48.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 -- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52040d0710 msgr2=0x7f52040b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52040d0710 0x7f52040b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 -- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 msgr2=0x7f52040ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520897f640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 0x7f52040ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 0x7f52040ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 -- 172.21.15.93:0/3085049859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80094d0 con 0x7f52040cda50 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520897f640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 0x7f52040ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5203fff640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c430 tx=0x7f51f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011790 con 0x7f52040cda50 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f40118f0 con 0x7f52040cda50 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040c88c0 con 0x7f52040cda50 2023-11-04T01:36:48.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011ce0 con 0x7f52040cda50 2023-11-04T01:36:48.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.755+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5204150370 con 0x7f52040cda50 2023-11-04T01:36:48.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.756+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040b3510 con 0x7f52040cda50 2023-11-04T01:36:48.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.757+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51f401c460 con 0x7f52040cda50 2023-11-04T01:36:48.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.757+0000 7f5200ff9640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.757+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f51f40899a0 con 0x7f52040cda50 2023-11-04T01:36:48.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.757+0000 7f52037fe640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.757+0000 7f52037fe640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 0x7f51f006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51f8036000 tx=0x7f51f8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.761+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51f4054690 con 0x7f52040cda50 2023-11-04T01:36:48.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.925+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52040cf2e0 con 0x7f52040cda50 2023-11-04T01:36:48.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.925+0000 7f5200ff9640 1 -- 172.21.15.93:0/3085049859 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51f4057cb0 con 0x7f52040cda50 2023-11-04T01:36:48.927 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 msgr2=0x7f51f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 0x7f51f006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51f8036000 tx=0x7f51f8030000 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 msgr2=0x7f52040a77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c430 tx=0x7f51f400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 shutdown_connections 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520415e430 0x7f52040ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52040d0710 0x7f52040b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 --2- 172.21.15.93:0/3085049859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52040cda50 0x7f52040a77b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 >> 172.21.15.93:0/3085049859 conn(0x7f520406ea20 msgr2=0x7f52040ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 shutdown_connections 2023-11-04T01:36:48.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:48.927+0000 7f520a3e2640 1 -- 172.21.15.93:0/3085049859 wait complete. 2023-11-04T01:36:48.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:49.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.041+0000 7f6242aa9640 1 Processor -- start 2023-11-04T01:36:49.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.041+0000 7f6242aa9640 1 -- start start 2023-11-04T01:36:49.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c070ff0 0x7f623c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f623c15d1b0 0x7f623c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 0x7f623c160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c0c9bf0 con 0x7f623c15d1b0 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c0cd890 con 0x7f623c066000 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6242aa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c071910 con 0x7f623c070ff0 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f623c15d1b0 0x7f623c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f623c15d1b0 0x7f623c0713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43014/0 (socket says 172.21.15.93:43014) 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 -- 172.21.15.93:0/2344471325 learned_addr learned my addr 172.21.15.93:0/2344471325 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6240845640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c070ff0 0x7f623c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6241046640 1 --2- 172.21.15.93:0/2344471325 >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 0x7f623c160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 -- 172.21.15.93:0/2344471325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c070ff0 msgr2=0x7f623c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c070ff0 0x7f623c0cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 -- 172.21.15.93:0/2344471325 >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 msgr2=0x7f623c160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 --2- 172.21.15.93:0/2344471325 >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 0x7f623c160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f623bfff640 1 -- 172.21.15.93:0/2344471325 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0cdb30 con 0x7f623c15d1b0 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.042+0000 7f6241046640 1 --2- 172.21.15.93:0/2344471325 >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 0x7f623c160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.043+0000 7f623bfff640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c15d1b0 0x7f623c0713d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f623c06c430 tx=0x7f622802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11bf9b502e196c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.043+0000 7f623b7fe640 1 -- 172.21.15.93:0/2344471325 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228031870 con 0x7f623c15d1b0 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.043+0000 7f623b7fe640 1 -- 172.21.15.93:0/2344471325 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62280319d0 con 0x7f623c15d1b0 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.043+0000 7f623b7fe640 1 -- 172.21.15.93:0/2344471325 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228031d60 con 0x7f623c15d1b0 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 -- 172.21.15.93:0/2344471325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c15d1b0 msgr2=0x7f623c0713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c15d1b0 0x7f623c0713d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f623c06c430 tx=0x7f622802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 -- 172.21.15.93:0/2344471325 shutdown_connections 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c15d1b0 0x7f623c0713d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2344471325 >> v2:172.21.15.125:3300/0 conn(0x7f623c066000 0x7f623c160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2344471325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c070ff0 0x7f623c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 -- 172.21.15.93:0/2344471325 >> 172.21.15.93:0/2344471325 conn(0x7f623c0cbc90 msgr2=0x7f623c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 -- 172.21.15.93:0/2344471325 shutdown_connections 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.044+0000 7f6242aa9640 1 -- 172.21.15.93:0/2344471325 wait complete. 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.045+0000 7f6242aa9640 1 Processor -- start 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.045+0000 7f6242aa9640 1 -- start start 2023-11-04T01:36:49.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 0x7f623c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c15d1b0 0x7f623c0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0b4070 con 0x7f623c066000 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0b3460 con 0x7f623c070ff0 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0b3740 con 0x7f623c15d1b0 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43030/0 (socket says 172.21.15.93:43030) 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 -- 172.21.15.93:0/2942073066 learned_addr learned my addr 172.21.15.93:0/2942073066 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f623bfff640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 0x7f623c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6241046640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c15d1b0 0x7f623c0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 -- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c15d1b0 msgr2=0x7f623c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c15d1b0 0x7f623c0caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 -- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 msgr2=0x7f623c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 0x7f623c0ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 -- 172.21.15.93:0/2942073066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280094d0 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f623bfff640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 0x7f623c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6240845640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f623000c7f0 tx=0x7f623000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230004220 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300043a0 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230007860 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.046+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c0b3a20 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.047+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c160f20 con 0x7f623c066000 2023-11-04T01:36:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.047+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c074290 con 0x7f623c066000 2023-11-04T01:36:49.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.048+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6230007bd0 con 0x7f623c066000 2023-11-04T01:36:49.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.048+0000 7f62397fa640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.048+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6230089990 con 0x7f623c066000 2023-11-04T01:36:49.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.048+0000 7f623bfff640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.049+0000 7f623bfff640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 0x7f622006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6228036000 tx=0x7f622803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.052+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6230054600 con 0x7f623c066000 2023-11-04T01:36:49.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.219+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f623c0b5190 con 0x7f623c066000 2023-11-04T01:36:49.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.220+0000 7f62397fa640 1 -- 172.21.15.93:0/2942073066 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6230057c20 con 0x7f623c066000 2023-11-04T01:36:49.221 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:49.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 msgr2=0x7f622006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 0x7f622006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6228036000 tx=0x7f622803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:49.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 msgr2=0x7f623c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f623000c7f0 tx=0x7f623000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 shutdown_connections 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f623c15d1b0 0x7f623c0caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f623c070ff0 0x7f623c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 --2- 172.21.15.93:0/2942073066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f623c066000 0x7f623c0b2e80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 >> 172.21.15.93:0/2942073066 conn(0x7f623c0cbc90 msgr2=0x7f623c15fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 shutdown_connections 2023-11-04T01:36:49.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.222+0000 7f6242aa9640 1 -- 172.21.15.93:0/2942073066 wait complete. 2023-11-04T01:36:49.234 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:49.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.336+0000 7fd0d69a9640 1 Processor -- start 2023-11-04T01:36:49.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.336+0000 7fd0d69a9640 1 -- start start 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d69a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0d00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d69a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0d00ae1d0 0x7fd0d00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d69a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d015aff0 con 0x7fd0d00c48e0 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d69a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00c52a0 con 0x7fd0d00ae1d0 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d69a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015a3e0 con 0x7fd0d0159c00 2023-11-04T01:36:49.341 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0cf7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd0d00c48e0 0x7fd0d00adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60756/0 (socket says 172.21.15.93:60756) 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0cf7fe640 1 -- 172.21.15.93:0/3276699608 learned_addr learned my addr 172.21.15.93:0/3276699608 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265780718 0 0) 0x7fd0d015aff0 con 0x7fd0d00c48e0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0cffff640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0d00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0d4f46640 1 --2- 172.21.15.93:0/3276699608 >> v2:172.21.15.125:3300/0 conn(0x7fd0d00ae1d0 0x7fd0d00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b8003520 con 0x7fd0d00c48e0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882546805 0 0) 0x7fd0b8003520 con 0x7fd0d00c48e0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 msgr2=0x7fd0d00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0d00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 >> v2:172.21.15.125:3300/0 conn(0x7fd0d00ae1d0 msgr2=0x7fd0d00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 --2- 172.21.15.93:0/3276699608 >> v2:172.21.15.125:3300/0 conn(0x7fd0d00ae1d0 0x7fd0d00c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d015a6c0 con 0x7fd0d00c48e0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fd0c4001670 con 0x7fd0d00c48e0 2023-11-04T01:36:49.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 >> v1:172.21.15.93:6789/0 conn(0x7fd0d00c48e0 legacy=0x7fd0d00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b8004d00 0x7fd0b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00c52a0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015a3e0 con 0x7fd0b8004d00 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.337+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b800b980 con 0x7fd0d0159c00 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cffff640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0d4f46640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b8004d00 0x7fd0b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 -- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 msgr2=0x7fd0b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d0159c00 0x7fd0b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 -- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b8004d00 msgr2=0x7fd0b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0b8004d00 0x7fd0b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.338+0000 7fd0cf7fe640 1 -- 172.21.15.93:0/3276699608 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8003520 con 0x7fd0b8003ef0 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0b80047c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c290 tx=0x7fd0b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6eb19408dfd69c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4005ad0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4005c30 con 0x7fd0b8003ef0 2023-11-04T01:36:49.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0ceffd640 1 -- 172.21.15.93:0/3276699608 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c402c8c0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 -- 172.21.15.93:0/3276699608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 msgr2=0x7fd0b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/3276699608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0b80047c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c290 tx=0x7fd0b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d4f46640 1 -- 172.21.15.93:0/3276699608 reap_dead start 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 -- 172.21.15.93:0/3276699608 shutdown_connections 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 -- 172.21.15.93:0/3276699608 >> 172.21.15.93:0/3276699608 conn(0x7fd0d00ce950 msgr2=0x7fd0d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 -- 172.21.15.93:0/3276699608 shutdown_connections 2023-11-04T01:36:49.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.339+0000 7fd0d69a9640 1 -- 172.21.15.93:0/3276699608 wait complete. 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.340+0000 7fd0d69a9640 1 Processor -- start 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 -- start start 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 0x7fd0d00a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d01507c0 0x7fd0d00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00a8c00 con 0x7fd0b8003ef0 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00a9560 con 0x7fd0d0150360 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d69a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00a7f80 con 0x7fd0d01507c0 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0cffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0cffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43046/0 (socket says 172.21.15.93:43046) 2023-11-04T01:36:49.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0cffff640 1 -- 172.21.15.93:0/2183470734 learned_addr learned my addr 172.21.15.93:0/2183470734 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 0x7fd0d00a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.341+0000 7fd0d4f46640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d01507c0 0x7fd0d00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 -- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d01507c0 msgr2=0x7fd0d00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d01507c0 0x7fd0d00cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 -- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 msgr2=0x7fd0d00a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 0x7fd0d00a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 -- 172.21.15.93:0/2183470734 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00a8260 con 0x7fd0b8003ef0 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 0x7fd0d00a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0cffff640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0011630 tx=0x7fd0c0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000f920 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c000fa80 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00a8540 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000fdf0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.342+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d01546e0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.343+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0074290 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.344+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0c0015460 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.344+0000 7fd0ccff9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 0x7fd0bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.344+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0c0089df0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.344+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 0x7fd0bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.344+0000 7fd0cf7fe640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 0x7fd0bc06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c4007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.348+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0c0054ae0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.513+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0d006d9f0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.514+0000 7fd0ccff9640 1 -- 172.21.15.93:0/2183470734 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0c00220a0 con 0x7fd0b8003ef0 2023-11-04T01:36:49.515 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.515+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 msgr2=0x7fd0bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.515+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 0x7fd0bc06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c4007000 comp rx=0 tx=0).stop 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.515+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 msgr2=0x7fd0d00a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.515+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0011630 tx=0x7fd0c0011af0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 shutdown_connections 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd0bc06ae70 0x7fd0bc06d330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd0d01507c0 0x7fd0d00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d0150360 0x7fd0d00a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 --2- 172.21.15.93:0/2183470734 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0b8003ef0 0x7fd0d00a9020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 >> 172.21.15.93:0/2183470734 conn(0x7fd0d00ce950 msgr2=0x7fd0d006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 shutdown_connections 2023-11-04T01:36:49.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.516+0000 7fd0d69a9640 1 -- 172.21.15.93:0/2183470734 wait complete. 2023-11-04T01:36:49.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:49.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.629+0000 7f362ca7c640 1 Processor -- start 2023-11-04T01:36:49.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.629+0000 7f362ca7c640 1 -- start start 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362ca7c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 0x7f36280ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362ca7c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f362806a830 0x7f36280722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362ca7c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280ca620 con 0x7f362815e590 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362ca7c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362806e7e0 con 0x7f362806a830 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362ca7c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280cb060 con 0x7f362815e1b0 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f362806a830 0x7f36280722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f362806a830 0x7f36280722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43058/0 (socket says 172.21.15.93:43058) 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 -- 172.21.15.93:0/3117388944 learned_addr learned my addr 172.21.15.93:0/3117388944 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362659c640 1 --2- 172.21.15.93:0/3117388944 >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 0x7f36280ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 -- 172.21.15.93:0/3117388944 >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 msgr2=0x7f36280ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 --2- 172.21.15.93:0/3117388944 >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 0x7f36280ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 -- 172.21.15.93:0/3117388944 >> v1:172.21.15.125:6789/0 conn(0x7f362815e590 legacy=0x7f362806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f3626d9d640 1 -- 172.21.15.93:0/3117388944 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280ca060 con 0x7f362806a830 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.630+0000 7f362659c640 1 --2- 172.21.15.93:0/3117388944 >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 0x7f36280ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.631+0000 7f3626d9d640 1 --2- 172.21.15.93:0/3117388944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280722d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3628067300 tx=0x7f362002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae18b48cf78b1787 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.631+0000 7f3625d9b640 1 -- 172.21.15.93:0/3117388944 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362002c9f0 con 0x7f362806a830 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.631+0000 7f3625d9b640 1 -- 172.21.15.93:0/3117388944 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362002cb50 con 0x7f362806a830 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.631+0000 7f3625d9b640 1 -- 172.21.15.93:0/3117388944 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200343f0 con 0x7f362806a830 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 -- 172.21.15.93:0/3117388944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 msgr2=0x7f36280722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 --2- 172.21.15.93:0/3117388944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280722d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3628067300 tx=0x7f362002be50 comp rx=0 tx=0).stop 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 -- 172.21.15.93:0/3117388944 shutdown_connections 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 --2- 172.21.15.93:0/3117388944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280722d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 --2- 172.21.15.93:0/3117388944 >> v2:172.21.15.125:3300/0 conn(0x7f362815e1b0 0x7f36280ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 -- 172.21.15.93:0/3117388944 >> 172.21.15.93:0/3117388944 conn(0x7f362806d800 msgr2=0x7f362806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 -- 172.21.15.93:0/3117388944 shutdown_connections 2023-11-04T01:36:49.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.632+0000 7f362ca7c640 1 -- 172.21.15.93:0/3117388944 wait complete. 2023-11-04T01:36:49.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.633+0000 7f362ca7c640 1 Processor -- start 2023-11-04T01:36:49.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.633+0000 7f362ca7c640 1 -- start start 2023-11-04T01:36:49.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362815e1b0 0x7f36280b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f362815e590 0x7f362815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280ce640 con 0x7f362806a830 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280cdb20 con 0x7f362815e1b0 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280cdda0 con 0x7f362815e590 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43060/0 (socket says 172.21.15.93:43060) 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 -- 172.21.15.93:0/272077275 learned_addr learned my addr 172.21.15.93:0/272077275 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 -- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f362815e590 msgr2=0x7f362815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f362815e590 0x7f362815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 -- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362815e1b0 msgr2=0x7f36280b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362815e1b0 0x7f36280b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 -- 172.21.15.93:0/272077275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009b30 con 0x7f362806a830 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362659c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f361800c820 tx=0x7f361800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618007a30 con 0x7f362806a830 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618007b90 con 0x7f362806a830 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280ce080 con 0x7f362806a830 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800ce10 con 0x7f362806a830 2023-11-04T01:36:49.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.634+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36280ac970 con 0x7f362806a830 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.635+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362806e3a0 con 0x7f362806a830 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.636+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36180113f0 con 0x7f362806a830 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.636+0000 7f361effd640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 0x7f360806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.636+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3618089ae0 con 0x7f362806a830 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.636+0000 7f361ffff640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 0x7f360806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.637+0000 7f361ffff640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 0x7f360806d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36280c87c0 tx=0x7f36100079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.640+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36180547d0 con 0x7f362806a830 2023-11-04T01:36:49.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.806+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f36280674e0 con 0x7f362806a830 2023-11-04T01:36:49.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.806+0000 7f361effd640 1 -- 172.21.15.93:0/272077275 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3618057df0 con 0x7f362806a830 2023-11-04T01:36:49.808 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 msgr2=0x7f360806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 0x7f360806d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36280c87c0 tx=0x7f36100079b0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 msgr2=0x7f36280cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f361800c820 tx=0x7f361800cce0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 shutdown_connections 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f360806aea0 0x7f360806d360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f362815e590 0x7f362815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362815e1b0 0x7f36280b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 --2- 172.21.15.93:0/272077275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f362806a830 0x7f36280cd5e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 >> 172.21.15.93:0/272077275 conn(0x7f362806d800 msgr2=0x7f36280b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 shutdown_connections 2023-11-04T01:36:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.808+0000 7f362ca7c640 1 -- 172.21.15.93:0/272077275 wait complete. 2023-11-04T01:36:49.820 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:49.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.920+0000 7f445a11d640 1 Processor -- start 2023-11-04T01:36:49.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.920+0000 7f445a11d640 1 -- start start 2023-11-04T01:36:49.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.921+0000 7f445a11d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 0x7f445415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.921+0000 7f445a11d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44540cd6d0 0x7f4454161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.921+0000 7f445a11d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44540cde60 con 0x7f44540b4880 2023-11-04T01:36:49.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.921+0000 7f445a11d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4454160f90 con 0x7f44540cd6d0 2023-11-04T01:36:49.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.921+0000 7f445a11d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445415e400 con 0x7f4454153e60 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44537fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 0x7f445415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f4452ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f44540cd6d0 0x7f4454161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f4453fff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f44540b4880 0x7f445406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:42868/0 (socket says 172.21.15.93:42868) 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f4453fff640 1 -- 172.21.15.93:0/3095089666 learned_addr learned my addr 172.21.15.93:0/3095089666 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44527fc640 1 -- 172.21.15.93:0/3095089666 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688950157 0 0) 0x7f44540cde60 con 0x7f44540b4880 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44537fe640 1 -- 172.21.15.93:0/3095089666 >> v2:172.21.15.125:3300/0 conn(0x7f44540cd6d0 msgr2=0x7f4454161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44537fe640 1 --2- 172.21.15.93:0/3095089666 >> v2:172.21.15.125:3300/0 conn(0x7f44540cd6d0 0x7f4454161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44537fe640 1 -- 172.21.15.93:0/3095089666 >> v1:172.21.15.125:6789/0 conn(0x7f44540b4880 legacy=0x7f445406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.922+0000 7f44537fe640 1 -- 172.21.15.93:0/3095089666 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454161960 con 0x7f4454153e60 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f44537fe640 1 --2- 172.21.15.93:0/3095089666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 0x7f445415dec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f444402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a031980daf32118 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f44527fc640 1 -- 172.21.15.93:0/3095089666 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444031830 con 0x7f4454153e60 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f44527fc640 1 -- 172.21.15.93:0/3095089666 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444031990 con 0x7f4454153e60 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f44527fc640 1 -- 172.21.15.93:0/3095089666 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444031d20 con 0x7f4454153e60 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 -- 172.21.15.93:0/3095089666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 msgr2=0x7f445415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 --2- 172.21.15.93:0/3095089666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 0x7f445415dec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f444402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 -- 172.21.15.93:0/3095089666 shutdown_connections 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 --2- 172.21.15.93:0/3095089666 >> v2:172.21.15.125:3300/0 conn(0x7f44540cd6d0 0x7f4454161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 --2- 172.21.15.93:0/3095089666 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4454153e60 0x7f445415dec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 -- 172.21.15.93:0/3095089666 >> 172.21.15.93:0/3095089666 conn(0x7f44540cf880 msgr2=0x7f44540cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 -- 172.21.15.93:0/3095089666 shutdown_connections 2023-11-04T01:36:49.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.923+0000 7f445a11d640 1 -- 172.21.15.93:0/3095089666 wait complete. 2023-11-04T01:36:49.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 Processor -- start 2023-11-04T01:36:49.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 -- start start 2023-11-04T01:36:49.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44540cd6d0 0x7f44540b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4454153e60 0x7f44540b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44541503f0 con 0x7f44540b4880 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540cbd30 con 0x7f4454153e60 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.925+0000 7f445a11d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540c7ed0 con 0x7f44540cd6d0 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43070/0 (socket says 172.21.15.93:43070) 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 -- 172.21.15.93:0/4222743014 learned_addr learned my addr 172.21.15.93:0/4222743014 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f4453fff640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4454153e60 0x7f44540b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f4452ffd640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44540cd6d0 0x7f44540b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 -- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44540cd6d0 msgr2=0x7f44540b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44540cd6d0 0x7f44540b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 -- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4454153e60 msgr2=0x7f44540b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4454153e60 0x7f44540b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 -- 172.21.15.93:0/4222743014 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009400 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f44537fe640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f44440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444004230 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540c81b0 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444004390 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444403a870 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.926+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540c8770 con 0x7f44540b4880 2023-11-04T01:36:49.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.927+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44540c8960 con 0x7f44540b4880 2023-11-04T01:36:49.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.928+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f444403a9d0 con 0x7f44540b4880 2023-11-04T01:36:49.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.928+0000 7f443bfff640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 0x7f444006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.928+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44440aba10 con 0x7f44540b4880 2023-11-04T01:36:49.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.928+0000 7f4452ffd640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 0x7f444006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.929+0000 7f4452ffd640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 0x7f444006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44540cced0 tx=0x7f4448009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:49.933+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4444076730 con 0x7f44540b4880 2023-11-04T01:36:50.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.109+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4454074290 con 0x7f44540b4880 2023-11-04T01:36:50.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.109+0000 7f443bfff640 1 -- 172.21.15.93:0/4222743014 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4444079d50 con 0x7f44540b4880 2023-11-04T01:36:50.111 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:50.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 msgr2=0x7f444006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 0x7f444006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44540cced0 tx=0x7f4448009190 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 msgr2=0x7f445414feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f44440046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 shutdown_connections 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f444006ae70 0x7f444006d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4454153e60 0x7f44540b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44540cd6d0 0x7f44540b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 --2- 172.21.15.93:0/4222743014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44540b4880 0x7f445414feb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 >> 172.21.15.93:0/4222743014 conn(0x7f44540cf880 msgr2=0x7f44540d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 shutdown_connections 2023-11-04T01:36:50.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.111+0000 7f445a11d640 1 -- 172.21.15.93:0/4222743014 wait complete. 2023-11-04T01:36:50.123 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-04T01:36:50.123 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:50.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:50.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:ceph-fuse[93724]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:50.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi125.stderr:2023-11-04T01:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:50.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:50.207 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:36:50.283 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:50.283 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:50.298 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:50.305 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:50.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:50.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:2023-11-04T01:36:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.490+0000 7f7724456640 1 Processor -- start 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.490+0000 7f7724456640 1 -- start start 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.491+0000 7f7724456640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.491+0000 7f7724456640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.491+0000 7f7724456640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c0cc990 con 0x7f771c0cace0 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.491+0000 7f7724456640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c0ccc70 con 0x7f771c0b0cd0 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.491+0000 7f7724456640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c9ce0 con 0x7f771c0cda60 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77219f1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77229f3640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f771c0cace0 0x7f771c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:42884/0 (socket says 172.21.15.93:42884) 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77219f1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:35634/0 (socket says 172.21.15.93:35634) 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:33676/0 (socket says 172.21.15.93:33676) 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77229f3640 1 -- 172.21.15.93:0/3470079709 learned_addr learned my addr 172.21.15.93:0/3470079709 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 -- 172.21.15.93:0/3470079709 >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 msgr2=0x7f771c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 --2- 172.21.15.93:0/3470079709 >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 -- 172.21.15.93:0/3470079709 >> v1:172.21.15.125:6789/0 conn(0x7f771c0cace0 legacy=0x7f771c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77221f2640 1 -- 172.21.15.93:0/3470079709 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c0c9fc0 con 0x7f771c0cda60 2023-11-04T01:36:50.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.492+0000 7f77219f1640 1 --2- 172.21.15.93:0/3470079709 >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.493+0000 7f77221f2640 1 --2- 172.21.15.93:0/3470079709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77180097a0 tx=0x7f771802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103b23c37465b350 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.493+0000 7f77211f0640 1 -- 172.21.15.93:0/3470079709 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718031830 con 0x7f771c0cda60 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.493+0000 7f77211f0640 1 -- 172.21.15.93:0/3470079709 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718031990 con 0x7f771c0cda60 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.493+0000 7f77211f0640 1 -- 172.21.15.93:0/3470079709 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718031d20 con 0x7f771c0cda60 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 -- 172.21.15.93:0/3470079709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 msgr2=0x7f771c0ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 --2- 172.21.15.93:0/3470079709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77180097a0 tx=0x7f771802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 -- 172.21.15.93:0/3470079709 shutdown_connections 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 --2- 172.21.15.93:0/3470079709 >> v2:172.21.15.125:3300/0 conn(0x7f771c0b0cd0 0x7f771c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 --2- 172.21.15.93:0/3470079709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cda60 0x7f771c0ca7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 -- 172.21.15.93:0/3470079709 >> 172.21.15.93:0/3470079709 conn(0x7f771c0ce950 msgr2=0x7f771c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 -- 172.21.15.93:0/3470079709 shutdown_connections 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.494+0000 7f7724456640 1 -- 172.21.15.93:0/3470079709 wait complete. 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.495+0000 7f7724456640 1 Processor -- start 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.495+0000 7f7724456640 1 -- start start 2023-11-04T01:36:50.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cace0 0x7f771c141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f771c0cda60 0x7f771c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c23e0 con 0x7f771c0b0cd0 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c26c0 con 0x7f771c0cda60 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c29a0 con 0x7f771c0cace0 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43072/0 (socket says 172.21.15.93:43072) 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 -- 172.21.15.93:0/2683782480 learned_addr learned my addr 172.21.15.93:0/2683782480 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77229f3640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f771c0cda60 0x7f771c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77219f1640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cace0 0x7f771c141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 -- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cace0 msgr2=0x7f771c141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cace0 0x7f771c141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 -- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f771c0cda60 msgr2=0x7f771c06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f771c0cda60 0x7f771c06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 -- 172.21.15.93:0/2683782480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009400 con 0x7f771c0b0cd0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f77221f2640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7718000c00 tx=0x7f77180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771803a830 con 0x7f771c0b0cd0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771803a9b0 con 0x7f771c0b0cd0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771803ad60 con 0x7f771c0b0cd0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7718009400 con 0x7f771c0b0cd0 2023-11-04T01:36:50.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.496+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c0c2f60 con 0x7f771c0b0cd0 2023-11-04T01:36:50.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.497+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c074290 con 0x7f771c0b0cd0 2023-11-04T01:36:50.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.498+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f771804d450 con 0x7f771c0b0cd0 2023-11-04T01:36:50.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.498+0000 7f7712ffd640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 0x7f770006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.498+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77180aba30 con 0x7f771c0b0cd0 2023-11-04T01:36:50.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.498+0000 7f77219f1640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 0x7f770006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.499+0000 7f77219f1640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 0x7f770006d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f771c157bb0 tx=0x7f770c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.502+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7718076720 con 0x7f771c0b0cd0 2023-11-04T01:36:50.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.670+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f771c0c9160 con 0x7f771c0b0cd0 2023-11-04T01:36:50.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.672+0000 7f7712ffd640 1 -- 172.21.15.93:0/2683782480 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f7718035090 con 0x7f771c0b0cd0 2023-11-04T01:36:50.673 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:50.673 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:50.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 msgr2=0x7f770006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 0x7f770006d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f771c157bb0 tx=0x7f770c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 msgr2=0x7f771c1573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7718000c00 tx=0x7f77180046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 shutdown_connections 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f770006ae70 0x7f770006d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f771c0cda60 0x7f771c06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f771c0cace0 0x7f771c141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 --2- 172.21.15.93:0/2683782480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f771c0b0cd0 0x7f771c1573f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 >> 172.21.15.93:0/2683782480 conn(0x7f771c0ce950 msgr2=0x7f771c0ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 shutdown_connections 2023-11-04T01:36:50.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.674+0000 7f7724456640 1 -- 172.21.15.93:0/2683782480 wait complete. 2023-11-04T01:36:50.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:50.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:50.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.788+0000 7ffab7807640 1 Processor -- start 2023-11-04T01:36:50.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.788+0000 7ffab7807640 1 -- start start 2023-11-04T01:36:50.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab7807640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffab00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab7807640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffab00c48e0 0x7ffab00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab7807640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab015aff0 con 0x7ffab00adac0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab7807640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00c52a0 con 0x7ffab00c48e0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab7807640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab015a3e0 con 0x7ffab0159c00 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab5da4640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffab00adac0 0x7ffab00adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:60758/0 (socket says 172.21.15.93:60758) 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab5da4640 1 -- 172.21.15.93:0/318565154 learned_addr learned my addr 172.21.15.93:0/318565154 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab55a3640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffab00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffab4da2640 1 --2- 172.21.15.93:0/318565154 >> v2:172.21.15.125:3300/0 conn(0x7ffab00c48e0 0x7ffab00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265118916 0 0) 0x7ffab015aff0 con 0x7ffab00adac0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.789+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9c003520 con 0x7ffab00adac0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188015863 0 0) 0x7ffa9c003520 con 0x7ffab00adac0 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 msgr2=0x7ffab00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffab00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 >> v2:172.21.15.125:3300/0 conn(0x7ffab00c48e0 msgr2=0x7ffab00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 --2- 172.21.15.93:0/318565154 >> v2:172.21.15.125:3300/0 conn(0x7ffab00c48e0 0x7ffab00c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab015a6c0 con 0x7ffab00adac0 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ffaa8001670 con 0x7ffab00adac0 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 >> v1:172.21.15.93:6789/0 conn(0x7ffab00adac0 legacy=0x7ffab00adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9c003970 0x7ffa9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffa9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c004d00 0x7ffa9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c52a0 con 0x7ffa9c003970 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab015a3e0 con 0x7ffa9c004d00 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c00db90 con 0x7ffab0159c00 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9c003970 0x7ffa9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab4da2640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffa9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab5da4640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c004d00 0x7ffa9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 -- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 msgr2=0x7ffa9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffa9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 -- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c004d00 msgr2=0x7ffa9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c004d00 0x7ffa9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab55a3640 1 -- 172.21.15.93:0/318565154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c003520 con 0x7ffa9c003970 2023-11-04T01:36:50.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.790+0000 7ffab4da2640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0159c00 0x7ffa9c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:50.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffab55a3640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9c003970 0x7ffa9c003d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009fc0 tx=0x7ffa9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df037caf40023d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac02cc20 con 0x7ffa9c003970 2023-11-04T01:36:50.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00f040 con 0x7ffa9c003970 2023-11-04T01:36:50.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffaa7fff640 1 -- 172.21.15.93:0/318565154 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac034440 con 0x7ffa9c003970 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffab7807640 1 -- 172.21.15.93:0/318565154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9c003970 msgr2=0x7ffa9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.791+0000 7ffab7807640 1 --2- 172.21.15.93:0/318565154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9c003970 0x7ffa9c003d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009fc0 tx=0x7ffa9c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.792+0000 7ffab5da4640 1 -- 172.21.15.93:0/318565154 reap_dead start 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.792+0000 7ffab7807640 1 -- 172.21.15.93:0/318565154 shutdown_connections 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.792+0000 7ffab7807640 1 -- 172.21.15.93:0/318565154 >> 172.21.15.93:0/318565154 conn(0x7ffab00ce950 msgr2=0x7ffab00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.792+0000 7ffab7807640 1 -- 172.21.15.93:0/318565154 shutdown_connections 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.792+0000 7ffab7807640 1 -- 172.21.15.93:0/318565154 wait complete. 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.793+0000 7ffab7807640 1 Processor -- start 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.793+0000 7ffab7807640 1 -- start start 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.793+0000 7ffab7807640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c003970 0x7ffab00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.793+0000 7ffab7807640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0153e80 0x7ffab0154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab014bbe0 con 0x7ffab01f2020 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0154840 con 0x7ffa9c003970 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab014afd0 con 0x7ffab0153e80 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43098/0 (socket says 172.21.15.93:43098) 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 -- 172.21.15.93:0/2683937677 learned_addr learned my addr 172.21.15.93:0/2683937677 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab5da4640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0153e80 0x7ffab0154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab55a3640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c003970 0x7ffab00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 -- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0153e80 msgr2=0x7ffab0154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0153e80 0x7ffab0154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 -- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c003970 msgr2=0x7ffab00c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c003970 0x7ffab00c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 -- 172.21.15.93:0/2683937677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab014b240 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab4da2640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00116d0 tx=0x7ffaa0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000f9c0 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000fb20 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab014b520 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000feb0 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.794+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab014e690 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.795+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab0074290 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.796+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffaa0015460 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.796+0000 7ffaa5ffb640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 0x7ffa9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.796+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffaa008a1b0 con 0x7ffab01f2020 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.796+0000 7ffab55a3640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 0x7ffa9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.797+0000 7ffab55a3640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 0x7ffa9406d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaac036000 tx=0x7ffaac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.800+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffaa0054f30 con 0x7ffab01f2020 2023-11-04T01:36:50.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:50.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:50.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.966+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffab006e4c0 con 0x7ffab01f2020 2023-11-04T01:36:50.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.967+0000 7ffaa5ffb640 1 -- 172.21.15.93:0/2683937677 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffaa0058550 con 0x7ffab01f2020 2023-11-04T01:36:50.968 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 msgr2=0x7ffa9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 0x7ffa9406d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaac036000 tx=0x7ffaac02e000 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 msgr2=0x7ffab0150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00116d0 tx=0x7ffaa0011b90 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 shutdown_connections 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffa9406ae70 0x7ffa9406d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab0153e80 0x7ffab0154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab01f2020 0x7ffab0150fc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 --2- 172.21.15.93:0/2683937677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa9c003970 0x7ffab00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 >> 172.21.15.93:0/2683937677 conn(0x7ffab00ce950 msgr2=0x7ffab00adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 shutdown_connections 2023-11-04T01:36:50.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:50.969+0000 7ffab7807640 1 -- 172.21.15.93:0/2683937677 wait complete. 2023-11-04T01:36:50.981 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:51.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.155+0000 7f3b394ec640 1 Processor -- start 2023-11-04T01:36:51.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.155+0000 7f3b394ec640 1 -- start start 2023-11-04T01:36:51.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b394ec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 0x7f3b340b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b394ec640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 0x7f3b3406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b394ec640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340b2fc0 con 0x7f3b3406c1d0 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b394ec640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340cb580 con 0x7f3b340b2b60 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b394ec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3406ca40 con 0x7f3b34160430 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b32ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 0x7f3b340b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b327fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 0x7f3b3406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b337fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3b3406c1d0 0x7f3b34160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:42886/0 (socket says 172.21.15.93:42886) 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.156+0000 7f3b337fe640 1 -- 172.21.15.93:0/3319770634 learned_addr learned my addr 172.21.15.93:0/3319770634 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b31ffb640 1 -- 172.21.15.93:0/3319770634 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573312953 0 0) 0x7f3b340b2fc0 con 0x7f3b3406c1d0 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b31ffb640 1 -- 172.21.15.93:0/3319770634 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c003520 con 0x7f3b3406c1d0 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b32ffd640 1 -- 172.21.15.93:0/3319770634 >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 msgr2=0x7f3b3406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b32ffd640 1 --2- 172.21.15.93:0/3319770634 >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 0x7f3b3406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b32ffd640 1 -- 172.21.15.93:0/3319770634 >> v1:172.21.15.125:6789/0 conn(0x7f3b3406c1d0 legacy=0x7f3b34160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b32ffd640 1 -- 172.21.15.93:0/3319770634 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3406cd20 con 0x7f3b34160430 2023-11-04T01:36:51.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.157+0000 7f3b327fc640 1 --2- 172.21.15.93:0/3319770634 >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 0x7f3b3406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b32ffd640 1 --2- 172.21.15.93:0/3319770634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 0x7f3b340b2620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce3c2468641f3d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b31ffb640 1 -- 172.21.15.93:0/3319770634 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24031830 con 0x7f3b34160430 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b31ffb640 1 -- 172.21.15.93:0/3319770634 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24031990 con 0x7f3b34160430 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b31ffb640 1 -- 172.21.15.93:0/3319770634 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24031d00 con 0x7f3b34160430 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 -- 172.21.15.93:0/3319770634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 msgr2=0x7f3b340b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 --2- 172.21.15.93:0/3319770634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 0x7f3b340b2620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 -- 172.21.15.93:0/3319770634 shutdown_connections 2023-11-04T01:36:51.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 --2- 172.21.15.93:0/3319770634 >> v2:172.21.15.125:3300/0 conn(0x7f3b340b2b60 0x7f3b3406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 --2- 172.21.15.93:0/3319770634 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b34160430 0x7f3b340b2620 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 -- 172.21.15.93:0/3319770634 >> 172.21.15.93:0/3319770634 conn(0x7f3b3406ea20 msgr2=0x7f3b3406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 -- 172.21.15.93:0/3319770634 shutdown_connections 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.158+0000 7f3b394ec640 1 -- 172.21.15.93:0/3319770634 wait complete. 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 Processor -- start 2023-11-04T01:36:51.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 -- start start 2023-11-04T01:36:51.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3406c1d0 0x7f3b341f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b34160430 0x7f3b340b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b341f0570 con 0x7f3b340b2b60 2023-11-04T01:36:51.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b49e0 con 0x7f3b34160430 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b394ec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b4c30 con 0x7f3b3406c1d0 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b327fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b327fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43114/0 (socket says 172.21.15.93:43114) 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b327fc640 1 -- 172.21.15.93:0/4163337758 learned_addr learned my addr 172.21.15.93:0/4163337758 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b32ffd640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3406c1d0 0x7f3b341f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.160+0000 7f3b337fe640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b34160430 0x7f3b340b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 -- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3406c1d0 msgr2=0x7f3b341f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3406c1d0 0x7f3b341f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 -- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b34160430 msgr2=0x7f3b340b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b34160430 0x7f3b340b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 -- 172.21.15.93:0/4163337758 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009400 con 0x7f3b340b2b60 2023-11-04T01:36:51.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b327fc640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800ebe0 tx=0x7f3b2800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28009760 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b24009400 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800cc30 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800eee0 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.161+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b340b51f0 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.162+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b34074290 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.162+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b28013470 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.163+0000 7f3b1b7fe640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 0x7f3b2006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.163+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b28089ce0 con 0x7f3b340b2b60 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.163+0000 7f3b32ffd640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 0x7f3b2006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.163+0000 7f3b32ffd640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 0x7f3b2006d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b24036000 tx=0x7f3b2403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.167+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b28054a00 con 0x7f3b340b2b60 2023-11-04T01:36:51.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.333+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b340b6b20 con 0x7f3b340b2b60 2023-11-04T01:36:51.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.333+0000 7f3b1b7fe640 1 -- 172.21.15.93:0/4163337758 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b28058020 con 0x7f3b340b2b60 2023-11-04T01:36:51.334 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:51.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 msgr2=0x7f3b2006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 0x7f3b2006d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b24036000 tx=0x7f3b2403c040 comp rx=0 tx=0).stop 2023-11-04T01:36:51.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 msgr2=0x7f3b340c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800ebe0 tx=0x7f3b2800c520 comp rx=0 tx=0).stop 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 shutdown_connections 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b2006aea0 0x7f3b2006d360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b34160430 0x7f3b340b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b340b2b60 0x7f3b340c6c40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 --2- 172.21.15.93:0/4163337758 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3b3406c1d0 0x7f3b341f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 >> 172.21.15.93:0/4163337758 conn(0x7f3b3406ea20 msgr2=0x7f3b340cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 shutdown_connections 2023-11-04T01:36:51.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.335+0000 7f3b394ec640 1 -- 172.21.15.93:0/4163337758 wait complete. 2023-11-04T01:36:51.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:51.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.449+0000 7f66e7826640 1 Processor -- start 2023-11-04T01:36:51.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.449+0000 7f66e7826640 1 -- start start 2023-11-04T01:36:51.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e7826640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f66e00c4ff0 0x7f66e00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e7826640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 0x7f66e00adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e7826640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e015aff0 con 0x7f66e0159c00 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e7826640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e00ae460 con 0x7f66e00c4ff0 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e7826640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e015a3e0 con 0x7f66e00adac0 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e4dc1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f66e00c4ff0 0x7f66e00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e55c2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f66e0159c00 0x7f66e00c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44376/0 (socket says 172.21.15.93:44376) 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e55c2640 1 -- 172.21.15.93:0/3665849680 learned_addr learned my addr 172.21.15.93:0/3665849680 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e5dc3640 1 --2- 172.21.15.93:0/3665849680 >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 0x7f66e00adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e4dc1640 1 -- 172.21.15.93:0/3665849680 >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 msgr2=0x7f66e00adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e4dc1640 1 --2- 172.21.15.93:0/3665849680 >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 0x7f66e00adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e4dc1640 1 -- 172.21.15.93:0/3665849680 >> v1:172.21.15.93:6789/0 conn(0x7f66e0159c00 legacy=0x7f66e00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e4dc1640 1 -- 172.21.15.93:0/3665849680 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e015a6c0 con 0x7f66e00c4ff0 2023-11-04T01:36:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.450+0000 7f66e5dc3640 1 --2- 172.21.15.93:0/3665849680 >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 0x7f66e00adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66e4dc1640 1 --2- 172.21.15.93:0/3665849680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00c4ff0 0x7f66e00cc890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f66e00c59a0 tx=0x7f66d002e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d894cb24befa1658 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66d7fff640 1 -- 172.21.15.93:0/3665849680 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d002ee50 con 0x7f66e00c4ff0 2023-11-04T01:36:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66d7fff640 1 -- 172.21.15.93:0/3665849680 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0036440 con 0x7f66e00c4ff0 2023-11-04T01:36:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66d7fff640 1 -- 172.21.15.93:0/3665849680 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00367d0 con 0x7f66e00c4ff0 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66e7826640 1 -- 172.21.15.93:0/3665849680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00c4ff0 msgr2=0x7f66e00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.451+0000 7f66e7826640 1 --2- 172.21.15.93:0/3665849680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00c4ff0 0x7f66e00cc890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f66e00c59a0 tx=0x7f66d002e0a0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 -- 172.21.15.93:0/3665849680 shutdown_connections 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 --2- 172.21.15.93:0/3665849680 >> v2:172.21.15.125:3300/0 conn(0x7f66e00adac0 0x7f66e00adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 --2- 172.21.15.93:0/3665849680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00c4ff0 0x7f66e00cc890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 -- 172.21.15.93:0/3665849680 >> 172.21.15.93:0/3665849680 conn(0x7f66e00ce950 msgr2=0x7f66e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 -- 172.21.15.93:0/3665849680 shutdown_connections 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.452+0000 7f66e7826640 1 -- 172.21.15.93:0/3665849680 wait complete. 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 Processor -- start 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 -- start start 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66e00c4ff0 0x7f66e014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 0x7f66e014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c6970 con 0x7f66e00adac0 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e014da90 con 0x7f66e00c4ff0 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.453+0000 7f66e7826640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c7420 con 0x7f66e0159c00 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38058/0 (socket says 172.21.15.93:38058) 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 -- 172.21.15.93:0/565434399 learned_addr learned my addr 172.21.15.93:0/565434399 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e4dc1640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66e00c4ff0 0x7f66e014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e5dc3640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 0x7f66e014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 -- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 msgr2=0x7f66e014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 0x7f66e014a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 -- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66e00c4ff0 msgr2=0x7f66e014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66e00c4ff0 0x7f66e014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 -- 172.21.15.93:0/565434399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d000b6a0 con 0x7f66e00adac0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e5dc3640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 0x7f66e014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e55c2640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00c480 tx=0x7f66dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc005ce0 con 0x7f66e00adac0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc005e40 con 0x7f66e00adac0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0072f0 con 0x7f66e00adac0 2023-11-04T01:36:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00c6b80 con 0x7f66e00adac0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.454+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00c7140 con 0x7f66e00adac0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.455+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0074290 con 0x7f66e00adac0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.455+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66dc007510 con 0x7f66e00adac0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.456+0000 7f66d5ffb640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 0x7f66c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.456+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66dc088e00 con 0x7f66e00adac0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.456+0000 7f66e4dc1640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 0x7f66c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.456+0000 7f66e4dc1640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 0x7f66c406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66d0038000 tx=0x7f66d0032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.460+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66dc053c30 con 0x7f66e00adac0 2023-11-04T01:36:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.624+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66e015c9b0 con 0x7f66e00adac0 2023-11-04T01:36:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.625+0000 7f66d5ffb640 1 -- 172.21.15.93:0/565434399 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66dc017020 con 0x7f66e00adac0 2023-11-04T01:36:51.626 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:51.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 msgr2=0x7f66c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 0x7f66c406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66d0038000 tx=0x7f66d0032000 comp rx=0 tx=0).stop 2023-11-04T01:36:51.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 msgr2=0x7f66e00c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00c480 tx=0x7f66dc00c940 comp rx=0 tx=0).stop 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 shutdown_connections 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f66c406ae70 0x7f66c406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66e0159c00 0x7f66e014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66e00c4ff0 0x7f66e014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 --2- 172.21.15.93:0/565434399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66e00adac0 0x7f66e00c6430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 >> 172.21.15.93:0/565434399 conn(0x7f66e00ce950 msgr2=0x7f66e00cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 shutdown_connections 2023-11-04T01:36:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.627+0000 7f66e7826640 1 -- 172.21.15.93:0/565434399 wait complete. 2023-11-04T01:36:51.639 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:51.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.739+0000 7fae557ee640 1 Processor -- start 2023-11-04T01:36:51.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.739+0000 7fae557ee640 1 -- start start 2023-11-04T01:36:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae557ee640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fae50153e60 0x7fae5015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae557ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae500b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae557ee640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500cde60 con 0x7fae500cd6d0 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae557ee640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae50160f90 con 0x7fae50153e60 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae557ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500b5200 con 0x7fae500b4880 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae4effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fae50153e60 0x7fae5015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae4effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fae50153e60 0x7fae5015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38064/0 (socket says 172.21.15.93:38064) 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae4e7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fae500cd6d0 0x7fae50161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44392/0 (socket says 172.21.15.93:44392) 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.740+0000 7fae4effd640 1 -- 172.21.15.93:0/88858141 learned_addr learned my addr 172.21.15.93:0/88858141 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4f7fe640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae500b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4effd640 1 -- 172.21.15.93:0/88858141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 msgr2=0x7fae500b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4effd640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae500b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4effd640 1 -- 172.21.15.93:0/88858141 >> v1:172.21.15.93:6789/0 conn(0x7fae500cd6d0 legacy=0x7fae50161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4effd640 1 -- 172.21.15.93:0/88858141 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5015e400 con 0x7fae50153e60 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4dffb640 1 -- 172.21.15.93:0/88858141 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155062055 0 0) 0x7fae500cde60 con 0x7fae500cd6d0 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4f7fe640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae500b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.741+0000 7fae4effd640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae50153e60 0x7fae5015dec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fae40009e50 tx=0x7fae4002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b1a3adb61e22e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae4dffb640 1 -- 172.21.15.93:0/88858141 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4002cb00 con 0x7fae50153e60 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae4dffb640 1 -- 172.21.15.93:0/88858141 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4002cc60 con 0x7fae50153e60 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae4dffb640 1 -- 172.21.15.93:0/88858141 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae400343f0 con 0x7fae50153e60 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 -- 172.21.15.93:0/88858141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae50153e60 msgr2=0x7fae5015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae50153e60 0x7fae5015dec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fae40009e50 tx=0x7fae4002bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 -- 172.21.15.93:0/88858141 shutdown_connections 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae500b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 --2- 172.21.15.93:0/88858141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae50153e60 0x7fae5015dec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 -- 172.21.15.93:0/88858141 >> 172.21.15.93:0/88858141 conn(0x7fae500cf880 msgr2=0x7fae500cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 -- 172.21.15.93:0/88858141 shutdown_connections 2023-11-04T01:36:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.742+0000 7fae557ee640 1 -- 172.21.15.93:0/88858141 wait complete. 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.743+0000 7fae557ee640 1 Processor -- start 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.743+0000 7fae557ee640 1 -- start start 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae501534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae50153e60 0x7fae500cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c9f70 con 0x7fae500cd6d0 2023-11-04T01:36:51.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca250 con 0x7fae50153e60 2023-11-04T01:36:51.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae557ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca530 con 0x7fae500b4880 2023-11-04T01:36:51.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae4e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae4e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38078/0 (socket says 172.21.15.93:38078) 2023-11-04T01:36:51.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae4e7fc640 1 -- 172.21.15.93:0/1511621202 learned_addr learned my addr 172.21.15.93:0/1511621202 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae4effd640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae501534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.744+0000 7fae4f7fe640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae50153e60 0x7fae500cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 -- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 msgr2=0x7fae501534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae501534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 -- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae50153e60 msgr2=0x7fae500cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae50153e60 0x7fae500cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 -- 172.21.15.93:0/1511621202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40009b30 con 0x7fae500cd6d0 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae4e7fc640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c4b0 tx=0x7fae4400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440074e0 con 0x7fae500cd6d0 2023-11-04T01:36:51.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44007660 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44004a20 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500ca810 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.745+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500cc460 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.746+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50074290 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.746+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae44004b80 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.747+0000 7fae377fe640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 0x7fae3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.747+0000 7fae4effd640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 0x7fae3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.747+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fae44088a80 con 0x7fae500cd6d0 2023-11-04T01:36:51.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.747+0000 7fae4effd640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 0x7fae3c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae40035000 tx=0x7fae40030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:51.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.751+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae440538e0 con 0x7fae500cd6d0 2023-11-04T01:36:51.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.916+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fae5015c9a0 con 0x7fae500cd6d0 2023-11-04T01:36:51.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.917+0000 7fae377fe640 1 -- 172.21.15.93:0/1511621202 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fae44018020 con 0x7fae500cd6d0 2023-11-04T01:36:51.918 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 msgr2=0x7fae3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 0x7fae3c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae40035000 tx=0x7fae40030000 comp rx=0 tx=0).stop 2023-11-04T01:36:51.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 msgr2=0x7fae500cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c4b0 tx=0x7fae4400c970 comp rx=0 tx=0).stop 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 shutdown_connections 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae3c06ae70 0x7fae3c06d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae50153e60 0x7fae500cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae500cd6d0 0x7fae500cbf20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 --2- 172.21.15.93:0/1511621202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fae500b4880 0x7fae501534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 >> 172.21.15.93:0/1511621202 conn(0x7fae500cf880 msgr2=0x7fae500b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 shutdown_connections 2023-11-04T01:36:51.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:51.919+0000 7fae557ee640 1 -- 172.21.15.93:0/1511621202 wait complete. 2023-11-04T01:36:51.931 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:52.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.038+0000 7fe8ddea2640 1 Processor -- start 2023-11-04T01:36:52.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.038+0000 7fe8ddea2640 1 -- start start 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8ddea2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 0x7fe8d80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8ddea2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80cde60 con 0x7fe8d8153e60 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8ddea2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d8160f90 con 0x7fe8d80cd6d0 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8ddea2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80b5200 con 0x7fe8d80b4880 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8d77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe8d8153e60 0x7fe8d815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44406/0 (socket says 172.21.15.93:44406) 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8d77fe640 1 -- 172.21.15.93:0/3663658110 learned_addr learned my addr 172.21.15.93:0/3663658110 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.039+0000 7fe8d7fff640 1 --2- 172.21.15.93:0/3663658110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 0x7fe8d80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991053639 0 0) 0x7fe8d80cde60 con 0x7fe8d8153e60 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c0003520 con 0x7fe8d8153e60 2023-11-04T01:36:52.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115859868 0 0) 0x7fe8d8160f90 con 0x7fe8d80cd6d0 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d80cde60 con 0x7fe8d80cd6d0 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d7fff640 1 -- 172.21.15.93:0/3663658110 >> v1:172.21.15.125:6789/0 conn(0x7fe8d80cd6d0 legacy=0x7fe8d8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d7fff640 1 -- 172.21.15.93:0/3663658110 >> v1:172.21.15.93:6789/0 conn(0x7fe8d8153e60 legacy=0x7fe8d815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d7fff640 1 -- 172.21.15.93:0/3663658110 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80ce090 con 0x7fe8d80b4880 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.040+0000 7fe8d7fff640 1 --2- 172.21.15.93:0/3663658110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 0x7fe8d80b4cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009dc0 tx=0x7fe8d002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90870628df3122a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d002ccd0 con 0x7fe8d80b4880 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d002ce30 con 0x7fe8d80b4880 2023-11-04T01:36:52.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8d67fc640 1 -- 172.21.15.93:0/3663658110 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0034640 con 0x7fe8d80b4880 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3663658110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 msgr2=0x7fe8d80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3663658110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 0x7fe8d80b4cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009dc0 tx=0x7fe8d002bf20 comp rx=0 tx=0).stop 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3663658110 shutdown_connections 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3663658110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80b4880 0x7fe8d80b4cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3663658110 >> 172.21.15.93:0/3663658110 conn(0x7fe8d80cf880 msgr2=0x7fe8d80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3663658110 shutdown_connections 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.041+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3663658110 wait complete. 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.042+0000 7fe8ddea2640 1 Processor -- start 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 -- start start 2023-11-04T01:36:52.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 0x7fe8d81506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 0x7fe8d815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8159eb0 con 0x7fe8d80b4880 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c9650 con 0x7fe8d8153e60 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8ddea2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d815a170 con 0x7fe8d80cd6d0 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8d77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8d6ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 0x7fe8d81506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8d77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38086/0 (socket says 172.21.15.93:38086) 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8d77fe640 1 -- 172.21.15.93:0/3332320429 learned_addr learned my addr 172.21.15.93:0/3332320429 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:52.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.043+0000 7fe8d7fff640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 0x7fe8d815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 -- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 msgr2=0x7fe8d81506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 0x7fe8d81506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 -- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 msgr2=0x7fe8d815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 0x7fe8d815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 -- 172.21.15.93:0/3332320429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009a70 con 0x7fe8d80b4880 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d6ffd640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 0x7fe8d81506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d7fff640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 0x7fe8d815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8d77fe640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c410 tx=0x7fe8c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8005ce0 con 0x7fe8d80b4880 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8005e40 con 0x7fe8d80b4880 2023-11-04T01:36:52.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d815a450 con 0x7fe8d80b4880 2023-11-04T01:36:52.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80072f0 con 0x7fe8d80b4880 2023-11-04T01:36:52.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.044+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d8157e10 con 0x7fe8d80b4880 2023-11-04T01:36:52.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.045+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8074290 con 0x7fe8d80b4880 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.045+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8c8007450 con 0x7fe8d80b4880 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.046+0000 7fe8bffff640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 0x7fe8c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.046+0000 7fe8d6ffd640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 0x7fe8c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.046+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe8c8088ef0 con 0x7fe8d80b4880 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.046+0000 7fe8d6ffd640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 0x7fe8c406d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007fd0 tx=0x7fe8cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.050+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8c8053de0 con 0x7fe8d80b4880 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.235+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8d80d0b80 con 0x7fe8d80b4880 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.235+0000 7fe8bffff640 1 -- 172.21.15.93:0/3332320429 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8c8017080 con 0x7fe8d80b4880 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:52.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 msgr2=0x7fe8c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 0x7fe8c406d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007fd0 tx=0x7fe8cc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 msgr2=0x7fe8d8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c410 tx=0x7fe8c800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 shutdown_connections 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe8c406aea0 0x7fe8c406d360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8d8153e60 0x7fe8d815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe8d80cd6d0 0x7fe8d81506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 --2- 172.21.15.93:0/3332320429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8d80b4880 0x7fe8d8160030 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 >> 172.21.15.93:0/3332320429 conn(0x7fe8d80cf880 msgr2=0x7fe8d815d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 shutdown_connections 2023-11-04T01:36:52.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.237+0000 7fe8ddea2640 1 -- 172.21.15.93:0/3332320429 wait complete. 2023-11-04T01:36:52.249 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:36:52.249 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:52.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:52.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.403+0000 7fcfaa844640 1 Processor -- start 2023-11-04T01:36:52.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 -- start start 2023-11-04T01:36:52.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcfa4157540 0x7fcfa40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa415e000 con 0x7fcfa40cde60 2023-11-04T01:36:52.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa415e5c0 con 0x7fcfa4157540 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfaa844640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415e2e0 con 0x7fcfa40ce240 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfa8de1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcfa4157540 0x7fcfa40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfa3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcfa40cde60 0x7fcfa415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44410/0 (socket says 172.21.15.93:44410) 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfa3fff640 1 -- 172.21.15.93:0/2155944743 learned_addr learned my addr 172.21.15.93:0/2155944743 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfa8de1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcfa4157540 0x7fcfa40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38096/0 (socket says 172.21.15.93:38096) 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.404+0000 7fcfa37fe640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa8de1640 1 -- 172.21.15.93:0/2155944743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 msgr2=0x7fcfa4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa8de1640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa8de1640 1 -- 172.21.15.93:0/2155944743 >> v1:172.21.15.93:6789/0 conn(0x7fcfa40cde60 legacy=0x7fcfa415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa8de1640 1 -- 172.21.15.93:0/2155944743 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40d1120 con 0x7fcfa4157540 2023-11-04T01:36:52.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa2ffd640 1 -- 172.21.15.93:0/2155944743 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356256831 0 0) 0x7fcfa415e000 con 0x7fcfa40cde60 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.405+0000 7fcfa8de1640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa4157540 0x7fcfa40d1920 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009d90 tx=0x7fcf9c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6442ff5344083e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfa2ffd640 1 -- 172.21.15.93:0/2155944743 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c02cc50 con 0x7fcfa4157540 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfa2ffd640 1 -- 172.21.15.93:0/2155944743 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c02cdb0 con 0x7fcfa4157540 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfa2ffd640 1 -- 172.21.15.93:0/2155944743 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c034660 con 0x7fcfa4157540 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 -- 172.21.15.93:0/2155944743 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa4157540 msgr2=0x7fcfa40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa4157540 0x7fcfa40d1920 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009d90 tx=0x7fcf9c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 -- 172.21.15.93:0/2155944743 shutdown_connections 2023-11-04T01:36:52.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa4157540 0x7fcfa40d1920 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 --2- 172.21.15.93:0/2155944743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 -- 172.21.15.93:0/2155944743 >> 172.21.15.93:0/2155944743 conn(0x7fcfa4071f30 msgr2=0x7fcfa40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 -- 172.21.15.93:0/2155944743 shutdown_connections 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.406+0000 7fcfaa844640 1 -- 172.21.15.93:0/2155944743 wait complete. 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.407+0000 7fcfaa844640 1 Processor -- start 2023-11-04T01:36:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 -- start start 2023-11-04T01:36:52.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 0x7fcfa40c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4157b30 con 0x7fcfa40cde60 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa41583d0 con 0x7fcfa4157540 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfaa844640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415c7c0 con 0x7fcfa40ce240 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa8de1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 0x7fcfa40c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38098/0 (socket says 172.21.15.93:38098) 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa415be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:56688/0 (socket says 172.21.15.93:56688) 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.408+0000 7fcfa3fff640 1 -- 172.21.15.93:0/1793413585 learned_addr learned my addr 172.21.15.93:0/1793413585 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 -- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 msgr2=0x7fcfa415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 -- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 msgr2=0x7fcfa40c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 0x7fcfa40c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 -- 172.21.15.93:0/1793413585 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009a70 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa8de1640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 0x7fcfa40c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa3fff640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c500 tx=0x7fcf9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94007560 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940047e0 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4157d80 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004b90 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.409+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa41f24d0 con 0x7fcfa40cde60 2023-11-04T01:36:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.410+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40d0360 con 0x7fcfa40cde60 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.410+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf94004cf0 con 0x7fcfa40cde60 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.411+0000 7fcfa0ff9640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 0x7fcf9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.411+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf94088da0 con 0x7fcfa40cde60 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.411+0000 7fcfa37fe640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 0x7fcf9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.411+0000 7fcfa37fe640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 0x7fcf9006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40c8c10 tx=0x7fcf98009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.415+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf94053bd0 con 0x7fcfa40cde60 2023-11-04T01:36:52.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.586+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa4074290 con 0x7fcfa40cde60 2023-11-04T01:36:52.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.587+0000 7fcfa0ff9640 1 -- 172.21.15.93:0/1793413585 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7fcf94018020 con 0x7fcfa40cde60 2023-11-04T01:36:52.589 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:52.589 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 msgr2=0x7fcf9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 0x7fcf9006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40c8c10 tx=0x7fcf98009190 comp rx=0 tx=0).stop 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 msgr2=0x7fcfa41f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c500 tx=0x7fcf9400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 shutdown_connections 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf9006ae70 0x7fcf9006d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfa4157540 0x7fcfa40c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfa40ce240 0x7fcfa415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 --2- 172.21.15.93:0/1793413585 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa40cde60 0x7fcfa41f1f90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 >> 172.21.15.93:0/1793413585 conn(0x7fcfa4071f30 msgr2=0x7fcfa4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 shutdown_connections 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.589+0000 7fcfaa844640 1 -- 172.21.15.93:0/1793413585 wait complete. 2023-11-04T01:36:52.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:52.602 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:52.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.703+0000 7f11ca032640 1 Processor -- start 2023-11-04T01:36:52.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 -- start start 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11c40cd6d0 0x7f11c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f11c40b4880 0x7f11c40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c40cde60 con 0x7f11c4153e60 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c4160f90 con 0x7f11c40b4880 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11ca032640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c4161960 con 0x7f11c40cd6d0 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f11c40b4880 0x7f11c40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f11c40b4880 0x7f11c40b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38108/0 (socket says 172.21.15.93:38108) 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.704+0000 7f11c3fff640 1 -- 172.21.15.93:0/589866525 learned_addr learned my addr 172.21.15.93:0/589866525 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c2ffd640 1 --2- 172.21.15.93:0/589866525 >> v2:172.21.15.125:3300/0 conn(0x7f11c40cd6d0 0x7f11c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c3fff640 1 -- 172.21.15.93:0/589866525 >> v2:172.21.15.125:3300/0 conn(0x7f11c40cd6d0 msgr2=0x7f11c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c3fff640 1 --2- 172.21.15.93:0/589866525 >> v2:172.21.15.125:3300/0 conn(0x7f11c40cd6d0 0x7f11c4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c3fff640 1 -- 172.21.15.93:0/589866525 >> v1:172.21.15.125:6789/0 conn(0x7f11c4153e60 legacy=0x7f11c415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c3fff640 1 -- 172.21.15.93:0/589866525 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40b5220 con 0x7f11c40b4880 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.705+0000 7f11c3fff640 1 --2- 172.21.15.93:0/589866525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40b4880 0x7f11c40b4ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9e80 tx=0x7f11bc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9812109033b522cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11c27fc640 1 -- 172.21.15.93:0/589866525 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc02cb20 con 0x7f11c40b4880 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11c27fc640 1 -- 172.21.15.93:0/589866525 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc02cc80 con 0x7f11c40b4880 2023-11-04T01:36:52.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11c27fc640 1 -- 172.21.15.93:0/589866525 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0343f0 con 0x7f11c40b4880 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 -- 172.21.15.93:0/589866525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40b4880 msgr2=0x7f11c40b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 --2- 172.21.15.93:0/589866525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40b4880 0x7f11c40b4ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9e80 tx=0x7f11bc02bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 -- 172.21.15.93:0/589866525 shutdown_connections 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 --2- 172.21.15.93:0/589866525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40b4880 0x7f11c40b4ce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 --2- 172.21.15.93:0/589866525 >> v2:172.21.15.125:3300/0 conn(0x7f11c40cd6d0 0x7f11c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 -- 172.21.15.93:0/589866525 >> 172.21.15.93:0/589866525 conn(0x7f11c40cf880 msgr2=0x7f11c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 -- 172.21.15.93:0/589866525 shutdown_connections 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.706+0000 7f11ca032640 1 -- 172.21.15.93:0/589866525 wait complete. 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.707+0000 7f11ca032640 1 Processor -- start 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 -- start start 2023-11-04T01:36:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 0x7f11c41f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4153e60 0x7f11c41f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f6f10 con 0x7f11c40cd6d0 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f29a0 con 0x7f11c40b4880 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11ca032640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f38f0 con 0x7f11c4153e60 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11c2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11c2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38124/0 (socket says 172.21.15.93:38124) 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11c2ffd640 1 -- 172.21.15.93:0/2354104028 learned_addr learned my addr 172.21.15.93:0/2354104028 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.708+0000 7f11c37fe640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 0x7f11c41f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 -- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4153e60 msgr2=0x7f11c41f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4153e60 0x7f11c41f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 -- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 msgr2=0x7f11c41f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 0x7f11c41f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 -- 172.21.15.93:0/2354104028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009b30 con 0x7f11c40cd6d0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c37fe640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 0x7f11c41f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11c2ffd640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f11b800e9b0 tx=0x7f11b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8009670 con 0x7f11c40cd6d0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800c9a0 con 0x7f11c40cd6d0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c41f6950 con 0x7f11c40cd6d0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800cd50 con 0x7f11c40cd6d0 2023-11-04T01:36:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.709+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c41f2e90 con 0x7f11c40cd6d0 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.710+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c41f6d40 con 0x7f11c40cd6d0 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.710+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11b8013470 con 0x7f11c40cd6d0 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.710+0000 7f11abfff640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.711+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11b8089b90 con 0x7f11c40cd6d0 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.711+0000 7f11c37fe640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.711+0000 7f11c37fe640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 0x7f11b006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000f60 tx=0x7f11b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.715+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11b8054910 con 0x7f11c40cd6d0 2023-11-04T01:36:52.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.879+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11c4074290 con 0x7f11c40cd6d0 2023-11-04T01:36:52.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.879+0000 7f11abfff640 1 -- 172.21.15.93:0/2354104028 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11b80170a0 con 0x7f11c40cd6d0 2023-11-04T01:36:52.881 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 msgr2=0x7f11b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 0x7f11b006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000f60 tx=0x7f11b4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 msgr2=0x7f11c40c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f11b800e9b0 tx=0x7f11b800ee70 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 shutdown_connections 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c4153e60 0x7f11c41f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11c40cd6d0 0x7f11c40c9040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 --2- 172.21.15.93:0/2354104028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c40b4880 0x7f11c41f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 >> 172.21.15.93:0/2354104028 conn(0x7f11c40cf880 msgr2=0x7f11c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 shutdown_connections 2023-11-04T01:36:52.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.881+0000 7f11ca032640 1 -- 172.21.15.93:0/2354104028 wait complete. 2023-11-04T01:36:52.894 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:52.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.996+0000 7eff53f4c640 1 Processor -- start 2023-11-04T01:36:52.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff53f4c640 1 -- start start 2023-11-04T01:36:52.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff53f4c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 0x7eff4c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff53f4c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0cde60 con 0x7eff4c0b4880 2023-11-04T01:36:52.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff53f4c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c160f90 con 0x7eff4c153e60 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff53f4c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c161960 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.997+0000 7eff524e9640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7eff4c0b4880 0x7eff4c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44416/0 (socket says 172.21.15.93:44416) 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff524e9640 1 -- 172.21.15.93:0/3182159545 learned_addr learned my addr 172.21.15.93:0/3182159545 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff514e7640 1 --2- 172.21.15.93:0/3182159545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 0x7eff4c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195324389 0 0) 0x7eff4c0cde60 con 0x7eff4c0b4880 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff38003520 con 0x7eff4c0b4880 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475142 0 0) 0x7eff4c160f90 con 0x7eff4c153e60 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c0cde60 con 0x7eff4c153e60 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff514e7640 1 -- 172.21.15.93:0/3182159545 >> v1:172.21.15.125:6789/0 conn(0x7eff4c153e60 legacy=0x7eff4c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff514e7640 1 -- 172.21.15.93:0/3182159545 >> v1:172.21.15.93:6789/0 conn(0x7eff4c0b4880 legacy=0x7eff4c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.998+0000 7eff514e7640 1 -- 172.21.15.93:0/3182159545 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0ce090 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff514e7640 1 --2- 172.21.15.93:0/3182159545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 0x7eff4c161420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097d0 tx=0x7eff3c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96cec34365d9e02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c031890 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c0319f0 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff50ce6640 1 -- 172.21.15.93:0/3182159545 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c031d80 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff53f4c640 1 -- 172.21.15.93:0/3182159545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 msgr2=0x7eff4c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff53f4c640 1 --2- 172.21.15.93:0/3182159545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 0x7eff4c161420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097d0 tx=0x7eff3c02b930 comp rx=0 tx=0).stop 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff53f4c640 1 -- 172.21.15.93:0/3182159545 shutdown_connections 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff53f4c640 1 --2- 172.21.15.93:0/3182159545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0cd6d0 0x7eff4c161420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:52.999+0000 7eff53f4c640 1 -- 172.21.15.93:0/3182159545 >> 172.21.15.93:0/3182159545 conn(0x7eff4c0cf880 msgr2=0x7eff4c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.000+0000 7eff53f4c640 1 -- 172.21.15.93:0/3182159545 shutdown_connections 2023-11-04T01:36:53.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.000+0000 7eff53f4c640 1 -- 172.21.15.93:0/3182159545 wait complete. 2023-11-04T01:36:53.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 Processor -- start 2023-11-04T01:36:53.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 -- start start 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0b4880 0x7eff4c1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cd6d0 0x7eff4c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c15a390 con 0x7eff4c153e60 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1f34a0 con 0x7eff4c0cd6d0 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff53f4c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c155840 con 0x7eff4c0b4880 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff524e9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff524e9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38128/0 (socket says 172.21.15.93:38128) 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.001+0000 7eff524e9640 1 -- 172.21.15.93:0/139682491 learned_addr learned my addr 172.21.15.93:0/139682491 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff514e7640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cd6d0 0x7eff4c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff51ce8640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0b4880 0x7eff4c1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 -- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0b4880 msgr2=0x7eff4c1f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0b4880 0x7eff4c1f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 -- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cd6d0 msgr2=0x7eff4c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cd6d0 0x7eff4c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 -- 172.21.15.93:0/139682491 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c009400 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff524e9640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff4400cba0 tx=0x7eff4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ace0 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400ae40 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c0cccd0 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44012620 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.002+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c1560a0 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.003+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c074290 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.003+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff44007070 con 0x7eff4c153e60 2023-11-04T01:36:53.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.004+0000 7eff427fc640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.004+0000 7eff51ce8640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.004+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff440899b0 con 0x7eff4c153e60 2023-11-04T01:36:53.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.004+0000 7eff51ce8640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 0x7eff3006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff480011e0 tx=0x7eff48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.008+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff44054750 con 0x7eff4c153e60 2023-11-04T01:36:53.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.173+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff4c0d0b80 con 0x7eff4c153e60 2023-11-04T01:36:53.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.173+0000 7eff427fc640 1 -- 172.21.15.93:0/139682491 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff44017020 con 0x7eff4c153e60 2023-11-04T01:36:53.175 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 msgr2=0x7eff3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 0x7eff3006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff480011e0 tx=0x7eff48009040 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 msgr2=0x7eff4c1568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff4400cba0 tx=0x7eff4400a430 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 shutdown_connections 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7eff3006ae70 0x7eff3006d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff4c153e60 0x7eff4c1568a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cd6d0 0x7eff4c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 --2- 172.21.15.93:0/139682491 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7eff4c0b4880 0x7eff4c1f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 >> 172.21.15.93:0/139682491 conn(0x7eff4c0cf880 msgr2=0x7eff4c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 shutdown_connections 2023-11-04T01:36:53.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.175+0000 7eff53f4c640 1 -- 172.21.15.93:0/139682491 wait complete. 2023-11-04T01:36:53.188 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:53.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.289+0000 7f0d1e161640 1 Processor -- start 2023-11-04T01:36:53.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.289+0000 7f0d1e161640 1 -- start start 2023-11-04T01:36:53.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d1e161640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d180cc9d0 0x7f0d180c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d1e161640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180c3860 con 0x7f0d18153850 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d1e161640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180c9250 con 0x7f0d180cc520 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d1e161640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d18153c30 con 0x7f0d180cc9d0 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d177fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0d18153850 0x7f0d1815a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44418/0 (socket says 172.21.15.93:44418) 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d177fe640 1 -- 172.21.15.93:0/1907778838 learned_addr learned my addr 172.21.15.93:0/1907778838 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d17fff640 1 --2- 172.21.15.93:0/1907778838 >> v2:172.21.15.125:3300/0 conn(0x7f0d180cc9d0 0x7f0d180c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483590242 0 0) 0x7f0d180c3860 con 0x7f0d18153850 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00003520 con 0x7f0d18153850 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182984436 0 0) 0x7f0d00003520 con 0x7f0d18153850 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 >> v2:172.21.15.125:3300/0 conn(0x7f0d180cc9d0 msgr2=0x7f0d180c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 --2- 172.21.15.93:0/1907778838 >> v2:172.21.15.125:3300/0 conn(0x7f0d180cc9d0 0x7f0d180c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 >> v1:172.21.15.125:6789/0 conn(0x7f0d180cc520 legacy=0x7f0d18070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180ce590 con 0x7f0d18153850 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f0d0c001670 con 0x7f0d18153850 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 >> v1:172.21.15.93:6789/0 conn(0x7f0d18153850 legacy=0x7f0d1815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d00003970 0x7f0d00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 0x7f0d00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d00005180 0x7f0d0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18153c30 con 0x7f0d000047c0 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0000c020 con 0x7f0d00005180 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.290+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0000c1e0 con 0x7f0d00003970 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 0x7f0d00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d177fe640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d00003970 0x7f0d00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d17fff640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d00005180 0x7f0d0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 -- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d00003970 msgr2=0x7f0d00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d00003970 0x7f0d00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 -- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d00005180 msgr2=0x7f0d0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d00005180 0x7f0d0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d17fff640 1 -- 172.21.15.93:0/1907778838 reap_dead start 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d16ffd640 1 -- 172.21.15.93:0/1907778838 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00003520 con 0x7f0d000047c0 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.291+0000 7f0d177fe640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d00003970 0x7f0d00003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d16ffd640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 0x7f0d00004c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d08001750 tx=0x7f0d000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99a4650d8983cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080052d0 con 0x7f0d000047c0 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0802e050 con 0x7f0d000047c0 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d167fc640 1 -- 172.21.15.93:0/1907778838 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08003830 con 0x7f0d000047c0 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 -- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 msgr2=0x7f0d00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 0x7f0d00004c40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d08001750 tx=0x7f0d000057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 -- 172.21.15.93:0/1907778838 shutdown_connections 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 --2- 172.21.15.93:0/1907778838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d000047c0 0x7f0d00004c40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 -- 172.21.15.93:0/1907778838 >> 172.21.15.93:0/1907778838 conn(0x7f0d180ce950 msgr2=0x7f0d180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 -- 172.21.15.93:0/1907778838 shutdown_connections 2023-11-04T01:36:53.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.292+0000 7f0d1e161640 1 -- 172.21.15.93:0/1907778838 wait complete. 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.293+0000 7f0d1e161640 1 Processor -- start 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 -- start start 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d000047c0 0x7f0d180afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1814c700 0x7f0d1814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181f3930 con 0x7f0d181f2bc0 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1814d0c0 con 0x7f0d1814c700 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d1e161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181f6e30 con 0x7f0d000047c0 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38156/0 (socket says 172.21.15.93:38156) 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.294+0000 7f0d17fff640 1 -- 172.21.15.93:0/2164240209 learned_addr learned my addr 172.21.15.93:0/2164240209 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:53.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d177fe640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d000047c0 0x7f0d180afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d16ffd640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1814c700 0x7f0d1814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 -- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d000047c0 msgr2=0x7f0d180afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d000047c0 0x7f0d180afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 -- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1814c700 msgr2=0x7f0d1814cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1814c700 0x7f0d1814cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 -- 172.21.15.93:0/2164240209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180b3540 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d17fff640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0d180cb380 tx=0x7f0d1000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000e040 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1000f040 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d181f6070 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000fec0 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.295+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d181f6630 con 0x7f0d181f2bc0 2023-11-04T01:36:53.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.296+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d18074290 con 0x7f0d181f2bc0 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.296+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d10015430 con 0x7f0d181f2bc0 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.297+0000 7f0cfffff640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 0x7f0d0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.297+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d1008a360 con 0x7f0d181f2bc0 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.297+0000 7f0d177fe640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 0x7f0d0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.297+0000 7f0d177fe640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 0x7f0d0406d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d1814d2e0 tx=0x7f0d0c007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.301+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d10055100 con 0x7f0d181f2bc0 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.467+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d180cdb40 con 0x7f0d181f2bc0 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.468+0000 7f0cfffff640 1 -- 172.21.15.93:0/2164240209 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d10058720 con 0x7f0d181f2bc0 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 msgr2=0x7f0d0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 0x7f0d0406d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d1814d2e0 tx=0x7f0d0c007040 comp rx=0 tx=0).stop 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 msgr2=0x7f0d181f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0d180cb380 tx=0x7f0d1000f1b0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 shutdown_connections 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d0406aea0 0x7f0d0406d360 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d181f2bc0 0x7f0d181f3040 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d1814c700 0x7f0d1814cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 --2- 172.21.15.93:0/2164240209 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d000047c0 0x7f0d180afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.469+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 >> 172.21.15.93:0/2164240209 conn(0x7f0d180ce950 msgr2=0x7f0d1814efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.470+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 shutdown_connections 2023-11-04T01:36:53.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.470+0000 7f0d1e161640 1 -- 172.21.15.93:0/2164240209 wait complete. 2023-11-04T01:36:53.482 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:53.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.582+0000 7fa672f7c640 1 Processor -- start 2023-11-04T01:36:53.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.582+0000 7fa672f7c640 1 -- start start 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa672f7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa66c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa672f7c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06ca40 con 0x7fa66c0b2d30 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa672f7c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06cd20 con 0x7fa66c160430 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa672f7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0cb580 con 0x7fa66c0cccc0 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa66bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa66c0b2d30 0x7fa66c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44428/0 (socket says 172.21.15.93:44428) 2023-11-04T01:36:53.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.583+0000 7fa66bfff640 1 -- 172.21.15.93:0/2363453988 learned_addr learned my addr 172.21.15.93:0/2363453988 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993533305 0 0) 0x7fa66c06ca40 con 0x7fa66c0b2d30 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa671519640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa66c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa654003520 con 0x7fa66c0b2d30 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1047393071 0 0) 0x7fa654003520 con 0x7fa66c0b2d30 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 msgr2=0x7fa66c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa66c06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 >> v1:172.21.15.125:6789/0 conn(0x7fa66c160430 legacy=0x7fa66c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06d000 con 0x7fa66c0b2d30 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa660001670 con 0x7fa66c0b2d30 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 >> v1:172.21.15.93:6789/0 conn(0x7fa66c0b2d30 legacy=0x7fa66c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6540039a0 0x7fa654003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa6540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa654004d00 0x7fa654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0cb580 con 0x7fa6540039a0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65400ba30 con 0x7fa654004d00 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65400bbf0 con 0x7fa66c0cccc0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6540039a0 0x7fa654003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66bfff640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa6540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa671519640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa654004d00 0x7fa654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 -- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 msgr2=0x7fa6540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa6540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 -- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa654004d00 msgr2=0x7fa654005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa654004d00 0x7fa654005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa670d18640 1 -- 172.21.15.93:0/2363453988 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654003520 con 0x7fa6540039a0 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.584+0000 7fa66bfff640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0cccc0 0x7fa6540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.585+0000 7fa670d18640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6540039a0 0x7fa654003d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa65c001860 tx=0x7fa6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6646e9a65a112d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.585+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c033630 con 0x7fa6540039a0 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.585+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c0337b0 con 0x7fa6540039a0 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.585+0000 7fa66b7fe640 1 -- 172.21.15.93:0/2363453988 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c033b60 con 0x7fa6540039a0 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 -- 172.21.15.93:0/2363453988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6540039a0 msgr2=0x7fa654003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 --2- 172.21.15.93:0/2363453988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6540039a0 0x7fa654003d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa65c001860 tx=0x7fa6540057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa671519640 1 -- 172.21.15.93:0/2363453988 reap_dead start 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 -- 172.21.15.93:0/2363453988 shutdown_connections 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 -- 172.21.15.93:0/2363453988 >> 172.21.15.93:0/2363453988 conn(0x7fa66c06ea20 msgr2=0x7fa66c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 -- 172.21.15.93:0/2363453988 shutdown_connections 2023-11-04T01:36:53.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.586+0000 7fa672f7c640 1 -- 172.21.15.93:0/2363453988 wait complete. 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.587+0000 7fa672f7c640 1 Processor -- start 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.587+0000 7fa672f7c640 1 -- start start 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540039a0 0x7fa66c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0b5cf0 0x7fa66c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c14d5b0 con 0x7fa66c1560c0 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0b66b0 con 0x7fa6540039a0 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c157bf0 con 0x7fa66c0b5cf0 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38170/0 (socket says 172.21.15.93:38170) 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 -- 172.21.15.93:0/1684094587 learned_addr learned my addr 172.21.15.93:0/1684094587 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:53.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 -- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0b5cf0 msgr2=0x7fa66c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0b5cf0 0x7fa66c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 -- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540039a0 msgr2=0x7fa66c14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540039a0 0x7fa66c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 -- 172.21.15.93:0/1684094587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0b3d00 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa66bfff640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e700 tx=0x7fa66000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000c660 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000c7c0 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0b3f30 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000cb30 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.588+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c0b44f0 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.590+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c074290 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.590+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa66000cc90 con 0x7fa66c1560c0 2023-11-04T01:36:53.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.590+0000 7fa6697fa640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 0x7fa65806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.590+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6600897d0 con 0x7fa66c1560c0 2023-11-04T01:36:53.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.590+0000 7fa670d18640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 0x7fa65806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.591+0000 7fa670d18640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 0x7fa65806d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa65c036000 tx=0x7fa65c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.594+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa660054550 con 0x7fa66c1560c0 2023-11-04T01:36:53.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.760+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa66c0cb790 con 0x7fa66c1560c0 2023-11-04T01:36:53.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.760+0000 7fa6697fa640 1 -- 172.21.15.93:0/1684094587 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa6600014d0 con 0x7fa66c1560c0 2023-11-04T01:36:53.761 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 msgr2=0x7fa65806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 0x7fa65806d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa65c036000 tx=0x7fa65c009030 comp rx=0 tx=0).stop 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 msgr2=0x7fa66c0b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e700 tx=0x7fa66000ebc0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 shutdown_connections 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa65806ae70 0x7fa65806d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa66c0b5cf0 0x7fa66c0b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa66c1560c0 0x7fa66c0b37c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 --2- 172.21.15.93:0/1684094587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6540039a0 0x7fa66c14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 >> 172.21.15.93:0/1684094587 conn(0x7fa66c06ea20 msgr2=0x7fa66c0cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 shutdown_connections 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.762+0000 7fa672f7c640 1 -- 172.21.15.93:0/1684094587 wait complete. 2023-11-04T01:36:53.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:53.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.874+0000 7f06a8f9e640 1 Processor -- start 2023-11-04T01:36:53.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.874+0000 7f06a8f9e640 1 -- start start 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a8f9e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f06a415cec0 0x7f06a40d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a8f9e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40d1740 con 0x7f06a40d12c0 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a8f9e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40d1a20 con 0x7f06a40b86d0 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a8f9e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a40d1d00 con 0x7f06a415cec0 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f06a40d12c0 0x7f06a40b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44442/0 (socket says 172.21.15.93:44442) 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a3fff640 1 -- 172.21.15.93:0/338648028 learned_addr learned my addr 172.21.15.93:0/338648028 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a37fe640 1 --2- 172.21.15.93:0/338648028 >> v2:172.21.15.125:3300/0 conn(0x7f06a415cec0 0x7f06a40d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214547575 0 0) 0x7f06a40d1740 con 0x7f06a40d12c0 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.875+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068c003520 con 0x7f06a40d12c0 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964518745 0 0) 0x7f068c003520 con 0x7f06a40d12c0 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 >> v2:172.21.15.125:3300/0 conn(0x7f06a415cec0 msgr2=0x7f06a40d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 --2- 172.21.15.93:0/338648028 >> v2:172.21.15.125:3300/0 conn(0x7f06a415cec0 0x7f06a40d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 >> v1:172.21.15.125:6789/0 conn(0x7f06a40b86d0 legacy=0x7f06a40cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40d1fe0 con 0x7f06a40d12c0 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f069c0019f0 con 0x7f06a40d12c0 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 >> v1:172.21.15.93:6789/0 conn(0x7f06a40d12c0 legacy=0x7f06a40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f068c003970 0x7f068c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f068c005180 0x7f068c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40d1d00 con 0x7f068c0047c0 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c00c120 con 0x7f068c003970 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c00c2e0 con 0x7f068c005180 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a37fe640 1 --2- 172.21.15.93:0/338648028 >> v2:172.21.15.125:3300/0 conn(0x7f06a415cec0 0x7f06a40d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a3fff640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f068c005180 0x7f068c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a37fe640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f068c003970 0x7f068c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 -- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f068c005180 msgr2=0x7f068c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f068c005180 0x7f068c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 -- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f068c003970 msgr2=0x7f068c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f068c003970 0x7f068c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a2ffd640 1 -- 172.21.15.93:0/338648028 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c003520 con 0x7f068c0047c0 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.876+0000 7f06a3fff640 1 -- 172.21.15.93:0/338648028 reap_dead start 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0698001750 tx=0x7f068c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5742abefd742e37b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980052d0 con 0x7f068c0047c0 2023-11-04T01:36:53.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069802e050 con 0x7f068c0047c0 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a27fc640 1 -- 172.21.15.93:0/338648028 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698003830 con 0x7f068c0047c0 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 -- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 msgr2=0x7f068c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0698001750 tx=0x7f068c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 -- 172.21.15.93:0/338648028 shutdown_connections 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/338648028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f068c004c40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 -- 172.21.15.93:0/338648028 >> 172.21.15.93:0/338648028 conn(0x7f06a4071c70 msgr2=0x7f06a4072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 -- 172.21.15.93:0/338648028 shutdown_connections 2023-11-04T01:36:53.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.877+0000 7f06a8f9e640 1 -- 172.21.15.93:0/338648028 wait complete. 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.879+0000 7f06a8f9e640 1 Processor -- start 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.879+0000 7f06a8f9e640 1 -- start start 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06a4150640 0x7f06a40cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 0x7f06a415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4151830 con 0x7f068c0047c0 2023-11-04T01:36:53.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a415c750 con 0x7f06a415bd90 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a414e310 con 0x7f06a4150640 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38198/0 (socket says 172.21.15.93:38198) 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 -- 172.21.15.93:0/1710346150 learned_addr learned my addr 172.21.15.93:0/1710346150 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06a4150640 0x7f06a40cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a3fff640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 0x7f06a415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 -- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06a4150640 msgr2=0x7f06a40cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06a4150640 0x7f06a40cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 -- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 msgr2=0x7f06a415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 0x7f06a415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 -- 172.21.15.93:0/1710346150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4150bb0 con 0x7f068c0047c0 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a3fff640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 0x7f06a415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a37fe640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0694011900 tx=0x7f0694011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694009720 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400fbd0 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a4150e90 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694015460 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.880+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a4151450 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.881+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a4151aa0 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.882+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06940155c0 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.882+0000 7f068bfff640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 0x7f069006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.882+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f069408a430 con 0x7f068c0047c0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.882+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 0x7f069006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.883+0000 7f06a2ffd640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 0x7f069006d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0698033000 tx=0x7f0698009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:53.886+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06940551b0 con 0x7f068c0047c0 2023-11-04T01:36:54.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.065+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f06a4067c50 con 0x7f068c0047c0 2023-11-04T01:36:54.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.066+0000 7f068bfff640 1 -- 172.21.15.93:0/1710346150 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f06940587d0 con 0x7f068c0047c0 2023-11-04T01:36:54.067 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:54.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 msgr2=0x7f069006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 0x7f069006d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0698033000 tx=0x7f0698009030 comp rx=0 tx=0).stop 2023-11-04T01:36:54.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 msgr2=0x7f06a414ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0694011900 tx=0x7f0694011dc0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 shutdown_connections 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f069006ae70 0x7f069006d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06a415bd90 0x7f06a415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f06a4150640 0x7f06a40cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.067+0000 7f06a8f9e640 1 --2- 172.21.15.93:0/1710346150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f068c0047c0 0x7f06a414ddd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.068+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 >> 172.21.15.93:0/1710346150 conn(0x7f06a4071c70 msgr2=0x7f06a415acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.068+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 shutdown_connections 2023-11-04T01:36:54.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.068+0000 7f06a8f9e640 1 -- 172.21.15.93:0/1710346150 wait complete. 2023-11-04T01:36:54.080 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:36:54.080 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:54.080 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:54.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:ceph-fuse[129621]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:54.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi093.stderr:2023-11-04T01:36:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:54.146 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:54.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:36:54.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:54.151 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:36:54.206 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:54.206 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:54.225 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:54.225 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:54.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:54.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:2023-11-04T01:36:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:54.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.384+0000 7fbe34905640 1 Processor -- start 2023-11-04T01:36:54.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.384+0000 7fbe34905640 1 -- start start 2023-11-04T01:36:54.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.385+0000 7fbe34905640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.385+0000 7fbe34905640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe30157540 0x7fbe300d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.385+0000 7fbe34905640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3015e000 con 0x7fbe300cde60 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.385+0000 7fbe34905640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3015e5c0 con 0x7fbe30157540 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.385+0000 7fbe34905640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3015e2e0 con 0x7fbe300ce240 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe27fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe30157540 0x7fbe300d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2e59c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbe300cde60 0x7fbe3015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38284/0 (socket says 172.21.15.93:38284) 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2e59c640 1 -- 172.21.15.93:0/230427501 learned_addr learned my addr 172.21.15.93:0/230427501 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe27fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:56790/0 (socket says 172.21.15.93:56790) 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe30157540 0x7fbe300d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:35558/0 (socket says 172.21.15.93:35558) 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 msgr2=0x7fbe30157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/230427501 >> v1:172.21.15.125:6789/0 conn(0x7fbe300cde60 legacy=0x7fbe3015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/230427501 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300d1120 con 0x7fbe30157540 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.386+0000 7fbe27fff640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.387+0000 7fbe2ed9d640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe30157540 0x7fbe300d1920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009d90 tx=0x7fbe2802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8f8c1dca334244 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.387+0000 7fbe2dd9b640 1 -- 172.21.15.93:0/230427501 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2802cc50 con 0x7fbe30157540 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.387+0000 7fbe2dd9b640 1 -- 172.21.15.93:0/230427501 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2802cdb0 con 0x7fbe30157540 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.387+0000 7fbe2dd9b640 1 -- 172.21.15.93:0/230427501 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28034660 con 0x7fbe30157540 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 -- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe30157540 msgr2=0x7fbe300d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe30157540 0x7fbe300d1920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009d90 tx=0x7fbe2802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 -- 172.21.15.93:0/230427501 shutdown_connections 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe30157540 0x7fbe300d1920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 --2- 172.21.15.93:0/230427501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe30157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 -- 172.21.15.93:0/230427501 >> 172.21.15.93:0/230427501 conn(0x7fbe30071f30 msgr2=0x7fbe300cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 -- 172.21.15.93:0/230427501 shutdown_connections 2023-11-04T01:36:54.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.388+0000 7fbe34905640 1 -- 172.21.15.93:0/230427501 wait complete. 2023-11-04T01:36:54.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.389+0000 7fbe34905640 1 Processor -- start 2023-11-04T01:36:54.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.389+0000 7fbe34905640 1 -- start start 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe300cde60 0x7fbe301f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe301f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014c0e0 con 0x7fbe30157540 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014c980 con 0x7fbe300cde60 2023-11-04T01:36:54.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe34905640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014b9e0 con 0x7fbe300ce240 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38214/0 (socket says 172.21.15.93:38214) 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/3868952739 learned_addr learned my addr 172.21.15.93:0/3868952739 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe27fff640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe301f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2e59c640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe300cde60 0x7fbe301f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 msgr2=0x7fbe301f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe301f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe300cde60 msgr2=0x7fbe301f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe300cde60 0x7fbe301f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 -- 172.21.15.93:0/3868952739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18009400 con 0x7fbe30157540 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe2ed9d640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009eb0 tx=0x7fbe28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28040650 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.390+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280407b0 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.391+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe28009a70 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.391+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28040b60 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.391+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3014c610 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.391+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3014cb10 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.392+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe28040cc0 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.392+0000 7fbe26ffd640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 0x7fbe1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.392+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe280ac4d0 con 0x7fbe30157540 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.392+0000 7fbe2e59c640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 0x7fbe1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.393+0000 7fbe2e59c640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 0x7fbe1006d360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005880 tx=0x7fbe20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.397+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe28077300 con 0x7fbe30157540 2023-11-04T01:36:54.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.563+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe30074290 con 0x7fbe30157540 2023-11-04T01:36:54.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.564+0000 7fbe26ffd640 1 -- 172.21.15.93:0/3868952739 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7fbe28009450 con 0x7fbe30157540 2023-11-04T01:36:54.566 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:54.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 msgr2=0x7fbe1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 0x7fbe1006d360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005880 tx=0x7fbe20009040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 msgr2=0x7fbe301f5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009eb0 tx=0x7fbe28004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 shutdown_connections 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe1006aea0 0x7fbe1006d360 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe30157540 0x7fbe301f5ec0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe300ce240 0x7fbe301f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 --2- 172.21.15.93:0/3868952739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe300cde60 0x7fbe301f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 >> 172.21.15.93:0/3868952739 conn(0x7fbe30071f30 msgr2=0x7fbe300d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 shutdown_connections 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.566+0000 7fbe34905640 1 -- 172.21.15.93:0/3868952739 wait complete. 2023-11-04T01:36:54.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:54.579 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:54.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.681+0000 7fc0972cf640 1 Processor -- start 2023-11-04T01:36:54.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.681+0000 7fc0972cf640 1 -- start start 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc0972cf640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc090160430 0x7fc0900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc0972cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc0972cf640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900b2fc0 con 0x7fc0900b2b60 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc0972cf640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900cb580 con 0x7fc090160430 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc0972cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09006c7f0 con 0x7fc09006c3a0 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc090160430 0x7fc0900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09586c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc090160430 0x7fc0900b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:35590/0 (socket says 172.21.15.93:35590) 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09486a640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc0900b2b60 0x7fc09006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38288/0 (socket says 172.21.15.93:38288) 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 -- 172.21.15.93:0/3974235338 learned_addr learned my addr 172.21.15.93:0/3974235338 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 -- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 msgr2=0x7fc0900cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 -- 172.21.15.93:0/3974235338 >> v1:172.21.15.125:6789/0 conn(0x7fc0900b2b60 legacy=0x7fc09006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09506b640 1 -- 172.21.15.93:0/3974235338 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09006ca40 con 0x7fc090160430 2023-11-04T01:36:54.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.682+0000 7fc09586c640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.683+0000 7fc09506b640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc090160430 0x7fc0900b2620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009870 tx=0x7fc08c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a9ef2d6084ce39 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.683+0000 7fc087fff640 1 -- 172.21.15.93:0/3974235338 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c030840 con 0x7fc090160430 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.683+0000 7fc087fff640 1 -- 172.21.15.93:0/3974235338 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c0309a0 con 0x7fc090160430 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.683+0000 7fc087fff640 1 -- 172.21.15.93:0/3974235338 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c030d30 con 0x7fc090160430 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 -- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc090160430 msgr2=0x7fc0900b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc090160430 0x7fc0900b2620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009870 tx=0x7fc08c02b980 comp rx=0 tx=0).stop 2023-11-04T01:36:54.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 -- 172.21.15.93:0/3974235338 shutdown_connections 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 --2- 172.21.15.93:0/3974235338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc090160430 0x7fc0900b2620 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 -- 172.21.15.93:0/3974235338 >> 172.21.15.93:0/3974235338 conn(0x7fc09006ea20 msgr2=0x7fc09006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 -- 172.21.15.93:0/3974235338 shutdown_connections 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.684+0000 7fc0972cf640 1 -- 172.21.15.93:0/3974235338 wait complete. 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.685+0000 7fc0972cf640 1 Processor -- start 2023-11-04T01:36:54.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.685+0000 7fc0972cf640 1 -- start start 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0900b2b60 0x7fc0900b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900b5750 con 0x7fc090160430 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900b5c10 con 0x7fc0900b2b60 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc090152140 con 0x7fc09006c3a0 2023-11-04T01:36:54.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38220/0 (socket says 172.21.15.93:38220) 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 -- 172.21.15.93:0/1105406154 learned_addr learned my addr 172.21.15.93:0/1105406154 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09506b640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09486a640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0900b2b60 0x7fc0900b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 -- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 msgr2=0x7fc0900c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 -- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0900b2b60 msgr2=0x7fc0900b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0900b2b60 0x7fc0900b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 -- 172.21.15.93:0/1105406154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009a70 con 0x7fc090160430 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc09586c640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc08800efc0 tx=0x7fc088009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088009d70 con 0x7fc090160430 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08800f040 con 0x7fc090160430 2023-11-04T01:36:54.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088003990 con 0x7fc090160430 2023-11-04T01:36:54.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.686+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c0094d0 con 0x7fc090160430 2023-11-04T01:36:54.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.687+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc090152d80 con 0x7fc090160430 2023-11-04T01:36:54.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.688+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc090074290 con 0x7fc090160430 2023-11-04T01:36:54.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.688+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0880144a0 con 0x7fc090160430 2023-11-04T01:36:54.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.688+0000 7fc085ffb640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 0x7fc07406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.689+0000 7fc09506b640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 0x7fc07406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.689+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc08808a5b0 con 0x7fc090160430 2023-11-04T01:36:54.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.689+0000 7fc09506b640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 0x7fc07406d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc08c036000 tx=0x7fc08c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.693+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc088055330 con 0x7fc090160430 2023-11-04T01:36:54.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.857+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc09015b730 con 0x7fc090160430 2023-11-04T01:36:54.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.858+0000 7fc085ffb640 1 -- 172.21.15.93:0/1105406154 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc088058950 con 0x7fc090160430 2023-11-04T01:36:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:54.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 msgr2=0x7fc07406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 0x7fc07406d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc08c036000 tx=0x7fc08c03b040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 msgr2=0x7fc090151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc08800efc0 tx=0x7fc088009f90 comp rx=0 tx=0).stop 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 shutdown_connections 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc07406ae70 0x7fc07406d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc090160430 0x7fc090151c00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0900b2b60 0x7fc0900b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 --2- 172.21.15.93:0/1105406154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc09006c3a0 0x7fc0900c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 >> 172.21.15.93:0/1105406154 conn(0x7fc09006ea20 msgr2=0x7fc0900b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 shutdown_connections 2023-11-04T01:36:54.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.860+0000 7fc0972cf640 1 -- 172.21.15.93:0/1105406154 wait complete. 2023-11-04T01:36:54.872 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:54.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.973+0000 7ff0883e2640 1 Processor -- start 2023-11-04T01:36:54.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.973+0000 7ff0883e2640 1 -- start start 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff0883e2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff080159c00 0x7ff0800cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff0883e2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0800c48e0 0x7ff0800c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff0883e2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08015aff0 con 0x7ff0800adac0 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff0883e2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0800c52d0 con 0x7ff0800c48e0 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff0883e2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08015a3e0 con 0x7ff080159c00 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0800c48e0 0x7ff0800c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0800c48e0 0x7ff0800c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38234/0 (socket says 172.21.15.93:38234) 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 -- 172.21.15.93:0/2524831616 learned_addr learned my addr 172.21.15.93:0/2524831616 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08617e640 1 --2- 172.21.15.93:0/2524831616 >> v2:172.21.15.125:3300/0 conn(0x7ff080159c00 0x7ff0800cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 -- 172.21.15.93:0/2524831616 >> v2:172.21.15.125:3300/0 conn(0x7ff080159c00 msgr2=0x7ff0800cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 --2- 172.21.15.93:0/2524831616 >> v2:172.21.15.125:3300/0 conn(0x7ff080159c00 0x7ff0800cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 -- 172.21.15.93:0/2524831616 >> v1:172.21.15.125:6789/0 conn(0x7ff0800adac0 legacy=0x7ff0800adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.974+0000 7ff08597d640 1 -- 172.21.15.93:0/2524831616 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08015a6c0 con 0x7ff0800c48e0 2023-11-04T01:36:54.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff08597d640 1 --2- 172.21.15.93:0/2524831616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800c48e0 0x7ff0800c4d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0800cc4d0 tx=0x7ff07002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3a9f759c8d95e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff08517c640 1 -- 172.21.15.93:0/2524831616 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070031870 con 0x7ff0800c48e0 2023-11-04T01:36:54.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff08517c640 1 -- 172.21.15.93:0/2524831616 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700319d0 con 0x7ff0800c48e0 2023-11-04T01:36:54.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff08517c640 1 -- 172.21.15.93:0/2524831616 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070031d60 con 0x7ff0800c48e0 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff0883e2640 1 -- 172.21.15.93:0/2524831616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800c48e0 msgr2=0x7ff0800c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.975+0000 7ff0883e2640 1 --2- 172.21.15.93:0/2524831616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800c48e0 0x7ff0800c4d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0800cc4d0 tx=0x7ff07002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 -- 172.21.15.93:0/2524831616 shutdown_connections 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 --2- 172.21.15.93:0/2524831616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800c48e0 0x7ff0800c4d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 --2- 172.21.15.93:0/2524831616 >> v2:172.21.15.125:3300/0 conn(0x7ff080159c00 0x7ff0800cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 -- 172.21.15.93:0/2524831616 >> 172.21.15.93:0/2524831616 conn(0x7ff0800ce950 msgr2=0x7ff0800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 -- 172.21.15.93:0/2524831616 shutdown_connections 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.976+0000 7ff0883e2640 1 -- 172.21.15.93:0/2524831616 wait complete. 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 Processor -- start 2023-11-04T01:36:54.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 -- start start 2023-11-04T01:36:54.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 0x7ff080145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 0x7ff0801eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800a7810 con 0x7ff0800adac0 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.977+0000 7ff0883e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080159480 con 0x7ff080159c00 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff0883e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff080156c80 con 0x7ff0800c48e0 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38244/0 (socket says 172.21.15.93:38244) 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 -- 172.21.15.93:0/873272419 learned_addr learned my addr 172.21.15.93:0/873272419 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08597d640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 0x7ff080145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08697f640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 0x7ff0801eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 -- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 msgr2=0x7ff080145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 0x7ff080145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 -- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 msgr2=0x7ff0801eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 0x7ff0801eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 -- 172.21.15.93:0/873272419 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700094d0 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08597d640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 0x7ff080145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08697f640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 0x7ff0801eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff08617e640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e870 tx=0x7ff07c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0094f0 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c00c940 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff080156f60 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080157520 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.978+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00ccf0 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.979+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080074290 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.980+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff07c013470 con 0x7ff0800adac0 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.980+0000 7ff076ffd640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 0x7ff06406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.980+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff07c089a80 con 0x7ff0800adac0 2023-11-04T01:36:54.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.980+0000 7ff08597d640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 0x7ff06406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.981+0000 7ff08597d640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 0x7ff06406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff070036000 tx=0x7ff07003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:54.984+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff07c054780 con 0x7ff0800adac0 2023-11-04T01:36:55.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.151+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff080146250 con 0x7ff0800adac0 2023-11-04T01:36:55.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.151+0000 7ff076ffd640 1 -- 172.21.15.93:0/873272419 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff07c057da0 con 0x7ff0800adac0 2023-11-04T01:36:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 msgr2=0x7ff06406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 0x7ff06406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff070036000 tx=0x7ff07003c040 comp rx=0 tx=0).stop 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 msgr2=0x7ff080158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e870 tx=0x7ff07c00ed30 comp rx=0 tx=0).stop 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 shutdown_connections 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff06406ae70 0x7ff06406d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff080159c00 0x7ff0801eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff0800c48e0 0x7ff080145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 --2- 172.21.15.93:0/873272419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0800adac0 0x7ff080158f40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 >> 172.21.15.93:0/873272419 conn(0x7ff0800ce950 msgr2=0x7ff0800cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 shutdown_connections 2023-11-04T01:36:55.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.153+0000 7ff0883e2640 1 -- 172.21.15.93:0/873272419 wait complete. 2023-11-04T01:36:55.166 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:55.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 Processor -- start 2023-11-04T01:36:55.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 -- start start 2023-11-04T01:36:55.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5340c37d0 0x7fc5340c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 0x7fc534070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340710a0 con 0x7fc5341460c0 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5341464a0 con 0x7fc5340c37d0 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.323+0000 7fc53a04f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340c41a0 con 0x7fc534070710 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc532ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5340c37d0 0x7fc5340c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc5337fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc5341460c0 0x7fc5340b1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44448/0 (socket says 172.21.15.93:44448) 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc5337fe640 1 -- 172.21.15.93:0/10404172 learned_addr learned my addr 172.21.15.93:0/10404172 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc533fff640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 0x7fc534070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc532ffd640 1 -- 172.21.15.93:0/10404172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 msgr2=0x7fc534070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc532ffd640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 0x7fc534070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc532ffd640 1 -- 172.21.15.93:0/10404172 >> v1:172.21.15.93:6789/0 conn(0x7fc5341460c0 legacy=0x7fc5340b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc532ffd640 1 -- 172.21.15.93:0/10404172 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534146950 con 0x7fc5340c37d0 2023-11-04T01:36:55.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc5327fc640 1 -- 172.21.15.93:0/10404172 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587507603 0 0) 0x7fc528001110 con 0x7fc5341460c0 2023-11-04T01:36:55.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.324+0000 7fc533fff640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 0x7fc534070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc532ffd640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5340c37d0 0x7fc5340c3c60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc5240097d0 tx=0x7fc52402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199524acb6e17ce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc5327fc640 1 -- 172.21.15.93:0/10404172 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524031800 con 0x7fc5340c37d0 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc5327fc640 1 -- 172.21.15.93:0/10404172 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524031960 con 0x7fc5340c37d0 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc5327fc640 1 -- 172.21.15.93:0/10404172 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524031cf0 con 0x7fc5340c37d0 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 -- 172.21.15.93:0/10404172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5340c37d0 msgr2=0x7fc5340c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5340c37d0 0x7fc5340c3c60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc5240097d0 tx=0x7fc52402b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 -- 172.21.15.93:0/10404172 shutdown_connections 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc534070710 0x7fc534070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 --2- 172.21.15.93:0/10404172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5340c37d0 0x7fc5340c3c60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 -- 172.21.15.93:0/10404172 >> 172.21.15.93:0/10404172 conn(0x7fc5340ce950 msgr2=0x7fc5340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 -- 172.21.15.93:0/10404172 shutdown_connections 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.325+0000 7fc53a04f640 1 -- 172.21.15.93:0/10404172 wait complete. 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.326+0000 7fc53a04f640 1 Processor -- start 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 -- start start 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340c37d0 0x7fc5341f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5341460c0 0x7fc5341431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5341f2440 con 0x7fc534070710 2023-11-04T01:36:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340c6000 con 0x7fc5340c37d0 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc53a04f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340c62e0 con 0x7fc5341460c0 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc5337fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc5337fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38258/0 (socket says 172.21.15.93:38258) 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.327+0000 7fc5337fe640 1 -- 172.21.15.93:0/2582565158 learned_addr learned my addr 172.21.15.93:0/2582565158 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 -- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5341460c0 msgr2=0x7fc5341431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5341460c0 0x7fc5341431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc532ffd640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340c37d0 0x7fc5341f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 -- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340c37d0 msgr2=0x7fc5341f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340c37d0 0x7fc5341f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 -- 172.21.15.93:0/2582565158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524009400 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc5337fe640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c400 tx=0x7fc52800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528005ce0 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528005e40 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5340c65c0 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528007310 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.328+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5340c6b80 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.329+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc534074290 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.329+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc528007470 con 0x7fc534070710 2023-11-04T01:36:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.330+0000 7fc51bfff640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 0x7fc52006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.330+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc528088e60 con 0x7fc534070710 2023-11-04T01:36:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.330+0000 7fc532ffd640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 0x7fc52006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.330+0000 7fc532ffd640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 0x7fc52006d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc524036000 tx=0x7fc524008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.334+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc528053b50 con 0x7fc534070710 2023-11-04T01:36:55.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.500+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5340710a0 con 0x7fc534070710 2023-11-04T01:36:55.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.501+0000 7fc51bfff640 1 -- 172.21.15.93:0/2582565158 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5340710a0 con 0x7fc534070710 2023-11-04T01:36:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 msgr2=0x7fc52006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 0x7fc52006d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc524036000 tx=0x7fc524008030 comp rx=0 tx=0).stop 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 msgr2=0x7fc5340c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c400 tx=0x7fc52800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 shutdown_connections 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.502+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc52006ae70 0x7fc52006d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc5341460c0 0x7fc5341431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5340c37d0 0x7fc5341f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 --2- 172.21.15.93:0/2582565158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc534070710 0x7fc5340c5a20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 >> 172.21.15.93:0/2582565158 conn(0x7fc5340ce950 msgr2=0x7fc534145400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 shutdown_connections 2023-11-04T01:36:55.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.503+0000 7fc53a04f640 1 -- 172.21.15.93:0/2582565158 wait complete. 2023-11-04T01:36:55.515 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:55.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.616+0000 7fe29629b640 1 Processor -- start 2023-11-04T01:36:55.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.616+0000 7fe29629b640 1 -- start start 2023-11-04T01:36:55.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe29015ad30 0x7fe2900adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2900ad730 0x7fe290070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe290070c50 0x7fe2900c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900ae260 con 0x7fe290070c50 2023-11-04T01:36:55.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900710e0 con 0x7fe29015ad30 2023-11-04T01:36:55.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe29629b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c3900 con 0x7fe2900ad730 2023-11-04T01:36:55.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe294838640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe290070c50 0x7fe2900c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe294838640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe290070c50 0x7fe2900c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38260/0 (socket says 172.21.15.93:38260) 2023-11-04T01:36:55.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.617+0000 7fe294838640 1 -- 172.21.15.93:0/3298462207 learned_addr learned my addr 172.21.15.93:0/3298462207 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:55.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe28f7fe640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2900ad730 0x7fe290070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe28ffff640 1 --2- 172.21.15.93:0/3298462207 >> v2:172.21.15.125:3300/0 conn(0x7fe29015ad30 0x7fe2900adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 -- 172.21.15.93:0/3298462207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2900ad730 msgr2=0x7fe290070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2900ad730 0x7fe290070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 -- 172.21.15.93:0/3298462207 >> v2:172.21.15.125:3300/0 conn(0x7fe29015ad30 msgr2=0x7fe2900adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 --2- 172.21.15.93:0/3298462207 >> v2:172.21.15.125:3300/0 conn(0x7fe29015ad30 0x7fe2900adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 -- 172.21.15.93:0/3298462207 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900c3be0 con 0x7fe290070c50 2023-11-04T01:36:55.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe294838640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe290070c50 0x7fe2900c8fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe288009e50 tx=0x7fe28802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b24b5fba1beb7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe28effd640 1 -- 172.21.15.93:0/3298462207 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28802c9e0 con 0x7fe290070c50 2023-11-04T01:36:55.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe28effd640 1 -- 172.21.15.93:0/3298462207 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28802cb40 con 0x7fe290070c50 2023-11-04T01:36:55.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.618+0000 7fe28effd640 1 -- 172.21.15.93:0/3298462207 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880343f0 con 0x7fe290070c50 2023-11-04T01:36:55.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 -- 172.21.15.93:0/3298462207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe290070c50 msgr2=0x7fe2900c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe290070c50 0x7fe2900c8fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe288009e50 tx=0x7fe28802be40 comp rx=0 tx=0).stop 2023-11-04T01:36:55.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 -- 172.21.15.93:0/3298462207 shutdown_connections 2023-11-04T01:36:55.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe290070c50 0x7fe2900c8fa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 --2- 172.21.15.93:0/3298462207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2900ad730 0x7fe290070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 --2- 172.21.15.93:0/3298462207 >> v2:172.21.15.125:3300/0 conn(0x7fe29015ad30 0x7fe2900adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 -- 172.21.15.93:0/3298462207 >> 172.21.15.93:0/3298462207 conn(0x7fe2900ce950 msgr2=0x7fe2900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 -- 172.21.15.93:0/3298462207 shutdown_connections 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.619+0000 7fe29629b640 1 -- 172.21.15.93:0/3298462207 wait complete. 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.620+0000 7fe29629b640 1 Processor -- start 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.620+0000 7fe29629b640 1 -- start start 2023-11-04T01:36:55.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070c50 0x7fe2900c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe29015ad30 0x7fe290153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900b26f0 con 0x7fe2900ad730 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900b2410 con 0x7fe290070c50 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe29629b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c75b0 con 0x7fe29015ad30 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38264/0 (socket says 172.21.15.93:38264) 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 -- 172.21.15.93:0/2886291461 learned_addr learned my addr 172.21.15.93:0/2886291461 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe294838640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe29015ad30 0x7fe290153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 -- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe29015ad30 msgr2=0x7fe290153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28ffff640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070c50 0x7fe2900c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe29015ad30 0x7fe290153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 -- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070c50 msgr2=0x7fe2900c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070c50 0x7fe2900c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.621+0000 7fe28f7fe640 1 -- 172.21.15.93:0/2886291461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009b30 con 0x7fe2900ad730 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe28f7fe640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c7f0 tx=0x7fe28400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284004220 con 0x7fe2900ad730 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284004380 con 0x7fe2900ad730 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900c7890 con 0x7fe2900ad730 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284007860 con 0x7fe2900ad730 2023-11-04T01:36:55.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.622+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900b3a90 con 0x7fe2900ad730 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.623+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900c7db0 con 0x7fe2900ad730 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.623+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe284007bd0 con 0x7fe2900ad730 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.624+0000 7fe28cff9640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 0x7fe27c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.624+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe284089930 con 0x7fe2900ad730 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.624+0000 7fe28ffff640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 0x7fe27c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.624+0000 7fe28ffff640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 0x7fe27c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2900afce0 tx=0x7fe280008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.628+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2900c7db0 con 0x7fe2900ad730 2023-11-04T01:36:55.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.793+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2900c7db0 con 0x7fe2900ad730 2023-11-04T01:36:55.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.793+0000 7fe28cff9640 1 -- 172.21.15.93:0/2886291461 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2900c7db0 con 0x7fe2900ad730 2023-11-04T01:36:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 msgr2=0x7fe27c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 0x7fe27c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2900afce0 tx=0x7fe280008040 comp rx=0 tx=0).stop 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 msgr2=0x7fe2900b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c7f0 tx=0x7fe28400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 shutdown_connections 2023-11-04T01:36:55.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe27c06ae70 0x7fe27c06d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe29015ad30 0x7fe290153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2900ad730 0x7fe2900b3550 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 --2- 172.21.15.93:0/2886291461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe290070c50 0x7fe2900c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.795+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 >> 172.21.15.93:0/2886291461 conn(0x7fe2900ce950 msgr2=0x7fe29006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.796+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 shutdown_connections 2023-11-04T01:36:55.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.796+0000 7fe29629b640 1 -- 172.21.15.93:0/2886291461 wait complete. 2023-11-04T01:36:55.808 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.906+0000 7fdfb0dd0640 1 Processor -- start 2023-11-04T01:36:55.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.906+0000 7fdfb0dd0640 1 -- start start 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfb0dd0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdfac0c4ff0 0x7fdfac0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfb0dd0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdfac0adac0 0x7fdfac0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfb0dd0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac15aff0 con 0x7fdfac159c00 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfb0dd0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0ae460 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfb0dd0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac15a3e0 con 0x7fdfac0adac0 2023-11-04T01:36:55.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfa9d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdfac0c4ff0 0x7fdfac0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfa9d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdfac0c4ff0 0x7fdfac0cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38274/0 (socket says 172.21.15.93:38274) 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.907+0000 7fdfa9d9b640 1 -- 172.21.15.93:0/3178692892 learned_addr learned my addr 172.21.15.93:0/3178692892 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa9d9b640 1 -- 172.21.15.93:0/3178692892 >> v2:172.21.15.125:3300/0 conn(0x7fdfac0adac0 msgr2=0x7fdfac0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfaad9d640 1 --2- 172.21.15.93:0/3178692892 >> v2:172.21.15.125:3300/0 conn(0x7fdfac0adac0 0x7fdfac0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa9d9b640 1 --2- 172.21.15.93:0/3178692892 >> v2:172.21.15.125:3300/0 conn(0x7fdfac0adac0 0x7fdfac0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa9d9b640 1 -- 172.21.15.93:0/3178692892 >> v1:172.21.15.125:6789/0 conn(0x7fdfac159c00 legacy=0x7fdfac0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa9d9b640 1 -- 172.21.15.93:0/3178692892 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac15a6c0 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa9d9b640 1 --2- 172.21.15.93:0/3178692892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac0cc890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0c59a0 tx=0x7fdfa002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec61548e22a4929 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.908+0000 7fdfa959a640 1 -- 172.21.15.93:0/3178692892 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa002ee90 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfa959a640 1 -- 172.21.15.93:0/3178692892 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0036440 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfa959a640 1 -- 172.21.15.93:0/3178692892 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00367d0 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/3178692892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac0c4ff0 msgr2=0x7fdfac0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/3178692892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac0cc890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0c59a0 tx=0x7fdfa002e0e0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/3178692892 shutdown_connections 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/3178692892 >> v2:172.21.15.125:3300/0 conn(0x7fdfac0adac0 0x7fdfac0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/3178692892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac0cc890 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/3178692892 >> 172.21.15.93:0/3178692892 conn(0x7fdfac0ce950 msgr2=0x7fdfac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/3178692892 shutdown_connections 2023-11-04T01:36:55.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.909+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/3178692892 wait complete. 2023-11-04T01:36:55.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.910+0000 7fdfb0dd0640 1 Processor -- start 2023-11-04T01:36:55.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.910+0000 7fdfb0dd0640 1 -- start start 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfac0adac0 0x7fdfac0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac140fb0 con 0x7fdfac159c00 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac1426f0 con 0x7fdfac0c4ff0 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfb0dd0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0c7df0 con 0x7fdfac0adac0 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfaad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfaad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38284/0 (socket says 172.21.15.93:38284) 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfaad9d640 1 -- 172.21.15.93:0/1088910400 learned_addr learned my addr 172.21.15.93:0/1088910400 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.911+0000 7fdfa9d9b640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 -- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfac0adac0 msgr2=0x7fdfac0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfac0adac0 0x7fdfac0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 -- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfac0c4ff0 msgr2=0x7fdfac1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 -- 172.21.15.93:0/1088910400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa000b770 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfaad9d640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c7f0 tx=0x7fdfa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4004220 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4004380 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4007860 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0c80d0 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.912+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac0c8690 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.913+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac074290 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.913+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfa4007bd0 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.914+0000 7fdf9affd640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 0x7fdf8c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.914+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdfa4089900 con 0x7fdfac159c00 2023-11-04T01:36:55.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.914+0000 7fdfaa59c640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 0x7fdf8c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.914+0000 7fdfaa59c640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 0x7fdf8c06d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00ab90 tx=0x7fdf9c009230 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:55.918+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdfa4054680 con 0x7fdfac159c00 2023-11-04T01:36:56.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.098+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdfac0c9870 con 0x7fdfac159c00 2023-11-04T01:36:56.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.099+0000 7fdf9affd640 1 -- 172.21.15.93:0/1088910400 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdfa401e080 con 0x7fdfac159c00 2023-11-04T01:36:56.100 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:56.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 msgr2=0x7fdf8c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 0x7fdf8c06d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00ab90 tx=0x7fdf9c009230 comp rx=0 tx=0).stop 2023-11-04T01:36:56.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 msgr2=0x7fdfac154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c7f0 tx=0x7fdfa400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 shutdown_connections 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdf8c06aea0 0x7fdf8c06d360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfac159c00 0x7fdfac154e10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfac0c4ff0 0x7fdfac1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 --2- 172.21.15.93:0/1088910400 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdfac0adac0 0x7fdfac0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.100+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 >> 172.21.15.93:0/1088910400 conn(0x7fdfac0ce950 msgr2=0x7fdfac0c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.101+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 shutdown_connections 2023-11-04T01:36:56.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.101+0000 7fdfb0dd0640 1 -- 172.21.15.93:0/1088910400 wait complete. 2023-11-04T01:36:56.113 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:36:56.113 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:56.132 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:56.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.230+0000 7f86f3b89640 1 Processor -- start 2023-11-04T01:36:56.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.230+0000 7f86f3b89640 1 -- start start 2023-11-04T01:36:56.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f3b89640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86ec0cde60 0x7f86ec15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f3b89640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f86ec15daa0 0x7f86ec157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f3b89640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec15e000 con 0x7f86ec0ce240 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f3b89640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec15e5c0 con 0x7f86ec15daa0 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f3b89640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec15e2e0 con 0x7f86ec0cde60 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f86ec15daa0 0x7f86ec157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f86ec15daa0 0x7f86ec157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38294/0 (socket says 172.21.15.93:38294) 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 -- 172.21.15.93:0/2518815875 learned_addr learned my addr 172.21.15.93:0/2518815875 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1925640 1 --2- 172.21.15.93:0/2518815875 >> v2:172.21.15.125:3300/0 conn(0x7f86ec0cde60 0x7f86ec15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 -- 172.21.15.93:0/2518815875 >> v2:172.21.15.125:3300/0 conn(0x7f86ec0cde60 msgr2=0x7f86ec15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 --2- 172.21.15.93:0/2518815875 >> v2:172.21.15.125:3300/0 conn(0x7f86ec0cde60 0x7f86ec15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 -- 172.21.15.93:0/2518815875 >> v1:172.21.15.125:6789/0 conn(0x7f86ec0ce240 legacy=0x7f86ec06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.231+0000 7f86f1124640 1 -- 172.21.15.93:0/2518815875 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0d1120 con 0x7f86ec15daa0 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.232+0000 7f86f1124640 1 --2- 172.21.15.93:0/2518815875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec15daa0 0x7f86ec157000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b5550 tx=0x7f86dc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822a573c4ae33c67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.232+0000 7f86f0923640 1 -- 172.21.15.93:0/2518815875 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc030860 con 0x7f86ec15daa0 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.232+0000 7f86f0923640 1 -- 172.21.15.93:0/2518815875 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0309c0 con 0x7f86ec15daa0 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.232+0000 7f86f0923640 1 -- 172.21.15.93:0/2518815875 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc030d50 con 0x7f86ec15daa0 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 -- 172.21.15.93:0/2518815875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec15daa0 msgr2=0x7f86ec157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2518815875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec15daa0 0x7f86ec157000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b5550 tx=0x7f86dc02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 -- 172.21.15.93:0/2518815875 shutdown_connections 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2518815875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec15daa0 0x7f86ec157000 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2518815875 >> v2:172.21.15.125:3300/0 conn(0x7f86ec0cde60 0x7f86ec15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 -- 172.21.15.93:0/2518815875 >> 172.21.15.93:0/2518815875 conn(0x7f86ec071f30 msgr2=0x7f86ec0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 -- 172.21.15.93:0/2518815875 shutdown_connections 2023-11-04T01:36:56.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.233+0000 7f86f3b89640 1 -- 172.21.15.93:0/2518815875 wait complete. 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.234+0000 7f86f3b89640 1 Processor -- start 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.234+0000 7f86f3b89640 1 -- start start 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 0x7f86ec1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86ec15daa0 0x7f86ec0b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec15ce10 con 0x7f86ec0cde60 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec1f2900 con 0x7f86ec0ce240 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f3b89640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec15c010 con 0x7f86ec15daa0 2023-11-04T01:36:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38298/0 (socket says 172.21.15.93:38298) 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 -- 172.21.15.93:0/2175822295 learned_addr learned my addr 172.21.15.93:0/2175822295 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1124640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 0x7f86ec1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f2126640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86ec15daa0 0x7f86ec0b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 -- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86ec15daa0 msgr2=0x7f86ec0b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86ec15daa0 0x7f86ec0b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 -- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 msgr2=0x7f86ec1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 0x7f86ec1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1925640 1 -- 172.21.15.93:0/2175822295 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094d0 con 0x7f86ec0cde60 2023-11-04T01:36:56.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.235+0000 7f86f1124640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 0x7f86ec1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86f1925640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e9e0 tx=0x7f86e800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8009670 con 0x7f86ec0cde60 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e800c9d0 con 0x7f86ec0cde60 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800cd80 con 0x7f86ec0cde60 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec15c290 con 0x7f86ec0cde60 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.236+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec15cb30 con 0x7f86ec0cde60 2023-11-04T01:36:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.237+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec074290 con 0x7f86ec0cde60 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.237+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86e8013470 con 0x7f86ec0cde60 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.237+0000 7f86e27fc640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 0x7f86d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.238+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86e8089bb0 con 0x7f86ec0cde60 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.238+0000 7f86f1124640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 0x7f86d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.238+0000 7f86f1124640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 0x7f86d006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86dc036000 tx=0x7f86dc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.242+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86e80548a0 con 0x7f86ec0cde60 2023-11-04T01:36:56.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.410+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86ec0c62a0 con 0x7f86ec0cde60 2023-11-04T01:36:56.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.411+0000 7f86e27fc640 1 -- 172.21.15.93:0/2175822295 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f86e8017090 con 0x7f86ec0cde60 2023-11-04T01:36:56.413 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 msgr2=0x7f86d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 0x7f86d006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86dc036000 tx=0x7f86dc03b040 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 msgr2=0x7f86ec0c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e9e0 tx=0x7f86e800eea0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 shutdown_connections 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f86d006ae70 0x7f86d006d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f86ec15daa0 0x7f86ec0b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec0ce240 0x7f86ec1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 --2- 172.21.15.93:0/2175822295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86ec0cde60 0x7f86ec0c8060 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 >> 172.21.15.93:0/2175822295 conn(0x7f86ec071f30 msgr2=0x7f86ec0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 shutdown_connections 2023-11-04T01:36:56.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.413+0000 7f86f3b89640 1 -- 172.21.15.93:0/2175822295 wait complete. 2023-11-04T01:36:56.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:56.426 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:56.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.526+0000 7fc921ed4640 1 Processor -- start 2023-11-04T01:36:56.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.526+0000 7fc921ed4640 1 -- start start 2023-11-04T01:36:56.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc921ed4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c15ad30 0x7fc91c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc921ed4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc91c0ad730 0x7fc91c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc921ed4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0c3900 con 0x7fc91c070c50 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc921ed4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c0ae260 con 0x7fc91c0ad730 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc921ed4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15f750 con 0x7fc91c15ad30 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc91affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc91c0ad730 0x7fc91c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc91affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc91c0ad730 0x7fc91c070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38314/0 (socket says 172.21.15.93:38314) 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.527+0000 7fc91affd640 1 -- 172.21.15.93:0/267761896 learned_addr learned my addr 172.21.15.93:0/267761896 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91affd640 1 -- 172.21.15.93:0/267761896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c15ad30 msgr2=0x7fc91c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91affd640 1 --2- 172.21.15.93:0/267761896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c15ad30 0x7fc91c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91affd640 1 -- 172.21.15.93:0/267761896 >> v1:172.21.15.125:6789/0 conn(0x7fc91c070c50 legacy=0x7fc91c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91affd640 1 -- 172.21.15.93:0/267761896 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c0c3be0 con 0x7fc91c0ad730 2023-11-04T01:36:56.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91affd640 1 --2- 172.21.15.93:0/267761896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c0ad730 0x7fc91c070710 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc9100098a0 tx=0x7fc91002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f745773a0630c0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91a7fc640 1 -- 172.21.15.93:0/267761896 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9100317c0 con 0x7fc91c0ad730 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91a7fc640 1 -- 172.21.15.93:0/267761896 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910031920 con 0x7fc91c0ad730 2023-11-04T01:36:56.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.528+0000 7fc91a7fc640 1 -- 172.21.15.93:0/267761896 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910031cb0 con 0x7fc91c0ad730 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 -- 172.21.15.93:0/267761896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c0ad730 msgr2=0x7fc91c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 --2- 172.21.15.93:0/267761896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c0ad730 0x7fc91c070710 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc9100098a0 tx=0x7fc91002b860 comp rx=0 tx=0).stop 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 -- 172.21.15.93:0/267761896 shutdown_connections 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 --2- 172.21.15.93:0/267761896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c0ad730 0x7fc91c070710 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 --2- 172.21.15.93:0/267761896 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c15ad30 0x7fc91c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 -- 172.21.15.93:0/267761896 >> 172.21.15.93:0/267761896 conn(0x7fc91c0ce950 msgr2=0x7fc91c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 -- 172.21.15.93:0/267761896 shutdown_connections 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.529+0000 7fc921ed4640 1 -- 172.21.15.93:0/267761896 wait complete. 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.530+0000 7fc921ed4640 1 Processor -- start 2023-11-04T01:36:56.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.530+0000 7fc921ed4640 1 -- start start 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 0x7fc91c0ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 0x7fc91c06da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0cd930 con 0x7fc91c15ad30 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0cdc10 con 0x7fc91c070c50 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc921ed4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0cdef0 con 0x7fc91c0ad730 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38328/0 (socket says 172.21.15.93:38328) 2023-11-04T01:36:56.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 -- 172.21.15.93:0/354337049 learned_addr learned my addr 172.21.15.93:0/354337049 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 -- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 msgr2=0x7fc91c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91affd640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 0x7fc91c06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91b7fe640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 0x7fc91c0ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 0x7fc91c06da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 -- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 msgr2=0x7fc91c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 0x7fc91c0ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91bfff640 1 -- 172.21.15.93:0/354337049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100094d0 con 0x7fc91c15ad30 2023-11-04T01:36:56.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91affd640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 0x7fc91c06da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.531+0000 7fc91b7fe640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 0x7fc91c0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc91bfff640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c780 tx=0x7fc91400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914004b60 con 0x7fc91c15ad30 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400ce90 con 0x7fc91c15ad30 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c0ce1d0 con 0x7fc91c15ad30 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400a850 con 0x7fc91c15ad30 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.532+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c0ccfe0 con 0x7fc91c15ad30 2023-11-04T01:36:56.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.533+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c156fc0 con 0x7fc91c15ad30 2023-11-04T01:36:56.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.533+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc91400a9b0 con 0x7fc91c15ad30 2023-11-04T01:36:56.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.534+0000 7fc903fff640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 0x7fc90806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.534+0000 7fc91b7fe640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 0x7fc90806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.534+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc914089b90 con 0x7fc91c15ad30 2023-11-04T01:36:56.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.534+0000 7fc91b7fe640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 0x7fc90806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00a870 tx=0x7fc90c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.538+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc914054880 con 0x7fc91c15ad30 2023-11-04T01:36:56.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.702+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc91c074290 con 0x7fc91c15ad30 2023-11-04T01:36:56.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.703+0000 7fc903fff640 1 -- 172.21.15.93:0/354337049 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc914057ea0 con 0x7fc91c15ad30 2023-11-04T01:36:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:56.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 msgr2=0x7fc90806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 0x7fc90806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00a870 tx=0x7fc90c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:56.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 msgr2=0x7fc91c06df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c780 tx=0x7fc91400cc40 comp rx=0 tx=0).stop 2023-11-04T01:36:56.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 shutdown_connections 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc90806ae70 0x7fc90806d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc91c15ad30 0x7fc91c06df80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc91c0ad730 0x7fc91c06da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 --2- 172.21.15.93:0/354337049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc91c070c50 0x7fc91c0ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.704+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 >> 172.21.15.93:0/354337049 conn(0x7fc91c0ce950 msgr2=0x7fc91c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.705+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 shutdown_connections 2023-11-04T01:36:56.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.705+0000 7fc921ed4640 1 -- 172.21.15.93:0/354337049 wait complete. 2023-11-04T01:36:56.719 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:56.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.820+0000 7f5e90d9e640 1 Processor -- start 2023-11-04T01:36:56.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.820+0000 7f5e90d9e640 1 -- start start 2023-11-04T01:36:56.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e90d9e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5e8c15ce60 0x7f5e8c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e90d9e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e90d9e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0cdc20 con 0x7f5e8c161540 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e90d9e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0ce4c0 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e90d9e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c15d240 con 0x7f5e8c15ce60 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e8bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e8affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5e8c161540 0x7f5e8c0cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44460/0 (socket says 172.21.15.93:44460) 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e8affd640 1 -- 172.21.15.93:0/1068409173 learned_addr learned my addr 172.21.15.93:0/1068409173 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.821+0000 7f5e8bfff640 1 --2- 172.21.15.93:0/1068409173 >> v2:172.21.15.93:3300/0 conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38338/0 (socket says 172.21.15.93:38338) 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8b7fe640 1 --2- 172.21.15.93:0/1068409173 >> v2:172.21.15.125:3300/0 conn(0x7f5e8c15ce60 0x7f5e8c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8bfff640 1 -- 172.21.15.93:0/1068409173 >> v2:172.21.15.125:3300/0 conn(0x7f5e8c15ce60 msgr2=0x7f5e8c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8bfff640 1 --2- 172.21.15.93:0/1068409173 >> v2:172.21.15.125:3300/0 conn(0x7f5e8c15ce60 0x7f5e8c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8bfff640 1 -- 172.21.15.93:0/1068409173 >> v1:172.21.15.93:6789/0 conn(0x7f5e8c161540 legacy=0x7f5e8c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8bfff640 1 -- 172.21.15.93:0/1068409173 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0cdf00 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8bfff640 1 --2- 172.21.15.93:0/1068409173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0b56c0 tx=0x7f5e8402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6175eb31839c0b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.822+0000 7f5e8a7fc640 1 -- 172.21.15.93:0/1068409173 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8402cc80 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e8a7fc640 1 -- 172.21.15.93:0/1068409173 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8402cde0 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e8a7fc640 1 -- 172.21.15.93:0/1068409173 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84034660 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1068409173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c0cfbf0 msgr2=0x7f5e8c0d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1068409173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0b56c0 tx=0x7f5e8402bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1068409173 shutdown_connections 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1068409173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c0d14c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1068409173 >> v2:172.21.15.125:3300/0 conn(0x7f5e8c15ce60 0x7f5e8c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1068409173 >> 172.21.15.93:0/1068409173 conn(0x7f5e8c06b4c0 msgr2=0x7f5e8c06b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1068409173 shutdown_connections 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.823+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1068409173 wait complete. 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.824+0000 7f5e90d9e640 1 Processor -- start 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 -- start start 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e8c161540 0x7f5e8c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c1581d0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c15fc60 con 0x7f5e8c0cfbf0 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e90d9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c15f470 con 0x7f5e8c161540 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e8affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e8affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38348/0 (socket says 172.21.15.93:38348) 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.825+0000 7f5e8affd640 1 -- 172.21.15.93:0/1337382787 learned_addr learned my addr 172.21.15.93:0/1337382787 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8b7fe640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8bfff640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e8c161540 0x7f5e8c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 -- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e8c161540 msgr2=0x7f5e8c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e8c161540 0x7f5e8c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 -- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 msgr2=0x7f5e8c15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 -- 172.21.15.93:0/1337382787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009a70 con 0x7f5e8c15ce60 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8b7fe640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e8affd640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c4b0 tx=0x7f5e8000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80005ce0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80005e40 con 0x7f5e8c15ce60 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80007270 con 0x7f5e8c15ce60 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0cb260 con 0x7f5e8c15ce60 2023-11-04T01:36:56.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.826+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c15f980 con 0x7f5e8c15ce60 2023-11-04T01:36:56.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.827+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c0cb0c0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.827+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e800073d0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.828+0000 7f5e73fff640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 0x7f5e7806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.828+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e80088de0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.828+0000 7f5e8b7fe640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 0x7f5e7806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.828+0000 7f5e8b7fe640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 0x7f5e7806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c006fd0 tx=0x7f5e7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.832+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e8c0cb0c0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.997+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e8c0cb0c0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.997+0000 7f5e73fff640 1 -- 172.21.15.93:0/1337382787 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e8c0cb0c0 con 0x7f5e8c15ce60 2023-11-04T01:36:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 msgr2=0x7f5e7806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 0x7f5e7806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c006fd0 tx=0x7f5e7c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 msgr2=0x7f5e8c1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c4b0 tx=0x7f5e8000c970 comp rx=0 tx=0).stop 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 shutdown_connections 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5e7806aea0 0x7f5e7806d360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5e8c161540 0x7f5e8c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5e8c15ce60 0x7f5e8c1570f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 --2- 172.21.15.93:0/1337382787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e8c0cfbf0 0x7f5e8c15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 >> 172.21.15.93:0/1337382787 conn(0x7f5e8c06b4c0 msgr2=0x7f5e8c0d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 shutdown_connections 2023-11-04T01:36:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:56.999+0000 7f5e90d9e640 1 -- 172.21.15.93:0/1337382787 wait complete. 2023-11-04T01:36:57.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:57.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.113+0000 7ffaf41b6640 1 Processor -- start 2023-11-04T01:36:57.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.113+0000 7ffaf41b6640 1 -- start start 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec153e60 0x7ffaec15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffaec0cd6d0 0x7ffaec161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffaec0b4880 0x7ffaec0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec0cde60 con 0x7ffaec0b4880 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec160f90 con 0x7ffaec0cd6d0 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf41b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0b5200 con 0x7ffaec153e60 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf2753640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffaec0b4880 0x7ffaec0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf2753640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffaec0b4880 0x7ffaec0b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38360/0 (socket says 172.21.15.93:38360) 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.114+0000 7ffaf2753640 1 -- 172.21.15.93:0/2320336799 learned_addr learned my addr 172.21.15.93:0/2320336799 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 -- 172.21.15.93:0/2320336799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec153e60 msgr2=0x7ffaec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 --2- 172.21.15.93:0/2320336799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec153e60 0x7ffaec15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf1751640 1 --2- 172.21.15.93:0/2320336799 >> v2:172.21.15.125:3300/0 conn(0x7ffaec0cd6d0 0x7ffaec161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 -- 172.21.15.93:0/2320336799 >> v2:172.21.15.125:3300/0 conn(0x7ffaec0cd6d0 msgr2=0x7ffaec161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 --2- 172.21.15.93:0/2320336799 >> v2:172.21.15.125:3300/0 conn(0x7ffaec0cd6d0 0x7ffaec161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 -- 172.21.15.93:0/2320336799 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec15e400 con 0x7ffaec0b4880 2023-11-04T01:36:57.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf2753640 1 --2- 172.21.15.93:0/2320336799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0b4cc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffaec06c930 tx=0x7ffae402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc94d5c12c7c908 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf0f50640 1 -- 172.21.15.93:0/2320336799 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4031870 con 0x7ffaec0b4880 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.115+0000 7ffaf0f50640 1 -- 172.21.15.93:0/2320336799 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae40319d0 con 0x7ffaec0b4880 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf0f50640 1 -- 172.21.15.93:0/2320336799 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4031d60 con 0x7ffaec0b4880 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 -- 172.21.15.93:0/2320336799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 msgr2=0x7ffaec0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/2320336799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0b4cc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffaec06c930 tx=0x7ffae402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 -- 172.21.15.93:0/2320336799 shutdown_connections 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/2320336799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0b4cc0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/2320336799 >> v2:172.21.15.125:3300/0 conn(0x7ffaec0cd6d0 0x7ffaec161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/2320336799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec153e60 0x7ffaec15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 -- 172.21.15.93:0/2320336799 >> 172.21.15.93:0/2320336799 conn(0x7ffaec0cf880 msgr2=0x7ffaec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 -- 172.21.15.93:0/2320336799 shutdown_connections 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.116+0000 7ffaf41b6640 1 -- 172.21.15.93:0/2320336799 wait complete. 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.117+0000 7ffaf41b6640 1 Processor -- start 2023-11-04T01:36:57.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.117+0000 7ffaf41b6640 1 -- start start 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec0cd6d0 0x7ffaec0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaec153e60 0x7ffaec0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1555c0 con 0x7ffaec0b4880 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec157b70 con 0x7ffaec153e60 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf41b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0c8bc0 con 0x7ffaec0cd6d0 2023-11-04T01:36:57.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38368/0 (socket says 172.21.15.93:38368) 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 -- 172.21.15.93:0/735665817 learned_addr learned my addr 172.21.15.93:0/735665817 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 -- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec0cd6d0 msgr2=0x7ffaec0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec0cd6d0 0x7ffaec0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 -- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaec153e60 msgr2=0x7ffaec0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf2753640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaec153e60 0x7ffaec0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaec153e60 0x7ffaec0c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.118+0000 7ffaf1f52640 1 -- 172.21.15.93:0/735665817 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40094d0 con 0x7ffaec0b4880 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffaf1f52640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffae800ba50 tx=0x7ffae800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae800cbe0 con 0x7ffaec0b4880 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae800cd60 con 0x7ffaec0b4880 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0c8ea0 con 0x7ffaec0b4880 2023-11-04T01:36:57.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8014680 con 0x7ffaec0b4880 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.119+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec0c9460 con 0x7ffaec0b4880 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.120+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec074290 con 0x7ffaec0b4880 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.120+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffae801d3b0 con 0x7ffaec0b4880 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.121+0000 7ffae27fc640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 0x7ffad006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.121+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffae8089990 con 0x7ffaec0b4880 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.121+0000 7ffaf1751640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 0x7ffad006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.121+0000 7ffaf1751640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 0x7ffad006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffaec1564e0 tx=0x7ffadc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.125+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffae8054680 con 0x7ffaec0b4880 2023-11-04T01:36:57.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.296+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffaec157d30 con 0x7ffaec0b4880 2023-11-04T01:36:57.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.296+0000 7ffae27fc640 1 -- 172.21.15.93:0/735665817 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffae80190a0 con 0x7ffaec0b4880 2023-11-04T01:36:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 msgr2=0x7ffad006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 0x7ffad006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffaec1564e0 tx=0x7ffadc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 msgr2=0x7ffaec0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffae800ba50 tx=0x7ffae800bf10 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 shutdown_connections 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffad006ae70 0x7ffad006d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaec153e60 0x7ffaec0c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaec0cd6d0 0x7ffaec0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 --2- 172.21.15.93:0/735665817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaec0b4880 0x7ffaec0d1560 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 >> 172.21.15.93:0/735665817 conn(0x7ffaec0cf880 msgr2=0x7ffaec0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 shutdown_connections 2023-11-04T01:36:57.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.298+0000 7ffaf41b6640 1 -- 172.21.15.93:0/735665817 wait complete. 2023-11-04T01:36:57.310 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:57.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.411+0000 7fa3b7978640 1 Processor -- start 2023-11-04T01:36:57.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.411+0000 7fa3b7978640 1 -- start start 2023-11-04T01:36:57.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.411+0000 7fa3b7978640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 0x7fa3b00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b7978640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b7978640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00b2fc0 con 0x7fa3b00b2b60 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b7978640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00cb580 con 0x7fa3b006c3a0 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b7978640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b006c7d0 con 0x7fa3b0160430 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38372/0 (socket says 172.21.15.93:38372) 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 -- 172.21.15.93:0/2224133828 learned_addr learned my addr 172.21.15.93:0/2224133828 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 -- 172.21.15.93:0/2224133828 >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 msgr2=0x7fa3b00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5714640 1 --2- 172.21.15.93:0/2224133828 >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 0x7fa3b00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 --2- 172.21.15.93:0/2224133828 >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 0x7fa3b00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 -- 172.21.15.93:0/2224133828 >> v1:172.21.15.125:6789/0 conn(0x7fa3b00b2b60 legacy=0x7fa3b006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5f15640 1 -- 172.21.15.93:0/2224133828 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b006ca40 con 0x7fa3b006c3a0 2023-11-04T01:36:57.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.412+0000 7fa3b5714640 1 --2- 172.21.15.93:0/2224133828 >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 0x7fa3b00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b5f15640 1 --2- 172.21.15.93:0/2224133828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa3b006f6d0 tx=0x7fa3a802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd1a8e17c1a155 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3a7fff640 1 -- 172.21.15.93:0/2224133828 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a802ca80 con 0x7fa3b006c3a0 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3a7fff640 1 -- 172.21.15.93:0/2224133828 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a802cbe0 con 0x7fa3b006c3a0 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3a7fff640 1 -- 172.21.15.93:0/2224133828 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80343f0 con 0x7fa3b006c3a0 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 -- 172.21.15.93:0/2224133828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b006c3a0 msgr2=0x7fa3b00cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2224133828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa3b006f6d0 tx=0x7fa3a802bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 -- 172.21.15.93:0/2224133828 shutdown_connections 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2224133828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b006c3a0 0x7fa3b00cbcb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2224133828 >> v2:172.21.15.125:3300/0 conn(0x7fa3b0160430 0x7fa3b00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 -- 172.21.15.93:0/2224133828 >> 172.21.15.93:0/2224133828 conn(0x7fa3b006ea20 msgr2=0x7fa3b006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.413+0000 7fa3b7978640 1 -- 172.21.15.93:0/2224133828 shutdown_connections 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.414+0000 7fa3b7978640 1 -- 172.21.15.93:0/2224133828 wait complete. 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 Processor -- start 2023-11-04T01:36:57.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 -- start start 2023-11-04T01:36:57.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b006c3a0 0x7fa3b015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0160430 0x7fa3b0151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00cab00 con 0x7fa3b00b2b60 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00c9f80 con 0x7fa3b006c3a0 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b7978640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00ca260 con 0x7fa3b0160430 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b4f13640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.415+0000 7fa3b4f13640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38382/0 (socket says 172.21.15.93:38382) 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 -- 172.21.15.93:0/2479826925 learned_addr learned my addr 172.21.15.93:0/2479826925 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b5714640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b006c3a0 0x7fa3b015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b5f15640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0160430 0x7fa3b0151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 -- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0160430 msgr2=0x7fa3b0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0160430 0x7fa3b0151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 -- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b006c3a0 msgr2=0x7fa3b015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b006c3a0 0x7fa3b015ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 -- 172.21.15.93:0/2479826925 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009b30 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b4f13640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c430 tx=0x7fa3a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011790 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a00118f0 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00ca540 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011ce0 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.416+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b00c7f00 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.417+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0074290 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.418+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3a001c460 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.418+0000 7fa3a5ffb640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 0x7fa39406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.418+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3a00898e0 con 0x7fa3b00b2b60 2023-11-04T01:36:57.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.418+0000 7fa3b5714640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 0x7fa39406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.419+0000 7fa3b5714640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 0x7fa39406d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00b840 tx=0x7fa3ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.423+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3a0054660 con 0x7fa3b00b2b60 2023-11-04T01:36:57.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.587+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa3b00b6b20 con 0x7fa3b00b2b60 2023-11-04T01:36:57.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.587+0000 7fa3a5ffb640 1 -- 172.21.15.93:0/2479826925 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa3a0057c80 con 0x7fa3b00b2b60 2023-11-04T01:36:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 msgr2=0x7fa39406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 0x7fa39406d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00b840 tx=0x7fa3ac008040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 msgr2=0x7fa3b00c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c430 tx=0x7fa3a000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 shutdown_connections 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa39406ae70 0x7fa39406d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa3b0160430 0x7fa3b0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3b00b2b60 0x7fa3b00c94e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 --2- 172.21.15.93:0/2479826925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b006c3a0 0x7fa3b015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 >> 172.21.15.93:0/2479826925 conn(0x7fa3b006ea20 msgr2=0x7fa3b00b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 shutdown_connections 2023-11-04T01:36:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.589+0000 7fa3b7978640 1 -- 172.21.15.93:0/2479826925 wait complete. 2023-11-04T01:36:57.602 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:57.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.701+0000 7f0bbd644640 1 Processor -- start 2023-11-04T01:36:57.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.701+0000 7f0bbd644640 1 -- start start 2023-11-04T01:36:57.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bbd644640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0bb815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bbd644640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80cde60 con 0x7f0bb80b4880 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bbd644640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb8160f90 con 0x7f0bb80cd6d0 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bbd644640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb815e400 con 0x7f0bb8153e60 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0bb80b4880 0x7f0bb80d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44474/0 (socket says 172.21.15.93:44474) 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb77fe640 1 -- 172.21.15.93:0/1694791872 learned_addr learned my addr 172.21.15.93:0/1694791872 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb6ffd640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0bb815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439144390 0 0) 0x7f0bb80cde60 con 0x7f0bb80b4880 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba4003520 con 0x7f0bb80b4880 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733772438 0 0) 0x7f0ba4003520 con 0x7f0bb80b4880 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 msgr2=0x7f0bb815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0bb815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 >> v1:172.21.15.125:6789/0 conn(0x7f0bb80cd6d0 legacy=0x7f0bb8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80ce090 con 0x7f0bb80b4880 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f0bb00019f0 con 0x7f0bb80b4880 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 >> v1:172.21.15.93:6789/0 conn(0x7f0bb80b4880 legacy=0x7f0bb80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0ba40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba4003ee0 0x7f0ba40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba4004d00 0x7f0ba4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb815e400 con 0x7f0ba4004d00 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba400b9e0 con 0x7f0ba4003ee0 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.702+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba400bba0 con 0x7f0bb8153e60 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba4004d00 0x7f0ba4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb6ffd640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0ba40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba4003ee0 0x7f0ba40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 -- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 msgr2=0x7f0ba40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb8153e60 0x7f0ba40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 -- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba4003ee0 msgr2=0x7f0ba40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba4003ee0 0x7f0ba40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 -- 172.21.15.93:0/1694791872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4003520 con 0x7f0ba4004d00 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ba4003ee0 0x7f0ba40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.703+0000 7f0bb77fe640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba4004d00 0x7f0ba4005180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000a840 tx=0x7f0ba40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d99e33ccddc61a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb002cea0 con 0x7f0ba4004d00 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb002f070 con 0x7f0ba4004d00 2023-11-04T01:36:57.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bb67fc640 1 -- 172.21.15.93:0/1694791872 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00348b0 con 0x7f0ba4004d00 2023-11-04T01:36:57.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 -- 172.21.15.93:0/1694791872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba4004d00 msgr2=0x7f0ba4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1694791872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ba4004d00 0x7f0ba4005180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000a840 tx=0x7f0ba40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bb77fe640 1 -- 172.21.15.93:0/1694791872 reap_dead start 2023-11-04T01:36:57.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 -- 172.21.15.93:0/1694791872 shutdown_connections 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 -- 172.21.15.93:0/1694791872 >> 172.21.15.93:0/1694791872 conn(0x7f0bb80cf880 msgr2=0x7f0bb80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 -- 172.21.15.93:0/1694791872 shutdown_connections 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.704+0000 7f0bbd644640 1 -- 172.21.15.93:0/1694791872 wait complete. 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.705+0000 7f0bbd644640 1 Processor -- start 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.705+0000 7f0bbd644640 1 -- start start 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 0x7f0bb80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bb8158610 0x7f0bb8158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb815a2f0 con 0x7f0bb80c9310 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8155b60 con 0x7f0bb8158610 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bbd644640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80cca40 con 0x7f0bb80cc0a0 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bb6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bb6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38412/0 (socket says 172.21.15.93:38412) 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bb6ffd640 1 -- 172.21.15.93:0/1220853547 learned_addr learned my addr 172.21.15.93:0/1220853547 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 0x7f0bb80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.706+0000 7f0bb77fe640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bb8158610 0x7f0bb8158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 -- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 msgr2=0x7f0bb80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 0x7f0bb80cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 -- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bb8158610 msgr2=0x7f0bb8158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bb8158610 0x7f0bb8158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 -- 172.21.15.93:0/1220853547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8156230 con 0x7f0bb80c9310 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 0x7f0bb80cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bb6ffd640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80119a0 tx=0x7f0ba8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800fa90 con 0x7f0bb80c9310 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba800fbf0 con 0x7f0bb80c9310 2023-11-04T01:36:57.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8014440 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb8158fd0 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.707+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb81564a0 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.708+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8074290 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.708+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ba80145a0 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.709+0000 7f0baffff640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 0x7f0b9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.709+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ba808a200 con 0x7f0bb80c9310 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.709+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 0x7f0b9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.709+0000 7f0bae7fc640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 0x7f0b9806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007b40 tx=0x7f0ba0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.713+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ba8054ef0 con 0x7f0bb80c9310 2023-11-04T01:36:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.891+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0bb80d0b80 con 0x7f0bb80c9310 2023-11-04T01:36:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.891+0000 7f0baffff640 1 -- 172.21.15.93:0/1220853547 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0ba8058510 con 0x7f0bb80c9310 2023-11-04T01:36:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:36:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 msgr2=0x7f0b9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 0x7f0b9806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007b40 tx=0x7f0ba0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 msgr2=0x7f0bb8156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80119a0 tx=0x7f0ba8011e60 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 shutdown_connections 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0b9806ae70 0x7f0b9806d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0bb8158610 0x7f0bb8158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0bb80cc0a0 0x7f0bb80cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 --2- 172.21.15.93:0/1220853547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb80c9310 0x7f0bb8156f80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 >> 172.21.15.93:0/1220853547 conn(0x7f0bb80cf880 msgr2=0x7f0bb815fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 shutdown_connections 2023-11-04T01:36:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:57.893+0000 7f0bbd644640 1 -- 172.21.15.93:0/1220853547 wait complete. 2023-11-04T01:36:57.905 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-11-04T01:36:57.905 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:57.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:36:57.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:57.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:ceph-fuse[94176]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:57.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-11-04T01:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:57.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi125.stderr:2023-11-04T01:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:57.981 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:57.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:36:57.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:57.987 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:36:58.043 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:36:58.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:58.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.141+0000 7f08fe7f5640 1 Processor -- start 2023-11-04T01:36:58.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.141+0000 7f08fe7f5640 1 -- start start 2023-11-04T01:36:58.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 0x7f08f80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 0x7f08f80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f08f80b0910 0x7f08f815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f80b49b0 con 0x7f08f80b0910 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f80b0da0 con 0x7f08f8159c70 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fe7f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80b4110 con 0x7f08f806db20 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f08f80b0910 0x7f08f815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f08f80b0910 0x7f08f815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38422/0 (socket says 172.21.15.93:38422) 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 -- 172.21.15.93:0/2615560711 learned_addr learned my addr 172.21.15.93:0/2615560711 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08f77fe640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 0x7f08f80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08f7fff640 1 --2- 172.21.15.93:0/2615560711 >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 0x7f08f80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 -- 172.21.15.93:0/2615560711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 msgr2=0x7f08f80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 0x7f08f80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 -- 172.21.15.93:0/2615560711 >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 msgr2=0x7f08f80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 --2- 172.21.15.93:0/2615560711 >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 0x7f08f80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08fcd92640 1 -- 172.21.15.93:0/2615560711 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80b43f0 con 0x7f08f80b0910 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08f77fe640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 0x7f08f80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:58.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.142+0000 7f08f7fff640 1 --2- 172.21.15.93:0/2615560711 >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 0x7f08f80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:58.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08fcd92640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f80b0910 0x7f08f815d7d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f08f80cc440 tx=0x7f08f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650e34b37b14c64a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08f6ffd640 1 -- 172.21.15.93:0/2615560711 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f002ca70 con 0x7f08f80b0910 2023-11-04T01:36:58.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08f6ffd640 1 -- 172.21.15.93:0/2615560711 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f002cbd0 con 0x7f08f80b0910 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08f6ffd640 1 -- 172.21.15.93:0/2615560711 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00343f0 con 0x7f08f80b0910 2023-11-04T01:36:58.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08fe7f5640 1 -- 172.21.15.93:0/2615560711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f80b0910 msgr2=0x7f08f815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.143+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f80b0910 0x7f08f815d7d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f08f80cc440 tx=0x7f08f002bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 -- 172.21.15.93:0/2615560711 shutdown_connections 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f80b0910 0x7f08f815d7d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/2615560711 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f806db20 0x7f08f80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/2615560711 >> v2:172.21.15.125:3300/0 conn(0x7f08f8159c70 0x7f08f80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 -- 172.21.15.93:0/2615560711 >> 172.21.15.93:0/2615560711 conn(0x7f08f80ce950 msgr2=0x7f08f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 -- 172.21.15.93:0/2615560711 shutdown_connections 2023-11-04T01:36:58.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.144+0000 7f08fe7f5640 1 -- 172.21.15.93:0/2615560711 wait complete. 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.145+0000 7f08fe7f5640 1 Processor -- start 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.145+0000 7f08fe7f5640 1 -- start start 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 0x7f08f8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 0x7f08f815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f814fc10 con 0x7f08f8159c70 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8150380 con 0x7f08f806db20 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8150660 con 0x7f08f80b0910 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38438/0 (socket says 172.21.15.93:38438) 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 -- 172.21.15.93:0/3101324258 learned_addr learned my addr 172.21.15.93:0/3101324258 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:58.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f77fe640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 0x7f08f815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f7fff640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 0x7f08f8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 -- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 msgr2=0x7f08f815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 0x7f08f815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 -- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 msgr2=0x7f08f8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 0x7f08f8154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 -- 172.21.15.93:0/3101324258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009b30 con 0x7f08f8159c70 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f77fe640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 0x7f08f815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f7fff640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 0x7f08f8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fcd92640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036040 tx=0x7f08f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0009510 con 0x7f08f8159c70 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f003e450 con 0x7f08f8159c70 2023-11-04T01:36:58.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f003e7e0 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f8150940 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.146+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f8150f00 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.147+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f81510f0 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.148+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08f003e940 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.148+0000 7f08f4ff9640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 0x7f08e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.148+0000 7f08f7fff640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 0x7f08e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.148+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08f00ac7f0 con 0x7f08f8159c70 2023-11-04T01:36:58.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.149+0000 7f08f7fff640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 0x7f08e406d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.152+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08f00774e0 con 0x7f08f8159c70 2023-11-04T01:36:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.353+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f8074290 con 0x7f08f8159c70 2023-11-04T01:36:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.354+0000 7f08f4ff9640 1 -- 172.21.15.93:0/3101324258 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f08f007ab00 con 0x7f08f8159c70 2023-11-04T01:36:58.356 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:36:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 msgr2=0x7f08e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 0x7f08e406d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 msgr2=0x7f08f815c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036040 tx=0x7f08f0004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 shutdown_connections 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08e406ae70 0x7f08e406d330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08f8159c70 0x7f08f815c630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08f80b0910 0x7f08f815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 --2- 172.21.15.93:0/3101324258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08f806db20 0x7f08f8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 >> 172.21.15.93:0/3101324258 conn(0x7f08f80ce950 msgr2=0x7f08f8158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 shutdown_connections 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.356+0000 7f08fe7f5640 1 -- 172.21.15.93:0/3101324258 wait complete. 2023-11-04T01:36:58.368 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.466+0000 7f381c6e7640 1 Processor -- start 2023-11-04T01:36:58.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.466+0000 7f381c6e7640 1 -- start start 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381c6e7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f381415d250 0x7f38140c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381c6e7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381406a120 con 0x7f38140c9d70 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381c6e7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381406a370 con 0x7f381415ce70 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381c6e7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38140cdc10 con 0x7f381415d250 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f3819c82640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f381415d250 0x7f38140c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381ac84640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f38140c9d70 0x7f38140ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44476/0 (socket says 172.21.15.93:44476) 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f381ac84640 1 -- 172.21.15.93:0/3335134404 learned_addr learned my addr 172.21.15.93:0/3335134404 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.467+0000 7f3819c82640 1 -- 172.21.15.93:0/3335134404 >> v1:172.21.15.125:6789/0 conn(0x7f381415ce70 legacy=0x7f381406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819c82640 1 -- 172.21.15.93:0/3335134404 >> v1:172.21.15.93:6789/0 conn(0x7f38140c9d70 legacy=0x7f38140ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819481640 1 -- 172.21.15.93:0/3335134404 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223920981 0 0) 0x7f381406a120 con 0x7f38140c9d70 2023-11-04T01:36:58.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819c82640 1 -- 172.21.15.93:0/3335134404 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381406a650 con 0x7f381415d250 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819c82640 1 --2- 172.21.15.93:0/3335134404 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415d250 0x7f38140c9830 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f38040097a0 tx=0x7f380402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f357f8d85bcfb20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819481640 1 -- 172.21.15.93:0/3335134404 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804031830 con 0x7f381415d250 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819481640 1 -- 172.21.15.93:0/3335134404 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804031990 con 0x7f381415d250 2023-11-04T01:36:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.468+0000 7f3819481640 1 -- 172.21.15.93:0/3335134404 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804031d20 con 0x7f381415d250 2023-11-04T01:36:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 -- 172.21.15.93:0/3335134404 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415d250 msgr2=0x7f38140c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 --2- 172.21.15.93:0/3335134404 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415d250 0x7f38140c9830 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f38040097a0 tx=0x7f380402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 -- 172.21.15.93:0/3335134404 shutdown_connections 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 --2- 172.21.15.93:0/3335134404 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415d250 0x7f38140c9830 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 -- 172.21.15.93:0/3335134404 >> 172.21.15.93:0/3335134404 conn(0x7f38140b0cd0 msgr2=0x7f38140b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 -- 172.21.15.93:0/3335134404 shutdown_connections 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.469+0000 7f381c6e7640 1 -- 172.21.15.93:0/3335134404 wait complete. 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.470+0000 7f381c6e7640 1 Processor -- start 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.470+0000 7f381c6e7640 1 -- start start 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f381415d250 0x7f38140c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38140c7180 0x7f381415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140c7630 con 0x7f381415ce70 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38141f62f0 con 0x7f381415d250 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381c6e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38141f65d0 con 0x7f38140c7180 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38444/0 (socket says 172.21.15.93:38444) 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 -- 172.21.15.93:0/1736186764 learned_addr learned my addr 172.21.15.93:0/1736186764 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 -- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38140c7180 msgr2=0x7f381415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38140c7180 0x7f381415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 -- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f381415d250 msgr2=0x7f38140c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f381415d250 0x7f38140c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 -- 172.21.15.93:0/1736186764 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009400 con 0x7f381415ce70 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.471+0000 7f381a483640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f381000c7a0 tx=0x7f381000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.472+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810003d80 con 0x7f381415ce70 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.472+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810005070 con 0x7f381415ce70 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.472+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38141f68b0 con 0x7f381415ce70 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.472+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810005460 con 0x7f381415ce70 2023-11-04T01:36:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.472+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38141f6e70 con 0x7f381415ce70 2023-11-04T01:36:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.473+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3814074290 con 0x7f381415ce70 2023-11-04T01:36:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.473+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38100055c0 con 0x7f381415ce70 2023-11-04T01:36:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.473+0000 7f380affd640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 0x7f37f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.473+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3810088dd0 con 0x7f381415ce70 2023-11-04T01:36:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.473+0000 7f3819c82640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 0x7f37f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.474+0000 7f3819c82640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 0x7f37f806d360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f3804030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.478+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3810053ac0 con 0x7f381415ce70 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.644+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38140cd490 con 0x7f381415ce70 2023-11-04T01:36:58.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.646+0000 7f380affd640 1 -- 172.21.15.93:0/1736186764 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f3810080e60 con 0x7f381415ce70 2023-11-04T01:36:58.647 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:36:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 msgr2=0x7f37f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 0x7f37f806d360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f3804030000 comp rx=0 tx=0).stop 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 msgr2=0x7f38140c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f381000c7a0 tx=0x7f381000cc60 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 shutdown_connections 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f37f806aea0 0x7f37f806d360 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.647+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38140c7180 0x7f381415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.648+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f381415d250 0x7f38140c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.648+0000 7f381c6e7640 1 --2- 172.21.15.93:0/1736186764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f381415ce70 0x7f38140c5160 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.648+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 >> 172.21.15.93:0/1736186764 conn(0x7f38140b0cd0 msgr2=0x7f381406b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.648+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 shutdown_connections 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.648+0000 7f381c6e7640 1 -- 172.21.15.93:0/1736186764 wait complete. 2023-11-04T01:36:58.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:35:49.447878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:35:50.361372+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:35:54.088659+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:58.661 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:58.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.761+0000 7ff816656640 1 Processor -- start 2023-11-04T01:36:58.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.761+0000 7ff816656640 1 -- start start 2023-11-04T01:36:58.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff816656640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff810153e60 0x7ff81015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff816656640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8100b4880 0x7ff8100b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff816656640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100cde60 con 0x7ff8100cd6d0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff816656640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff810160f90 con 0x7ff810153e60 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff816656640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100b5200 con 0x7ff8100b4880 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff80f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff8100cd6d0 0x7ff810161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44492/0 (socket says 172.21.15.93:44492) 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.762+0000 7ff80f7fe640 1 -- 172.21.15.93:0/430802155 learned_addr learned my addr 172.21.15.93:0/430802155 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> v2:172.21.15.125:3300/0 conn(0x7ff810153e60 0x7ff81015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff814bf3640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8100b4880 0x7ff8100b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707806453 0 0) 0x7ff8100cde60 con 0x7ff8100cd6d0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f8003520 con 0x7ff8100cd6d0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1969247081 0 0) 0x7ff7f8003520 con 0x7ff8100cd6d0 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8100b4880 msgr2=0x7ff8100b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8100b4880 0x7ff8100b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 >> v2:172.21.15.125:3300/0 conn(0x7ff810153e60 msgr2=0x7ff81015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 --2- 172.21.15.93:0/430802155 >> v2:172.21.15.125:3300/0 conn(0x7ff810153e60 0x7ff81015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81015e400 con 0x7ff8100cd6d0 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff804001670 con 0x7ff8100cd6d0 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 >> v1:172.21.15.93:6789/0 conn(0x7ff8100cd6d0 legacy=0x7ff810161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7f8003970 0x7ff7f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f80047c0 0x7ff7f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8005180 0x7ff7f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810160f90 con 0x7ff7f8003970 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100b5200 con 0x7ff7f8005180 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f800bec0 con 0x7ff7f80047c0 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> v2:172.21.15.125:3300/0 conn(0x7ff810153e60 0x7ff81015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff814bf3640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8100b4880 0x7ff8100b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7f8003970 0x7ff7f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80f7fe640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f80047c0 0x7ff7f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff814bf3640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8005180 0x7ff7f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 -- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f80047c0 msgr2=0x7ff7f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f80047c0 0x7ff7f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 -- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8005180 msgr2=0x7ff7f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8005180 0x7ff7f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff80ffff640 1 -- 172.21.15.93:0/430802155 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8003520 con 0x7ff7f8003970 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.763+0000 7ff814bf3640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8005180 0x7ff7f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.764+0000 7ff80ffff640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7f8003970 0x7ff7f8003d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff800009ca0 tx=0x7ff7f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b76dcc4e356566c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.764+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800004020 con 0x7ff7f8003970 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.764+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800004180 con 0x7ff7f8003970 2023-11-04T01:36:58.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.764+0000 7ff80effd640 1 -- 172.21.15.93:0/430802155 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80002c960 con 0x7ff7f8003970 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 -- 172.21.15.93:0/430802155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7f8003970 msgr2=0x7ff7f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 --2- 172.21.15.93:0/430802155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7f8003970 0x7ff7f8003d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff800009ca0 tx=0x7ff7f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff814bf3640 1 -- 172.21.15.93:0/430802155 reap_dead start 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 -- 172.21.15.93:0/430802155 shutdown_connections 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 -- 172.21.15.93:0/430802155 >> 172.21.15.93:0/430802155 conn(0x7ff8100cf880 msgr2=0x7ff8100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 -- 172.21.15.93:0/430802155 shutdown_connections 2023-11-04T01:36:58.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.765+0000 7ff816656640 1 -- 172.21.15.93:0/430802155 wait complete. 2023-11-04T01:36:58.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.766+0000 7ff816656640 1 Processor -- start 2023-11-04T01:36:58.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.766+0000 7ff816656640 1 -- start start 2023-11-04T01:36:58.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 0x7ff8100b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 0x7ff8100cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810154450 con 0x7ff810152dc0 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100cc3b0 con 0x7ff8100cb5f0 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff816656640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100cc690 con 0x7ff7f8003970 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38462/0 (socket says 172.21.15.93:38462) 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 -- 172.21.15.93:0/806346444 learned_addr learned my addr 172.21.15.93:0/806346444 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 -- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 msgr2=0x7ff8100b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff814bf3640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 0x7ff8100cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80ffff640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 0x7ff8100b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 0x7ff8100b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 -- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 msgr2=0x7ff8100cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 0x7ff8100cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80f7fe640 1 -- 172.21.15.93:0/806346444 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100cc970 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff80ffff640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 0x7ff8100b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.767+0000 7ff814bf3640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 0x7ff8100cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff80f7fe640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff804004f40 tx=0x7ff8040074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400f750 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400f910 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8100ccc50 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400fcc0 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.768+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8101f2770 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.769+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810074290 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.769+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff80401d460 con 0x7ff810152dc0 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.770+0000 7ff80cff9640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 0x7ff7fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.770+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff804089a00 con 0x7ff810152dc0 2023-11-04T01:36:58.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.770+0000 7ff80ffff640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 0x7ff7fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.770+0000 7ff80ffff640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 0x7ff7fc06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff800035000 tx=0x7ff800030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.774+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff804058180 con 0x7ff810152dc0 2023-11-04T01:36:58.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.940+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8100d1d00 con 0x7ff810152dc0 2023-11-04T01:36:58.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.940+0000 7ff80cff9640 1 -- 172.21.15.93:0/806346444 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff804057d10 con 0x7ff810152dc0 2023-11-04T01:36:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 msgr2=0x7ff7fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 0x7ff7fc06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff800035000 tx=0x7ff800030000 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 msgr2=0x7ff8100b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff804004f40 tx=0x7ff8040074f0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 shutdown_connections 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7fc06aea0 0x7ff7fc06d360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8100cb5f0 0x7ff8100cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff810152dc0 0x7ff8100b7560 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 --2- 172.21.15.93:0/806346444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7f8003970 0x7ff8100b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 >> 172.21.15.93:0/806346444 conn(0x7ff8100cf880 msgr2=0x7ff81015eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 shutdown_connections 2023-11-04T01:36:58.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:58.942+0000 7ff816656640 1 -- 172.21.15.93:0/806346444 wait complete. 2023-11-04T01:36:58.954 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:59.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.055+0000 7f203c0fc640 1 Processor -- start 2023-11-04T01:36:59.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.055+0000 7f203c0fc640 1 -- start start 2023-11-04T01:36:59.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203c0fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 0x7f20340cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203c0fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 0x7f20340adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203c0fc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203415aff0 con 0x7f2034159c00 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203c0fc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340ae450 con 0x7f20340adac0 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203c0fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203415a3e0 con 0x7f20340c4ff0 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203a699640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 0x7f20340adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039697640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 0x7f20340cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039e98640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2034159c00 0x7f20340c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38370/0 (socket says 172.21.15.93:38370) 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039e98640 1 -- 172.21.15.93:0/1684501073 learned_addr learned my addr 172.21.15.93:0/1684501073 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039697640 1 -- 172.21.15.93:0/1684501073 >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 msgr2=0x7f20340adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039697640 1 --2- 172.21.15.93:0/1684501073 >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 0x7f20340adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039697640 1 -- 172.21.15.93:0/1684501073 >> v1:172.21.15.125:6789/0 conn(0x7f2034159c00 legacy=0x7f20340c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f2039697640 1 -- 172.21.15.93:0/1684501073 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203415a6c0 con 0x7f20340c4ff0 2023-11-04T01:36:59.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.056+0000 7f203a699640 1 --2- 172.21.15.93:0/1684501073 >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 0x7f20340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.057+0000 7f2039697640 1 --2- 172.21.15.93:0/1684501073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 0x7f20340cc890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc4900af0890d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.057+0000 7f2038e96640 1 -- 172.21.15.93:0/1684501073 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024031830 con 0x7f20340c4ff0 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.057+0000 7f2038e96640 1 -- 172.21.15.93:0/1684501073 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2024031990 con 0x7f20340c4ff0 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.057+0000 7f2038e96640 1 -- 172.21.15.93:0/1684501073 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024031d20 con 0x7f20340c4ff0 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 -- 172.21.15.93:0/1684501073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 msgr2=0x7f20340cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 --2- 172.21.15.93:0/1684501073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 0x7f20340cc890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 -- 172.21.15.93:0/1684501073 shutdown_connections 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 --2- 172.21.15.93:0/1684501073 >> v2:172.21.15.125:3300/0 conn(0x7f20340adac0 0x7f20340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 --2- 172.21.15.93:0/1684501073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20340c4ff0 0x7f20340cc890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 -- 172.21.15.93:0/1684501073 >> 172.21.15.93:0/1684501073 conn(0x7f20340ce950 msgr2=0x7f20340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 -- 172.21.15.93:0/1684501073 shutdown_connections 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.058+0000 7f203c0fc640 1 -- 172.21.15.93:0/1684501073 wait complete. 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.059+0000 7f203c0fc640 1 Processor -- start 2023-11-04T01:36:59.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.059+0000 7f203c0fc640 1 -- start start 2023-11-04T01:36:59.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20340adac0 0x7f2034150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 0x7f203413f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203413f0e0 con 0x7f20340c4ff0 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203413e4d0 con 0x7f20340adac0 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203c0fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203413e7b0 con 0x7f2034159c00 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38464/0 (socket says 172.21.15.93:38464) 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 -- 172.21.15.93:0/3153391307 learned_addr learned my addr 172.21.15.93:0/3153391307 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039e98640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20340adac0 0x7f2034150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203a699640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 0x7f203413f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 -- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 msgr2=0x7f203413f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 0x7f203413f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 -- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20340adac0 msgr2=0x7f2034150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20340adac0 0x7f2034150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 -- 172.21.15.93:0/3153391307 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009a70 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f203a699640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 0x7f203413f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.060+0000 7f2039697640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f202402bee0 tx=0x7f20240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202403a6f0 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202403a870 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2024009400 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202403ac20 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203413ed70 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.061+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203413f290 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.062+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f202404c3b0 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.062+0000 7f202a7fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.062+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20240ab5e0 con 0x7f20340c4ff0 2023-11-04T01:36:59.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.062+0000 7f2039e98640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.063+0000 7f2039e98640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 0x7f201806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2030005880 tx=0x7f2030009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.066+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f203413f290 con 0x7f20340c4ff0 2023-11-04T01:36:59.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.234+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2034074290 con 0x7f20340c4ff0 2023-11-04T01:36:59.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.234+0000 7f202a7fc640 1 -- 172.21.15.93:0/3153391307 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20240763f0 con 0x7f20340c4ff0 2023-11-04T01:36:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:59.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 msgr2=0x7f201806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 0x7f201806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2030005880 tx=0x7f2030009040 comp rx=0 tx=0).stop 2023-11-04T01:36:59.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 msgr2=0x7f203414e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f202402bee0 tx=0x7f20240046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 shutdown_connections 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2034159c00 0x7f203413f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20340c4ff0 0x7f203414e5a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 --2- 172.21.15.93:0/3153391307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20340adac0 0x7f2034150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 >> 172.21.15.93:0/3153391307 conn(0x7f20340ce950 msgr2=0x7f20340c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 shutdown_connections 2023-11-04T01:36:59.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.236+0000 7f203c0fc640 1 -- 172.21.15.93:0/3153391307 wait complete. 2023-11-04T01:36:59.249 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:59.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.349+0000 7fcd3c555640 1 Processor -- start 2023-11-04T01:36:59.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.349+0000 7fcd3c555640 1 -- start start 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.350+0000 7fcd3c555640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd340b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.350+0000 7fcd3c555640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340cde60 con 0x7fcd340cd6d0 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.350+0000 7fcd3c555640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd34160f90 con 0x7fcd34153e60 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.350+0000 7fcd3c555640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b5200 con 0x7fcd340b4880 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd39af0640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcd340cd6d0 0x7fcd34161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44504/0 (socket says 172.21.15.93:44504) 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd39af0640 1 -- 172.21.15.93:0/1624988216 learned_addr learned my addr 172.21.15.93:0/1624988216 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd3aaf2640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd340b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850274460 0 0) 0x7fcd340cde60 con 0x7fcd340cd6d0 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd20003520 con 0x7fcd340cd6d0 2023-11-04T01:36:59.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 862926424 0 0) 0x7fcd20003520 con 0x7fcd340cd6d0 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 msgr2=0x7fcd340b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd340b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 >> v1:172.21.15.125:6789/0 conn(0x7fcd34153e60 legacy=0x7fcd3415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340ce090 con 0x7fcd340cd6d0 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fcd24001670 con 0x7fcd340cd6d0 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 >> v1:172.21.15.93:6789/0 conn(0x7fcd340cd6d0 legacy=0x7fcd34161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd200039a0 0x7fcd20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b5200 con 0x7fcd200047c0 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2000ba60 con 0x7fcd200039a0 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2000bc20 con 0x7fcd340b4880 2023-11-04T01:36:59.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd39af0640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd3a2f1640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd200039a0 0x7fcd20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.351+0000 7fcd3aaf2640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 -- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 msgr2=0x7fcd20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 -- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd200039a0 msgr2=0x7fcd20003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd200039a0 0x7fcd20003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 -- 172.21.15.93:0/1624988216 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20003520 con 0x7fcd200047c0 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd3aaf2640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340b4880 0x7fcd20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:59.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.352+0000 7fcd39af0640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd20004c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcd34161b30 tx=0x7fcd200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e8b8d297dcf0ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24005ad0 con 0x7fcd200047c0 2023-11-04T01:36:59.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24005c50 con 0x7fcd200047c0 2023-11-04T01:36:59.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd392ef640 1 -- 172.21.15.93:0/1624988216 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2402c830 con 0x7fcd200047c0 2023-11-04T01:36:59.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 -- 172.21.15.93:0/1624988216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 msgr2=0x7fcd20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 --2- 172.21.15.93:0/1624988216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd20004c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcd34161b30 tx=0x7fcd200057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3aaf2640 1 -- 172.21.15.93:0/1624988216 reap_dead start 2023-11-04T01:36:59.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 -- 172.21.15.93:0/1624988216 shutdown_connections 2023-11-04T01:36:59.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 -- 172.21.15.93:0/1624988216 >> 172.21.15.93:0/1624988216 conn(0x7fcd340cf880 msgr2=0x7fcd340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 -- 172.21.15.93:0/1624988216 shutdown_connections 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.353+0000 7fcd3c555640 1 -- 172.21.15.93:0/1624988216 wait complete. 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.354+0000 7fcd3c555640 1 Processor -- start 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.354+0000 7fcd3c555640 1 -- start start 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340c6fc0 0x7fcd340c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd340c7440 0x7fcd340c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341555e0 con 0x7fcd200047c0 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341558c0 con 0x7fcd340c7440 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3c555640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34155ba0 con 0x7fcd340c6fc0 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3a2f1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3a2f1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38490/0 (socket says 172.21.15.93:38490) 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3a2f1640 1 -- 172.21.15.93:0/2104921208 learned_addr learned my addr 172.21.15.93:0/2104921208 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd39af0640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340c6fc0 0x7fcd340c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.355+0000 7fcd3aaf2640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd340c7440 0x7fcd340c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 -- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340c6fc0 msgr2=0x7fcd340c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340c6fc0 0x7fcd340c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 -- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd340c7440 msgr2=0x7fcd340c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd340c7440 0x7fcd340c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 -- 172.21.15.93:0/2104921208 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34155e80 con 0x7fcd200047c0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3a2f1640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000fb90 tx=0x7fcd3000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000fe90 con 0x7fcd200047c0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000dc30 con 0x7fcd200047c0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd340c6aa0 con 0x7fcd200047c0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30003970 con 0x7fcd200047c0 2023-11-04T01:36:59.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.356+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd340b7020 con 0x7fcd200047c0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.357+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd340c6900 con 0x7fcd200047c0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.357+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd30003ad0 con 0x7fcd200047c0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.358+0000 7fcd2affd640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 0x7fcd1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.358+0000 7fcd39af0640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 0x7fcd1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.358+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd30089b60 con 0x7fcd200047c0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.358+0000 7fcd39af0640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 0x7fcd1806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd24034000 tx=0x7fcd24009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.362+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd340c6900 con 0x7fcd200047c0 2023-11-04T01:36:59.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.527+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd340c6900 con 0x7fcd200047c0 2023-11-04T01:36:59.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.528+0000 7fcd2affd640 1 -- 172.21.15.93:0/2104921208 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd340c6900 con 0x7fcd200047c0 2023-11-04T01:36:59.529 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:36:59.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 msgr2=0x7fcd1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 0x7fcd1806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd24034000 tx=0x7fcd24009030 comp rx=0 tx=0).stop 2023-11-04T01:36:59.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 msgr2=0x7fcd341f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000fb90 tx=0x7fcd3000d520 comp rx=0 tx=0).stop 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 shutdown_connections 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd1806ae70 0x7fcd1806d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd340c7440 0x7fcd340c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd340c6fc0 0x7fcd340c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 --2- 172.21.15.93:0/2104921208 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd200047c0 0x7fcd341f1e50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 >> 172.21.15.93:0/2104921208 conn(0x7fcd340cf880 msgr2=0x7fcd3415efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 shutdown_connections 2023-11-04T01:36:59.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.530+0000 7fcd3c555640 1 -- 172.21.15.93:0/2104921208 wait complete. 2023-11-04T01:36:59.542 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.642+0000 7ffbad64f640 1 Processor -- start 2023-11-04T01:36:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.642+0000 7ffbad64f640 1 -- start start 2023-11-04T01:36:59.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffbad64f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffba80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffbad64f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffba80cd3b0 0x7ffba80cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffbad64f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80d01f0 con 0x7ffba80b64c0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffbad64f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80cc380 con 0x7ffba80cd3b0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffbad64f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cdd80 con 0x7ffba815af20 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffba67fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffba80b64c0 0x7ffba80cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44506/0 (socket says 172.21.15.93:44506) 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.643+0000 7ffba67fc640 1 -- 172.21.15.93:0/4116848440 learned_addr learned my addr 172.21.15.93:0/4116848440 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffba80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095914814 0 0) 0x7ffba80d01f0 con 0x7ffba80b64c0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 --2- 172.21.15.93:0/4116848440 >> v2:172.21.15.125:3300/0 conn(0x7ffba80cd3b0 0x7ffba80cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb90003520 con 0x7ffba80b64c0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661073385 0 0) 0x7ffb90003520 con 0x7ffba80b64c0 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 msgr2=0x7ffba80b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffba80b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 >> v2:172.21.15.125:3300/0 conn(0x7ffba80cd3b0 msgr2=0x7ffba80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 --2- 172.21.15.93:0/4116848440 >> v2:172.21.15.125:3300/0 conn(0x7ffba80cd3b0 0x7ffba80cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80b6a40 con 0x7ffba80b64c0 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ffb9c001670 con 0x7ffba80b64c0 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 >> v1:172.21.15.93:6789/0 conn(0x7ffba80b64c0 legacy=0x7ffba80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffb900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003f20 0x7ffb900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cc380 con 0x7ffb90004d00 2023-11-04T01:36:59.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cdd80 con 0x7ffb90003f20 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9000b980 con 0x7ffba815af20 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffb900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba67fc640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003f20 0x7ffb900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 -- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 msgr2=0x7ffb900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815af20 0x7ffb900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 -- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003f20 msgr2=0x7ffb900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003f20 0x7ffb900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.644+0000 7ffba77fe640 1 -- 172.21.15.93:0/4116848440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90003520 con 0x7ffb90004d00 2023-11-04T01:36:59.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.645+0000 7ffba77fe640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009ac0 tx=0x7ffb900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d6dff94cbc8880 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.645+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba002c710 con 0x7ffb90004d00 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.645+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba002c870 con 0x7ffb90004d00 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.645+0000 7ffba5ffb640 1 -- 172.21.15.93:0/4116848440 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba002cc00 con 0x7ffb90004d00 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 -- 172.21.15.93:0/4116848440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 msgr2=0x7ffb90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 --2- 172.21.15.93:0/4116848440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009ac0 tx=0x7ffb900057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffba77fe640 1 -- 172.21.15.93:0/4116848440 reap_dead start 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 -- 172.21.15.93:0/4116848440 shutdown_connections 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 -- 172.21.15.93:0/4116848440 >> 172.21.15.93:0/4116848440 conn(0x7ffba806ea20 msgr2=0x7ffba806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 -- 172.21.15.93:0/4116848440 shutdown_connections 2023-11-04T01:36:59.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.646+0000 7ffbad64f640 1 -- 172.21.15.93:0/4116848440 wait complete. 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.647+0000 7ffbad64f640 1 Processor -- start 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.647+0000 7ffbad64f640 1 -- start start 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 0x7ffba8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba81f3a40 con 0x7ffba81f0410 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8156ff0 con 0x7ffba8156630 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba81f11b0 con 0x7ffb90004d00 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38500/0 (socket says 172.21.15.93:38500) 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 -- 172.21.15.93:0/2205025624 learned_addr learned my addr 172.21.15.93:0/2205025624 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba67fc640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 0x7ffba8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 -- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 msgr2=0x7ffba80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba80b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 -- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 msgr2=0x7ffba8156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 0x7ffba8156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 -- 172.21.15.93:0/2205025624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba81f3c50 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba67fc640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 0x7ffba8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffba77fe640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009ac0 tx=0x7ffba0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba002c710 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0003830 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.648+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba81f3f30 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.649+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0003be0 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.649+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80b1a50 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.649+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba81f4450 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.650+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffba0003d40 con 0x7ffba81f0410 2023-11-04T01:36:59.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.650+0000 7ffb8f7fe640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 0x7ffb9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.650+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffba00aaa20 con 0x7ffba81f0410 2023-11-04T01:36:59.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.650+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 0x7ffb9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.651+0000 7ffba6ffd640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 0x7ffb9406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffba815a930 tx=0x7ffb9800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.654+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffba81f4450 con 0x7ffba81f0410 2023-11-04T01:36:59.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.818+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffba81f4450 con 0x7ffba81f0410 2023-11-04T01:36:59.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.818+0000 7ffb8f7fe640 1 -- 172.21.15.93:0/2205025624 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffba81f4450 con 0x7ffba81f0410 2023-11-04T01:36:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:36:59.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 msgr2=0x7ffb9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 0x7ffb9406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffba815a930 tx=0x7ffb9800b040 comp rx=0 tx=0).stop 2023-11-04T01:36:59.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 msgr2=0x7ffba81f08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009ac0 tx=0x7ffba0004730 comp rx=0 tx=0).stop 2023-11-04T01:36:59.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 shutdown_connections 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb9406ae70 0x7ffb9406d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba81f0410 0x7ffba81f08c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba8156630 0x7ffba8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 --2- 172.21.15.93:0/2205025624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 >> 172.21.15.93:0/2205025624 conn(0x7ffba806ea20 msgr2=0x7ffba80c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 shutdown_connections 2023-11-04T01:36:59.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.820+0000 7ffbad64f640 1 -- 172.21.15.93:0/2205025624 wait complete. 2023-11-04T01:36:59.833 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:59.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.930+0000 7ff678bc9640 1 Processor -- start 2023-11-04T01:36:59.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.930+0000 7ff678bc9640 1 -- start start 2023-11-04T01:36:59.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff674159c70 0x7ff6740ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff6740b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6740b0910 0x7ff67415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740b49b0 con 0x7ff674159c70 2023-11-04T01:36:59.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740b0da0 con 0x7ff6740b0910 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff678bc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740b4110 con 0x7ff67406db20 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff674159c70 0x7ff6740ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff674159c70 0x7ff6740ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38510/0 (socket says 172.21.15.93:38510) 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 -- 172.21.15.93:0/856050935 learned_addr learned my addr 172.21.15.93:0/856050935 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff672d9d640 1 --2- 172.21.15.93:0/856050935 >> v2:172.21.15.125:3300/0 conn(0x7ff6740b0910 0x7ff67415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff671d9b640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff6740b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 -- 172.21.15.93:0/856050935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 msgr2=0x7ff6740b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff6740b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 -- 172.21.15.93:0/856050935 >> v2:172.21.15.125:3300/0 conn(0x7ff6740b0910 msgr2=0x7ff67415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 --2- 172.21.15.93:0/856050935 >> v2:172.21.15.125:3300/0 conn(0x7ff6740b0910 0x7ff67415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff67259c640 1 -- 172.21.15.93:0/856050935 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740b43f0 con 0x7ff674159c70 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.931+0000 7ff671d9b640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff6740b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.932+0000 7ff67259c640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff674159c70 0x7ff6740ce370 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff6740ca130 tx=0x7ff66c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ab1b5d92777be0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.932+0000 7ff67159a640 1 -- 172.21.15.93:0/856050935 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c02ca70 con 0x7ff674159c70 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.932+0000 7ff67159a640 1 -- 172.21.15.93:0/856050935 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c02cbd0 con 0x7ff674159c70 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.932+0000 7ff67159a640 1 -- 172.21.15.93:0/856050935 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0343f0 con 0x7ff674159c70 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 -- 172.21.15.93:0/856050935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff674159c70 msgr2=0x7ff6740ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff674159c70 0x7ff6740ce370 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff6740ca130 tx=0x7ff66c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 -- 172.21.15.93:0/856050935 shutdown_connections 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 --2- 172.21.15.93:0/856050935 >> v2:172.21.15.125:3300/0 conn(0x7ff6740b0910 0x7ff67415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff6740b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 --2- 172.21.15.93:0/856050935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff674159c70 0x7ff6740ce370 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 -- 172.21.15.93:0/856050935 >> 172.21.15.93:0/856050935 conn(0x7ff6740ce950 msgr2=0x7ff6740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 -- 172.21.15.93:0/856050935 shutdown_connections 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.933+0000 7ff678bc9640 1 -- 172.21.15.93:0/856050935 wait complete. 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.934+0000 7ff678bc9640 1 Processor -- start 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.934+0000 7ff678bc9640 1 -- start start 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff67414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff674159c70 0x7ff67414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740c8660 con 0x7ff6740b0910 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740c79e0 con 0x7ff674159c70 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740c7cc0 con 0x7ff67406db20 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38514/0 (socket says 172.21.15.93:38514) 2023-11-04T01:36:59.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 -- 172.21.15.93:0/621091965 learned_addr learned my addr 172.21.15.93:0/621091965 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 -- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 msgr2=0x7ff67414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff67414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 -- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff674159c70 msgr2=0x7ff67414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff674159c70 0x7ff67414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 -- 172.21.15.93:0/621091965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c009b30 con 0x7ff6740b0910 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff671d9b640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e810 tx=0x7ff66800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668004030 con 0x7ff6740b0910 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668004190 con 0x7ff6740b0910 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6740c7fa0 con 0x7ff6740b0910 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668004520 con 0x7ff6740b0910 2023-11-04T01:36:59.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.935+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff674165e10 con 0x7ff6740b0910 2023-11-04T01:36:59.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.936+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff674074290 con 0x7ff6740b0910 2023-11-04T01:36:59.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.937+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff66800c6d0 con 0x7ff6740b0910 2023-11-04T01:36:59.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.937+0000 7ff662ffd640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 0x7ff65406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.937+0000 7ff67259c640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 0x7ff65406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.937+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff668089550 con 0x7ff6740b0910 2023-11-04T01:36:59.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.938+0000 7ff67259c640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 0x7ff65406d360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff66c035000 tx=0x7ff66c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:36:59.941+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff668054240 con 0x7ff6740b0910 2023-11-04T01:37:00.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.145+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff67406d3f0 con 0x7ff6740b0910 2023-11-04T01:37:00.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.145+0000 7ff662ffd640 1 -- 172.21.15.93:0/621091965 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7ff668057860 con 0x7ff6740b0910 2023-11-04T01:37:00.148 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:00.151 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:37:00.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 msgr2=0x7ff65406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 0x7ff65406d360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff66c035000 tx=0x7ff66c02e000 comp rx=0 tx=0).stop 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 msgr2=0x7ff6740c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e810 tx=0x7ff66800ecd0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 shutdown_connections 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff65406aea0 0x7ff65406d360 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff674159c70 0x7ff67414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6740b0910 0x7ff6740c6fb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 --2- 172.21.15.93:0/621091965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff67406db20 0x7ff67414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.147+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 >> 172.21.15.93:0/621091965 conn(0x7ff6740ce950 msgr2=0x7ff6740cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.148+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 shutdown_connections 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.148+0000 7ff678bc9640 1 -- 172.21.15.93:0/621091965 wait complete. 2023-11-04T01:37:00.160 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.260+0000 7f9313b55640 1 Processor -- start 2023-11-04T01:37:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.260+0000 7f9313b55640 1 -- start start 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f9313b55640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f9313b55640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 0x7f930c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f9313b55640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c1615d0 con 0x7f930c161050 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f9313b55640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c0cbde0 con 0x7f930c06bd30 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f9313b55640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1618b0 con 0x7f930c15ce60 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93110f0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 0x7f930c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:57126/0 (socket says 172.21.15.93:57126) 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 -- 172.21.15.93:0/625968616 learned_addr learned my addr 172.21.15.93:0/625968616 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93120f2640 1 --1- 172.21.15.93:0/625968616 >> v1:172.21.15.125:6789/0 conn(0x7f930c161050 0x7f930c0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38388/0 (socket says 172.21.15.93:38388) 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 -- 172.21.15.93:0/625968616 >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 msgr2=0x7f930c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 --2- 172.21.15.93:0/625968616 >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 0x7f930c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 -- 172.21.15.93:0/625968616 >> v1:172.21.15.125:6789/0 conn(0x7f930c161050 legacy=0x7f930c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93118f1640 1 -- 172.21.15.93:0/625968616 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0cba00 con 0x7f930c15ce60 2023-11-04T01:37:00.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.261+0000 7f93110f0640 1 --2- 172.21.15.93:0/625968616 >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 0x7f930c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:00.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.262+0000 7f93118f1640 1 --2- 172.21.15.93:0/625968616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f930802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=119e11267a77fc5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.262+0000 7f93108ef640 1 -- 172.21.15.93:0/625968616 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308030840 con 0x7f930c15ce60 2023-11-04T01:37:00.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.262+0000 7f93108ef640 1 -- 172.21.15.93:0/625968616 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93080309a0 con 0x7f930c15ce60 2023-11-04T01:37:00.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.262+0000 7f93108ef640 1 -- 172.21.15.93:0/625968616 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308030d30 con 0x7f930c15ce60 2023-11-04T01:37:00.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 -- 172.21.15.93:0/625968616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 msgr2=0x7f930c06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 --2- 172.21.15.93:0/625968616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9308009870 tx=0x7f930802b980 comp rx=0 tx=0).stop 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 -- 172.21.15.93:0/625968616 shutdown_connections 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 --2- 172.21.15.93:0/625968616 >> v2:172.21.15.125:3300/0 conn(0x7f930c06bd30 0x7f930c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 --2- 172.21.15.93:0/625968616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ce60 0x7f930c06b7f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 -- 172.21.15.93:0/625968616 >> 172.21.15.93:0/625968616 conn(0x7f930c06ea90 msgr2=0x7f930c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 -- 172.21.15.93:0/625968616 shutdown_connections 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.263+0000 7f9313b55640 1 -- 172.21.15.93:0/625968616 wait complete. 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.264+0000 7f9313b55640 1 Processor -- start 2023-11-04T01:37:00.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.264+0000 7f9313b55640 1 -- start start 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 0x7f930c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ee50 0x7f930c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c15e140 con 0x7f930c161050 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0ca560 con 0x7f930c15ce60 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c15e9c0 con 0x7f930c15ee50 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38522/0 (socket says 172.21.15.93:38522) 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 -- 172.21.15.93:0/521896721 learned_addr learned my addr 172.21.15.93:0/521896721 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93120f2640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ee50 0x7f930c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93118f1640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 0x7f930c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 -- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ee50 msgr2=0x7f930c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ee50 0x7f930c0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 -- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 msgr2=0x7f930c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 0x7f930c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 -- 172.21.15.93:0/521896721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc009400 con 0x7f930c161050 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93118f1640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 0x7f930c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93110f0640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e990 tx=0x7f92fc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00c9e0 con 0x7f930c161050 2023-11-04T01:37:00.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00cb40 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080094d0 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00ced0 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.265+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c0ca280 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.266+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c074290 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.267+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92fc013470 con 0x7f930c161050 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.267+0000 7f93027fc640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 0x7f92f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.267+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92fc089c10 con 0x7f930c161050 2023-11-04T01:37:00.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.267+0000 7f93118f1640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 0x7f92f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.268+0000 7f93118f1640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 0x7f92f006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9308036000 tx=0x7f9308008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.271+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92fc054900 con 0x7f930c161050 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.439+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f930c15eb00 con 0x7f930c161050 2023-11-04T01:37:00.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.440+0000 7f93027fc640 1 -- 172.21.15.93:0/521896721 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f92fc017090 con 0x7f930c161050 2023-11-04T01:37:00.442 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 msgr2=0x7f92f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 0x7f92f006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9308036000 tx=0x7f9308008030 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 msgr2=0x7f930c15ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e990 tx=0x7f92fc00ee50 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 shutdown_connections 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f92f006ae70 0x7f92f006d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f930c15ee50 0x7f930c0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f930c161050 0x7f930c15ff90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 --2- 172.21.15.93:0/521896721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f930c15ce60 0x7f930c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 >> 172.21.15.93:0/521896721 conn(0x7f930c06ea90 msgr2=0x7f930c072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 shutdown_connections 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.442+0000 7f9313b55640 1 -- 172.21.15.93:0/521896721 wait complete. 2023-11-04T01:37:00.455 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:00.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:00.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.553+0000 7f828740e640 1 Processor -- start 2023-11-04T01:37:00.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.553+0000 7f828740e640 1 -- start start 2023-11-04T01:37:00.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f828740e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 0x7f828006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f828740e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f828006cf20 0x7f82800b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f828740e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800c9880 con 0x7f82800b0d30 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f828740e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800b1140 con 0x7f828006cf20 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f828740e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800cd650 con 0x7f828015cf10 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f828006cf20 0x7f82800b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f828006cf20 0x7f82800b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38524/0 (socket says 172.21.15.93:38524) 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 -- 172.21.15.93:0/4212149391 learned_addr learned my addr 172.21.15.93:0/4212149391 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82859ab640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f82800b0d30 0x7f82800ca2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44514/0 (socket says 172.21.15.93:44514) 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82851aa640 1 --2- 172.21.15.93:0/4212149391 >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 0x7f828006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 -- 172.21.15.93:0/4212149391 >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 msgr2=0x7f828006c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 --2- 172.21.15.93:0/4212149391 >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 0x7f828006c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 -- 172.21.15.93:0/4212149391 >> v1:172.21.15.93:6789/0 conn(0x7f82800b0d30 legacy=0x7f82800ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82849a9640 1 -- 172.21.15.93:0/4212149391 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800cd930 con 0x7f828006cf20 2023-11-04T01:37:00.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.554+0000 7f82851aa640 1 --2- 172.21.15.93:0/4212149391 >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 0x7f828006c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f82849a9640 1 --2- 172.21.15.93:0/4212149391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828006cf20 0x7f82800b07f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82800cc6d0 tx=0x7f827002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555ad9632981ddc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f8277fff640 1 -- 172.21.15.93:0/4212149391 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270030860 con 0x7f828006cf20 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f8277fff640 1 -- 172.21.15.93:0/4212149391 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82700309c0 con 0x7f828006cf20 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f8277fff640 1 -- 172.21.15.93:0/4212149391 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270030d50 con 0x7f828006cf20 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 -- 172.21.15.93:0/4212149391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828006cf20 msgr2=0x7f82800b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 --2- 172.21.15.93:0/4212149391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828006cf20 0x7f82800b07f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82800cc6d0 tx=0x7f827002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 -- 172.21.15.93:0/4212149391 shutdown_connections 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 --2- 172.21.15.93:0/4212149391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828006cf20 0x7f82800b07f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 --2- 172.21.15.93:0/4212149391 >> v2:172.21.15.125:3300/0 conn(0x7f828015cf10 0x7f828006c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.555+0000 7f828740e640 1 -- 172.21.15.93:0/4212149391 >> 172.21.15.93:0/4212149391 conn(0x7f82800cb7f0 msgr2=0x7f82800cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.556+0000 7f828740e640 1 -- 172.21.15.93:0/4212149391 shutdown_connections 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.556+0000 7f828740e640 1 -- 172.21.15.93:0/4212149391 wait complete. 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 Processor -- start 2023-11-04T01:37:00.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 -- start start 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 0x7f82800c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8280156590 0x7f8280158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800c1d40 con 0x7f828015cf10 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b4680 con 0x7f82800b0d30 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f828740e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b3a70 con 0x7f8280156590 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f82849a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f82849a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38532/0 (socket says 172.21.15.93:38532) 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.557+0000 7f82849a9640 1 -- 172.21.15.93:0/1353951594 learned_addr learned my addr 172.21.15.93:0/1353951594 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82851aa640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 0x7f82800c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82859ab640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8280156590 0x7f8280158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 -- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8280156590 msgr2=0x7f8280158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8280156590 0x7f8280158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 -- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 msgr2=0x7f82800c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 0x7f82800c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 -- 172.21.15.93:0/1353951594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700094d0 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82851aa640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 0x7f82800c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f82849a9640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f827002b9e0 tx=0x7f8270004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270039d60 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270043400 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800b3d50 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700437b0 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.558+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800b4310 con 0x7f828015cf10 2023-11-04T01:37:00.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.559+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828015d2f0 con 0x7f828015cf10 2023-11-04T01:37:00.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.560+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8270043910 con 0x7f828015cf10 2023-11-04T01:37:00.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.560+0000 7f8275ffb640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 0x7f826406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.560+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f827003e070 con 0x7f828015cf10 2023-11-04T01:37:00.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.560+0000 7f82851aa640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 0x7f826406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.560+0000 7f82851aa640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 0x7f826406d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.564+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8270077a00 con 0x7f828015cf10 2023-11-04T01:37:00.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.769+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82800c9a80 con 0x7f828015cf10 2023-11-04T01:37:00.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.769+0000 7f8275ffb640 1 -- 172.21.15.93:0/1353951594 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f8270034090 con 0x7f828015cf10 2023-11-04T01:37:00.771 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:00.771 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:37:00.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 msgr2=0x7f826406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 0x7f826406d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:00.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 msgr2=0x7f82800b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f827002b9e0 tx=0x7f8270004730 comp rx=0 tx=0).stop 2023-11-04T01:37:00.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 shutdown_connections 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f826406ae70 0x7f826406d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8280156590 0x7f8280158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f828015cf10 0x7f82800b1cb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 --2- 172.21.15.93:0/1353951594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82800b0d30 0x7f82800c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.771+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 >> 172.21.15.93:0/1353951594 conn(0x7f82800cb7f0 msgr2=0x7f828015b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.772+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 shutdown_connections 2023-11-04T01:37:00.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.772+0000 7f828740e640 1 -- 172.21.15.93:0/1353951594 wait complete. 2023-11-04T01:37:00.784 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:00.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 Processor -- start 2023-11-04T01:37:00.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 -- start start 2023-11-04T01:37:00.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40540b42c0 0x7f40540c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40540ca070 con 0x7f40540c9c40 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405406cd00 con 0x7f40540b42c0 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.883+0000 7f405a1b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405406cfa0 con 0x7f405415ad80 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f4053fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f40540c9c40 0x7f4054070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44518/0 (socket says 172.21.15.93:44518) 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f4053fff640 1 -- 172.21.15.93:0/723651202 learned_addr learned my addr 172.21.15.93:0/723651202 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40537fe640 1 --2- 172.21.15.93:0/723651202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f4052ffd640 1 --2- 172.21.15.93:0/723651202 >> v2:172.21.15.125:3300/0 conn(0x7f40540b42c0 0x7f40540c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910126636 0 0) 0x7f40540ca070 con 0x7f40540c9c40 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f403c003520 con 0x7f40540c9c40 2023-11-04T01:37:00.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1767664515 0 0) 0x7f403c003520 con 0x7f40540c9c40 2023-11-04T01:37:00.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40537fe640 1 -- 172.21.15.93:0/723651202 >> v2:172.21.15.125:3300/0 conn(0x7f40540b42c0 msgr2=0x7f40540c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40537fe640 1 --2- 172.21.15.93:0/723651202 >> v2:172.21.15.125:3300/0 conn(0x7f40540b42c0 0x7f40540c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40537fe640 1 -- 172.21.15.93:0/723651202 >> v1:172.21.15.93:6789/0 conn(0x7f40540c9c40 legacy=0x7f4054070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.884+0000 7f40537fe640 1 -- 172.21.15.93:0/723651202 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405406d280 con 0x7f405415ad80 2023-11-04T01:37:00.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f40537fe640 1 --2- 172.21.15.93:0/723651202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405406c7c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40440097a0 tx=0x7f404402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6f5d17fcd4629ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404402f050 con 0x7f405415ad80 2023-11-04T01:37:00.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4044031500 con 0x7f405415ad80 2023-11-04T01:37:00.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f40527fc640 1 -- 172.21.15.93:0/723651202 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c001a10 con 0x7f405415ad80 2023-11-04T01:37:00.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 -- 172.21.15.93:0/723651202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 msgr2=0x7f405406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 --2- 172.21.15.93:0/723651202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405406c7c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40440097a0 tx=0x7f404402b820 comp rx=0 tx=0).stop 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 -- 172.21.15.93:0/723651202 shutdown_connections 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 --2- 172.21.15.93:0/723651202 >> v2:172.21.15.125:3300/0 conn(0x7f40540b42c0 0x7f40540c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 --2- 172.21.15.93:0/723651202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405406c7c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.885+0000 7f405a1b7640 1 -- 172.21.15.93:0/723651202 >> 172.21.15.93:0/723651202 conn(0x7f40540ce950 msgr2=0x7f40540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.886+0000 7f405a1b7640 1 -- 172.21.15.93:0/723651202 shutdown_connections 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.886+0000 7f405a1b7640 1 -- 172.21.15.93:0/723651202 wait complete. 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.887+0000 7f405a1b7640 1 Processor -- start 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.887+0000 7f405a1b7640 1 -- start start 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.887+0000 7f405a1b7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 0x7f40541f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.887+0000 7f405a1b7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.887+0000 7f405a1b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f405a1b7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40541f5ce0 con 0x7f40540c9c40 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f405a1b7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ccea0 con 0x7f40540b42c0 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f405a1b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ac5a0 con 0x7f405415ad80 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38546/0 (socket says 172.21.15.93:38546) 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 -- 172.21.15.93:0/713768879 learned_addr learned my addr 172.21.15.93:0/713768879 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f40537fe640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 0x7f40541f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4053fff640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 -- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 msgr2=0x7f405414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405414d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 -- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 msgr2=0x7f40541f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 0x7f40541f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 -- 172.21.15.93:0/713768879 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009400 con 0x7f40540c9c40 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f40537fe640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 0x7f40541f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4053fff640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f4052ffd640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f404800e870 tx=0x7f404800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480094f0 con 0x7f40540c9c40 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800c940 con 0x7f40540c9c40 2023-11-04T01:37:00.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40540ac880 con 0x7f40540c9c40 2023-11-04T01:37:00.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800ccf0 con 0x7f40540c9c40 2023-11-04T01:37:00.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.888+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40540ac270 con 0x7f40540c9c40 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.889+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40540cd010 con 0x7f40540c9c40 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.890+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4048013470 con 0x7f40540c9c40 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.890+0000 7f403bfff640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 0x7f404006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.890+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4048089af0 con 0x7f40540c9c40 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.890+0000 7f40537fe640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 0x7f404006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.891+0000 7f40537fe640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 0x7f404006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4044035000 tx=0x7f4044008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:00.894+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40540cd010 con 0x7f40540c9c40 2023-11-04T01:37:01.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.095+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40540cd010 con 0x7f40540c9c40 2023-11-04T01:37:01.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.095+0000 7f403bfff640 1 -- 172.21.15.93:0/713768879 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f40540cd010 con 0x7f40540c9c40 2023-11-04T01:37:01.097 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:01.097 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3747295099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3747295099},{"type":"v1","addr":"172.21.15.93:6835","nonce":3747295099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/490807518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":490807518},{"type":"v1","addr":"172.21.15.93:6837","nonce":490807518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1546250974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1546250974},{"type":"v1","addr":"172.21.15.125:6833","nonce":1546250974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:35:51.391271+0000","modified":"2023-11-04T01:36:08.444963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2694324946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2694324946},{"type":"v1","addr":"172.21.15.125:6835","nonce":2694324946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:01.097 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 9 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 msgr2=0x7f404006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 0x7f404006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4044035000 tx=0x7f4044008030 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 msgr2=0x7f40540ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f404800e870 tx=0x7f404800ed30 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 shutdown_connections 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f404006ae70 0x7f404006d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f405415ad80 0x7f405414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40540c9c40 0x7f40540ab8e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 --2- 172.21.15.93:0/713768879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40540b42c0 0x7f40541f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 >> 172.21.15.93:0/713768879 conn(0x7f40540ce950 msgr2=0x7f405415a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 shutdown_connections 2023-11-04T01:37:01.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.097+0000 7f405a1b7640 1 -- 172.21.15.93:0/713768879 wait complete. 2023-11-04T01:37:01.110 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:01.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.208+0000 7f52ed339640 1 Processor -- start 2023-11-04T01:37:01.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.208+0000 7f52ed339640 1 -- start start 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52ed339640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52e80ce240 0x7f52e8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52ed339640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52e8157540 0x7f52e80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52ed339640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e815e000 con 0x7f52e80cde60 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52ed339640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e815e5c0 con 0x7f52e80ce240 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52ed339640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e815e2e0 con 0x7f52e8157540 2023-11-04T01:37:01.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52e80ce240 0x7f52e8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f52e80ce240 0x7f52e8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38548/0 (socket says 172.21.15.93:38548) 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 -- 172.21.15.93:0/3989645251 learned_addr learned my addr 172.21.15.93:0/3989645251 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52e6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f52e80cde60 0x7f52e815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44524/0 (socket says 172.21.15.93:44524) 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 -- 172.21.15.93:0/3989645251 >> v2:172.21.15.125:3300/0 conn(0x7f52e8157540 msgr2=0x7f52e80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 --2- 172.21.15.93:0/3989645251 >> v2:172.21.15.125:3300/0 conn(0x7f52e8157540 0x7f52e80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 -- 172.21.15.93:0/3989645251 >> v1:172.21.15.93:6789/0 conn(0x7f52e80cde60 legacy=0x7f52e815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.209+0000 7f52dffff640 1 -- 172.21.15.93:0/3989645251 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e80d1120 con 0x7f52e80ce240 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52dffff640 1 --2- 172.21.15.93:0/3989645251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e80ce240 0x7f52e8157000 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52e80cf2e0 tx=0x7f52d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c094008969c2e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52e67fc640 1 -- 172.21.15.93:0/3989645251 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0030860 con 0x7f52e80ce240 2023-11-04T01:37:01.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52e67fc640 1 -- 172.21.15.93:0/3989645251 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d00309c0 con 0x7f52e80ce240 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52e67fc640 1 -- 172.21.15.93:0/3989645251 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0030d50 con 0x7f52e80ce240 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52ed339640 1 -- 172.21.15.93:0/3989645251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e80ce240 msgr2=0x7f52e8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.210+0000 7f52ed339640 1 --2- 172.21.15.93:0/3989645251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e80ce240 0x7f52e8157000 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52e80cf2e0 tx=0x7f52d002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 -- 172.21.15.93:0/3989645251 shutdown_connections 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 --2- 172.21.15.93:0/3989645251 >> v2:172.21.15.125:3300/0 conn(0x7f52e8157540 0x7f52e80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 --2- 172.21.15.93:0/3989645251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e80ce240 0x7f52e8157000 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 -- 172.21.15.93:0/3989645251 >> 172.21.15.93:0/3989645251 conn(0x7f52e8071f30 msgr2=0x7f52e80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 -- 172.21.15.93:0/3989645251 shutdown_connections 2023-11-04T01:37:01.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.211+0000 7f52ed339640 1 -- 172.21.15.93:0/3989645251 wait complete. 2023-11-04T01:37:01.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 Processor -- start 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 -- start start 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52e80cde60 0x7f52e80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e80ce240 0x7f52e81443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8145ef0 con 0x7f52e8157540 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8156200 con 0x7f52e80ce240 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.212+0000 7f52ed339640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8144f40 con 0x7f52e80cde60 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38556/0 (socket says 172.21.15.93:38556) 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 -- 172.21.15.93:0/4208150819 learned_addr learned my addr 172.21.15.93:0/4208150819 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:01.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 -- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52e80cde60 msgr2=0x7f52e80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52e80cde60 0x7f52e80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 -- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e80ce240 msgr2=0x7f52e81443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e80ce240 0x7f52e81443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 -- 172.21.15.93:0/4208150819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00094d0 con 0x7f52e8157540 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52e77fe640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f52e000b970 tx=0x7f52e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000cb40 con 0x7f52e8157540 2023-11-04T01:37:01.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e000ccc0 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e8145220 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0014680 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.213+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e81457e0 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.214+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e8146030 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.215+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52e001d3b0 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.215+0000 7f52df7fe640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 0x7f52c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.215+0000 7f52e6ffd640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 0x7f52c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.215+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52e0089950 con 0x7f52e8157540 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.215+0000 7f52e6ffd640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 0x7f52c806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52d80015e0 tx=0x7f52d80079c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.219+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52e8146030 con 0x7f52e8157540 2023-11-04T01:37:01.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.387+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52e8146030 con 0x7f52e8157540 2023-11-04T01:37:01.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.388+0000 7f52df7fe640 1 -- 172.21.15.93:0/4208150819 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18688 (secure 0 0 0) 0x7f52e8146030 con 0x7f52e8157540 2023-11-04T01:37:01.390 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:01.390 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":26,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:36:33.034482+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:35:49.447878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:35:50.361372+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:35:54.088659+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 msgr2=0x7f52c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 0x7f52c806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52d80015e0 tx=0x7f52d80079c0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 msgr2=0x7f52e81448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f52e000b970 tx=0x7f52e000be30 comp rx=0 tx=0).stop 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 shutdown_connections 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52c806ae70 0x7f52c806d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e8157540 0x7f52e81448e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e80ce240 0x7f52e81443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 --2- 172.21.15.93:0/4208150819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52e80cde60 0x7f52e80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 >> 172.21.15.93:0/4208150819 conn(0x7f52e8071f30 msgr2=0x7f52e80b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 shutdown_connections 2023-11-04T01:37:01.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.390+0000 7f52ed339640 1 -- 172.21.15.93:0/4208150819 wait complete. 2023-11-04T01:37:01.403 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:37:01.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.504+0000 7fd404bf5640 1 Processor -- start 2023-11-04T01:37:01.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.504+0000 7fd404bf5640 1 -- start start 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd404bf5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd400159c00 0x7fd4000cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd404bf5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40015aff0 con 0x7fd4000c48e0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd404bf5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40015a3e0 con 0x7fd4000ae1d0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd404bf5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40015a6c0 con 0x7fd400159c00 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd3fdd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd4000c48e0 0x7fd4000adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46934/0 (socket says 172.21.15.93:46934) 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.505+0000 7fd3fdd9b640 1 -- 172.21.15.93:0/39742030 learned_addr learned my addr 172.21.15.93:0/39742030 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fe59c640 1 --2- 172.21.15.93:0/39742030 >> v2:172.21.15.125:3300/0 conn(0x7fd400159c00 0x7fd4000cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980507555 0 0) 0x7fd40015aff0 con 0x7fd4000c48e0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e8003520 con 0x7fd4000c48e0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567547304 0 0) 0x7fd3e8003520 con 0x7fd4000c48e0 2023-11-04T01:37:01.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 >> v2:172.21.15.125:3300/0 conn(0x7fd400159c00 msgr2=0x7fd4000cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 --2- 172.21.15.93:0/39742030 >> v2:172.21.15.125:3300/0 conn(0x7fd400159c00 0x7fd4000cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 >> v1:172.21.15.125:6789/0 conn(0x7fd4000ae1d0 legacy=0x7fd4000709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40015a9a0 con 0x7fd4000c48e0 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fd3f4001670 con 0x7fd4000c48e0 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 >> v1:172.21.15.93:6789/0 conn(0x7fd4000c48e0 legacy=0x7fd4000adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3e8003970 0x7fd3e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e80047c0 0x7fd3e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd3e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40015a6c0 con 0x7fd3e8005180 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e800c120 con 0x7fd3e80047c0 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e800c2e0 con 0x7fd3e8003970 2023-11-04T01:37:01.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd3e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fdd9b640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e80047c0 0x7fd3e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fe59c640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3e8003970 0x7fd3e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 -- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3e8003970 msgr2=0x7fd3e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3e8003970 0x7fd3e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 -- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e80047c0 msgr2=0x7fd3e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e80047c0 0x7fd3e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.506+0000 7fd3fed9d640 1 -- 172.21.15.93:0/39742030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8003520 con 0x7fd3e8005180 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.507+0000 7fd3fed9d640 1 -- 172.21.15.93:0/39742030 reap_dead start 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.507+0000 7fd3fed9d640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd3e800b980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8001750 tx=0x7fd3e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258af814f71f1ee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.507+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80052d0 con 0x7fd3e8005180 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.507+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f802e050 con 0x7fd3e8005180 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.507+0000 7fd3fd59a640 1 -- 172.21.15.93:0/39742030 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8003830 con 0x7fd3e8005180 2023-11-04T01:37:01.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 -- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 msgr2=0x7fd3e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd3e800b980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8001750 tx=0x7fd3e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 -- 172.21.15.93:0/39742030 shutdown_connections 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 --2- 172.21.15.93:0/39742030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd3e800b980 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 -- 172.21.15.93:0/39742030 >> 172.21.15.93:0/39742030 conn(0x7fd4000ce950 msgr2=0x7fd4000ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 -- 172.21.15.93:0/39742030 shutdown_connections 2023-11-04T01:37:01.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.508+0000 7fd404bf5640 1 -- 172.21.15.93:0/39742030 wait complete. 2023-11-04T01:37:01.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.509+0000 7fd404bf5640 1 Processor -- start 2023-11-04T01:37:01.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.509+0000 7fd404bf5640 1 -- start start 2023-11-04T01:37:01.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000c82a0 0x7fd400153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4001535a0 0x7fd40014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd400153a50 con 0x7fd3e8005180 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40014ac20 con 0x7fd4000c82a0 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd404bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000c5e00 con 0x7fd4001535a0 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41110/0 (socket says 172.21.15.93:41110) 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 -- 172.21.15.93:0/720798869 learned_addr learned my addr 172.21.15.93:0/720798869 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 -- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4001535a0 msgr2=0x7fd40014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4001535a0 0x7fd40014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 -- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000c82a0 msgr2=0x7fd400153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000c82a0 0x7fd400153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 -- 172.21.15.93:0/720798869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000c60e0 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.510+0000 7fd3fe59c640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f90 tx=0x7fd3f000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.511+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000e040 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.511+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f000f040 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.511+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000c63c0 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.511+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0015670 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.511+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000c7eb0 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.512+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000c68e0 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.512+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3f00157d0 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.512+0000 7fd3eeffd640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 0x7fd3e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.513+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3f008a720 con 0x7fd3e8005180 2023-11-04T01:37:01.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.513+0000 7fd3fdd9b640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 0x7fd3e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.513+0000 7fd3fdd9b640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 0x7fd3e006d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000f60 tx=0x7fd3f4000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.517+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4000c68e0 con 0x7fd3e8005180 2023-11-04T01:37:01.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.715+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd4000c68e0 con 0x7fd3e8005180 2023-11-04T01:37:01.717 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:37:01.716+0000 7f76f40f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:37:01.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.717+0000 7fd3eeffd640 1 -- 172.21.15.93:0/720798869 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd4000c68e0 con 0x7fd3e8005180 2023-11-04T01:37:01.719 INFO:teuthology.orchestra.run.smithi093.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 msgr2=0x7fd3e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 0x7fd3e006d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000f60 tx=0x7fd3f4000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 msgr2=0x7fd40014a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f90 tx=0x7fd3f000f580 comp rx=0 tx=0).stop 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 shutdown_connections 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3e006ae70 0x7fd3e006d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4001535a0 0x7fd40014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000c82a0 0x7fd400153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 --2- 172.21.15.93:0/720798869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3e8005180 0x7fd40014a6e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.720+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 >> 172.21.15.93:0/720798869 conn(0x7fd4000ce950 msgr2=0x7fd4000c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.721+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 shutdown_connections 2023-11-04T01:37:01.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.721+0000 7fd404bf5640 1 -- 172.21.15.93:0/720798869 wait complete. 2023-11-04T01:37:01.725 INFO:tasks.ceph.mds.d.smithi125.stderr: -4582> 2023-11-04T01:35:56.035+0000 7f699b707640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:01.733 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:37:01.755 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:37:01.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.833+0000 7fc653bf5640 1 Processor -- start 2023-11-04T01:37:01.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 -- start start 2023-11-04T01:37:01.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc64c0cd6d0 0x7fc64c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 0x7fc64c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0cde60 con 0x7fc64c153e60 2023-11-04T01:37:01.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c160f90 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc653bf5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c161960 con 0x7fc64c0b4880 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.834+0000 7fc651190640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc64c0cd6d0 0x7fc64c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc64c0cd6d0 0x7fc64c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41120/0 (socket says 172.21.15.93:41120) 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 -- 172.21.15.93:0/1213210041 learned_addr learned my addr 172.21.15.93:0/1213210041 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc652192640 1 --2- 172.21.15.93:0/1213210041 >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 0x7fc64c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 -- 172.21.15.93:0/1213210041 >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 msgr2=0x7fc64c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 --2- 172.21.15.93:0/1213210041 >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 0x7fc64c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 -- 172.21.15.93:0/1213210041 >> v1:172.21.15.125:6789/0 conn(0x7fc64c153e60 legacy=0x7fc64c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 -- 172.21.15.93:0/1213210041 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0b5220 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc652192640 1 --2- 172.21.15.93:0/1213210041 >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 0x7fc64c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:01.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.835+0000 7fc651190640 1 --2- 172.21.15.93:0/1213210041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0cd6d0 0x7fc64c161420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0b8f40 tx=0x7fc63c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0285ec6f42daa59 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc65098f640 1 -- 172.21.15.93:0/1213210041 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c031870 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc65098f640 1 -- 172.21.15.93:0/1213210041 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0319d0 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc65098f640 1 -- 172.21.15.93:0/1213210041 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c031d60 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 -- 172.21.15.93:0/1213210041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0cd6d0 msgr2=0x7fc64c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 --2- 172.21.15.93:0/1213210041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0cd6d0 0x7fc64c161420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0b8f40 tx=0x7fc63c02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 -- 172.21.15.93:0/1213210041 shutdown_connections 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 --2- 172.21.15.93:0/1213210041 >> v2:172.21.15.125:3300/0 conn(0x7fc64c0b4880 0x7fc64c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 --2- 172.21.15.93:0/1213210041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0cd6d0 0x7fc64c161420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 -- 172.21.15.93:0/1213210041 >> 172.21.15.93:0/1213210041 conn(0x7fc64c0cf880 msgr2=0x7fc64c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 -- 172.21.15.93:0/1213210041 shutdown_connections 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.836+0000 7fc653bf5640 1 -- 172.21.15.93:0/1213210041 wait complete. 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.837+0000 7fc653bf5640 1 Processor -- start 2023-11-04T01:37:01.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 -- start start 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc64c0cd6d0 0x7fc64c1f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc64c153e60 0x7fc64c1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c158bc0 con 0x7fc64c0b4880 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0c77a0 con 0x7fc64c153e60 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc653bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0c7a80 con 0x7fc64c0cd6d0 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc651991640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc651991640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41126/0 (socket says 172.21.15.93:41126) 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc651991640 1 -- 172.21.15.93:0/3454003964 learned_addr learned my addr 172.21.15.93:0/3454003964 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc652192640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc64c153e60 0x7fc64c1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.838+0000 7fc651190640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc64c0cd6d0 0x7fc64c1f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 -- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc64c0cd6d0 msgr2=0x7fc64c1f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc64c0cd6d0 0x7fc64c1f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 -- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc64c153e60 msgr2=0x7fc64c1f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc64c153e60 0x7fc64c1f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 -- 172.21.15.93:0/3454003964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0094d0 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc651991640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ba50 tx=0x7fc64800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800cc10 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800cd70 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c158e10 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648014680 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.839+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c1f25d0 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.840+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c159330 con 0x7fc64c0b4880 2023-11-04T01:37:01.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.840+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc64801d3b0 con 0x7fc64c0b4880 2023-11-04T01:37:01.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.841+0000 7fc6427fc640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 0x7fc63006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:01.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.841+0000 7fc651190640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 0x7fc63006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:01.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.841+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc6480899d0 con 0x7fc64c0b4880 2023-11-04T01:37:01.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.841+0000 7fc651190640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 0x7fc63006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc63c036000 tx=0x7fc63c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:01.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:01.845+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc64c159330 con 0x7fc64c0b4880 2023-11-04T01:37:02.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.049+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc64c159330 con 0x7fc64c0b4880 2023-11-04T01:37:02.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.719+0000 7fc6427fc640 1 -- 172.21.15.93:0/3454003964 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc64c159330 con 0x7fc64c0b4880 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 msgr2=0x7fc63006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 0x7fc63006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc63c036000 tx=0x7fc63c03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 msgr2=0x7fc64c1f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ba50 tx=0x7fc64800bf10 comp rx=0 tx=0).stop 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 shutdown_connections 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc63006ae70 0x7fc63006d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc64c153e60 0x7fc64c1f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc64c0cd6d0 0x7fc64c1f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 --2- 172.21.15.93:0/3454003964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc64c0b4880 0x7fc64c1f2090 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.721+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 >> 172.21.15.93:0/3454003964 conn(0x7fc64c0cf880 msgr2=0x7fc64c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.722+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 shutdown_connections 2023-11-04T01:37:02.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.722+0000 7fc653bf5640 1 -- 172.21.15.93:0/3454003964 wait complete. 2023-11-04T01:37:02.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:37:02.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.839+0000 7f4ce6cc2640 1 Processor -- start 2023-11-04T01:37:02.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 -- start start 2023-11-04T01:37:02.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4ce015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ce00d17b0 0x7f4ce00d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00d1320 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce015e4d0 con 0x7f4ce00d17b0 2023-11-04T01:37:02.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce6cc2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015df10 con 0x7f4ce015d4b0 2023-11-04T01:37:02.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce4a5e640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4ce00cd9f0 0x7f4ce00cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46944/0 (socket says 172.21.15.93:46944) 2023-11-04T01:37:02.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.840+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/1988514376 learned_addr learned my addr 172.21.15.93:0/1988514376 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097087574 0 0) 0x7f4ce00d1320 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdffff640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4ce015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd0003520 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4ce525f640 1 --2- 172.21.15.93:0/1988514376 >> v2:172.21.15.125:3300/0 conn(0x7f4ce00d17b0 0x7f4ce00d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044263076 0 0) 0x7f4cd0003520 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 msgr2=0x7f4ce015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4ce015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 >> v2:172.21.15.125:3300/0 conn(0x7f4ce00d17b0 msgr2=0x7f4ce00d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 --2- 172.21.15.93:0/1988514376 >> v2:172.21.15.125:3300/0 conn(0x7f4ce00d17b0 0x7f4ce00d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce015e1f0 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4cd4001670 con 0x7f4ce00cd9f0 2023-11-04T01:37:02.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 >> v1:172.21.15.93:6789/0 conn(0x7f4ce00cd9f0 legacy=0x7f4ce00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4cd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cd00047c0 0x7f4cd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4cd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015e4d0 con 0x7f4cd0003970 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015df10 con 0x7f4cd00047c0 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd000b980 con 0x7f4ce015d4b0 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4cd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4cdffff640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cd00047c0 0x7f4cd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.841+0000 7f4ce525f640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4cd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 msgr2=0x7f4cd0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4cd0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cd00047c0 msgr2=0x7f4cd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cd00047c0 0x7f4cd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/1988514376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0003520 con 0x7f4cd0003970 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce525f640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce015d4b0 0x7f4cd0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4cd0003d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c290 tx=0x7f4cd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c3c24ca3061532 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4005ad0 con 0x7f4cd0003970 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4005c30 con 0x7f4cd0003970 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.842+0000 7f4cdf7fe640 1 -- 172.21.15.93:0/1988514376 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd402c8d0 con 0x7f4cd0003970 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/1988514376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 msgr2=0x7f4cd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/1988514376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4cd0003d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c290 tx=0x7f4cd00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce525f640 1 -- 172.21.15.93:0/1988514376 reap_dead start 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/1988514376 shutdown_connections 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/1988514376 >> 172.21.15.93:0/1988514376 conn(0x7f4ce0071c40 msgr2=0x7f4ce0072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:02.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/1988514376 shutdown_connections 2023-11-04T01:37:02.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.843+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/1988514376 wait complete. 2023-11-04T01:37:02.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.844+0000 7f4ce6cc2640 1 Processor -- start 2023-11-04T01:37:02.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.844+0000 7f4ce6cc2640 1 -- start start 2023-11-04T01:37:02.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00b7700 0x7f4ce00b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 0x7f4ce01e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce01e7130 con 0x7f4cd0003970 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00b6c40 con 0x7f4ce01e6770 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce6cc2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00b6030 con 0x7f4ce00b7700 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41148/0 (socket says 172.21.15.93:41148) 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/3077034008 learned_addr learned my addr 172.21.15.93:0/3077034008 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00b7700 msgr2=0x7f4ce00b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00b7700 0x7f4ce00b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce525f640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 0x7f4ce01e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 msgr2=0x7f4ce01e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 0x7f4ce01e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce4a5e640 1 -- 172.21.15.93:0/3077034008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00b6310 con 0x7f4cd0003970 2023-11-04T01:37:02.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.845+0000 7f4ce525f640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 0x7f4ce01e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4ce4a5e640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c3b0 tx=0x7f4cd4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd402cce0 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4001ca0 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40072b0 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce00b65f0 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.846+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce014d7e0 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.847+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00b4010 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.847+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4cd4032070 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.848+0000 7f4cdd7fa640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 0x7f4cc406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.848+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4cd403c040 con 0x7f4cd0003970 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.848+0000 7f4cdffff640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 0x7f4cc406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:02.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.848+0000 7f4cdffff640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 0x7f4cc406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ce01e7330 tx=0x7f4ccc009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:02.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:02.852+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ce00b4010 con 0x7f4cd0003970 2023-11-04T01:37:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.017+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ce00b4010 con 0x7f4cd0003970 2023-11-04T01:37:03.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.720+0000 7f4cdd7fa640 1 -- 172.21.15.93:0/3077034008 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4ce00b4010 con 0x7f4cd0003970 2023-11-04T01:37:03.722 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 msgr2=0x7f4cc406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 0x7f4cc406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ce01e7330 tx=0x7f4ccc009320 comp rx=0 tx=0).stop 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 msgr2=0x7f4ce014d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c3b0 tx=0x7f4cd4000fe0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 shutdown_connections 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cc406aea0 0x7f4cc406d360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ce01e6770 0x7f4ce01e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ce00b7700 0x7f4ce00b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 --2- 172.21.15.93:0/3077034008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cd0003970 0x7f4ce014d2a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 >> 172.21.15.93:0/3077034008 conn(0x7f4ce0071c40 msgr2=0x7f4ce0072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 shutdown_connections 2023-11-04T01:37:03.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.724+0000 7f4ce6cc2640 1 -- 172.21.15.93:0/3077034008 wait complete. 2023-11-04T01:37:03.740 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:37:03.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.846+0000 7fbd682da640 1 Processor -- start 2023-11-04T01:37:03.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.846+0000 7fbd682da640 1 -- start start 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd682da640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd6015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd682da640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd600d17b0 0x7fbd600d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd682da640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd600d1320 con 0x7fbd600cd9f0 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd682da640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6015e4d0 con 0x7fbd600d17b0 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd682da640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6015df10 con 0x7fbd6015d4b0 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd600d17b0 0x7fbd600d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd600d17b0 0x7fbd600d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41156/0 (socket says 172.21.15.93:41156) 2023-11-04T01:37:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 -- 172.21.15.93:0/3664454732 learned_addr learned my addr 172.21.15.93:0/3664454732 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd65875640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd6015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 -- 172.21.15.93:0/3664454732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 msgr2=0x7fbd6015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd6015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 -- 172.21.15.93:0/3664454732 >> v1:172.21.15.125:6789/0 conn(0x7fbd600cd9f0 legacy=0x7fbd600cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.847+0000 7fbd66877640 1 -- 172.21.15.93:0/3664454732 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6015e1f0 con 0x7fbd600d17b0 2023-11-04T01:37:03.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.848+0000 7fbd66877640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600d1c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab4765810baa113 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.848+0000 7fbd65074640 1 -- 172.21.15.93:0/3664454732 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5802cb90 con 0x7fbd600d17b0 2023-11-04T01:37:03.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.848+0000 7fbd65074640 1 -- 172.21.15.93:0/3664454732 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5802ccf0 con 0x7fbd600d17b0 2023-11-04T01:37:03.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.848+0000 7fbd65074640 1 -- 172.21.15.93:0/3664454732 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58034610 con 0x7fbd600d17b0 2023-11-04T01:37:03.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 -- 172.21.15.93:0/3664454732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 msgr2=0x7fbd600d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600d1c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5802bff0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 -- 172.21.15.93:0/3664454732 shutdown_connections 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600d1c30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 --2- 172.21.15.93:0/3664454732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd6015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 -- 172.21.15.93:0/3664454732 >> 172.21.15.93:0/3664454732 conn(0x7fbd60071c40 msgr2=0x7fbd60072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 -- 172.21.15.93:0/3664454732 shutdown_connections 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.849+0000 7fbd682da640 1 -- 172.21.15.93:0/3664454732 wait complete. 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.850+0000 7fbd682da640 1 Processor -- start 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.850+0000 7fbd682da640 1 -- start start 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd600cd9f0 0x7fbd6014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd600cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b4d00 con 0x7fbd600d17b0 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b4fe0 con 0x7fbd600cd9f0 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b52c0 con 0x7fbd6015d4b0 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41170/0 (socket says 172.21.15.93:41170) 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 -- 172.21.15.93:0/756534835 learned_addr learned my addr 172.21.15.93:0/756534835 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd66877640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd600cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 -- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 msgr2=0x7fbd600cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd600cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 -- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd600cd9f0 msgr2=0x7fbd6014d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd600cd9f0 0x7fbd6014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 -- 172.21.15.93:0/756534835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009b30 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd65875640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000d5d0 tx=0x7fbd5000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500125f0 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50012770 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600b55a0 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50012b20 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.851+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600b35d0 con 0x7fbd600d17b0 2023-11-04T01:37:03.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.852+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6014b660 con 0x7fbd600d17b0 2023-11-04T01:37:03.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.853+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd50012c80 con 0x7fbd600d17b0 2023-11-04T01:37:03.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.853+0000 7fbd56ffd640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 0x7fbd4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.853+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fbd50089df0 con 0x7fbd600d17b0 2023-11-04T01:37:03.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.853+0000 7fbd66076640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 0x7fbd4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.854+0000 7fbd66076640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 0x7fbd4406d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000f60 tx=0x7fbd5c0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:03.857+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd6014b660 con 0x7fbd600d17b0 2023-11-04T01:37:04.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.025+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd6014b660 con 0x7fbd600d17b0 2023-11-04T01:37:04.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.722+0000 7fbd56ffd640 1 -- 172.21.15.93:0/756534835 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbd6014b660 con 0x7fbd600d17b0 2023-11-04T01:37:04.724 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' removed 2023-11-04T01:37:04.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 msgr2=0x7fbd4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 0x7fbd4406d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000f60 tx=0x7fbd5c0079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 msgr2=0x7fbd600b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000d5d0 tx=0x7fbd5000da90 comp rx=0 tx=0).stop 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 shutdown_connections 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbd4406ae70 0x7fbd4406d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd6015d4b0 0x7fbd600cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd600d17b0 0x7fbd600b4260 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 --2- 172.21.15.93:0/756534835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd600cd9f0 0x7fbd6014d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.726+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 >> 172.21.15.93:0/756534835 conn(0x7fbd60071c40 msgr2=0x7fbd6015e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.727+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 shutdown_connections 2023-11-04T01:37:04.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.727+0000 7fbd682da640 1 -- 172.21.15.93:0/756534835 wait complete. 2023-11-04T01:37:04.745 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-04T01:37:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.852+0000 7fcf5e461640 1 Processor -- start 2023-11-04T01:37:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.852+0000 7fcf5e461640 1 -- start start 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf5e461640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcf5815d1b0 0x7fcf580ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf5e461640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58161870 con 0x7fcf580cecf0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf5e461640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58160c60 con 0x7fcf580cdc50 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf5e461640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf58160f40 con 0x7fcf5815d1b0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf577fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcf580cecf0 0x7fcf580cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46956/0 (socket says 172.21.15.93:46956) 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf577fe640 1 -- 172.21.15.93:0/1672755578 learned_addr learned my addr 172.21.15.93:0/1672755578 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606517269 0 0) 0x7fcf58161870 con 0x7fcf580cecf0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf40003520 con 0x7fcf580cecf0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.853+0000 7fcf57fff640 1 --2- 172.21.15.93:0/1672755578 >> v2:172.21.15.125:3300/0 conn(0x7fcf5815d1b0 0x7fcf580ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560254381 0 0) 0x7fcf40003520 con 0x7fcf580cecf0 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 >> v2:172.21.15.125:3300/0 conn(0x7fcf5815d1b0 msgr2=0x7fcf580ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 --2- 172.21.15.93:0/1672755578 >> v2:172.21.15.125:3300/0 conn(0x7fcf5815d1b0 0x7fcf580ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 >> v1:172.21.15.125:6789/0 conn(0x7fcf580cdc50 legacy=0x7fcf5815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58161220 con 0x7fcf580cecf0 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fcf4c001670 con 0x7fcf580cecf0 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 >> v1:172.21.15.93:6789/0 conn(0x7fcf580cecf0 legacy=0x7fcf580cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 0x7fcf40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf400047c0 0x7fcf40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40005180 0x7fcf4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58160f40 con 0x7fcf40003970 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4000c020 con 0x7fcf40005180 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4000c1e0 con 0x7fcf400047c0 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 0x7fcf40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf577fe640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf400047c0 0x7fcf40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf5c9fe640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40005180 0x7fcf4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 -- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf400047c0 msgr2=0x7fcf40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:04.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf400047c0 0x7fcf40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 -- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40005180 msgr2=0x7fcf4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:04.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40005180 0x7fcf4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf57fff640 1 -- 172.21.15.93:0/1672755578 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40003520 con 0x7fcf40003970 2023-11-04T01:37:04.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf5c9fe640 1 -- 172.21.15.93:0/1672755578 reap_dead start 2023-11-04T01:37:04.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.854+0000 7fcf577fe640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf400047c0 0x7fcf40004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:04.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf57fff640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 0x7fcf40003d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009ac0 tx=0x7fcf400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d23238be77c2a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4802c6b0 con 0x7fcf40003970 2023-11-04T01:37:04.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4802c810 con 0x7fcf40003970 2023-11-04T01:37:04.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf56ffd640 1 -- 172.21.15.93:0/1672755578 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4802cba0 con 0x7fcf40003970 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf5e461640 1 -- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 msgr2=0x7fcf40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf5e461640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 0x7fcf40003d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009ac0 tx=0x7fcf400057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf5e461640 1 -- 172.21.15.93:0/1672755578 shutdown_connections 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.855+0000 7fcf5e461640 1 --2- 172.21.15.93:0/1672755578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf40003970 0x7fcf40003d90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.856+0000 7fcf5e461640 1 -- 172.21.15.93:0/1672755578 >> 172.21.15.93:0/1672755578 conn(0x7fcf5806ea20 msgr2=0x7fcf5806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.856+0000 7fcf5e461640 1 -- 172.21.15.93:0/1672755578 shutdown_connections 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.856+0000 7fcf5e461640 1 -- 172.21.15.93:0/1672755578 wait complete. 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.857+0000 7fcf5e461640 1 Processor -- start 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.857+0000 7fcf5e461640 1 -- start start 2023-11-04T01:37:04.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40003970 0x7fcf580c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf580c8a00 0x7fcf5815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c8e80 con 0x7fcf58150ff0 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c6050 con 0x7fcf40003970 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5815f4a0 con 0x7fcf580c8a00 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41196/0 (socket says 172.21.15.93:41196) 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 -- 172.21.15.93:0/288083230 learned_addr learned my addr 172.21.15.93:0/288083230 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf57fff640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40003970 0x7fcf580c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 -- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf580c8a00 msgr2=0x7fcf5815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf580c8a00 0x7fcf5815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 -- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40003970 msgr2=0x7fcf580c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40003970 0x7fcf580c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 -- 172.21.15.93:0/288083230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580c62a0 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf577fe640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e760 tx=0x7fcf4c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00ee70 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00c870 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580c6580 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00cbe0 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.858+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58151470 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.859+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58151630 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.860+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf4c00cd40 con 0x7fcf58150ff0 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.860+0000 7fcf54ff9640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 0x7fcf4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:04.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.860+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fcf4c089570 con 0x7fcf58150ff0 2023-11-04T01:37:04.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.860+0000 7fcf57fff640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 0x7fcf4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:04.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.860+0000 7fcf57fff640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 0x7fcf4406d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf48036000 tx=0x7fcf48030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:04.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:04.864+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf4c058060 con 0x7fcf58150ff0 2023-11-04T01:37:05.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.036+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf5804e490 con 0x7fcf58150ff0 2023-11-04T01:37:05.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.740+0000 7fcf54ff9640 1 -- 172.21.15.93:0/288083230 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fcf4c057bf0 con 0x7fcf58150ff0 2023-11-04T01:37:05.741 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data_ec' removed 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 msgr2=0x7fcf4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 0x7fcf4406d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf48036000 tx=0x7fcf48030000 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 msgr2=0x7fcf580c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e760 tx=0x7fcf4c00ec20 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 shutdown_connections 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcf4406aea0 0x7fcf4406d360 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf580c8a00 0x7fcf5815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58150ff0 0x7fcf580c84c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 --2- 172.21.15.93:0/288083230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf40003970 0x7fcf580c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 >> 172.21.15.93:0/288083230 conn(0x7fcf5806ea20 msgr2=0x7fcf580c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 shutdown_connections 2023-11-04T01:37:05.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.742+0000 7fcf5e461640 1 -- 172.21.15.93:0/288083230 wait complete. 2023-11-04T01:37:05.759 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:37:05.759 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:37:05.759 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:37:05.759 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:05.760 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:37:05.760 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:37:05.760 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:37:05.760 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:05.760 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:37:05.760 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:37:05.760 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:37:05.761 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:05.761 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:37:05.761 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:37:05.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:37:05.761 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:05.769 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:37:05.770 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:37:05.770 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:37:05.771 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:37:05.771 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:37:05.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:37:05.772 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:37:05.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:37:05.811 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:37:05.812 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:05.813 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:37:05.813 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:05.814 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:37:05.814 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:05.815 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:37:05.815 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:05.815 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:37:05.889 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:37:05.889 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:37:05.893 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:37:05.893 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:37:05.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.919+0000 7fc63484f640 1 Processor -- start 2023-11-04T01:37:05.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 -- start start 2023-11-04T01:37:05.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 0x7fc63015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc6300b4880 0x7fc6300b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300cde60 con 0x7fc6300cd6d0 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300b5230 con 0x7fc6300b4880 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.920+0000 7fc63484f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630160f90 con 0x7fc630153e60 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc627fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc6300cd6d0 0x7fc630161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46974/0 (socket says 172.21.15.93:46974) 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc627fff640 1 -- 172.21.15.93:0/1304149445 learned_addr learned my addr 172.21.15.93:0/1304149445 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1304149445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 0x7fc63015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62ed9d640 1 --2- 172.21.15.93:0/1304149445 >> v2:172.21.15.125:3300/0 conn(0x7fc6300b4880 0x7fc6300b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62dd9b640 1 -- 172.21.15.93:0/1304149445 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774646172 0 0) 0x7fc6300cde60 con 0x7fc6300cd6d0 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62dd9b640 1 -- 172.21.15.93:0/1304149445 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c003520 con 0x7fc6300cd6d0 2023-11-04T01:37:05.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62e59c640 1 -- 172.21.15.93:0/1304149445 >> v2:172.21.15.125:3300/0 conn(0x7fc6300b4880 msgr2=0x7fc6300b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:05.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1304149445 >> v2:172.21.15.125:3300/0 conn(0x7fc6300b4880 0x7fc6300b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62e59c640 1 -- 172.21.15.93:0/1304149445 >> v1:172.21.15.93:6789/0 conn(0x7fc6300cd6d0 legacy=0x7fc630161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.921+0000 7fc62e59c640 1 -- 172.21.15.93:0/1304149445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63015e400 con 0x7fc630153e60 2023-11-04T01:37:05.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1304149445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 0x7fc63015dec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097a0 tx=0x7fc62002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9050c7010d5b359 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc62dd9b640 1 -- 172.21.15.93:0/1304149445 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62002d040 con 0x7fc630153e60 2023-11-04T01:37:05.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc62dd9b640 1 -- 172.21.15.93:0/1304149445 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620031810 con 0x7fc630153e60 2023-11-04T01:37:05.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc62dd9b640 1 -- 172.21.15.93:0/1304149445 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620031ba0 con 0x7fc630153e60 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 -- 172.21.15.93:0/1304149445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 msgr2=0x7fc63015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 --2- 172.21.15.93:0/1304149445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 0x7fc63015dec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097a0 tx=0x7fc62002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 -- 172.21.15.93:0/1304149445 shutdown_connections 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 --2- 172.21.15.93:0/1304149445 >> v2:172.21.15.125:3300/0 conn(0x7fc6300b4880 0x7fc6300b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 --2- 172.21.15.93:0/1304149445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc630153e60 0x7fc63015dec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 -- 172.21.15.93:0/1304149445 >> 172.21.15.93:0/1304149445 conn(0x7fc6300cf880 msgr2=0x7fc6300cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 -- 172.21.15.93:0/1304149445 shutdown_connections 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.922+0000 7fc63484f640 1 -- 172.21.15.93:0/1304149445 wait complete. 2023-11-04T01:37:05.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.924+0000 7fc63484f640 1 Processor -- start 2023-11-04T01:37:05.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.924+0000 7fc63484f640 1 -- start start 2023-11-04T01:37:05.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.924+0000 7fc63484f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.924+0000 7fc63484f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6300cd6d0 0x7fc630156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.924+0000 7fc63484f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc630153e60 0x7fc6301f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc63484f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300cb0a0 con 0x7fc6300b4880 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc63484f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63015c950 con 0x7fc630153e60 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc63484f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300ca490 con 0x7fc6300cd6d0 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41242/0 (socket says 172.21.15.93:41242) 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 -- 172.21.15.93:0/1769727202 learned_addr learned my addr 172.21.15.93:0/1769727202 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:05.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 -- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6300cd6d0 msgr2=0x7fc630156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6300cd6d0 0x7fc630156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62ed9d640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc630153e60 0x7fc6301f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 -- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc630153e60 msgr2=0x7fc6301f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc630153e60 0x7fc6301f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 -- 172.21.15.93:0/1769727202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620009400 con 0x7fc6300b4880 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc62e59c640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc620000c00 tx=0x7fc6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62003ad60 con 0x7fc6300b4880 2023-11-04T01:37:05.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6200443f0 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300ca770 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200445a0 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.925+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300cad30 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.926+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630074290 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.927+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc62004d450 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.927+0000 7fc626ffd640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 0x7fc61006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.927+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc6200ab510 con 0x7fc6300b4880 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.927+0000 7fc627fff640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 0x7fc61006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:05.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.928+0000 7fc627fff640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 0x7fc61006d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc630155e60 tx=0x7fc618007930 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:05.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:05.931+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc620076780 con 0x7fc6300b4880 2023-11-04T01:37:06.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.119+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc6300d0b80 con 0x7fc6300b4880 2023-11-04T01:37:06.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.754+0000 7fc626ffd640 1 -- 172.21.15.93:0/1769727202 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc620079da0 con 0x7fc6300b4880 2023-11-04T01:37:06.756 INFO:teuthology.orchestra.run.smithi093.stderr: removed all blocklist entries 2023-11-04T01:37:06.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 msgr2=0x7fc61006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 0x7fc61006d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc630155e60 tx=0x7fc618007930 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 msgr2=0x7fc63015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc620000c00 tx=0x7fc6200046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 shutdown_connections 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc61006ae70 0x7fc61006d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc630153e60 0x7fc6301f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc6300cd6d0 0x7fc630156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 --2- 172.21.15.93:0/1769727202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6300b4880 0x7fc63015c410 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 >> 172.21.15.93:0/1769727202 conn(0x7fc6300cf880 msgr2=0x7fc63015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 shutdown_connections 2023-11-04T01:37:06.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.757+0000 7fc63484f640 1 -- 172.21.15.93:0/1769727202 wait complete. 2023-11-04T01:37:06.772 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:37:06.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.870+0000 7fe02007c640 1 Processor -- start 2023-11-04T01:37:06.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.870+0000 7fe02007c640 1 -- start start 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe02007c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe018159c70 0x7fe0180ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe02007c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe01815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe02007c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0180b4110 con 0x7fe01806db20 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe02007c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180b49b0 con 0x7fe018159c70 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe02007c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180b43f0 con 0x7fe0180b0ae0 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe01d617640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe01806db20 0x7fe0180b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46982/0 (socket says 172.21.15.93:46982) 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe01d617640 1 -- 172.21.15.93:0/2162461303 learned_addr learned my addr 172.21.15.93:0/2162461303 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe01de18640 1 --2- 172.21.15.93:0/2162461303 >> v2:172.21.15.125:3300/0 conn(0x7fe018159c70 0x7fe0180ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168615293 0 0) 0x7fe0180b4110 con 0x7fe01806db20 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.871+0000 7fe01e619640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe01815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe004005730 con 0x7fe01806db20 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119715401 0 0) 0x7fe004005730 con 0x7fe01806db20 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 msgr2=0x7fe01815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe01815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 >> v2:172.21.15.125:3300/0 conn(0x7fe018159c70 msgr2=0x7fe0180ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 --2- 172.21.15.93:0/2162461303 >> v2:172.21.15.125:3300/0 conn(0x7fe018159c70 0x7fe0180ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180b46d0 con 0x7fe01806db20 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fe008001670 con 0x7fe01806db20 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 >> v1:172.21.15.93:6789/0 conn(0x7fe01806db20 legacy=0x7fe0180b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe004005b80 0x7fe004005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe0040069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe004006f10 0x7fe004007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180b49b0 con 0x7fe004006f10 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180b43f0 con 0x7fe004005b80 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00400db90 con 0x7fe0180b0ae0 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe004006f10 0x7fe004007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01de18640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe004005b80 0x7fe004005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01d617640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe0040069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 -- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 msgr2=0x7fe0040069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe0180b0ae0 0x7fe0040069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 -- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe004005b80 msgr2=0x7fe004005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe004005b80 0x7fe004005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.872+0000 7fe01e619640 1 -- 172.21.15.93:0/2162461303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004005730 con 0x7fe004006f10 2023-11-04T01:37:06.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.873+0000 7fe01e619640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe004006f10 0x7fe004007390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe010009af0 tx=0x7fe004007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7743097fc73f0194 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.873+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01002c6b0 con 0x7fe004006f10 2023-11-04T01:37:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.873+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01002c810 con 0x7fe004006f10 2023-11-04T01:37:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.873+0000 7fe01ce16640 1 -- 172.21.15.93:0/2162461303 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01002cba0 con 0x7fe004006f10 2023-11-04T01:37:06.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 -- 172.21.15.93:0/2162461303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe004006f10 msgr2=0x7fe004007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 --2- 172.21.15.93:0/2162461303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe004006f10 0x7fe004007390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe010009af0 tx=0x7fe004007a00 comp rx=0 tx=0).stop 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe01e619640 1 -- 172.21.15.93:0/2162461303 reap_dead start 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 -- 172.21.15.93:0/2162461303 shutdown_connections 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 -- 172.21.15.93:0/2162461303 >> 172.21.15.93:0/2162461303 conn(0x7fe0180ce950 msgr2=0x7fe0180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 -- 172.21.15.93:0/2162461303 shutdown_connections 2023-11-04T01:37:06.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.874+0000 7fe02007c640 1 -- 172.21.15.93:0/2162461303 wait complete. 2023-11-04T01:37:06.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.875+0000 7fe02007c640 1 Processor -- start 2023-11-04T01:37:06.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.875+0000 7fe02007c640 1 -- start start 2023-11-04T01:37:06.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004006f10 0x7fe0180c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0180c6800 0x7fe0180c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01815a050 con 0x7fe018153cb0 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018154670 con 0x7fe0180c6800 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0181ee240 con 0x7fe004006f10 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41258/0 (socket says 172.21.15.93:41258) 2023-11-04T01:37:06.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 -- 172.21.15.93:0/640742813 learned_addr learned my addr 172.21.15.93:0/640742813 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01de18640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004006f10 0x7fe0180c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01e619640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0180c6800 0x7fe0180c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 -- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004006f10 msgr2=0x7fe0180c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004006f10 0x7fe0180c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 -- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0180c6800 msgr2=0x7fe0180c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0180c6800 0x7fe0180c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 -- 172.21.15.93:0/640742813 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01815a260 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe01d617640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe008007310 tx=0x7fe0080077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800f9a0 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800fb00 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01815a540 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800feb0 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.876+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01815ab00 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.877+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01806df70 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.878+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe00801d460 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.878+0000 7fe00e7fc640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 0x7fdffc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.878+0000 7fe01de18640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 0x7fdffc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.878+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe008089680 con 0x7fe018153cb0 2023-11-04T01:37:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.879+0000 7fe01de18640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 0x7fdffc06d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe014009fd0 tx=0x7fe01400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:06.882+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0080549d0 con 0x7fe018153cb0 2023-11-04T01:37:07.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.110+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe01815ad20 con 0x7fe018153cb0 2023-11-04T01:37:07.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.111+0000 7fe00e7fc640 1 -- 172.21.15.93:0/640742813 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe008057ff0 con 0x7fe018153cb0 2023-11-04T01:37:07.112 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "auth_dump": [ 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.a", 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA==", 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.113 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.b", 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q==", 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.114 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.c", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA==", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.d", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A==", 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.115 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.0", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng==", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.116 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.1", 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg==", 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.117 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.2", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ==", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.3", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw==", 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.118 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.4", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw==", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.119 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.5", 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig==", 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.120 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.6", 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q==", 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.121 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.7", 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg==", 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.122 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.0", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA==", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.1", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA==", 2023-11-04T01:37:07.123 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.2", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA==", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:07.124 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.3", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA==", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.125 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.admin", 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC8n0VlXE3tMRAAENuvCH1TV9mwClMjb99rXg==", 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.126 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0VlNCydDxAAwbqy6WNHS9HBh4OFRs6mLA==", 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0VlozWdDxAAwIy5hWN8ZDbZGkq+rZCcpA==", 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.127 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0Vla3qdDxAAkOwZ/emOGB/hsrDjxxJCpw==", 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0Vl9ICdDxAAqVDKUScowdwvH/e1aTbHzg==", 2023-11-04T01:37:07.128 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0VlWIedDxAAffWT9ky8PPDcdk+L5U4O9w==", 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:37:07.129 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDfn0Vlt42dDxAA3Jn2p4JZLB4pUYK/D2aB0g==", 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.x", 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA==", 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:07.130 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.131 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.131 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:07.131 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:07.131 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.y", 2023-11-04T01:37:07.131 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA==", 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-11-04T01:37:07.132 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:07.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 msgr2=0x7fdffc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 0x7fdffc06d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe014009fd0 tx=0x7fe01400b040 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 msgr2=0x7fe018154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe008007310 tx=0x7fe0080077d0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 shutdown_connections 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdffc06ae70 0x7fdffc06d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0180c6800 0x7fe0180c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe018153cb0 0x7fe018154130 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 --2- 172.21.15.93:0/640742813 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe004006f10 0x7fe0180c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 >> 172.21.15.93:0/640742813 conn(0x7fe0180ce950 msgr2=0x7fe0180cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 shutdown_connections 2023-11-04T01:37:07.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.113+0000 7fe02007c640 1 -- 172.21.15.93:0/640742813 wait complete. 2023-11-04T01:37:07.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:37:07.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.233+0000 7f412171d640 1 Processor -- start 2023-11-04T01:37:07.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.233+0000 7f412171d640 1 -- start start 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f411c1603d0 0x7f411c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 0x7f411c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 0x7f411c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0b19d0 con 0x7f411c1603d0 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c06aaf0 con 0x7f411c06a660 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f412171d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0cdf80 con 0x7f411c0722a0 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f411affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f411c1603d0 0x7f411c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f411affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f411c1603d0 0x7f411c0b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41264/0 (socket says 172.21.15.93:41264) 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f411affd640 1 -- 172.21.15.93:0/1834971909 learned_addr learned my addr 172.21.15.93:0/1834971909 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f411b7fe640 1 --2- 172.21.15.93:0/1834971909 >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 0x7f411c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.234+0000 7f411a7fc640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 0x7f411c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 -- 172.21.15.93:0/1834971909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 msgr2=0x7f411c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 0x7f411c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 -- 172.21.15.93:0/1834971909 >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 msgr2=0x7f411c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 --2- 172.21.15.93:0/1834971909 >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 0x7f411c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 -- 172.21.15.93:0/1834971909 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0ce6f0 con 0x7f411c1603d0 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411b7fe640 1 --2- 172.21.15.93:0/1834971909 >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 0x7f411c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411a7fc640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 0x7f411c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f411affd640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c0b1490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b5940 tx=0x7f410c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64434f6f6d572bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f4119ffb640 1 -- 172.21.15.93:0/1834971909 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c02c9e0 con 0x7f411c1603d0 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f4119ffb640 1 -- 172.21.15.93:0/1834971909 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c02cb40 con 0x7f411c1603d0 2023-11-04T01:37:07.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.235+0000 7f4119ffb640 1 -- 172.21.15.93:0/1834971909 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0343f0 con 0x7f411c1603d0 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 -- 172.21.15.93:0/1834971909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 msgr2=0x7f411c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c0b1490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b5940 tx=0x7f410c02be40 comp rx=0 tx=0).stop 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 -- 172.21.15.93:0/1834971909 shutdown_connections 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 --2- 172.21.15.93:0/1834971909 >> v2:172.21.15.125:3300/0 conn(0x7f411c06a660 0x7f411c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c0722a0 0x7f411c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 --2- 172.21.15.93:0/1834971909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c0b1490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 -- 172.21.15.93:0/1834971909 >> 172.21.15.93:0/1834971909 conn(0x7f411c06d800 msgr2=0x7f411c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 -- 172.21.15.93:0/1834971909 shutdown_connections 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.236+0000 7f412171d640 1 -- 172.21.15.93:0/1834971909 wait complete. 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.237+0000 7f412171d640 1 Processor -- start 2023-11-04T01:37:07.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.237+0000 7f412171d640 1 -- start start 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c06a660 0x7f411c1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f411c0722a0 0x7f411c156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1f37b0 con 0x7f411c1603d0 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156cb0 con 0x7f411c0722a0 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f412171d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c156f30 con 0x7f411c06a660 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41268/0 (socket says 172.21.15.93:41268) 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 -- 172.21.15.93:0/4214924082 learned_addr learned my addr 172.21.15.93:0/4214924082 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411a7fc640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f411c0722a0 0x7f411c156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411affd640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c06a660 0x7f411c1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 -- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c06a660 msgr2=0x7f411c1f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c06a660 0x7f411c1f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 -- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f411c0722a0 msgr2=0x7f411c156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f411c0722a0 0x7f411c156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.238+0000 7f411b7fe640 1 -- 172.21.15.93:0/4214924082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c009b30 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f411b7fe640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f411400c820 tx=0x7f411400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114007a30 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114007b90 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400ce10 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c157210 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.239+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c1577d0 con 0x7f411c1603d0 2023-11-04T01:37:07.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.240+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c0c4570 con 0x7f411c1603d0 2023-11-04T01:37:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.240+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41140113f0 con 0x7f411c1603d0 2023-11-04T01:37:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.240+0000 7f41037fe640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 0x7f410806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.241+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f41140894e0 con 0x7f411c1603d0 2023-11-04T01:37:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.241+0000 7f411affd640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 0x7f410806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.241+0000 7f411affd640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 0x7f410806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f410c035000 tx=0x7f410c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.245+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4114054830 con 0x7f411c1603d0 2023-11-04T01:37:07.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.475+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f411c1f0160 con 0x7f411c1603d0 2023-11-04T01:37:07.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.477+0000 7f41037fe640 1 -- 172.21.15.93:0/4214924082 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4114057e50 con 0x7f411c1603d0 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 msgr2=0x7f410806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 0x7f410806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f410c035000 tx=0x7f410c030000 comp rx=0 tx=0).stop 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 msgr2=0x7f411c1efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f411400c820 tx=0x7f411400cce0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 shutdown_connections 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f410806ae70 0x7f410806d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f411c1603d0 0x7f411c1efc20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f411c0722a0 0x7f411c156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 --2- 172.21.15.93:0/4214924082 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f411c06a660 0x7f411c1f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 >> 172.21.15.93:0/4214924082 conn(0x7f411c06d800 msgr2=0x7f411c0c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 shutdown_connections 2023-11-04T01:37:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.479+0000 7f412171d640 1 -- 172.21.15.93:0/4214924082 wait complete. 2023-11-04T01:37:07.491 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:37:07.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.590+0000 7f95b9a90640 1 Processor -- start 2023-11-04T01:37:07.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.590+0000 7f95b9a90640 1 -- start start 2023-11-04T01:37:07.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b9a90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f95b4070ff0 0x7f95b40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b9a90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40c9bf0 con 0x7f95b4066000 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b9a90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40cd890 con 0x7f95b415d1b0 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b9a90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40cdb30 con 0x7f95b4070ff0 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f95b4070ff0 0x7f95b40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f95b4070ff0 0x7f95b40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41280/0 (socket says 172.21.15.93:41280) 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 -- 172.21.15.93:0/1382917663 learned_addr learned my addr 172.21.15.93:0/1382917663 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 -- 172.21.15.93:0/1382917663 >> v1:172.21.15.125:6789/0 conn(0x7f95b415d1b0 legacy=0x7f95b40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 -- 172.21.15.93:0/1382917663 >> v1:172.21.15.93:6789/0 conn(0x7f95b4066000 legacy=0x7f95b406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b37fe640 1 -- 172.21.15.93:0/1382917663 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40cde10 con 0x7f95b4070ff0 2023-11-04T01:37:07.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.591+0000 7f95b27fc640 1 -- 172.21.15.93:0/1382917663 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751406499 0 0) 0x7f95b40c9bf0 con 0x7f95b4066000 2023-11-04T01:37:07.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b37fe640 1 --2- 172.21.15.93:0/1382917663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4070ff0 0x7f95b40cb4e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009870 tx=0x7f95a402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7622b4d7e8c9a52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b27fc640 1 -- 172.21.15.93:0/1382917663 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402f840 con 0x7f95b4070ff0 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b27fc640 1 -- 172.21.15.93:0/1382917663 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a402f9a0 con 0x7f95b4070ff0 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b27fc640 1 -- 172.21.15.93:0/1382917663 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402fd30 con 0x7f95b4070ff0 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b9a90640 1 -- 172.21.15.93:0/1382917663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4070ff0 msgr2=0x7f95b40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1382917663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4070ff0 0x7f95b40cb4e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009870 tx=0x7f95a402ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b9a90640 1 -- 172.21.15.93:0/1382917663 shutdown_connections 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1382917663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4070ff0 0x7f95b40cb4e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.592+0000 7f95b9a90640 1 -- 172.21.15.93:0/1382917663 >> 172.21.15.93:0/1382917663 conn(0x7f95b40cbc90 msgr2=0x7f95b40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.593+0000 7f95b9a90640 1 -- 172.21.15.93:0/1382917663 shutdown_connections 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.593+0000 7f95b9a90640 1 -- 172.21.15.93:0/1382917663 wait complete. 2023-11-04T01:37:07.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 Processor -- start 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 -- start start 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 0x7f95b415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 0x7f95b415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4158a50 con 0x7f95b4066000 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b26b0 con 0x7f95b4070ff0 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.594+0000 7f95b9a90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b415c7b0 con 0x7f95b415d1b0 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41284/0 (socket says 172.21.15.93:41284) 2023-11-04T01:37:07.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 -- 172.21.15.93:0/1641244785 learned_addr learned my addr 172.21.15.93:0/1641244785 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b3fff640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 0x7f95b415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 -- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 msgr2=0x7f95b415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 0x7f95b415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b2ffd640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 0x7f95b415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 -- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 msgr2=0x7f95b415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 0x7f95b415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 -- 172.21.15.93:0/1641244785 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094d0 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b3fff640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 0x7f95b415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b2ffd640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 0x7f95b415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b37fe640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009870 tx=0x7f95a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402f7f0 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4041400 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b415bf10 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40417b0 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.595+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b415c4d0 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.596+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4074290 con 0x7f95b4066000 2023-11-04T01:37:07.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.597+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95a4041910 con 0x7f95b4066000 2023-11-04T01:37:07.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.597+0000 7f959bfff640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 0x7f95a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.597+0000 7f95b2ffd640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 0x7f95a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.597+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f95a403c070 con 0x7f95b4066000 2023-11-04T01:37:07.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.597+0000 7f95b2ffd640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 0x7f95a006d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95b40b2520 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.601+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95a4077640 con 0x7f95b4066000 2023-11-04T01:37:07.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.834+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f95b40b5190 con 0x7f95b4066000 2023-11-04T01:37:07.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.836+0000 7f959bfff640 1 -- 172.21.15.93:0/1641244785 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f95a407ac60 con 0x7f95b4066000 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 msgr2=0x7f95a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 0x7f95a006d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95b40b2520 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 msgr2=0x7f95b4158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009870 tx=0x7f95a4004730 comp rx=0 tx=0).stop 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 shutdown_connections 2023-11-04T01:37:07.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f95a006ae70 0x7f95a006d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f95b415d1b0 0x7f95b415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95b4070ff0 0x7f95b415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 --2- 172.21.15.93:0/1641244785 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95b4066000 0x7f95b4158510 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 >> 172.21.15.93:0/1641244785 conn(0x7f95b40cbc90 msgr2=0x7f95b40c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 shutdown_connections 2023-11-04T01:37:07.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.839+0000 7f95b9a90640 1 -- 172.21.15.93:0/1641244785 wait complete. 2023-11-04T01:37:07.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:37:07.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.951+0000 7fddf352c640 1 Processor -- start 2023-11-04T01:37:07.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.951+0000 7fddf352c640 1 -- start start 2023-11-04T01:37:07.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fddec1460c0 0x7fddec0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fddec0c37d0 0x7fddec0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec070710 0x7fddec070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec1464a0 con 0x7fddec0c37d0 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec0c41a0 con 0x7fddec1460c0 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf352c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0710a0 con 0x7fddec070710 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fddec0c37d0 0x7fddec0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fddec0c37d0 0x7fddec0c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41298/0 (socket says 172.21.15.93:41298) 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 -- 172.21.15.93:0/982041113 learned_addr learned my addr 172.21.15.93:0/982041113 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 -- 172.21.15.93:0/982041113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec070710 msgr2=0x7fddec070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/982041113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec070710 0x7fddec070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 -- 172.21.15.93:0/982041113 >> v2:172.21.15.125:3300/0 conn(0x7fddec1460c0 msgr2=0x7fddec0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/982041113 >> v2:172.21.15.125:3300/0 conn(0x7fddec1460c0 0x7fddec0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.952+0000 7fddf0ac7640 1 -- 172.21.15.93:0/982041113 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec146950 con 0x7fddec0c37d0 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/982041113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec0c3c60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fddec071210 tx=0x7fdddc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe9554d20406c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fdde3fff640 1 -- 172.21.15.93:0/982041113 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc031640 con 0x7fddec0c37d0 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fdde3fff640 1 -- 172.21.15.93:0/982041113 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc0317a0 con 0x7fddec0c37d0 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fdde3fff640 1 -- 172.21.15.93:0/982041113 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc031b30 con 0x7fddec0c37d0 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fddf352c640 1 -- 172.21.15.93:0/982041113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 msgr2=0x7fddec0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.953+0000 7fddf352c640 1 --2- 172.21.15.93:0/982041113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec0c3c60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fddec071210 tx=0x7fdddc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 -- 172.21.15.93:0/982041113 shutdown_connections 2023-11-04T01:37:07.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 --2- 172.21.15.93:0/982041113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec0c3c60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 --2- 172.21.15.93:0/982041113 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec070710 0x7fddec070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 --2- 172.21.15.93:0/982041113 >> v2:172.21.15.125:3300/0 conn(0x7fddec1460c0 0x7fddec0b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 -- 172.21.15.93:0/982041113 >> 172.21.15.93:0/982041113 conn(0x7fddec0ce950 msgr2=0x7fddec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 -- 172.21.15.93:0/982041113 shutdown_connections 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.954+0000 7fddf352c640 1 -- 172.21.15.93:0/982041113 wait complete. 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.955+0000 7fddf352c640 1 Processor -- start 2023-11-04T01:37:07.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.955+0000 7fddf352c640 1 -- start start 2023-11-04T01:37:07.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 0x7fddec15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec1460c0 0x7fddec15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1f3200 con 0x7fddec0c37d0 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1f5910 con 0x7fddec070710 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1f5bf0 con 0x7fddec1460c0 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41312/0 (socket says 172.21.15.93:41312) 2023-11-04T01:37:07.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 -- 172.21.15.93:0/136369728 learned_addr learned my addr 172.21.15.93:0/136369728 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:07.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf12c8640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 0x7fddec15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf1ac9640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec1460c0 0x7fddec15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 -- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec1460c0 msgr2=0x7fddec15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec1460c0 0x7fddec15fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 -- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 msgr2=0x7fddec15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 0x7fddec15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 -- 172.21.15.93:0/136369728 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0094d0 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf12c8640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 0x7fddec15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf0ac7640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdddc000c00 tx=0x7fdddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc03ac40 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc03ada0 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec1f5ed0 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.956+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc044630 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.957+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec15cc70 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.958+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec1f63f0 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.958+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdddc02f050 con 0x7fddec0c37d0 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.958+0000 7fdde1ffb640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 0x7fddd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:07.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.959+0000 7fddf12c8640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 0x7fddd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:07.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.959+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdddc0ab450 con 0x7fddec0c37d0 2023-11-04T01:37:07.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.959+0000 7fddf12c8640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 0x7fddd006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fddec136fc0 tx=0x7fdde8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:07.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:07.963+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fddec1f63f0 con 0x7fddec0c37d0 2023-11-04T01:37:08.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.195+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fddec1f63f0 con 0x7fddec0c37d0 2023-11-04T01:37:08.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.197+0000 7fdde1ffb640 1 -- 172.21.15.93:0/136369728 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fddec1f63f0 con 0x7fddec0c37d0 2023-11-04T01:37:08.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 msgr2=0x7fddd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 0x7fddd006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fddec136fc0 tx=0x7fdde8008040 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 msgr2=0x7fddec15f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdddc000c00 tx=0x7fdddc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 shutdown_connections 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddd006ae70 0x7fddd006d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fddec1460c0 0x7fddec15fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fddec0c37d0 0x7fddec15f610 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 --2- 172.21.15.93:0/136369728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddec070710 0x7fddec15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 >> 172.21.15.93:0/136369728 conn(0x7fddec0ce950 msgr2=0x7fddec145420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 shutdown_connections 2023-11-04T01:37:08.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.199+0000 7fddf352c640 1 -- 172.21.15.93:0/136369728 wait complete. 2023-11-04T01:37:08.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:37:08.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.310+0000 7f9e3dc76640 1 Processor -- start 2023-11-04T01:37:08.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.310+0000 7f9e3dc76640 1 -- start start 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e3dc76640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9e380c4ff0 0x7f9e380cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e3dc76640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3815aff0 con 0x7f9e38159c00 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e3dc76640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3815a3e0 con 0x7f9e380adac0 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e3dc76640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3815a6c0 con 0x7f9e380c4ff0 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e36ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9e380c4ff0 0x7f9e380cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e36ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9e380c4ff0 0x7f9e380cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41326/0 (socket says 172.21.15.93:41326) 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e36ffd640 1 -- 172.21.15.93:0/1412769311 learned_addr learned my addr 172.21.15.93:0/1412769311 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e377fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9e38159c00 0x7f9e380c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46988/0 (socket says 172.21.15.93:46988) 2023-11-04T01:37:08.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e36ffd640 1 -- 172.21.15.93:0/1412769311 >> v1:172.21.15.125:6789/0 conn(0x7f9e380adac0 legacy=0x7f9e380adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:08.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.311+0000 7f9e36ffd640 1 -- 172.21.15.93:0/1412769311 >> v1:172.21.15.93:6789/0 conn(0x7f9e38159c00 legacy=0x7f9e380c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.312+0000 7f9e36ffd640 1 -- 172.21.15.93:0/1412769311 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3815a9a0 con 0x7f9e380c4ff0 2023-11-04T01:37:08.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.312+0000 7f9e36ffd640 1 --2- 172.21.15.93:0/1412769311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380c4ff0 0x7f9e380cc890 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f19fd4a4a20b897 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.312+0000 7f9e367fc640 1 -- 172.21.15.93:0/1412769311 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c030860 con 0x7f9e380c4ff0 2023-11-04T01:37:08.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.312+0000 7f9e367fc640 1 -- 172.21.15.93:0/1412769311 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0309c0 con 0x7f9e380c4ff0 2023-11-04T01:37:08.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.312+0000 7f9e367fc640 1 -- 172.21.15.93:0/1412769311 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c030d50 con 0x7f9e380c4ff0 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1412769311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380c4ff0 msgr2=0x7f9e380cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1412769311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380c4ff0 0x7f9e380cc890 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009870 tx=0x7f9e2c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1412769311 shutdown_connections 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1412769311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380c4ff0 0x7f9e380cc890 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1412769311 >> 172.21.15.93:0/1412769311 conn(0x7f9e380ce950 msgr2=0x7f9e380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1412769311 shutdown_connections 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.313+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1412769311 wait complete. 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.314+0000 7f9e3dc76640 1 Processor -- start 2023-11-04T01:37:08.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.314+0000 7f9e3dc76640 1 -- start start 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e380c4ff0 0x7f9e3815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e38159c00 0x7f9e381e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38158b10 con 0x7f9e380adac0 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38157d50 con 0x7f9e38159c00 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e3dc76640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38158030 con 0x7f9e380c4ff0 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41334/0 (socket says 172.21.15.93:41334) 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 -- 172.21.15.93:0/1818780331 learned_addr learned my addr 172.21.15.93:0/1818780331 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 -- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e380c4ff0 msgr2=0x7f9e3815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e380c4ff0 0x7f9e3815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 -- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e38159c00 msgr2=0x7f9e381e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e38159c00 0x7f9e381e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 -- 172.21.15.93:0/1818780331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0094d0 con 0x7f9e380adac0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.315+0000 7f9e377fe640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c3c0 tx=0x7f9e2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.316+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280074e0 con 0x7f9e380adac0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.316+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28007640 con 0x7f9e380adac0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.316+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e38158310 con 0x7f9e380adac0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.316+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28004a00 con 0x7f9e380adac0 2023-11-04T01:37:08.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.316+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38157a20 con 0x7f9e380adac0 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.317+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38158830 con 0x7f9e380adac0 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.317+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e28004b60 con 0x7f9e380adac0 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.317+0000 7f9e1ffff640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 0x7f9e2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.318+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9e28088db0 con 0x7f9e380adac0 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.318+0000 7f9e36ffd640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 0x7f9e2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.318+0000 7f9e36ffd640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 0x7f9e2406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c036000 tx=0x7f9e2c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.322+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e38158830 con 0x7f9e380adac0 2023-11-04T01:37:08.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.550+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9e38158830 con 0x7f9e380adac0 2023-11-04T01:37:08.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.553+0000 7f9e1ffff640 1 -- 172.21.15.93:0/1818780331 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9e28054070 con 0x7f9e380adac0 2023-11-04T01:37:08.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 msgr2=0x7f9e2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 0x7f9e2406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c036000 tx=0x7f9e2c03b040 comp rx=0 tx=0).stop 2023-11-04T01:37:08.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 msgr2=0x7f9e38152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c3c0 tx=0x7f9e2800c880 comp rx=0 tx=0).stop 2023-11-04T01:37:08.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 shutdown_connections 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9e2406ae70 0x7f9e2406d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e38159c00 0x7f9e381e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9e380c4ff0 0x7f9e3815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 --2- 172.21.15.93:0/1818780331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9e380adac0 0x7f9e38152fc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 >> 172.21.15.93:0/1818780331 conn(0x7f9e380ce950 msgr2=0x7f9e380cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 shutdown_connections 2023-11-04T01:37:08.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.555+0000 7f9e3dc76640 1 -- 172.21.15.93:0/1818780331 wait complete. 2023-11-04T01:37:08.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.666+0000 7f078286f640 1 Processor -- start 2023-11-04T01:37:08.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.666+0000 7f078286f640 1 -- start start 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.666+0000 7f078286f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f077c153850 0x7f077c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.666+0000 7f078286f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f077c0cc9d0 0x7f077c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f078286f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0c3860 con 0x7f077c0cc520 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f078286f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0c9250 con 0x7f077c0cc9d0 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f078286f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c153c30 con 0x7f077c153850 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f077c0cc9d0 0x7f077c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f077c0cc9d0 0x7f077c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41336/0 (socket says 172.21.15.93:41336) 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 -- 172.21.15.93:0/1348625405 learned_addr learned my addr 172.21.15.93:0/1348625405 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 -- 172.21.15.93:0/1348625405 >> v2:172.21.15.125:3300/0 conn(0x7f077c153850 msgr2=0x7f077c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 --2- 172.21.15.93:0/1348625405 >> v2:172.21.15.125:3300/0 conn(0x7f077c153850 0x7f077c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 -- 172.21.15.93:0/1348625405 >> v1:172.21.15.125:6789/0 conn(0x7f077c0cc520 legacy=0x7f077c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.667+0000 7f0780e0c640 1 -- 172.21.15.93:0/1348625405 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c15a700 con 0x7f077c0cc9d0 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f0780e0c640 1 --2- 172.21.15.93:0/1348625405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc9d0 0x7f077c0c3cf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f077c0c5710 tx=0x7f077402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd800e748ec8cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f077affd640 1 -- 172.21.15.93:0/1348625405 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077402eea0 con 0x7f077c0cc9d0 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f077affd640 1 -- 172.21.15.93:0/1348625405 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774032070 con 0x7f077c0cc9d0 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f077affd640 1 -- 172.21.15.93:0/1348625405 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774038620 con 0x7f077c0cc9d0 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 -- 172.21.15.93:0/1348625405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc9d0 msgr2=0x7f077c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 --2- 172.21.15.93:0/1348625405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc9d0 0x7f077c0c3cf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f077c0c5710 tx=0x7f077402e0f0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 -- 172.21.15.93:0/1348625405 shutdown_connections 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 --2- 172.21.15.93:0/1348625405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc9d0 0x7f077c0c3cf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 --2- 172.21.15.93:0/1348625405 >> v2:172.21.15.125:3300/0 conn(0x7f077c153850 0x7f077c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 -- 172.21.15.93:0/1348625405 >> 172.21.15.93:0/1348625405 conn(0x7f077c0ce950 msgr2=0x7f077c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 -- 172.21.15.93:0/1348625405 shutdown_connections 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.668+0000 7f078286f640 1 -- 172.21.15.93:0/1348625405 wait complete. 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.669+0000 7f078286f640 1 Processor -- start 2023-11-04T01:37:08.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 -- start start 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c0cc9d0 0x7f077c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c153850 0x7f077c1f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1e2190 con 0x7f077c0cc520 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1e2470 con 0x7f077c0cc9d0 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f078286f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1e2750 con 0x7f077c153850 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f077bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f077bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41348/0 (socket says 172.21.15.93:41348) 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.670+0000 7f077bfff640 1 -- 172.21.15.93:0/1857539592 learned_addr learned my addr 172.21.15.93:0/1857539592 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077b7fe640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c0cc9d0 0x7f077c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 -- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c153850 msgr2=0x7f077c1f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c153850 0x7f077c1f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 -- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c0cc9d0 msgr2=0x7f077c0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c0cc9d0 0x7f077c0b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 -- 172.21.15.93:0/1857539592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077400bd40 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f077bfff640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f076c00b410 tx=0x7f076c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011830 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0119b0 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c1e2a30 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011d60 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.671+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c1500c0 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.672+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c1e2c20 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.672+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f076c01a400 con 0x7f077c0cc520 2023-11-04T01:37:08.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.673+0000 7f0778ff9640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 0x7f076806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:08.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.673+0000 7f077b7fe640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 0x7f076806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:08.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.673+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f076c089380 con 0x7f077c0cc520 2023-11-04T01:37:08.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.673+0000 7f077b7fe640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 0x7f076806d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f077c0cf1e0 tx=0x7f0770009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:08.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.677+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f076c054640 con 0x7f077c0cc520 2023-11-04T01:37:08.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.908+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f077c1500c0 con 0x7f077c0cc520 2023-11-04T01:37:08.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.910+0000 7f0778ff9640 1 -- 172.21.15.93:0/1857539592 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f077c1500c0 con 0x7f077c0cc520 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 msgr2=0x7f076806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 0x7f076806d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f077c0cf1e0 tx=0x7f0770009040 comp rx=0 tx=0).stop 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 msgr2=0x7f077c14f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f076c00b410 tx=0x7f076c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 shutdown_connections 2023-11-04T01:37:08.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076806ae70 0x7f076806d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f077c153850 0x7f077c1f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f077c0cc9d0 0x7f077c0b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 --2- 172.21.15.93:0/1857539592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f077c0cc520 0x7f077c14f9a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 >> 172.21.15.93:0/1857539592 conn(0x7f077c0ce950 msgr2=0x7f077c152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.912+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 shutdown_connections 2023-11-04T01:37:08.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:08.913+0000 7f078286f640 1 -- 172.21.15.93:0/1857539592 wait complete. 2023-11-04T01:37:08.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:37:09.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.023+0000 7fe302ee1640 1 Processor -- start 2023-11-04T01:37:09.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 -- start start 2023-11-04T01:37:09.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe2fc153850 0x7fe2fc15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0c3860 con 0x7fe2fc0cc520 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c9250 con 0x7fe2fc153850 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe302ee1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc153c30 con 0x7fe2fc0cc9d0 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.024+0000 7fe300c7d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe2fc153850 0x7fe2fc15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe2fbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe2fc0cc520 0x7fe2fc070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46998/0 (socket says 172.21.15.93:46998) 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe2fbfff640 1 -- 172.21.15.93:0/1888062621 learned_addr learned my addr 172.21.15.93:0/1888062621 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe300c7d640 1 -- 172.21.15.93:0/1888062621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 msgr2=0x7fe2fc0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe300c7d640 1 --2- 172.21.15.93:0/1888062621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe300c7d640 1 -- 172.21.15.93:0/1888062621 >> v1:172.21.15.93:6789/0 conn(0x7fe2fc0cc520 legacy=0x7fe2fc070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.025+0000 7fe300c7d640 1 -- 172.21.15.93:0/1888062621 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc15a700 con 0x7fe2fc153850 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe300c7d640 1 --2- 172.21.15.93:0/1888062621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc15a1c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097a0 tx=0x7fe2f002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2631252b303a69e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe2fb7fe640 1 -- 172.21.15.93:0/1888062621 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0030710 con 0x7fe2fc153850 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe2fb7fe640 1 -- 172.21.15.93:0/1888062621 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f002e050 con 0x7fe2fc153850 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe2fb7fe640 1 -- 172.21.15.93:0/1888062621 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0030a90 con 0x7fe2fc153850 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 -- 172.21.15.93:0/1888062621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 msgr2=0x7fe2fc15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1888062621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc15a1c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097a0 tx=0x7fe2f002b710 comp rx=0 tx=0).stop 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 -- 172.21.15.93:0/1888062621 shutdown_connections 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1888062621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1888062621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc15a1c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 -- 172.21.15.93:0/1888062621 >> 172.21.15.93:0/1888062621 conn(0x7fe2fc0ce950 msgr2=0x7fe2fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 -- 172.21.15.93:0/1888062621 shutdown_connections 2023-11-04T01:37:09.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.026+0000 7fe302ee1640 1 -- 172.21.15.93:0/1888062621 wait complete. 2023-11-04T01:37:09.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.027+0000 7fe302ee1640 1 Processor -- start 2023-11-04T01:37:09.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.027+0000 7fe302ee1640 1 -- start start 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2fc0cc520 0x7fe2fc14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06e450 con 0x7fe2fc153850 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc1f1470 con 0x7fe2fc0cc520 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe302ee1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc14e920 con 0x7fe2fc0cc9d0 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe30147e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe30147e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41370/0 (socket says 172.21.15.93:41370) 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.028+0000 7fe30147e640 1 -- 172.21.15.93:0/1093178035 learned_addr learned my addr 172.21.15.93:0/1093178035 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe2fbfff640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe300c7d640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2fc0cc520 0x7fe2fc14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 -- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 msgr2=0x7fe2fc156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 -- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2fc0cc520 msgr2=0x7fe2fc14e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2fc0cc520 0x7fe2fc14e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 -- 172.21.15.93:0/1093178035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009400 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe30147e640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400b9e0 tx=0x7fe2f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400cac0 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f400cc20 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4014440 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc1f0860 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.029+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc1f0e20 con 0x7fe2fc153850 2023-11-04T01:37:09.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.030+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc074290 con 0x7fe2fc153850 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.031+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2f401c360 con 0x7fe2fc153850 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.031+0000 7fe2f97fa640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 0x7fe2e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.031+0000 7fe300c7d640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 0x7fe2e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.031+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe2f40892f0 con 0x7fe2fc153850 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.031+0000 7fe300c7d640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 0x7fe2e006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0034000 tx=0x7fe2f0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.035+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2f4058040 con 0x7fe2fc153850 2023-11-04T01:37:09.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.264+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe2fc1f15b0 con 0x7fe2fc153850 2023-11-04T01:37:09.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.266+0000 7fe2f97fa640 1 -- 172.21.15.93:0/1093178035 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe2f4057bd0 con 0x7fe2fc153850 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 msgr2=0x7fe2e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 0x7fe2e006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0034000 tx=0x7fe2f0008030 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 msgr2=0x7fe2fc154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400b9e0 tx=0x7fe2f400bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 shutdown_connections 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2e006ae70 0x7fe2e006d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2fc153850 0x7fe2fc154780 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2fc0cc9d0 0x7fe2fc156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 --2- 172.21.15.93:0/1093178035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2fc0cc520 0x7fe2fc14e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 >> 172.21.15.93:0/1093178035 conn(0x7fe2fc0ce950 msgr2=0x7fe2fc15aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 shutdown_connections 2023-11-04T01:37:09.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.268+0000 7fe302ee1640 1 -- 172.21.15.93:0/1093178035 wait complete. 2023-11-04T01:37:09.282 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:09.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.383+0000 7fea4b716640 1 Processor -- start 2023-11-04T01:37:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.383+0000 7fea4b716640 1 -- start start 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea4b716640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea440b0ae0 0x7fea440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea4b716640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea4415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea4b716640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440b4110 con 0x7fea44159c70 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea4b716640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea440b49b0 con 0x7fea440b0ae0 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea4b716640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b43f0 con 0x7fea4406db20 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea494b2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fea44159c70 0x7fea440b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47010/0 (socket says 172.21.15.93:47010) 2023-11-04T01:37:09.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea494b2640 1 -- 172.21.15.93:0/640079811 learned_addr learned my addr 172.21.15.93:0/640079811 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea49cb3640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea4415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea48cb1640 1 --2- 172.21.15.93:0/640079811 >> v2:172.21.15.125:3300/0 conn(0x7fea440b0ae0 0x7fea440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040781335 0 0) 0x7fea440b4110 con 0x7fea44159c70 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea30003520 con 0x7fea44159c70 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191011908 0 0) 0x7fea30003520 con 0x7fea44159c70 2023-11-04T01:37:09.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 msgr2=0x7fea4415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea4415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 >> v2:172.21.15.125:3300/0 conn(0x7fea440b0ae0 msgr2=0x7fea440ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 --2- 172.21.15.93:0/640079811 >> v2:172.21.15.125:3300/0 conn(0x7fea440b0ae0 0x7fea440ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440b46d0 con 0x7fea44159c70 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.384+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fea400019f0 con 0x7fea44159c70 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 >> v1:172.21.15.93:6789/0 conn(0x7fea44159c70 legacy=0x7fea440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea30003970 0x7fea30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea300047c0 0x7fea30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b49b0 con 0x7fea300047c0 2023-11-04T01:37:09.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b43f0 con 0x7fea30003970 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3000b980 con 0x7fea4406db20 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea300047c0 0x7fea30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea494b2640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea30003970 0x7fea30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea49cb3640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 -- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 msgr2=0x7fea30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea30005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 -- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea30003970 msgr2=0x7fea30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea30003970 0x7fea30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea48cb1640 1 -- 172.21.15.93:0/640079811 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30003520 con 0x7fea300047c0 2023-11-04T01:37:09.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.385+0000 7fea49cb3640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4406db20 0x7fea30005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:09.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea48cb1640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea300047c0 0x7fea30004c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea34009ac0 tx=0x7fea300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8942b58bd0313529 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3402c710 con 0x7fea300047c0 2023-11-04T01:37:09.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3402c870 con 0x7fea300047c0 2023-11-04T01:37:09.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea3bfff640 1 -- 172.21.15.93:0/640079811 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3402cc00 con 0x7fea300047c0 2023-11-04T01:37:09.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 -- 172.21.15.93:0/640079811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea300047c0 msgr2=0x7fea30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 --2- 172.21.15.93:0/640079811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea300047c0 0x7fea30004c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea34009ac0 tx=0x7fea300057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea49cb3640 1 -- 172.21.15.93:0/640079811 reap_dead start 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 -- 172.21.15.93:0/640079811 shutdown_connections 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 -- 172.21.15.93:0/640079811 >> 172.21.15.93:0/640079811 conn(0x7fea440ce950 msgr2=0x7fea440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 -- 172.21.15.93:0/640079811 shutdown_connections 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.386+0000 7fea4b716640 1 -- 172.21.15.93:0/640079811 wait complete. 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 Processor -- start 2023-11-04T01:37:09.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 -- start start 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea300047c0 0x7fea4414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea441f0b60 0x7fea44155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea44150ba0 con 0x7fea441f0fa0 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea44154190 con 0x7fea441f0b60 2023-11-04T01:37:09.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea4b716640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44154470 con 0x7fea300047c0 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea49cb3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea49cb3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41394/0 (socket says 172.21.15.93:41394) 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea49cb3640 1 -- 172.21.15.93:0/4291363361 learned_addr learned my addr 172.21.15.93:0/4291363361 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea48cb1640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea441f0b60 0x7fea44155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.388+0000 7fea494b2640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea300047c0 0x7fea4414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 -- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea300047c0 msgr2=0x7fea4414e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea300047c0 0x7fea4414e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 -- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea441f0b60 msgr2=0x7fea44155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea441f0b60 0x7fea44155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 -- 172.21.15.93:0/4291363361 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44150df0 con 0x7fea441f0fa0 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea49cb3640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea440cf6e0 tx=0x7fea3c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c004500 con 0x7fea441f0fa0 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c003610 con 0x7fea441f0fa0 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0039c0 con 0x7fea441f0fa0 2023-11-04T01:37:09.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea441510d0 con 0x7fea441f0fa0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.389+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea44153d20 con 0x7fea441f0fa0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.390+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44152b70 con 0x7fea441f0fa0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.391+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea3c003b20 con 0x7fea441f0fa0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.391+0000 7fea39ffb640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 0x7fea2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.391+0000 7fea494b2640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 0x7fea2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.391+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fea3c089570 con 0x7fea441f0fa0 2023-11-04T01:37:09.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.391+0000 7fea494b2640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 0x7fea2806d360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fea400013d0 tx=0x7fea40006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.395+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea3c054970 con 0x7fea441f0fa0 2023-11-04T01:37:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.563+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea4415a050 con 0x7fea441f0fa0 2023-11-04T01:37:09.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.563+0000 7fea39ffb640 1 -- 172.21.15.93:0/4291363361 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13074 (secure 0 0 0) 0x7fea3c057f90 con 0x7fea441f0fa0 2023-11-04T01:37:09.566 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:09.567 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":34,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:06.764994+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 msgr2=0x7fea2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 0x7fea2806d360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fea400013d0 tx=0x7fea40006040 comp rx=0 tx=0).stop 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 msgr2=0x7fea440c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea440cf6e0 tx=0x7fea3c011920 comp rx=0 tx=0).stop 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 shutdown_connections 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea2806aea0 0x7fea2806d360 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea441f0fa0 0x7fea440c7dd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea441f0b60 0x7fea44155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 --2- 172.21.15.93:0/4291363361 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea300047c0 0x7fea4414e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.565+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 >> 172.21.15.93:0/4291363361 conn(0x7fea440ce950 msgr2=0x7fea440b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.566+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 shutdown_connections 2023-11-04T01:37:09.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.566+0000 7fea4b716640 1 -- 172.21.15.93:0/4291363361 wait complete. 2023-11-04T01:37:09.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:09.579 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:09.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.679+0000 7f39e2b90640 1 Processor -- start 2023-11-04T01:37:09.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.679+0000 7f39e2b90640 1 -- start start 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39dc159c00 0x7f39dc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39dc0c48e0 0x7f39dc0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0c52d0 con 0x7f39dc0c48e0 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc15aff0 con 0x7f39dc159c00 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e2b90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc15a3e0 con 0x7f39dc0adac0 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39dbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39dc0c48e0 0x7f39dc0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39dbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39dc0c48e0 0x7f39dc0c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41408/0 (socket says 172.21.15.93:41408) 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39dbfff640 1 -- 172.21.15.93:0/1506687498 learned_addr learned my addr 172.21.15.93:0/1506687498 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e092c640 1 --2- 172.21.15.93:0/1506687498 >> v2:172.21.15.125:3300/0 conn(0x7f39dc159c00 0x7f39dc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39e112d640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39dbfff640 1 -- 172.21.15.93:0/1506687498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 msgr2=0x7f39dc0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.680+0000 7f39dbfff640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39dbfff640 1 -- 172.21.15.93:0/1506687498 >> v2:172.21.15.125:3300/0 conn(0x7f39dc159c00 msgr2=0x7f39dc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39dbfff640 1 --2- 172.21.15.93:0/1506687498 >> v2:172.21.15.125:3300/0 conn(0x7f39dc159c00 0x7f39dc0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39dbfff640 1 -- 172.21.15.93:0/1506687498 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc15a6c0 con 0x7f39dc0c48e0 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39dbfff640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c4d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0cc4d0 tx=0x7f39d002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44de4b8028e5a03d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39db7fe640 1 -- 172.21.15.93:0/1506687498 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d002ee90 con 0x7f39dc0c48e0 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39db7fe640 1 -- 172.21.15.93:0/1506687498 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0036440 con 0x7f39dc0c48e0 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.681+0000 7f39db7fe640 1 -- 172.21.15.93:0/1506687498 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00367d0 con 0x7f39dc0c48e0 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 -- 172.21.15.93:0/1506687498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc0c48e0 msgr2=0x7f39dc0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c4d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0cc4d0 tx=0x7f39d002e0e0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 -- 172.21.15.93:0/1506687498 shutdown_connections 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c4d90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1506687498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1506687498 >> v2:172.21.15.125:3300/0 conn(0x7f39dc159c00 0x7f39dc0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 -- 172.21.15.93:0/1506687498 >> 172.21.15.93:0/1506687498 conn(0x7f39dc0ce950 msgr2=0x7f39dc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 -- 172.21.15.93:0/1506687498 shutdown_connections 2023-11-04T01:37:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.682+0000 7f39e2b90640 1 -- 172.21.15.93:0/1506687498 wait complete. 2023-11-04T01:37:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.683+0000 7f39e2b90640 1 Processor -- start 2023-11-04T01:37:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.683+0000 7f39e2b90640 1 -- start start 2023-11-04T01:37:09.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0c7be0 con 0x7f39dc159c00 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0ad340 con 0x7f39dc0c48e0 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e2b90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc156af0 con 0x7f39dc0adac0 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41416/0 (socket says 172.21.15.93:41416) 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 -- 172.21.15.93:0/1803642629 learned_addr learned my addr 172.21.15.93:0/1803642629 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e092c640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39dbfff640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 -- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 msgr2=0x7f39dc0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 -- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39dc0c48e0 msgr2=0x7f39dc0c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 -- 172.21.15.93:0/1803642629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d000b770 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.684+0000 7f39e112d640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f39d4007e90 tx=0x7f39d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.685+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4014420 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.685+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d40145a0 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.685+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc0c6600 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.685+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4014950 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.685+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc0c6bc0 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.686+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc074290 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.686+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39d4014ab0 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.686+0000 7f39d97fa640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 0x7f39c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.686+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f39d4089cb0 con 0x7f39dc159c00 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.686+0000 7f39e092c640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 0x7f39c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.687+0000 7f39e092c640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 0x7f39c806d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39cc006fd0 tx=0x7f39cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.691+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39d4055000 con 0x7f39dc159c00 2023-11-04T01:37:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.858+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39dc0cbf60 con 0x7f39dc159c00 2023-11-04T01:37:09.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.858+0000 7f39d97fa640 1 -- 172.21.15.93:0/1803642629 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39d4058620 con 0x7f39dc159c00 2023-11-04T01:37:09.861 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:09.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 msgr2=0x7f39c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 0x7f39c806d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39cc006fd0 tx=0x7f39cc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:09.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 msgr2=0x7f39dc0c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f39d4007e90 tx=0x7f39d400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 shutdown_connections 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f39c806ae70 0x7f39c806d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39dc159c00 0x7f39dc0c5f60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39dc0c48e0 0x7f39dc0c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 --2- 172.21.15.93:0/1803642629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f39dc0adac0 0x7f39dc0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 >> 172.21.15.93:0/1803642629 conn(0x7f39dc0ce950 msgr2=0x7f39dc06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 shutdown_connections 2023-11-04T01:37:09.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.860+0000 7f39e2b90640 1 -- 172.21.15.93:0/1803642629 wait complete. 2023-11-04T01:37:09.873 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:37:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 Processor -- start 2023-11-04T01:37:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 -- start start 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecf0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf015e000 con 0x7fecf0157540 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf015e2e0 con 0x7fecf00cde60 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.970+0000 7fecf6856640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015e5c0 con 0x7fecf00ce240 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7fecf4df3640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fecf0157540 0x7fecf00d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47022/0 (socket says 172.21.15.93:47022) 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7fecf4df3640 1 -- 172.21.15.93:0/1262066652 learned_addr learned my addr 172.21.15.93:0/1262066652 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7fecef7fe640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecf0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697564685 0 0) 0x7fecf015e000 con 0x7fecf0157540 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd8003520 con 0x7fecf0157540 2023-11-04T01:37:09.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763833109 0 0) 0x7fecf015e2e0 con 0x7fecf00cde60 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf015e000 con 0x7fecf00cde60 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3578287775 0 0) 0x7fecd8003520 con 0x7fecf0157540 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 msgr2=0x7fecf0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecf0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 >> v1:172.21.15.125:6789/0 conn(0x7fecf00cde60 legacy=0x7fecf015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00d1120 con 0x7fecf0157540 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fece80019f0 con 0x7fecf0157540 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 >> v1:172.21.15.93:6789/0 conn(0x7fecf0157540 legacy=0x7fecf00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecd8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecd8004090 0x7fecd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecd8004d00 0x7fecd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015e5c0 con 0x7fecd8004d00 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd800ba60 con 0x7fecd8004090 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd800bc20 con 0x7fecf00ce240 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecd8004d00 0x7fecd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7fecef7fe640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecd8004090 0x7fecd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.971+0000 7feceffff640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecd8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 -- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 msgr2=0x7fecd8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf00ce240 0x7fecd8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 -- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecd8004090 msgr2=0x7fecd80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecd8004090 0x7fecd80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 -- 172.21.15.93:0/1262066652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8003520 con 0x7fecd8004d00 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecd8004d00 0x7fecd8005180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fece800a7c0 tx=0x7fecd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8895bebf1be737db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8034630 con 0x7fecd8004d00 2023-11-04T01:37:09.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece802f070 con 0x7fecd8004d00 2023-11-04T01:37:09.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.972+0000 7feceeffd640 1 -- 172.21.15.93:0/1262066652 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8034a30 con 0x7fecd8004d00 2023-11-04T01:37:09.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 -- 172.21.15.93:0/1262066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecd8004d00 msgr2=0x7fecd8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 --2- 172.21.15.93:0/1262066652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecd8004d00 0x7fecd8005180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fece800a7c0 tx=0x7fecd80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf4df3640 1 -- 172.21.15.93:0/1262066652 reap_dead start 2023-11-04T01:37:09.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 -- 172.21.15.93:0/1262066652 shutdown_connections 2023-11-04T01:37:09.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 -- 172.21.15.93:0/1262066652 >> 172.21.15.93:0/1262066652 conn(0x7fecf0071f30 msgr2=0x7fecf00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 -- 172.21.15.93:0/1262066652 shutdown_connections 2023-11-04T01:37:09.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.973+0000 7fecf6856640 1 -- 172.21.15.93:0/1262066652 wait complete. 2023-11-04T01:37:09.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.974+0000 7fecf6856640 1 Processor -- start 2023-11-04T01:37:09.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.974+0000 7fecf6856640 1 -- start start 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf014b0a0 0x7fecf0157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 0x7fecf00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0152950 con 0x7fecf014b480 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0158c00 con 0x7fecf0152090 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf6856640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0158640 con 0x7fecf014b0a0 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41426/0 (socket says 172.21.15.93:41426) 2023-11-04T01:37:09.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 -- 172.21.15.93:0/1465517890 learned_addr learned my addr 172.21.15.93:0/1465517890 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:09.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7feceffff640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf014b0a0 0x7fecf0157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 0x7fecf00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 -- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf014b0a0 msgr2=0x7fecf0157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf014b0a0 0x7fecf0157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 -- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 msgr2=0x7fecf00c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 0x7fecf00c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecef7fe640 1 -- 172.21.15.93:0/1465517890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0158920 con 0x7fecf014b480 2023-11-04T01:37:09.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.975+0000 7fecf4df3640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 0x7fecf00c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:09.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fecef7fe640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fece00119a0 tx=0x7fece0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000f9d0 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece000fb30 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf00cba40 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000fea0 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.976+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf00cc140 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.977+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0074290 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.977+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fece0014440 con 0x7fecf014b480 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.978+0000 7fececff9640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 0x7fecdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.978+0000 7feceffff640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 0x7fecdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.978+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fece0089cb0 con 0x7fecf014b480 2023-11-04T01:37:09.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.978+0000 7feceffff640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 0x7fecdc06d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fece4001910 tx=0x7fece4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:09.982+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fece0055020 con 0x7fecf014b480 2023-11-04T01:37:10.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.149+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fecf00c6950 con 0x7fecf014b480 2023-11-04T01:37:10.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.150+0000 7fececff9640 1 -- 172.21.15.93:0/1465517890 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7fece0058640 con 0x7fecf014b480 2023-11-04T01:37:10.153 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:10.153 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:37:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:37:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:37:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:10.154 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 msgr2=0x7fecdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 0x7fecdc06d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fece4001910 tx=0x7fece4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 msgr2=0x7fecf00c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fece00119a0 tx=0x7fece0011da0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 shutdown_connections 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fecdc06ae70 0x7fecdc06d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecf0152090 0x7fecf00c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecf014b480 0x7fecf00c7ec0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 --2- 172.21.15.93:0/1465517890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecf014b0a0 0x7fecf0157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 >> 172.21.15.93:0/1465517890 conn(0x7fecf0071f30 msgr2=0x7fecf00cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:10.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 shutdown_connections 2023-11-04T01:37:10.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.152+0000 7fecf6856640 1 -- 172.21.15.93:0/1465517890 wait complete. 2023-11-04T01:37:10.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:37:10.165 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:37:10.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.266+0000 7f0c7d0c2640 1 Processor -- start 2023-11-04T01:37:10.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.266+0000 7f0c7d0c2640 1 -- start start 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7d0c2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c7815e420 0x7f0c780ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7d0c2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780c5890 con 0x7f0c780adc70 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7d0c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780cd8e0 con 0x7f0c78159be0 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7d0c2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780c5670 con 0x7f0c7815e420 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c7815e420 0x7f0c780ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7759e640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0c780adc70 0x7f0c780c3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47036/0 (socket says 172.21.15.93:47036) 2023-11-04T01:37:10.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7759e640 1 -- 172.21.15.93:0/3456937893 learned_addr learned my addr 172.21.15.93:0/3456937893 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c75d9b640 1 -- 172.21.15.93:0/3456937893 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821462408 0 0) 0x7f0c780c5890 con 0x7f0c780adc70 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c75d9b640 1 -- 172.21.15.93:0/3456937893 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c60003520 con 0x7f0c780adc70 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7659c640 1 -- 172.21.15.93:0/3456937893 >> v1:172.21.15.125:6789/0 conn(0x7f0c78159be0 legacy=0x7f0c780c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7659c640 1 -- 172.21.15.93:0/3456937893 >> v1:172.21.15.93:6789/0 conn(0x7f0c780adc70 legacy=0x7f0c780c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.267+0000 7f0c7659c640 1 -- 172.21.15.93:0/3456937893 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780cdbc0 con 0x7f0c7815e420 2023-11-04T01:37:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.268+0000 7f0c7659c640 1 --2- 172.21.15.93:0/3456937893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780ad730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3df30bdd4ad7df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c75d9b640 1 -- 172.21.15.93:0/3456937893 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031830 con 0x7f0c7815e420 2023-11-04T01:37:10.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c75d9b640 1 -- 172.21.15.93:0/3456937893 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c031990 con 0x7f0c7815e420 2023-11-04T01:37:10.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c75d9b640 1 -- 172.21.15.93:0/3456937893 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031d20 con 0x7f0c7815e420 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/3456937893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 msgr2=0x7f0c780ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/3456937893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780ad730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/3456937893 shutdown_connections 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/3456937893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780ad730 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/3456937893 >> 172.21.15.93:0/3456937893 conn(0x7f0c780b05d0 msgr2=0x7f0c780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/3456937893 shutdown_connections 2023-11-04T01:37:10.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.270+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/3456937893 wait complete. 2023-11-04T01:37:10.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 Processor -- start 2023-11-04T01:37:10.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 -- start start 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c780adc70 0x7f0c78153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c78159be0 0x7f0c781530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78071690 con 0x7f0c7815e420 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78070830 con 0x7f0c780adc70 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7d0c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78070a80 con 0x7f0c78159be0 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.272+0000 7f0c7759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41448/0 (socket says 172.21.15.93:41448) 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 -- 172.21.15.93:0/245681727 learned_addr learned my addr 172.21.15.93:0/245681727 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c76d9d640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c780adc70 0x7f0c78153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7659c640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c78159be0 0x7f0c781530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 -- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c78159be0 msgr2=0x7f0c781530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c78159be0 0x7f0c781530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 -- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c780adc70 msgr2=0x7f0c78153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c780adc70 0x7f0c78153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 -- 172.21.15.93:0/245681727 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009400 con 0x7f0c7815e420 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7759e640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000caa0 tx=0x7f0c7000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000ac00 con 0x7f0c7815e420 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7000ad60 con 0x7f0c7815e420 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c78070d60 con 0x7f0c7815e420 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70012620 con 0x7f0c7815e420 2023-11-04T01:37:10.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.273+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c78071320 con 0x7f0c7815e420 2023-11-04T01:37:10.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.274+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7806e1e0 con 0x7f0c7815e420 2023-11-04T01:37:10.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.275+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c70007070 con 0x7f0c7815e420 2023-11-04T01:37:10.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.275+0000 7f0c5f7fe640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:10.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.275+0000 7f0c76d9d640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:10.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.275+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0c70089340 con 0x7f0c7815e420 2023-11-04T01:37:10.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.276+0000 7f0c76d9d640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 0x7f0c6406d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c68000f60 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:10.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.279+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c700546b0 con 0x7f0c7815e420 2023-11-04T01:37:10.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:10.447+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c780b38a0 con 0x7f0c7815e420 2023-11-04T01:37:11.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.269+0000 7f0c5f7fe640 1 -- 172.21.15.93:0/245681727 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c780b38a0 con 0x7f0c7815e420 2023-11-04T01:37:11.272 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:37:11.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.273+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 msgr2=0x7f0c6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.273+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 0x7f0c6406d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c68000f60 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2023-11-04T01:37:11.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.273+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 msgr2=0x7f0c780c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.273+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000caa0 tx=0x7f0c7000cf60 comp rx=0 tx=0).stop 2023-11-04T01:37:11.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 shutdown_connections 2023-11-04T01:37:11.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c6406ae70 0x7f0c6406d330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c7815e420 0x7f0c780c83a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c78159be0 0x7f0c781530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 --2- 172.21.15.93:0/245681727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c780adc70 0x7f0c78153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 >> 172.21.15.93:0/245681727 conn(0x7f0c780b05d0 msgr2=0x7f0c780c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:11.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 shutdown_connections 2023-11-04T01:37:11.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.274+0000 7f0c7d0c2640 1 -- 172.21.15.93:0/245681727 wait complete. 2023-11-04T01:37:11.292 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:37:11.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 Processor -- start 2023-11-04T01:37:11.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 -- start start 2023-11-04T01:37:11.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faeb4159c00 0x7faeb40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faeb40ae1d0 0x7faeb40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb415aff0 con 0x7faeb40c48e0 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40c52d0 con 0x7faeb40ae1d0 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.400+0000 7faebb1f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb415a3e0 con 0x7faeb4159c00 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faeb40ae1d0 0x7faeb40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faeb40ae1d0 0x7faeb40c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44598/0 (socket says 172.21.15.93:44598) 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb3fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7faeb40c48e0 0x7faeb40adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47174/0 (socket says 172.21.15.93:47174) 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 -- 172.21.15.93:0/3091665047 learned_addr learned my addr 172.21.15.93:0/3091665047 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb8f91640 1 --2- 172.21.15.93:0/3091665047 >> v2:172.21.15.125:3300/0 conn(0x7faeb4159c00 0x7faeb40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 -- 172.21.15.93:0/3091665047 >> v2:172.21.15.125:3300/0 conn(0x7faeb4159c00 msgr2=0x7faeb40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 --2- 172.21.15.93:0/3091665047 >> v2:172.21.15.125:3300/0 conn(0x7faeb4159c00 0x7faeb40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 -- 172.21.15.93:0/3091665047 >> v1:172.21.15.93:6789/0 conn(0x7faeb40c48e0 legacy=0x7faeb40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb9792640 1 -- 172.21.15.93:0/3091665047 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb415a6c0 con 0x7faeb40ae1d0 2023-11-04T01:37:11.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.401+0000 7faeb37fe640 1 -- 172.21.15.93:0/3091665047 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743064114 0 0) 0x7faeb415aff0 con 0x7faeb40c48e0 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faeb9792640 1 --2- 172.21.15.93:0/3091665047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40ae1d0 0x7faeb40c4d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faeb40cc4d0 tx=0x7faeac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6089f4e10031974f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faeb37fe640 1 -- 172.21.15.93:0/3091665047 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac02ca80 con 0x7faeb40ae1d0 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faeb37fe640 1 -- 172.21.15.93:0/3091665047 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac02cbe0 con 0x7faeb40ae1d0 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faeb37fe640 1 -- 172.21.15.93:0/3091665047 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0343f0 con 0x7faeb40ae1d0 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 -- 172.21.15.93:0/3091665047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40ae1d0 msgr2=0x7faeb40c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 --2- 172.21.15.93:0/3091665047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40ae1d0 0x7faeb40c4d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faeb40cc4d0 tx=0x7faeac02bee0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 -- 172.21.15.93:0/3091665047 shutdown_connections 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 --2- 172.21.15.93:0/3091665047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40ae1d0 0x7faeb40c4d90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 --2- 172.21.15.93:0/3091665047 >> v2:172.21.15.125:3300/0 conn(0x7faeb4159c00 0x7faeb40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 -- 172.21.15.93:0/3091665047 >> 172.21.15.93:0/3091665047 conn(0x7faeb40ce950 msgr2=0x7faeb40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:11.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 -- 172.21.15.93:0/3091665047 shutdown_connections 2023-11-04T01:37:11.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.402+0000 7faebb1f5640 1 -- 172.21.15.93:0/3091665047 wait complete. 2023-11-04T01:37:11.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.403+0000 7faebb1f5640 1 Processor -- start 2023-11-04T01:37:11.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.403+0000 7faebb1f5640 1 -- start start 2023-11-04T01:37:11.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb40ae1d0 0x7faeb4147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb4159c00 0x7faeb40c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40af180 con 0x7faeb40c48e0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4158df0 con 0x7faeb4159c00 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faebb1f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40ae7e0 con 0x7faeb40ae1d0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.404+0000 7faeb3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44612/0 (socket says 172.21.15.93:44612) 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 -- 172.21.15.93:0/1645577941 learned_addr learned my addr 172.21.15.93:0/1645577941 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb8f91640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb40ae1d0 0x7faeb4147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb9792640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb4159c00 0x7faeb40c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 -- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb40ae1d0 msgr2=0x7faeb4147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb40ae1d0 0x7faeb4147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 -- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb4159c00 msgr2=0x7faeb40c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb4159c00 0x7faeb40c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 -- 172.21.15.93:0/1645577941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac009b30 con 0x7faeb40c48e0 2023-11-04T01:37:11.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb3fff640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faea000c4d0 tx=0x7faea000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00074e0 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0007660 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40aeac0 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0004a20 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.405+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb40af5a0 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.406+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb40af2c0 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.407+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faea001c3b0 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.407+0000 7faeb17fa640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 0x7fae9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.407+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7faea0088a60 con 0x7faeb40c48e0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.407+0000 7faeb8f91640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 0x7fae9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:11.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.407+0000 7faeb8f91640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 0x7fae9806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faea80079a0 tx=0x7faea8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:11.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.411+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faea0053dd0 con 0x7faeb40c48e0 2023-11-04T01:37:11.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:11.579+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faeb40af2c0 con 0x7faeb40c48e0 2023-11-04T01:37:12.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.274+0000 7faeb17fa640 1 -- 172.21.15.93:0/1645577941 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7faeb40af2c0 con 0x7faeb40c48e0 2023-11-04T01:37:12.276 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 msgr2=0x7fae9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 0x7fae9806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faea80079a0 tx=0x7faea8008040 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 msgr2=0x7faeb40c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faea000c4d0 tx=0x7faea000c990 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 shutdown_connections 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fae9806ae70 0x7fae9806d330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeb4159c00 0x7faeb40c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faeb40c48e0 0x7faeb40c7a30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 --2- 172.21.15.93:0/1645577941 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faeb40ae1d0 0x7faeb4147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 >> 172.21.15.93:0/1645577941 conn(0x7faeb40ce950 msgr2=0x7faeb406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 shutdown_connections 2023-11-04T01:37:12.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.276+0000 7faebb1f5640 1 -- 172.21.15.93:0/1645577941 wait complete. 2023-11-04T01:37:12.300 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:37:12.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.402+0000 7f51a232c640 1 Processor -- start 2023-11-04T01:37:12.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.402+0000 7f51a232c640 1 -- start start 2023-11-04T01:37:12.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f51a232c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f519c0c4ff0 0x7f519c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f51a232c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f519c0adac0 0x7f519c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f51a232c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c15aff0 con 0x7f519c159c00 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f51a232c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0ae460 con 0x7f519c0c4ff0 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f51a232c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c15a3e0 con 0x7f519c0adac0 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f519c0c4ff0 0x7f519c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f519c0c4ff0 0x7f519c0cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44624/0 (socket says 172.21.15.93:44624) 2023-11-04T01:37:12.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 -- 172.21.15.93:0/1524921014 learned_addr learned my addr 172.21.15.93:0/1524921014 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:12.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 -- 172.21.15.93:0/1524921014 >> v2:172.21.15.125:3300/0 conn(0x7f519c0adac0 msgr2=0x7f519c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:12.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 --2- 172.21.15.93:0/1524921014 >> v2:172.21.15.125:3300/0 conn(0x7f519c0adac0 0x7f519c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 -- 172.21.15.93:0/1524921014 >> v1:172.21.15.125:6789/0 conn(0x7f519c159c00 legacy=0x7f519c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:12.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.403+0000 7f519b7fe640 1 -- 172.21.15.93:0/1524921014 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c15a6c0 con 0x7f519c0c4ff0 2023-11-04T01:37:12.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f519b7fe640 1 --2- 172.21.15.93:0/1524921014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c0c4ff0 0x7f519c0cc890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f519c0c59a0 tx=0x7f519002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdabffbb77984228 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f519affd640 1 -- 172.21.15.93:0/1524921014 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190031870 con 0x7f519c0c4ff0 2023-11-04T01:37:12.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f519affd640 1 -- 172.21.15.93:0/1524921014 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900319d0 con 0x7f519c0c4ff0 2023-11-04T01:37:12.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f519affd640 1 -- 172.21.15.93:0/1524921014 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190031d60 con 0x7f519c0c4ff0 2023-11-04T01:37:12.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 -- 172.21.15.93:0/1524921014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c0c4ff0 msgr2=0x7f519c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 --2- 172.21.15.93:0/1524921014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c0c4ff0 0x7f519c0cc890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f519c0c59a0 tx=0x7f519002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 -- 172.21.15.93:0/1524921014 shutdown_connections 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 --2- 172.21.15.93:0/1524921014 >> v2:172.21.15.125:3300/0 conn(0x7f519c0adac0 0x7f519c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 --2- 172.21.15.93:0/1524921014 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c0c4ff0 0x7f519c0cc890 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.404+0000 7f51a232c640 1 -- 172.21.15.93:0/1524921014 >> 172.21.15.93:0/1524921014 conn(0x7f519c0ce950 msgr2=0x7f519c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.405+0000 7f51a232c640 1 -- 172.21.15.93:0/1524921014 shutdown_connections 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.405+0000 7f51a232c640 1 -- 172.21.15.93:0/1524921014 wait complete. 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 Processor -- start 2023-11-04T01:37:12.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 -- start start 2023-11-04T01:37:12.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f519c0adac0 0x7f519c1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f519c0c4ff0 0x7f519c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c6d40 con 0x7f519c159c00 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c7020 con 0x7f519c0adac0 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.406+0000 7f51a232c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c7300 con 0x7f519c0c4ff0 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44638/0 (socket says 172.21.15.93:44638) 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 -- 172.21.15.93:0/1141865841 learned_addr learned my addr 172.21.15.93:0/1141865841 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f519bfff640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f519c0adac0 0x7f519c1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f519b7fe640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f519c0c4ff0 0x7f519c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 -- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f519c0c4ff0 msgr2=0x7f519c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f519c0c4ff0 0x7f519c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 -- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f519c0adac0 msgr2=0x7f519c1efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f519c0adac0 0x7f519c1efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 -- 172.21.15.93:0/1141865841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094d0 con 0x7f519c159c00 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a08c9640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f519400b970 tx=0x7f519400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400cb40 con 0x7f519c159c00 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400ccc0 con 0x7f519c159c00 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c0c75e0 con 0x7f519c159c00 2023-11-04T01:37:12.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194014680 con 0x7f519c159c00 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.407+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c1f0180 con 0x7f519c159c00 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.408+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c0c7b00 con 0x7f519c159c00 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.409+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f519401d3b0 con 0x7f519c159c00 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.409+0000 7f5198ff9640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 0x7f518806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.409+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f5194089590 con 0x7f519c159c00 2023-11-04T01:37:12.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.409+0000 7f519bfff640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 0x7f518806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.409+0000 7f519bfff640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 0x7f518806d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.413+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f519c0c7b00 con 0x7f519c159c00 2023-11-04T01:37:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:12.617+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f519c0c7b00 con 0x7f519c159c00 2023-11-04T01:37:13.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.275+0000 7f5198ff9640 1 -- 172.21.15.93:0/1141865841 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f519c0c7b00 con 0x7f519c159c00 2023-11-04T01:37:13.278 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 5 and data pool 6 2023-11-04T01:37:13.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 msgr2=0x7f518806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 0x7f518806d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f518c006fd0 tx=0x7f518c009060 comp rx=0 tx=0).stop 2023-11-04T01:37:13.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 msgr2=0x7f519c0c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f519400b970 tx=0x7f519400be30 comp rx=0 tx=0).stop 2023-11-04T01:37:13.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 shutdown_connections 2023-11-04T01:37:13.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.279+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f518806aea0 0x7f518806d360 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.280+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f519c159c00 0x7f519c0c7de0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.280+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f519c0c4ff0 0x7f519c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.280+0000 7f51a232c640 1 --2- 172.21.15.93:0/1141865841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f519c0adac0 0x7f519c1efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.280+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 >> 172.21.15.93:0/1141865841 conn(0x7f519c0ce950 msgr2=0x7f519c0709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.282+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 shutdown_connections 2023-11-04T01:37:13.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.288+0000 7f51a232c640 1 -- 172.21.15.93:0/1141865841 wait complete. 2023-11-04T01:37:13.312 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:13.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.409+0000 7f1b31439640 1 Processor -- start 2023-11-04T01:37:13.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.409+0000 7f1b31439640 1 -- start start 2023-11-04T01:37:13.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b31439640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1b2c15ac70 0x7f1b2c0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b31439640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0b3c10 con 0x7f1b2c0cec10 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b31439640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0cf180 con 0x7f1b2c0b2d10 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b31439640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cf460 con 0x7f1b2c15ac70 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b2affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1b2c15ac70 0x7f1b2c0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b2affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1b2c15ac70 0x7f1b2c0d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44644/0 (socket says 172.21.15.93:44644) 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b2a7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1b2c0cec10 0x7f1b2c0b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47184/0 (socket says 172.21.15.93:47184) 2023-11-04T01:37:13.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.410+0000 7f1b2affd640 1 -- 172.21.15.93:0/2562244391 learned_addr learned my addr 172.21.15.93:0/2562244391 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b2affd640 1 -- 172.21.15.93:0/2562244391 >> v1:172.21.15.125:6789/0 conn(0x7f1b2c0b2d10 legacy=0x7f1b2c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b2affd640 1 -- 172.21.15.93:0/2562244391 >> v1:172.21.15.93:6789/0 conn(0x7f1b2c0cec10 legacy=0x7f1b2c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b2affd640 1 -- 172.21.15.93:0/2562244391 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0cf740 con 0x7f1b2c15ac70 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b2affd640 1 --2- 172.21.15.93:0/2562244391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c15ac70 0x7f1b2c0d0330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ea0 tx=0x7f1b1c02bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2ba18aec4a3726 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b29ffb640 1 -- 172.21.15.93:0/2562244391 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c02cb60 con 0x7f1b2c15ac70 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b29ffb640 1 -- 172.21.15.93:0/2562244391 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c02ccc0 con 0x7f1b2c15ac70 2023-11-04T01:37:13.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.411+0000 7f1b29ffb640 1 -- 172.21.15.93:0/2562244391 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c034610 con 0x7f1b2c15ac70 2023-11-04T01:37:13.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 -- 172.21.15.93:0/2562244391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c15ac70 msgr2=0x7f1b2c0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 --2- 172.21.15.93:0/2562244391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c15ac70 0x7f1b2c0d0330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ea0 tx=0x7f1b1c02bfc0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 -- 172.21.15.93:0/2562244391 shutdown_connections 2023-11-04T01:37:13.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 --2- 172.21.15.93:0/2562244391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c15ac70 0x7f1b2c0d0330 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 -- 172.21.15.93:0/2562244391 >> 172.21.15.93:0/2562244391 conn(0x7f1b2c0cd600 msgr2=0x7f1b2c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 -- 172.21.15.93:0/2562244391 shutdown_connections 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.412+0000 7f1b31439640 1 -- 172.21.15.93:0/2562244391 wait complete. 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.413+0000 7f1b31439640 1 Processor -- start 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.413+0000 7f1b31439640 1 -- start start 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b2c0b2d10 0x7f1b2c1e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b2c15ac70 0x7f1b2c148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c61e0 con 0x7f1b2c0cec10 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c64c0 con 0x7f1b2c0b2d10 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b31439640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c67a0 con 0x7f1b2c15ac70 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44652/0 (socket says 172.21.15.93:44652) 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 -- 172.21.15.93:0/2298537136 learned_addr learned my addr 172.21.15.93:0/2298537136 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:13.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2affd640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b2c0b2d10 0x7f1b2c1e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 -- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b2c15ac70 msgr2=0x7f1b2c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b2c15ac70 0x7f1b2c148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 -- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b2c0b2d10 msgr2=0x7f1b2c1e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b2c0b2d10 0x7f1b2c1e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.414+0000 7f1b2a7fc640 1 -- 172.21.15.93:0/2298537136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c009b30 con 0x7f1b2c0cec10 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b2a7fc640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c450 tx=0x7f1b2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20007480 con 0x7f1b2c0cec10 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20007600 con 0x7f1b2c0cec10 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0c6a80 con 0x7f1b2c0cec10 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20004a20 con 0x7f1b2c0cec10 2023-11-04T01:37:13.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.415+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c14c850 con 0x7f1b2c0cec10 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.416+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c0c6fa0 con 0x7f1b2c0cec10 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.416+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b20004b80 con 0x7f1b2c0cec10 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.416+0000 7f1b137fe640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 0x7f1b1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.417+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b20088760 con 0x7f1b2c0cec10 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.417+0000 7f1b2affd640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 0x7f1b1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.417+0000 7f1b2affd640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 0x7f1b1806d360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c035000 tx=0x7f1b1c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.421+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b2c0c6fa0 con 0x7f1b2c0cec10 2023-11-04T01:37:13.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.587+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b2c0c6fa0 con 0x7f1b2c0cec10 2023-11-04T01:37:13.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.588+0000 7f1b137fe640 1 -- 172.21.15.93:0/2298537136 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f1b2c0c6fa0 con 0x7f1b2c0cec10 2023-11-04T01:37:13.591 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:13.591 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":37,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:12.619496+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:13.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 msgr2=0x7f1b1806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 0x7f1b1806d360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c035000 tx=0x7f1b1c030000 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 msgr2=0x7f1b2c0c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c450 tx=0x7f1b2000c910 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 shutdown_connections 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1b1806aea0 0x7f1b1806d360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1b2c15ac70 0x7f1b2c148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b2c0cec10 0x7f1b2c0c56e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 --2- 172.21.15.93:0/2298537136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b2c0b2d10 0x7f1b2c1e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 >> 172.21.15.93:0/2298537136 conn(0x7f1b2c0cd600 msgr2=0x7f1b2c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 shutdown_connections 2023-11-04T01:37:13.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.590+0000 7f1b31439640 1 -- 172.21.15.93:0/2298537136 wait complete. 2023-11-04T01:37:13.603 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.700+0000 7f1c7ce56640 1 Processor -- start 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.700+0000 7f1c7ce56640 1 -- start start 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c7ce56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780cde60 0x7f1c7815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c7ce56640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7815e000 con 0x7f1c7815daa0 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c7ce56640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7815e2e0 con 0x7f1c780ce240 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c7ce56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815e5c0 con 0x7f1c780cde60 2023-11-04T01:37:13.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c6ffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1c7815daa0 0x7f1c78157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47192/0 (socket says 172.21.15.93:47192) 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.701+0000 7f1c6ffff640 1 -- 172.21.15.93:0/3465995835 learned_addr learned my addr 172.21.15.93:0/3465995835 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675663347 0 0) 0x7f1c7815e000 con 0x7f1c7815daa0 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780cde60 0x7f1c7815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c64003520 con 0x7f1c7815daa0 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491391951 0 0) 0x7f1c64003520 con 0x7f1c7815daa0 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780cde60 msgr2=0x7f1c7815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780cde60 0x7f1c7815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 >> v1:172.21.15.125:6789/0 conn(0x7f1c780ce240 legacy=0x7f1c780d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780d1120 con 0x7f1c7815daa0 2023-11-04T01:37:13.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1c60001670 con 0x7f1c7815daa0 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 >> v1:172.21.15.93:6789/0 conn(0x7f1c7815daa0 legacy=0x7f1c78157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c640047c0 0x7f1c64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64005180 0x7f1c6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815e5c0 con 0x7f1c640039a0 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6400c020 con 0x7f1c640047c0 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6400c1e0 con 0x7f1c64005180 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780cde60 0x7f1c7815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c6ffff640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c640047c0 0x7f1c64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c76d9d640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64005180 0x7f1c6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 -- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64005180 msgr2=0x7f1c6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64005180 0x7f1c6400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 -- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c640047c0 msgr2=0x7f1c64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c640047c0 0x7f1c64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c7659c640 1 -- 172.21.15.93:0/3465995835 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64003520 con 0x7f1c640039a0 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.702+0000 7f1c76d9d640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c64005180 0x7f1c6400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.703+0000 7f1c7659c640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c64003dc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3113d78357c3d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.703+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68033600 con 0x7f1c640039a0 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.703+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6802f050 con 0x7f1c640039a0 2023-11-04T01:37:13.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.703+0000 7f1c75d9b640 1 -- 172.21.15.93:0/3465995835 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68033980 con 0x7f1c640039a0 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 -- 172.21.15.93:0/3465995835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 msgr2=0x7f1c64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/3465995835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c64003dc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c640057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c76d9d640 1 -- 172.21.15.93:0/3465995835 reap_dead start 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 -- 172.21.15.93:0/3465995835 shutdown_connections 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 -- 172.21.15.93:0/3465995835 >> 172.21.15.93:0/3465995835 conn(0x7f1c78071f30 msgr2=0x7f1c780cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 -- 172.21.15.93:0/3465995835 shutdown_connections 2023-11-04T01:37:13.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.704+0000 7f1c7ce56640 1 -- 172.21.15.93:0/3465995835 wait complete. 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.705+0000 7f1c7ce56640 1 Processor -- start 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.705+0000 7f1c7ce56640 1 -- start start 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 0x7f1c781583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 0x7f1c78159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780cc3e0 con 0x7f1c640039a0 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7814abc0 con 0x7f1c78158910 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7ce56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780cae00 con 0x7f1c780ca900 2023-11-04T01:37:13.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44682/0 (socket says 172.21.15.93:44682) 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 -- 172.21.15.93:0/2835021333 learned_addr learned my addr 172.21.15.93:0/2835021333 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 -- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 msgr2=0x7f1c781583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c76d9d640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 0x7f1c78159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c6ffff640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 0x7f1c781583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 0x7f1c781583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 -- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 msgr2=0x7f1c78159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 0x7f1c78159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 -- 172.21.15.93:0/2835021333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780cb0e0 con 0x7f1c640039a0 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c6ffff640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 0x7f1c781583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:13.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c76d9d640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 0x7f1c78159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.706+0000 7f1c7659c640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c780d3f00 tx=0x7f1c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.707+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6803d710 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.707+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6803d870 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.707+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780cb3c0 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.707+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6803dc00 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.707+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780cb980 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.708+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c780cbb10 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.708+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c68032420 con 0x7f1c640039a0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.708+0000 7f1c6effd640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 0x7f1c5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.709+0000 7f1c6ffff640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 0x7f1c5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.708+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1c680ab240 con 0x7f1c640039a0 2023-11-04T01:37:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.709+0000 7f1c6ffff640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 0x7f1c5806d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000c00 tx=0x7f1c60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.713+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c680761b0 con 0x7f1c640039a0 2023-11-04T01:37:13.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.879+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c78074290 con 0x7f1c640039a0 2023-11-04T01:37:13.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.880+0000 7f1c6effd640 1 -- 172.21.15.93:0/2835021333 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f1c6800f040 con 0x7f1c640039a0 2023-11-04T01:37:13.883 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:13.883 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":37,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:12.619496+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 msgr2=0x7f1c5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 0x7f1c5806d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000c00 tx=0x7f1c60009040 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 msgr2=0x7f1c780cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c780d3f00 tx=0x7f1c680046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 shutdown_connections 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c5806ae70 0x7f1c5806d330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c78158910 0x7f1c78159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c780ca900 0x7f1c781583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 --2- 172.21.15.93:0/2835021333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c640039a0 0x7f1c780cbea0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 >> 172.21.15.93:0/2835021333 conn(0x7f1c78071f30 msgr2=0x7f1c780c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 shutdown_connections 2023-11-04T01:37:13.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.882+0000 7f1c7ce56640 1 -- 172.21.15.93:0/2835021333 wait complete. 2023-11-04T01:37:13.896 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:37:13.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.996+0000 7fa56b59e640 1 Processor -- start 2023-11-04T01:37:13.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.996+0000 7fa56b59e640 1 -- start start 2023-11-04T01:37:14.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56b59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa56c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56b59e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c0cbae0 con 0x7fa56c0b2990 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56b59e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c15a0d0 con 0x7fa56c159cf0 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56b59e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0b46f0 con 0x7fa56c0cb140 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56ad9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa56c0b2990 0x7fa56c0b2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47196/0 (socket says 172.21.15.93:47196) 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.997+0000 7fa56ad9d640 1 -- 172.21.15.93:0/1243976107 learned_addr learned my addr 172.21.15.93:0/1243976107 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:14.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa569d9b640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa56c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973929619 0 0) 0x7fa56c0cbae0 con 0x7fa56c0b2990 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003520 con 0x7fa56c0b2990 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259925738 0 0) 0x7fa554003520 con 0x7fa56c0b2990 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 msgr2=0x7fa56c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa56c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 >> v1:172.21.15.125:6789/0 conn(0x7fa56c159cf0 legacy=0x7fa56c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0cae10 con 0x7fa56c0b2990 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa564001670 con 0x7fa56c0b2990 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 >> v1:172.21.15.93:6789/0 conn(0x7fa56c0b2990 legacy=0x7fa56c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5540039a0 0x7fa554003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa5540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa554004d00 0x7fa554005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0b46f0 con 0x7fa5540039a0 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400ba30 con 0x7fa554004d00 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400bbf0 con 0x7fa56c0cb140 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56a59c640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5540039a0 0x7fa554003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa569d9b640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa5540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56ad9d640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa554004d00 0x7fa554005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56a59c640 1 -- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 msgr2=0x7fa5540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56a59c640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa56c0cb140 0x7fa5540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56a59c640 1 -- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa554004d00 msgr2=0x7fa554005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.998+0000 7fa56a59c640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa554004d00 0x7fa554005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.999+0000 7fa56a59c640 1 -- 172.21.15.93:0/1243976107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554003520 con 0x7fa5540039a0 2023-11-04T01:37:14.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.999+0000 7fa56a59c640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5540039a0 0x7fa554003dc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001c80 tx=0x7fa5540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3d4d6666553b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.999+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c003b70 con 0x7fa5540039a0 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.999+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c003cd0 con 0x7fa5540039a0 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:13.999+0000 7fa56959a640 1 -- 172.21.15.93:0/1243976107 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c005310 con 0x7fa5540039a0 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 -- 172.21.15.93:0/1243976107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5540039a0 msgr2=0x7fa554003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 --2- 172.21.15.93:0/1243976107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5540039a0 0x7fa554003dc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001c80 tx=0x7fa5540057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56ad9d640 1 -- 172.21.15.93:0/1243976107 reap_dead start 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 -- 172.21.15.93:0/1243976107 shutdown_connections 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 -- 172.21.15.93:0/1243976107 >> 172.21.15.93:0/1243976107 conn(0x7fa56c0b02c0 msgr2=0x7fa56c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 -- 172.21.15.93:0/1243976107 shutdown_connections 2023-11-04T01:37:14.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.000+0000 7fa56b59e640 1 -- 172.21.15.93:0/1243976107 wait complete. 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.001+0000 7fa56b59e640 1 Processor -- start 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.001+0000 7fa56b59e640 1 -- start start 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5540039a0 0x7fa56c150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa56c0ca140 0x7fa56c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0cab00 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0cd290 con 0x7fa56c0ca140 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56b59e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1f5b70 con 0x7fa5540039a0 2023-11-04T01:37:14.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44694/0 (socket says 172.21.15.93:44694) 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 -- 172.21.15.93:0/2866532718 learned_addr learned my addr 172.21.15.93:0/2866532718 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa569d9b640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa56c0ca140 0x7fa56c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56a59c640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5540039a0 0x7fa56c150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 -- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5540039a0 msgr2=0x7fa56c150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5540039a0 0x7fa56c150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 -- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa56c0ca140 msgr2=0x7fa56c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa56c0ca140 0x7fa56c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.002+0000 7fa56ad9d640 1 -- 172.21.15.93:0/2866532718 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c1f69d0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa56ad9d640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa56c072500 tx=0x7fa564007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400f620 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56400f7c0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1f5dc0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400fb70 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.003+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c1f6380 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.004+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c04ece0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.004+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa56400fcd0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.004+0000 7fa55affd640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 0x7fa54c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.005+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa5640895a0 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.005+0000 7fa56a59c640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 0x7fa54c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.005+0000 7fa56a59c640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 0x7fa54c06d360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa55c034000 tx=0x7fa55c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.009+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa564054510 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.210+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa56c0cf500 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.291+0000 7fa55affd640 1 -- 172.21.15.93:0/2866532718 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa564057b30 con 0x7fa56c0cc8d0 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 msgr2=0x7fa54c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 0x7fa54c06d360 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa55c034000 tx=0x7fa55c009030 comp rx=0 tx=0).stop 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 msgr2=0x7fa56c0ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa56c072500 tx=0x7fa564007430 comp rx=0 tx=0).stop 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 shutdown_connections 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa54c06aea0 0x7fa54c06d360 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa56c0cc8d0 0x7fa56c0ccd50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa56c0ca140 0x7fa56c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 --2- 172.21.15.93:0/2866532718 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5540039a0 0x7fa56c150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 >> 172.21.15.93:0/2866532718 conn(0x7fa56c0b02c0 msgr2=0x7fa56c0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 shutdown_connections 2023-11-04T01:37:14.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.293+0000 7fa56b59e640 1 -- 172.21.15.93:0/2866532718 wait complete. 2023-11-04T01:37:14.307 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:37:14.307 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:37:14.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.407+0000 7fb9f21ce640 1 Processor -- start 2023-11-04T01:37:14.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.407+0000 7fb9f21ce640 1 -- start start 2023-11-04T01:37:14.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9f21ce640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb9ec159c00 0x7fb9ec0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9f21ce640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec15aff0 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9f21ce640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec15a3e0 con 0x7fb9ec0ae1d0 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9f21ce640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec15a6c0 con 0x7fb9ec159c00 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9eaffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb9ec0c48e0 0x7fb9ec0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47202/0 (socket says 172.21.15.93:47202) 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9eaffd640 1 -- 172.21.15.93:0/3920980392 learned_addr learned my addr 172.21.15.93:0/3920980392 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808120693 0 0) 0x7fb9ec15aff0 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9eb7fe640 1 --2- 172.21.15.93:0/3920980392 >> v2:172.21.15.125:3300/0 conn(0x7fb9ec159c00 0x7fb9ec0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.408+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d4005730 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2759953500 0 0) 0x7fb9d4005730 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 >> v2:172.21.15.125:3300/0 conn(0x7fb9ec159c00 msgr2=0x7fb9ec0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 --2- 172.21.15.93:0/3920980392 >> v2:172.21.15.125:3300/0 conn(0x7fb9ec159c00 0x7fb9ec0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 >> v1:172.21.15.125:6789/0 conn(0x7fb9ec0ae1d0 legacy=0x7fb9ec0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec15a9a0 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fb9dc001670 con 0x7fb9ec0c48e0 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 >> v1:172.21.15.93:6789/0 conn(0x7fb9ec0c48e0 legacy=0x7fb9ec0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9d4005b80 0x7fb9d4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 0x7fb9d4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d4007390 0x7fb9d400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec15a6c0 con 0x7fb9d40069d0 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400e330 con 0x7fb9d4007390 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400e4f0 con 0x7fb9d4005b80 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 0x7fb9d4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eb7fe640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9d4005b80 0x7fb9d4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ebfff640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d4007390 0x7fb9d400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 -- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9d4005b80 msgr2=0x7fb9d4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9d4005b80 0x7fb9d4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 -- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d4007390 msgr2=0x7fb9d400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d4007390 0x7fb9d400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9eaffd640 1 -- 172.21.15.93:0/3920980392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4005730 con 0x7fb9d40069d0 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.409+0000 7fb9ebfff640 1 -- 172.21.15.93:0/3920980392 reap_dead start 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 0x7fb9d4006e50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c240 tx=0x7fb9d4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c037abe60edcbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc005ad0 con 0x7fb9d40069d0 2023-11-04T01:37:14.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005c30 con 0x7fb9d40069d0 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9ea7fc640 1 -- 172.21.15.93:0/3920980392 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc02caf0 con 0x7fb9d40069d0 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9f21ce640 1 -- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 msgr2=0x7fb9d4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.410+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 0x7fb9d4006e50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c240 tx=0x7fb9d4007a00 comp rx=0 tx=0).stop 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.411+0000 7fb9f21ce640 1 -- 172.21.15.93:0/3920980392 shutdown_connections 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.411+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/3920980392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9d40069d0 0x7fb9d4006e50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.411+0000 7fb9f21ce640 1 -- 172.21.15.93:0/3920980392 >> 172.21.15.93:0/3920980392 conn(0x7fb9ec0ce950 msgr2=0x7fb9ec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.411+0000 7fb9f21ce640 1 -- 172.21.15.93:0/3920980392 shutdown_connections 2023-11-04T01:37:14.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.411+0000 7fb9f21ce640 1 -- 172.21.15.93:0/3920980392 wait complete. 2023-11-04T01:37:14.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.412+0000 7fb9f21ce640 1 Processor -- start 2023-11-04T01:37:14.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.412+0000 7fb9f21ce640 1 -- start start 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d40069d0 0x7fb9ec141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9ec144a10 0x7fb9ec144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0c84c0 con 0x7fb9ec0c7480 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0c7940 con 0x7fb9d40069d0 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0c7c20 con 0x7fb9ec144a10 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44714/0 (socket says 172.21.15.93:44714) 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 -- 172.21.15.93:0/862463323 learned_addr learned my addr 172.21.15.93:0/862463323 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eb7fe640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d40069d0 0x7fb9ec141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9ebfff640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9ec144a10 0x7fb9ec144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 -- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9ec144a10 msgr2=0x7fb9ec144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9ec144a10 0x7fb9ec144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 -- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d40069d0 msgr2=0x7fb9ec141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d40069d0 0x7fb9ec141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 -- 172.21.15.93:0/862463323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0c7f00 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9eaffd640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc001930 tx=0x7fb9dc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc03c040 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc02cd80 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0c81e0 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc007290 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.413+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec145400 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.414+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0c7d60 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.415+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9dc032070 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.415+0000 7fb9d3fff640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.415+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb9dc0aaac0 con 0x7fb9ec0c7480 2023-11-04T01:37:14.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.415+0000 7fb9eb7fe640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.416+0000 7fb9eb7fe640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 0x7fb9d806d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009b40 tx=0x7fb9e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.419+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9ec0c7d60 con 0x7fb9ec0c7480 2023-11-04T01:37:14.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:14.620+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb9ec0c7d60 con 0x7fb9ec0c7480 2023-11-04T01:37:15.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.298+0000 7fb9d3fff640 1 -- 172.21.15.93:0/862463323 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb9ec0c7d60 con 0x7fb9ec0c7480 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 msgr2=0x7fb9d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 0x7fb9d806d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009b40 tx=0x7fb9e0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 msgr2=0x7fb9ec142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc001930 tx=0x7fb9dc02e070 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 shutdown_connections 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9ec144a10 0x7fb9ec144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9ec0c7480 0x7fb9ec142000 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 --2- 172.21.15.93:0/862463323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9d40069d0 0x7fb9ec141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 >> 172.21.15.93:0/862463323 conn(0x7fb9ec0ce950 msgr2=0x7fb9ec06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 shutdown_connections 2023-11-04T01:37:15.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.300+0000 7fb9f21ce640 1 -- 172.21.15.93:0/862463323 wait complete. 2023-11-04T01:37:15.314 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:37:15.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:15.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.415+0000 7f2e7da21640 1 Processor -- start 2023-11-04T01:37:15.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.415+0000 7f2e7da21640 1 -- start start 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e7da21640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e7815ce60 0x7f2e7806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e7da21640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2e780cf160 0x7f2e780cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e7da21640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e781615d0 con 0x7f2e7806bd30 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e7da21640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e780cbde0 con 0x7f2e780cf160 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e7da21640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e780cfb30 con 0x7f2e7815ce60 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2e780cf160 0x7f2e780cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e767fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2e7806bd30 0x7f2e78160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47208/0 (socket says 172.21.15.93:47208) 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2e780cf160 0x7f2e780cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44724/0 (socket says 172.21.15.93:44724) 2023-11-04T01:37:15.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e767fc640 1 -- 172.21.15.93:0/2220437062 learned_addr learned my addr 172.21.15.93:0/2220437062 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:15.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 -- 172.21.15.93:0/2220437062 >> v2:172.21.15.125:3300/0 conn(0x7f2e7815ce60 msgr2=0x7f2e7806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 --2- 172.21.15.93:0/2220437062 >> v2:172.21.15.125:3300/0 conn(0x7f2e7815ce60 0x7f2e7806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 -- 172.21.15.93:0/2220437062 >> v1:172.21.15.93:6789/0 conn(0x7f2e7806bd30 legacy=0x7f2e78160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e777fe640 1 -- 172.21.15.93:0/2220437062 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781618b0 con 0x7f2e780cf160 2023-11-04T01:37:15.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.416+0000 7f2e75ffb640 1 -- 172.21.15.93:0/2220437062 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816189581 0 0) 0x7f2e781615d0 con 0x7f2e7806bd30 2023-11-04T01:37:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.417+0000 7f2e777fe640 1 --2- 172.21.15.93:0/2220437062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e780cf160 0x7f2e780cf5f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806e960 tx=0x7f2e7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807b991ae315207e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.417+0000 7f2e75ffb640 1 -- 172.21.15.93:0/2220437062 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70031830 con 0x7f2e780cf160 2023-11-04T01:37:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.417+0000 7f2e75ffb640 1 -- 172.21.15.93:0/2220437062 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70031990 con 0x7f2e780cf160 2023-11-04T01:37:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.417+0000 7f2e75ffb640 1 -- 172.21.15.93:0/2220437062 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70031d20 con 0x7f2e780cf160 2023-11-04T01:37:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 -- 172.21.15.93:0/2220437062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e780cf160 msgr2=0x7f2e780cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 --2- 172.21.15.93:0/2220437062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e780cf160 0x7f2e780cf5f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2e7806e960 tx=0x7f2e7002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 -- 172.21.15.93:0/2220437062 shutdown_connections 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 --2- 172.21.15.93:0/2220437062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e780cf160 0x7f2e780cf5f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 --2- 172.21.15.93:0/2220437062 >> v2:172.21.15.125:3300/0 conn(0x7f2e7815ce60 0x7f2e7806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 -- 172.21.15.93:0/2220437062 >> 172.21.15.93:0/2220437062 conn(0x7f2e7806ea90 msgr2=0x7f2e7806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 -- 172.21.15.93:0/2220437062 shutdown_connections 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.418+0000 7f2e7da21640 1 -- 172.21.15.93:0/2220437062 wait complete. 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.419+0000 7f2e7da21640 1 Processor -- start 2023-11-04T01:37:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.419+0000 7f2e7da21640 1 -- start start 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e780cf160 0x7f2e781f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e780ab950 0x7f2e780c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c7d10 con 0x7f2e7815ce60 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c7fb0 con 0x7f2e780ab950 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e7da21640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c8290 con 0x7f2e780cf160 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44726/0 (socket says 172.21.15.93:44726) 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 -- 172.21.15.93:0/577839086 learned_addr learned my addr 172.21.15.93:0/577839086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e777fe640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e780ab950 0x7f2e780c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e76ffd640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e780cf160 0x7f2e781f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 -- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e780cf160 msgr2=0x7f2e781f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e780cf160 0x7f2e781f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 -- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e780ab950 msgr2=0x7f2e780c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e780ab950 0x7f2e780c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 -- 172.21.15.93:0/577839086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70009400 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.420+0000 7f2e767fc640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00c430 tx=0x7f2e6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.421+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0074e0 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.421+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c007660 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.421+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e780c8570 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.421+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c004a20 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.421+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e781f5990 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.422+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780c8a90 con 0x7f2e7815ce60 2023-11-04T01:37:15.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.422+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e6c004b80 con 0x7f2e7815ce60 2023-11-04T01:37:15.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.422+0000 7f2e5ffff640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 0x7f2e6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.423+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e6c089580 con 0x7f2e7815ce60 2023-11-04T01:37:15.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.423+0000 7f2e76ffd640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 0x7f2e6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.423+0000 7f2e76ffd640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 0x7f2e6406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e780c70f0 tx=0x7f2e680094f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.427+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e780c8a90 con 0x7f2e7815ce60 2023-11-04T01:37:15.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.627+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e780c8a90 con 0x7f2e7815ce60 2023-11-04T01:37:15.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.627+0000 7f2e5ffff640 1 -- 172.21.15.93:0/577839086 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f2e780c8a90 con 0x7f2e7815ce60 2023-11-04T01:37:15.630 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:15.630 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:15.630 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:15.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 msgr2=0x7f2e6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 0x7f2e6406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e780c70f0 tx=0x7f2e680094f0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 msgr2=0x7f2e781f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00c430 tx=0x7f2e6c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 shutdown_connections 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e6406ae70 0x7f2e6406d330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e780ab950 0x7f2e780c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e7815ce60 0x7f2e781f5450 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 --2- 172.21.15.93:0/577839086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e780cf160 0x7f2e781f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 >> 172.21.15.93:0/577839086 conn(0x7f2e7806ea90 msgr2=0x7f2e7806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 shutdown_connections 2023-11-04T01:37:15.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.629+0000 7f2e7da21640 1 -- 172.21.15.93:0/577839086 wait complete. 2023-11-04T01:37:15.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:15.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.739+0000 7fb29b541640 1 Processor -- start 2023-11-04T01:37:15.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 -- start start 2023-11-04T01:37:15.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb29415ae40 0x7fb29415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2940cda30 0x7fb2940ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940cc450 con 0x7fb2940cbc00 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29415f400 con 0x7fb2940cda30 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb29b541640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29415b220 con 0x7fb29415ae40 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb299ade640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2940cda30 0x7fb2940ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb299ade640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2940cda30 0x7fb2940ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44740/0 (socket says 172.21.15.93:44740) 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb298adc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb2940cbc00 0x7fb2940cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47210/0 (socket says 172.21.15.93:47210) 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.740+0000 7fb299ade640 1 -- 172.21.15.93:0/3777187642 learned_addr learned my addr 172.21.15.93:0/3777187642 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb2992dd640 1 --2- 172.21.15.93:0/3777187642 >> v2:172.21.15.125:3300/0 conn(0x7fb29415ae40 0x7fb29415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb299ade640 1 -- 172.21.15.93:0/3777187642 >> v2:172.21.15.125:3300/0 conn(0x7fb29415ae40 msgr2=0x7fb29415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb299ade640 1 --2- 172.21.15.93:0/3777187642 >> v2:172.21.15.125:3300/0 conn(0x7fb29415ae40 0x7fb29415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb299ade640 1 -- 172.21.15.93:0/3777187642 >> v1:172.21.15.93:6789/0 conn(0x7fb2940cbc00 legacy=0x7fb2940cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb28bfff640 1 -- 172.21.15.93:0/3777187642 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555249262 0 0) 0x7fb284001110 con 0x7fb2940cbc00 2023-11-04T01:37:15.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.741+0000 7fb299ade640 1 -- 172.21.15.93:0/3777187642 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29415f890 con 0x7fb2940cda30 2023-11-04T01:37:15.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb299ade640 1 --2- 172.21.15.93:0/3777187642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940ced70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb29406e580 tx=0x7fb29002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce90c3a3c9f8ddc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb28bfff640 1 -- 172.21.15.93:0/3777187642 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290030860 con 0x7fb2940cda30 2023-11-04T01:37:15.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb28bfff640 1 -- 172.21.15.93:0/3777187642 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2900309c0 con 0x7fb2940cda30 2023-11-04T01:37:15.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb28bfff640 1 -- 172.21.15.93:0/3777187642 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290030d50 con 0x7fb2940cda30 2023-11-04T01:37:15.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 -- 172.21.15.93:0/3777187642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 msgr2=0x7fb2940ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 --2- 172.21.15.93:0/3777187642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940ced70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb29406e580 tx=0x7fb29002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 -- 172.21.15.93:0/3777187642 shutdown_connections 2023-11-04T01:37:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 --2- 172.21.15.93:0/3777187642 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940ced70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 --2- 172.21.15.93:0/3777187642 >> v2:172.21.15.125:3300/0 conn(0x7fb29415ae40 0x7fb29415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 -- 172.21.15.93:0/3777187642 >> 172.21.15.93:0/3777187642 conn(0x7fb29406ea90 msgr2=0x7fb29406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 -- 172.21.15.93:0/3777187642 shutdown_connections 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.742+0000 7fb29b541640 1 -- 172.21.15.93:0/3777187642 wait complete. 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.743+0000 7fb29b541640 1 Processor -- start 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.743+0000 7fb29b541640 1 -- start start 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2940cbc00 0x7fb2940c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29415ae40 0x7fb29414be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c7570 con 0x7fb2940cda30 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294159620 con 0x7fb2940cbc00 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb29b541640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29414c370 con 0x7fb29415ae40 2023-11-04T01:37:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb298adc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb298adc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44754/0 (socket says 172.21.15.93:44754) 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb298adc640 1 -- 172.21.15.93:0/4059663190 learned_addr learned my addr 172.21.15.93:0/4059663190 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb2992dd640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2940cbc00 0x7fb2940c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.744+0000 7fb299ade640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29415ae40 0x7fb29414be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 -- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29415ae40 msgr2=0x7fb29414be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29415ae40 0x7fb29414be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 -- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2940cbc00 msgr2=0x7fb2940c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2940cbc00 0x7fb2940c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 -- 172.21.15.93:0/4059663190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900094d0 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb298adc640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c780 tx=0x7fb28400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840072d0 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284007450 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2940c7da0 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840047e0 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.745+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2940c8360 con 0x7fb2940cda30 2023-11-04T01:37:15.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.746+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940ce2d0 con 0x7fb2940cda30 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.746+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb284004960 con 0x7fb2940cda30 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.747+0000 7fb289ffb640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.747+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2840889f0 con 0x7fb2940cda30 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.747+0000 7fb2992dd640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.747+0000 7fb2992dd640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 0x7fb27806d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb28c003aa0 tx=0x7fb28c009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.751+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb284053aa0 con 0x7fb2940cda30 2023-11-04T01:37:15.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.918+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2940cc450 con 0x7fb2940cda30 2023-11-04T01:37:15.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.919+0000 7fb289ffb640 1 -- 172.21.15.93:0/4059663190 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16786 (secure 0 0 0) 0x7fb2940cc450 con 0x7fb2940cda30 2023-11-04T01:37:15.922 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:15.922 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":38,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:14.287852+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.921+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 msgr2=0x7fb27806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.921+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 0x7fb27806d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb28c003aa0 tx=0x7fb28c009830 comp rx=0 tx=0).stop 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.921+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 msgr2=0x7fb2940c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.921+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c780 tx=0x7fb28400cc40 comp rx=0 tx=0).stop 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 shutdown_connections 2023-11-04T01:37:15.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb29415ae40 0x7fb29414be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2940cda30 0x7fb2940c6f00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 --2- 172.21.15.93:0/4059663190 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2940cbc00 0x7fb2940c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 >> 172.21.15.93:0/4059663190 conn(0x7fb29406ea90 msgr2=0x7fb2940cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 shutdown_connections 2023-11-04T01:37:15.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:15.922+0000 7fb29b541640 1 -- 172.21.15.93:0/4059663190 wait complete. 2023-11-04T01:37:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:37:15.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:16.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.031+0000 7f0e1d0e0640 1 Processor -- start 2023-11-04T01:37:16.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.031+0000 7f0e1d0e0640 1 -- start start 2023-11-04T01:37:16.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1d0e0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 0x7f0e1815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1d0e0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e180cbc00 0x7f0e180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1d0e0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180cc450 con 0x7f0e180cd860 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1d0e0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1815f400 con 0x7f0e180cbc00 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1d0e0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1815b220 con 0x7f0e1815ae40 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e180cbc00 0x7f0e180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e180cbc00 0x7f0e180cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44770/0 (socket says 172.21.15.93:44770) 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1659c640 1 -- 172.21.15.93:0/935425074 learned_addr learned my addr 172.21.15.93:0/935425074 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e16d9d640 1 --2- 172.21.15.93:0/935425074 >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 0x7f0e1815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.032+0000 7f0e1659c640 1 -- 172.21.15.93:0/935425074 >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 msgr2=0x7f0e1815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e1659c640 1 --2- 172.21.15.93:0/935425074 >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 0x7f0e1815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e1659c640 1 -- 172.21.15.93:0/935425074 >> v1:172.21.15.93:6789/0 conn(0x7f0e180cd860 legacy=0x7f0e180b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e1659c640 1 -- 172.21.15.93:0/935425074 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1815f890 con 0x7f0e180cbc00 2023-11-04T01:37:16.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e16d9d640 1 --2- 172.21.15.93:0/935425074 >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 0x7f0e1815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e1659c640 1 --2- 172.21.15.93:0/935425074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cbc00 0x7f0e180cd320 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806e580 tx=0x7f0e0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99435759c35f3b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e15d9b640 1 -- 172.21.15.93:0/935425074 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c030860 con 0x7f0e180cbc00 2023-11-04T01:37:16.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e15d9b640 1 -- 172.21.15.93:0/935425074 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0309c0 con 0x7f0e180cbc00 2023-11-04T01:37:16.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.033+0000 7f0e15d9b640 1 -- 172.21.15.93:0/935425074 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c030d50 con 0x7f0e180cbc00 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/935425074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cbc00 msgr2=0x7f0e180cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/935425074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cbc00 0x7f0e180cd320 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806e580 tx=0x7f0e0c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/935425074 shutdown_connections 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/935425074 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cbc00 0x7f0e180cd320 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/935425074 >> v2:172.21.15.125:3300/0 conn(0x7f0e1815ae40 0x7f0e1815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/935425074 >> 172.21.15.93:0/935425074 conn(0x7f0e1806ea90 msgr2=0x7f0e1806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/935425074 shutdown_connections 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.034+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/935425074 wait complete. 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.035+0000 7f0e1d0e0640 1 Processor -- start 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.035+0000 7f0e1d0e0640 1 -- start start 2023-11-04T01:37:16.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e180cbc00 0x7f0e180c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 0x7f0e180c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c5a30 con 0x7f0e180cd860 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c7480 con 0x7f0e1815ae40 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1d0e0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c3dc0 con 0x7f0e180cbc00 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44784/0 (socket says 172.21.15.93:44784) 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1659c640 1 -- 172.21.15.93:0/2433724166 learned_addr learned my addr 172.21.15.93:0/2433724166 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e16d9d640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e180cbc00 0x7f0e180c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.036+0000 7f0e1759e640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 0x7f0e180c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 -- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e180cbc00 msgr2=0x7f0e180c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e180cbc00 0x7f0e180c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 -- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 msgr2=0x7f0e180c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 0x7f0e180c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 -- 172.21.15.93:0/2433724166 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094d0 con 0x7f0e180cd860 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1759e640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 0x7f0e180c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1659c640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c02b9e0 tx=0x7f0e0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c039d60 con 0x7f0e180cd860 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c043400 con 0x7f0e180cd860 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0437b0 con 0x7f0e180cd860 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180c4db0 con 0x7f0e180cd860 2023-11-04T01:37:16.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.037+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180c5370 con 0x7f0e180cd860 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.038+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e180ce2d0 con 0x7f0e180cd860 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.038+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e0c043910 con 0x7f0e180cd860 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.039+0000 7f0dff7fe640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 0x7f0e0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.039+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e0c03e070 con 0x7f0e180cd860 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.039+0000 7f0e16d9d640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 0x7f0e0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.039+0000 7f0e16d9d640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 0x7f0e0406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009fd0 tx=0x7f0e080097f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.043+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e0c077b20 con 0x7f0e180cd860 2023-11-04T01:37:16.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.206+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e1815edb0 con 0x7f0e0406ae70 2023-11-04T01:37:16.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.213+0000 7f0dff7fe640 1 -- 172.21.15.93:0/2433724166 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289487 (secure 0 0 0) 0x7f0e0800f040 con 0x7f0e0406ae70 2023-11-04T01:37:16.219 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:16.222 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 msgr2=0x7f0e0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 0x7f0e0406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009fd0 tx=0x7f0e080097f0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 msgr2=0x7f0e180c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c02b9e0 tx=0x7f0e0c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 shutdown_connections 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e0406ae70 0x7f0e0406d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e1815ae40 0x7f0e180c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e180cd860 0x7f0e180c3880 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 --2- 172.21.15.93:0/2433724166 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e180cbc00 0x7f0e180c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.216+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 >> 172.21.15.93:0/2433724166 conn(0x7f0e1806ea90 msgr2=0x7f0e1815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.217+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 shutdown_connections 2023-11-04T01:37:16.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.217+0000 7f0e1d0e0640 1 -- 172.21.15.93:0/2433724166 wait complete. 2023-11-04T01:37:16.230 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:37:15.343626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220732,"kb_used_data":4556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753988,"statfs":{"total":773094113280,"available":772868083712,"internally_reserved":0,"allocated":4665344,"data_stored":2645114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.071849"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308150+0000","last_change":"2023-11-04T01:37:13.301595+0000","last_active":"2023-11-04T01:37:13.308150+0000","last_peered":"2023-11-04T01:37:13.308150+0000","last_clean":"2023-11-04T01:37:13.308150+0000","last_became_active":"2023-11-04T01:37:13.301108+0000","last_became_peered":"2023-11-04T01:37:13.301108+0000","last_unstale":"2023-11-04T01:37:13.308150+0000","last_undegraded":"2023-11-04T01:37:13.308150+0000","last_fullsized":"2023-11-04T01:37:13.308150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303913+0000","last_change":"2023-11-04T01:37:13.298883+0000","last_active":"2023-11-04T01:37:13.303913+0000","last_peered":"2023-11-04T01:37:13.303913+0000","last_clean":"2023-11-04T01:37:13.303913+0000","last_became_active":"2023-11-04T01:37:13.298564+0000","last_became_peered":"2023-11-04T01:37:13.298564+0000","last_unstale":"2023-11-04T01:37:13.303913+0000","last_undegraded":"2023-11-04T01:37:13.303913+0000","last_fullsized":"2023-11-04T01:37:13.303913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297381+0000","last_change":"2023-11-04T01:37:13.299673+0000","last_active":"2023-11-04T01:37:14.297381+0000","last_peered":"2023-11-04T01:37:14.297381+0000","last_clean":"2023-11-04T01:37:14.297381+0000","last_became_active":"2023-11-04T01:37:13.299388+0000","last_became_peered":"2023-11-04T01:37:13.299388+0000","last_unstale":"2023-11-04T01:37:14.297381+0000","last_undegraded":"2023-11-04T01:37:14.297381+0000","last_fullsized":"2023-11-04T01:37:14.297381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:18.991830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298782+0000","last_change":"2023-11-04T01:37:13.294120+0000","last_active":"2023-11-04T01:37:13.298782+0000","last_peered":"2023-11-04T01:37:13.298782+0000","last_clean":"2023-11-04T01:37:13.298782+0000","last_became_active":"2023-11-04T01:37:13.293762+0000","last_became_peered":"2023-11-04T01:37:13.293762+0000","last_unstale":"2023-11-04T01:37:13.298782+0000","last_undegraded":"2023-11-04T01:37:13.298782+0000","last_fullsized":"2023-11-04T01:37:13.298782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:05.475586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298788+0000","last_change":"2023-11-04T01:37:13.295713+0000","last_active":"2023-11-04T01:37:13.298788+0000","last_peered":"2023-11-04T01:37:13.298788+0000","last_clean":"2023-11-04T01:37:13.298788+0000","last_became_active":"2023-11-04T01:37:13.294236+0000","last_became_peered":"2023-11-04T01:37:13.294236+0000","last_unstale":"2023-11-04T01:37:13.298788+0000","last_undegraded":"2023-11-04T01:37:13.298788+0000","last_fullsized":"2023-11-04T01:37:13.298788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:43.600483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.305363+0000","last_change":"2023-11-04T01:37:13.297753+0000","last_active":"2023-11-04T01:37:13.305363+0000","last_peered":"2023-11-04T01:37:13.305363+0000","last_clean":"2023-11-04T01:37:13.305363+0000","last_became_active":"2023-11-04T01:37:13.297453+0000","last_became_peered":"2023-11-04T01:37:13.297453+0000","last_unstale":"2023-11-04T01:37:13.305363+0000","last_undegraded":"2023-11-04T01:37:13.305363+0000","last_fullsized":"2023-11-04T01:37:13.305363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:45.742862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299188+0000","last_change":"2023-11-04T01:37:13.295768+0000","last_active":"2023-11-04T01:37:14.299188+0000","last_peered":"2023-11-04T01:37:14.299188+0000","last_clean":"2023-11-04T01:37:14.299188+0000","last_became_active":"2023-11-04T01:37:13.295516+0000","last_became_peered":"2023-11-04T01:37:13.295516+0000","last_unstale":"2023-11-04T01:37:14.299188+0000","last_undegraded":"2023-11-04T01:37:14.299188+0000","last_fullsized":"2023-11-04T01:37:14.299188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:04.032361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308121+0000","last_change":"2023-11-04T01:37:13.300851+0000","last_active":"2023-11-04T01:37:13.308121+0000","last_peered":"2023-11-04T01:37:13.308121+0000","last_clean":"2023-11-04T01:37:13.308121+0000","last_became_active":"2023-11-04T01:37:13.300608+0000","last_became_peered":"2023-11-04T01:37:13.300608+0000","last_unstale":"2023-11-04T01:37:13.308121+0000","last_undegraded":"2023-11-04T01:37:13.308121+0000","last_fullsized":"2023-11-04T01:37:13.308121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:45.742862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297414+0000","last_change":"2023-11-04T01:37:13.299702+0000","last_active":"2023-11-04T01:37:14.297414+0000","last_peered":"2023-11-04T01:37:14.297414+0000","last_clean":"2023-11-04T01:37:14.297414+0000","last_became_active":"2023-11-04T01:37:13.299425+0000","last_became_peered":"2023-11-04T01:37:13.299425+0000","last_unstale":"2023-11-04T01:37:14.297414+0000","last_undegraded":"2023-11-04T01:37:14.297414+0000","last_fullsized":"2023-11-04T01:37:14.297414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299881+0000","last_change":"2023-11-04T01:37:13.291278+0000","last_active":"2023-11-04T01:37:14.299881+0000","last_peered":"2023-11-04T01:37:14.299881+0000","last_clean":"2023-11-04T01:37:14.299881+0000","last_became_active":"2023-11-04T01:37:13.290974+0000","last_became_peered":"2023-11-04T01:37:13.290974+0000","last_unstale":"2023-11-04T01:37:14.299881+0000","last_undegraded":"2023-11-04T01:37:14.299881+0000","last_fullsized":"2023-11-04T01:37:14.299881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:51.529683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300635+0000","last_change":"2023-11-04T01:37:13.291534+0000","last_active":"2023-11-04T01:37:14.300635+0000","last_peered":"2023-11-04T01:37:14.300635+0000","last_clean":"2023-11-04T01:37:14.300635+0000","last_became_active":"2023-11-04T01:37:13.291265+0000","last_became_peered":"2023-11-04T01:37:13.291265+0000","last_unstale":"2023-11-04T01:37:14.300635+0000","last_undegraded":"2023-11-04T01:37:14.300635+0000","last_fullsized":"2023-11-04T01:37:14.300635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:30.411496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297253+0000","last_change":"2023-11-04T01:37:13.289812+0000","last_active":"2023-11-04T01:37:14.297253+0000","last_peered":"2023-11-04T01:37:14.297253+0000","last_clean":"2023-11-04T01:37:14.297253+0000","last_became_active":"2023-11-04T01:37:13.289525+0000","last_became_peered":"2023-11-04T01:37:13.289525+0000","last_unstale":"2023-11-04T01:37:14.297253+0000","last_undegraded":"2023-11-04T01:37:14.297253+0000","last_fullsized":"2023-11-04T01:37:14.297253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:49.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300027+0000","last_change":"2023-11-04T01:37:13.291882+0000","last_active":"2023-11-04T01:37:14.300027+0000","last_peered":"2023-11-04T01:37:14.300027+0000","last_clean":"2023-11-04T01:37:14.300027+0000","last_became_active":"2023-11-04T01:37:13.291629+0000","last_became_peered":"2023-11-04T01:37:13.291629+0000","last_unstale":"2023-11-04T01:37:14.300027+0000","last_undegraded":"2023-11-04T01:37:14.300027+0000","last_fullsized":"2023-11-04T01:37:14.300027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:31.705048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306874+0000","last_change":"2023-11-04T01:37:13.300066+0000","last_active":"2023-11-04T01:37:13.306874+0000","last_peered":"2023-11-04T01:37:13.306874+0000","last_clean":"2023-11-04T01:37:13.306874+0000","last_became_active":"2023-11-04T01:37:13.299817+0000","last_became_peered":"2023-11-04T01:37:13.299817+0000","last_unstale":"2023-11-04T01:37:13.306874+0000","last_undegraded":"2023-11-04T01:37:13.306874+0000","last_fullsized":"2023-11-04T01:37:13.306874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:08.131629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299363+0000","last_change":"2023-11-04T01:37:13.292648+0000","last_active":"2023-11-04T01:37:14.299363+0000","last_peered":"2023-11-04T01:37:14.299363+0000","last_clean":"2023-11-04T01:37:14.299363+0000","last_became_active":"2023-11-04T01:37:13.292399+0000","last_became_peered":"2023-11-04T01:37:13.292399+0000","last_unstale":"2023-11-04T01:37:14.299363+0000","last_undegraded":"2023-11-04T01:37:14.299363+0000","last_fullsized":"2023-11-04T01:37:14.299363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:22.345590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299240+0000","last_change":"2023-11-04T01:37:13.303242+0000","last_active":"2023-11-04T01:37:14.299240+0000","last_peered":"2023-11-04T01:37:14.299240+0000","last_clean":"2023-11-04T01:37:14.299240+0000","last_became_active":"2023-11-04T01:37:13.303007+0000","last_became_peered":"2023-11-04T01:37:13.303007+0000","last_unstale":"2023-11-04T01:37:14.299240+0000","last_undegraded":"2023-11-04T01:37:14.299240+0000","last_fullsized":"2023-11-04T01:37:14.299240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299968+0000","last_change":"2023-11-04T01:37:13.304400+0000","last_active":"2023-11-04T01:37:14.299968+0000","last_peered":"2023-11-04T01:37:14.299968+0000","last_clean":"2023-11-04T01:37:14.299968+0000","last_became_active":"2023-11-04T01:37:13.303052+0000","last_became_peered":"2023-11-04T01:37:13.303052+0000","last_unstale":"2023-11-04T01:37:14.299968+0000","last_undegraded":"2023-11-04T01:37:14.299968+0000","last_fullsized":"2023-11-04T01:37:14.299968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:04.032361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302157+0000","last_change":"2023-11-04T01:37:13.301135+0000","last_active":"2023-11-04T01:37:13.302157+0000","last_peered":"2023-11-04T01:37:13.302157+0000","last_clean":"2023-11-04T01:37:13.302157+0000","last_became_active":"2023-11-04T01:37:13.300834+0000","last_became_peered":"2023-11-04T01:37:13.300834+0000","last_unstale":"2023-11-04T01:37:13.302157+0000","last_undegraded":"2023-11-04T01:37:13.302157+0000","last_fullsized":"2023-11-04T01:37:13.302157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:11.202174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297858+0000","last_change":"2023-11-04T01:37:13.293786+0000","last_active":"2023-11-04T01:37:13.297858+0000","last_peered":"2023-11-04T01:37:13.297858+0000","last_clean":"2023-11-04T01:37:13.297858+0000","last_became_active":"2023-11-04T01:37:13.293532+0000","last_became_peered":"2023-11-04T01:37:13.293532+0000","last_unstale":"2023-11-04T01:37:13.297858+0000","last_undegraded":"2023-11-04T01:37:13.297858+0000","last_fullsized":"2023-11-04T01:37:13.297858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:52.316316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.301288+0000","last_change":"2023-11-04T01:37:13.300376+0000","last_active":"2023-11-04T01:37:13.301288+0000","last_peered":"2023-11-04T01:37:13.301288+0000","last_clean":"2023-11-04T01:37:13.301288+0000","last_became_active":"2023-11-04T01:37:13.300085+0000","last_became_peered":"2023-11-04T01:37:13.300085+0000","last_unstale":"2023-11-04T01:37:13.301288+0000","last_undegraded":"2023-11-04T01:37:13.301288+0000","last_fullsized":"2023-11-04T01:37:13.301288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:10.977915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300186+0000","last_change":"2023-11-04T01:37:13.299139+0000","last_active":"2023-11-04T01:37:14.300186+0000","last_peered":"2023-11-04T01:37:14.300186+0000","last_clean":"2023-11-04T01:37:14.300186+0000","last_became_active":"2023-11-04T01:37:13.298850+0000","last_became_peered":"2023-11-04T01:37:13.298850+0000","last_unstale":"2023-11-04T01:37:14.300186+0000","last_undegraded":"2023-11-04T01:37:14.300186+0000","last_fullsized":"2023-11-04T01:37:14.300186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:40.803988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.304374+0000","last_change":"2023-11-04T01:37:13.294658+0000","last_active":"2023-11-04T01:37:13.304374+0000","last_peered":"2023-11-04T01:37:13.304374+0000","last_clean":"2023-11-04T01:37:13.304374+0000","last_became_active":"2023-11-04T01:37:13.294382+0000","last_became_peered":"2023-11-04T01:37:13.294382+0000","last_unstale":"2023-11-04T01:37:13.304374+0000","last_undegraded":"2023-11-04T01:37:13.304374+0000","last_fullsized":"2023-11-04T01:37:13.304374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:24.407998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299522+0000","last_change":"2023-11-04T01:37:13.298836+0000","last_active":"2023-11-04T01:37:14.299522+0000","last_peered":"2023-11-04T01:37:14.299522+0000","last_clean":"2023-11-04T01:37:14.299522+0000","last_became_active":"2023-11-04T01:37:13.298470+0000","last_became_peered":"2023-11-04T01:37:13.298470+0000","last_unstale":"2023-11-04T01:37:14.299522+0000","last_undegraded":"2023-11-04T01:37:14.299522+0000","last_fullsized":"2023-11-04T01:37:14.299522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:40.603346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303634+0000","last_change":"2023-11-04T01:37:13.296535+0000","last_active":"2023-11-04T01:37:13.303634+0000","last_peered":"2023-11-04T01:37:13.303634+0000","last_clean":"2023-11-04T01:37:13.303634+0000","last_became_active":"2023-11-04T01:37:13.294413+0000","last_became_peered":"2023-11-04T01:37:13.294413+0000","last_unstale":"2023-11-04T01:37:13.303634+0000","last_undegraded":"2023-11-04T01:37:13.303634+0000","last_fullsized":"2023-11-04T01:37:13.303634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:28.666782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303146+0000","last_change":"2023-11-04T01:37:13.301781+0000","last_active":"2023-11-04T01:37:13.303146+0000","last_peered":"2023-11-04T01:37:13.303146+0000","last_clean":"2023-11-04T01:37:13.303146+0000","last_became_active":"2023-11-04T01:37:13.301491+0000","last_became_peered":"2023-11-04T01:37:13.301491+0000","last_unstale":"2023-11-04T01:37:13.303146+0000","last_undegraded":"2023-11-04T01:37:13.303146+0000","last_fullsized":"2023-11-04T01:37:13.303146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:21.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308386+0000","last_change":"2023-11-04T01:37:13.301278+0000","last_active":"2023-11-04T01:37:13.308386+0000","last_peered":"2023-11-04T01:37:13.308386+0000","last_clean":"2023-11-04T01:37:13.308386+0000","last_became_active":"2023-11-04T01:37:13.301007+0000","last_became_peered":"2023-11-04T01:37:13.301007+0000","last_unstale":"2023-11-04T01:37:13.308386+0000","last_undegraded":"2023-11-04T01:37:13.308386+0000","last_fullsized":"2023-11-04T01:37:13.308386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:03.204602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303747+0000","last_change":"2023-11-04T01:37:13.302681+0000","last_active":"2023-11-04T01:37:13.303747+0000","last_peered":"2023-11-04T01:37:13.303747+0000","last_clean":"2023-11-04T01:37:13.303747+0000","last_became_active":"2023-11-04T01:37:13.302338+0000","last_became_peered":"2023-11-04T01:37:13.302338+0000","last_unstale":"2023-11-04T01:37:13.303747+0000","last_undegraded":"2023-11-04T01:37:13.303747+0000","last_fullsized":"2023-11-04T01:37:13.303747+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:24.762983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300678+0000","last_change":"2023-11-04T01:37:13.296318+0000","last_active":"2023-11-04T01:37:14.300678+0000","last_peered":"2023-11-04T01:37:14.300678+0000","last_clean":"2023-11-04T01:37:14.300678+0000","last_became_active":"2023-11-04T01:37:13.296071+0000","last_became_peered":"2023-11-04T01:37:13.296071+0000","last_unstale":"2023-11-04T01:37:14.300678+0000","last_undegraded":"2023-11-04T01:37:14.300678+0000","last_fullsized":"2023-11-04T01:37:14.300678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:00.701503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302637+0000","last_change":"2023-11-04T01:37:13.301820+0000","last_active":"2023-11-04T01:37:13.302637+0000","last_peered":"2023-11-04T01:37:13.302637+0000","last_clean":"2023-11-04T01:37:13.302637+0000","last_became_active":"2023-11-04T01:37:13.301534+0000","last_became_peered":"2023-11-04T01:37:13.301534+0000","last_unstale":"2023-11-04T01:37:13.302637+0000","last_undegraded":"2023-11-04T01:37:13.302637+0000","last_fullsized":"2023-11-04T01:37:13.302637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:50.112388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302598+0000","last_change":"2023-11-04T01:37:13.301386+0000","last_active":"2023-11-04T01:37:13.302598+0000","last_peered":"2023-11-04T01:37:13.302598+0000","last_clean":"2023-11-04T01:37:13.302598+0000","last_became_active":"2023-11-04T01:37:13.301027+0000","last_became_peered":"2023-11-04T01:37:13.301027+0000","last_unstale":"2023-11-04T01:37:13.302598+0000","last_undegraded":"2023-11-04T01:37:13.302598+0000","last_fullsized":"2023-11-04T01:37:13.302598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:34.825128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299669+0000","last_change":"2023-11-04T01:37:13.300127+0000","last_active":"2023-11-04T01:37:14.299669+0000","last_peered":"2023-11-04T01:37:14.299669+0000","last_clean":"2023-11-04T01:37:14.299669+0000","last_became_active":"2023-11-04T01:37:13.299871+0000","last_became_peered":"2023-11-04T01:37:13.299871+0000","last_unstale":"2023-11-04T01:37:14.299669+0000","last_undegraded":"2023-11-04T01:37:14.299669+0000","last_fullsized":"2023-11-04T01:37:14.299669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:53.800398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.299212+0000","last_change":"2023-11-04T01:37:13.295156+0000","last_active":"2023-11-04T01:37:13.299212+0000","last_peered":"2023-11-04T01:37:13.299212+0000","last_clean":"2023-11-04T01:37:13.299212+0000","last_became_active":"2023-11-04T01:37:13.294925+0000","last_became_peered":"2023-11-04T01:37:13.294925+0000","last_unstale":"2023-11-04T01:37:13.299212+0000","last_undegraded":"2023-11-04T01:37:13.299212+0000","last_fullsized":"2023-11-04T01:37:13.299212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:24.407998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299829+0000","last_change":"2023-11-04T01:37:13.305468+0000","last_active":"2023-11-04T01:37:14.299829+0000","last_peered":"2023-11-04T01:37:14.299829+0000","last_clean":"2023-11-04T01:37:14.299829+0000","last_became_active":"2023-11-04T01:37:13.305224+0000","last_became_peered":"2023-11-04T01:37:13.305224+0000","last_unstale":"2023-11-04T01:37:14.299829+0000","last_undegraded":"2023-11-04T01:37:14.299829+0000","last_fullsized":"2023-11-04T01:37:14.299829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:15.815358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308200+0000","last_change":"2023-11-04T01:37:12.296446+0000","last_active":"2023-11-04T01:37:13.308200+0000","last_peered":"2023-11-04T01:37:13.308200+0000","last_clean":"2023-11-04T01:37:13.308200+0000","last_became_active":"2023-11-04T01:37:12.296188+0000","last_became_peered":"2023-11-04T01:37:12.296188+0000","last_unstale":"2023-11-04T01:37:13.308200+0000","last_undegraded":"2023-11-04T01:37:13.308200+0000","last_fullsized":"2023-11-04T01:37:13.308200+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:02.202632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308470+0000","last_change":"2023-11-04T01:37:13.302007+0000","last_active":"2023-11-04T01:37:13.308470+0000","last_peered":"2023-11-04T01:37:13.308470+0000","last_clean":"2023-11-04T01:37:13.308470+0000","last_became_active":"2023-11-04T01:37:13.301621+0000","last_became_peered":"2023-11-04T01:37:13.301621+0000","last_unstale":"2023-11-04T01:37:13.308470+0000","last_undegraded":"2023-11-04T01:37:13.308470+0000","last_fullsized":"2023-11-04T01:37:13.308470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:16.977382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297393+0000","last_change":"2023-11-04T01:37:12.293178+0000","last_active":"2023-11-04T01:37:14.297393+0000","last_peered":"2023-11-04T01:37:14.297393+0000","last_clean":"2023-11-04T01:37:14.297393+0000","last_became_active":"2023-11-04T01:37:12.292901+0000","last_became_peered":"2023-11-04T01:37:12.292901+0000","last_unstale":"2023-11-04T01:37:14.297393+0000","last_undegraded":"2023-11-04T01:37:14.297393+0000","last_fullsized":"2023-11-04T01:37:14.297393+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306815+0000","last_change":"2023-11-04T01:37:13.304165+0000","last_active":"2023-11-04T01:37:13.306815+0000","last_peered":"2023-11-04T01:37:13.306815+0000","last_clean":"2023-11-04T01:37:13.306815+0000","last_became_active":"2023-11-04T01:37:13.303147+0000","last_became_peered":"2023-11-04T01:37:13.303147+0000","last_unstale":"2023-11-04T01:37:13.306815+0000","last_undegraded":"2023-11-04T01:37:13.306815+0000","last_fullsized":"2023-11-04T01:37:13.306815+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:03.204602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.307488+0000","last_change":"2023-11-04T01:37:12.298299+0000","last_active":"2023-11-04T01:37:13.307488+0000","last_peered":"2023-11-04T01:37:13.307488+0000","last_clean":"2023-11-04T01:37:13.307488+0000","last_became_active":"2023-11-04T01:37:12.297996+0000","last_became_peered":"2023-11-04T01:37:12.297996+0000","last_unstale":"2023-11-04T01:37:13.307488+0000","last_undegraded":"2023-11-04T01:37:13.307488+0000","last_fullsized":"2023-11-04T01:37:13.307488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.783606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.310319+0000","last_change":"2023-11-04T01:37:13.303081+0000","last_active":"2023-11-04T01:37:13.310319+0000","last_peered":"2023-11-04T01:37:13.310319+0000","last_clean":"2023-11-04T01:37:13.310319+0000","last_became_active":"2023-11-04T01:37:13.302797+0000","last_became_peered":"2023-11-04T01:37:13.302797+0000","last_unstale":"2023-11-04T01:37:13.310319+0000","last_undegraded":"2023-11-04T01:37:13.310319+0000","last_fullsized":"2023-11-04T01:37:13.310319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:26.109602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.304362+0000","last_change":"2023-11-04T01:37:12.300628+0000","last_active":"2023-11-04T01:37:13.304362+0000","last_peered":"2023-11-04T01:37:13.304362+0000","last_clean":"2023-11-04T01:37:13.304362+0000","last_became_active":"2023-11-04T01:37:12.300357+0000","last_became_peered":"2023-11-04T01:37:12.300357+0000","last_unstale":"2023-11-04T01:37:13.304362+0000","last_undegraded":"2023-11-04T01:37:13.304362+0000","last_fullsized":"2023-11-04T01:37:13.304362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:16.727263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297190+0000","last_change":"2023-11-04T01:37:13.288953+0000","last_active":"2023-11-04T01:37:14.297190+0000","last_peered":"2023-11-04T01:37:14.297190+0000","last_clean":"2023-11-04T01:37:14.297190+0000","last_became_active":"2023-11-04T01:37:13.288708+0000","last_became_peered":"2023-11-04T01:37:13.288708+0000","last_unstale":"2023-11-04T01:37:14.297190+0000","last_undegraded":"2023-11-04T01:37:14.297190+0000","last_fullsized":"2023-11-04T01:37:14.297190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:25.787711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300258+0000","last_change":"2023-11-04T01:37:12.301177+0000","last_active":"2023-11-04T01:37:14.300258+0000","last_peered":"2023-11-04T01:37:14.300258+0000","last_clean":"2023-11-04T01:37:14.300258+0000","last_became_active":"2023-11-04T01:37:12.300857+0000","last_became_peered":"2023-11-04T01:37:12.300857+0000","last_unstale":"2023-11-04T01:37:14.300258+0000","last_undegraded":"2023-11-04T01:37:14.300258+0000","last_fullsized":"2023-11-04T01:37:14.300258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:48.056279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299502+0000","last_change":"2023-11-04T01:37:13.297352+0000","last_active":"2023-11-04T01:37:14.299502+0000","last_peered":"2023-11-04T01:37:14.299502+0000","last_clean":"2023-11-04T01:37:14.299502+0000","last_became_active":"2023-11-04T01:37:13.296864+0000","last_became_peered":"2023-11-04T01:37:13.296864+0000","last_unstale":"2023-11-04T01:37:14.299502+0000","last_undegraded":"2023-11-04T01:37:14.299502+0000","last_fullsized":"2023-11-04T01:37:14.299502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:41.873262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300094+0000","last_change":"2023-11-04T01:37:12.296218+0000","last_active":"2023-11-04T01:37:14.300094+0000","last_peered":"2023-11-04T01:37:14.300094+0000","last_clean":"2023-11-04T01:37:14.300094+0000","last_became_active":"2023-11-04T01:37:12.295943+0000","last_became_peered":"2023-11-04T01:37:12.295943+0000","last_unstale":"2023-11-04T01:37:14.300094+0000","last_undegraded":"2023-11-04T01:37:14.300094+0000","last_fullsized":"2023-11-04T01:37:14.300094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306895+0000","last_change":"2023-11-04T01:37:13.303877+0000","last_active":"2023-11-04T01:37:13.306895+0000","last_peered":"2023-11-04T01:37:13.306895+0000","last_clean":"2023-11-04T01:37:13.306895+0000","last_became_active":"2023-11-04T01:37:13.303051+0000","last_became_peered":"2023-11-04T01:37:13.303051+0000","last_unstale":"2023-11-04T01:37:13.306895+0000","last_undegraded":"2023-11-04T01:37:13.306895+0000","last_fullsized":"2023-11-04T01:37:13.306895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:58.889626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.286425+0000","last_change":"2023-11-04T01:37:12.297071+0000","last_active":"2023-11-04T01:37:13.286425+0000","last_peered":"2023-11-04T01:37:13.286425+0000","last_clean":"2023-11-04T01:37:13.286425+0000","last_became_active":"2023-11-04T01:37:12.296824+0000","last_became_peered":"2023-11-04T01:37:12.296824+0000","last_unstale":"2023-11-04T01:37:13.286425+0000","last_undegraded":"2023-11-04T01:37:13.286425+0000","last_fullsized":"2023-11-04T01:37:13.286425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:18.571133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308363+0000","last_change":"2023-11-04T01:37:13.302766+0000","last_active":"2023-11-04T01:37:13.308363+0000","last_peered":"2023-11-04T01:37:13.308363+0000","last_clean":"2023-11-04T01:37:13.308363+0000","last_became_active":"2023-11-04T01:37:13.302493+0000","last_became_peered":"2023-11-04T01:37:13.302493+0000","last_unstale":"2023-11-04T01:37:13.308363+0000","last_undegraded":"2023-11-04T01:37:13.308363+0000","last_fullsized":"2023-11-04T01:37:13.308363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287742+0000","last_change":"2023-11-04T01:37:12.294021+0000","last_active":"2023-11-04T01:37:13.287742+0000","last_peered":"2023-11-04T01:37:13.287742+0000","last_clean":"2023-11-04T01:37:13.287742+0000","last_became_active":"2023-11-04T01:37:12.293773+0000","last_became_peered":"2023-11-04T01:37:12.293773+0000","last_unstale":"2023-11-04T01:37:13.287742+0000","last_undegraded":"2023-11-04T01:37:13.287742+0000","last_fullsized":"2023-11-04T01:37:13.287742+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:00.331948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298801+0000","last_change":"2023-11-04T01:37:13.294384+0000","last_active":"2023-11-04T01:37:13.298801+0000","last_peered":"2023-11-04T01:37:13.298801+0000","last_clean":"2023-11-04T01:37:13.298801+0000","last_became_active":"2023-11-04T01:37:13.294121+0000","last_became_peered":"2023-11-04T01:37:13.294121+0000","last_unstale":"2023-11-04T01:37:13.298801+0000","last_undegraded":"2023-11-04T01:37:13.298801+0000","last_fullsized":"2023-11-04T01:37:13.298801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:23.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.290428+0000","last_change":"2023-11-04T01:37:12.303559+0000","last_active":"2023-11-04T01:37:13.290428+0000","last_peered":"2023-11-04T01:37:13.290428+0000","last_clean":"2023-11-04T01:37:13.290428+0000","last_became_active":"2023-11-04T01:37:12.303291+0000","last_became_peered":"2023-11-04T01:37:12.303291+0000","last_unstale":"2023-11-04T01:37:13.290428+0000","last_undegraded":"2023-11-04T01:37:13.290428+0000","last_fullsized":"2023-11-04T01:37:13.290428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:14.813388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299465+0000","last_change":"2023-11-04T01:37:13.303397+0000","last_active":"2023-11-04T01:37:14.299465+0000","last_peered":"2023-11-04T01:37:14.299465+0000","last_clean":"2023-11-04T01:37:14.299465+0000","last_became_active":"2023-11-04T01:37:13.302414+0000","last_became_peered":"2023-11-04T01:37:13.302414+0000","last_unstale":"2023-11-04T01:37:14.299465+0000","last_undegraded":"2023-11-04T01:37:14.299465+0000","last_fullsized":"2023-11-04T01:37:14.299465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300218+0000","last_change":"2023-11-04T01:37:12.303708+0000","last_active":"2023-11-04T01:37:14.300218+0000","last_peered":"2023-11-04T01:37:14.300218+0000","last_clean":"2023-11-04T01:37:14.300218+0000","last_became_active":"2023-11-04T01:37:12.303467+0000","last_became_peered":"2023-11-04T01:37:12.303467+0000","last_unstale":"2023-11-04T01:37:14.300218+0000","last_undegraded":"2023-11-04T01:37:14.300218+0000","last_fullsized":"2023-11-04T01:37:14.300218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:12.160173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297417+0000","last_change":"2023-11-04T01:37:13.290760+0000","last_active":"2023-11-04T01:37:14.297417+0000","last_peered":"2023-11-04T01:37:14.297417+0000","last_clean":"2023-11-04T01:37:14.297417+0000","last_became_active":"2023-11-04T01:37:13.290508+0000","last_became_peered":"2023-11-04T01:37:13.290508+0000","last_unstale":"2023-11-04T01:37:14.297417+0000","last_undegraded":"2023-11-04T01:37:14.297417+0000","last_fullsized":"2023-11-04T01:37:14.297417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300729+0000","last_change":"2023-11-04T01:37:12.301377+0000","last_active":"2023-11-04T01:37:14.300729+0000","last_peered":"2023-11-04T01:37:14.300729+0000","last_clean":"2023-11-04T01:37:14.300729+0000","last_became_active":"2023-11-04T01:37:12.301005+0000","last_became_peered":"2023-11-04T01:37:12.301005+0000","last_unstale":"2023-11-04T01:37:14.300729+0000","last_undegraded":"2023-11-04T01:37:14.300729+0000","last_fullsized":"2023-11-04T01:37:14.300729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:39.601375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306415+0000","last_change":"2023-11-04T01:37:13.298838+0000","last_active":"2023-11-04T01:37:13.306415+0000","last_peered":"2023-11-04T01:37:13.306415+0000","last_clean":"2023-11-04T01:37:13.306415+0000","last_became_active":"2023-11-04T01:37:13.298027+0000","last_became_peered":"2023-11-04T01:37:13.298027+0000","last_unstale":"2023-11-04T01:37:13.306415+0000","last_undegraded":"2023-11-04T01:37:13.306415+0000","last_fullsized":"2023-11-04T01:37:13.306415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:38.785577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.312733+0000","last_change":"2023-11-04T01:37:12.300977+0000","last_active":"2023-11-04T01:37:13.312733+0000","last_peered":"2023-11-04T01:37:13.312733+0000","last_clean":"2023-11-04T01:37:13.312733+0000","last_became_active":"2023-11-04T01:37:12.300696+0000","last_became_peered":"2023-11-04T01:37:12.300696+0000","last_unstale":"2023-11-04T01:37:13.312733+0000","last_undegraded":"2023-11-04T01:37:13.312733+0000","last_fullsized":"2023-11-04T01:37:13.312733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:52.798428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297559+0000","last_change":"2023-11-04T01:37:13.290295+0000","last_active":"2023-11-04T01:37:14.297559+0000","last_peered":"2023-11-04T01:37:14.297559+0000","last_clean":"2023-11-04T01:37:14.297559+0000","last_became_active":"2023-11-04T01:37:13.290052+0000","last_became_peered":"2023-11-04T01:37:13.290052+0000","last_unstale":"2023-11-04T01:37:14.297559+0000","last_undegraded":"2023-11-04T01:37:14.297559+0000","last_fullsized":"2023-11-04T01:37:14.297559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:40.603346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302099+0000","last_change":"2023-11-04T01:37:12.303601+0000","last_active":"2023-11-04T01:37:13.302099+0000","last_peered":"2023-11-04T01:37:13.302099+0000","last_clean":"2023-11-04T01:37:13.302099+0000","last_became_active":"2023-11-04T01:37:12.303284+0000","last_became_peered":"2023-11-04T01:37:12.303284+0000","last_unstale":"2023-11-04T01:37:13.302099+0000","last_undegraded":"2023-11-04T01:37:13.302099+0000","last_fullsized":"2023-11-04T01:37:13.302099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:39.601375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297077+0000","last_change":"2023-11-04T01:37:13.291154+0000","last_active":"2023-11-04T01:37:13.297077+0000","last_peered":"2023-11-04T01:37:13.297077+0000","last_clean":"2023-11-04T01:37:13.297077+0000","last_became_active":"2023-11-04T01:37:13.290862+0000","last_became_peered":"2023-11-04T01:37:13.290862+0000","last_unstale":"2023-11-04T01:37:13.297077+0000","last_undegraded":"2023-11-04T01:37:13.297077+0000","last_fullsized":"2023-11-04T01:37:13.297077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:18.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287279+0000","last_change":"2023-11-04T01:37:12.297651+0000","last_active":"2023-11-04T01:37:13.287279+0000","last_peered":"2023-11-04T01:37:13.287279+0000","last_clean":"2023-11-04T01:37:13.287279+0000","last_became_active":"2023-11-04T01:37:12.295616+0000","last_became_peered":"2023-11-04T01:37:12.295616+0000","last_unstale":"2023-11-04T01:37:13.287279+0000","last_undegraded":"2023-11-04T01:37:13.287279+0000","last_fullsized":"2023-11-04T01:37:13.287279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:06.023251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299991+0000","last_change":"2023-11-04T01:37:13.300393+0000","last_active":"2023-11-04T01:37:14.299991+0000","last_peered":"2023-11-04T01:37:14.299991+0000","last_clean":"2023-11-04T01:37:14.299991+0000","last_became_active":"2023-11-04T01:37:13.300122+0000","last_became_peered":"2023-11-04T01:37:13.300122+0000","last_unstale":"2023-11-04T01:37:14.299991+0000","last_undegraded":"2023-11-04T01:37:14.299991+0000","last_fullsized":"2023-11-04T01:37:14.299991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:39.038168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.291929+0000","last_change":"2023-11-04T01:37:12.296858+0000","last_active":"2023-11-04T01:37:13.291929+0000","last_peered":"2023-11-04T01:37:13.291929+0000","last_clean":"2023-11-04T01:37:13.291929+0000","last_became_active":"2023-11-04T01:37:12.296174+0000","last_became_peered":"2023-11-04T01:37:12.296174+0000","last_unstale":"2023-11-04T01:37:13.291929+0000","last_undegraded":"2023-11-04T01:37:13.291929+0000","last_fullsized":"2023-11-04T01:37:13.291929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:23.406027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.296688+0000","last_change":"2023-11-04T01:37:13.292147+0000","last_active":"2023-11-04T01:37:13.296688+0000","last_peered":"2023-11-04T01:37:13.296688+0000","last_clean":"2023-11-04T01:37:13.296688+0000","last_became_active":"2023-11-04T01:37:13.291908+0000","last_became_peered":"2023-11-04T01:37:13.291908+0000","last_unstale":"2023-11-04T01:37:13.296688+0000","last_undegraded":"2023-11-04T01:37:13.296688+0000","last_fullsized":"2023-11-04T01:37:13.296688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:07.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299337+0000","last_change":"2023-11-04T01:37:12.296218+0000","last_active":"2023-11-04T01:37:14.299337+0000","last_peered":"2023-11-04T01:37:14.299337+0000","last_clean":"2023-11-04T01:37:14.299337+0000","last_became_active":"2023-11-04T01:37:12.295950+0000","last_became_peered":"2023-11-04T01:37:12.295950+0000","last_unstale":"2023-11-04T01:37:14.299337+0000","last_undegraded":"2023-11-04T01:37:14.299337+0000","last_fullsized":"2023-11-04T01:37:14.299337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:17.353382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308198+0000","last_change":"2023-11-04T01:37:13.302535+0000","last_active":"2023-11-04T01:37:13.308198+0000","last_peered":"2023-11-04T01:37:13.308198+0000","last_clean":"2023-11-04T01:37:13.308198+0000","last_became_active":"2023-11-04T01:37:13.302260+0000","last_became_peered":"2023-11-04T01:37:13.302260+0000","last_unstale":"2023-11-04T01:37:13.308198+0000","last_undegraded":"2023-11-04T01:37:13.308198+0000","last_fullsized":"2023-11-04T01:37:13.308198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:18.991830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300608+0000","last_change":"2023-11-04T01:37:12.296069+0000","last_active":"2023-11-04T01:37:14.300608+0000","last_peered":"2023-11-04T01:37:14.300608+0000","last_clean":"2023-11-04T01:37:14.300608+0000","last_became_active":"2023-11-04T01:37:12.295807+0000","last_became_peered":"2023-11-04T01:37:12.295807+0000","last_unstale":"2023-11-04T01:37:14.300608+0000","last_undegraded":"2023-11-04T01:37:14.300608+0000","last_fullsized":"2023-11-04T01:37:14.300608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:52.798428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300644+0000","last_change":"2023-11-04T01:37:13.298532+0000","last_active":"2023-11-04T01:37:14.300644+0000","last_peered":"2023-11-04T01:37:14.300644+0000","last_clean":"2023-11-04T01:37:14.300644+0000","last_became_active":"2023-11-04T01:37:13.298167+0000","last_became_peered":"2023-11-04T01:37:13.298167+0000","last_unstale":"2023-11-04T01:37:14.300644+0000","last_undegraded":"2023-11-04T01:37:14.300644+0000","last_fullsized":"2023-11-04T01:37:14.300644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:00:52.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.307606+0000","last_change":"2023-11-04T01:37:12.298239+0000","last_active":"2023-11-04T01:37:13.307606+0000","last_peered":"2023-11-04T01:37:13.307606+0000","last_clean":"2023-11-04T01:37:13.307606+0000","last_became_active":"2023-11-04T01:37:12.297961+0000","last_became_peered":"2023-11-04T01:37:12.297961+0000","last_unstale":"2023-11-04T01:37:13.307606+0000","last_undegraded":"2023-11-04T01:37:13.307606+0000","last_fullsized":"2023-11-04T01:37:13.307606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297786+0000","last_change":"2023-11-04T01:37:13.292987+0000","last_active":"2023-11-04T01:37:13.297786+0000","last_peered":"2023-11-04T01:37:13.297786+0000","last_clean":"2023-11-04T01:37:13.297786+0000","last_became_active":"2023-11-04T01:37:13.292701+0000","last_became_peered":"2023-11-04T01:37:13.292701+0000","last_unstale":"2023-11-04T01:37:13.297786+0000","last_undegraded":"2023-11-04T01:37:13.297786+0000","last_fullsized":"2023-11-04T01:37:13.297786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:19.573103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.309672+0000","last_change":"2023-11-04T01:37:12.299087+0000","last_active":"2023-11-04T01:37:13.309672+0000","last_peered":"2023-11-04T01:37:13.309672+0000","last_clean":"2023-11-04T01:37:13.309672+0000","last_became_active":"2023-11-04T01:37:12.298838+0000","last_became_peered":"2023-11-04T01:37:12.298838+0000","last_unstale":"2023-11-04T01:37:13.309672+0000","last_undegraded":"2023-11-04T01:37:13.309672+0000","last_fullsized":"2023-11-04T01:37:13.309672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:05.439830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.305433+0000","last_change":"2023-11-04T01:37:13.298900+0000","last_active":"2023-11-04T01:37:13.305433+0000","last_peered":"2023-11-04T01:37:13.305433+0000","last_clean":"2023-11-04T01:37:13.305433+0000","last_became_active":"2023-11-04T01:37:13.298587+0000","last_became_peered":"2023-11-04T01:37:13.298587+0000","last_unstale":"2023-11-04T01:37:13.305433+0000","last_undegraded":"2023-11-04T01:37:13.305433+0000","last_fullsized":"2023-11-04T01:37:13.305433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:54.381668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.286610+0000","last_change":"2023-11-04T01:37:12.297645+0000","last_active":"2023-11-04T01:37:13.286610+0000","last_peered":"2023-11-04T01:37:13.286610+0000","last_clean":"2023-11-04T01:37:13.286610+0000","last_became_active":"2023-11-04T01:37:12.297384+0000","last_became_peered":"2023-11-04T01:37:12.297384+0000","last_unstale":"2023-11-04T01:37:13.286610+0000","last_undegraded":"2023-11-04T01:37:13.286610+0000","last_fullsized":"2023-11-04T01:37:13.286610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:00.331948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299472+0000","last_change":"2023-11-04T01:37:13.302783+0000","last_active":"2023-11-04T01:37:14.299472+0000","last_peered":"2023-11-04T01:37:14.299472+0000","last_clean":"2023-11-04T01:37:14.299472+0000","last_became_active":"2023-11-04T01:37:13.302529+0000","last_became_peered":"2023-11-04T01:37:13.302529+0000","last_unstale":"2023-11-04T01:37:14.299472+0000","last_undegraded":"2023-11-04T01:37:14.299472+0000","last_fullsized":"2023-11-04T01:37:14.299472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.301734+0000","last_change":"2023-11-04T01:37:12.293889+0000","last_active":"2023-11-04T01:37:13.301734+0000","last_peered":"2023-11-04T01:37:13.301734+0000","last_clean":"2023-11-04T01:37:13.301734+0000","last_became_active":"2023-11-04T01:37:12.293603+0000","last_became_peered":"2023-11-04T01:37:12.293603+0000","last_unstale":"2023-11-04T01:37:13.301734+0000","last_undegraded":"2023-11-04T01:37:13.301734+0000","last_fullsized":"2023-11-04T01:37:13.301734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:08.726556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297193+0000","last_change":"2023-11-04T01:37:13.290738+0000","last_active":"2023-11-04T01:37:14.297193+0000","last_peered":"2023-11-04T01:37:14.297193+0000","last_clean":"2023-11-04T01:37:14.297193+0000","last_became_active":"2023-11-04T01:37:13.290466+0000","last_became_peered":"2023-11-04T01:37:13.290466+0000","last_unstale":"2023-11-04T01:37:14.297193+0000","last_undegraded":"2023-11-04T01:37:14.297193+0000","last_fullsized":"2023-11-04T01:37:14.297193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:18.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.280779+0000","last_change":"2023-11-04T01:37:12.296131+0000","last_active":"2023-11-04T01:37:13.280779+0000","last_peered":"2023-11-04T01:37:13.280779+0000","last_clean":"2023-11-04T01:37:13.280779+0000","last_became_active":"2023-11-04T01:37:12.295870+0000","last_became_peered":"2023-11-04T01:37:12.295870+0000","last_unstale":"2023-11-04T01:37:13.280779+0000","last_undegraded":"2023-11-04T01:37:13.280779+0000","last_fullsized":"2023-11-04T01:37:13.280779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:39.509162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299275+0000","last_change":"2023-11-04T01:37:13.306369+0000","last_active":"2023-11-04T01:37:14.299275+0000","last_peered":"2023-11-04T01:37:14.299275+0000","last_clean":"2023-11-04T01:37:14.299275+0000","last_became_active":"2023-11-04T01:37:13.306090+0000","last_became_peered":"2023-11-04T01:37:13.306090+0000","last_unstale":"2023-11-04T01:37:14.299275+0000","last_undegraded":"2023-11-04T01:37:14.299275+0000","last_fullsized":"2023-11-04T01:37:14.299275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:39.038168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299659+0000","last_change":"2023-11-04T01:37:12.297010+0000","last_active":"2023-11-04T01:37:14.299659+0000","last_peered":"2023-11-04T01:37:14.299659+0000","last_clean":"2023-11-04T01:37:14.299659+0000","last_became_active":"2023-11-04T01:37:12.296757+0000","last_became_peered":"2023-11-04T01:37:12.296757+0000","last_unstale":"2023-11-04T01:37:14.299659+0000","last_undegraded":"2023-11-04T01:37:14.299659+0000","last_fullsized":"2023-11-04T01:37:14.299659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:24.785741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308166+0000","last_change":"2023-11-04T01:37:13.302251+0000","last_active":"2023-11-04T01:37:13.308166+0000","last_peered":"2023-11-04T01:37:13.308166+0000","last_clean":"2023-11-04T01:37:13.308166+0000","last_became_active":"2023-11-04T01:37:13.301263+0000","last_became_peered":"2023-11-04T01:37:13.301263+0000","last_unstale":"2023-11-04T01:37:13.308166+0000","last_undegraded":"2023-11-04T01:37:13.308166+0000","last_fullsized":"2023-11-04T01:37:13.308166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:17.729233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.281112+0000","last_change":"2023-11-04T01:37:12.296958+0000","last_active":"2023-11-04T01:37:13.281112+0000","last_peered":"2023-11-04T01:37:13.281112+0000","last_clean":"2023-11-04T01:37:13.281112+0000","last_became_active":"2023-11-04T01:37:12.296712+0000","last_became_peered":"2023-11-04T01:37:12.296712+0000","last_unstale":"2023-11-04T01:37:13.281112+0000","last_undegraded":"2023-11-04T01:37:13.281112+0000","last_fullsized":"2023-11-04T01:37:13.281112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:50.863791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308396+0000","last_change":"2023-11-04T01:37:13.300767+0000","last_active":"2023-11-04T01:37:13.308396+0000","last_peered":"2023-11-04T01:37:13.308396+0000","last_clean":"2023-11-04T01:37:13.308396+0000","last_became_active":"2023-11-04T01:37:13.300540+0000","last_became_peered":"2023-11-04T01:37:13.300540+0000","last_unstale":"2023-11-04T01:37:13.308396+0000","last_undegraded":"2023-11-04T01:37:13.308396+0000","last_fullsized":"2023-11-04T01:37:13.308396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:08.131629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300728+0000","last_change":"2023-11-04T01:37:12.301326+0000","last_active":"2023-11-04T01:37:14.300728+0000","last_peered":"2023-11-04T01:37:14.300728+0000","last_clean":"2023-11-04T01:37:14.300728+0000","last_became_active":"2023-11-04T01:37:12.300920+0000","last_became_peered":"2023-11-04T01:37:12.300920+0000","last_unstale":"2023-11-04T01:37:14.300728+0000","last_undegraded":"2023-11-04T01:37:14.300728+0000","last_fullsized":"2023-11-04T01:37:14.300728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:14.813388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299605+0000","last_change":"2023-11-04T01:37:13.301092+0000","last_active":"2023-11-04T01:37:14.299605+0000","last_peered":"2023-11-04T01:37:14.299605+0000","last_clean":"2023-11-04T01:37:14.299605+0000","last_became_active":"2023-11-04T01:37:13.300512+0000","last_became_peered":"2023-11-04T01:37:13.300512+0000","last_unstale":"2023-11-04T01:37:14.299605+0000","last_undegraded":"2023-11-04T01:37:14.299605+0000","last_fullsized":"2023-11-04T01:37:14.299605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:26.109602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.281150+0000","last_change":"2023-11-04T01:37:12.297592+0000","last_active":"2023-11-04T01:37:13.281150+0000","last_peered":"2023-11-04T01:37:13.281150+0000","last_clean":"2023-11-04T01:37:13.281150+0000","last_became_active":"2023-11-04T01:37:12.297263+0000","last_became_peered":"2023-11-04T01:37:12.297263+0000","last_unstale":"2023-11-04T01:37:13.281150+0000","last_undegraded":"2023-11-04T01:37:13.281150+0000","last_fullsized":"2023-11-04T01:37:13.281150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:51.407310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.296659+0000","last_change":"2023-11-04T01:37:13.293347+0000","last_active":"2023-11-04T01:37:13.296659+0000","last_peered":"2023-11-04T01:37:13.296659+0000","last_clean":"2023-11-04T01:37:13.296659+0000","last_became_active":"2023-11-04T01:37:13.293081+0000","last_became_peered":"2023-11-04T01:37:13.293081+0000","last_unstale":"2023-11-04T01:37:13.296659+0000","last_undegraded":"2023-11-04T01:37:13.296659+0000","last_fullsized":"2023-11-04T01:37:13.296659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:49.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297375+0000","last_change":"2023-11-04T01:37:12.296983+0000","last_active":"2023-11-04T01:37:14.297375+0000","last_peered":"2023-11-04T01:37:14.297375+0000","last_clean":"2023-11-04T01:37:14.297375+0000","last_became_active":"2023-11-04T01:37:12.296557+0000","last_became_peered":"2023-11-04T01:37:12.296557+0000","last_unstale":"2023-11-04T01:37:14.297375+0000","last_undegraded":"2023-11-04T01:37:14.297375+0000","last_fullsized":"2023-11-04T01:37:14.297375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.783606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297520+0000","last_change":"2023-11-04T01:37:13.289771+0000","last_active":"2023-11-04T01:37:14.297520+0000","last_peered":"2023-11-04T01:37:14.297520+0000","last_clean":"2023-11-04T01:37:14.297520+0000","last_became_active":"2023-11-04T01:37:13.289473+0000","last_became_peered":"2023-11-04T01:37:13.289473+0000","last_unstale":"2023-11-04T01:37:14.297520+0000","last_undegraded":"2023-11-04T01:37:14.297520+0000","last_fullsized":"2023-11-04T01:37:14.297520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297483+0000","last_change":"2023-11-04T01:37:12.291344+0000","last_active":"2023-11-04T01:37:14.297483+0000","last_peered":"2023-11-04T01:37:14.297483+0000","last_clean":"2023-11-04T01:37:14.297483+0000","last_became_active":"2023-11-04T01:37:12.291084+0000","last_became_peered":"2023-11-04T01:37:12.291084+0000","last_unstale":"2023-11-04T01:37:14.297483+0000","last_undegraded":"2023-11-04T01:37:14.297483+0000","last_fullsized":"2023-11-04T01:37:14.297483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:07.129658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308414+0000","last_change":"2023-11-04T01:37:13.304143+0000","last_active":"2023-11-04T01:37:13.308414+0000","last_peered":"2023-11-04T01:37:13.308414+0000","last_clean":"2023-11-04T01:37:13.308414+0000","last_became_active":"2023-11-04T01:37:13.303867+0000","last_became_peered":"2023-11-04T01:37:13.303867+0000","last_unstale":"2023-11-04T01:37:13.308414+0000","last_undegraded":"2023-11-04T01:37:13.308414+0000","last_fullsized":"2023-11-04T01:37:13.308414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:58.889626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.292250+0000","last_change":"2023-11-04T01:37:12.294377+0000","last_active":"2023-11-04T01:37:13.292250+0000","last_peered":"2023-11-04T01:37:13.292250+0000","last_clean":"2023-11-04T01:37:13.292250+0000","last_became_active":"2023-11-04T01:37:12.294095+0000","last_became_peered":"2023-11-04T01:37:12.294095+0000","last_unstale":"2023-11-04T01:37:13.292250+0000","last_undegraded":"2023-11-04T01:37:13.292250+0000","last_fullsized":"2023-11-04T01:37:13.292250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:57.887656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.292482+0000","last_change":"2023-11-04T01:37:13.290704+0000","last_active":"2023-11-04T01:37:13.292482+0000","last_peered":"2023-11-04T01:37:13.292482+0000","last_clean":"2023-11-04T01:37:13.292482+0000","last_became_active":"2023-11-04T01:37:13.290413+0000","last_became_peered":"2023-11-04T01:37:13.290413+0000","last_unstale":"2023-11-04T01:37:13.292482+0000","last_undegraded":"2023-11-04T01:37:13.292482+0000","last_fullsized":"2023-11-04T01:37:13.292482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:16.977382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.288566+0000","last_change":"2023-11-04T01:37:12.296920+0000","last_active":"2023-11-04T01:37:13.288566+0000","last_peered":"2023-11-04T01:37:13.288566+0000","last_clean":"2023-11-04T01:37:13.288566+0000","last_became_active":"2023-11-04T01:37:12.296644+0000","last_became_peered":"2023-11-04T01:37:12.296644+0000","last_unstale":"2023-11-04T01:37:13.288566+0000","last_undegraded":"2023-11-04T01:37:13.288566+0000","last_fullsized":"2023-11-04T01:37:13.288566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:06.023251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300329+0000","last_change":"2023-11-04T01:37:13.304628+0000","last_active":"2023-11-04T01:37:14.300329+0000","last_peered":"2023-11-04T01:37:14.300329+0000","last_clean":"2023-11-04T01:37:14.300329+0000","last_became_active":"2023-11-04T01:37:13.303761+0000","last_became_peered":"2023-11-04T01:37:13.303761+0000","last_unstale":"2023-11-04T01:37:14.300329+0000","last_undegraded":"2023-11-04T01:37:14.300329+0000","last_fullsized":"2023-11-04T01:37:14.300329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:22.345590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.285084+0000","last_change":"2023-11-04T01:37:12.300901+0000","last_active":"2023-11-04T01:37:13.285084+0000","last_peered":"2023-11-04T01:37:13.285084+0000","last_clean":"2023-11-04T01:37:13.285084+0000","last_became_active":"2023-11-04T01:37:12.300652+0000","last_became_peered":"2023-11-04T01:37:12.300652+0000","last_unstale":"2023-11-04T01:37:13.285084+0000","last_undegraded":"2023-11-04T01:37:13.285084+0000","last_fullsized":"2023-11-04T01:37:13.285084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:24.785741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300465+0000","last_change":"2023-11-04T01:37:13.296319+0000","last_active":"2023-11-04T01:37:14.300465+0000","last_peered":"2023-11-04T01:37:14.300465+0000","last_clean":"2023-11-04T01:37:14.300465+0000","last_became_active":"2023-11-04T01:37:13.296107+0000","last_became_peered":"2023-11-04T01:37:13.296107+0000","last_unstale":"2023-11-04T01:37:14.300465+0000","last_undegraded":"2023-11-04T01:37:14.300465+0000","last_fullsized":"2023-11-04T01:37:14.300465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:14.083324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299821+0000","last_change":"2023-11-04T01:37:12.299132+0000","last_active":"2023-11-04T01:37:14.299821+0000","last_peered":"2023-11-04T01:37:14.299821+0000","last_clean":"2023-11-04T01:37:14.299821+0000","last_became_active":"2023-11-04T01:37:12.298857+0000","last_became_peered":"2023-11-04T01:37:12.298857+0000","last_unstale":"2023-11-04T01:37:14.299821+0000","last_undegraded":"2023-11-04T01:37:14.299821+0000","last_fullsized":"2023-11-04T01:37:14.299821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:48.056279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287022+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:13.287022+0000","last_peered":"2023-11-04T01:37:13.287022+0000","last_clean":"2023-11-04T01:37:13.287022+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:13.287022+0000","last_undegraded":"2023-11-04T01:37:13.287022+0000","last_fullsized":"2023-11-04T01:37:13.287022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":780542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.752},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.498}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":181435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.372}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":181984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.628}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":182476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.625}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.22900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.249},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.216}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.247}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.29399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.36799999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.35299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.38300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":771255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.23899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.27900000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.29299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:16.236 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:16.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.368+0000 7ff4c02e1640 1 Processor -- start 2023-11-04T01:37:16.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.368+0000 7ff4c02e1640 1 -- start start 2023-11-04T01:37:16.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4c02e1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4b80b0ae0 0x7ff4b80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4c02e1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 0x7ff4b815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4c02e1640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80b4110 con 0x7ff4b8159c70 2023-11-04T01:37:16.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4c02e1640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80b49b0 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4c02e1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b43f0 con 0x7ff4b806db20 2023-11-04T01:37:16.373 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4be87e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 0x7ff4b815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4bd87c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff4b80b0ae0 0x7ff4b80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4be07d640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff4b8159c70 0x7ff4b80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:41944/0 (socket says 172.21.15.93:41944) 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4be07d640 1 -- 172.21.15.93:0/4157589325 learned_addr learned my addr 172.21.15.93:0/4157589325 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.369+0000 7ff4bd07b640 1 -- 172.21.15.93:0/4157589325 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648582400 0 0) 0x7ff4b80b4110 con 0x7ff4b8159c70 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd07b640 1 -- 172.21.15.93:0/4157589325 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a4003520 con 0x7ff4b8159c70 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd87c640 1 -- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 msgr2=0x7ff4b815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd87c640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 0x7ff4b815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd87c640 1 -- 172.21.15.93:0/4157589325 >> v1:172.21.15.125:6789/0 conn(0x7ff4b8159c70 legacy=0x7ff4b80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd87c640 1 -- 172.21.15.93:0/4157589325 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80b46d0 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4be87e640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 0x7ff4b815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.370+0000 7ff4bd87c640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b80b0ae0 0x7ff4b80ce370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1027037ea2111049 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4bd07b640 1 -- 172.21.15.93:0/4157589325 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031830 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4bd07b640 1 -- 172.21.15.93:0/4157589325 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a8031990 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4bd07b640 1 -- 172.21.15.93:0/4157589325 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031d20 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 -- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b80b0ae0 msgr2=0x7ff4b80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b80b0ae0 0x7ff4b80ce370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 -- 172.21.15.93:0/4157589325 shutdown_connections 2023-11-04T01:37:16.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b806db20 0x7ff4b815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/4157589325 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b80b0ae0 0x7ff4b80ce370 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 -- 172.21.15.93:0/4157589325 >> 172.21.15.93:0/4157589325 conn(0x7ff4b80ce950 msgr2=0x7ff4b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 -- 172.21.15.93:0/4157589325 shutdown_connections 2023-11-04T01:37:16.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.371+0000 7ff4c02e1640 1 -- 172.21.15.93:0/4157589325 wait complete. 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.372+0000 7ff4c02e1640 1 Processor -- start 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.372+0000 7ff4c02e1640 1 -- start start 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 0x7ff4b8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b80b0ae0 0x7ff4b8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815a050 con 0x7ff4b8159c70 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81551c0 con 0x7ff4b806db20 2023-11-04T01:37:16.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4c02e1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815a2a0 con 0x7ff4b80b0ae0 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44794/0 (socket says 172.21.15.93:44794) 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 -- 172.21.15.93:0/963864592 learned_addr learned my addr 172.21.15.93:0/963864592 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be07d640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 0x7ff4b8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4bd87c640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b80b0ae0 0x7ff4b8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 -- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b80b0ae0 msgr2=0x7ff4b8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b80b0ae0 0x7ff4b8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 -- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 msgr2=0x7ff4b8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 0x7ff4b8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be87e640 1 -- 172.21.15.93:0/963864592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009a70 con 0x7ff4b8159c70 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.373+0000 7ff4be07d640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 0x7ff4b8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4be87e640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000efc0 tx=0x7ff4b0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0009d70 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000f040 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0003990 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a8009400 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.374+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b815a860 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.375+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8074290 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.375+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4b00144a0 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.375+0000 7ff4aeffd640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 0x7ff49c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.376+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4b008a2f0 con 0x7ff4b8159c70 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.376+0000 7ff4be07d640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 0x7ff49c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.376+0000 7ff4be07d640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 0x7ff49c06d360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40011e0 tx=0x7ff4b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.380+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4b00552f0 con 0x7ff4b8159c70 2023-11-04T01:37:16.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.542+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4b80cde50 con 0x7ff49c06aea0 2023-11-04T01:37:16.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.549+0000 7ff4aeffd640 1 -- 172.21.15.93:0/963864592 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289487 (secure 0 0 0) 0x7ff4b40013d0 con 0x7ff49c06aea0 2023-11-04T01:37:16.555 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.552+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 msgr2=0x7ff49c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.552+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 0x7ff49c06d360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40011e0 tx=0x7ff4b4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.552+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 msgr2=0x7ff4b80af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.552+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000efc0 tx=0x7ff4b0009f90 comp rx=0 tx=0).stop 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 shutdown_connections 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff49c06aea0 0x7ff49c06d360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4b8159c70 0x7ff4b80af990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff4b80b0ae0 0x7ff4b8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 --2- 172.21.15.93:0/963864592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4b806db20 0x7ff4b8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 >> 172.21.15.93:0/963864592 conn(0x7ff4b80ce950 msgr2=0x7ff4b80b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 shutdown_connections 2023-11-04T01:37:16.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.553+0000 7ff4c02e1640 1 -- 172.21.15.93:0/963864592 wait complete. 2023-11-04T01:37:16.566 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:37:15.343626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220732,"kb_used_data":4556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753988,"statfs":{"total":773094113280,"available":772868083712,"internally_reserved":0,"allocated":4665344,"data_stored":2645114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.071849"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308150+0000","last_change":"2023-11-04T01:37:13.301595+0000","last_active":"2023-11-04T01:37:13.308150+0000","last_peered":"2023-11-04T01:37:13.308150+0000","last_clean":"2023-11-04T01:37:13.308150+0000","last_became_active":"2023-11-04T01:37:13.301108+0000","last_became_peered":"2023-11-04T01:37:13.301108+0000","last_unstale":"2023-11-04T01:37:13.308150+0000","last_undegraded":"2023-11-04T01:37:13.308150+0000","last_fullsized":"2023-11-04T01:37:13.308150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303913+0000","last_change":"2023-11-04T01:37:13.298883+0000","last_active":"2023-11-04T01:37:13.303913+0000","last_peered":"2023-11-04T01:37:13.303913+0000","last_clean":"2023-11-04T01:37:13.303913+0000","last_became_active":"2023-11-04T01:37:13.298564+0000","last_became_peered":"2023-11-04T01:37:13.298564+0000","last_unstale":"2023-11-04T01:37:13.303913+0000","last_undegraded":"2023-11-04T01:37:13.303913+0000","last_fullsized":"2023-11-04T01:37:13.303913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297381+0000","last_change":"2023-11-04T01:37:13.299673+0000","last_active":"2023-11-04T01:37:14.297381+0000","last_peered":"2023-11-04T01:37:14.297381+0000","last_clean":"2023-11-04T01:37:14.297381+0000","last_became_active":"2023-11-04T01:37:13.299388+0000","last_became_peered":"2023-11-04T01:37:13.299388+0000","last_unstale":"2023-11-04T01:37:14.297381+0000","last_undegraded":"2023-11-04T01:37:14.297381+0000","last_fullsized":"2023-11-04T01:37:14.297381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:18.991830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298782+0000","last_change":"2023-11-04T01:37:13.294120+0000","last_active":"2023-11-04T01:37:13.298782+0000","last_peered":"2023-11-04T01:37:13.298782+0000","last_clean":"2023-11-04T01:37:13.298782+0000","last_became_active":"2023-11-04T01:37:13.293762+0000","last_became_peered":"2023-11-04T01:37:13.293762+0000","last_unstale":"2023-11-04T01:37:13.298782+0000","last_undegraded":"2023-11-04T01:37:13.298782+0000","last_fullsized":"2023-11-04T01:37:13.298782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:05.475586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298788+0000","last_change":"2023-11-04T01:37:13.295713+0000","last_active":"2023-11-04T01:37:13.298788+0000","last_peered":"2023-11-04T01:37:13.298788+0000","last_clean":"2023-11-04T01:37:13.298788+0000","last_became_active":"2023-11-04T01:37:13.294236+0000","last_became_peered":"2023-11-04T01:37:13.294236+0000","last_unstale":"2023-11-04T01:37:13.298788+0000","last_undegraded":"2023-11-04T01:37:13.298788+0000","last_fullsized":"2023-11-04T01:37:13.298788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:43.600483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.305363+0000","last_change":"2023-11-04T01:37:13.297753+0000","last_active":"2023-11-04T01:37:13.305363+0000","last_peered":"2023-11-04T01:37:13.305363+0000","last_clean":"2023-11-04T01:37:13.305363+0000","last_became_active":"2023-11-04T01:37:13.297453+0000","last_became_peered":"2023-11-04T01:37:13.297453+0000","last_unstale":"2023-11-04T01:37:13.305363+0000","last_undegraded":"2023-11-04T01:37:13.305363+0000","last_fullsized":"2023-11-04T01:37:13.305363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:45.742862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299188+0000","last_change":"2023-11-04T01:37:13.295768+0000","last_active":"2023-11-04T01:37:14.299188+0000","last_peered":"2023-11-04T01:37:14.299188+0000","last_clean":"2023-11-04T01:37:14.299188+0000","last_became_active":"2023-11-04T01:37:13.295516+0000","last_became_peered":"2023-11-04T01:37:13.295516+0000","last_unstale":"2023-11-04T01:37:14.299188+0000","last_undegraded":"2023-11-04T01:37:14.299188+0000","last_fullsized":"2023-11-04T01:37:14.299188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:04.032361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308121+0000","last_change":"2023-11-04T01:37:13.300851+0000","last_active":"2023-11-04T01:37:13.308121+0000","last_peered":"2023-11-04T01:37:13.308121+0000","last_clean":"2023-11-04T01:37:13.308121+0000","last_became_active":"2023-11-04T01:37:13.300608+0000","last_became_peered":"2023-11-04T01:37:13.300608+0000","last_unstale":"2023-11-04T01:37:13.308121+0000","last_undegraded":"2023-11-04T01:37:13.308121+0000","last_fullsized":"2023-11-04T01:37:13.308121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:45.742862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297414+0000","last_change":"2023-11-04T01:37:13.299702+0000","last_active":"2023-11-04T01:37:14.297414+0000","last_peered":"2023-11-04T01:37:14.297414+0000","last_clean":"2023-11-04T01:37:14.297414+0000","last_became_active":"2023-11-04T01:37:13.299425+0000","last_became_peered":"2023-11-04T01:37:13.299425+0000","last_unstale":"2023-11-04T01:37:14.297414+0000","last_undegraded":"2023-11-04T01:37:14.297414+0000","last_fullsized":"2023-11-04T01:37:14.297414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299881+0000","last_change":"2023-11-04T01:37:13.291278+0000","last_active":"2023-11-04T01:37:14.299881+0000","last_peered":"2023-11-04T01:37:14.299881+0000","last_clean":"2023-11-04T01:37:14.299881+0000","last_became_active":"2023-11-04T01:37:13.290974+0000","last_became_peered":"2023-11-04T01:37:13.290974+0000","last_unstale":"2023-11-04T01:37:14.299881+0000","last_undegraded":"2023-11-04T01:37:14.299881+0000","last_fullsized":"2023-11-04T01:37:14.299881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:51.529683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300635+0000","last_change":"2023-11-04T01:37:13.291534+0000","last_active":"2023-11-04T01:37:14.300635+0000","last_peered":"2023-11-04T01:37:14.300635+0000","last_clean":"2023-11-04T01:37:14.300635+0000","last_became_active":"2023-11-04T01:37:13.291265+0000","last_became_peered":"2023-11-04T01:37:13.291265+0000","last_unstale":"2023-11-04T01:37:14.300635+0000","last_undegraded":"2023-11-04T01:37:14.300635+0000","last_fullsized":"2023-11-04T01:37:14.300635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:30.411496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297253+0000","last_change":"2023-11-04T01:37:13.289812+0000","last_active":"2023-11-04T01:37:14.297253+0000","last_peered":"2023-11-04T01:37:14.297253+0000","last_clean":"2023-11-04T01:37:14.297253+0000","last_became_active":"2023-11-04T01:37:13.289525+0000","last_became_peered":"2023-11-04T01:37:13.289525+0000","last_unstale":"2023-11-04T01:37:14.297253+0000","last_undegraded":"2023-11-04T01:37:14.297253+0000","last_fullsized":"2023-11-04T01:37:14.297253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:49.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300027+0000","last_change":"2023-11-04T01:37:13.291882+0000","last_active":"2023-11-04T01:37:14.300027+0000","last_peered":"2023-11-04T01:37:14.300027+0000","last_clean":"2023-11-04T01:37:14.300027+0000","last_became_active":"2023-11-04T01:37:13.291629+0000","last_became_peered":"2023-11-04T01:37:13.291629+0000","last_unstale":"2023-11-04T01:37:14.300027+0000","last_undegraded":"2023-11-04T01:37:14.300027+0000","last_fullsized":"2023-11-04T01:37:14.300027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:31.705048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306874+0000","last_change":"2023-11-04T01:37:13.300066+0000","last_active":"2023-11-04T01:37:13.306874+0000","last_peered":"2023-11-04T01:37:13.306874+0000","last_clean":"2023-11-04T01:37:13.306874+0000","last_became_active":"2023-11-04T01:37:13.299817+0000","last_became_peered":"2023-11-04T01:37:13.299817+0000","last_unstale":"2023-11-04T01:37:13.306874+0000","last_undegraded":"2023-11-04T01:37:13.306874+0000","last_fullsized":"2023-11-04T01:37:13.306874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:08.131629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299363+0000","last_change":"2023-11-04T01:37:13.292648+0000","last_active":"2023-11-04T01:37:14.299363+0000","last_peered":"2023-11-04T01:37:14.299363+0000","last_clean":"2023-11-04T01:37:14.299363+0000","last_became_active":"2023-11-04T01:37:13.292399+0000","last_became_peered":"2023-11-04T01:37:13.292399+0000","last_unstale":"2023-11-04T01:37:14.299363+0000","last_undegraded":"2023-11-04T01:37:14.299363+0000","last_fullsized":"2023-11-04T01:37:14.299363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:22.345590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299240+0000","last_change":"2023-11-04T01:37:13.303242+0000","last_active":"2023-11-04T01:37:14.299240+0000","last_peered":"2023-11-04T01:37:14.299240+0000","last_clean":"2023-11-04T01:37:14.299240+0000","last_became_active":"2023-11-04T01:37:13.303007+0000","last_became_peered":"2023-11-04T01:37:13.303007+0000","last_unstale":"2023-11-04T01:37:14.299240+0000","last_undegraded":"2023-11-04T01:37:14.299240+0000","last_fullsized":"2023-11-04T01:37:14.299240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:05:58.493145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299968+0000","last_change":"2023-11-04T01:37:13.304400+0000","last_active":"2023-11-04T01:37:14.299968+0000","last_peered":"2023-11-04T01:37:14.299968+0000","last_clean":"2023-11-04T01:37:14.299968+0000","last_became_active":"2023-11-04T01:37:13.303052+0000","last_became_peered":"2023-11-04T01:37:13.303052+0000","last_unstale":"2023-11-04T01:37:14.299968+0000","last_undegraded":"2023-11-04T01:37:14.299968+0000","last_fullsized":"2023-11-04T01:37:14.299968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:04.032361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302157+0000","last_change":"2023-11-04T01:37:13.301135+0000","last_active":"2023-11-04T01:37:13.302157+0000","last_peered":"2023-11-04T01:37:13.302157+0000","last_clean":"2023-11-04T01:37:13.302157+0000","last_became_active":"2023-11-04T01:37:13.300834+0000","last_became_peered":"2023-11-04T01:37:13.300834+0000","last_unstale":"2023-11-04T01:37:13.302157+0000","last_undegraded":"2023-11-04T01:37:13.302157+0000","last_fullsized":"2023-11-04T01:37:13.302157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:11.202174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297858+0000","last_change":"2023-11-04T01:37:13.293786+0000","last_active":"2023-11-04T01:37:13.297858+0000","last_peered":"2023-11-04T01:37:13.297858+0000","last_clean":"2023-11-04T01:37:13.297858+0000","last_became_active":"2023-11-04T01:37:13.293532+0000","last_became_peered":"2023-11-04T01:37:13.293532+0000","last_unstale":"2023-11-04T01:37:13.297858+0000","last_undegraded":"2023-11-04T01:37:13.297858+0000","last_fullsized":"2023-11-04T01:37:13.297858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:52.316316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.301288+0000","last_change":"2023-11-04T01:37:13.300376+0000","last_active":"2023-11-04T01:37:13.301288+0000","last_peered":"2023-11-04T01:37:13.301288+0000","last_clean":"2023-11-04T01:37:13.301288+0000","last_became_active":"2023-11-04T01:37:13.300085+0000","last_became_peered":"2023-11-04T01:37:13.300085+0000","last_unstale":"2023-11-04T01:37:13.301288+0000","last_undegraded":"2023-11-04T01:37:13.301288+0000","last_fullsized":"2023-11-04T01:37:13.301288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:10.977915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300186+0000","last_change":"2023-11-04T01:37:13.299139+0000","last_active":"2023-11-04T01:37:14.300186+0000","last_peered":"2023-11-04T01:37:14.300186+0000","last_clean":"2023-11-04T01:37:14.300186+0000","last_became_active":"2023-11-04T01:37:13.298850+0000","last_became_peered":"2023-11-04T01:37:13.298850+0000","last_unstale":"2023-11-04T01:37:14.300186+0000","last_undegraded":"2023-11-04T01:37:14.300186+0000","last_fullsized":"2023-11-04T01:37:14.300186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:40.803988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.304374+0000","last_change":"2023-11-04T01:37:13.294658+0000","last_active":"2023-11-04T01:37:13.304374+0000","last_peered":"2023-11-04T01:37:13.304374+0000","last_clean":"2023-11-04T01:37:13.304374+0000","last_became_active":"2023-11-04T01:37:13.294382+0000","last_became_peered":"2023-11-04T01:37:13.294382+0000","last_unstale":"2023-11-04T01:37:13.304374+0000","last_undegraded":"2023-11-04T01:37:13.304374+0000","last_fullsized":"2023-11-04T01:37:13.304374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:24.407998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299522+0000","last_change":"2023-11-04T01:37:13.298836+0000","last_active":"2023-11-04T01:37:14.299522+0000","last_peered":"2023-11-04T01:37:14.299522+0000","last_clean":"2023-11-04T01:37:14.299522+0000","last_became_active":"2023-11-04T01:37:13.298470+0000","last_became_peered":"2023-11-04T01:37:13.298470+0000","last_unstale":"2023-11-04T01:37:14.299522+0000","last_undegraded":"2023-11-04T01:37:14.299522+0000","last_fullsized":"2023-11-04T01:37:14.299522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:40.603346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303634+0000","last_change":"2023-11-04T01:37:13.296535+0000","last_active":"2023-11-04T01:37:13.303634+0000","last_peered":"2023-11-04T01:37:13.303634+0000","last_clean":"2023-11-04T01:37:13.303634+0000","last_became_active":"2023-11-04T01:37:13.294413+0000","last_became_peered":"2023-11-04T01:37:13.294413+0000","last_unstale":"2023-11-04T01:37:13.303634+0000","last_undegraded":"2023-11-04T01:37:13.303634+0000","last_fullsized":"2023-11-04T01:37:13.303634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:28.666782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303146+0000","last_change":"2023-11-04T01:37:13.301781+0000","last_active":"2023-11-04T01:37:13.303146+0000","last_peered":"2023-11-04T01:37:13.303146+0000","last_clean":"2023-11-04T01:37:13.303146+0000","last_became_active":"2023-11-04T01:37:13.301491+0000","last_became_peered":"2023-11-04T01:37:13.301491+0000","last_unstale":"2023-11-04T01:37:13.303146+0000","last_undegraded":"2023-11-04T01:37:13.303146+0000","last_fullsized":"2023-11-04T01:37:13.303146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:21.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308386+0000","last_change":"2023-11-04T01:37:13.301278+0000","last_active":"2023-11-04T01:37:13.308386+0000","last_peered":"2023-11-04T01:37:13.308386+0000","last_clean":"2023-11-04T01:37:13.308386+0000","last_became_active":"2023-11-04T01:37:13.301007+0000","last_became_peered":"2023-11-04T01:37:13.301007+0000","last_unstale":"2023-11-04T01:37:13.308386+0000","last_undegraded":"2023-11-04T01:37:13.308386+0000","last_fullsized":"2023-11-04T01:37:13.308386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:03.204602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.303747+0000","last_change":"2023-11-04T01:37:13.302681+0000","last_active":"2023-11-04T01:37:13.303747+0000","last_peered":"2023-11-04T01:37:13.303747+0000","last_clean":"2023-11-04T01:37:13.303747+0000","last_became_active":"2023-11-04T01:37:13.302338+0000","last_became_peered":"2023-11-04T01:37:13.302338+0000","last_unstale":"2023-11-04T01:37:13.303747+0000","last_undegraded":"2023-11-04T01:37:13.303747+0000","last_fullsized":"2023-11-04T01:37:13.303747+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:24.762983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300678+0000","last_change":"2023-11-04T01:37:13.296318+0000","last_active":"2023-11-04T01:37:14.300678+0000","last_peered":"2023-11-04T01:37:14.300678+0000","last_clean":"2023-11-04T01:37:14.300678+0000","last_became_active":"2023-11-04T01:37:13.296071+0000","last_became_peered":"2023-11-04T01:37:13.296071+0000","last_unstale":"2023-11-04T01:37:14.300678+0000","last_undegraded":"2023-11-04T01:37:14.300678+0000","last_fullsized":"2023-11-04T01:37:14.300678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:00.701503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302637+0000","last_change":"2023-11-04T01:37:13.301820+0000","last_active":"2023-11-04T01:37:13.302637+0000","last_peered":"2023-11-04T01:37:13.302637+0000","last_clean":"2023-11-04T01:37:13.302637+0000","last_became_active":"2023-11-04T01:37:13.301534+0000","last_became_peered":"2023-11-04T01:37:13.301534+0000","last_unstale":"2023-11-04T01:37:13.302637+0000","last_undegraded":"2023-11-04T01:37:13.302637+0000","last_fullsized":"2023-11-04T01:37:13.302637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:50.112388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302598+0000","last_change":"2023-11-04T01:37:13.301386+0000","last_active":"2023-11-04T01:37:13.302598+0000","last_peered":"2023-11-04T01:37:13.302598+0000","last_clean":"2023-11-04T01:37:13.302598+0000","last_became_active":"2023-11-04T01:37:13.301027+0000","last_became_peered":"2023-11-04T01:37:13.301027+0000","last_unstale":"2023-11-04T01:37:13.302598+0000","last_undegraded":"2023-11-04T01:37:13.302598+0000","last_fullsized":"2023-11-04T01:37:13.302598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:34.825128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299669+0000","last_change":"2023-11-04T01:37:13.300127+0000","last_active":"2023-11-04T01:37:14.299669+0000","last_peered":"2023-11-04T01:37:14.299669+0000","last_clean":"2023-11-04T01:37:14.299669+0000","last_became_active":"2023-11-04T01:37:13.299871+0000","last_became_peered":"2023-11-04T01:37:13.299871+0000","last_unstale":"2023-11-04T01:37:14.299669+0000","last_undegraded":"2023-11-04T01:37:14.299669+0000","last_fullsized":"2023-11-04T01:37:14.299669+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:53.800398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.299212+0000","last_change":"2023-11-04T01:37:13.295156+0000","last_active":"2023-11-04T01:37:13.299212+0000","last_peered":"2023-11-04T01:37:13.299212+0000","last_clean":"2023-11-04T01:37:13.299212+0000","last_became_active":"2023-11-04T01:37:13.294925+0000","last_became_peered":"2023-11-04T01:37:13.294925+0000","last_unstale":"2023-11-04T01:37:13.299212+0000","last_undegraded":"2023-11-04T01:37:13.299212+0000","last_fullsized":"2023-11-04T01:37:13.299212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:24.407998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299829+0000","last_change":"2023-11-04T01:37:13.305468+0000","last_active":"2023-11-04T01:37:14.299829+0000","last_peered":"2023-11-04T01:37:14.299829+0000","last_clean":"2023-11-04T01:37:14.299829+0000","last_became_active":"2023-11-04T01:37:13.305224+0000","last_became_peered":"2023-11-04T01:37:13.305224+0000","last_unstale":"2023-11-04T01:37:14.299829+0000","last_undegraded":"2023-11-04T01:37:14.299829+0000","last_fullsized":"2023-11-04T01:37:14.299829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:15.815358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308200+0000","last_change":"2023-11-04T01:37:12.296446+0000","last_active":"2023-11-04T01:37:13.308200+0000","last_peered":"2023-11-04T01:37:13.308200+0000","last_clean":"2023-11-04T01:37:13.308200+0000","last_became_active":"2023-11-04T01:37:12.296188+0000","last_became_peered":"2023-11-04T01:37:12.296188+0000","last_unstale":"2023-11-04T01:37:13.308200+0000","last_undegraded":"2023-11-04T01:37:13.308200+0000","last_fullsized":"2023-11-04T01:37:13.308200+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:02.202632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308470+0000","last_change":"2023-11-04T01:37:13.302007+0000","last_active":"2023-11-04T01:37:13.308470+0000","last_peered":"2023-11-04T01:37:13.308470+0000","last_clean":"2023-11-04T01:37:13.308470+0000","last_became_active":"2023-11-04T01:37:13.301621+0000","last_became_peered":"2023-11-04T01:37:13.301621+0000","last_unstale":"2023-11-04T01:37:13.308470+0000","last_undegraded":"2023-11-04T01:37:13.308470+0000","last_fullsized":"2023-11-04T01:37:13.308470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:16.977382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297393+0000","last_change":"2023-11-04T01:37:12.293178+0000","last_active":"2023-11-04T01:37:14.297393+0000","last_peered":"2023-11-04T01:37:14.297393+0000","last_clean":"2023-11-04T01:37:14.297393+0000","last_became_active":"2023-11-04T01:37:12.292901+0000","last_became_peered":"2023-11-04T01:37:12.292901+0000","last_unstale":"2023-11-04T01:37:14.297393+0000","last_undegraded":"2023-11-04T01:37:14.297393+0000","last_fullsized":"2023-11-04T01:37:14.297393+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306815+0000","last_change":"2023-11-04T01:37:13.304165+0000","last_active":"2023-11-04T01:37:13.306815+0000","last_peered":"2023-11-04T01:37:13.306815+0000","last_clean":"2023-11-04T01:37:13.306815+0000","last_became_active":"2023-11-04T01:37:13.303147+0000","last_became_peered":"2023-11-04T01:37:13.303147+0000","last_unstale":"2023-11-04T01:37:13.306815+0000","last_undegraded":"2023-11-04T01:37:13.306815+0000","last_fullsized":"2023-11-04T01:37:13.306815+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:03.204602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.307488+0000","last_change":"2023-11-04T01:37:12.298299+0000","last_active":"2023-11-04T01:37:13.307488+0000","last_peered":"2023-11-04T01:37:13.307488+0000","last_clean":"2023-11-04T01:37:13.307488+0000","last_became_active":"2023-11-04T01:37:12.297996+0000","last_became_peered":"2023-11-04T01:37:12.297996+0000","last_unstale":"2023-11-04T01:37:13.307488+0000","last_undegraded":"2023-11-04T01:37:13.307488+0000","last_fullsized":"2023-11-04T01:37:13.307488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.783606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.310319+0000","last_change":"2023-11-04T01:37:13.303081+0000","last_active":"2023-11-04T01:37:13.310319+0000","last_peered":"2023-11-04T01:37:13.310319+0000","last_clean":"2023-11-04T01:37:13.310319+0000","last_became_active":"2023-11-04T01:37:13.302797+0000","last_became_peered":"2023-11-04T01:37:13.302797+0000","last_unstale":"2023-11-04T01:37:13.310319+0000","last_undegraded":"2023-11-04T01:37:13.310319+0000","last_fullsized":"2023-11-04T01:37:13.310319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:26.109602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.304362+0000","last_change":"2023-11-04T01:37:12.300628+0000","last_active":"2023-11-04T01:37:13.304362+0000","last_peered":"2023-11-04T01:37:13.304362+0000","last_clean":"2023-11-04T01:37:13.304362+0000","last_became_active":"2023-11-04T01:37:12.300357+0000","last_became_peered":"2023-11-04T01:37:12.300357+0000","last_unstale":"2023-11-04T01:37:13.304362+0000","last_undegraded":"2023-11-04T01:37:13.304362+0000","last_fullsized":"2023-11-04T01:37:13.304362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:16.727263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297190+0000","last_change":"2023-11-04T01:37:13.288953+0000","last_active":"2023-11-04T01:37:14.297190+0000","last_peered":"2023-11-04T01:37:14.297190+0000","last_clean":"2023-11-04T01:37:14.297190+0000","last_became_active":"2023-11-04T01:37:13.288708+0000","last_became_peered":"2023-11-04T01:37:13.288708+0000","last_unstale":"2023-11-04T01:37:14.297190+0000","last_undegraded":"2023-11-04T01:37:14.297190+0000","last_fullsized":"2023-11-04T01:37:14.297190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:25.787711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300258+0000","last_change":"2023-11-04T01:37:12.301177+0000","last_active":"2023-11-04T01:37:14.300258+0000","last_peered":"2023-11-04T01:37:14.300258+0000","last_clean":"2023-11-04T01:37:14.300258+0000","last_became_active":"2023-11-04T01:37:12.300857+0000","last_became_peered":"2023-11-04T01:37:12.300857+0000","last_unstale":"2023-11-04T01:37:14.300258+0000","last_undegraded":"2023-11-04T01:37:14.300258+0000","last_fullsized":"2023-11-04T01:37:14.300258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:48.056279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299502+0000","last_change":"2023-11-04T01:37:13.297352+0000","last_active":"2023-11-04T01:37:14.299502+0000","last_peered":"2023-11-04T01:37:14.299502+0000","last_clean":"2023-11-04T01:37:14.299502+0000","last_became_active":"2023-11-04T01:37:13.296864+0000","last_became_peered":"2023-11-04T01:37:13.296864+0000","last_unstale":"2023-11-04T01:37:14.299502+0000","last_undegraded":"2023-11-04T01:37:14.299502+0000","last_fullsized":"2023-11-04T01:37:14.299502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:41.873262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300094+0000","last_change":"2023-11-04T01:37:12.296218+0000","last_active":"2023-11-04T01:37:14.300094+0000","last_peered":"2023-11-04T01:37:14.300094+0000","last_clean":"2023-11-04T01:37:14.300094+0000","last_became_active":"2023-11-04T01:37:12.295943+0000","last_became_peered":"2023-11-04T01:37:12.295943+0000","last_unstale":"2023-11-04T01:37:14.300094+0000","last_undegraded":"2023-11-04T01:37:14.300094+0000","last_fullsized":"2023-11-04T01:37:14.300094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306895+0000","last_change":"2023-11-04T01:37:13.303877+0000","last_active":"2023-11-04T01:37:13.306895+0000","last_peered":"2023-11-04T01:37:13.306895+0000","last_clean":"2023-11-04T01:37:13.306895+0000","last_became_active":"2023-11-04T01:37:13.303051+0000","last_became_peered":"2023-11-04T01:37:13.303051+0000","last_unstale":"2023-11-04T01:37:13.306895+0000","last_undegraded":"2023-11-04T01:37:13.306895+0000","last_fullsized":"2023-11-04T01:37:13.306895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:58.889626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.286425+0000","last_change":"2023-11-04T01:37:12.297071+0000","last_active":"2023-11-04T01:37:13.286425+0000","last_peered":"2023-11-04T01:37:13.286425+0000","last_clean":"2023-11-04T01:37:13.286425+0000","last_became_active":"2023-11-04T01:37:12.296824+0000","last_became_peered":"2023-11-04T01:37:12.296824+0000","last_unstale":"2023-11-04T01:37:13.286425+0000","last_undegraded":"2023-11-04T01:37:13.286425+0000","last_fullsized":"2023-11-04T01:37:13.286425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:18.571133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308363+0000","last_change":"2023-11-04T01:37:13.302766+0000","last_active":"2023-11-04T01:37:13.308363+0000","last_peered":"2023-11-04T01:37:13.308363+0000","last_clean":"2023-11-04T01:37:13.308363+0000","last_became_active":"2023-11-04T01:37:13.302493+0000","last_became_peered":"2023-11-04T01:37:13.302493+0000","last_unstale":"2023-11-04T01:37:13.308363+0000","last_undegraded":"2023-11-04T01:37:13.308363+0000","last_fullsized":"2023-11-04T01:37:13.308363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287742+0000","last_change":"2023-11-04T01:37:12.294021+0000","last_active":"2023-11-04T01:37:13.287742+0000","last_peered":"2023-11-04T01:37:13.287742+0000","last_clean":"2023-11-04T01:37:13.287742+0000","last_became_active":"2023-11-04T01:37:12.293773+0000","last_became_peered":"2023-11-04T01:37:12.293773+0000","last_unstale":"2023-11-04T01:37:13.287742+0000","last_undegraded":"2023-11-04T01:37:13.287742+0000","last_fullsized":"2023-11-04T01:37:13.287742+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:00.331948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.298801+0000","last_change":"2023-11-04T01:37:13.294384+0000","last_active":"2023-11-04T01:37:13.298801+0000","last_peered":"2023-11-04T01:37:13.298801+0000","last_clean":"2023-11-04T01:37:13.298801+0000","last_became_active":"2023-11-04T01:37:13.294121+0000","last_became_peered":"2023-11-04T01:37:13.294121+0000","last_unstale":"2023-11-04T01:37:13.298801+0000","last_undegraded":"2023-11-04T01:37:13.298801+0000","last_fullsized":"2023-11-04T01:37:13.298801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:23.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.290428+0000","last_change":"2023-11-04T01:37:12.303559+0000","last_active":"2023-11-04T01:37:13.290428+0000","last_peered":"2023-11-04T01:37:13.290428+0000","last_clean":"2023-11-04T01:37:13.290428+0000","last_became_active":"2023-11-04T01:37:12.303291+0000","last_became_peered":"2023-11-04T01:37:12.303291+0000","last_unstale":"2023-11-04T01:37:13.290428+0000","last_undegraded":"2023-11-04T01:37:13.290428+0000","last_fullsized":"2023-11-04T01:37:13.290428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:14.813388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299465+0000","last_change":"2023-11-04T01:37:13.303397+0000","last_active":"2023-11-04T01:37:14.299465+0000","last_peered":"2023-11-04T01:37:14.299465+0000","last_clean":"2023-11-04T01:37:14.299465+0000","last_became_active":"2023-11-04T01:37:13.302414+0000","last_became_peered":"2023-11-04T01:37:13.302414+0000","last_unstale":"2023-11-04T01:37:14.299465+0000","last_undegraded":"2023-11-04T01:37:14.299465+0000","last_fullsized":"2023-11-04T01:37:14.299465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300218+0000","last_change":"2023-11-04T01:37:12.303708+0000","last_active":"2023-11-04T01:37:14.300218+0000","last_peered":"2023-11-04T01:37:14.300218+0000","last_clean":"2023-11-04T01:37:14.300218+0000","last_became_active":"2023-11-04T01:37:12.303467+0000","last_became_peered":"2023-11-04T01:37:12.303467+0000","last_unstale":"2023-11-04T01:37:14.300218+0000","last_undegraded":"2023-11-04T01:37:14.300218+0000","last_fullsized":"2023-11-04T01:37:14.300218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:12.160173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297417+0000","last_change":"2023-11-04T01:37:13.290760+0000","last_active":"2023-11-04T01:37:14.297417+0000","last_peered":"2023-11-04T01:37:14.297417+0000","last_clean":"2023-11-04T01:37:14.297417+0000","last_became_active":"2023-11-04T01:37:13.290508+0000","last_became_peered":"2023-11-04T01:37:13.290508+0000","last_unstale":"2023-11-04T01:37:14.297417+0000","last_undegraded":"2023-11-04T01:37:14.297417+0000","last_fullsized":"2023-11-04T01:37:14.297417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:28.652543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300729+0000","last_change":"2023-11-04T01:37:12.301377+0000","last_active":"2023-11-04T01:37:14.300729+0000","last_peered":"2023-11-04T01:37:14.300729+0000","last_clean":"2023-11-04T01:37:14.300729+0000","last_became_active":"2023-11-04T01:37:12.301005+0000","last_became_peered":"2023-11-04T01:37:12.301005+0000","last_unstale":"2023-11-04T01:37:14.300729+0000","last_undegraded":"2023-11-04T01:37:14.300729+0000","last_fullsized":"2023-11-04T01:37:14.300729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:39.601375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.306415+0000","last_change":"2023-11-04T01:37:13.298838+0000","last_active":"2023-11-04T01:37:13.306415+0000","last_peered":"2023-11-04T01:37:13.306415+0000","last_clean":"2023-11-04T01:37:13.306415+0000","last_became_active":"2023-11-04T01:37:13.298027+0000","last_became_peered":"2023-11-04T01:37:13.298027+0000","last_unstale":"2023-11-04T01:37:13.306415+0000","last_undegraded":"2023-11-04T01:37:13.306415+0000","last_fullsized":"2023-11-04T01:37:13.306415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:38.785577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.312733+0000","last_change":"2023-11-04T01:37:12.300977+0000","last_active":"2023-11-04T01:37:13.312733+0000","last_peered":"2023-11-04T01:37:13.312733+0000","last_clean":"2023-11-04T01:37:13.312733+0000","last_became_active":"2023-11-04T01:37:12.300696+0000","last_became_peered":"2023-11-04T01:37:12.300696+0000","last_unstale":"2023-11-04T01:37:13.312733+0000","last_undegraded":"2023-11-04T01:37:13.312733+0000","last_fullsized":"2023-11-04T01:37:13.312733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:52.798428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297559+0000","last_change":"2023-11-04T01:37:13.290295+0000","last_active":"2023-11-04T01:37:14.297559+0000","last_peered":"2023-11-04T01:37:14.297559+0000","last_clean":"2023-11-04T01:37:14.297559+0000","last_became_active":"2023-11-04T01:37:13.290052+0000","last_became_peered":"2023-11-04T01:37:13.290052+0000","last_unstale":"2023-11-04T01:37:14.297559+0000","last_undegraded":"2023-11-04T01:37:14.297559+0000","last_fullsized":"2023-11-04T01:37:14.297559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:40.603346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.302099+0000","last_change":"2023-11-04T01:37:12.303601+0000","last_active":"2023-11-04T01:37:13.302099+0000","last_peered":"2023-11-04T01:37:13.302099+0000","last_clean":"2023-11-04T01:37:13.302099+0000","last_became_active":"2023-11-04T01:37:12.303284+0000","last_became_peered":"2023-11-04T01:37:12.303284+0000","last_unstale":"2023-11-04T01:37:13.302099+0000","last_undegraded":"2023-11-04T01:37:13.302099+0000","last_fullsized":"2023-11-04T01:37:13.302099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:39.601375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297077+0000","last_change":"2023-11-04T01:37:13.291154+0000","last_active":"2023-11-04T01:37:13.297077+0000","last_peered":"2023-11-04T01:37:13.297077+0000","last_clean":"2023-11-04T01:37:13.297077+0000","last_became_active":"2023-11-04T01:37:13.290862+0000","last_became_peered":"2023-11-04T01:37:13.290862+0000","last_unstale":"2023-11-04T01:37:13.297077+0000","last_undegraded":"2023-11-04T01:37:13.297077+0000","last_fullsized":"2023-11-04T01:37:13.297077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:18.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287279+0000","last_change":"2023-11-04T01:37:12.297651+0000","last_active":"2023-11-04T01:37:13.287279+0000","last_peered":"2023-11-04T01:37:13.287279+0000","last_clean":"2023-11-04T01:37:13.287279+0000","last_became_active":"2023-11-04T01:37:12.295616+0000","last_became_peered":"2023-11-04T01:37:12.295616+0000","last_unstale":"2023-11-04T01:37:13.287279+0000","last_undegraded":"2023-11-04T01:37:13.287279+0000","last_fullsized":"2023-11-04T01:37:13.287279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:06.023251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299991+0000","last_change":"2023-11-04T01:37:13.300393+0000","last_active":"2023-11-04T01:37:14.299991+0000","last_peered":"2023-11-04T01:37:14.299991+0000","last_clean":"2023-11-04T01:37:14.299991+0000","last_became_active":"2023-11-04T01:37:13.300122+0000","last_became_peered":"2023-11-04T01:37:13.300122+0000","last_unstale":"2023-11-04T01:37:14.299991+0000","last_undegraded":"2023-11-04T01:37:14.299991+0000","last_fullsized":"2023-11-04T01:37:14.299991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:39.038168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.291929+0000","last_change":"2023-11-04T01:37:12.296858+0000","last_active":"2023-11-04T01:37:13.291929+0000","last_peered":"2023-11-04T01:37:13.291929+0000","last_clean":"2023-11-04T01:37:13.291929+0000","last_became_active":"2023-11-04T01:37:12.296174+0000","last_became_peered":"2023-11-04T01:37:12.296174+0000","last_unstale":"2023-11-04T01:37:13.291929+0000","last_undegraded":"2023-11-04T01:37:13.291929+0000","last_fullsized":"2023-11-04T01:37:13.291929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:23.406027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.296688+0000","last_change":"2023-11-04T01:37:13.292147+0000","last_active":"2023-11-04T01:37:13.296688+0000","last_peered":"2023-11-04T01:37:13.296688+0000","last_clean":"2023-11-04T01:37:13.296688+0000","last_became_active":"2023-11-04T01:37:13.291908+0000","last_became_peered":"2023-11-04T01:37:13.291908+0000","last_unstale":"2023-11-04T01:37:13.296688+0000","last_undegraded":"2023-11-04T01:37:13.296688+0000","last_fullsized":"2023-11-04T01:37:13.296688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:07.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299337+0000","last_change":"2023-11-04T01:37:12.296218+0000","last_active":"2023-11-04T01:37:14.299337+0000","last_peered":"2023-11-04T01:37:14.299337+0000","last_clean":"2023-11-04T01:37:14.299337+0000","last_became_active":"2023-11-04T01:37:12.295950+0000","last_became_peered":"2023-11-04T01:37:12.295950+0000","last_unstale":"2023-11-04T01:37:14.299337+0000","last_undegraded":"2023-11-04T01:37:14.299337+0000","last_fullsized":"2023-11-04T01:37:14.299337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:17.353382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308198+0000","last_change":"2023-11-04T01:37:13.302535+0000","last_active":"2023-11-04T01:37:13.308198+0000","last_peered":"2023-11-04T01:37:13.308198+0000","last_clean":"2023-11-04T01:37:13.308198+0000","last_became_active":"2023-11-04T01:37:13.302260+0000","last_became_peered":"2023-11-04T01:37:13.302260+0000","last_unstale":"2023-11-04T01:37:13.308198+0000","last_undegraded":"2023-11-04T01:37:13.308198+0000","last_fullsized":"2023-11-04T01:37:13.308198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:18.991830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300608+0000","last_change":"2023-11-04T01:37:12.296069+0000","last_active":"2023-11-04T01:37:14.300608+0000","last_peered":"2023-11-04T01:37:14.300608+0000","last_clean":"2023-11-04T01:37:14.300608+0000","last_became_active":"2023-11-04T01:37:12.295807+0000","last_became_peered":"2023-11-04T01:37:12.295807+0000","last_unstale":"2023-11-04T01:37:14.300608+0000","last_undegraded":"2023-11-04T01:37:14.300608+0000","last_fullsized":"2023-11-04T01:37:14.300608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:52.798428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300644+0000","last_change":"2023-11-04T01:37:13.298532+0000","last_active":"2023-11-04T01:37:14.300644+0000","last_peered":"2023-11-04T01:37:14.300644+0000","last_clean":"2023-11-04T01:37:14.300644+0000","last_became_active":"2023-11-04T01:37:13.298167+0000","last_became_peered":"2023-11-04T01:37:13.298167+0000","last_unstale":"2023-11-04T01:37:14.300644+0000","last_undegraded":"2023-11-04T01:37:14.300644+0000","last_fullsized":"2023-11-04T01:37:14.300644+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:00:52.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.307606+0000","last_change":"2023-11-04T01:37:12.298239+0000","last_active":"2023-11-04T01:37:13.307606+0000","last_peered":"2023-11-04T01:37:13.307606+0000","last_clean":"2023-11-04T01:37:13.307606+0000","last_became_active":"2023-11-04T01:37:12.297961+0000","last_became_peered":"2023-11-04T01:37:12.297961+0000","last_unstale":"2023-11-04T01:37:13.307606+0000","last_undegraded":"2023-11-04T01:37:13.307606+0000","last_fullsized":"2023-11-04T01:37:13.307606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:44.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.297786+0000","last_change":"2023-11-04T01:37:13.292987+0000","last_active":"2023-11-04T01:37:13.297786+0000","last_peered":"2023-11-04T01:37:13.297786+0000","last_clean":"2023-11-04T01:37:13.297786+0000","last_became_active":"2023-11-04T01:37:13.292701+0000","last_became_peered":"2023-11-04T01:37:13.292701+0000","last_unstale":"2023-11-04T01:37:13.297786+0000","last_undegraded":"2023-11-04T01:37:13.297786+0000","last_fullsized":"2023-11-04T01:37:13.297786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:19.573103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.309672+0000","last_change":"2023-11-04T01:37:12.299087+0000","last_active":"2023-11-04T01:37:13.309672+0000","last_peered":"2023-11-04T01:37:13.309672+0000","last_clean":"2023-11-04T01:37:13.309672+0000","last_became_active":"2023-11-04T01:37:12.298838+0000","last_became_peered":"2023-11-04T01:37:12.298838+0000","last_unstale":"2023-11-04T01:37:13.309672+0000","last_undegraded":"2023-11-04T01:37:13.309672+0000","last_fullsized":"2023-11-04T01:37:13.309672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:05.439830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.305433+0000","last_change":"2023-11-04T01:37:13.298900+0000","last_active":"2023-11-04T01:37:13.305433+0000","last_peered":"2023-11-04T01:37:13.305433+0000","last_clean":"2023-11-04T01:37:13.305433+0000","last_became_active":"2023-11-04T01:37:13.298587+0000","last_became_peered":"2023-11-04T01:37:13.298587+0000","last_unstale":"2023-11-04T01:37:13.305433+0000","last_undegraded":"2023-11-04T01:37:13.305433+0000","last_fullsized":"2023-11-04T01:37:13.305433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:54.381668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.286610+0000","last_change":"2023-11-04T01:37:12.297645+0000","last_active":"2023-11-04T01:37:13.286610+0000","last_peered":"2023-11-04T01:37:13.286610+0000","last_clean":"2023-11-04T01:37:13.286610+0000","last_became_active":"2023-11-04T01:37:12.297384+0000","last_became_peered":"2023-11-04T01:37:12.297384+0000","last_unstale":"2023-11-04T01:37:13.286610+0000","last_undegraded":"2023-11-04T01:37:13.286610+0000","last_fullsized":"2023-11-04T01:37:13.286610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:00.331948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299472+0000","last_change":"2023-11-04T01:37:13.302783+0000","last_active":"2023-11-04T01:37:14.299472+0000","last_peered":"2023-11-04T01:37:14.299472+0000","last_clean":"2023-11-04T01:37:14.299472+0000","last_became_active":"2023-11-04T01:37:13.302529+0000","last_became_peered":"2023-11-04T01:37:13.302529+0000","last_unstale":"2023-11-04T01:37:14.299472+0000","last_undegraded":"2023-11-04T01:37:14.299472+0000","last_fullsized":"2023-11-04T01:37:14.299472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.301734+0000","last_change":"2023-11-04T01:37:12.293889+0000","last_active":"2023-11-04T01:37:13.301734+0000","last_peered":"2023-11-04T01:37:13.301734+0000","last_clean":"2023-11-04T01:37:13.301734+0000","last_became_active":"2023-11-04T01:37:12.293603+0000","last_became_peered":"2023-11-04T01:37:12.293603+0000","last_unstale":"2023-11-04T01:37:13.301734+0000","last_undegraded":"2023-11-04T01:37:13.301734+0000","last_fullsized":"2023-11-04T01:37:13.301734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:08.726556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297193+0000","last_change":"2023-11-04T01:37:13.290738+0000","last_active":"2023-11-04T01:37:14.297193+0000","last_peered":"2023-11-04T01:37:14.297193+0000","last_clean":"2023-11-04T01:37:14.297193+0000","last_became_active":"2023-11-04T01:37:13.290466+0000","last_became_peered":"2023-11-04T01:37:13.290466+0000","last_unstale":"2023-11-04T01:37:14.297193+0000","last_undegraded":"2023-11-04T01:37:14.297193+0000","last_fullsized":"2023-11-04T01:37:14.297193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:48:18.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.280779+0000","last_change":"2023-11-04T01:37:12.296131+0000","last_active":"2023-11-04T01:37:13.280779+0000","last_peered":"2023-11-04T01:37:13.280779+0000","last_clean":"2023-11-04T01:37:13.280779+0000","last_became_active":"2023-11-04T01:37:12.295870+0000","last_became_peered":"2023-11-04T01:37:12.295870+0000","last_unstale":"2023-11-04T01:37:13.280779+0000","last_undegraded":"2023-11-04T01:37:13.280779+0000","last_fullsized":"2023-11-04T01:37:13.280779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:39.509162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299275+0000","last_change":"2023-11-04T01:37:13.306369+0000","last_active":"2023-11-04T01:37:14.299275+0000","last_peered":"2023-11-04T01:37:14.299275+0000","last_clean":"2023-11-04T01:37:14.299275+0000","last_became_active":"2023-11-04T01:37:13.306090+0000","last_became_peered":"2023-11-04T01:37:13.306090+0000","last_unstale":"2023-11-04T01:37:14.299275+0000","last_undegraded":"2023-11-04T01:37:14.299275+0000","last_fullsized":"2023-11-04T01:37:14.299275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:39.038168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299659+0000","last_change":"2023-11-04T01:37:12.297010+0000","last_active":"2023-11-04T01:37:14.299659+0000","last_peered":"2023-11-04T01:37:14.299659+0000","last_clean":"2023-11-04T01:37:14.299659+0000","last_became_active":"2023-11-04T01:37:12.296757+0000","last_became_peered":"2023-11-04T01:37:12.296757+0000","last_unstale":"2023-11-04T01:37:14.299659+0000","last_undegraded":"2023-11-04T01:37:14.299659+0000","last_fullsized":"2023-11-04T01:37:14.299659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:24.785741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308166+0000","last_change":"2023-11-04T01:37:13.302251+0000","last_active":"2023-11-04T01:37:13.308166+0000","last_peered":"2023-11-04T01:37:13.308166+0000","last_clean":"2023-11-04T01:37:13.308166+0000","last_became_active":"2023-11-04T01:37:13.301263+0000","last_became_peered":"2023-11-04T01:37:13.301263+0000","last_unstale":"2023-11-04T01:37:13.308166+0000","last_undegraded":"2023-11-04T01:37:13.308166+0000","last_fullsized":"2023-11-04T01:37:13.308166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:17.729233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.281112+0000","last_change":"2023-11-04T01:37:12.296958+0000","last_active":"2023-11-04T01:37:13.281112+0000","last_peered":"2023-11-04T01:37:13.281112+0000","last_clean":"2023-11-04T01:37:13.281112+0000","last_became_active":"2023-11-04T01:37:12.296712+0000","last_became_peered":"2023-11-04T01:37:12.296712+0000","last_unstale":"2023-11-04T01:37:13.281112+0000","last_undegraded":"2023-11-04T01:37:13.281112+0000","last_fullsized":"2023-11-04T01:37:13.281112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:50.863791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308396+0000","last_change":"2023-11-04T01:37:13.300767+0000","last_active":"2023-11-04T01:37:13.308396+0000","last_peered":"2023-11-04T01:37:13.308396+0000","last_clean":"2023-11-04T01:37:13.308396+0000","last_became_active":"2023-11-04T01:37:13.300540+0000","last_became_peered":"2023-11-04T01:37:13.300540+0000","last_unstale":"2023-11-04T01:37:13.308396+0000","last_undegraded":"2023-11-04T01:37:13.308396+0000","last_fullsized":"2023-11-04T01:37:13.308396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:08.131629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300728+0000","last_change":"2023-11-04T01:37:12.301326+0000","last_active":"2023-11-04T01:37:14.300728+0000","last_peered":"2023-11-04T01:37:14.300728+0000","last_clean":"2023-11-04T01:37:14.300728+0000","last_became_active":"2023-11-04T01:37:12.300920+0000","last_became_peered":"2023-11-04T01:37:12.300920+0000","last_unstale":"2023-11-04T01:37:14.300728+0000","last_undegraded":"2023-11-04T01:37:14.300728+0000","last_fullsized":"2023-11-04T01:37:14.300728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:14.813388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299605+0000","last_change":"2023-11-04T01:37:13.301092+0000","last_active":"2023-11-04T01:37:14.299605+0000","last_peered":"2023-11-04T01:37:14.299605+0000","last_clean":"2023-11-04T01:37:14.299605+0000","last_became_active":"2023-11-04T01:37:13.300512+0000","last_became_peered":"2023-11-04T01:37:13.300512+0000","last_unstale":"2023-11-04T01:37:14.299605+0000","last_undegraded":"2023-11-04T01:37:14.299605+0000","last_fullsized":"2023-11-04T01:37:14.299605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:26.109602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.281150+0000","last_change":"2023-11-04T01:37:12.297592+0000","last_active":"2023-11-04T01:37:13.281150+0000","last_peered":"2023-11-04T01:37:13.281150+0000","last_clean":"2023-11-04T01:37:13.281150+0000","last_became_active":"2023-11-04T01:37:12.297263+0000","last_became_peered":"2023-11-04T01:37:12.297263+0000","last_unstale":"2023-11-04T01:37:13.281150+0000","last_undegraded":"2023-11-04T01:37:13.281150+0000","last_fullsized":"2023-11-04T01:37:13.281150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:51.407310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.296659+0000","last_change":"2023-11-04T01:37:13.293347+0000","last_active":"2023-11-04T01:37:13.296659+0000","last_peered":"2023-11-04T01:37:13.296659+0000","last_clean":"2023-11-04T01:37:13.296659+0000","last_became_active":"2023-11-04T01:37:13.293081+0000","last_became_peered":"2023-11-04T01:37:13.293081+0000","last_unstale":"2023-11-04T01:37:13.296659+0000","last_undegraded":"2023-11-04T01:37:13.296659+0000","last_fullsized":"2023-11-04T01:37:13.296659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:49.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297375+0000","last_change":"2023-11-04T01:37:12.296983+0000","last_active":"2023-11-04T01:37:14.297375+0000","last_peered":"2023-11-04T01:37:14.297375+0000","last_clean":"2023-11-04T01:37:14.297375+0000","last_became_active":"2023-11-04T01:37:12.296557+0000","last_became_peered":"2023-11-04T01:37:12.296557+0000","last_unstale":"2023-11-04T01:37:14.297375+0000","last_undegraded":"2023-11-04T01:37:14.297375+0000","last_fullsized":"2023-11-04T01:37:14.297375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.783606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297520+0000","last_change":"2023-11-04T01:37:13.289771+0000","last_active":"2023-11-04T01:37:14.297520+0000","last_peered":"2023-11-04T01:37:14.297520+0000","last_clean":"2023-11-04T01:37:14.297520+0000","last_became_active":"2023-11-04T01:37:13.289473+0000","last_became_peered":"2023-11-04T01:37:13.289473+0000","last_unstale":"2023-11-04T01:37:14.297520+0000","last_undegraded":"2023-11-04T01:37:14.297520+0000","last_fullsized":"2023-11-04T01:37:14.297520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:13.162144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.297483+0000","last_change":"2023-11-04T01:37:12.291344+0000","last_active":"2023-11-04T01:37:14.297483+0000","last_peered":"2023-11-04T01:37:14.297483+0000","last_clean":"2023-11-04T01:37:14.297483+0000","last_became_active":"2023-11-04T01:37:12.291084+0000","last_became_peered":"2023-11-04T01:37:12.291084+0000","last_unstale":"2023-11-04T01:37:14.297483+0000","last_undegraded":"2023-11-04T01:37:14.297483+0000","last_fullsized":"2023-11-04T01:37:14.297483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:07.129658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.308414+0000","last_change":"2023-11-04T01:37:13.304143+0000","last_active":"2023-11-04T01:37:13.308414+0000","last_peered":"2023-11-04T01:37:13.308414+0000","last_clean":"2023-11-04T01:37:13.308414+0000","last_became_active":"2023-11-04T01:37:13.303867+0000","last_became_peered":"2023-11-04T01:37:13.303867+0000","last_unstale":"2023-11-04T01:37:13.308414+0000","last_undegraded":"2023-11-04T01:37:13.308414+0000","last_fullsized":"2023-11-04T01:37:13.308414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:58.889626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.292250+0000","last_change":"2023-11-04T01:37:12.294377+0000","last_active":"2023-11-04T01:37:13.292250+0000","last_peered":"2023-11-04T01:37:13.292250+0000","last_clean":"2023-11-04T01:37:13.292250+0000","last_became_active":"2023-11-04T01:37:12.294095+0000","last_became_peered":"2023-11-04T01:37:12.294095+0000","last_unstale":"2023-11-04T01:37:13.292250+0000","last_undegraded":"2023-11-04T01:37:13.292250+0000","last_fullsized":"2023-11-04T01:37:13.292250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:19:57.887656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.292482+0000","last_change":"2023-11-04T01:37:13.290704+0000","last_active":"2023-11-04T01:37:13.292482+0000","last_peered":"2023-11-04T01:37:13.292482+0000","last_clean":"2023-11-04T01:37:13.292482+0000","last_became_active":"2023-11-04T01:37:13.290413+0000","last_became_peered":"2023-11-04T01:37:13.290413+0000","last_unstale":"2023-11-04T01:37:13.292482+0000","last_undegraded":"2023-11-04T01:37:13.292482+0000","last_fullsized":"2023-11-04T01:37:13.292482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:16.977382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.288566+0000","last_change":"2023-11-04T01:37:12.296920+0000","last_active":"2023-11-04T01:37:13.288566+0000","last_peered":"2023-11-04T01:37:13.288566+0000","last_clean":"2023-11-04T01:37:13.288566+0000","last_became_active":"2023-11-04T01:37:12.296644+0000","last_became_peered":"2023-11-04T01:37:12.296644+0000","last_unstale":"2023-11-04T01:37:13.288566+0000","last_undegraded":"2023-11-04T01:37:13.288566+0000","last_fullsized":"2023-11-04T01:37:13.288566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:06.023251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300329+0000","last_change":"2023-11-04T01:37:13.304628+0000","last_active":"2023-11-04T01:37:14.300329+0000","last_peered":"2023-11-04T01:37:14.300329+0000","last_clean":"2023-11-04T01:37:14.300329+0000","last_became_active":"2023-11-04T01:37:13.303761+0000","last_became_peered":"2023-11-04T01:37:13.303761+0000","last_unstale":"2023-11-04T01:37:14.300329+0000","last_undegraded":"2023-11-04T01:37:14.300329+0000","last_fullsized":"2023-11-04T01:37:14.300329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:22.345590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.285084+0000","last_change":"2023-11-04T01:37:12.300901+0000","last_active":"2023-11-04T01:37:13.285084+0000","last_peered":"2023-11-04T01:37:13.285084+0000","last_clean":"2023-11-04T01:37:13.285084+0000","last_became_active":"2023-11-04T01:37:12.300652+0000","last_became_peered":"2023-11-04T01:37:12.300652+0000","last_unstale":"2023-11-04T01:37:13.285084+0000","last_undegraded":"2023-11-04T01:37:13.285084+0000","last_fullsized":"2023-11-04T01:37:13.285084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:24.785741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.300465+0000","last_change":"2023-11-04T01:37:13.296319+0000","last_active":"2023-11-04T01:37:14.300465+0000","last_peered":"2023-11-04T01:37:14.300465+0000","last_clean":"2023-11-04T01:37:14.300465+0000","last_became_active":"2023-11-04T01:37:13.296107+0000","last_became_peered":"2023-11-04T01:37:13.296107+0000","last_unstale":"2023-11-04T01:37:14.300465+0000","last_undegraded":"2023-11-04T01:37:14.300465+0000","last_fullsized":"2023-11-04T01:37:14.300465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:12.271467+0000","last_clean_scrub_stamp":"2023-11-04T01:37:12.271467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:14.083324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:14.299821+0000","last_change":"2023-11-04T01:37:12.299132+0000","last_active":"2023-11-04T01:37:14.299821+0000","last_peered":"2023-11-04T01:37:14.299821+0000","last_clean":"2023-11-04T01:37:14.299821+0000","last_became_active":"2023-11-04T01:37:12.298857+0000","last_became_peered":"2023-11-04T01:37:12.298857+0000","last_unstale":"2023-11-04T01:37:14.299821+0000","last_undegraded":"2023-11-04T01:37:14.299821+0000","last_fullsized":"2023-11-04T01:37:14.299821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:11.269497+0000","last_clean_scrub_stamp":"2023-11-04T01:37:11.269497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:48.056279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:13.287022+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:13.287022+0000","last_peered":"2023-11-04T01:37:13.287022+0000","last_clean":"2023-11-04T01:37:13.287022+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:13.287022+0000","last_undegraded":"2023-11-04T01:37:13.287022+0000","last_fullsized":"2023-11-04T01:37:13.287022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":780542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.752},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.498}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":181435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.372}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":181984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.628}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":182476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.625}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.22900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.249},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.216}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.247}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.29399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.36799999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.35299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.38300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":771255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.23899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.27900000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.29299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:16.571 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:37:16.572 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:37:16.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.710+0000 7f0c207b6640 1 Processor -- start 2023-11-04T01:37:16.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.710+0000 7f0c207b6640 1 -- start start 2023-11-04T01:37:16.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c207b6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c18159c00 0x7f0c180cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c207b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c180ae1d0 0x7f0c180c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c207b6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1815aff0 con 0x7f0c180c48e0 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c207b6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180c52d0 con 0x7f0c18159c00 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c207b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1815a3e0 con 0x7f0c180ae1d0 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c1e552640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c18159c00 0x7f0c180cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c1e552640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c18159c00 0x7f0c180cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44808/0 (socket says 172.21.15.93:44808) 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c1dd51640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0c180c48e0 0x7f0c180adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47228/0 (socket says 172.21.15.93:47228) 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.711+0000 7f0c1e552640 1 -- 172.21.15.93:0/1121005221 learned_addr learned my addr 172.21.15.93:0/1121005221 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1ed53640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c180ae1d0 0x7f0c180c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1e552640 1 -- 172.21.15.93:0/1121005221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c180ae1d0 msgr2=0x7f0c180c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1e552640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c180ae1d0 0x7f0c180c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1e552640 1 -- 172.21.15.93:0/1121005221 >> v1:172.21.15.93:6789/0 conn(0x7f0c180c48e0 legacy=0x7f0c180adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1d550640 1 -- 172.21.15.93:0/1121005221 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697191522 0 0) 0x7f0c1815aff0 con 0x7f0c180c48e0 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1e552640 1 -- 172.21.15.93:0/1121005221 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1815a6c0 con 0x7f0c18159c00 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1e552640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c18159c00 0x7f0c180cc890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009e50 tx=0x7f0c1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe558a1f4a8e3f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1d550640 1 -- 172.21.15.93:0/1121005221 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1402ca70 con 0x7f0c18159c00 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1d550640 1 -- 172.21.15.93:0/1121005221 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1402cbd0 con 0x7f0c18159c00 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.712+0000 7f0c1d550640 1 -- 172.21.15.93:0/1121005221 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140343f0 con 0x7f0c18159c00 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 -- 172.21.15.93:0/1121005221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c18159c00 msgr2=0x7f0c180cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c18159c00 0x7f0c180cc890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009e50 tx=0x7f0c1402bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 -- 172.21.15.93:0/1121005221 shutdown_connections 2023-11-04T01:37:16.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c180ae1d0 0x7f0c180c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1121005221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c18159c00 0x7f0c180cc890 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 -- 172.21.15.93:0/1121005221 >> 172.21.15.93:0/1121005221 conn(0x7f0c180ce950 msgr2=0x7f0c180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 -- 172.21.15.93:0/1121005221 shutdown_connections 2023-11-04T01:37:16.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.713+0000 7f0c207b6640 1 -- 172.21.15.93:0/1121005221 wait complete. 2023-11-04T01:37:16.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.714+0000 7f0c207b6640 1 Processor -- start 2023-11-04T01:37:16.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.714+0000 7f0c207b6640 1 -- start start 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c180ae1d0 0x7f0c181e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c18159c00 0x7f0c1806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c181e7480 con 0x7f0c180c48e0 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c6560 con 0x7f0c180ae1d0 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c207b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c6840 con 0x7f0c18159c00 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44814/0 (socket says 172.21.15.93:44814) 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 -- 172.21.15.93:0/1995449249 learned_addr learned my addr 172.21.15.93:0/1995449249 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 -- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c18159c00 msgr2=0x7f0c1806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c18159c00 0x7f0c1806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 -- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c180ae1d0 msgr2=0x7f0c181e6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c180ae1d0 0x7f0c181e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 -- 172.21.15.93:0/1995449249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14009b30 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.715+0000 7f0c1dd51640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c4d0 tx=0x7f0c0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.716+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080074e0 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.716+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08007660 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.716+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180c6b20 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.716+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08004a20 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.716+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180c70e0 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.717+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180c7300 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.717+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c08004b80 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.717+0000 7f0c0effd640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 0x7f0bfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.717+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c08088850 con 0x7f0c180c48e0 2023-11-04T01:37:16.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.718+0000 7f0c1e552640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 0x7f0bfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.718+0000 7f0c1e552640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 0x7f0bfc06d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c14035000 tx=0x7f0c1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.722+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c08053850 con 0x7f0c180c48e0 2023-11-04T01:37:16.751 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:37:16.748+0000 7f4e2a443640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:16.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.950+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0c18074290 con 0x7f0c180c48e0 2023-11-04T01:37:16.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.952+0000 7f0c0effd640 1 -- 172.21.15.93:0/1995449249 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0c08018020 con 0x7f0c180c48e0 2023-11-04T01:37:16.954 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:37:16.955 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:37:16.955 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow" 2023-11-04T01:37:16.955 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow r" 2023-11-04T01:37:16.955 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:16.955 INFO:teuthology.orchestra.run.smithi093.stderr:updated caps for client.0 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 msgr2=0x7f0bfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 0x7f0bfc06d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c14035000 tx=0x7f0c1402e000 comp rx=0 tx=0).stop 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 msgr2=0x7f0c1806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c4d0 tx=0x7f0c0800c990 comp rx=0 tx=0).stop 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 shutdown_connections 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0bfc06ae70 0x7f0bfc06d330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c18159c00 0x7f0c1806ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c180c48e0 0x7f0c1806d890 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 --2- 172.21.15.93:0/1995449249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c180ae1d0 0x7f0c181e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 >> 172.21.15.93:0/1995449249 conn(0x7f0c180ce950 msgr2=0x7f0c180b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 shutdown_connections 2023-11-04T01:37:16.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:16.955+0000 7f0c207b6640 1 -- 172.21.15.93:0/1995449249 wait complete. 2023-11-04T01:37:16.967 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:17.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.065+0000 7f535581f640 1 Processor -- start 2023-11-04T01:37:17.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.065+0000 7f535581f640 1 -- start start 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f535581f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5350070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f535581f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53500cde40 0x7f5350070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f535581f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cc990 con 0x7f53500cda60 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f535581f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500ccc70 con 0x7f53500cde40 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f535581f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c9ce0 con 0x7f53500b0cd0 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f53500cda60 0x7f53500ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47240/0 (socket says 172.21.15.93:47240) 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534effd640 1 -- 172.21.15.93:0/1702622842 learned_addr learned my addr 172.21.15.93:0/1702622842 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387898141 0 0) 0x7f53500cc990 con 0x7f53500cda60 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534f7fe640 1 --2- 172.21.15.93:0/1702622842 >> v2:172.21.15.125:3300/0 conn(0x7f53500cde40 0x7f5350070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534e7fc640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5350070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003520 con 0x7f53500cda60 2023-11-04T01:37:17.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564810229 0 0) 0x7f5338003520 con 0x7f53500cda60 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 msgr2=0x7f5350070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5350070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 >> v2:172.21.15.125:3300/0 conn(0x7f53500cde40 msgr2=0x7f5350070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 --2- 172.21.15.93:0/1702622842 >> v2:172.21.15.125:3300/0 conn(0x7f53500cde40 0x7f5350070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500c9fc0 con 0x7f53500cda60 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5340001670 con 0x7f53500cda60 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 >> v1:172.21.15.93:6789/0 conn(0x7f53500cda60 legacy=0x7f53500ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5338003970 0x7f5338003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f5338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500ccc70 con 0x7f53380047c0 2023-11-04T01:37:17.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c9ce0 con 0x7f5338003970 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533800ca90 con 0x7f53500b0cd0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.066+0000 7f534e7fc640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f5338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534effd640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5338003970 0x7f5338003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534f7fe640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 -- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 msgr2=0x7f5338005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53500b0cd0 0x7f5338005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 -- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5338003970 msgr2=0x7f5338003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5338003970 0x7f5338003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 -- 172.21.15.93:0/1702622842 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338003520 con 0x7f53380047c0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534effd640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5338003970 0x7f5338003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534e7fc640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f5338004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5344009ac0 tx=0x7f53380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c64fa44e143d15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.067+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534402c6b0 con 0x7f53380047c0 2023-11-04T01:37:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534402c810 con 0x7f53380047c0 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f534dffb640 1 -- 172.21.15.93:0/1702622842 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534402cba0 con 0x7f53380047c0 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 -- 172.21.15.93:0/1702622842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 msgr2=0x7f5338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 --2- 172.21.15.93:0/1702622842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f5338004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5344009ac0 tx=0x7f53380057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f534f7fe640 1 -- 172.21.15.93:0/1702622842 reap_dead start 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 -- 172.21.15.93:0/1702622842 shutdown_connections 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 -- 172.21.15.93:0/1702622842 >> 172.21.15.93:0/1702622842 conn(0x7f53500ce950 msgr2=0x7f53500ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 -- 172.21.15.93:0/1702622842 shutdown_connections 2023-11-04T01:37:17.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.068+0000 7f535581f640 1 -- 172.21.15.93:0/1702622842 wait complete. 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.069+0000 7f535581f640 1 Processor -- start 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.069+0000 7f535581f640 1 -- start start 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53501f67d0 0x7f535014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f535015a3b0 0x7f53501f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500abe20 con 0x7f53380047c0 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535015ace0 con 0x7f53501f67d0 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f535581f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c3060 con 0x7f535015a3b0 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44834/0 (socket says 172.21.15.93:44834) 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 -- 172.21.15.93:0/3376705905 learned_addr learned my addr 172.21.15.93:0/3376705905 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 -- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f535015a3b0 msgr2=0x7f53501f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f535015a3b0 0x7f53501f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 -- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53501f67d0 msgr2=0x7f535014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53501f67d0 0x7f535014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.070+0000 7f534effd640 1 -- 172.21.15.93:0/3376705905 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500c3340 con 0x7f53380047c0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f534effd640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f534000e730 tx=0x7f534000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000ee40 con 0x7f53380047c0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000c8d0 con 0x7f53380047c0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500c3620 con 0x7f53380047c0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000cc60 con 0x7f53380047c0 2023-11-04T01:37:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.071+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535015a830 con 0x7f53380047c0 2023-11-04T01:37:17.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.072+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53500c2ec0 con 0x7f53380047c0 2023-11-04T01:37:17.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.072+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f534001d460 con 0x7f53380047c0 2023-11-04T01:37:17.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.072+0000 7f5337fff640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 0x7f533c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.072+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5340089700 con 0x7f53380047c0 2023-11-04T01:37:17.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.073+0000 7f534e7fc640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 0x7f533c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.073+0000 7f534e7fc640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 0x7f533c06d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5344036000 tx=0x7f534402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.077+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53500c2ec0 con 0x7f53380047c0 2023-11-04T01:37:17.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.275+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53500cc470 con 0x7f53380047c0 2023-11-04T01:37:17.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.275+0000 7f5337fff640 1 -- 172.21.15.93:0/3376705905 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f53500cc470 con 0x7f53380047c0 2023-11-04T01:37:17.278 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:17.278 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:17.278 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:17.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 msgr2=0x7f533c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 0x7f533c06d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5344036000 tx=0x7f534402e000 comp rx=0 tx=0).stop 2023-11-04T01:37:17.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 msgr2=0x7f53500ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f534000e730 tx=0x7f534000ebf0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 shutdown_connections 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f533c06aea0 0x7f533c06d360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f535015a3b0 0x7f53501f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53501f67d0 0x7f535014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 --2- 172.21.15.93:0/3376705905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53380047c0 0x7f53500ab8e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 >> 172.21.15.93:0/3376705905 conn(0x7f53500ce950 msgr2=0x7f5350158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 shutdown_connections 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.277+0000 7f535581f640 1 -- 172.21.15.93:0/3376705905 wait complete. 2023-11-04T01:37:17.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:37:12.619808+0000', 'modified': '2023-11-04T01:37:14.621855+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5562}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5562': {'gid': 5562, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6837/3895579334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6835', 'nonce': 3895579334}, {'type': 'v1', 'addr': '172.21.15.93:6837', 'nonce': 3895579334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:37:17.693 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:37:17.694 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:37:17.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.794+0000 7fa096eec640 1 Processor -- start 2023-11-04T01:37:17.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.794+0000 7fa096eec640 1 -- start start 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa096eec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa090159c00 0x7fa0900cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa096eec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa0900ae1d0 0x7fa0900c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa096eec640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09015aff0 con 0x7fa0900c48e0 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa096eec640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0900c52a0 con 0x7fa0900ae1d0 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa096eec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09015a3e0 con 0x7fa090159c00 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa0900ae1d0 0x7fa0900c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa0900ae1d0 0x7fa0900c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44850/0 (socket says 172.21.15.93:44850) 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 -- 172.21.15.93:0/895947297 learned_addr learned my addr 172.21.15.93:0/895947297 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa094c88640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa090159c00 0x7fa0900cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 -- 172.21.15.93:0/895947297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa090159c00 msgr2=0x7fa0900cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa090159c00 0x7fa0900cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 -- 172.21.15.93:0/895947297 >> v1:172.21.15.125:6789/0 conn(0x7fa0900c48e0 legacy=0x7fa0900adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.795+0000 7fa095489640 1 -- 172.21.15.93:0/895947297 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09015a6c0 con 0x7fa0900ae1d0 2023-11-04T01:37:17.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.796+0000 7fa095489640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0900ae1d0 0x7fa0900c4d60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b3fd20f890cb6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.796+0000 7fa08f7fe640 1 -- 172.21.15.93:0/895947297 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08802ca70 con 0x7fa0900ae1d0 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.796+0000 7fa08f7fe640 1 -- 172.21.15.93:0/895947297 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08802cbd0 con 0x7fa0900ae1d0 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.796+0000 7fa08f7fe640 1 -- 172.21.15.93:0/895947297 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880343f0 con 0x7fa0900ae1d0 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 -- 172.21.15.93:0/895947297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0900ae1d0 msgr2=0x7fa0900c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0900ae1d0 0x7fa0900c4d60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa08802bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 -- 172.21.15.93:0/895947297 shutdown_connections 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0900ae1d0 0x7fa0900c4d60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 --2- 172.21.15.93:0/895947297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa090159c00 0x7fa0900cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 -- 172.21.15.93:0/895947297 >> 172.21.15.93:0/895947297 conn(0x7fa0900ce950 msgr2=0x7fa0900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 -- 172.21.15.93:0/895947297 shutdown_connections 2023-11-04T01:37:17.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.797+0000 7fa096eec640 1 -- 172.21.15.93:0/895947297 wait complete. 2023-11-04T01:37:17.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.798+0000 7fa096eec640 1 Processor -- start 2023-11-04T01:37:17.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.798+0000 7fa096eec640 1 -- start start 2023-11-04T01:37:17.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 0x7fa090152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0900c48e0 0x7fa090158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901e4630 con 0x7fa090159c00 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901e4910 con 0x7fa0900ae1d0 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901e4bf0 con 0x7fa0900c48e0 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44862/0 (socket says 172.21.15.93:44862) 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 -- 172.21.15.93:0/3094480168 learned_addr learned my addr 172.21.15.93:0/3094480168 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 -- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0900c48e0 msgr2=0x7fa090158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0900c48e0 0x7fa090158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa094c88640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 0x7fa090152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 -- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 msgr2=0x7fa090152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 0x7fa090152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 -- 172.21.15.93:0/3094480168 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088009b30 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa094c88640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 0x7fa090152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa095489640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa08d7fa640 1 -- 172.21.15.93:0/3094480168 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088009510 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa08d7fa640 1 -- 172.21.15.93:0/3094480168 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08803e450 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0901e4ed0 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa08d7fa640 1 -- 172.21.15.93:0/3094480168 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08803e800 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.799+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0901e42c0 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.801+0000 7fa08d7fa640 1 -- 172.21.15.93:0/3094480168 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa08803e960 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa08d7fa640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 0x7fa07406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa08d7fa640 1 -- 172.21.15.93:0/3094480168 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa0880ac610 con 0x7fa090159c00 2023-11-04T01:37:17.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa094c88640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 0x7fa07406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa094c88640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 0x7fa07406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa084008890 tx=0x7fa084008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa099a81740 1 Processor -- start 2023-11-04T01:37:17.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.802+0000 7fa099a81740 1 -- start start 2023-11-04T01:37:17.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf6c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 0x55daecf9cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daece7d740 con 0x55daecf99c30 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daecedf8d0 con 0x55daecf99850 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daecedcfc0 con 0x55daecf6cc90 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44878/0 (socket says 172.21.15.93:44878) 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa08ffff640 1 -- 172.21.15.93:0/1990739143 learned_addr learned my addr 172.21.15.93:0/1990739143 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa094c88640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf6c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa095489640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 0x55daecf9cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.803+0000 7fa08ffff640 1 -- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 msgr2=0x55daecf9cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa08ffff640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 0x55daecf9cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa08ffff640 1 -- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 msgr2=0x55daecf6c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa08ffff640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf6c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa08ffff640 1 -- 172.21.15.93:0/1990739143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daece9bca0 con 0x55daecf99c30 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa094c88640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf6c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa095489640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 0x55daecf9cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa08ffff640 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009740 tx=0x7fa07c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c2b8feb8f7637e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa07a7fc640 1 -- 172.21.15.93:0/1990739143 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c009e50 con 0x55daecf99c30 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa07a7fc640 1 -- 172.21.15.93:0/1990739143 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c004020 con 0x55daecf99c30 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa07a7fc640 1 -- 172.21.15.93:0/1990739143 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0043d0 con 0x55daecf99c30 2023-11-04T01:37:17.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 -- 172.21.15.93:0/1990739143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 msgr2=0x55daecf9c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009740 tx=0x7fa07c009c00 comp rx=0 tx=0).stop 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 -- 172.21.15.93:0/1990739143 shutdown_connections 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf6cc90 0x55daecf9cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecf9c5e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 --2- 172.21.15.93:0/1990739143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf6c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 -- 172.21.15.93:0/1990739143 >> 172.21.15.93:0/1990739143 conn(0x55daecf6ea60 msgr2=0x55daecfb75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 -- 172.21.15.93:0/1990739143 shutdown_connections 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.804+0000 7fa099a81740 1 -- 172.21.15.93:0/1990739143 wait complete. 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.805+0000 7fa099a81740 1 -- start start 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.805+0000 7fa099a81740 1 Processor -- start 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 0x55daecfb7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfb3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daeced88b0 con 0x55daecf99850 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daece92c80 con 0x55daecf99c30 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daece92920 con 0x55daecfb7d90 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa099a81740 10 client.0 _ll_register_callbacks cb 0x55daecbeaac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44884/0 (socket says 172.21.15.93:44884) 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 -- 172.21.15.93:0/469653594 learned_addr learned my addr 172.21.15.93:0/469653594 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa08ffff640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 0x55daecfb7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa095489640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfb3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 -- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 msgr2=0x55daecfb3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfb3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 -- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 msgr2=0x55daecfb7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 0x55daecfb7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa094c88640 1 -- 172.21.15.93:0/469653594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c009370 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.806+0000 7fa08ffff640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 0x55daecfb7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa094c88640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0840126f0 tx=0x7fa084004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63fa287be935b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400b050 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa084012e20 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daece84bf0 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa084013800 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 10 client.5751 fetch_fsmap learned FSMap version 16 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55daeced6f30 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daece84bf0 con 0x55daecf99850 2023-11-04T01:37:17.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa084013960 con 0x55daecf99850 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 10 client.5751 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 10 client.5751 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 20 client.5751 populate_metadata read hostname 'smithi093' 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daecfca9b0 0x55daecfcad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 4 client.5751 mds_command: new command op to 5562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 --> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daeced1890 con 0x55daecfca9b0 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.807+0000 7fa08ffff640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daecfca9b0 0x55daecfcad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa06f7fe640 10 client.5751 ms_handle_connect on v2:172.21.15.93:6835/3895579334 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa08ffff640 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daecfca9b0 0x55daecfcad90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437fbb8c5fe6264d server_cookie=53c33dc31f0bffe2 in_seq=0 out_seq=0 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa06f7fe640 1 -- 172.21.15.93:0/469653594 <== mds.0 v2:172.21.15.93:6835/3895579334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55daeced1890 con 0x55daecfca9b0 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa06f7fe640 10 client.5751 handle_command_reply: tid=0 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 client.5751 shutdown 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 msgr2=0x55daecfb5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0840126f0 tx=0x7fa084004730 comp rx=0 tx=0).stop 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 shutdown_connections 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daecfca9b0 0x55daecfcad90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfb3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa06f7fe640 0 client.5751 ms_handle_reset on v2:172.21.15.93:6835/3895579334 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99c30 0x55daecfb7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 --2- 172.21.15.93:0/469653594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfb5670 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 >> 172.21.15.93:0/469653594 conn(0x55daecf6cc90 msgr2=0x55daecf706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 shutdown_connections 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.808+0000 7fa099a81740 1 -- 172.21.15.93:0/469653594 wait complete. 2023-11-04T01:37:17.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.809+0000 7fa099a81740 20 client.5751 trim_cache size 0 max 16384 2023-11-04T01:37:17.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.824+0000 7fa099a81740 1 Processor -- start 2023-11-04T01:37:17.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.824+0000 7fa099a81740 1 -- start start 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.824+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf9c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.824+0000 7fa099a81740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.824+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfd1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa099a81740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daece58280 con 0x55daecf99c30 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daecf67cb0 con 0x55daecf99850 2023-11-04T01:37:17.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daecfc6d30 con 0x55daecfb7d90 2023-11-04T01:37:17.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44896/0 (socket says 172.21.15.93:44896) 2023-11-04T01:37:17.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 -- 172.21.15.93:0/3561326976 learned_addr learned my addr 172.21.15.93:0/3561326976 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa094c88640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf9c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa095489640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfd1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 -- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 msgr2=0x55daecfd1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfd1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 -- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 msgr2=0x55daecf9c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf9c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 -- 172.21.15.93:0/3561326976 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daece74d10 con 0x55daecf99c30 2023-11-04T01:37:17.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa095489640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfd1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:17.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa094c88640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf9c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0090b0 tx=0x7fa07c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d014f270fd893 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa07affd640 1 -- 172.21.15.93:0/3561326976 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c021040 con 0x55daecf99c30 2023-11-04T01:37:17.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa07affd640 1 -- 172.21.15.93:0/3561326976 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0042b0 con 0x55daecf99c30 2023-11-04T01:37:17.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.825+0000 7fa07affd640 1 -- 172.21.15.93:0/3561326976 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c024dc0 con 0x55daecf99c30 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- 172.21.15.93:0/3561326976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 msgr2=0x55daecfb1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0090b0 tx=0x7fa07c010000 comp rx=0 tx=0).stop 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- 172.21.15.93:0/3561326976 shutdown_connections 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecfb7d90 0x55daecfd1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99c30 0x55daecfb1ed0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 --2- 172.21.15.93:0/3561326976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecf99850 0x55daecf9c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- 172.21.15.93:0/3561326976 >> 172.21.15.93:0/3561326976 conn(0x55daecf6cc90 msgr2=0x55daecfbaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- 172.21.15.93:0/3561326976 shutdown_connections 2023-11-04T01:37:17.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- 172.21.15.93:0/3561326976 wait complete. 2023-11-04T01:37:17.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.826+0000 7fa099a81740 1 -- start start 2023-11-04T01:37:17.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 Processor -- start 2023-11-04T01:37:17.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf99c30 0x55daecfc5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecfb7d90 0x55daecf9e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daecfd1870 con 0x55daecf99850 2023-11-04T01:37:17.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daecf9ce50 con 0x55daecfb7d90 2023-11-04T01:37:17.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daecfc56b0 con 0x55daecf99c30 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa099a81740 10 client.0 _ll_register_callbacks cb 0x7fa07c006ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa094c88640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa094c88640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44900/0 (socket says 172.21.15.93:44900) 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa094c88640 1 -- 172.21.15.93:0/3454681501 learned_addr learned my addr 172.21.15.93:0/3454681501 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa095489640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecfb7d90 0x55daecf9e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.827+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf99c30 0x55daecfc5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 -- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf99c30 msgr2=0x55daecfc5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf99c30 0x55daecfc5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 -- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecfb7d90 msgr2=0x55daecf9e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecfb7d90 0x55daecf9e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 -- 172.21.15.93:0/3454681501 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daece9bca0 con 0x55daecf99850 2023-11-04T01:37:17.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa094c88640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa0840126f0 tx=0x7fa084012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acf102e75243f28 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:37:17.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400b040 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa084013e20 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa07c004020 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa084013ad0 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 10 client.5757 fetch_fsmap learned FSMap version 16 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55daece9a500 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c004020 con 0x55daecf99850 2023-11-04T01:37:17.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa08401f870 con 0x55daecf99850 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 10 client.5757 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 10 client.5757 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 20 client.5757 populate_metadata read hostname 'smithi093' 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daed022710 0x55daecf9e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 4 client.5757 mds_command: new command op to 5562 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.828+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 --> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55daeced15b0 con 0x55daed022710 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daed022710 0x55daecf9e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa06f7fe640 10 client.5757 ms_handle_connect on v2:172.21.15.93:6835/3895579334 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa08ffff640 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daed022710 0x55daecf9e8e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7135ee6652971980 server_cookie=751d588c5ecd3e7d in_seq=0 out_seq=0 2023-11-04T01:37:17.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa06f7fe640 1 -- 172.21.15.93:0/3454681501 <== mds.0 v2:172.21.15.93:6835/3895579334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55daeced15b0 con 0x55daed022710 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa06f7fe640 10 client.5757 handle_command_reply: tid=0 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 client.5757 shutdown 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 msgr2=0x55daecfd0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa0840126f0 tx=0x7fa084012000 comp rx=0 tx=0).stop 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 shutdown_connections 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:6835/3895579334,v1:172.21.15.93:6837/3895579334] conn(0x55daed022710 0x55daecf9e8e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55daecfb7d90 0x55daecf9e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa06f7fe640 0 client.5757 ms_handle_reset on v2:172.21.15.93:6835/3895579334 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55daecf99c30 0x55daecfc5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 --2- 172.21.15.93:0/3454681501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55daecf99850 0x55daecfd0dc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 >> 172.21.15.93:0/3454681501 conn(0x55daecf6cc90 msgr2=0x55daecfb1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 shutdown_connections 2023-11-04T01:37:17.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 1 -- 172.21.15.93:0/3454681501 wait complete. 2023-11-04T01:37:17.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.829+0000 7fa099a81740 20 client.5757 trim_cache size 0 max 16384 2023-11-04T01:37:17.850 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:17.850 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:37:17.850 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5562, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 4.5530344449999998, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 16, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 38, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 38, 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 11.940569821 2023-11-04T01:37:17.851 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:17.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 msgr2=0x7fa07406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 0x7fa07406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa084008890 tx=0x7fa084008040 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 msgr2=0x7fa0900c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa088009e50 tx=0x7fa088004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 shutdown_connections 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa07406ae70 0x7fa07406d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa090159c00 0x7fa0900c7850 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0900c48e0 0x7fa090158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 --2- 172.21.15.93:0/3094480168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0900ae1d0 0x7fa090152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 >> 172.21.15.93:0/3094480168 conn(0x7fa0900ce950 msgr2=0x7fa0900c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 shutdown_connections 2023-11-04T01:37:17.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.830+0000 7fa096eec640 1 -- 172.21.15.93:0/3094480168 wait complete. 2023-11-04T01:37:17.855 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:17.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.954+0000 7f539ac4b640 1 Processor -- start 2023-11-04T01:37:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.954+0000 7f539ac4b640 1 -- start start 2023-11-04T01:37:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f539ac4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 0x7f53940c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f539ac4b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53940c9c40 0x7f53940b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f539ac4b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940ca090 con 0x7f539415ad80 2023-11-04T01:37:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f539ac4b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539406cfa0 con 0x7f53940c9c40 2023-11-04T01:37:17.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f539ac4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539406d280 con 0x7f53940b42c0 2023-11-04T01:37:17.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f53991e8640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53940c9c40 0x7f53940b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f5393fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 0x7f53940c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f5393fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 0x7f53940c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:52940/0 (socket says 172.21.15.93:52940) 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f53989e7640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f539415ad80 0x7f539406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:41968/0 (socket says 172.21.15.93:41968) 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f53991e8640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53940c9c40 0x7f53940b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:58582/0 (socket says 172.21.15.93:58582) 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.955+0000 7f5393fff640 1 -- 172.21.15.93:0/1166371188 learned_addr learned my addr 172.21.15.93:0/1166371188 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.956+0000 7f53991e8640 1 -- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 msgr2=0x7f53940c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.956+0000 7f53991e8640 1 --2- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 0x7f53940c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.956+0000 7f53991e8640 1 -- 172.21.15.93:0/1166371188 >> v1:172.21.15.125:6789/0 conn(0x7f539415ad80 legacy=0x7f539406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.956+0000 7f53991e8640 1 -- 172.21.15.93:0/1166371188 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539406d560 con 0x7f53940c9c40 2023-11-04T01:37:17.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.956+0000 7f53937fe640 1 -- 172.21.15.93:0/1166371188 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498303901 0 0) 0x7f5384001110 con 0x7f539415ad80 2023-11-04T01:37:17.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f53991e8640 1 --2- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940c9c40 0x7f53940b1a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f538c009d90 tx=0x7f538c02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6235fa3e02dab7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f53937fe640 1 -- 172.21.15.93:0/1166371188 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c02cce0 con 0x7f53940c9c40 2023-11-04T01:37:17.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f53937fe640 1 -- 172.21.15.93:0/1166371188 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c02ce40 con 0x7f53940c9c40 2023-11-04T01:37:17.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f53937fe640 1 -- 172.21.15.93:0/1166371188 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c034660 con 0x7f53940c9c40 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 -- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940c9c40 msgr2=0x7f53940b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 --2- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940c9c40 0x7f53940b1a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f538c009d90 tx=0x7f538c02bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 -- 172.21.15.93:0/1166371188 shutdown_connections 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 --2- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940c9c40 0x7f53940b1a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 --2- 172.21.15.93:0/1166371188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53940b42c0 0x7f53940c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 -- 172.21.15.93:0/1166371188 >> 172.21.15.93:0/1166371188 conn(0x7f53940ce950 msgr2=0x7f53940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 -- 172.21.15.93:0/1166371188 shutdown_connections 2023-11-04T01:37:17.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.957+0000 7f539ac4b640 1 -- 172.21.15.93:0/1166371188 wait complete. 2023-11-04T01:37:17.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.958+0000 7f539ac4b640 1 Processor -- start 2023-11-04T01:37:17.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 -- start start 2023-11-04T01:37:17.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 0x7f53941549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f539415ad80 0x7f53940c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940c73b0 con 0x7f53940c9c40 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940c7f30 con 0x7f53940b42c0 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f539ac4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53941546d0 con 0x7f539415ad80 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f5393fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f5393fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44912/0 (socket says 172.21.15.93:44912) 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.959+0000 7f5393fff640 1 -- 172.21.15.93:0/3073707174 learned_addr learned my addr 172.21.15.93:0/3073707174 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53989e7640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 0x7f53941549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53991e8640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f539415ad80 0x7f53940c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 -- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f539415ad80 msgr2=0x7f53940c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f539415ad80 0x7f53940c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 -- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 msgr2=0x7f53941549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 0x7f53941549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 -- 172.21.15.93:0/3073707174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009a70 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53989e7640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 0x7f53941549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f5393fff640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f538800e870 tx=0x7f538800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800c8e0 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800ca40 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800cdf0 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53940c8900 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.960+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53940c78e0 con 0x7f53940c9c40 2023-11-04T01:37:17.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.961+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5394074290 con 0x7f53940c9c40 2023-11-04T01:37:17.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.962+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5388013470 con 0x7f53940c9c40 2023-11-04T01:37:17.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.962+0000 7f53917fa640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 0x7f538006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.962+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5388089860 con 0x7f53940c9c40 2023-11-04T01:37:17.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.962+0000 7f53989e7640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 0x7f538006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.962+0000 7f53989e7640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 0x7f538006d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5384000f60 tx=0x7f5384007a50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:17.966+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5388054810 con 0x7f53940c9c40 2023-11-04T01:37:18.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.167+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53940b4880 con 0x7f53940c9c40 2023-11-04T01:37:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.167+0000 7f53917fa640 1 -- 172.21.15.93:0/3073707174 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5388057e30 con 0x7f53940c9c40 2023-11-04T01:37:18.170 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 msgr2=0x7f538006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 0x7f538006d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5384000f60 tx=0x7f5384007a50 comp rx=0 tx=0).stop 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 msgr2=0x7f53941578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f538800e870 tx=0x7f538800ed30 comp rx=0 tx=0).stop 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 shutdown_connections 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f538006ae70 0x7f538006d330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f539415ad80 0x7f53940c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53940c9c40 0x7f53941578c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 --2- 172.21.15.93:0/3073707174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53940b42c0 0x7f53941549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 >> 172.21.15.93:0/3073707174 conn(0x7f53940ce950 msgr2=0x7f53940b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 shutdown_connections 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:18.169+0000 7f539ac4b640 1 -- 172.21.15.93:0/3073707174 wait complete. 2023-11-04T01:37:18.182 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:18.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:18.183 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:18.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.184 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:37:18.199 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:18.199 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:18.199 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:37:18.200 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41762sec preferred_lft 41762sec 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.201 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:37:18.202 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:18.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.203 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:18.265 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:37:18.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.266 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:37:18.322 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:37:18.323 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:18.323 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:18.323 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:18.323 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:18.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:18.324 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:37:18.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.419 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:37:18.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:37:18.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:37:18.433 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:18.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.434 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:37:18.500 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:37:18.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:18.500 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:18.555 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:18.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:18.555 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:18.612 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:18.666 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:18.667 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:18.668 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:18.669 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:18.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.670 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:18.725 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:18.725 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:37:18.769 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:18.786 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:18.787 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:18.788 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:18.789 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:18.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:18.789 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:18.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:37:18.854+0000 7f891d043480 -1 init, newargv = 0x55f8f9bfcff0 newargc=15 2023-11-04T01:37:18.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[135413]: starting ceph client 2023-11-04T01:37:18.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[135413]: starting fuse 2023-11-04T01:37:19.942 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:19.961 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:19.961 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:19.961 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:19.962 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:19.965 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:20.020 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:37:20.021 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:37:20.021 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:37:20.022 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:37:20.023 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:37:20.024 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:20.024 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:20.024 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:37:20.024 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:37:20.155 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.135413.asok 2023-11-04T01:37:20.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:20.169 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.135413.asok 2023-11-04T01:37:20.169 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:20.169 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.135413.asok status 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:20.356 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "135413", 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:37:20.357 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5766, 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 5766 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 4071454169 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:20.358 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 4071454169 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.5766 192.168.0.1:0/4071454169", 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/4071454169", 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 16, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 38, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:37:20.359 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:37:20.360 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:20.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:20.372 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:20.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:20.372 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:20.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:20.432 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:37:20.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:20.439 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:20.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:20.439 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:20.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:20.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:20.504 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:37:20.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.604+0000 7fe2598e5640 1 Processor -- start 2023-11-04T01:37:20.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.604+0000 7fe2598e5640 1 -- start start 2023-11-04T01:37:20.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2598e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe25415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2598e5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 0x7fe254161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2598e5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540cde60 con 0x7fe2540b4880 2023-11-04T01:37:20.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2598e5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe254160f90 con 0x7fe2540cd6d0 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2598e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415e400 con 0x7fe254153e60 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2537fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe2540b4880 0x7fe25406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:47246/0 (socket says 172.21.15.93:47246) 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2537fe640 1 -- 172.21.15.93:0/2202340743 learned_addr learned my addr 172.21.15.93:0/2202340743 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe252ffd640 1 --2- 172.21.15.93:0/2202340743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe25415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe24bfff640 1 --2- 172.21.15.93:0/2202340743 >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 0x7fe254161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456411822 0 0) 0x7fe2540cde60 con 0x7fe2540b4880 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe240003520 con 0x7fe2540b4880 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe252ffd640 1 -- 172.21.15.93:0/2202340743 >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 msgr2=0x7fe254161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe252ffd640 1 --2- 172.21.15.93:0/2202340743 >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 0x7fe254161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332759268 0 0) 0x7fe240003520 con 0x7fe2540b4880 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe252ffd640 1 -- 172.21.15.93:0/2202340743 >> v1:172.21.15.93:6789/0 conn(0x7fe2540b4880 legacy=0x7fe25406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe252ffd640 1 -- 172.21.15.93:0/2202340743 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254161960 con 0x7fe254153e60 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.605+0000 7fe24bfff640 1 --2- 172.21.15.93:0/2202340743 >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 0x7fe254161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.606+0000 7fe252ffd640 1 --2- 172.21.15.93:0/2202340743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe25415dec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2440097a0 tx=0x7fe24402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab356c4b53dead22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.606+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0019f0 con 0x7fe254153e60 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.606+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24402e050 con 0x7fe254153e60 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.606+0000 7fe2527fc640 1 -- 172.21.15.93:0/2202340743 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244030710 con 0x7fe254153e60 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 -- 172.21.15.93:0/2202340743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 msgr2=0x7fe25415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 --2- 172.21.15.93:0/2202340743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe25415dec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2440097a0 tx=0x7fe24402b790 comp rx=0 tx=0).stop 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 -- 172.21.15.93:0/2202340743 shutdown_connections 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 --2- 172.21.15.93:0/2202340743 >> v2:172.21.15.125:3300/0 conn(0x7fe2540cd6d0 0x7fe254161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 --2- 172.21.15.93:0/2202340743 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe25415dec0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 -- 172.21.15.93:0/2202340743 >> 172.21.15.93:0/2202340743 conn(0x7fe2540cf880 msgr2=0x7fe2540cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 -- 172.21.15.93:0/2202340743 shutdown_connections 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.607+0000 7fe2598e5640 1 -- 172.21.15.93:0/2202340743 wait complete. 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.608+0000 7fe2598e5640 1 Processor -- start 2023-11-04T01:37:20.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.608+0000 7fe2598e5640 1 -- start start 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 0x7fe2540c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe2540c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c8880 con 0x7fe2540cd6d0 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c7c00 con 0x7fe2540b4880 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2598e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c7ee0 con 0x7fe254153e60 2023-11-04T01:37:20.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:44926/0 (socket says 172.21.15.93:44926) 2023-11-04T01:37:20.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 -- 172.21.15.93:0/304321309 learned_addr learned my addr 172.21.15.93:0/304321309 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:20.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe2537fe640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe2540c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe252ffd640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 0x7fe2540c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 -- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 msgr2=0x7fe2540c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe2540c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 -- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 msgr2=0x7fe2540c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 0x7fe2540c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 -- 172.21.15.93:0/304321309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009400 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe252ffd640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 0x7fe2540c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe24bfff640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ebb0 tx=0x7fe23c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00eeb0 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.609+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00cc30 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.610+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe244009400 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.610+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c013470 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.610+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2540c84a0 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.611+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254074290 con 0x7fe2540cd6d0 2023-11-04T01:37:20.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.611+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe23c0135d0 con 0x7fe2540cd6d0 2023-11-04T01:37:20.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.611+0000 7fe250ff9640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 0x7fe23406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.611+0000 7fe252ffd640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 0x7fe23406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.611+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe23c089980 con 0x7fe2540cd6d0 2023-11-04T01:37:20.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.612+0000 7fe252ffd640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 0x7fe23406d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe244034000 tx=0x7fe24402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.616+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe23c054980 con 0x7fe2540cd6d0 2023-11-04T01:37:20.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:20.783+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7fe2540d0b80 con 0x7fe2540cd6d0 2023-11-04T01:37:21.019 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:21.022 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:21.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.401+0000 7fe250ff9640 1 -- 172.21.15.93:0/304321309 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe23c0170a0 con 0x7fe2540cd6d0 2023-11-04T01:37:21.404 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'snap-test-pool' created 2023-11-04T01:37:21.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 msgr2=0x7fe23406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 0x7fe23406d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe244034000 tx=0x7fe24402f000 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 msgr2=0x7fe254155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ebb0 tx=0x7fe23c00c520 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 shutdown_connections 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe23406ae70 0x7fe23406d330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe254153e60 0x7fe2540c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540cd6d0 0x7fe254155320 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 --2- 172.21.15.93:0/304321309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2540b4880 0x7fe2540c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 >> 172.21.15.93:0/304321309 conn(0x7fe2540cf880 msgr2=0x7fe2540d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 shutdown_connections 2023-11-04T01:37:21.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.404+0000 7fe2598e5640 1 -- 172.21.15.93:0/304321309 wait complete. 2023-11-04T01:37:21.421 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:37:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 Processor -- start 2023-11-04T01:37:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 -- start start 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871952f7d0 0x5587194e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5587195b4960 0x5587195bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587194953b0 con 0x55871950f960 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871942f650 con 0x5587195b4960 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea48835f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55871942f2f0 con 0x55871952f7d0 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.459+0000 7fea45b79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56582/0 (socket says 172.21.15.93:56582) 2023-11-04T01:37:21.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 -- 172.21.15.93:0/2367258118 learned_addr learned my addr 172.21.15.93:0/2367258118 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45378640 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871952f7d0 0x5587194e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 -- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871952f7d0 msgr2=0x5587194e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871952f7d0 0x5587194e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 -- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5587195b4960 msgr2=0x5587195bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5587195b4960 0x5587195bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 -- 172.21.15.93:0/2367258118 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40005d20 con 0x55871950f960 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea45b79640 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fea380016e0 tx=0x7fea38001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71360c1161ce2dee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea3ffff640 1 -- 172.21.15.93:0/2367258118 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38003650 con 0x55871950f960 2023-11-04T01:37:21.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea3ffff640 1 -- 172.21.15.93:0/2367258118 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380037b0 con 0x55871950f960 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea3ffff640 1 -- 172.21.15.93:0/2367258118 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38003b20 con 0x55871950f960 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 -- 172.21.15.93:0/2367258118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 msgr2=0x5587195adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fea380016e0 tx=0x7fea38001ba0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 -- 172.21.15.93:0/2367258118 shutdown_connections 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5587195b4960 0x5587195bf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871952f7d0 0x5587194e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.460+0000 7fea48835f40 1 --2- 172.21.15.93:0/2367258118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55871950f960 0x5587195adf30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.461+0000 7fea48835f40 1 -- 172.21.15.93:0/2367258118 >> 172.21.15.93:0/2367258118 conn(0x558719511f40 msgr2=0x558719511150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.461+0000 7fea48835f40 1 -- 172.21.15.93:0/2367258118 shutdown_connections 2023-11-04T01:37:21.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.461+0000 7fea48835f40 1 -- 172.21.15.93:0/2367258118 wait complete. 2023-11-04T01:37:21.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.461+0000 7fea48835f40 1 Processor -- start 2023-11-04T01:37:21.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.461+0000 7fea48835f40 1 -- start start 2023-11-04T01:37:21.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 0x5587195a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55871952f7d0 0x5587195add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871940f4f0 con 0x5587195b4960 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587195af4f0 con 0x55871952f7d0 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea48835f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587195a7d40 con 0x55871950f960 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56586/0 (socket says 172.21.15.93:56586) 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 -- 172.21.15.93:0/4097294193 learned_addr learned my addr 172.21.15.93:0/4097294193 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea45378640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55871952f7d0 0x5587195add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea45b79640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 0x5587195a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 -- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 msgr2=0x5587195a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 0x5587195a7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 -- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55871952f7d0 msgr2=0x5587195add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55871952f7d0 0x5587195add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 -- 172.21.15.93:0/4097294193 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38006de0 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea45b79640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 0x5587195a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.462+0000 7fea4637a640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fea40055040 tx=0x7fea40005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.463+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4004aea0 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.463+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40052870 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.463+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55871943b780 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.463+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40052c20 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.463+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55871942e930 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.464+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea4005c400 con 0x5587195b4960 2023-11-04T01:37:21.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.464+0000 7fea3effd640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 0x7fea2806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.465+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fea400c9b00 con 0x5587195b4960 2023-11-04T01:37:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.465+0000 7fea45b79640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 0x7fea2806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.465+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(create snap pool 7 tid 1 name snap3 v0) v4 -- 0x55871949f330 con 0x5587195b4960 2023-11-04T01:37:21.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:21.465+0000 7fea45b79640 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 0x7fea2806bd10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea380016e0 tx=0x7fea38008070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.411+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v40) v1 ==== 43+0+0 (secure 0 0 0) 0x7fea40094b70 con 0x5587195b4960 2023-11-04T01:37:22.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.411+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=40}) v3 -- 0x7fea28072540 con 0x5587195b4960 2023-11-04T01:37:22.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea3effd640 1 -- 172.21.15.93:0/4097294193 <== mon.0 v2:172.21.15.93:3300/0 7 ==== osd_map(40..40 src has 1..40) v4 ==== 718+0+0 (secure 0 0 0) 0x7fea40098830 con 0x5587195b4960 2023-11-04T01:37:22.414 INFO:teuthology.orchestra.run.smithi093.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:37:22.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 msgr2=0x7fea2806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 0x7fea2806bd10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea380016e0 tx=0x7fea38008070 comp rx=0 tx=0).stop 2023-11-04T01:37:22.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 msgr2=0x5587195ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fea40055040 tx=0x7fea40005aa0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 shutdown_connections 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea28069850 0x7fea2806bd10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5587195b4960 0x5587195ae2b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55871952f7d0 0x5587195add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 --2- 172.21.15.93:0/4097294193 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55871950f960 0x5587195a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 >> 172.21.15.93:0/4097294193 conn(0x558719511f40 msgr2=0x5587194e4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 shutdown_connections 2023-11-04T01:37:22.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.412+0000 7fea48835f40 1 -- 172.21.15.93:0/4097294193 wait complete. 2023-11-04T01:37:22.421 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:37:22.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.569+0000 7f02cffa9640 1 Processor -- start 2023-11-04T01:37:22.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.569+0000 7f02cffa9640 1 -- start start 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cffa9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02c806a830 0x7f02c80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cffa9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c8160990 con 0x7f02c80b1a40 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cffa9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c80cc7c0 con 0x7f02c81605b0 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cffa9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c80cd750 con 0x7f02c806a830 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cd544640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f02c80b1a40 0x7f02c80cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57252/0 (socket says 172.21.15.93:57252) 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02cd544640 1 -- 172.21.15.93:0/2617550625 learned_addr learned my addr 172.21.15.93:0/2617550625 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ce546640 1 --2- 172.21.15.93:0/2617550625 >> v2:172.21.15.125:3300/0 conn(0x7f02c806a830 0x7f02c80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292838060 0 0) 0x7f02c8160990 con 0x7f02c80b1a40 2023-11-04T01:37:22.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b4003520 con 0x7f02c80b1a40 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2922577899 0 0) 0x7f02b4003520 con 0x7f02c80b1a40 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 >> v2:172.21.15.125:3300/0 conn(0x7f02c806a830 msgr2=0x7f02c80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 --2- 172.21.15.93:0/2617550625 >> v2:172.21.15.125:3300/0 conn(0x7f02c806a830 0x7f02c80ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 >> v1:172.21.15.125:6789/0 conn(0x7f02c81605b0 legacy=0x7f02c806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80cc4e0 con 0x7f02c80b1a40 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f02b8001670 con 0x7f02c80b1a40 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 >> v1:172.21.15.93:6789/0 conn(0x7f02c80b1a40 legacy=0x7f02c80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.570+0000 7f02ccd43640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b4003970 0x7f02b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ccd43640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 0x7f02b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ccd43640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b40052a0 0x7f02b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80cd750 con 0x7f02b40047c0 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b400c170 con 0x7f02b4003970 2023-11-04T01:37:22.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b400c330 con 0x7f02b40052a0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 0x7f02b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cdd45640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b4003970 0x7f02b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ce546640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b40052a0 0x7f02b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 -- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b40052a0 msgr2=0x7f02b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02b40052a0 0x7f02b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 -- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b4003970 msgr2=0x7f02b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b4003970 0x7f02b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02cd544640 1 -- 172.21.15.93:0/2617550625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4003520 con 0x7f02b40047c0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.571+0000 7f02ce546640 1 -- 172.21.15.93:0/2617550625 reap_dead start 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cd544640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 0x7f02b4004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c210 tx=0x7f02b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635393077a6704cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8005ad0 con 0x7f02b40047c0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8005c50 con 0x7f02b40047c0 2023-11-04T01:37:22.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02ccd43640 1 -- 172.21.15.93:0/2617550625 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b802c7e0 con 0x7f02b40047c0 2023-11-04T01:37:22.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 -- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 msgr2=0x7f02b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 0x7f02b4004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c210 tx=0x7f02b40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 -- 172.21.15.93:0/2617550625 shutdown_connections 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 --2- 172.21.15.93:0/2617550625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02b40047c0 0x7f02b4004c40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 -- 172.21.15.93:0/2617550625 >> 172.21.15.93:0/2617550625 conn(0x7f02c8071820 msgr2=0x7f02c8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 -- 172.21.15.93:0/2617550625 shutdown_connections 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.572+0000 7f02cffa9640 1 -- 172.21.15.93:0/2617550625 wait complete. 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 Processor -- start 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 -- start start 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b40047c0 0x7f02c81f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02c80c7810 0x7f02c80c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c80b4470 0x7f02c80b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80c9710 con 0x7f02c80c7810 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80b4e60 con 0x7f02b40047c0 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cffa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80c8a90 con 0x7f02c80b4470 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cd544640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02c80c7810 0x7f02c80c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cd544640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02c80c7810 0x7f02c80c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56608/0 (socket says 172.21.15.93:56608) 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cd544640 1 -- 172.21.15.93:0/114411607 learned_addr learned my addr 172.21.15.93:0/114411607 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.574+0000 7f02cdd45640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b40047c0 0x7f02c81f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02ce546640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c80b4470 0x7f02c80b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 -- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c80b4470 msgr2=0x7f02c80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c80b4470 0x7f02c80b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 -- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b40047c0 msgr2=0x7f02c81f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02b40047c0 0x7f02c81f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 -- 172.21.15.93:0/114411607 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80c8d70 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02ce546640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f02c80b4470 0x7f02c80b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cd544640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02c80c7810 0x7f02c80c8190 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f02b8001930 tx=0x7f02b802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b803c040 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b802cbf0 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8007070 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cffa9640 1 -- 172.21.15.93:0/114411607 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c80c9050 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.575+0000 7f02cffa9640 1 -- 172.21.15.93:0/114411607 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c81f2480 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.576+0000 7f02cffa9640 1 -- 172.21.15.93:0/114411607 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c80672a0 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.576+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02b8032070 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.577+0000 7f02be7fc640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02ac06aea0 0x7f02ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.577+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f02b80aab90 con 0x7f02c80c7810 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.577+0000 7f02cdd45640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02ac06aea0 0x7f02ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.577+0000 7f02cdd45640 1 --2- 172.21.15.93:0/114411607 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02ac06aea0 0x7f02ac06d360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02c4000c00 tx=0x7f02c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.581+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02b8075970 con 0x7f02c80c7810 2023-11-04T01:37:22.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.783+0000 7f02cffa9640 1 -- 172.21.15.93:0/114411607 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f02c8074290 con 0x7f02c80c7810 2023-11-04T01:37:22.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.783+0000 7f02be7fc640 1 -- 172.21.15.93:0/114411607 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(7) already has mon-managed snaps; can't attach pool to fs v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f02b8078f90 con 0x7f02c80c7810 2023-11-04T01:37:22.786 INFO:teuthology.orchestra.run.smithi093.stderr:Error ENOTSUP: pool(7) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:37:22.790 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:37:22.791 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:37:22.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.828+0000 7f21e5044f40 1 Processor -- start 2023-11-04T01:37:22.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.828+0000 7f21e5044f40 1 -- start start 2023-11-04T01:37:22.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 0x55c294a6a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 0x55c294a6aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2949f3ac0 con 0x55c294a3ec50 2023-11-04T01:37:22.835 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2949ef3b0 con 0x55c294afdd30 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e5044f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c294989650 con 0x55c294a6f780 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56632/0 (socket says 172.21.15.93:56632) 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 -- 172.21.15.93:0/1559460873 learned_addr learned my addr 172.21.15.93:0/1559460873 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 -- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 msgr2=0x55c294a6a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e1aad640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 0x55c294a6a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e2aaf640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 0x55c294a6aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 0x55c294a6a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 -- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 msgr2=0x55c294a6aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 0x55c294a6aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 -- 172.21.15.93:0/1559460873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8005d20 con 0x55c294a3ec50 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e1aad640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 0x55c294a6a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e2aaf640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 0x55c294a6aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.829+0000 7f21e22ae640 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b240 tx=0x7f21d400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d46dc5d9978872 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e0aab640 1 -- 172.21.15.93:0/1559460873 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4014070 con 0x55c294a3ec50 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e0aab640 1 -- 172.21.15.93:0/1559460873 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d400d500 con 0x55c294a3ec50 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e0aab640 1 -- 172.21.15.93:0/1559460873 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d400d8b0 con 0x55c294a3ec50 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 -- 172.21.15.93:0/1559460873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 msgr2=0x55c294b12650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b240 tx=0x7f21d400b700 comp rx=0 tx=0).stop 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 -- 172.21.15.93:0/1559460873 shutdown_connections 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294afdd30 0x55c294a6aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a6f780 0x55c294a6a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 --2- 172.21.15.93:0/1559460873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294a3ec50 0x55c294b12650 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 -- 172.21.15.93:0/1559460873 >> 172.21.15.93:0/1559460873 conn(0x55c294a6bf40 msgr2=0x55c294af9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 -- 172.21.15.93:0/1559460873 shutdown_connections 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.830+0000 7f21e5044f40 1 -- 172.21.15.93:0/1559460873 wait complete. 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 Processor -- start 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 -- start start 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a3ec50 0x55c294a85c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294a6f780 0x55c294af5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2949892f0 con 0x55c294afdd30 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2949694f0 con 0x55c294a6f780 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e5044f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c294af34b0 con 0x55c294a3ec50 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e2aaf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e2aaf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56638/0 (socket says 172.21.15.93:56638) 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e2aaf640 1 -- 172.21.15.93:0/4042642583 learned_addr learned my addr 172.21.15.93:0/4042642583 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e1aad640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294a6f780 0x55c294af5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.831+0000 7f21e22ae640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a3ec50 0x55c294a85c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 -- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a3ec50 msgr2=0x55c294a85c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a3ec50 0x55c294a85c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 -- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294a6f780 msgr2=0x55c294af5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294a6f780 0x55c294af5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 -- 172.21.15.93:0/4042642583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d4001b40 con 0x55c294afdd30 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e2aaf640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f21dc003240 tx=0x7f21dc00c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00ce10 con 0x55c294afdd30 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc011600 con 0x55c294afdd30 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc011990 con 0x55c294afdd30 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c294988930 con 0x55c294afdd30 2023-11-04T01:37:22.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.832+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c294988390 con 0x55c294afdd30 2023-11-04T01:37:22.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.833+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21dc011af0 con 0x55c294afdd30 2023-11-04T01:37:22.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.834+0000 7f21d37fe640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 0x7f21c406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.834+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f21dc0883e0 con 0x55c294afdd30 2023-11-04T01:37:22.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.834+0000 7f21e22ae640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 0x7f21c406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.834+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(delete snap pool 7 tid 1 name snap3 v0) v4 -- 0x55c2949f9330 con 0x55c294afdd30 2023-11-04T01:37:22.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:22.834+0000 7f21e22ae640 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 0x7f21c406bd10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b240 tx=0x7f21d4011040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v41) v1 ==== 43+0+0 (secure 0 0 0) 0x7f21dc053300 con 0x55c294afdd30 2023-11-04T01:37:23.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7f21c40725a0 con 0x55c294afdd30 2023-11-04T01:37:23.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21d37fe640 1 -- 172.21.15.93:0/4042642583 <== mon.0 v2:172.21.15.93:3300/0 7 ==== osd_map(41..41 src has 1..41) v4 ==== 643+0+0 (secure 0 0 0) 0x7f21dc056fc0 con 0x55c294afdd30 2023-11-04T01:37:23.426 INFO:teuthology.orchestra.run.smithi093.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:37:23.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 msgr2=0x7f21c406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 0x7f21c406bd10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21d400b240 tx=0x7f21d4011040 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 msgr2=0x55c294af6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f21dc003240 tx=0x7f21dc00c5e0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 shutdown_connections 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f21c4069850 0x7f21c406bd10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55c294afdd30 0x55c294af6120 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c294a6f780 0x55c294af5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 --2- 172.21.15.93:0/4042642583 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55c294a3ec50 0x55c294a85c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 >> 172.21.15.93:0/4042642583 conn(0x55c294a6bf40 msgr2=0x55c294af9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 shutdown_connections 2023-11-04T01:37:23.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.423+0000 7f21e5044f40 1 -- 172.21.15.93:0/4042642583 wait complete. 2023-11-04T01:37:23.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:37:23.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.575+0000 7ff94f5f5640 1 Processor -- start 2023-11-04T01:37:23.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.575+0000 7ff94f5f5640 1 -- start start 2023-11-04T01:37:23.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94f5f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff948070ff0 0x7ff9480cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94f5f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 0x7ff94806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94f5f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480c9bf0 con 0x7ff94815d1b0 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94f5f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480cd890 con 0x7ff948070ff0 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94f5f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480cdb30 con 0x7ff948066000 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94d391640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff948070ff0 0x7ff9480cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94cb90640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff94815d1b0 0x7ff9480713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57272/0 (socket says 172.21.15.93:57272) 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94cb90640 1 -- 172.21.15.93:0/1318911355 learned_addr learned my addr 172.21.15.93:0/1318911355 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94db92640 1 --2- 172.21.15.93:0/1318911355 >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 0x7ff94806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94d391640 1 -- 172.21.15.93:0/1318911355 >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 msgr2=0x7ff94806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94d391640 1 --2- 172.21.15.93:0/1318911355 >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 0x7ff94806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94d391640 1 -- 172.21.15.93:0/1318911355 >> v1:172.21.15.93:6789/0 conn(0x7ff94815d1b0 legacy=0x7ff9480713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94d391640 1 -- 172.21.15.93:0/1318911355 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480cde10 con 0x7ff948070ff0 2023-11-04T01:37:23.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.576+0000 7ff94db92640 1 --2- 172.21.15.93:0/1318911355 >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 0x7ff94806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:23.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.577+0000 7ff94d391640 1 --2- 172.21.15.93:0/1318911355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff948070ff0 0x7ff9480cb4e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff94806e960 tx=0x7ff94402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b44c3c99211125e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.577+0000 7ff93ffff640 1 -- 172.21.15.93:0/1318911355 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944031830 con 0x7ff948070ff0 2023-11-04T01:37:23.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.577+0000 7ff93ffff640 1 -- 172.21.15.93:0/1318911355 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944031990 con 0x7ff948070ff0 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.577+0000 7ff93ffff640 1 -- 172.21.15.93:0/1318911355 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944031d20 con 0x7ff948070ff0 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 -- 172.21.15.93:0/1318911355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff948070ff0 msgr2=0x7ff9480cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 --2- 172.21.15.93:0/1318911355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff948070ff0 0x7ff9480cb4e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff94806e960 tx=0x7ff94402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 -- 172.21.15.93:0/1318911355 shutdown_connections 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 --2- 172.21.15.93:0/1318911355 >> v2:172.21.15.125:3300/0 conn(0x7ff948066000 0x7ff94806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 --2- 172.21.15.93:0/1318911355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff948070ff0 0x7ff9480cb4e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 -- 172.21.15.93:0/1318911355 >> 172.21.15.93:0/1318911355 conn(0x7ff9480cbc90 msgr2=0x7ff9480cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 -- 172.21.15.93:0/1318911355 shutdown_connections 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.578+0000 7ff94f5f5640 1 -- 172.21.15.93:0/1318911355 wait complete. 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 Processor -- start 2023-11-04T01:37:23.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 -- start start 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff948066000 0x7ff9480c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff948070ff0 0x7ff9480b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff94815d1b0 0x7ff948159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b3320 con 0x7ff94815d1b0 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b2660 con 0x7ff948070ff0 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.579+0000 7ff94f5f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b2940 con 0x7ff948066000 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff94815d1b0 0x7ff948159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff94815d1b0 0x7ff948159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56654/0 (socket says 172.21.15.93:56654) 2023-11-04T01:37:23.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 -- 172.21.15.93:0/3930436680 learned_addr learned my addr 172.21.15.93:0/3930436680 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 -- 172.21.15.93:0/3930436680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff948066000 msgr2=0x7ff9480c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff948066000 0x7ff9480c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 -- 172.21.15.93:0/3930436680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff948070ff0 msgr2=0x7ff9480b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94cb90640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff948070ff0 0x7ff9480b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff948070ff0 0x7ff9480b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 -- 172.21.15.93:0/3930436680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009400 con 0x7ff94815d1b0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94db92640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff94815d1b0 0x7ff948159710 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff940007e70 tx=0x7ff94000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940003b90 con 0x7ff94815d1b0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000f040 con 0x7ff94815d1b0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000de80 con 0x7ff94815d1b0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94f5f5640 1 -- 172.21.15.93:0/3930436680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480b2c20 con 0x7ff94815d1b0 2023-11-04T01:37:23.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.580+0000 7ff94f5f5640 1 -- 172.21.15.93:0/3930436680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9480b2f00 con 0x7ff94815d1b0 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.581+0000 7ff94f5f5640 1 -- 172.21.15.93:0/3930436680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480b3460 con 0x7ff94815d1b0 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.582+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff940004030 con 0x7ff94815d1b0 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.582+0000 7ff93dffb640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff92c06ae70 0x7ff92c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.582+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7ff940089b70 con 0x7ff94815d1b0 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.582+0000 7ff94d391640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff92c06ae70 0x7ff92c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.583+0000 7ff94d391640 1 --2- 172.21.15.93:0/3930436680 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff92c06ae70 0x7ff92c06d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff944036000 tx=0x7ff944030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.586+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9400549d0 con 0x7ff94815d1b0 2023-11-04T01:37:23.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.753+0000 7ff94f5f5640 1 -- 172.21.15.93:0/3930436680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7ff948074290 con 0x7ff94815d1b0 2023-11-04T01:37:23.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.753+0000 7ff93dffb640 1 -- 172.21.15.93:0/3930436680 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v41) v1 ==== 296+0+0 (secure 0 0 0) 0x7ff94001a0a0 con 0x7ff94815d1b0 2023-11-04T01:37:23.755 INFO:teuthology.orchestra.run.smithi093.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:37:23.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:23.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:23.760 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:23.797 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:23.839 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:23.839 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:23.839 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:23.854 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:23.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 Processor -- start 2023-11-04T01:37:23.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 -- start start 2023-11-04T01:37:23.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f481c0b42c0 0x7f481c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f481c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c0ca090 con 0x7f481c15ad80 2023-11-04T01:37:23.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c06cfa0 con 0x7f481c0b42c0 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.991+0000 7f4822a34640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c06d280 con 0x7f481c0c9c40 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f481c15ad80 0x7f481c06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57280/0 (socket says 172.21.15.93:57280) 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481bfff640 1 -- 172.21.15.93:0/2542206033 learned_addr learned my addr 172.21.15.93:0/2542206033 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481b7fe640 1 --2- 172.21.15.93:0/2542206033 >> v2:172.21.15.125:3300/0 conn(0x7f481c0b42c0 0x7f481c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f4820fd1640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f481c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641293065 0 0) 0x7f480c001110 con 0x7f481c15ad80 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4804003520 con 0x7f481c15ad80 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258054657 0 0) 0x7f4804003520 con 0x7f481c15ad80 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 msgr2=0x7f481c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f481c0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 >> v2:172.21.15.125:3300/0 conn(0x7f481c0b42c0 msgr2=0x7f481c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 --2- 172.21.15.93:0/2542206033 >> v2:172.21.15.125:3300/0 conn(0x7f481c0b42c0 0x7f481c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c06d560 con 0x7f481c15ad80 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f480c001800 con 0x7f481c15ad80 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 >> v1:172.21.15.93:6789/0 conn(0x7f481c15ad80 legacy=0x7f481c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4804003970 0x7f4804003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48040047c0 0x7f4804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f4804005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c06cfa0 con 0x7f4804003970 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c06d280 con 0x7f48040047c0 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480400b980 con 0x7f481c0c9c40 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481bfff640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4804003970 0x7f4804003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f481b7fe640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48040047c0 0x7f4804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.992+0000 7f4820fd1640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f4804005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 -- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 msgr2=0x7f4804005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f4804005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 -- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48040047c0 msgr2=0x7f4804004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48040047c0 0x7f4804004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 -- 172.21.15.93:0/2542206033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804003520 con 0x7f4804003970 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f4820fd1640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f481c0c9c40 0x7f4804005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481bfff640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4804003970 0x7f4804003d90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f480c00c210 tx=0x7f48040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1da9b26c6d3ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0058d0 con 0x7f4804003970 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c005a30 con 0x7f4804003970 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.993+0000 7f481affd640 1 -- 172.21.15.93:0/2542206033 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c005de0 con 0x7f4804003970 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 -- 172.21.15.93:0/2542206033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4804003970 msgr2=0x7f4804003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 --2- 172.21.15.93:0/2542206033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4804003970 0x7f4804003d90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f480c00c210 tx=0x7f48040057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4820fd1640 1 -- 172.21.15.93:0/2542206033 reap_dead start 2023-11-04T01:37:23.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 -- 172.21.15.93:0/2542206033 shutdown_connections 2023-11-04T01:37:24.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 -- 172.21.15.93:0/2542206033 >> 172.21.15.93:0/2542206033 conn(0x7f481c0ce950 msgr2=0x7f481c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 -- 172.21.15.93:0/2542206033 shutdown_connections 2023-11-04T01:37:24.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.994+0000 7f4822a34640 1 -- 172.21.15.93:0/2542206033 wait complete. 2023-11-04T01:37:24.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.995+0000 7f4822a34640 1 Processor -- start 2023-11-04T01:37:24.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.995+0000 7f4822a34640 1 -- start start 2023-11-04T01:37:24.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 0x7f481c15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 0x7f481c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c4a50 con 0x7f481c15c350 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15d420 con 0x7f481c1f2960 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4822a34640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15c810 con 0x7f4804003970 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56664/0 (socket says 172.21.15.93:56664) 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 -- 172.21.15.93:0/2876476460 learned_addr learned my addr 172.21.15.93:0/2876476460 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4820fd1640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 0x7f481c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481bfff640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 0x7f481c15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 -- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 msgr2=0x7f481c15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 0x7f481c15d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 -- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 msgr2=0x7f481c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 0x7f481c0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481b7fe640 1 -- 172.21.15.93:0/2876476460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c15caf0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f4820fd1640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 0x7f481c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.996+0000 7f481bfff640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 0x7f481c15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f481b7fe640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f48100118e0 tx=0x7f4810011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000faf0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000fc50 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c15cdd0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810014440 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.997+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c1f2dd0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.998+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c15d590 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.998+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48100145a0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.998+0000 7f4818ff9640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 0x7f480806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.998+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f4810089fe0 con 0x7f481c15c350 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.999+0000 7f481bfff640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 0x7f480806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:23.999+0000 7f481bfff640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 0x7f480806d360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f480c038000 tx=0x7f480c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.003+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4810054e40 con 0x7f481c15c350 2023-11-04T01:37:24.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.170+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f481c074290 con 0x7f481c15c350 2023-11-04T01:37:24.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.171+0000 7f4818ff9640 1 -- 172.21.15.93:0/2876476460 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18625 (secure 0 0 0) 0x7f4810058460 con 0x7f481c15c350 2023-11-04T01:37:24.174 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:24.174 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":41,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:23.417585+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:24.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 msgr2=0x7f480806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 0x7f480806d360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f480c038000 tx=0x7f480c007000 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 msgr2=0x7f481c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f48100118e0 tx=0x7f4810011da0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 shutdown_connections 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f480806aea0 0x7f480806d360 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f481c1f2960 0x7f481c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f481c15c350 0x7f481c0c4510 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 --2- 172.21.15.93:0/2876476460 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4804003970 0x7f481c15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 >> 172.21.15.93:0/2876476460 conn(0x7f481c0ce950 msgr2=0x7f481c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.173+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 shutdown_connections 2023-11-04T01:37:24.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.174+0000 7f4822a34640 1 -- 172.21.15.93:0/2876476460 wait complete. 2023-11-04T01:37:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:10.466126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:11.597935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:24.187 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:24.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.287+0000 7f4743f25640 1 Processor -- start 2023-11-04T01:37:24.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 -- start start 2023-11-04T01:37:24.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f473c15cfd0 0x7f473c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f473c0cd570 0x7f473c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0cdf20 con 0x7f473c0cf180 2023-11-04T01:37:24.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c15d3b0 con 0x7f473c0cd570 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.288+0000 7f4743f25640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c0cea20 con 0x7f473c15cfd0 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47424c2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f473c0cd570 0x7f473c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47414c0640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f473c0cf180 0x7f473c161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57290/0 (socket says 172.21.15.93:57290) 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47414c0640 1 -- 172.21.15.93:0/2056812519 learned_addr learned my addr 172.21.15.93:0/2056812519 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f4741cc1640 1 --2- 172.21.15.93:0/2056812519 >> v2:172.21.15.125:3300/0 conn(0x7f473c15cfd0 0x7f473c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47424c2640 1 -- 172.21.15.93:0/2056812519 >> v2:172.21.15.125:3300/0 conn(0x7f473c15cfd0 msgr2=0x7f473c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47424c2640 1 --2- 172.21.15.93:0/2056812519 >> v2:172.21.15.125:3300/0 conn(0x7f473c15cfd0 0x7f473c06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47424c2640 1 -- 172.21.15.93:0/2056812519 >> v1:172.21.15.93:6789/0 conn(0x7f473c0cf180 legacy=0x7f473c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f4740cbf640 1 -- 172.21.15.93:0/2056812519 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615374683 0 0) 0x7f472c001110 con 0x7f473c0cf180 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.289+0000 7f47424c2640 1 -- 172.21.15.93:0/2056812519 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0cf610 con 0x7f473c0cd570 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f47424c2640 1 --2- 172.21.15.93:0/2056812519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c0cd9e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f473c0d1ca0 tx=0x7f473402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2f63688593f384 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4740cbf640 1 -- 172.21.15.93:0/2056812519 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473402cbf0 con 0x7f473c0cd570 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4740cbf640 1 -- 172.21.15.93:0/2056812519 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473402cd50 con 0x7f473c0cd570 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4740cbf640 1 -- 172.21.15.93:0/2056812519 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734034660 con 0x7f473c0cd570 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 -- 172.21.15.93:0/2056812519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 msgr2=0x7f473c0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 --2- 172.21.15.93:0/2056812519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c0cd9e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f473c0d1ca0 tx=0x7f473402be40 comp rx=0 tx=0).stop 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 -- 172.21.15.93:0/2056812519 shutdown_connections 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 --2- 172.21.15.93:0/2056812519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c0cd9e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 --2- 172.21.15.93:0/2056812519 >> v2:172.21.15.125:3300/0 conn(0x7f473c15cfd0 0x7f473c06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 -- 172.21.15.93:0/2056812519 >> 172.21.15.93:0/2056812519 conn(0x7f473c06ea20 msgr2=0x7f473c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 -- 172.21.15.93:0/2056812519 shutdown_connections 2023-11-04T01:37:24.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.290+0000 7f4743f25640 1 -- 172.21.15.93:0/2056812519 wait complete. 2023-11-04T01:37:24.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 Processor -- start 2023-11-04T01:37:24.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 -- start start 2023-11-04T01:37:24.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f473c15cfd0 0x7f473c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f473c0c6b90 0x7f473c0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0c7560 con 0x7f473c0cd570 2023-11-04T01:37:24.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1f2a80 con 0x7f473c15cfd0 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4743f25640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0b5ba0 con 0x7f473c0c6b90 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4741cc1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4741cc1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56672/0 (socket says 172.21.15.93:56672) 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.292+0000 7f4741cc1640 1 -- 172.21.15.93:0/3441476255 learned_addr learned my addr 172.21.15.93:0/3441476255 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f47424c2640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f473c0c6b90 0x7f473c0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 -- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f473c0c6b90 msgr2=0x7f473c0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f473c0c6b90 0x7f473c0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 -- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f473c15cfd0 msgr2=0x7f473c0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f47414c0640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f473c15cfd0 0x7f473c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f473c15cfd0 0x7f473c0b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 -- 172.21.15.93:0/3441476255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009a70 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4741cc1640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f473800c7f0 tx=0x7f473800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738004220 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738004380 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738007840 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c0b5e80 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.293+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c0b6440 con 0x7f473c0cd570 2023-11-04T01:37:24.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.294+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c06b300 con 0x7f473c0cd570 2023-11-04T01:37:24.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.294+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4738007bb0 con 0x7f473c0cd570 2023-11-04T01:37:24.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.295+0000 7f47327fc640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.295+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f4738089810 con 0x7f473c0cd570 2023-11-04T01:37:24.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.295+0000 7f47414c0640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.295+0000 7f47414c0640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 0x7f472006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f473c0cbee0 tx=0x7f472c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.299+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47380545e0 con 0x7f473c0cd570 2023-11-04T01:37:24.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.467+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f473c066100 con 0x7f473c0cd570 2023-11-04T01:37:24.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.467+0000 7f47327fc640 1 -- 172.21.15.93:0/3441476255 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f473801e0a0 con 0x7f473c0cd570 2023-11-04T01:37:24.470 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:24.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 msgr2=0x7f472006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 0x7f472006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f473c0cbee0 tx=0x7f472c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 msgr2=0x7f473c1f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f473800c7f0 tx=0x7f473800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 shutdown_connections 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f473c0c6b90 0x7f473c0c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f473c15cfd0 0x7f473c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 --2- 172.21.15.93:0/3441476255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f473c0cd570 0x7f473c1f2540 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 >> 172.21.15.93:0/3441476255 conn(0x7f473c06ea20 msgr2=0x7f473c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 shutdown_connections 2023-11-04T01:37:24.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.469+0000 7f4743f25640 1 -- 172.21.15.93:0/3441476255 wait complete. 2023-11-04T01:37:24.482 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:24.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.582+0000 7fd5ba53c640 1 Processor -- start 2023-11-04T01:37:24.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.582+0000 7fd5ba53c640 1 -- start start 2023-11-04T01:37:24.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5ba53c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5b4160430 0x7fd5b40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5ba53c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd5b406c3a0 0x7fd5b40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5ba53c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b40b2fc0 con 0x7fd5b40b2b60 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5ba53c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40cb580 con 0x7fd5b406c3a0 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5ba53c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b406c7d0 con 0x7fd5b4160430 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b8ad9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd5b406c3a0 0x7fd5b40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd5b40b2b60 0x7fd5b406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57306/0 (socket says 172.21.15.93:57306) 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b37fe640 1 -- 172.21.15.93:0/2405235017 learned_addr learned my addr 172.21.15.93:0/2405235017 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b3fff640 1 --2- 172.21.15.93:0/2405235017 >> v2:172.21.15.125:3300/0 conn(0x7fd5b4160430 0x7fd5b40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/2405235017 >> v2:172.21.15.125:3300/0 conn(0x7fd5b4160430 msgr2=0x7fd5b40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b8ad9640 1 --2- 172.21.15.93:0/2405235017 >> v2:172.21.15.125:3300/0 conn(0x7fd5b4160430 0x7fd5b40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/2405235017 >> v1:172.21.15.93:6789/0 conn(0x7fd5b40b2b60 legacy=0x7fd5b406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.583+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/2405235017 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b406ca40 con 0x7fd5b406c3a0 2023-11-04T01:37:24.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5b8ad9640 1 --2- 172.21.15.93:0/2405235017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b406c3a0 0x7fd5b40cbcb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd5b406f6d0 tx=0x7fd5ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f960efb2b0bcbb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5b2ffd640 1 -- 172.21.15.93:0/2405235017 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac02cc80 con 0x7fd5b406c3a0 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5b2ffd640 1 -- 172.21.15.93:0/2405235017 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac02cde0 con 0x7fd5b406c3a0 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5b2ffd640 1 -- 172.21.15.93:0/2405235017 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac034660 con 0x7fd5b406c3a0 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 -- 172.21.15.93:0/2405235017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b406c3a0 msgr2=0x7fd5b40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/2405235017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b406c3a0 0x7fd5b40cbcb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd5b406f6d0 tx=0x7fd5ac02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 -- 172.21.15.93:0/2405235017 shutdown_connections 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/2405235017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b406c3a0 0x7fd5b40cbcb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/2405235017 >> v2:172.21.15.125:3300/0 conn(0x7fd5b4160430 0x7fd5b40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 -- 172.21.15.93:0/2405235017 >> 172.21.15.93:0/2405235017 conn(0x7fd5b406ea20 msgr2=0x7fd5b406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.584+0000 7fd5ba53c640 1 -- 172.21.15.93:0/2405235017 shutdown_connections 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.585+0000 7fd5ba53c640 1 -- 172.21.15.93:0/2405235017 wait complete. 2023-11-04T01:37:24.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.586+0000 7fd5ba53c640 1 Processor -- start 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.586+0000 7fd5ba53c640 1 -- start start 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.586+0000 7fd5ba53c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b406c3a0 0x7fd5b415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.586+0000 7fd5ba53c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b40b2b60 0x7fd5b40c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.586+0000 7fd5ba53c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5ba53c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b46b0 con 0x7fd5b4160430 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5ba53c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b37c0 con 0x7fd5b406c3a0 2023-11-04T01:37:24.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5ba53c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40b3aa0 con 0x7fd5b40b2b60 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56696/0 (socket says 172.21.15.93:56696) 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/3668428766 learned_addr learned my addr 172.21.15.93:0/3668428766 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b40b2b60 msgr2=0x7fd5b40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b40b2b60 0x7fd5b40c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b406c3a0 msgr2=0x7fd5b415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b406c3a0 0x7fd5b415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 -- 172.21.15.93:0/3668428766 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac009a70 con 0x7fd5b4160430 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b8ad9640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009e80 tx=0x7fd5ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac040650 con 0x7fd5b4160430 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac0407b0 con 0x7fd5b4160430 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b40b3d80 con 0x7fd5b4160430 2023-11-04T01:37:24.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac040b60 con 0x7fd5b4160430 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.587+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b40b4340 con 0x7fd5b4160430 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.588+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b4074290 con 0x7fd5b4160430 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.589+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5ac040cc0 con 0x7fd5b4160430 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.589+0000 7fd5b0ff9640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 0x7fd5a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.589+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fd5ac0ac610 con 0x7fd5b4160430 2023-11-04T01:37:24.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.589+0000 7fd5b3fff640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 0x7fd5a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.589+0000 7fd5b3fff640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 0x7fd5a006d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006fd0 tx=0x7fd5a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.593+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5ac077470 con 0x7fd5b4160430 2023-11-04T01:37:24.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.758+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5b40b47f0 con 0x7fd5b4160430 2023-11-04T01:37:24.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.759+0000 7fd5b0ff9640 1 -- 172.21.15.93:0/3668428766 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5ac009450 con 0x7fd5b4160430 2023-11-04T01:37:24.761 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:24.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 msgr2=0x7fd5a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 0x7fd5a006d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006fd0 tx=0x7fd5a4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 msgr2=0x7fd5b40ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009e80 tx=0x7fd5ac004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 shutdown_connections 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd5a006ae70 0x7fd5a006d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5b4160430 0x7fd5b40ca270 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5b40b2b60 0x7fd5b40c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 --2- 172.21.15.93:0/3668428766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5b406c3a0 0x7fd5b415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 >> 172.21.15.93:0/3668428766 conn(0x7fd5b406ea20 msgr2=0x7fd5b40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 shutdown_connections 2023-11-04T01:37:24.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.761+0000 7fd5ba53c640 1 -- 172.21.15.93:0/3668428766 wait complete. 2023-11-04T01:37:24.774 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.875+0000 7f842ea90640 1 Processor -- start 2023-11-04T01:37:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.875+0000 7f842ea90640 1 -- start start 2023-11-04T01:37:24.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f842ea90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f842815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f842ea90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280cde60 con 0x7f84280cd6d0 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f842ea90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428160f90 con 0x7f84280b4880 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f842ea90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842815e400 con 0x7f8428153e60 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f8427fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f84280cd6d0 0x7f8428161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57312/0 (socket says 172.21.15.93:57312) 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f8427fff640 1 -- 172.21.15.93:0/2429897377 learned_addr learned my addr 172.21.15.93:0/2429897377 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.876+0000 7f842c82c640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f842815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048764454 0 0) 0x7f84280cde60 con 0x7f84280cd6d0 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8414003520 con 0x7f84280cd6d0 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221247138 0 0) 0x7f8414003520 con 0x7f84280cd6d0 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 msgr2=0x7f842815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f842815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 >> v1:172.21.15.125:6789/0 conn(0x7f84280b4880 legacy=0x7f84280d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280ce090 con 0x7f84280cd6d0 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8418001670 con 0x7f84280cd6d0 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 >> v1:172.21.15.93:6789/0 conn(0x7f84280cd6d0 legacy=0x7f8428161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84140039a0 0x7f8414003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f84140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8414004d00 0x7f8414005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842815e400 con 0x7f84140039a0 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841400b980 con 0x7f8414004d00 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841400bb40 con 0x7f8428153e60 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84140039a0 0x7f8414003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842d02d640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8414004d00 0x7f8414005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f8427fff640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f84140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 -- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 msgr2=0x7f84140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8428153e60 0x7f84140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 -- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8414004d00 msgr2=0x7f8414005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8414004d00 0x7f8414005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842c82c640 1 -- 172.21.15.93:0/2429897377 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414003520 con 0x7f84140039a0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.877+0000 7f842d02d640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8414004d00 0x7f8414005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.878+0000 7f842c82c640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84140039a0 0x7f8414003d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8420009fc0 tx=0x7f84140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55822a73d35affd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.878+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842002cb40 con 0x7f84140039a0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.878+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000f040 con 0x7f84140039a0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.878+0000 7f84277fe640 1 -- 172.21.15.93:0/2429897377 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420034440 con 0x7f84140039a0 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 -- 172.21.15.93:0/2429897377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84140039a0 msgr2=0x7f8414003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 --2- 172.21.15.93:0/2429897377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84140039a0 0x7f8414003d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8420009fc0 tx=0x7f84140057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842d02d640 1 -- 172.21.15.93:0/2429897377 reap_dead start 2023-11-04T01:37:24.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 -- 172.21.15.93:0/2429897377 shutdown_connections 2023-11-04T01:37:24.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 -- 172.21.15.93:0/2429897377 >> 172.21.15.93:0/2429897377 conn(0x7f84280cf880 msgr2=0x7f84280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 -- 172.21.15.93:0/2429897377 shutdown_connections 2023-11-04T01:37:24.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.879+0000 7f842ea90640 1 -- 172.21.15.93:0/2429897377 wait complete. 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.880+0000 7f842ea90640 1 Processor -- start 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.880+0000 7f842ea90640 1 -- start start 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84140039a0 0x7f8428152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 0x7f84280b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281f6430 con 0x7f842815c3b0 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281f5ad0 con 0x7f842815bf30 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84281f6850 con 0x7f84140039a0 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56710/0 (socket says 172.21.15.93:56710) 2023-11-04T01:37:24.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 -- 172.21.15.93:0/2013782346 learned_addr learned my addr 172.21.15.93:0/2013782346 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842c82c640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84140039a0 0x7f8428152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f8427fff640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 0x7f84280b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 -- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84140039a0 msgr2=0x7f8428152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84140039a0 0x7f8428152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 -- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 msgr2=0x7f84280b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 0x7f84280b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 -- 172.21.15.93:0/2013782346 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84281f5d70 con 0x7f842815c3b0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f8427fff640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 0x7f84280b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842d02d640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f84280d3e70 tx=0x7f841000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84100052e0 con 0x7f842815c3b0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410005440 con 0x7f842815c3b0 2023-11-04T01:37:24.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84281f6050 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.881+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410003830 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.882+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84281546d0 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.883+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84281f6570 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.883+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8410003990 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.883+0000 7f84257fa640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 0x7f840806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.883+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f8410088f20 con 0x7f842815c3b0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.883+0000 7f842c82c640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 0x7f840806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.884+0000 7f842c82c640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 0x7f840806d360 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8420036000 tx=0x7f842002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:24.887+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84281f6570 con 0x7f842815c3b0 2023-11-04T01:37:25.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.052+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84281f6570 con 0x7f842815c3b0 2023-11-04T01:37:25.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.052+0000 7f84257fa640 1 -- 172.21.15.93:0/2013782346 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84281f6570 con 0x7f842815c3b0 2023-11-04T01:37:25.055 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 msgr2=0x7f840806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 0x7f840806d360 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8420036000 tx=0x7f842002e000 comp rx=0 tx=0).stop 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 msgr2=0x7f84280b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f84280d3e70 tx=0x7f841000e940 comp rx=0 tx=0).stop 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 shutdown_connections 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f840806aea0 0x7f840806d360 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f842815c3b0 0x7f84280b65c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f842815bf30 0x7f84280b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 --2- 172.21.15.93:0/2013782346 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84140039a0 0x7f8428152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 >> 172.21.15.93:0/2013782346 conn(0x7f84280cf880 msgr2=0x7f84280b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 shutdown_connections 2023-11-04T01:37:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.054+0000 7f842ea90640 1 -- 172.21.15.93:0/2013782346 wait complete. 2023-11-04T01:37:25.067 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:25.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.167+0000 7fa7eb294640 1 Processor -- start 2023-11-04T01:37:25.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.167+0000 7fa7eb294640 1 -- start start 2023-11-04T01:37:25.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7eb294640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa7e4159c00 0x7fa7e40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7eb294640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7e40c48e0 0x7fa7e40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7eb294640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e415aff0 con 0x7fa7e40adac0 2023-11-04T01:37:25.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7eb294640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e40c52d0 con 0x7fa7e40c48e0 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7eb294640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e415a3e0 con 0x7fa7e4159c00 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7e882f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7e40c48e0 0x7fa7e40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7e9831640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa7e40adac0 0x7fa7e40adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57316/0 (socket says 172.21.15.93:57316) 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.168+0000 7fa7e9831640 1 -- 172.21.15.93:0/2649971097 learned_addr learned my addr 172.21.15.93:0/2649971097 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7e9030640 1 --2- 172.21.15.93:0/2649971097 >> v2:172.21.15.125:3300/0 conn(0x7fa7e4159c00 0x7fa7e40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7e882f640 1 -- 172.21.15.93:0/2649971097 >> v2:172.21.15.125:3300/0 conn(0x7fa7e4159c00 msgr2=0x7fa7e40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7e882f640 1 --2- 172.21.15.93:0/2649971097 >> v2:172.21.15.125:3300/0 conn(0x7fa7e4159c00 0x7fa7e40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7e882f640 1 -- 172.21.15.93:0/2649971097 >> v1:172.21.15.93:6789/0 conn(0x7fa7e40adac0 legacy=0x7fa7e40adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7d7fff640 1 -- 172.21.15.93:0/2649971097 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977687617 0 0) 0x7fa7e415aff0 con 0x7fa7e40adac0 2023-11-04T01:37:25.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.169+0000 7fa7e882f640 1 -- 172.21.15.93:0/2649971097 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e415a6c0 con 0x7fa7e40c48e0 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7e882f640 1 --2- 172.21.15.93:0/2649971097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e40c48e0 0x7fa7e40c4d90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc4d0 tx=0x7fa7d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f15087a7f8a297 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7d7fff640 1 -- 172.21.15.93:0/2649971097 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d802e070 con 0x7fa7e40c48e0 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7d7fff640 1 -- 172.21.15.93:0/2649971097 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80315a0 con 0x7fa7e40c48e0 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7d7fff640 1 -- 172.21.15.93:0/2649971097 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8031930 con 0x7fa7e40c48e0 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 -- 172.21.15.93:0/2649971097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e40c48e0 msgr2=0x7fa7e40c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 --2- 172.21.15.93:0/2649971097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e40c48e0 0x7fa7e40c4d90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40cc4d0 tx=0x7fa7d802b840 comp rx=0 tx=0).stop 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 -- 172.21.15.93:0/2649971097 shutdown_connections 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 --2- 172.21.15.93:0/2649971097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e40c48e0 0x7fa7e40c4d90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 --2- 172.21.15.93:0/2649971097 >> v2:172.21.15.125:3300/0 conn(0x7fa7e4159c00 0x7fa7e40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 -- 172.21.15.93:0/2649971097 >> 172.21.15.93:0/2649971097 conn(0x7fa7e40ce950 msgr2=0x7fa7e40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 -- 172.21.15.93:0/2649971097 shutdown_connections 2023-11-04T01:37:25.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.170+0000 7fa7eb294640 1 -- 172.21.15.93:0/2649971097 wait complete. 2023-11-04T01:37:25.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.171+0000 7fa7eb294640 1 Processor -- start 2023-11-04T01:37:25.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.171+0000 7fa7eb294640 1 -- start start 2023-11-04T01:37:25.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 0x7fa7e41f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7e40c48e0 0x7fa7e4150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4150a60 con 0x7fa7e4159c00 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4156470 con 0x7fa7e40c48e0 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7eb294640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4156750 con 0x7fa7e40adac0 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7e9831640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7e9831640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56722/0 (socket says 172.21.15.93:56722) 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7e9831640 1 -- 172.21.15.93:0/1085018342 learned_addr learned my addr 172.21.15.93:0/1085018342 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7e882f640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7e40c48e0 0x7fa7e4150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.172+0000 7fa7e9030640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 0x7fa7e41f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 -- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 msgr2=0x7fa7e41f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 0x7fa7e41f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 -- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7e40c48e0 msgr2=0x7fa7e4150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7e40c48e0 0x7fa7e4150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 -- 172.21.15.93:0/1085018342 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009400 con 0x7fa7e4159c00 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9030640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 0x7fa7e41f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7e9831640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c7e0 tx=0x7fa7dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00a640 con 0x7fa7e4159c00 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00a7c0 con 0x7fa7e4159c00 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e4156a30 con 0x7fa7e4159c00 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00ab70 con 0x7fa7e4159c00 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.173+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e4154760 con 0x7fa7e4159c00 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.174+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e4074290 con 0x7fa7e4159c00 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.174+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7dc00acd0 con 0x7fa7e4159c00 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.175+0000 7fa7d5ffb640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 0x7fa7c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.175+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fa7dc089050 con 0x7fa7e4159c00 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.175+0000 7fa7e9030640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 0x7fa7c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.175+0000 7fa7e9030640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 0x7fa7c806d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006fd0 tx=0x7fa7e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.179+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7dc053f60 con 0x7fa7e4159c00 2023-11-04T01:37:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.344+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fa7e4153f10 con 0x7fa7e4159c00 2023-11-04T01:37:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.345+0000 7fa7d5ffb640 1 -- 172.21.15.93:0/1085018342 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v41) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7dc0180a0 con 0x7fa7e4159c00 2023-11-04T01:37:25.347 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:25.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 msgr2=0x7fa7c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 0x7fa7c806d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006fd0 tx=0x7fa7e0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 msgr2=0x7fa7e406c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c7e0 tx=0x7fa7dc00cca0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 shutdown_connections 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa7c806ae70 0x7fa7c806d330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7e4159c00 0x7fa7e406c710 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa7e40c48e0 0x7fa7e4150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 --2- 172.21.15.93:0/1085018342 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7e40adac0 0x7fa7e41f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 >> 172.21.15.93:0/1085018342 conn(0x7fa7e40ce950 msgr2=0x7fa7e40cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 shutdown_connections 2023-11-04T01:37:25.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.347+0000 7fa7eb294640 1 -- 172.21.15.93:0/1085018342 wait complete. 2023-11-04T01:37:25.360 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:25.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.460+0000 7f5b6be75640 1 Processor -- start 2023-11-04T01:37:25.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.460+0000 7f5b6be75640 1 -- start start 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b6be75640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5b640d0710 0x7f5b640cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b6be75640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b640cda50 0x7f5b640b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b6be75640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640d0280 con 0x7f5b6415e430 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b6be75640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640cf670 con 0x7f5b640d0710 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b6be75640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640cf950 con 0x7f5b640cda50 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b69c11640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5b6415e430 0x7f5b640cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57324/0 (socket says 172.21.15.93:57324) 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.461+0000 7f5b69c11640 1 -- 172.21.15.93:0/1942033539 learned_addr learned my addr 172.21.15.93:0/1942033539 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113678073 0 0) 0x7f5b640d0280 con 0x7f5b6415e430 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b50003520 con 0x7f5b6415e430 2023-11-04T01:37:25.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b640cda50 0x7f5b640b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b69410640 1 --2- 172.21.15.93:0/1942033539 >> v2:172.21.15.125:3300/0 conn(0x7f5b640d0710 0x7f5b640cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3728845433 0 0) 0x7f5b50003520 con 0x7f5b6415e430 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b640cda50 msgr2=0x7f5b640b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b640cda50 0x7f5b640b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 >> v2:172.21.15.125:3300/0 conn(0x7f5b640d0710 msgr2=0x7f5b640cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 --2- 172.21.15.93:0/1942033539 >> v2:172.21.15.125:3300/0 conn(0x7f5b640d0710 0x7f5b640cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640cfc30 con 0x7f5b6415e430 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5b600019f0 con 0x7f5b6415e430 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 >> v1:172.21.15.93:6789/0 conn(0x7f5b6415e430 legacy=0x7f5b640cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b50003970 0x7f5b50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b500047c0 0x7f5b50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b50005180 0x7f5b5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640cf670 con 0x7f5b50005180 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640cf950 con 0x7f5b500047c0 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5000bfc0 con 0x7f5b50003970 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b69410640 1 --2- 172.21.15.93:0/1942033539 >> v2:172.21.15.125:3300/0 conn(0x7f5b640d0710 0x7f5b640cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b640cda50 0x7f5b640b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b50005180 0x7f5b5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b69c11640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b50003970 0x7f5b50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b69410640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b500047c0 0x7f5b50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 -- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b50003970 msgr2=0x7f5b50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b50003970 0x7f5b50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 -- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b500047c0 msgr2=0x7f5b50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b500047c0 0x7f5b50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.462+0000 7f5b6a412640 1 -- 172.21.15.93:0/1942033539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b50003520 con 0x7f5b50005180 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.463+0000 7f5b6a412640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b50005180 0x7f5b5000b980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5b640cb3f0 tx=0x7f5b500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97da74942ed017bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.463+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c033600 con 0x7f5b50005180 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.463+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c02f050 con 0x7f5b50005180 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.463+0000 7f5b68c0f640 1 -- 172.21.15.93:0/1942033539 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c033980 con 0x7f5b50005180 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 -- 172.21.15.93:0/1942033539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b50005180 msgr2=0x7f5b5000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 --2- 172.21.15.93:0/1942033539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b50005180 0x7f5b5000b980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5b640cb3f0 tx=0x7f5b500057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6a412640 1 -- 172.21.15.93:0/1942033539 reap_dead start 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 -- 172.21.15.93:0/1942033539 shutdown_connections 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 -- 172.21.15.93:0/1942033539 >> 172.21.15.93:0/1942033539 conn(0x7f5b6406ea20 msgr2=0x7f5b6406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 -- 172.21.15.93:0/1942033539 shutdown_connections 2023-11-04T01:37:25.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.464+0000 7f5b6be75640 1 -- 172.21.15.93:0/1942033539 wait complete. 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.465+0000 7f5b6be75640 1 Processor -- start 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.465+0000 7f5b6be75640 1 -- start start 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b6414ffc0 0x7f5b640a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b640b2c10 0x7f5b640c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640b30a0 con 0x7f5b640a8250 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b641f3c00 con 0x7f5b640b2c10 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b641f3ea0 con 0x7f5b6414ffc0 2023-11-04T01:37:25.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56730/0 (socket says 172.21.15.93:56730) 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 -- 172.21.15.93:0/2873772872 learned_addr learned my addr 172.21.15.93:0/2873772872 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 -- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b6414ffc0 msgr2=0x7f5b640a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b6414ffc0 0x7f5b640a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 -- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b640b2c10 msgr2=0x7f5b640c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b640b2c10 0x7f5b640c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 -- 172.21.15.93:0/2873772872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b641f4180 con 0x7f5b640a8250 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b69410640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5b540116d0 tx=0x7f5b54011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400c070 con 0x7f5b640a8250 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b54004220 con 0x7f5b640a8250 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.466+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b641f4460 con 0x7f5b640a8250 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.467+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400f6e0 con 0x7f5b640a8250 2023-11-04T01:37:25.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.467+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b640cbbf0 con 0x7f5b640a8250 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.468+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64074290 con 0x7f5b640a8250 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.468+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b5400f840 con 0x7f5b640a8250 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.468+0000 7f5b5a7fc640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 0x7f5b4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.469+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5b54089910 con 0x7f5b640a8250 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.469+0000 7f5b69c11640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 0x7f5b4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.469+0000 7f5b69c11640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 0x7f5b4806d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5b60001ad0 tx=0x7f5b60004b60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.473+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b54054770 con 0x7f5b640a8250 2023-11-04T01:37:25.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.649+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b640cf040 con 0x7f5b640a8250 2023-11-04T01:37:25.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.650+0000 7f5b5a7fc640 1 -- 172.21.15.93:0/2873772872 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b54057d90 con 0x7f5b640a8250 2023-11-04T01:37:25.652 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:37:25.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 msgr2=0x7f5b4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 0x7f5b4806d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5b60001ad0 tx=0x7f5b60004b60 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 msgr2=0x7f5b640b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5b540116d0 tx=0x7f5b54011b90 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 shutdown_connections 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5b4806ae70 0x7f5b4806d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b640b2c10 0x7f5b640c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b640a8250 0x7f5b640b26d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 --2- 172.21.15.93:0/2873772872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5b6414ffc0 0x7f5b640a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 >> 172.21.15.93:0/2873772872 conn(0x7f5b6406ea20 msgr2=0x7f5b640c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 shutdown_connections 2023-11-04T01:37:25.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25.652+0000 7f5b6be75640 1 -- 172.21.15.93:0/2873772872 wait complete. 2023-11-04T01:37:25.665 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:37:25.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:25.665 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:25.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:25.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[135413]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:25.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:25.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:37:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:25.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:37:25.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:25.731 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:37:25.745 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:25.746 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:25.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:25.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:37:25.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:25.765 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:37:25.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:25.822 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:37:25.823 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:25.823 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:25.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:25.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:37:25.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:25.838 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:37:25.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:25.893 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:37:25.893 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:25.893 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:25.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:25.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:37:25.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:25.913 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:37:25.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:25.971 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:37:25.971 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:26.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.068+0000 7f7edde44640 1 Processor -- start 2023-11-04T01:37:26.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.068+0000 7f7edde44640 1 -- start start 2023-11-04T01:37:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7edde44640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ed80cde60 0x7f7ed815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7edde44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed815e000 con 0x7f7ed80ce240 2023-11-04T01:37:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7edde44640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed815e2e0 con 0x7f7ed815daa0 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7edde44640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed815e5c0 con 0x7f7ed80cde60 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7ed7fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7ed80ce240 0x7f7ed80d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57336/0 (socket says 172.21.15.93:57336) 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.069+0000 7f7ed7fff640 1 -- 172.21.15.93:0/1195834712 learned_addr learned my addr 172.21.15.93:0/1195834712 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936765550 0 0) 0x7f7ed815e000 con 0x7f7ed80ce240 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/1195834712 >> v2:172.21.15.125:3300/0 conn(0x7f7ed80cde60 0x7f7ed815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec4003520 con 0x7f7ed80ce240 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574896394 0 0) 0x7f7ec4003520 con 0x7f7ed80ce240 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 >> v2:172.21.15.125:3300/0 conn(0x7f7ed80cde60 msgr2=0x7f7ed815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 --2- 172.21.15.93:0/1195834712 >> v2:172.21.15.125:3300/0 conn(0x7f7ed80cde60 0x7f7ed815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 >> v1:172.21.15.125:6789/0 conn(0x7f7ed815daa0 legacy=0x7f7ed8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80d1120 con 0x7f7ed80ce240 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f7ed00019f0 con 0x7f7ed80ce240 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 >> v1:172.21.15.93:6789/0 conn(0x7f7ed80ce240 legacy=0x7f7ed80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 0x7f7ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40047c0 0x7f7ec4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4005180 0x7f7ec400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed815e5c0 con 0x7f7ec4003970 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec400c020 con 0x7f7ec40047c0 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec400c1e0 con 0x7f7ec4005180 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 0x7f7ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7eceffd640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40047c0 0x7f7ec4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed7fff640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4005180 0x7f7ec400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 -- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4005180 msgr2=0x7f7ec400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4005180 0x7f7ec400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 -- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40047c0 msgr2=0x7f7ec4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40047c0 0x7f7ec4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed7fff640 1 -- 172.21.15.93:0/1195834712 reap_dead start 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7ed77fe640 1 -- 172.21.15.93:0/1195834712 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4003520 con 0x7f7ec4003970 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.070+0000 7f7eceffd640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec40047c0 0x7f7ec4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.071+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 0x7f7ec4003d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009ac0 tx=0x7f7ec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1fc0ca76d7b449 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.071+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802c6b0 con 0x7f7ec4003970 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.071+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec802c810 con 0x7f7ec4003970 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.071+0000 7f7ed6ffd640 1 -- 172.21.15.93:0/1195834712 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802cba0 con 0x7f7ec4003970 2023-11-04T01:37:26.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 -- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 msgr2=0x7f7ec4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 0x7f7ec4003d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009ac0 tx=0x7f7ec40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 -- 172.21.15.93:0/1195834712 shutdown_connections 2023-11-04T01:37:26.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 --2- 172.21.15.93:0/1195834712 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec4003970 0x7f7ec4003d90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 -- 172.21.15.93:0/1195834712 >> 172.21.15.93:0/1195834712 conn(0x7f7ed8071f30 msgr2=0x7f7ed80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 -- 172.21.15.93:0/1195834712 shutdown_connections 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.072+0000 7f7edde44640 1 -- 172.21.15.93:0/1195834712 wait complete. 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.073+0000 7f7edde44640 1 Processor -- start 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.073+0000 7f7edde44640 1 -- start start 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4003970 0x7f7ed81553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed815ace0 0x7f7ed815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8157770 con 0x7f7ed80b7750 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80b8110 con 0x7f7ed815ace0 2023-11-04T01:37:26.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81572e0 con 0x7f7ec4003970 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56740/0 (socket says 172.21.15.93:56740) 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 -- 172.21.15.93:0/160498982 learned_addr learned my addr 172.21.15.93:0/160498982 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 -- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4003970 msgr2=0x7f7ed81553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4003970 0x7f7ed81553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 -- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed815ace0 msgr2=0x7f7ed815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed815ace0 0x7f7ed815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 -- 172.21.15.93:0/160498982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed81566d0 con 0x7f7ed80b7750 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7eceffd640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000e410 tx=0x7f7ec000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00052e0 con 0x7f7ed80b7750 2023-11-04T01:37:26.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0005440 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00037f0 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.074+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed81569b0 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.075+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8156f70 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.076+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8074290 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.076+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ec0003950 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.076+0000 7f7ed4ff9640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 0x7f7eb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.076+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f7ec0089010 con 0x7f7ed80b7750 2023-11-04T01:37:26.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.076+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 0x7f7eb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.077+0000 7f7ed77fe640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 0x7f7eb806d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8036000 tx=0x7f7ec802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.080+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ec0053f20 con 0x7f7ed80b7750 2023-11-04T01:37:26.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.280+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ed8157420 con 0x7f7ed80b7750 2023-11-04T01:37:26.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.281+0000 7f7ed4ff9640 1 -- 172.21.15.93:0/160498982 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f7ec0019090 con 0x7f7ed80b7750 2023-11-04T01:37:26.283 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:26.284 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:26.284 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:26.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 msgr2=0x7f7eb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 0x7f7eb806d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8036000 tx=0x7f7ec802e000 comp rx=0 tx=0).stop 2023-11-04T01:37:26.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 msgr2=0x7f7ed80b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000e410 tx=0x7f7ec000e8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 shutdown_connections 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eb806ae70 0x7f7eb806d330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ed815ace0 0x7f7ed815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ed80b7750 0x7f7ed80b7bd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 --2- 172.21.15.93:0/160498982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec4003970 0x7f7ed81553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 >> 172.21.15.93:0/160498982 conn(0x7f7ed8071f30 msgr2=0x7f7ed80b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 shutdown_connections 2023-11-04T01:37:26.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.283+0000 7f7edde44640 1 -- 172.21.15.93:0/160498982 wait complete. 2023-11-04T01:37:26.296 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:26.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.394+0000 7fd958087640 1 Processor -- start 2023-11-04T01:37:26.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.394+0000 7fd958087640 1 -- start start 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd958087640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 0x7fd9500c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd958087640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 0x7fd9500ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd958087640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95006a120 con 0x7fd95015ce70 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd958087640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500cdc10 con 0x7fd95015d250 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd958087640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95006a370 con 0x7fd9500c9d70 2023-11-04T01:37:26.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd955e23640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd95015ce70 0x7fd95006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57346/0 (socket says 172.21.15.93:57346) 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd955e23640 1 -- 172.21.15.93:0/387887558 learned_addr learned my addr 172.21.15.93:0/387887558 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd956624640 1 --2- 172.21.15.93:0/387887558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 0x7fd9500ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd955622640 1 --2- 172.21.15.93:0/387887558 >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 0x7fd9500c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747485334 0 0) 0x7fd95006a120 con 0x7fd95015ce70 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003520 con 0x7fd95015ce70 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088370618 0 0) 0x7fd93c003520 con 0x7fd95015ce70 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd956624640 1 -- 172.21.15.93:0/387887558 >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 msgr2=0x7fd9500c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd956624640 1 --2- 172.21.15.93:0/387887558 >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 0x7fd9500c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd956624640 1 -- 172.21.15.93:0/387887558 >> v1:172.21.15.93:6789/0 conn(0x7fd95015ce70 legacy=0x7fd95006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd956624640 1 -- 172.21.15.93:0/387887558 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95006a650 con 0x7fd9500c9d70 2023-11-04T01:37:26.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.395+0000 7fd955622640 1 --2- 172.21.15.93:0/387887558 >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 0x7fd9500c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:26.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.396+0000 7fd956624640 1 --2- 172.21.15.93:0/387887558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 0x7fd9500ccdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd948009d90 tx=0x7fd94802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eafc726d9b8adf53 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.396+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c001670 con 0x7fd9500c9d70 2023-11-04T01:37:26.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.396+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94802c8a0 con 0x7fd9500c9d70 2023-11-04T01:37:26.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.396+0000 7fd954e21640 1 -- 172.21.15.93:0/387887558 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94802cc10 con 0x7fd9500c9d70 2023-11-04T01:37:26.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 -- 172.21.15.93:0/387887558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 msgr2=0x7fd9500ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 --2- 172.21.15.93:0/387887558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 0x7fd9500ccdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd948009d90 tx=0x7fd94802bd70 comp rx=0 tx=0).stop 2023-11-04T01:37:26.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 -- 172.21.15.93:0/387887558 shutdown_connections 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 --2- 172.21.15.93:0/387887558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd9500c9d70 0x7fd9500ccdb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 --2- 172.21.15.93:0/387887558 >> v2:172.21.15.125:3300/0 conn(0x7fd95015d250 0x7fd9500c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 -- 172.21.15.93:0/387887558 >> 172.21.15.93:0/387887558 conn(0x7fd9500b0cd0 msgr2=0x7fd9500b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 -- 172.21.15.93:0/387887558 shutdown_connections 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.397+0000 7fd958087640 1 -- 172.21.15.93:0/387887558 wait complete. 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.398+0000 7fd958087640 1 Processor -- start 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.398+0000 7fd958087640 1 -- start start 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95015ce70 0x7fd9500c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95015d250 0x7fd950155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c9630 con 0x7fd9500c8c40 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c71a0 con 0x7fd95015d250 2023-11-04T01:37:26.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd958087640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c62b0 con 0x7fd95015ce70 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56752/0 (socket says 172.21.15.93:56752) 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 -- 172.21.15.93:0/3708326291 learned_addr learned my addr 172.21.15.93:0/3708326291 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd955e23640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95015ce70 0x7fd9500c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd955622640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95015d250 0x7fd950155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 -- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95015ce70 msgr2=0x7fd9500c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95015ce70 0x7fd9500c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 -- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95015d250 msgr2=0x7fd950155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95015d250 0x7fd950155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 -- 172.21.15.93:0/3708326291 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940009400 con 0x7fd9500c8c40 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.399+0000 7fd956624640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd948009eb0 tx=0x7fd948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948007000 con 0x7fd9500c8c40 2023-11-04T01:37:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948009450 con 0x7fd9500c8c40 2023-11-04T01:37:26.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd948009a70 con 0x7fd9500c8c40 2023-11-04T01:37:26.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948004490 con 0x7fd9500c8c40 2023-11-04T01:37:26.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9500c6870 con 0x7fd9500c8c40 2023-11-04T01:37:26.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.400+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500c7350 con 0x7fd9500c8c40 2023-11-04T01:37:26.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.401+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd94803b070 con 0x7fd9500c8c40 2023-11-04T01:37:26.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.401+0000 7fd9467fc640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.401+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fd9480abe10 con 0x7fd9500c8c40 2023-11-04T01:37:26.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.401+0000 7fd955e23640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.402+0000 7fd955e23640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 0x7fd93406d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007a00 tx=0x7fd94c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.406+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9500c7350 con 0x7fd9500c8c40 2023-11-04T01:37:26.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.573+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9500c7310 con 0x7fd9500c8c40 2023-11-04T01:37:26.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.575+0000 7fd9467fc640 1 -- 172.21.15.93:0/3708326291 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18625 (secure 0 0 0) 0x7fd948039090 con 0x7fd9500c8c40 2023-11-04T01:37:26.577 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:26.577 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":41,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:23.417585+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 msgr2=0x7fd93406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 0x7fd93406d330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007a00 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 msgr2=0x7fd9500c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd948009eb0 tx=0x7fd948004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 shutdown_connections 2023-11-04T01:37:26.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.576+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9500c8c40 0x7fd9500c90f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95015d250 0x7fd950155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 --2- 172.21.15.93:0/3708326291 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd95015ce70 0x7fd9500c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 >> 172.21.15.93:0/3708326291 conn(0x7fd9500b0cd0 msgr2=0x7fd9500ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 shutdown_connections 2023-11-04T01:37:26.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.577+0000 7fd958087640 1 -- 172.21.15.93:0/3708326291 wait complete. 2023-11-04T01:37:26.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:10.466126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:11.597935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:26.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:26.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.691+0000 7fc469f1d640 1 Processor -- start 2023-11-04T01:37:26.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.691+0000 7fc469f1d640 1 -- start start 2023-11-04T01:37:26.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc469f1d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4640cd6d0 0x7fc464161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc469f1d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc4640b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc469f1d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640cde60 con 0x7fc464153e60 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc469f1d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc464160f90 con 0x7fc4640cd6d0 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc469f1d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc464161960 con 0x7fc4640b4880 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc4637fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc464153e60 0x7fc46415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57352/0 (socket says 172.21.15.93:57352) 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.692+0000 7fc4637fe640 1 -- 172.21.15.93:0/3150694745 learned_addr learned my addr 172.21.15.93:0/3150694745 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488000353 0 0) 0x7fc4640cde60 con 0x7fc464153e60 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c003520 con 0x7fc464153e60 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc463fff640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc4640b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 --2- 172.21.15.93:0/3150694745 >> v2:172.21.15.125:3300/0 conn(0x7fc4640cd6d0 0x7fc464161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464707158 0 0) 0x7fc44c003520 con 0x7fc464153e60 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 msgr2=0x7fc4640b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc4640b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 >> v2:172.21.15.125:3300/0 conn(0x7fc4640cd6d0 msgr2=0x7fc464161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 --2- 172.21.15.93:0/3150694745 >> v2:172.21.15.125:3300/0 conn(0x7fc4640cd6d0 0x7fc464161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640b5220 con 0x7fc464153e60 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fc454001670 con 0x7fc464153e60 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 >> v1:172.21.15.93:6789/0 conn(0x7fc464153e60 legacy=0x7fc46415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc44c003970 0x7fc44c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc44c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464160f90 con 0x7fc44c0047c0 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464161960 con 0x7fc44c003970 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c00b980 con 0x7fc4640b4880 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc4637fe640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc44c003970 0x7fc44c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc463fff640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc44c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 -- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 msgr2=0x7fc44c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640b4880 0x7fc44c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 -- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc44c003970 msgr2=0x7fc44c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc44c003970 0x7fc44c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.693+0000 7fc462ffd640 1 -- 172.21.15.93:0/3150694745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c003520 con 0x7fc44c0047c0 2023-11-04T01:37:26.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.694+0000 7fc462ffd640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ac0 tx=0x7fc44c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c964162870f2e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.694+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45802c710 con 0x7fc44c0047c0 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.694+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45802c870 con 0x7fc44c0047c0 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.694+0000 7fc4627fc640 1 -- 172.21.15.93:0/3150694745 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45802cc00 con 0x7fc44c0047c0 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 -- 172.21.15.93:0/3150694745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 msgr2=0x7fc44c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 --2- 172.21.15.93:0/3150694745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc44c004c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ac0 tx=0x7fc44c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc463fff640 1 -- 172.21.15.93:0/3150694745 reap_dead start 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 -- 172.21.15.93:0/3150694745 shutdown_connections 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 -- 172.21.15.93:0/3150694745 >> 172.21.15.93:0/3150694745 conn(0x7fc4640cf880 msgr2=0x7fc4640cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 -- 172.21.15.93:0/3150694745 shutdown_connections 2023-11-04T01:37:26.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.695+0000 7fc469f1d640 1 -- 172.21.15.93:0/3150694745 wait complete. 2023-11-04T01:37:26.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.696+0000 7fc469f1d640 1 Processor -- start 2023-11-04T01:37:26.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.696+0000 7fc469f1d640 1 -- start start 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640cb2e0 0x7fc464154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4640cb740 0x7fc464155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640cae50 con 0x7fc44c0047c0 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640ca240 con 0x7fc4640cb740 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc469f1d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640ca520 con 0x7fc4640cb2e0 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56774/0 (socket says 172.21.15.93:56774) 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 -- 172.21.15.93:0/907768002 learned_addr learned my addr 172.21.15.93:0/907768002 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:26.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 -- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640cb2e0 msgr2=0x7fc464154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640cb2e0 0x7fc464154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 -- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4640cb740 msgr2=0x7fc464155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4640cb740 0x7fc464155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 -- 172.21.15.93:0/907768002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640ca800 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.697+0000 7fc4637fe640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc454007310 tx=0x7fc4540077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.698+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400f8c0 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.698+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45400fa40 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.698+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4640caae0 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.698+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400fdf0 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.698+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc464155220 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.699+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc464074290 con 0x7fc44c0047c0 2023-11-04T01:37:26.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.699+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc45401d460 con 0x7fc44c0047c0 2023-11-04T01:37:26.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.699+0000 7fc44bfff640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 0x7fc45006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.699+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fc454089ba0 con 0x7fc44c0047c0 2023-11-04T01:37:26.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.700+0000 7fc462ffd640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 0x7fc45006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.700+0000 7fc462ffd640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 0x7fc45006d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc458036000 tx=0x7fc45802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.704+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4540548e0 con 0x7fc44c0047c0 2023-11-04T01:37:26.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.870+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4640d0b80 con 0x7fc44c0047c0 2023-11-04T01:37:26.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.870+0000 7fc44bfff640 1 -- 172.21.15.93:0/907768002 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc454057f00 con 0x7fc44c0047c0 2023-11-04T01:37:26.873 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 msgr2=0x7fc45006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 0x7fc45006d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc458036000 tx=0x7fc45802e000 comp rx=0 tx=0).stop 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 msgr2=0x7fc4640c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc454007310 tx=0x7fc4540077d0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 shutdown_connections 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45006ae70 0x7fc45006d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4640cb740 0x7fc464155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4640cb2e0 0x7fc464154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 --2- 172.21.15.93:0/907768002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc44c0047c0 0x7fc4640c8a40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 >> 172.21.15.93:0/907768002 conn(0x7fc4640cf880 msgr2=0x7fc4640d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 shutdown_connections 2023-11-04T01:37:26.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.872+0000 7fc469f1d640 1 -- 172.21.15.93:0/907768002 wait complete. 2023-11-04T01:37:26.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:26.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.984+0000 7f3f0446f640 1 Processor -- start 2023-11-04T01:37:26.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.984+0000 7f3f0446f640 1 -- start start 2023-11-04T01:37:26.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.985+0000 7f3f0446f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3efc0ad730 0x7f3efc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.985+0000 7f3f0446f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0c3900 con 0x7f3efc15ad30 2023-11-04T01:37:26.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.985+0000 7f3f0446f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0c3be0 con 0x7f3efc070e20 2023-11-04T01:37:26.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.985+0000 7f3f0446f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc0ae260 con 0x7f3efc0ad730 2023-11-04T01:37:26.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.985+0000 7f3f0220b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3efc15ad30 0x7f3efc070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57356/0 (socket says 172.21.15.93:57356) 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f0220b640 1 -- 172.21.15.93:0/3397588340 learned_addr learned my addr 172.21.15.93:0/3397588340 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f02a0c640 1 --2- 172.21.15.93:0/3397588340 >> v2:172.21.15.125:3300/0 conn(0x7f3efc0ad730 0x7f3efc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597336546 0 0) 0x7f3efc0c3900 con 0x7f3efc15ad30 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee8003520 con 0x7f3efc15ad30 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f02a0c640 1 -- 172.21.15.93:0/3397588340 >> v1:172.21.15.125:6789/0 conn(0x7f3efc070e20 legacy=0x7f3efc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522582517 0 0) 0x7f3ee8003520 con 0x7f3efc15ad30 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f02a0c640 1 -- 172.21.15.93:0/3397588340 >> v1:172.21.15.93:6789/0 conn(0x7f3efc15ad30 legacy=0x7f3efc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.986+0000 7f3f02a0c640 1 -- 172.21.15.93:0/3397588340 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0c3ec0 con 0x7f3efc0ad730 2023-11-04T01:37:26.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f02a0c640 1 --2- 172.21.15.93:0/3397588340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc0ad730 0x7f3efc0adc80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009d90 tx=0x7f3ef402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67729b318cc6547 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8001670 con 0x7f3efc0ad730 2023-11-04T01:37:26.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef402c8b0 con 0x7f3efc0ad730 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f01209640 1 -- 172.21.15.93:0/3397588340 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef402cc20 con 0x7f3efc0ad730 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f0446f640 1 -- 172.21.15.93:0/3397588340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc0ad730 msgr2=0x7f3efc0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.987+0000 7f3f0446f640 1 --2- 172.21.15.93:0/3397588340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc0ad730 0x7f3efc0adc80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009d90 tx=0x7f3ef402bd80 comp rx=0 tx=0).stop 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.988+0000 7f3f0446f640 1 -- 172.21.15.93:0/3397588340 shutdown_connections 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.988+0000 7f3f0446f640 1 --2- 172.21.15.93:0/3397588340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc0ad730 0x7f3efc0adc80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.988+0000 7f3f0446f640 1 -- 172.21.15.93:0/3397588340 >> 172.21.15.93:0/3397588340 conn(0x7f3efc0ce950 msgr2=0x7f3efc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.988+0000 7f3f0446f640 1 -- 172.21.15.93:0/3397588340 shutdown_connections 2023-11-04T01:37:26.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.988+0000 7f3f0446f640 1 -- 172.21.15.93:0/3397588340 wait complete. 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 Processor -- start 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 -- start start 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc0ad730 0x7f3efc158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc15ad30 0x7f3efc158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1518f0 con 0x7f3efc070e20 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0c5e00 con 0x7f3efc15ad30 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.989+0000 7f3f0446f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc15b530 con 0x7f3efc0ad730 2023-11-04T01:37:26.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56782/0 (socket says 172.21.15.93:56782) 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 -- 172.21.15.93:0/43227894 learned_addr learned my addr 172.21.15.93:0/43227894 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 -- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc0ad730 msgr2=0x7f3efc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc0ad730 0x7f3efc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 -- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc15ad30 msgr2=0x7f3efc158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc15ad30 0x7f3efc158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 -- 172.21.15.93:0/43227894 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4009a70 con 0x7f3efc070e20 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0220b640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80011e0 tx=0x7f3ef800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8005ad0 con 0x7f3efc070e20 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8005c50 con 0x7f3efc070e20 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc15b810 con 0x7f3efc070e20 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80072b0 con 0x7f3efc070e20 2023-11-04T01:37:26.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.990+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0c60e0 con 0x7f3efc070e20 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.991+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc15bd30 con 0x7f3efc070e20 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.992+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ef8007410 con 0x7f3efc070e20 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.992+0000 7f3ef2ffd640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 0x7f3ee006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.992+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f3ef8088ff0 con 0x7f3efc070e20 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.992+0000 7f3f01a0a640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 0x7f3ee006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.992+0000 7f3f01a0a640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 0x7f3ee006d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f60 tx=0x7f3eec0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:26.996+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3efc15bd30 con 0x7f3efc070e20 2023-11-04T01:37:27.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.165+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3efc15bd30 con 0x7f3efc070e20 2023-11-04T01:37:27.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.165+0000 7f3ef2ffd640 1 -- 172.21.15.93:0/43227894 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ef8017020 con 0x7f3efc070e20 2023-11-04T01:37:27.168 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 msgr2=0x7f3ee006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 0x7f3ee006d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f60 tx=0x7f3eec0079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 msgr2=0x7f3efc148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80011e0 tx=0x7f3ef800cb90 comp rx=0 tx=0).stop 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 shutdown_connections 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3ee006ae70 0x7f3ee006d330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3efc15ad30 0x7f3efc158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3efc0ad730 0x7f3efc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 --2- 172.21.15.93:0/43227894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3efc070e20 0x7f3efc148580 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 >> 172.21.15.93:0/43227894 conn(0x7f3efc0ce950 msgr2=0x7f3efc157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 shutdown_connections 2023-11-04T01:37:27.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.167+0000 7f3f0446f640 1 -- 172.21.15.93:0/43227894 wait complete. 2023-11-04T01:37:27.180 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:27.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.280+0000 7f3d9471d640 1 Processor -- start 2023-11-04T01:37:27.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.280+0000 7f3d9471d640 1 -- start start 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 0x7f3d8c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0adac0 0x7f3d8c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0c52d0 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c15aff0 con 0x7f3d8c159c00 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d9471d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c15a3e0 con 0x7f3d8c0adac0 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56788/0 (socket says 172.21.15.93:56788) 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 -- 172.21.15.93:0/1770260395 learned_addr learned my addr 172.21.15.93:0/1770260395 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:27.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d924b9640 1 --2- 172.21.15.93:0/1770260395 >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 0x7f3d8c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d92cba640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0adac0 0x7f3d8c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 -- 172.21.15.93:0/1770260395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0adac0 msgr2=0x7f3d8c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0adac0 0x7f3d8c0adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 -- 172.21.15.93:0/1770260395 >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 msgr2=0x7f3d8c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 --2- 172.21.15.93:0/1770260395 >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 0x7f3d8c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.281+0000 7f3d91cb8640 1 -- 172.21.15.93:0/1770260395 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c15a6c0 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.282+0000 7f3d924b9640 1 --2- 172.21.15.93:0/1770260395 >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 0x7f3d8c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:27.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.282+0000 7f3d91cb8640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0cc4d0 tx=0x7f3d7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b54df0194d0c7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.282+0000 7f3d914b7640 1 -- 172.21.15.93:0/1770260395 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c031870 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.282+0000 7f3d914b7640 1 -- 172.21.15.93:0/1770260395 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0319d0 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.282+0000 7f3d914b7640 1 -- 172.21.15.93:0/1770260395 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c031d60 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 -- 172.21.15.93:0/1770260395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c0c48e0 msgr2=0x7f3d8c0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0cc4d0 tx=0x7f3d7c02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 -- 172.21.15.93:0/1770260395 shutdown_connections 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c0c48e0 0x7f3d8c0c4d90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 --2- 172.21.15.93:0/1770260395 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0adac0 0x7f3d8c0adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 --2- 172.21.15.93:0/1770260395 >> v2:172.21.15.125:3300/0 conn(0x7f3d8c159c00 0x7f3d8c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 -- 172.21.15.93:0/1770260395 >> 172.21.15.93:0/1770260395 conn(0x7f3d8c0ce950 msgr2=0x7f3d8c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 -- 172.21.15.93:0/1770260395 shutdown_connections 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.283+0000 7f3d9471d640 1 -- 172.21.15.93:0/1770260395 wait complete. 2023-11-04T01:37:27.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.284+0000 7f3d9471d640 1 Processor -- start 2023-11-04T01:37:27.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.284+0000 7f3d9471d640 1 -- start start 2023-11-04T01:37:27.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 0x7f3d8c145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0c48e0 0x7f3d8c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c1482a0 con 0x7f3d8c159c00 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c148580 con 0x7f3d8c0adac0 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d9471d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c148860 con 0x7f3d8c0c48e0 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56804/0 (socket says 172.21.15.93:56804) 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 -- 172.21.15.93:0/3386643063 learned_addr learned my addr 172.21.15.93:0/3386643063 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d91cb8640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0c48e0 0x7f3d8c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d924b9640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 0x7f3d8c145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 -- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0c48e0 msgr2=0x7f3d8c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0c48e0 0x7f3d8c06c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 -- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 msgr2=0x7f3d8c145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 0x7f3d8c145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 -- 172.21.15.93:0/3386643063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0094d0 con 0x7f3d8c159c00 2023-11-04T01:37:27.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d924b9640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 0x7f3d8c145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d92cba640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c570 tx=0x7f3d8400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.285+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84004220 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.286+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84004380 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.286+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c148b40 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.286+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84003830 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.286+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c147ef0 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.286+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c074290 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.287+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d84003990 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.287+0000 7f3d82ffd640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 0x7f3d7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.287+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3d840895d0 con 0x7f3d8c159c00 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.287+0000 7f3d924b9640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 0x7f3d7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.288+0000 7f3d924b9640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 0x7f3d7006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b4670 tx=0x7f3d880074b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.292+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d840543c0 con 0x7f3d8c159c00 2023-11-04T01:37:27.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.459+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d8c157b10 con 0x7f3d8c159c00 2023-11-04T01:37:27.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.459+0000 7f3d82ffd640 1 -- 172.21.15.93:0/3386643063 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d840579e0 con 0x7f3d8c159c00 2023-11-04T01:37:27.462 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 msgr2=0x7f3d7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 0x7f3d7006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b4670 tx=0x7f3d880074b0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 msgr2=0x7f3d8c06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c570 tx=0x7f3d8400ca30 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 shutdown_connections 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d7006ae70 0x7f3d7006d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d8c159c00 0x7f3d8c06cca0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d8c0c48e0 0x7f3d8c06c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 --2- 172.21.15.93:0/3386643063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d8c0adac0 0x7f3d8c145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 >> 172.21.15.93:0/3386643063 conn(0x7f3d8c0ce950 msgr2=0x7f3d8c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 shutdown_connections 2023-11-04T01:37:27.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.461+0000 7f3d9471d640 1 -- 172.21.15.93:0/3386643063 wait complete. 2023-11-04T01:37:27.474 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:27.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.574+0000 7f4932705640 1 Processor -- start 2023-11-04T01:37:27.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 -- start start 2023-11-04T01:37:27.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 0x7f492c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 0x7f492c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0cde60 con 0x7f492c153e60 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c160f90 con 0x7f492c0cd6d0 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.575+0000 7f4932705640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c161960 con 0x7f492c0b4880 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f4930ca2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 0x7f492c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f492b7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 0x7f492c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f492bfff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f492c153e60 0x7f492c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:60288/0 (socket says 172.21.15.93:60288) 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f492bfff640 1 -- 172.21.15.93:0/3395675051 learned_addr learned my addr 172.21.15.93:0/3395675051 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f4930ca2640 1 -- 172.21.15.93:0/3395675051 >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 msgr2=0x7f492c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f4930ca2640 1 --2- 172.21.15.93:0/3395675051 >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 0x7f492c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f4930ca2640 1 -- 172.21.15.93:0/3395675051 >> v1:172.21.15.125:6789/0 conn(0x7f492c153e60 legacy=0x7f492c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f4930ca2640 1 -- 172.21.15.93:0/3395675051 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0b5220 con 0x7f492c0b4880 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.576+0000 7f492b7fe640 1 --2- 172.21.15.93:0/3395675051 >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 0x7f492c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f4930ca2640 1 --2- 172.21.15.93:0/3395675051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 0x7f492c0b4ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02118f4b95a0c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f492affd640 1 -- 172.21.15.93:0/3395675051 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492402cc50 con 0x7f492c0b4880 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f492affd640 1 -- 172.21.15.93:0/3395675051 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492402cdb0 con 0x7f492c0b4880 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f492affd640 1 -- 172.21.15.93:0/3395675051 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924034660 con 0x7f492c0b4880 2023-11-04T01:37:27.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f4932705640 1 -- 172.21.15.93:0/3395675051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 msgr2=0x7f492c0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.577+0000 7f4932705640 1 --2- 172.21.15.93:0/3395675051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 0x7f492c0b4ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492402bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 -- 172.21.15.93:0/3395675051 shutdown_connections 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 --2- 172.21.15.93:0/3395675051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0b4880 0x7f492c0b4ce0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 --2- 172.21.15.93:0/3395675051 >> v2:172.21.15.125:3300/0 conn(0x7f492c0cd6d0 0x7f492c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 -- 172.21.15.93:0/3395675051 >> 172.21.15.93:0/3395675051 conn(0x7f492c0cf880 msgr2=0x7f492c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 -- 172.21.15.93:0/3395675051 shutdown_connections 2023-11-04T01:37:27.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.578+0000 7f4932705640 1 -- 172.21.15.93:0/3395675051 wait complete. 2023-11-04T01:37:27.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.579+0000 7f4932705640 1 Processor -- start 2023-11-04T01:37:27.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.579+0000 7f4932705640 1 -- start start 2023-11-04T01:37:27.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.579+0000 7f4932705640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492c0b4880 0x7f492c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0cd6d0 0x7f492c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c155210 con 0x7f492c153e60 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1f6d80 con 0x7f492c0b4880 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c154600 con 0x7f492c0cd6d0 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56812/0 (socket says 172.21.15.93:56812) 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 -- 172.21.15.93:0/3155255302 learned_addr learned my addr 172.21.15.93:0/3155255302 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f492bfff640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492c0b4880 0x7f492c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f492b7fe640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0cd6d0 0x7f492c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 -- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0cd6d0 msgr2=0x7f492c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0cd6d0 0x7f492c156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 -- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492c0b4880 msgr2=0x7f492c153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492c0b4880 0x7f492c153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 -- 172.21.15.93:0/3155255302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920009400 con 0x7f492c153e60 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4930ca2640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f4924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924040650 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49240407b0 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924009a70 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924040b60 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.580+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c154bc0 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.581+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c155380 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.582+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4924040cc0 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.582+0000 7f4928ff9640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 0x7f491806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.582+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f49240ac460 con 0x7f492c153e60 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.582+0000 7f492bfff640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 0x7f491806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.583+0000 7f492bfff640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 0x7f491806d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f491c005880 tx=0x7f491c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.586+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4924077390 con 0x7f492c153e60 2023-11-04T01:37:27.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.753+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f492c074290 con 0x7f492c153e60 2023-11-04T01:37:27.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.753+0000 7f4928ff9640 1 -- 172.21.15.93:0/3155255302 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v42) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4924009450 con 0x7f492c153e60 2023-11-04T01:37:27.756 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 msgr2=0x7f491806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 0x7f491806d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f491c005880 tx=0x7f491c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 msgr2=0x7f492c1556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f4924004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 shutdown_connections 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491806ae70 0x7f491806d330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492c153e60 0x7f492c1556a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492c0cd6d0 0x7f492c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 --2- 172.21.15.93:0/3155255302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492c0b4880 0x7f492c153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 >> 172.21.15.93:0/3155255302 conn(0x7f492c0cf880 msgr2=0x7f492c15dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 shutdown_connections 2023-11-04T01:37:27.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.755+0000 7f4932705640 1 -- 172.21.15.93:0/3155255302 wait complete. 2023-11-04T01:37:27.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:27.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.866+0000 7f5841bf5640 1 Processor -- start 2023-11-04T01:37:27.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.866+0000 7f5841bf5640 1 -- start start 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f5841bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f5841bf5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f583c0b0ae0 0x7f583c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f5841bf5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0b4110 con 0x7f583c06db20 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f5841bf5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c0b49b0 con 0x7f583c0b0ae0 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f5841bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0b43f0 con 0x7f583c159c70 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583bfff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f583c0b0ae0 0x7f583c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:52964/0 (socket says 172.21.15.93:52964) 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 -- 172.21.15.93:0/1919782139 learned_addr learned my addr 172.21.15.93:0/1919782139 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:27.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583affd640 1 --1- 172.21.15.93:0/1919782139 >> v1:172.21.15.125:6789/0 conn(0x7f583c06db20 0x7f583c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:60292/0 (socket says 172.21.15.93:60292) 2023-11-04T01:37:27.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 -- 172.21.15.93:0/1919782139 >> v2:172.21.15.125:3300/0 conn(0x7f583c0b0ae0 msgr2=0x7f583c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 --2- 172.21.15.93:0/1919782139 >> v2:172.21.15.125:3300/0 conn(0x7f583c0b0ae0 0x7f583c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 -- 172.21.15.93:0/1919782139 >> v1:172.21.15.125:6789/0 conn(0x7f583c06db20 legacy=0x7f583c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.867+0000 7f583b7fe640 1 -- 172.21.15.93:0/1919782139 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c0b46d0 con 0x7f583c159c70 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.868+0000 7f583b7fe640 1 --2- 172.21.15.93:0/1919782139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f582c009870 tx=0x7f582c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3be50ed988ac0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.868+0000 7f583a7fc640 1 -- 172.21.15.93:0/1919782139 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c030840 con 0x7f583c159c70 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.868+0000 7f583a7fc640 1 -- 172.21.15.93:0/1919782139 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c0309a0 con 0x7f583c159c70 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.868+0000 7f583a7fc640 1 -- 172.21.15.93:0/1919782139 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c030d30 con 0x7f583c159c70 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 -- 172.21.15.93:0/1919782139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 msgr2=0x7f583c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 --2- 172.21.15.93:0/1919782139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f582c009870 tx=0x7f582c02b980 comp rx=0 tx=0).stop 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 -- 172.21.15.93:0/1919782139 shutdown_connections 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 --2- 172.21.15.93:0/1919782139 >> v2:172.21.15.125:3300/0 conn(0x7f583c0b0ae0 0x7f583c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 --2- 172.21.15.93:0/1919782139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ce370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 -- 172.21.15.93:0/1919782139 >> 172.21.15.93:0/1919782139 conn(0x7f583c0ce950 msgr2=0x7f583c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 -- 172.21.15.93:0/1919782139 shutdown_connections 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.869+0000 7f5841bf5640 1 -- 172.21.15.93:0/1919782139 wait complete. 2023-11-04T01:37:27.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.870+0000 7f5841bf5640 1 Processor -- start 2023-11-04T01:37:27.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.870+0000 7f5841bf5640 1 -- start start 2023-11-04T01:37:27.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f583c0b0ae0 0x7f583c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c14f480 con 0x7f583c06db20 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c14f7a0 con 0x7f583c0b0ae0 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f5841bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c14f9f0 con 0x7f583c159c70 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f583b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56816/0 (socket says 172.21.15.93:56816) 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f583b7fe640 1 -- 172.21.15.93:0/3042016024 learned_addr learned my addr 172.21.15.93:0/3042016024 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f583affd640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f583c0b0ae0 0x7f583c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.871+0000 7f583bfff640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 -- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 msgr2=0x7f583c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 -- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f583c0b0ae0 msgr2=0x7f583c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f583c0b0ae0 0x7f583c0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 -- 172.21.15.93:0/3042016024 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094d0 con 0x7f583c06db20 2023-11-04T01:37:27.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f583b7fe640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f582c0090b0 tx=0x7f582c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c03e070 con 0x7f583c06db20 2023-11-04T01:37:27.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c039800 con 0x7f583c06db20 2023-11-04T01:37:27.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c039bd0 con 0x7f583c06db20 2023-11-04T01:37:27.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c14fcd0 con 0x7f583c06db20 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.872+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c150290 con 0x7f583c06db20 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.873+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c0c79f0 con 0x7f583c06db20 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.873+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f582c042070 con 0x7f583c06db20 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.874+0000 7f5823fff640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 0x7f582806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.874+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f582c0ab380 con 0x7f583c06db20 2023-11-04T01:37:27.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.874+0000 7f583affd640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 0x7f582806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.874+0000 7f583affd640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 0x7f582806d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f583c0711f0 tx=0x7f5830000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:27.878+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f582c0762b0 con 0x7f583c06db20 2023-11-04T01:37:28.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.079+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f583c06d3f0 con 0x7f583c06db20 2023-11-04T01:37:28.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.080+0000 7f5823fff640 1 -- 172.21.15.93:0/3042016024 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f582c0798d0 con 0x7f583c06db20 2023-11-04T01:37:28.082 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:28.083 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:28.083 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:28.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 msgr2=0x7f582806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 0x7f582806d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f583c0711f0 tx=0x7f5830000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 msgr2=0x7f583c14ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f582c0090b0 tx=0x7f582c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 shutdown_connections 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f582806ae70 0x7f582806d330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f583c159c70 0x7f583c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f583c0b0ae0 0x7f583c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 --2- 172.21.15.93:0/3042016024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f583c06db20 0x7f583c14ef40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 >> 172.21.15.93:0/3042016024 conn(0x7f583c0ce950 msgr2=0x7f583c15c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 shutdown_connections 2023-11-04T01:37:28.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.082+0000 7f5841bf5640 1 -- 172.21.15.93:0/3042016024 wait complete. 2023-11-04T01:37:28.095 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:28.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.193+0000 7f3c058bb640 1 Processor -- start 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.193+0000 7f3c058bb640 1 -- start start 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3c058bb640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c000cde60 0x7f3c0015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3c058bb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3c000d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3c058bb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0015e000 con 0x7f3c0015daa0 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3c058bb640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0015e5c0 con 0x7f3c000cde60 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3c058bb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015e2e0 con 0x7f3c000ce240 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bf7fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3c0015daa0 0x7f3c00157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57370/0 (socket says 172.21.15.93:57370) 2023-11-04T01:37:28.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bf7fff640 1 -- 172.21.15.93:0/1139760058 learned_addr learned my addr 172.21.15.93:0/1139760058 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/1139760058 >> v2:172.21.15.125:3300/0 conn(0x7f3c000cde60 0x7f3c0015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bff7fe640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3c000d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434126394 0 0) 0x7f3c0015e000 con 0x7f3c0015daa0 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bec003520 con 0x7f3c0015daa0 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547693797 0 0) 0x7f3bec003520 con 0x7f3c0015daa0 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 msgr2=0x7f3c000d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3c000d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 >> v2:172.21.15.125:3300/0 conn(0x7f3c000cde60 msgr2=0x7f3c0015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 --2- 172.21.15.93:0/1139760058 >> v2:172.21.15.125:3300/0 conn(0x7f3c000cde60 0x7f3c0015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000d1120 con 0x7f3c0015daa0 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3be8001670 con 0x7f3c0015daa0 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/1139760058 >> v2:172.21.15.125:3300/0 conn(0x7f3c000cde60 0x7f3c0015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 >> v1:172.21.15.93:6789/0 conn(0x7f3c0015daa0 legacy=0x7f3c00157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3bec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bec003ef0 0x7f3bec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bec004d00 0x7f3bec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015e5c0 con 0x7f3bec004d00 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015e2e0 con 0x7f3bec003ef0 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec00b980 con 0x7f3c000ce240 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.194+0000 7f3bff7fe640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bec004d00 0x7f3bec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bf7fff640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bec003ef0 0x7f3bec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3bec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 -- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 msgr2=0x7f3bec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c000ce240 0x7f3bec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 -- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bec003ef0 msgr2=0x7f3bec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bec003ef0 0x7f3bec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 -- 172.21.15.93:0/1139760058 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec003520 con 0x7f3bec004d00 2023-11-04T01:37:28.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.195+0000 7f3bff7fe640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bec004d00 0x7f3bec005180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009f90 tx=0x7f3bec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100e539af8eccded server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf802cbc0 con 0x7f3bec004d00 2023-11-04T01:37:28.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800f040 con 0x7f3bec004d00 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3bfe7fc640 1 -- 172.21.15.93:0/1139760058 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8034440 con 0x7f3bec004d00 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 -- 172.21.15.93:0/1139760058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bec004d00 msgr2=0x7f3bec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 --2- 172.21.15.93:0/1139760058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bec004d00 0x7f3bec005180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009f90 tx=0x7f3bec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3bff7fe640 1 -- 172.21.15.93:0/1139760058 reap_dead start 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 -- 172.21.15.93:0/1139760058 shutdown_connections 2023-11-04T01:37:28.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 -- 172.21.15.93:0/1139760058 >> 172.21.15.93:0/1139760058 conn(0x7f3c00071f30 msgr2=0x7f3c000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 -- 172.21.15.93:0/1139760058 shutdown_connections 2023-11-04T01:37:28.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.196+0000 7f3c058bb640 1 -- 172.21.15.93:0/1139760058 wait complete. 2023-11-04T01:37:28.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.197+0000 7f3c058bb640 1 Processor -- start 2023-11-04T01:37:28.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.197+0000 7f3c058bb640 1 -- start start 2023-11-04T01:37:28.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c001f1c60 0x7f3c000cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c00146f30 0x7f3c00142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f6900 con 0x7f3c001f2040 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f5d80 con 0x7f3c001f1c60 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3c058bb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f6060 con 0x7f3c00146f30 2023-11-04T01:37:28.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56836/0 (socket says 172.21.15.93:56836) 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 -- 172.21.15.93:0/2875285431 learned_addr learned my addr 172.21.15.93:0/2875285431 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 -- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c00146f30 msgr2=0x7f3c00142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c00146f30 0x7f3c00142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 -- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c001f1c60 msgr2=0x7f3c000cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c001f1c60 0x7f3c000cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c001f1c60 0x7f3c000cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.198+0000 7f3bf7fff640 1 -- 172.21.15.93:0/2875285431 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c001f6340 con 0x7f3c001f2040 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3bf7fff640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be8004840 tx=0x7f3be8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800f9a0 con 0x7f3c001f2040 2023-11-04T01:37:28.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800fb20 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800fed0 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c001f6620 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.199+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c001467c0 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.200+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00074290 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.200+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3be801d460 con 0x7f3c001f2040 2023-11-04T01:37:28.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.200+0000 7f3bfcff9640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 0x7f3be006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.201+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3be8089b30 con 0x7f3c001f2040 2023-11-04T01:37:28.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.201+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 0x7f3be006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.201+0000 7f3bfeffd640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 0x7f3be006d360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009bf0 tx=0x7f3bf0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.205+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3be80549b0 con 0x7f3c001f2040 2023-11-04T01:37:28.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.374+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c0006c0d0 con 0x7f3c001f2040 2023-11-04T01:37:28.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.375+0000 7f3bfcff9640 1 -- 172.21.15.93:0/2875285431 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18582 (secure 0 0 0) 0x7f3be8057fd0 con 0x7f3c001f2040 2023-11-04T01:37:28.377 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:28.378 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":42,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:27.022104+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 msgr2=0x7f3be006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 0x7f3be006d360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009bf0 tx=0x7f3bf0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 msgr2=0x7f3c000cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be8004840 tx=0x7f3be8007720 comp rx=0 tx=0).stop 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 shutdown_connections 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3be006aea0 0x7f3be006d360 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3c00146f30 0x7f3c00142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3c001f2040 0x7f3c000cc6c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 --2- 172.21.15.93:0/2875285431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c001f1c60 0x7f3c000cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 >> 172.21.15.93:0/2875285431 conn(0x7f3c00071f30 msgr2=0x7f3c000d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 shutdown_connections 2023-11-04T01:37:28.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.377+0000 7f3c058bb640 1 -- 172.21.15.93:0/2875285431 wait complete. 2023-11-04T01:37:28.391 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:28.391 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:28.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.488+0000 7fc1d2ab4640 1 Processor -- start 2023-11-04T01:37:28.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.488+0000 7fc1d2ab4640 1 -- start start 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d2ab4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1cc15ad80 0x7fc1cc0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d2ab4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc0c9a40 0x7fc1cc0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d2ab4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc06b720 con 0x7fc1cc06a1b0 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d2ab4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc0ca410 con 0x7fc1cc15ad80 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d2ab4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc06cf60 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1cc15ad80 0x7fc1cc0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1cc15ad80 0x7fc1cc0abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56850/0 (socket says 172.21.15.93:56850) 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 -- 172.21.15.93:0/1340254665 learned_addr learned my addr 172.21.15.93:0/1340254665 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 -- 172.21.15.93:0/1340254665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc0c9a40 msgr2=0x7fc1cc0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 --2- 172.21.15.93:0/1340254665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc0c9a40 0x7fc1cc0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 -- 172.21.15.93:0/1340254665 >> v1:172.21.15.125:6789/0 conn(0x7fc1cc06a1b0 legacy=0x7fc1cc06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.489+0000 7fc1d0850640 1 -- 172.21.15.93:0/1340254665 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0ac390 con 0x7fc1cc15ad80 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.490+0000 7fc1d0850640 1 --2- 172.21.15.93:0/1340254665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc15ad80 0x7fc1cc0abe50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009870 tx=0x7fc1c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392dd3647a6c4680 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.490+0000 7fc1cb7fe640 1 -- 172.21.15.93:0/1340254665 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0031640 con 0x7fc1cc15ad80 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.490+0000 7fc1cb7fe640 1 -- 172.21.15.93:0/1340254665 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c00317a0 con 0x7fc1cc15ad80 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.490+0000 7fc1cb7fe640 1 -- 172.21.15.93:0/1340254665 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0031b30 con 0x7fc1cc15ad80 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/1340254665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc15ad80 msgr2=0x7fc1cc0abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/1340254665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc15ad80 0x7fc1cc0abe50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009870 tx=0x7fc1c002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/1340254665 shutdown_connections 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/1340254665 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc0c9a40 0x7fc1cc0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/1340254665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc15ad80 0x7fc1cc0abe50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/1340254665 >> 172.21.15.93:0/1340254665 conn(0x7fc1cc0b0cd0 msgr2=0x7fc1cc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/1340254665 shutdown_connections 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.491+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/1340254665 wait complete. 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.492+0000 7fc1d2ab4640 1 Processor -- start 2023-11-04T01:37:28.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.492+0000 7fc1d2ab4640 1 -- start start 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1cc06a1b0 0x7fc1cc0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc15ad80 0x7fc1cc14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0c85a0 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc14f6c0 con 0x7fc1cc06a1b0 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0c7990 con 0x7fc1cc15ad80 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56864/0 (socket says 172.21.15.93:56864) 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 -- 172.21.15.93:0/2464993702 learned_addr learned my addr 172.21.15.93:0/2464993702 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 -- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc15ad80 msgr2=0x7fc1cc14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc15ad80 0x7fc1cc14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 -- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1cc06a1b0 msgr2=0x7fc1cc0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1cc06a1b0 0x7fc1cc0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 -- 172.21.15.93:0/2464993702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00094d0 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1cbfff640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b420 tx=0x7fc1b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011830 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8011990 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011d40 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.493+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc0c7c70 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.494+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc0c8230 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.494+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc074290 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.495+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1b801b460 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.495+0000 7fc1c97fa640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 0x7fc1b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.495+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc1b80893d0 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.495+0000 7fc1d0850640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 0x7fc1b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.496+0000 7fc1d0850640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 0x7fc1b006d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0036000 tx=0x7fc1c0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.499+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1b8054250 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.702+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1cc0c86e0 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.703+0000 7fc1c97fa640 1 -- 172.21.15.93:0/2464993702 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fc1b8057870 con 0x7fc1cc0c9a40 2023-11-04T01:37:28.705 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:28.705 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:28.706 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:28.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 msgr2=0x7fc1b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 0x7fc1b006d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0036000 tx=0x7fc1c0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 msgr2=0x7fc1cc14b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b420 tx=0x7fc1b800b8e0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 shutdown_connections 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc1b006ae70 0x7fc1b006d330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1cc15ad80 0x7fc1cc14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1cc0c9a40 0x7fc1cc14b7d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 --2- 172.21.15.93:0/2464993702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1cc06a1b0 0x7fc1cc0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 >> 172.21.15.93:0/2464993702 conn(0x7fc1cc0b0cd0 msgr2=0x7fc1cc0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 shutdown_connections 2023-11-04T01:37:28.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.705+0000 7fc1d2ab4640 1 -- 172.21.15.93:0/2464993702 wait complete. 2023-11-04T01:37:28.718 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:28.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.815+0000 7f1626d55640 1 Processor -- start 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.815+0000 7f1626d55640 1 -- start start 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.816+0000 7f1626d55640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16200cde60 0x7f162015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.816+0000 7f1626d55640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.816+0000 7f1626d55640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162015e000 con 0x7f162015daa0 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.816+0000 7f1626d55640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162015e5c0 con 0x7f16200cde60 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.816+0000 7f1626d55640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162015e2e0 con 0x7f16200ce240 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16200cde60 0x7f162015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f16252f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16200cde60 0x7f162015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:40034/0 (socket says 172.21.15.93:40034) 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f16252f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:53012/0 (socket says 172.21.15.93:53012) 2023-11-04T01:37:28.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 -- 172.21.15.93:0/1106675311 learned_addr learned my addr 172.21.15.93:0/1106675311 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 -- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 msgr2=0x7f16200d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 -- 172.21.15.93:0/1106675311 >> v1:172.21.15.125:6789/0 conn(0x7f162015daa0 legacy=0x7f1620157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f1624af1640 1 -- 172.21.15.93:0/1106675311 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200d1120 con 0x7f16200cde60 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f161f7fe640 1 -- 172.21.15.93:0/1106675311 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868249724 0 0) 0x7f162015e000 con 0x7f162015daa0 2023-11-04T01:37:28.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.817+0000 7f16252f2640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:28.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f1624af1640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200cde60 0x7f162015d560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1610009870 tx=0x7f161002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bb2302a3042320 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f161f7fe640 1 -- 172.21.15.93:0/1106675311 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610030840 con 0x7f16200cde60 2023-11-04T01:37:28.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f161f7fe640 1 -- 172.21.15.93:0/1106675311 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100309a0 con 0x7f16200cde60 2023-11-04T01:37:28.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f161f7fe640 1 -- 172.21.15.93:0/1106675311 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610030d30 con 0x7f16200cde60 2023-11-04T01:37:28.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f1626d55640 1 -- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200cde60 msgr2=0x7f162015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.818+0000 7f1626d55640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200cde60 0x7f162015d560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1610009870 tx=0x7f161002b980 comp rx=0 tx=0).stop 2023-11-04T01:37:28.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 -- 172.21.15.93:0/1106675311 shutdown_connections 2023-11-04T01:37:28.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200ce240 0x7f16200d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 --2- 172.21.15.93:0/1106675311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200cde60 0x7f162015d560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 -- 172.21.15.93:0/1106675311 >> 172.21.15.93:0/1106675311 conn(0x7f1620071f30 msgr2=0x7f16200cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 -- 172.21.15.93:0/1106675311 shutdown_connections 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.819+0000 7f1626d55640 1 -- 172.21.15.93:0/1106675311 wait complete. 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.820+0000 7f1626d55640 1 Processor -- start 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.820+0000 7f1626d55640 1 -- start start 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200cde60 0x7f16200cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200ce240 0x7f16201f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200cbe30 con 0x7f162015daa0 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200caf40 con 0x7f16200ce240 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200cb220 con 0x7f16200cde60 2023-11-04T01:37:28.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56878/0 (socket says 172.21.15.93:56878) 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 -- 172.21.15.93:0/333755451 learned_addr learned my addr 172.21.15.93:0/333755451 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 -- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200cde60 msgr2=0x7f16200cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200cde60 0x7f16200cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 -- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200ce240 msgr2=0x7f16201f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200ce240 0x7f16201f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 -- 172.21.15.93:0/333755451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009a70 con 0x7f162015daa0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f16252f2640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f1618009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618014480 con 0x7f162015daa0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800f040 con 0x7f162015daa0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100094d0 con 0x7f162015daa0 2023-11-04T01:37:28.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618014800 con 0x7f162015daa0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.821+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16200cb7e0 con 0x7f162015daa0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.822+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620074290 con 0x7f162015daa0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.823+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1618014960 con 0x7f162015daa0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.823+0000 7f161d7fa640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 0x7f160c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.823+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f161808a8f0 con 0x7f162015daa0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.823+0000 7f1624af1640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 0x7f160c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.824+0000 7f1624af1640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 0x7f160c06d360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1610036000 tx=0x7f161003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:28.827+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1618055650 con 0x7f162015daa0 2023-11-04T01:37:29.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.028+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16200cbf70 con 0x7f162015daa0 2023-11-04T01:37:29.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.029+0000 7f161d7fa640 1 -- 172.21.15.93:0/333755451 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f1618018070 con 0x7f162015daa0 2023-11-04T01:37:29.032 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:29.032 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:12.619808+0000","modified":"2023-11-04T01:37:14.621855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6837/3895579334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3895579334},{"type":"v1","addr":"172.21.15.93:6837","nonce":3895579334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:29.032 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 16 2023-11-04T01:37:29.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 msgr2=0x7f160c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 0x7f160c06d360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1610036000 tx=0x7f161003b040 comp rx=0 tx=0).stop 2023-11-04T01:37:29.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 msgr2=0x7f162015c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f1618009f90 comp rx=0 tx=0).stop 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 shutdown_connections 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f160c06aea0 0x7f160c06d360 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f162015daa0 0x7f162015c4b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16200ce240 0x7f16201f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 --2- 172.21.15.93:0/333755451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16200cde60 0x7f16200cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 >> 172.21.15.93:0/333755451 conn(0x7f1620071f30 msgr2=0x7f16201551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 shutdown_connections 2023-11-04T01:37:29.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.031+0000 7f1626d55640 1 -- 172.21.15.93:0/333755451 wait complete. 2023-11-04T01:37:29.044 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:29.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.141+0000 7f2c98834640 1 Processor -- start 2023-11-04T01:37:29.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.141+0000 7f2c98834640 1 -- start start 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c98834640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 0x7f2c940ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c98834640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c940b0cd0 0x7f2c94070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c98834640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940cc990 con 0x7f2c940cace0 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c98834640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940ccc70 con 0x7f2c940b0cd0 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c98834640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940c9ce0 con 0x7f2c940cda60 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c940b0cd0 0x7f2c94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c940b0cd0 0x7f2c94070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56890/0 (socket says 172.21.15.93:56890) 2023-11-04T01:37:29.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 -- 172.21.15.93:0/3213585274 learned_addr learned my addr 172.21.15.93:0/3213585274 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c9259c640 1 --2- 172.21.15.93:0/3213585274 >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 0x7f2c940ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 -- 172.21.15.93:0/3213585274 >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 msgr2=0x7f2c940ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/3213585274 >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 0x7f2c940ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 -- 172.21.15.93:0/3213585274 >> v1:172.21.15.125:6789/0 conn(0x7f2c940cace0 legacy=0x7f2c9406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c91d9b640 1 -- 172.21.15.93:0/3213585274 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940c9fc0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.142+0000 7f2c9259c640 1 --2- 172.21.15.93:0/3213585274 >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 0x7f2c940ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/3213585274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c94070630 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c940cf800 tx=0x7f2c8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d263c9a3e10a9db4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c9159a640 1 -- 172.21.15.93:0/3213585274 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84031870 con 0x7f2c940b0cd0 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c9159a640 1 -- 172.21.15.93:0/3213585274 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c840319d0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c9159a640 1 -- 172.21.15.93:0/3213585274 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84031d60 con 0x7f2c940b0cd0 2023-11-04T01:37:29.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 -- 172.21.15.93:0/3213585274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 msgr2=0x7f2c94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 --2- 172.21.15.93:0/3213585274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c94070630 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c940cf800 tx=0x7f2c8402b910 comp rx=0 tx=0).stop 2023-11-04T01:37:29.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 -- 172.21.15.93:0/3213585274 shutdown_connections 2023-11-04T01:37:29.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 --2- 172.21.15.93:0/3213585274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c94070630 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 --2- 172.21.15.93:0/3213585274 >> v2:172.21.15.125:3300/0 conn(0x7f2c940cda60 0x7f2c940ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.143+0000 7f2c98834640 1 -- 172.21.15.93:0/3213585274 >> 172.21.15.93:0/3213585274 conn(0x7f2c940ce950 msgr2=0x7f2c940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.144+0000 7f2c98834640 1 -- 172.21.15.93:0/3213585274 shutdown_connections 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.144+0000 7f2c98834640 1 -- 172.21.15.93:0/3213585274 wait complete. 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.145+0000 7f2c98834640 1 Processor -- start 2023-11-04T01:37:29.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.145+0000 7f2c98834640 1 -- start start 2023-11-04T01:37:29.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.145+0000 7f2c98834640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.145+0000 7f2c98834640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 0x7f2c94158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.145+0000 7f2c98834640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 0x7f2c940c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c98834640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c4780 con 0x7f2c940b0cd0 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c98834640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c6f20 con 0x7f2c940cace0 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c98834640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c77c0 con 0x7f2c940cda60 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56894/0 (socket says 172.21.15.93:56894) 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 -- 172.21.15.93:0/108073388 learned_addr learned my addr 172.21.15.93:0/108073388 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 0x7f2c94158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c92d9d640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 0x7f2c940c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 -- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 msgr2=0x7f2c940c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 0x7f2c940c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 -- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 msgr2=0x7f2c94158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 0x7f2c94158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 -- 172.21.15.93:0/108073388 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840094d0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 0x7f2c94158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c92d9d640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 0x7f2c940c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c9259c640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c820 tx=0x7f2c8800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88007a30 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88007b90 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940c35d0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800ce10 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.146+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940c7450 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.147+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94074290 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.147+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c880113f0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.148+0000 7f2c82ffd640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 0x7f2c7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.148+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2c880899a0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.148+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 0x7f2c7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.148+0000 7f2c91d9b640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 0x7f2c7406d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c84036000 tx=0x7f2c8403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.152+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c88054790 con 0x7f2c940b0cd0 2023-11-04T01:37:29.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.322+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c940b48d0 con 0x7f2c940b0cd0 2023-11-04T01:37:29.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.323+0000 7f2c82ffd640 1 -- 172.21.15.93:0/108073388 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18582 (secure 0 0 0) 0x7f2c8801f090 con 0x7f2c940b0cd0 2023-11-04T01:37:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":42,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:27.022104+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:10.466126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:11.597935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 msgr2=0x7f2c7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 0x7f2c7406d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c84036000 tx=0x7f2c8403c040 comp rx=0 tx=0).stop 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 msgr2=0x7f2c941f0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c820 tx=0x7f2c8800cce0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 shutdown_connections 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c7406ae70 0x7f2c7406d330 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c940cda60 0x7f2c940c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c940cace0 0x7f2c94158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 --2- 172.21.15.93:0/108073388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c940b0cd0 0x7f2c941f0410 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.325+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 >> 172.21.15.93:0/108073388 conn(0x7f2c940ce950 msgr2=0x7f2c940b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.326+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 shutdown_connections 2023-11-04T01:37:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.326+0000 7f2c98834640 1 -- 172.21.15.93:0/108073388 wait complete. 2023-11-04T01:37:29.339 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:37:29.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.437+0000 7fd2951e7640 1 Processor -- start 2023-11-04T01:37:29.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.437+0000 7fd2951e7640 1 -- start start 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd2951e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 0x7fd290161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd2951e7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd2900b4880 0x7fd2900b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd2951e7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900cde60 con 0x7fd290153e60 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd2951e7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd290160f90 con 0x7fd2900b4880 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd2951e7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd290161960 con 0x7fd2900cd6d0 2023-11-04T01:37:29.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28ed9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd290153e60 0x7fd29015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57378/0 (socket says 172.21.15.93:57378) 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28f59e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd2900b4880 0x7fd2900b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28ed9d640 1 -- 172.21.15.93:0/2250647429 learned_addr learned my addr 172.21.15.93:0/2250647429 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28e59c640 1 --2- 172.21.15.93:0/2250647429 >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 0x7fd290161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28f59e640 1 -- 172.21.15.93:0/2250647429 >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 msgr2=0x7fd290161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28f59e640 1 --2- 172.21.15.93:0/2250647429 >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 0x7fd290161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28f59e640 1 -- 172.21.15.93:0/2250647429 >> v1:172.21.15.93:6789/0 conn(0x7fd290153e60 legacy=0x7fd29015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28f59e640 1 -- 172.21.15.93:0/2250647429 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900b5220 con 0x7fd2900b4880 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.438+0000 7fd28e59c640 1 --2- 172.21.15.93:0/2250647429 >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 0x7fd290161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:29.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.439+0000 7fd28f59e640 1 --2- 172.21.15.93:0/2250647429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900b4880 0x7fd2900b4ce0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd2900c9e80 tx=0x7fd28802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f148d54a04364f06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.440+0000 7fd28dd9b640 1 -- 172.21.15.93:0/2250647429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288031830 con 0x7fd2900b4880 2023-11-04T01:37:29.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.440+0000 7fd28dd9b640 1 -- 172.21.15.93:0/2250647429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288031990 con 0x7fd2900b4880 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.440+0000 7fd28dd9b640 1 -- 172.21.15.93:0/2250647429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288031d20 con 0x7fd2900b4880 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 -- 172.21.15.93:0/2250647429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900b4880 msgr2=0x7fd2900b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 --2- 172.21.15.93:0/2250647429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900b4880 0x7fd2900b4ce0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd2900c9e80 tx=0x7fd28802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 -- 172.21.15.93:0/2250647429 shutdown_connections 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 --2- 172.21.15.93:0/2250647429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900b4880 0x7fd2900b4ce0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 --2- 172.21.15.93:0/2250647429 >> v2:172.21.15.125:3300/0 conn(0x7fd2900cd6d0 0x7fd290161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 -- 172.21.15.93:0/2250647429 >> 172.21.15.93:0/2250647429 conn(0x7fd2900cf880 msgr2=0x7fd2900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 -- 172.21.15.93:0/2250647429 shutdown_connections 2023-11-04T01:37:29.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.441+0000 7fd2951e7640 1 -- 172.21.15.93:0/2250647429 wait complete. 2023-11-04T01:37:29.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.442+0000 7fd2951e7640 1 Processor -- start 2023-11-04T01:37:29.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.442+0000 7fd2951e7640 1 -- start start 2023-11-04T01:37:29.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 0x7fd2900c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 0x7fd290154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900c89e0 con 0x7fd2900cd6d0 2023-11-04T01:37:29.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900c7ec0 con 0x7fd2900b4880 2023-11-04T01:37:29.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd2951e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2901553b0 con 0x7fd290153e60 2023-11-04T01:37:29.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56914/0 (socket says 172.21.15.93:56914) 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28e59c640 1 -- 172.21.15.93:0/913345475 learned_addr learned my addr 172.21.15.93:0/913345475 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28ed9d640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 0x7fd2900c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28f59e640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 0x7fd290154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.443+0000 7fd28e59c640 1 -- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 msgr2=0x7fd290154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28e59c640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 0x7fd290154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28e59c640 1 -- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 msgr2=0x7fd2900c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28e59c640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 0x7fd2900c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28e59c640 1 -- 172.21.15.93:0/913345475 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009400 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28ed9d640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 0x7fd2900c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28f59e640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 0x7fd290154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd28e59c640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd28400e7e0 tx=0x7fd28400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284004030 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284004190 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2900c8140 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284004520 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.444+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2900c8700 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.445+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290074290 con 0x7fd2900cd6d0 2023-11-04T01:37:29.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.445+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd28400c6d0 con 0x7fd2900cd6d0 2023-11-04T01:37:29.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.446+0000 7fd2777fe640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 0x7fd27c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.446+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd2840895c0 con 0x7fd2900cd6d0 2023-11-04T01:37:29.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.446+0000 7fd28ed9d640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 0x7fd27c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.446+0000 7fd28ed9d640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 0x7fd27c06d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd280005c00 tx=0x7fd280009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.450+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2840543b0 con 0x7fd2900cd6d0 2023-11-04T01:37:29.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.649+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd2900d0b80 con 0x7fd2900cd6d0 2023-11-04T01:37:29.652 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:37:29.650+0000 7f76f40f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:37:29.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.651+0000 7fd2777fe640 1 -- 172.21.15.93:0/913345475 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd2840579d0 con 0x7fd2900cd6d0 2023-11-04T01:37:29.653 INFO:teuthology.orchestra.run.smithi093.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:37:29.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 msgr2=0x7fd27c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 0x7fd27c06d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd280005c00 tx=0x7fd280009040 comp rx=0 tx=0).stop 2023-11-04T01:37:29.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 msgr2=0x7fd2900c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd28400e7e0 tx=0x7fd28400eca0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 shutdown_connections 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd27c06ae70 0x7fd27c06d330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd290153e60 0x7fd290154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2900cd6d0 0x7fd2900c7980 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 --2- 172.21.15.93:0/913345475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2900b4880 0x7fd2900c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 >> 172.21.15.93:0/913345475 conn(0x7fd2900cf880 msgr2=0x7fd2900cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 shutdown_connections 2023-11-04T01:37:29.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.653+0000 7fd2951e7640 1 -- 172.21.15.93:0/913345475 wait complete. 2023-11-04T01:37:29.659 INFO:tasks.ceph.mds.c.smithi093.stderr: -686> 2023-11-04T01:37:16.748+0000 7f4e2a443640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:29.669 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:37:29.681 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.768+0000 7fad15739640 1 Processor -- start 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.768+0000 7fad15739640 1 -- start start 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad15739640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad1015b120 0x7fad1006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad15739640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad10065df0 con 0x7fad1015ad40 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad15739640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad10066040 con 0x7fad100c9b60 2023-11-04T01:37:29.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad15739640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1006bc40 con 0x7fad1015b120 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fad1015ad40 0x7fad1015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57380/0 (socket says 172.21.15.93:57380) 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0effd640 1 -- 172.21.15.93:0/2438318339 learned_addr learned my addr 172.21.15.93:0/2438318339 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/2438318339 >> v2:172.21.15.125:3300/0 conn(0x7fad1015b120 0x7fad1006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122076468 0 0) 0x7fad10065df0 con 0x7fad1015ad40 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facfc003520 con 0x7fad1015ad40 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561921276 0 0) 0x7fad10066040 con 0x7fad100c9b60 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad10065df0 con 0x7fad100c9b60 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1987131622 0 0) 0x7facfc003520 con 0x7fad1015ad40 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 >> v2:172.21.15.125:3300/0 conn(0x7fad1015b120 msgr2=0x7fad1006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 --2- 172.21.15.93:0/2438318339 >> v2:172.21.15.125:3300/0 conn(0x7fad1015b120 0x7fad1006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.769+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 >> v1:172.21.15.125:6789/0 conn(0x7fad100c9b60 legacy=0x7fad10070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10066320 con 0x7fad1015ad40 2023-11-04T01:37:29.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7facf8001670 con 0x7fad1015ad40 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 >> v1:172.21.15.93:6789/0 conn(0x7fad1015ad40 legacy=0x7fad1015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc003b00 0x7facfc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 0x7facfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facfc005180 0x7facfc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1006bc40 con 0x7facfc0047c0 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc00c000 con 0x7facfc005180 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc00c1c0 con 0x7facfc003b00 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 0x7facfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0effd640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc003b00 0x7facfc003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0f7fe640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facfc005180 0x7facfc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 -- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc003b00 msgr2=0x7facfc003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc003b00 0x7facfc003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 -- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facfc005180 msgr2=0x7facfc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facfc005180 0x7facfc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0f7fe640 1 -- 172.21.15.93:0/2438318339 reap_dead start 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.770+0000 7fad0e7fc640 1 -- 172.21.15.93:0/2438318339 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc003520 con 0x7facfc0047c0 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 0x7facfc004c40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fad00009a90 tx=0x7facfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc80ac02d551667 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0002c680 con 0x7facfc0047c0 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0002c7e0 con 0x7facfc0047c0 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad0dffb640 1 -- 172.21.15.93:0/2438318339 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0002cb70 con 0x7facfc0047c0 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 -- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 msgr2=0x7facfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 0x7facfc004c40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fad00009a90 tx=0x7facfc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 -- 172.21.15.93:0/2438318339 shutdown_connections 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 --2- 172.21.15.93:0/2438318339 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7facfc0047c0 0x7facfc004c40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 -- 172.21.15.93:0/2438318339 >> 172.21.15.93:0/2438318339 conn(0x7fad100cbc90 msgr2=0x7fad100cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 -- 172.21.15.93:0/2438318339 shutdown_connections 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.771+0000 7fad15739640 1 -- 172.21.15.93:0/2438318339 wait complete. 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 Processor -- start 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 -- start start 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc0047c0 0x7fad100c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1014b4b0 0x7fad100c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad100c7540 con 0x7fad100c8860 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad100c77c0 con 0x7fad1014b4b0 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.773+0000 7fad15739640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad100c7aa0 con 0x7facfc0047c0 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56948/0 (socket says 172.21.15.93:56948) 2023-11-04T01:37:29.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 -- 172.21.15.93:0/3431893689 learned_addr learned my addr 172.21.15.93:0/3431893689 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0e7fc640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1014b4b0 0x7fad100c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 -- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc0047c0 msgr2=0x7fad100c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc0047c0 0x7fad100c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 -- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1014b4b0 msgr2=0x7fad100c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1014b4b0 0x7fad100c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 -- 172.21.15.93:0/3431893689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100c7d80 con 0x7fad100c8860 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad0f7fe640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fad100c97f0 tx=0x7fad0800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08006e20 con 0x7fad100c8860 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08003970 con 0x7fad100c8860 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08003d20 con 0x7fad100c8860 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad100c8060 con 0x7fad100c8860 2023-11-04T01:37:29.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.774+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1014b930 con 0x7fad100c8860 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.775+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad10074290 con 0x7fad100c8860 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.775+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad08005030 con 0x7fad100c8860 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.776+0000 7fad077fe640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 0x7facf006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.776+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fad08088a10 con 0x7fad100c8860 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.776+0000 7fad0effd640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 0x7facf006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.776+0000 7fad0effd640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 0x7facf006d360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7facf8000c00 tx=0x7facf8000fe0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.780+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad080537c0 con 0x7fad100c8860 2023-11-04T01:37:29.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:29.981+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad1015ebd0 con 0x7fad100c8860 2023-11-04T01:37:30.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.653+0000 7fad077fe640 1 -- 172.21.15.93:0/3431893689 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad080190a0 con 0x7fad100c8860 2023-11-04T01:37:30.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 msgr2=0x7facf006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 0x7facf006d360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7facf8000c00 tx=0x7facf8000fe0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 msgr2=0x7fad100c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fad100c97f0 tx=0x7fad0800fd40 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 shutdown_connections 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7facf006aea0 0x7facf006d360 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad100c8860 0x7fad100c30b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1014b4b0 0x7fad100c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 --2- 172.21.15.93:0/3431893689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7facfc0047c0 0x7fad100c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 >> 172.21.15.93:0/3431893689 conn(0x7fad100cbc90 msgr2=0x7fad10156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 shutdown_connections 2023-11-04T01:37:30.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.655+0000 7fad15739640 1 -- 172.21.15.93:0/3431893689 wait complete. 2023-11-04T01:37:30.671 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:37:30.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.815+0000 7f22f6578640 1 Processor -- start 2023-11-04T01:37:30.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.815+0000 7f22f6578640 1 -- start start 2023-11-04T01:37:30.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22f6578640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22f0165ba0 0x7f22f0167f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22f6578640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f0160af0 con 0x7f22f00cb320 2023-11-04T01:37:30.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22f6578640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f00c51e0 con 0x7f22f015a950 2023-11-04T01:37:30.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22f6578640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f0160d90 con 0x7f22f0165ba0 2023-11-04T01:37:30.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22ef7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f22f00cb320 0x7f22f00cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57388/0 (socket says 172.21.15.93:57388) 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22ef7fe640 1 -- 172.21.15.93:0/2113298102 learned_addr learned my addr 172.21.15.93:0/2113298102 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028111020 0 0) 0x7f22f0160af0 con 0x7f22f00cb320 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d8003520 con 0x7f22f00cb320 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.816+0000 7f22f4b15640 1 --2- 172.21.15.93:0/2113298102 >> v2:172.21.15.125:3300/0 conn(0x7f22f0165ba0 0x7f22f0167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836393280 0 0) 0x7f22d8003520 con 0x7f22f00cb320 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 >> v2:172.21.15.125:3300/0 conn(0x7f22f0165ba0 msgr2=0x7f22f0167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 --2- 172.21.15.93:0/2113298102 >> v2:172.21.15.125:3300/0 conn(0x7f22f0165ba0 0x7f22f0167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 >> v1:172.21.15.125:6789/0 conn(0x7f22f015a950 legacy=0x7f22f00ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0161070 con 0x7f22f00cb320 2023-11-04T01:37:30.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f22e4001670 con 0x7f22f00cb320 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 >> v1:172.21.15.93:6789/0 conn(0x7f22f00cb320 legacy=0x7f22f00cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22d8003970 0x7f22d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22d8005180 0x7f22d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0160d90 con 0x7f22d80047c0 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800c020 con 0x7f22d8005180 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d800c1e0 con 0x7f22d8003970 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22f4b15640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22d8005180 0x7f22d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22effff640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22d8003970 0x7f22d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 -- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22d8003970 msgr2=0x7f22d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22d8003970 0x7f22d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 -- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22d8005180 msgr2=0x7f22d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22d8005180 0x7f22d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22f4b15640 1 -- 172.21.15.93:0/2113298102 reap_dead start 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22ef7fe640 1 -- 172.21.15.93:0/2113298102 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8003520 con 0x7f22d80047c0 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.817+0000 7f22effff640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22d8003970 0x7f22d8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001050 tx=0x7f22d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7904ef2401ce50c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4005ad0 con 0x7f22d80047c0 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e4005c30 con 0x7f22d80047c0 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22eeffd640 1 -- 172.21.15.93:0/2113298102 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e402ca50 con 0x7f22d80047c0 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22f6578640 1 -- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 msgr2=0x7f22d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.818+0000 7f22f6578640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001050 tx=0x7f22d80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.819+0000 7f22f6578640 1 -- 172.21.15.93:0/2113298102 shutdown_connections 2023-11-04T01:37:30.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.819+0000 7f22f6578640 1 --2- 172.21.15.93:0/2113298102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22d8004c40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.819+0000 7f22f6578640 1 -- 172.21.15.93:0/2113298102 >> 172.21.15.93:0/2113298102 conn(0x7f22f00b05d0 msgr2=0x7f22f00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.819+0000 7f22f6578640 1 -- 172.21.15.93:0/2113298102 shutdown_connections 2023-11-04T01:37:30.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.819+0000 7f22f6578640 1 -- 172.21.15.93:0/2113298102 wait complete. 2023-11-04T01:37:30.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.820+0000 7f22f6578640 1 Processor -- start 2023-11-04T01:37:30.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.820+0000 7f22f6578640 1 -- start start 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 0x7f22f0149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 0x7f22f00c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0151e70 con 0x7f22d80047c0 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0149880 con 0x7f22f01519f0 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00abb20 con 0x7f22f00c6190 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56964/0 (socket says 172.21.15.93:56964) 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 -- 172.21.15.93:0/4175145558 learned_addr learned my addr 172.21.15.93:0/4175145558 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 0x7f22f0149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 -- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 msgr2=0x7f22f00c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f4b15640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 0x7f22f00c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 0x7f22f00c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 -- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 msgr2=0x7f22f0149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 0x7f22f0149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 -- 172.21.15.93:0/4175145558 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00abe00 con 0x7f22d80047c0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 0x7f22f0149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f4b15640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 0x7f22f00c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22effff640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f22e000e4b0 tx=0x7f22e000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0017070 con 0x7f22d80047c0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0007e90 con 0x7f22d80047c0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f00ac0e0 con 0x7f22d80047c0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00052e0 con 0x7f22d80047c0 2023-11-04T01:37:30.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.821+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f014a210 con 0x7f22d80047c0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.822+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f004e490 con 0x7f22d80047c0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.823+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22e0007020 con 0x7f22d80047c0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.823+0000 7f22ecff9640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 0x7f22dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.823+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f22e0088f30 con 0x7f22d80047c0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.823+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 0x7f22dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.824+0000 7f22ef7fe640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 0x7f22dc06d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f22e4034000 tx=0x7f22e4007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.827+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22e0053ce0 con 0x7f22d80047c0 2023-11-04T01:37:30.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:30.994+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22f014aa10 con 0x7f22d80047c0 2023-11-04T01:37:31.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.659+0000 7f22ecff9640 1 -- 172.21.15.93:0/4175145558 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f22e0057300 con 0x7f22d80047c0 2023-11-04T01:37:31.662 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 msgr2=0x7f22dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 0x7f22dc06d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f22e4034000 tx=0x7f22e4007000 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 msgr2=0x7f22f0149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f22e000e4b0 tx=0x7f22e000e970 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 shutdown_connections 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f22dc06aea0 0x7f22dc06d360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f22f00c6190 0x7f22f00c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f01519f0 0x7f22f0149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 --2- 172.21.15.93:0/4175145558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22d80047c0 0x7f22f0149a20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 >> 172.21.15.93:0/4175145558 conn(0x7f22f00b05d0 msgr2=0x7f22f00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 shutdown_connections 2023-11-04T01:37:31.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.662+0000 7f22f6578640 1 -- 172.21.15.93:0/4175145558 wait complete. 2023-11-04T01:37:31.677 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:37:31.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.779+0000 7fa5cc92c640 1 Processor -- start 2023-11-04T01:37:31.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.779+0000 7fa5cc92c640 1 -- start start 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5c815e1a0 0x7fa5c815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa5c80b6570 0x7fa5c80cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c80cbdf0 0x7fa5c80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80b3d80 con 0x7fa5c815e1a0 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80cc250 con 0x7fa5c80b6570 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5cc92c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c815f7a0 con 0x7fa5c80cbdf0 2023-11-04T01:37:31.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5c659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5c815e1a0 0x7fa5c815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5c659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5c815e1a0 0x7fa5c815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42918/0 (socket says 172.21.15.93:42918) 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.780+0000 7fa5c659c640 1 -- 172.21.15.93:0/3846996755 learned_addr learned my addr 172.21.15.93:0/3846996755 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 -- 172.21.15.93:0/3846996755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c80cbdf0 msgr2=0x7fa5c80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3846996755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c80cbdf0 0x7fa5c80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 -- 172.21.15.93:0/3846996755 >> v2:172.21.15.125:3300/0 conn(0x7fa5c80b6570 msgr2=0x7fa5c80cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3846996755 >> v2:172.21.15.125:3300/0 conn(0x7fa5c80b6570 0x7fa5c80cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 -- 172.21.15.93:0/3846996755 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80ce0e0 con 0x7fa5c815e1a0 2023-11-04T01:37:31.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.781+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3846996755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c815e1a0 0x7fa5c815e8b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806fe10 tx=0x7fa5b802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5834648ace999241 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5c559a640 1 -- 172.21.15.93:0/3846996755 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b802c950 con 0x7fa5c815e1a0 2023-11-04T01:37:31.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5c559a640 1 -- 172.21.15.93:0/3846996755 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b802cab0 con 0x7fa5c815e1a0 2023-11-04T01:37:31.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5c559a640 1 -- 172.21.15.93:0/3846996755 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b802ce40 con 0x7fa5c815e1a0 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3846996755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c815e1a0 msgr2=0x7fa5c815e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3846996755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c815e1a0 0x7fa5c815e8b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806fe10 tx=0x7fa5b802bdb0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3846996755 shutdown_connections 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3846996755 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c80cbdf0 0x7fa5c80b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3846996755 >> v2:172.21.15.125:3300/0 conn(0x7fa5c80b6570 0x7fa5c80cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3846996755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c815e1a0 0x7fa5c815e8b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3846996755 >> 172.21.15.93:0/3846996755 conn(0x7fa5c806ea20 msgr2=0x7fa5c806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3846996755 shutdown_connections 2023-11-04T01:37:31.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.782+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3846996755 wait complete. 2023-11-04T01:37:31.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.784+0000 7fa5cc92c640 1 Processor -- start 2023-11-04T01:37:31.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.784+0000 7fa5cc92c640 1 -- start start 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5c80cbdf0 0x7fa5c80c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c815e1a0 0x7fa5c80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b1840 con 0x7fa5c80b6570 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b1b20 con 0x7fa5c80cbdf0 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5cc92c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b1e00 con 0x7fa5c815e1a0 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5c659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5c659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42928/0 (socket says 172.21.15.93:42928) 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.785+0000 7fa5c659c640 1 -- 172.21.15.93:0/3221611428 learned_addr learned my addr 172.21.15.93:0/3221611428 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c5d9b640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5c80cbdf0 0x7fa5c80c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c6d9d640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c815e1a0 0x7fa5c80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 -- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c815e1a0 msgr2=0x7fa5c80b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c815e1a0 0x7fa5c80b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 -- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5c80cbdf0 msgr2=0x7fa5c80c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5c80cbdf0 0x7fa5c80c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 -- 172.21.15.93:0/3221611428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009b30 con 0x7fa5c80b6570 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5c659c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000f80 tx=0x7fa5b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b803e450 con 0x7fa5c80b6570 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b803e5b0 con 0x7fa5c80b6570 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c80b20e0 con 0x7fa5c80b6570 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b803e960 con 0x7fa5c80b6570 2023-11-04T01:37:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.786+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80b26a0 con 0x7fa5c80b6570 2023-11-04T01:37:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.787+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c804e490 con 0x7fa5c80b6570 2023-11-04T01:37:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.788+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5b803eac0 con 0x7fa5c80b6570 2023-11-04T01:37:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.788+0000 7fa5b6ffd640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 0x7fa5a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.788+0000 7fa5c5d9b640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 0x7fa5a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.788+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fa5b80ac640 con 0x7fa5c80b6570 2023-11-04T01:37:31.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.789+0000 7fa5c5d9b640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 0x7fa5a806d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80d04f0 tx=0x7fa5bc009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.793+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5b80775d0 con 0x7fa5c80b6570 2023-11-04T01:37:31.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:31.965+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5c80cf140 con 0x7fa5c80b6570 2023-11-04T01:37:32.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.660+0000 7fa5b6ffd640 1 -- 172.21.15.93:0/3221611428 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5b807abf0 con 0x7fa5c80b6570 2023-11-04T01:37:32.663 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' removed 2023-11-04T01:37:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 msgr2=0x7fa5a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 0x7fa5a806d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80d04f0 tx=0x7fa5bc009060 comp rx=0 tx=0).stop 2023-11-04T01:37:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 msgr2=0x7fa5c80b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000f80 tx=0x7fa5b8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 shutdown_connections 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5a806ae70 0x7fa5a806d330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5c815e1a0 0x7fa5c80b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5c80cbdf0 0x7fa5c80c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 --2- 172.21.15.93:0/3221611428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5c80b6570 0x7fa5c80b0880 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.666+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 >> 172.21.15.93:0/3221611428 conn(0x7fa5c806ea20 msgr2=0x7fa5c80c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.667+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 shutdown_connections 2023-11-04T01:37:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.667+0000 7fa5cc92c640 1 -- 172.21.15.93:0/3221611428 wait complete. 2023-11-04T01:37:32.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:37:32.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.786+0000 7f8404155640 1 Processor -- start 2023-11-04T01:37:32.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.786+0000 7f8404155640 1 -- start start 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f8404155640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc0b1a40 0x7f83fc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f8404155640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f83fc06a830 0x7f83fc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f8404155640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc160990 con 0x7f83fc1605b0 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f8404155640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0cc7c0 con 0x7f83fc06a830 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f8404155640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0cd750 con 0x7f83fc0b1a40 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f83fc06a830 0x7f83fc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f83fc06a830 0x7f83fc0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42940/0 (socket says 172.21.15.93:42940) 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 -- 172.21.15.93:0/599857800 learned_addr learned my addr 172.21.15.93:0/599857800 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:32.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84016f0640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc0b1a40 0x7f83fc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 -- 172.21.15.93:0/599857800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc0b1a40 msgr2=0x7f83fc0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:32.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc0b1a40 0x7f83fc0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 -- 172.21.15.93:0/599857800 >> v1:172.21.15.125:6789/0 conn(0x7f83fc1605b0 legacy=0x7f83fc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.787+0000 7f84026f2640 1 -- 172.21.15.93:0/599857800 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc0cc4e0 con 0x7f83fc06a830 2023-11-04T01:37:32.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.788+0000 7f84026f2640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc06a830 0x7f83fc0cf9f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009e50 tx=0x7f83f402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129c976502bcc6f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.788+0000 7f8400eef640 1 -- 172.21.15.93:0/599857800 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f402c9e0 con 0x7f83fc06a830 2023-11-04T01:37:32.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.788+0000 7f8400eef640 1 -- 172.21.15.93:0/599857800 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f402cb40 con 0x7f83fc06a830 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.788+0000 7f8400eef640 1 -- 172.21.15.93:0/599857800 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40343f0 con 0x7f83fc06a830 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 -- 172.21.15.93:0/599857800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc06a830 msgr2=0x7f83fc0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc06a830 0x7f83fc0cf9f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009e50 tx=0x7f83f402be40 comp rx=0 tx=0).stop 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 -- 172.21.15.93:0/599857800 shutdown_connections 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc06a830 0x7f83fc0cf9f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 --2- 172.21.15.93:0/599857800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc0b1a40 0x7f83fc0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 -- 172.21.15.93:0/599857800 >> 172.21.15.93:0/599857800 conn(0x7f83fc071820 msgr2=0x7f83fc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 -- 172.21.15.93:0/599857800 shutdown_connections 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.789+0000 7f8404155640 1 -- 172.21.15.93:0/599857800 wait complete. 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.790+0000 7f8404155640 1 Processor -- start 2023-11-04T01:37:32.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.790+0000 7f8404155640 1 -- start start 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc06a830 0x7f83fc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83fc1605b0 0x7f83fc1f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b5300 con 0x7f83fc0b4230 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b46f0 con 0x7f83fc1605b0 2023-11-04T01:37:32.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b49d0 con 0x7f83fc06a830 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42952/0 (socket says 172.21.15.93:42952) 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 -- 172.21.15.93:0/1469202198 learned_addr learned my addr 172.21.15.93:0/1469202198 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 -- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc06a830 msgr2=0x7f83fc0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc06a830 0x7f83fc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 -- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83fc1605b0 msgr2=0x7f83fc1f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83fc1605b0 0x7f83fc1f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 -- 172.21.15.93:0/1469202198 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009b30 con 0x7f83fc0b4230 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f84026f2640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009e50 tx=0x7f83f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4009510 con 0x7f83fc0b4230 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f403e450 con 0x7f83fc0b4230 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc0b4cb0 con 0x7f83fc0b4230 2023-11-04T01:37:32.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.791+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f403e800 con 0x7f83fc0b4230 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.792+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc0b35c0 con 0x7f83fc0b4230 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.792+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc0672a0 con 0x7f83fc0b4230 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.793+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83f403e960 con 0x7f83fc0b4230 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.793+0000 7f83f27fc640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 0x7f83e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.793+0000 7f8401ef1640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 0x7f83e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.793+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f83f40ac2b0 con 0x7f83fc0b4230 2023-11-04T01:37:32.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.794+0000 7f8401ef1640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 0x7f83e006d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f60 tx=0x7f83f80079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.798+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83f4077450 con 0x7f83fc0b4230 2023-11-04T01:37:32.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.965+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f83fc074290 con 0x7f83fc0b4230 2023-11-04T01:37:32.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.968+0000 7f83f27fc640 1 -- 172.21.15.93:0/1469202198 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f83f407aa70 con 0x7f83fc0b4230 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 msgr2=0x7f83e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 0x7f83e006d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f60 tx=0x7f83f80079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 msgr2=0x7f83fc0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009e50 tx=0x7f83f4004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 shutdown_connections 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83e006ae70 0x7f83e006d330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83fc0b4230 0x7f83fc0cade0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83fc1605b0 0x7f83fc1f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 --2- 172.21.15.93:0/1469202198 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83fc06a830 0x7f83fc0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 >> 172.21.15.93:0/1469202198 conn(0x7f83fc071820 msgr2=0x7f83fc0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 shutdown_connections 2023-11-04T01:37:32.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:32.970+0000 7f8404155640 1 -- 172.21.15.93:0/1469202198 wait complete. 2023-11-04T01:37:32.983 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:37:33.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.080+0000 7f106c8e1640 1 Processor -- start 2023-11-04T01:37:33.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.080+0000 7f106c8e1640 1 -- start start 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f106c8e1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f10680c9e10 0x7f10681659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f106c8e1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106806cfa0 con 0x7f10680b42c0 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f106c8e1640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106806d280 con 0x7f106815ad80 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f106c8e1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106806d560 con 0x7f10680c9e10 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1066d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f10680c9e10 0x7f10681659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1065d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f10680b42c0 0x7f10680c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54992/0 (socket says 172.21.15.93:54992) 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1065d9b640 1 -- 172.21.15.93:0/1707604674 learned_addr learned my addr 172.21.15.93:0/1707604674 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:33.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1066d9d640 1 -- 172.21.15.93:0/1707604674 >> v1:172.21.15.125:6789/0 conn(0x7f106815ad80 legacy=0x7f106806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1066d9d640 1 -- 172.21.15.93:0/1707604674 >> v1:172.21.15.93:6789/0 conn(0x7f10680b42c0 legacy=0x7f10680c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f1066d9d640 1 -- 172.21.15.93:0/1707604674 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106806d840 con 0x7f10680c9e10 2023-11-04T01:37:33.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.081+0000 7f106559a640 1 -- 172.21.15.93:0/1707604674 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048902792 0 0) 0x7f106806cfa0 con 0x7f10680b42c0 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.082+0000 7f1066d9d640 1 --2- 172.21.15.93:0/1707604674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10680c9e10 0x7f10681659e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1060009d90 tx=0x7f106002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed4431aa7b2a87e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.082+0000 7f106559a640 1 -- 172.21.15.93:0/1707604674 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106002cd00 con 0x7f10680c9e10 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.082+0000 7f106559a640 1 -- 172.21.15.93:0/1707604674 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106002ce60 con 0x7f10680c9e10 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.082+0000 7f106559a640 1 -- 172.21.15.93:0/1707604674 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060034660 con 0x7f10680c9e10 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 -- 172.21.15.93:0/1707604674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10680c9e10 msgr2=0x7f10681659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 --2- 172.21.15.93:0/1707604674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10680c9e10 0x7f10681659e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1060009d90 tx=0x7f106002bf50 comp rx=0 tx=0).stop 2023-11-04T01:37:33.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 -- 172.21.15.93:0/1707604674 shutdown_connections 2023-11-04T01:37:33.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 --2- 172.21.15.93:0/1707604674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10680c9e10 0x7f10681659e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 -- 172.21.15.93:0/1707604674 >> 172.21.15.93:0/1707604674 conn(0x7f10680ce950 msgr2=0x7f10680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 -- 172.21.15.93:0/1707604674 shutdown_connections 2023-11-04T01:37:33.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.083+0000 7f106c8e1640 1 -- 172.21.15.93:0/1707604674 wait complete. 2023-11-04T01:37:33.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.084+0000 7f106c8e1640 1 Processor -- start 2023-11-04T01:37:33.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.084+0000 7f106c8e1640 1 -- start start 2023-11-04T01:37:33.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10680b42c0 0x7f10680acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10680c9e10 0x7f10680c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10680c43c0 con 0x7f106815ad80 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10680c3e00 con 0x7f10680b42c0 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106c8e1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10680c40e0 con 0x7f10680c9e10 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42964/0 (socket says 172.21.15.93:42964) 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 -- 172.21.15.93:0/121645264 learned_addr learned my addr 172.21.15.93:0/121645264 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1065d9b640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10680c9e10 0x7f10680c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f106659c640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10680b42c0 0x7f10680acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 -- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10680c9e10 msgr2=0x7f10680c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10680c9e10 0x7f10680c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 -- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10680b42c0 msgr2=0x7f10680acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10680b42c0 0x7f10680acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 -- 172.21.15.93:0/121645264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009a70 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.085+0000 7f1066d9d640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1060009d90 tx=0x7f1060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.086+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060003b90 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.086+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060003cf0 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.086+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106815b6d0 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.086+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060004230 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.086+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10680c4e00 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.087+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106815bbf0 con 0x7f106815ad80 2023-11-04T01:37:33.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.087+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f106003b040 con 0x7f106815ad80 2023-11-04T01:37:33.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.087+0000 7f1056ffd640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 0x7f104806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.088+0000 7f106659c640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 0x7f104806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.088+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f10600ac400 con 0x7f106815ad80 2023-11-04T01:37:33.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.088+0000 7f106659c640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 0x7f104806d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f105800a730 tx=0x7f1058008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.092+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f106815bbf0 con 0x7f106815ad80 2023-11-04T01:37:33.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.322+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f106815bbf0 con 0x7f106815ad80 2023-11-04T01:37:33.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.668+0000 7f1056ffd640 1 -- 172.21.15.93:0/121645264 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v118) v1 ==== 173+0+0 (secure 0 0 0) 0x7f106815bbf0 con 0x7f106815ad80 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 msgr2=0x7f104806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 0x7f104806d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f105800a730 tx=0x7f1058008040 comp rx=0 tx=0).stop 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 msgr2=0x7f106815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1060009d90 tx=0x7f1060004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 shutdown_connections 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f104806ae70 0x7f104806d330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f106815ad80 0x7f106815bed0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10680c9e10 0x7f10680c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 --2- 172.21.15.93:0/121645264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10680b42c0 0x7f10680acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 >> 172.21.15.93:0/121645264 conn(0x7f10680ce950 msgr2=0x7f10680af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 shutdown_connections 2023-11-04T01:37:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.670+0000 7f106c8e1640 1 -- 172.21.15.93:0/121645264 wait complete. 2023-11-04T01:37:33.683 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:37:33.684 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:37:33.684 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:37:33.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:33.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.781+0000 7f36ae389640 1 Processor -- start 2023-11-04T01:37:33.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.781+0000 7f36ae389640 1 -- start start 2023-11-04T01:37:33.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ae389640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ae389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ae389640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a806d310 con 0x7f36a815ab70 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ae389640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80cba70 con 0x7f36a806a830 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ae389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8161c50 con 0x7f36a806eba0 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36a77fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36a77fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:58508/0 (socket says 172.21.15.93:58508) 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:57922/0 (socket says 172.21.15.93:57922) 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36a77fe640 1 -- 172.21.15.93:0/89119542 learned_addr learned my addr 172.21.15.93:0/89119542 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36a7fff640 1 --1- 172.21.15.93:0/89119542 >> v1:172.21.15.125:6789/0 conn(0x7f36a815ab70 0x7f36a806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:54206/0 (socket says 172.21.15.93:54206) 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 -- 172.21.15.93:0/89119542 >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 msgr2=0x7f36a80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 --2- 172.21.15.93:0/89119542 >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 -- 172.21.15.93:0/89119542 >> v1:172.21.15.125:6789/0 conn(0x7f36a815ab70 legacy=0x7f36a806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36ac926640 1 -- 172.21.15.93:0/89119542 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a815d860 con 0x7f36a806eba0 2023-11-04T01:37:33.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.782+0000 7f36a77fe640 1 --2- 172.21.15.93:0/89119542 >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.783+0000 7f36ac926640 1 --2- 172.21.15.93:0/89119542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009d90 tx=0x7f36a002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae929a66fb661708 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.783+0000 7f36a6ffd640 1 -- 172.21.15.93:0/89119542 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a002cbc0 con 0x7f36a806eba0 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.783+0000 7f36a6ffd640 1 -- 172.21.15.93:0/89119542 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a002cd20 con 0x7f36a806eba0 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.783+0000 7f36a6ffd640 1 -- 172.21.15.93:0/89119542 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0034660 con 0x7f36a806eba0 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 -- 172.21.15.93:0/89119542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 msgr2=0x7f36a80ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 --2- 172.21.15.93:0/89119542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009d90 tx=0x7f36a002be10 comp rx=0 tx=0).stop 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 -- 172.21.15.93:0/89119542 shutdown_connections 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 --2- 172.21.15.93:0/89119542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a80ae5e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 --2- 172.21.15.93:0/89119542 >> v2:172.21.15.125:3300/0 conn(0x7f36a806a830 0x7f36a80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 -- 172.21.15.93:0/89119542 >> 172.21.15.93:0/89119542 conn(0x7f36a8098d40 msgr2=0x7f36a80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 -- 172.21.15.93:0/89119542 shutdown_connections 2023-11-04T01:37:33.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.784+0000 7f36ae389640 1 -- 172.21.15.93:0/89119542 wait complete. 2023-11-04T01:37:33.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.785+0000 7f36ae389640 1 Processor -- start 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.785+0000 7f36ae389640 1 -- start start 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a806a830 0x7f36a815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c4d30 con 0x7f36a815ab70 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80b4640 con 0x7f36a806a830 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ae389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80b4920 con 0x7f36a806eba0 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ac926640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ac926640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42978/0 (socket says 172.21.15.93:42978) 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36ac926640 1 -- 172.21.15.93:0/1435183274 learned_addr learned my addr 172.21.15.93:0/1435183274 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:33.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36a77fe640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.786+0000 7f36a7fff640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a806a830 0x7f36a815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 -- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 msgr2=0x7f36a815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a815c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 -- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a806a830 msgr2=0x7f36a815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a806a830 0x7f36a815c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 -- 172.21.15.93:0/1435183274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009460 con 0x7f36a815ab70 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ac926640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009eb0 tx=0x7f36a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0040650 con 0x7f36a815ab70 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a002ce90 con 0x7f36a815ab70 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00409f0 con 0x7f36a815ab70 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a0009a70 con 0x7f36a815ab70 2023-11-04T01:37:33.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.787+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a80b4ee0 con 0x7f36a815ab70 2023-11-04T01:37:33.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.788+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8074290 con 0x7f36a815ab70 2023-11-04T01:37:33.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.788+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36a0040b50 con 0x7f36a815ab70 2023-11-04T01:37:33.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.789+0000 7f36a4ff9640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.789+0000 7f36a7fff640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.789+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f36a00ac000 con 0x7f36a815ab70 2023-11-04T01:37:33.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.789+0000 7f36a7fff640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 0x7f369406d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f369c000fb0 tx=0x7f369c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.793+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36a0077250 con 0x7f36a815ab70 2023-11-04T01:37:33.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.961+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a80b50a0 con 0x7f36a815ab70 2023-11-04T01:37:33.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.961+0000 7f36a4ff9640 1 -- 172.21.15.93:0/1435183274 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14956 (secure 0 0 0) 0x7f36a0009450 con 0x7f36a815ab70 2023-11-04T01:37:33.964 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:33.964 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":45,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:32.660799+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6837/3895579334":"2023-11-05T01:37:29.651452+0000","172.21.15.93:6835/3895579334":"2023-11-05T01:37:29.651452+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 msgr2=0x7f369406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 0x7f369406d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f369c000fb0 tx=0x7f369c007e30 comp rx=0 tx=0).stop 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 msgr2=0x7f36a80c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009eb0 tx=0x7f36a0004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 shutdown_connections 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36a815ab70 0x7f36a80c4000 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f36a806eba0 0x7f36a815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 --2- 172.21.15.93:0/1435183274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a806a830 0x7f36a815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.963+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 >> 172.21.15.93:0/1435183274 conn(0x7f36a8098d40 msgr2=0x7f36a806a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.964+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 shutdown_connections 2023-11-04T01:37:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:33.964+0000 7f36ae389640 1 -- 172.21.15.93:0/1435183274 wait complete. 2023-11-04T01:37:33.977 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:33.977 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:34.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.081+0000 7f5243e64640 1 Processor -- start 2023-11-04T01:37:34.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.081+0000 7f5243e64640 1 -- start start 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5243e64640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f523c160430 0x7f523c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5243e64640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f523c06c3a0 0x7f523c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5243e64640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c0b2fc0 con 0x7f523c0b2b60 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5243e64640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0cb580 con 0x7f523c160430 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5243e64640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c06c7d0 con 0x7f523c06c3a0 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5241c00640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f523c160430 0x7f523c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5241c00640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f523c160430 0x7f523c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42984/0 (socket says 172.21.15.93:42984) 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5241c00640 1 -- 172.21.15.93:0/2508992514 learned_addr learned my addr 172.21.15.93:0/2508992514 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.082+0000 7f5242401640 1 --2- 172.21.15.93:0/2508992514 >> v2:172.21.15.125:3300/0 conn(0x7f523c06c3a0 0x7f523c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.083+0000 7f5241c00640 1 -- 172.21.15.93:0/2508992514 >> v2:172.21.15.125:3300/0 conn(0x7f523c06c3a0 msgr2=0x7f523c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.083+0000 7f5241c00640 1 --2- 172.21.15.93:0/2508992514 >> v2:172.21.15.125:3300/0 conn(0x7f523c06c3a0 0x7f523c0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.083+0000 7f5241c00640 1 -- 172.21.15.93:0/2508992514 >> v1:172.21.15.125:6789/0 conn(0x7f523c0b2b60 legacy=0x7f523c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.083+0000 7f5241c00640 1 -- 172.21.15.93:0/2508992514 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c06ca40 con 0x7f523c160430 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.083+0000 7f5241c00640 1 --2- 172.21.15.93:0/2508992514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c160430 0x7f523c0b2620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c4600 tx=0x7f523802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce83acd11383526 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5240bfe640 1 -- 172.21.15.93:0/2508992514 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238030860 con 0x7f523c160430 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5240bfe640 1 -- 172.21.15.93:0/2508992514 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52380309c0 con 0x7f523c160430 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5240bfe640 1 -- 172.21.15.93:0/2508992514 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238030d50 con 0x7f523c160430 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 -- 172.21.15.93:0/2508992514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c160430 msgr2=0x7f523c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 --2- 172.21.15.93:0/2508992514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c160430 0x7f523c0b2620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c4600 tx=0x7f523802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 -- 172.21.15.93:0/2508992514 shutdown_connections 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 --2- 172.21.15.93:0/2508992514 >> v2:172.21.15.125:3300/0 conn(0x7f523c06c3a0 0x7f523c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 --2- 172.21.15.93:0/2508992514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c160430 0x7f523c0b2620 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.084+0000 7f5243e64640 1 -- 172.21.15.93:0/2508992514 >> 172.21.15.93:0/2508992514 conn(0x7f523c06ea20 msgr2=0x7f523c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.085+0000 7f5243e64640 1 -- 172.21.15.93:0/2508992514 shutdown_connections 2023-11-04T01:37:34.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.085+0000 7f5243e64640 1 -- 172.21.15.93:0/2508992514 wait complete. 2023-11-04T01:37:34.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 Processor -- start 2023-11-04T01:37:34.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 -- start start 2023-11-04T01:37:34.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 0x7f523c155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f523c160430 0x7f523c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c155f00 con 0x7f523c0b2b60 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1554e0 con 0x7f523c06c3a0 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.086+0000 7f5243e64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c154f20 con 0x7f523c160430 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42994/0 (socket says 172.21.15.93:42994) 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 -- 172.21.15.93:0/1319065793 learned_addr learned my addr 172.21.15.93:0/1319065793 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f5241c00640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 0x7f523c155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 -- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f523c160430 msgr2=0x7f523c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f523c160430 0x7f523c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 -- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 msgr2=0x7f523c155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 0x7f523c155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 -- 172.21.15.93:0/1319065793 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380094d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f5241c00640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 0x7f523c155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52413ff640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c450 tx=0x7f522c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0052d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c005430 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c155200 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c012870 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.087+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c0b4650 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.088+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c0b41d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.089+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f522c0129d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.089+0000 7f52327fc640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 0x7f522006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.089+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f522c0890d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.089+0000 7f5241c00640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 0x7f522006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.089+0000 7f5241c00640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 0x7f522006d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5238036000 tx=0x7f523803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.093+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f523c0b41d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.258+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f523c0b41d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.259+0000 7f52327fc640 1 -- 172.21.15.93:0/1319065793 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f523c0b41d0 con 0x7f523c0b2b60 2023-11-04T01:37:34.261 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 msgr2=0x7f522006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 0x7f522006d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5238036000 tx=0x7f523803b040 comp rx=0 tx=0).stop 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 msgr2=0x7f523c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c450 tx=0x7f522c00c910 comp rx=0 tx=0).stop 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 shutdown_connections 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f522006ae70 0x7f522006d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f523c160430 0x7f523c0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f523c0b2b60 0x7f523c152400 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 --2- 172.21.15.93:0/1319065793 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f523c06c3a0 0x7f523c155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 >> 172.21.15.93:0/1319065793 conn(0x7f523c06ea20 msgr2=0x7f523c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 shutdown_connections 2023-11-04T01:37:34.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.260+0000 7f5243e64640 1 -- 172.21.15.93:0/1319065793 wait complete. 2023-11-04T01:37:34.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:34.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.374+0000 7f0d5485d640 1 Processor -- start 2023-11-04T01:37:34.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.374+0000 7f0d5485d640 1 -- start start 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d5485d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d5006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d5485d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d50065df0 con 0x7f0d5015ad40 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d5485d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d50066040 con 0x7f0d5015b120 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d5485d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5006bc40 con 0x7f0d50071700 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d4e59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0d5015ad40 0x7f0d5015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54994/0 (socket says 172.21.15.93:54994) 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d4e59c640 1 -- 172.21.15.93:0/2910168733 learned_addr learned my addr 172.21.15.93:0/2910168733 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d4ed9d640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d5006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679688493 0 0) 0x7f0d50065df0 con 0x7f0d5015ad40 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.375+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d38003520 con 0x7f0d5015ad40 2023-11-04T01:37:34.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175446660 0 0) 0x7f0d50066040 con 0x7f0d5015b120 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d50065df0 con 0x7f0d5015b120 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1282112779 0 0) 0x7f0d38003520 con 0x7f0d5015ad40 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 msgr2=0x7f0d5006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d5006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 >> v1:172.21.15.125:6789/0 conn(0x7f0d5015b120 legacy=0x7f0d50070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50066320 con 0x7f0d5015ad40 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f0d40001670 con 0x7f0d5015ad40 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 >> v1:172.21.15.93:6789/0 conn(0x7f0d5015ad40 legacy=0x7f0d5015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d38003b30 0x7f0d38003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d380047c0 0x7f0d38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5006bc40 con 0x7f0d38003b30 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3800ba30 con 0x7f0d380047c0 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3800bbf0 con 0x7f0d50071700 2023-11-04T01:37:34.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d38003b30 0x7f0d38003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4dd9b640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d380047c0 0x7f0d38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4ed9d640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 -- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 msgr2=0x7f0d38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d50071700 0x7f0d38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 -- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d380047c0 msgr2=0x7f0d38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d380047c0 0x7f0d38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.376+0000 7f0d4e59c640 1 -- 172.21.15.93:0/2910168733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38003520 con 0x7f0d38003b30 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d38003b30 0x7f0d38003f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001eb0 tx=0x7f0d380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29097120b19f0249 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40005ad0 con 0x7f0d38003b30 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40005c50 con 0x7f0d38003b30 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d4d59a640 1 -- 172.21.15.93:0/2910168733 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4002c810 con 0x7f0d38003b30 2023-11-04T01:37:34.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d5485d640 1 -- 172.21.15.93:0/2910168733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d38003b30 msgr2=0x7f0d38003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.377+0000 7f0d5485d640 1 --2- 172.21.15.93:0/2910168733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d38003b30 0x7f0d38003f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001eb0 tx=0x7f0d380057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.378+0000 7f0d4ed9d640 1 -- 172.21.15.93:0/2910168733 reap_dead start 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.378+0000 7f0d5485d640 1 -- 172.21.15.93:0/2910168733 shutdown_connections 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.378+0000 7f0d5485d640 1 -- 172.21.15.93:0/2910168733 >> 172.21.15.93:0/2910168733 conn(0x7f0d500cbc90 msgr2=0x7f0d500cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.378+0000 7f0d5485d640 1 -- 172.21.15.93:0/2910168733 shutdown_connections 2023-11-04T01:37:34.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.378+0000 7f0d5485d640 1 -- 172.21.15.93:0/2910168733 wait complete. 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.379+0000 7f0d5485d640 1 Processor -- start 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.379+0000 7f0d5485d640 1 -- start start 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 0x7f0d501e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 0x7f0d5006ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5006b370 con 0x7f0d500b0660 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d501e5a70 con 0x7f0d5006a9b0 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500b0ae0 con 0x7f0d38003b30 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43016/0 (socket says 172.21.15.93:43016) 2023-11-04T01:37:34.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 -- 172.21.15.93:0/3975291542 learned_addr learned my addr 172.21.15.93:0/3975291542 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 0x7f0d501e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4ed9d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 0x7f0d5006ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 -- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 msgr2=0x7f0d501e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 0x7f0d501e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 -- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 msgr2=0x7f0d5006ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 0x7f0d5006ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 -- 172.21.15.93:0/3975291542 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5014ce70 con 0x7f0d500b0660 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 0x7f0d501e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4ed9d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 0x7f0d5006ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d4dd9b640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400f770 tx=0x7f0d4400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44005110 con 0x7f0d500b0660 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44005290 con 0x7f0d500b0660 2023-11-04T01:37:34.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d500aff00 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44007030 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.380+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d501e5cc0 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.381+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d501e70c0 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.382+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d440073c0 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.382+0000 7f0d3effd640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 0x7f0d3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.382+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0d440890e0 con 0x7f0d500b0660 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.382+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 0x7f0d3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.383+0000 7f0d4e59c640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 0x7f0d3006d360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001eb0 tx=0x7f0d40007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.387+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d44054280 con 0x7f0d500b0660 2023-11-04T01:37:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.551+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0d501e5eb0 con 0x7f0d500b0660 2023-11-04T01:37:34.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.551+0000 7f0d3effd640 1 -- 172.21.15.93:0/3975291542 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v45) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0d440578a0 con 0x7f0d500b0660 2023-11-04T01:37:34.554 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 msgr2=0x7f0d3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 0x7f0d3006d360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001eb0 tx=0x7f0d40007000 comp rx=0 tx=0).stop 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 msgr2=0x7f0d5014c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400f770 tx=0x7f0d4400fc30 comp rx=0 tx=0).stop 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 shutdown_connections 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0d3006aea0 0x7f0d3006d360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d5006a9b0 0x7f0d5006ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d500b0660 0x7f0d5014c930 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 --2- 172.21.15.93:0/3975291542 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0d38003b30 0x7f0d501e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 >> 172.21.15.93:0/3975291542 conn(0x7f0d500cbc90 msgr2=0x7f0d500c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 shutdown_connections 2023-11-04T01:37:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.553+0000 7f0d5485d640 1 -- 172.21.15.93:0/3975291542 wait complete. 2023-11-04T01:37:34.566 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:37:34.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.664+0000 7f07bd407640 1 Processor -- start 2023-11-04T01:37:34.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.664+0000 7f07bd407640 1 -- start start 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07bd407640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07b815ae70 0x7f07b815f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07bd407640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b80c99b0 0x7f07b806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07bd407640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b80cab30 con 0x7f07b806d550 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07bd407640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b806d9e0 con 0x7f07b815ae70 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07bd407640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80b5110 con 0x7f07b80c99b0 2023-11-04T01:37:34.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07b815ae70 0x7f07b815f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f07b806d550 0x7f07b8071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55010/0 (socket says 172.21.15.93:55010) 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07b815ae70 0x7f07b815f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43018/0 (socket says 172.21.15.93:43018) 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b77fe640 1 -- 172.21.15.93:0/2586855154 learned_addr learned my addr 172.21.15.93:0/2586855154 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 -- 172.21.15.93:0/2586855154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b80c99b0 msgr2=0x7f07b806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/2586855154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b80c99b0 0x7f07b806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 -- 172.21.15.93:0/2586855154 >> v1:172.21.15.93:6789/0 conn(0x7f07b806d550 legacy=0x7f07b8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b5ffb640 1 -- 172.21.15.93:0/2586855154 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507445188 0 0) 0x7f07b80cab30 con 0x7f07b806d550 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.665+0000 7f07b6ffd640 1 -- 172.21.15.93:0/2586855154 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b815f820 con 0x7f07b815ae70 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.666+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/2586855154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815ae70 0x7f07b815f2e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6512d617db36f02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.666+0000 7f07b5ffb640 1 -- 172.21.15.93:0/2586855154 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a802cce0 con 0x7f07b815ae70 2023-11-04T01:37:34.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.666+0000 7f07b5ffb640 1 -- 172.21.15.93:0/2586855154 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a802ce40 con 0x7f07b815ae70 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.666+0000 7f07b5ffb640 1 -- 172.21.15.93:0/2586855154 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8034660 con 0x7f07b815ae70 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 -- 172.21.15.93:0/2586855154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815ae70 msgr2=0x7f07b815f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 --2- 172.21.15.93:0/2586855154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815ae70 0x7f07b815f2e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a802bf30 comp rx=0 tx=0).stop 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 -- 172.21.15.93:0/2586855154 shutdown_connections 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 --2- 172.21.15.93:0/2586855154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b80c99b0 0x7f07b806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 --2- 172.21.15.93:0/2586855154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815ae70 0x7f07b815f2e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 -- 172.21.15.93:0/2586855154 >> 172.21.15.93:0/2586855154 conn(0x7f07b80cf4b0 msgr2=0x7f07b80cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 -- 172.21.15.93:0/2586855154 shutdown_connections 2023-11-04T01:37:34.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.667+0000 7f07bd407640 1 -- 172.21.15.93:0/2586855154 wait complete. 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.668+0000 7f07bd407640 1 Processor -- start 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.668+0000 7f07bd407640 1 -- start start 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 0x7f07b81e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815ae70 0x7f07b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81e6010 con 0x7f07b806d550 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81e62f0 con 0x7f07b80c99b0 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07bd407640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81e65d0 con 0x7f07b815ae70 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43022/0 (socket says 172.21.15.93:43022) 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 -- 172.21.15.93:0/1762686889 learned_addr learned my addr 172.21.15.93:0/1762686889 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:34.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b77fe640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815ae70 0x7f07b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b67fc640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 0x7f07b81e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 -- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815ae70 msgr2=0x7f07b806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815ae70 0x7f07b806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 -- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 msgr2=0x7f07b81e5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 0x7f07b81e5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b6ffd640 1 -- 172.21.15.93:0/1762686889 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009a70 con 0x7f07b806d550 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.669+0000 7f07b67fc640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 0x7f07b81e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.670+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07a8037040 tx=0x7f07a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.671+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a803d600 con 0x7f07b806d550 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.671+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a803d760 con 0x7f07b806d550 2023-11-04T01:37:34.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.671+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a803db10 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.671+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b81e68b0 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.671+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b81e5c50 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.672+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b81e75f0 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.672+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07a803b040 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.673+0000 7f079f7fe640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.673+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f07a80ab4e0 con 0x7f07b806d550 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.673+0000 7f07b67fc640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.673+0000 7f07b67fc640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07b8155940 tx=0x7f07ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.677+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07a8076730 con 0x7f07b806d550 2023-11-04T01:37:34.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:34.907+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f07b81e6dd0 con 0x7f07b806d550 2023-11-04T01:37:35.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.676+0000 7f079f7fe640 1 -- 172.21.15.93:0/1762686889 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7f07a8079d50 con 0x7f07b806d550 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 msgr2=0x7f07a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07b8155940 tx=0x7f07ac008040 comp rx=0 tx=0).stop 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 msgr2=0x7f07b81e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07a8037040 tx=0x7f07a8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 shutdown_connections 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815ae70 0x7f07b806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80c99b0 0x7f07b81e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 --2- 172.21.15.93:0/1762686889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b806d550 0x7f07b81e70b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.678+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 >> 172.21.15.93:0/1762686889 conn(0x7f07b80cf4b0 msgr2=0x7f07b80c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.679+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 shutdown_connections 2023-11-04T01:37:35.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.679+0000 7f07bd407640 1 -- 172.21.15.93:0/1762686889 wait complete. 2023-11-04T01:37:35.693 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.799+0000 7fcaca5c9640 1 Processor -- start 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 -- start start 2023-11-04T01:37:35.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac415af20 0x7fcac40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcac40b64c0 0x7fcac40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcac40cd3b0 0x7fcac40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40cdd80 con 0x7fcac40b64c0 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40d01f0 con 0x7fcac40cd3b0 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcaca5c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40b6a40 con 0x7fcac415af20 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcac37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcac40b64c0 0x7fcac40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcac37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcac40b64c0 0x7fcac40cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43034/0 (socket says 172.21.15.93:43034) 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.800+0000 7fcac37fe640 1 -- 172.21.15.93:0/3732422355 learned_addr learned my addr 172.21.15.93:0/3732422355 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac8b66640 1 --2- 172.21.15.93:0/3732422355 >> v2:172.21.15.125:3300/0 conn(0x7fcac40cd3b0 0x7fcac40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac3fff640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac415af20 0x7fcac40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 -- 172.21.15.93:0/3732422355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac415af20 msgr2=0x7fcac40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac415af20 0x7fcac40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 -- 172.21.15.93:0/3732422355 >> v2:172.21.15.125:3300/0 conn(0x7fcac40cd3b0 msgr2=0x7fcac40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 --2- 172.21.15.93:0/3732422355 >> v2:172.21.15.125:3300/0 conn(0x7fcac40cd3b0 0x7fcac40cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 -- 172.21.15.93:0/3732422355 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40d04b0 con 0x7fcac40b64c0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.801+0000 7fcac37fe640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac40b64c0 0x7fcac40cbc70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcac40c7b70 tx=0x7fcab802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99a128fbe0c7d52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcac2ffd640 1 -- 172.21.15.93:0/3732422355 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8031870 con 0x7fcac40b64c0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcac2ffd640 1 -- 172.21.15.93:0/3732422355 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80319d0 con 0x7fcac40b64c0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcac2ffd640 1 -- 172.21.15.93:0/3732422355 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8031d60 con 0x7fcac40b64c0 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3732422355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac40b64c0 msgr2=0x7fcac40cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac40b64c0 0x7fcac40cbc70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcac40c7b70 tx=0x7fcab802b910 comp rx=0 tx=0).stop 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3732422355 shutdown_connections 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac40b64c0 0x7fcac40cbc70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3732422355 >> v2:172.21.15.125:3300/0 conn(0x7fcac40cd3b0 0x7fcac40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3732422355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac415af20 0x7fcac40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3732422355 >> 172.21.15.93:0/3732422355 conn(0x7fcac406ea20 msgr2=0x7fcac406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3732422355 shutdown_connections 2023-11-04T01:37:35.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.802+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3732422355 wait complete. 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.803+0000 7fcaca5c9640 1 Processor -- start 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 -- start start 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcac40b64c0 0x7fcac406b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac40cd3b0 0x7fcac40af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac406b8c0 con 0x7fcac415af20 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac406bba0 con 0x7fcac40b64c0 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcaca5c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac406be80 con 0x7fcac40cd3b0 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcac8b66640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcac8b66640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43044/0 (socket says 172.21.15.93:43044) 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcac8b66640 1 -- 172.21.15.93:0/3297602669 learned_addr learned my addr 172.21.15.93:0/3297602669 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcac3fff640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcac40b64c0 0x7fcac406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.804+0000 7fcac37fe640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac40cd3b0 0x7fcac40af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 -- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac40cd3b0 msgr2=0x7fcac40af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac40cd3b0 0x7fcac40af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 -- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcac40b64c0 msgr2=0x7fcac406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcac40b64c0 0x7fcac406b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 -- 172.21.15.93:0/3297602669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094d0 con 0x7fcac415af20 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac8b66640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007e40 tx=0x7fcabc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc014620 con 0x7fcac415af20 2023-11-04T01:37:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00ee90 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac406c160 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0149e0 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.805+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac406c960 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.806+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac406c680 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.806+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcabc014b40 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.807+0000 7fcac0ff9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 0x7fcab006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.807+0000 7fcac3fff640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 0x7fcab006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.807+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcabc089e10 con 0x7fcac415af20 2023-11-04T01:37:35.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.807+0000 7fcac3fff640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 0x7fcab006d360 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcab4007920 tx=0x7fcab4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.811+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcac406c680 con 0x7fcac415af20 2023-11-04T01:37:35.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.977+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcac406c680 con 0x7fcac415af20 2023-11-04T01:37:35.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.980+0000 7fcac0ff9640 1 -- 172.21.15.93:0/3297602669 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcac406c680 con 0x7fcac415af20 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 msgr2=0x7fcab006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 0x7fcab006d360 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcab4007920 tx=0x7fcab4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 msgr2=0x7fcac4158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007e40 tx=0x7fcabc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 shutdown_connections 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcab006aea0 0x7fcab006d360 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcac415af20 0x7fcac4158ef0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcac40cd3b0 0x7fcac40af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 --2- 172.21.15.93:0/3297602669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcac40b64c0 0x7fcac406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.982+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 >> 172.21.15.93:0/3297602669 conn(0x7fcac406ea20 msgr2=0x7fcac40b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.983+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 shutdown_connections 2023-11-04T01:37:35.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:35.983+0000 7fcaca5c9640 1 -- 172.21.15.93:0/3297602669 wait complete. 2023-11-04T01:37:35.995 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:35.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:36.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:36.085 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:36.086 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:36.086 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:36.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:36.101 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:36.102 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:36.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:36.119 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:36.119 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:36.156 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:36.156 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:36.156 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:36.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:36.176 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:37:36.176 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:36.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.294+0000 7f920639e640 1 Processor -- start 2023-11-04T01:37:36.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.294+0000 7f920639e640 1 -- start start 2023-11-04T01:37:36.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920639e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f92001432b0 0x7f92000b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920639e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f920015df80 0x7f92000c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920639e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920015e5c0 con 0x7f92000b0cd0 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920639e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920015e3b0 con 0x7f920015df80 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920639e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92000aebe0 con 0x7f92001432b0 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f920015df80 0x7f92000c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f920015df80 0x7f92000c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43052/0 (socket says 172.21.15.93:43052) 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 -- 172.21.15.93:0/4122185503 learned_addr learned my addr 172.21.15.93:0/4122185503 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f920539c640 1 --2- 172.21.15.93:0/4122185503 >> v2:172.21.15.125:3300/0 conn(0x7f92001432b0 0x7f92000b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 -- 172.21.15.93:0/4122185503 >> v2:172.21.15.125:3300/0 conn(0x7f92001432b0 msgr2=0x7f92000b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 --2- 172.21.15.93:0/4122185503 >> v2:172.21.15.125:3300/0 conn(0x7f92001432b0 0x7f92000b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 -- 172.21.15.93:0/4122185503 >> v1:172.21.15.125:6789/0 conn(0x7f92000b0cd0 legacy=0x7f920015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.295+0000 7f9205b9d640 1 -- 172.21.15.93:0/4122185503 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92000ae2b0 con 0x7f920015df80 2023-11-04T01:37:36.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f9205b9d640 1 --2- 172.21.15.93:0/4122185503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92000c8eb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9200071b40 tx=0x7f91f802e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8189b9b2efd0dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f91f7fff640 1 -- 172.21.15.93:0/4122185503 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f802ea00 con 0x7f920015df80 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f91f7fff640 1 -- 172.21.15.93:0/4122185503 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f802eb60 con 0x7f920015df80 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f91f7fff640 1 -- 172.21.15.93:0/4122185503 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8009600 con 0x7f920015df80 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f920639e640 1 -- 172.21.15.93:0/4122185503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 msgr2=0x7f92000c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.296+0000 7f920639e640 1 --2- 172.21.15.93:0/4122185503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92000c8eb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9200071b40 tx=0x7f91f802e060 comp rx=0 tx=0).stop 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 -- 172.21.15.93:0/4122185503 shutdown_connections 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 --2- 172.21.15.93:0/4122185503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92000c8eb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 --2- 172.21.15.93:0/4122185503 >> v2:172.21.15.125:3300/0 conn(0x7f92001432b0 0x7f92000b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 -- 172.21.15.93:0/4122185503 >> 172.21.15.93:0/4122185503 conn(0x7f920006a300 msgr2=0x7f920006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 -- 172.21.15.93:0/4122185503 shutdown_connections 2023-11-04T01:37:36.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.297+0000 7f920639e640 1 -- 172.21.15.93:0/4122185503 wait complete. 2023-11-04T01:37:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.298+0000 7f920639e640 1 Processor -- start 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.298+0000 7f920639e640 1 -- start start 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92000b0cd0 0x7f920015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 0x7f92000b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920015aa60 con 0x7f920015df80 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92000b3fa0 con 0x7f92001432b0 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92000b1340 con 0x7f92000b0cd0 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43068/0 (socket says 172.21.15.93:43068) 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 -- 172.21.15.93:0/160516333 learned_addr learned my addr 172.21.15.93:0/160516333 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920539c640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92000b0cd0 0x7f920015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9204b9b640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 0x7f92000b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 -- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92000b0cd0 msgr2=0x7f920015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92000b0cd0 0x7f920015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 -- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 msgr2=0x7f92000b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 0x7f92000b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 -- 172.21.15.93:0/160516333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f800bd40 con 0x7f920015df80 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9204b9b640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 0x7f92000b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f9205b9d640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f91f800d240 tx=0x7f91f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800b720 con 0x7f920015df80 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8009e10 con 0x7f920015df80 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920015ac70 con 0x7f920015df80 2023-11-04T01:37:36.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.299+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8040880 con 0x7f920015df80 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.300+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920015b230 con 0x7f920015df80 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.301+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92000b1140 con 0x7f920015df80 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.301+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91f80409e0 con 0x7f920015df80 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.302+0000 7f91f5ffb640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 0x7f91e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.302+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f91f80ae700 con 0x7f920015df80 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.302+0000 7f920539c640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 0x7f91e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.302+0000 7f920539c640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 0x7f91e406d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0079a0 tx=0x7f91fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.306+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92000b1140 con 0x7f920015df80 2023-11-04T01:37:36.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.506+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92000b1140 con 0x7f920015df80 2023-11-04T01:37:36.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.507+0000 7f91f5ffb640 1 -- 172.21.15.93:0/160516333 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f91f8045e90 con 0x7f920015df80 2023-11-04T01:37:36.509 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:36.509 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/640071625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":640071625},{"type":"v1","addr":"172.21.15.125:6835","nonce":640071625}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/3057442989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":3057442989},{"type":"v1","addr":"172.21.15.125:6834","nonce":3057442989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/1947764545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1947764545},{"type":"v1","addr":"172.21.15.93:6836","nonce":1947764545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2376031347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":2376031347},{"type":"v1","addr":"172.21.15.93:6837","nonce":2376031347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-11-04T01:37:36.509 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 18 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 msgr2=0x7f91e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 0x7f91e406d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0079a0 tx=0x7f91fc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 msgr2=0x7f92001ed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f91f800d240 tx=0x7f91f8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 shutdown_connections 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f91e406ae70 0x7f91e406d330 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f920015df80 0x7f92001ed7e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92001432b0 0x7f92000b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 --2- 172.21.15.93:0/160516333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f92000b0cd0 0x7f920015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 >> 172.21.15.93:0/160516333 conn(0x7f920006a300 msgr2=0x7f92000cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 shutdown_connections 2023-11-04T01:37:36.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.509+0000 7f920639e640 1 -- 172.21.15.93:0/160516333 wait complete. 2023-11-04T01:37:36.521 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:37:36.522 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:37:36.522 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:37:36.522 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:36.522 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:37:36.522 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:37:36.522 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:37:36.523 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:36.523 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:37:36.523 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:37:36.523 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:37:36.523 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:36.523 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:37:36.523 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:37:36.524 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:37:36.524 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:36.531 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:37:36.531 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:37:36.532 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:37:36.532 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:37:36.534 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:37:36.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:37:36.535 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:37:36.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:37:36.574 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:37:36.574 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:36.575 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:37:36.576 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:36.579 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:37:36.579 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:37:36.580 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:36.580 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:36.580 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:37:36.649 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:37:36.650 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:37:36.660 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:37:36.660 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:37:36.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.686+0000 7ff05187c640 1 Processor -- start 2023-11-04T01:37:36.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.686+0000 7ff05187c640 1 -- start start 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff05187c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff04c1603d0 0x7ff04c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff05187c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0cdf80 con 0x7ff04c06a830 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff05187c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0ce6f0 con 0x7ff04c0722a0 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff05187c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0b19d0 con 0x7ff04c1603d0 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff04affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff04c1603d0 0x7ff04c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff04b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff04c06a830 0x7ff04c0ca380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55034/0 (socket says 172.21.15.93:55034) 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff04affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff04c1603d0 0x7ff04c0b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43086/0 (socket says 172.21.15.93:43086) 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.687+0000 7ff04b7fe640 1 -- 172.21.15.93:0/716483634 learned_addr learned my addr 172.21.15.93:0/716483634 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.688+0000 7ff04affd640 1 -- 172.21.15.93:0/716483634 >> v1:172.21.15.125:6789/0 conn(0x7ff04c0722a0 legacy=0x7ff04c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.688+0000 7ff04affd640 1 -- 172.21.15.93:0/716483634 >> v1:172.21.15.93:6789/0 conn(0x7ff04c06a830 legacy=0x7ff04c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.688+0000 7ff04affd640 1 -- 172.21.15.93:0/716483634 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c072700 con 0x7ff04c1603d0 2023-11-04T01:37:36.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.689+0000 7ff04affd640 1 --2- 172.21.15.93:0/716483634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0b1490 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0097a0 tx=0x7ff03c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f33138b2803800 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.689+0000 7ff049ffb640 1 -- 172.21.15.93:0/716483634 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c031830 con 0x7ff04c1603d0 2023-11-04T01:37:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.691+0000 7ff049ffb640 1 -- 172.21.15.93:0/716483634 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c031990 con 0x7ff04c1603d0 2023-11-04T01:37:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.691+0000 7ff049ffb640 1 -- 172.21.15.93:0/716483634 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c031d20 con 0x7ff04c1603d0 2023-11-04T01:37:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 -- 172.21.15.93:0/716483634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 msgr2=0x7ff04c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 --2- 172.21.15.93:0/716483634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0b1490 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0097a0 tx=0x7ff03c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 -- 172.21.15.93:0/716483634 shutdown_connections 2023-11-04T01:37:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 --2- 172.21.15.93:0/716483634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0b1490 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 -- 172.21.15.93:0/716483634 >> 172.21.15.93:0/716483634 conn(0x7ff04c06d800 msgr2=0x7ff04c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 -- 172.21.15.93:0/716483634 shutdown_connections 2023-11-04T01:37:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.692+0000 7ff05187c640 1 -- 172.21.15.93:0/716483634 wait complete. 2023-11-04T01:37:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.694+0000 7ff05187c640 1 Processor -- start 2023-11-04T01:37:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.694+0000 7ff05187c640 1 -- start start 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 0x7ff04c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 0x7ff04c0c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c15cdd0 con 0x7ff04c1603d0 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1563f0 con 0x7ff04c0722a0 2023-11-04T01:37:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c155870 con 0x7ff04c06a830 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43090/0 (socket says 172.21.15.93:43090) 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 -- 172.21.15.93:0/1679242945 learned_addr learned my addr 172.21.15.93:0/1679242945 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04affd640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 0x7ff04c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04a7fc640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 0x7ff04c0c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 -- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 msgr2=0x7ff04c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 0x7ff04c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 -- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 msgr2=0x7ff04c0c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 0x7ff04c0c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 -- 172.21.15.93:0/1679242945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009400 con 0x7ff04c1603d0 2023-11-04T01:37:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04a7fc640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 0x7ff04c0c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04affd640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 0x7ff04c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff04b7fe640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff04400cb10 tx=0x7ff04400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400ac70 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04400add0 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044012600 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.695+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c155b50 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.696+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c156110 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.696+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c15cf10 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.697+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff044007070 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.697+0000 7ff033fff640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 0x7ff03806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.697+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff044089320 con 0x7ff04c1603d0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.697+0000 7ff04affd640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 0x7ff03806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.698+0000 7ff04affd640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 0x7ff03806d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff03c036000 tx=0x7ff03c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.702+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0440544e0 con 0x7ff04c1603d0 2023-11-04T01:37:36.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:36.880+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff04c0b5990 con 0x7ff04c1603d0 2023-11-04T01:37:37.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.690+0000 7ff033fff640 1 -- 172.21.15.93:0/1679242945 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff044057b00 con 0x7ff04c1603d0 2023-11-04T01:37:37.692 INFO:teuthology.orchestra.run.smithi093.stderr: removed all blocklist entries 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 msgr2=0x7ff03806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 0x7ff03806d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff03c036000 tx=0x7ff03c03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 msgr2=0x7ff04c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff04400cb10 tx=0x7ff04400a060 comp rx=0 tx=0).stop 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 shutdown_connections 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff03806aea0 0x7ff03806d360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff04c1603d0 0x7ff04c0c5730 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff04c0722a0 0x7ff04c0c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 --2- 172.21.15.93:0/1679242945 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff04c06a830 0x7ff04c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 >> 172.21.15.93:0/1679242945 conn(0x7ff04c06d800 msgr2=0x7ff04c0cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 shutdown_connections 2023-11-04T01:37:37.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.693+0000 7ff05187c640 1 -- 172.21.15.93:0/1679242945 wait complete. 2023-11-04T01:37:37.706 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:37:37.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.805+0000 7f04de6e5640 1 Processor -- start 2023-11-04T01:37:37.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.805+0000 7f04de6e5640 1 -- start start 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04de6e5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f04d815ce60 0x7f04d806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04de6e5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d81615d0 con 0x7f04d80cf160 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04de6e5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d81618b0 con 0x7f04d806bd30 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04de6e5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d80cbde0 con 0x7f04d815ce60 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04dcc82640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f04d80cf160 0x7f04d80cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55050/0 (socket says 172.21.15.93:55050) 2023-11-04T01:37:37.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.806+0000 7f04dcc82640 1 -- 172.21.15.93:0/1724216913 learned_addr learned my addr 172.21.15.93:0/1724216913 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 --2- 172.21.15.93:0/1724216913 >> v2:172.21.15.125:3300/0 conn(0x7f04d815ce60 0x7f04d806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543213356 0 0) 0x7f04d81615d0 con 0x7f04d80cf160 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c0003520 con 0x7f04d80cf160 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1988623238 0 0) 0x7f04c0003520 con 0x7f04d80cf160 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 >> v2:172.21.15.125:3300/0 conn(0x7f04d815ce60 msgr2=0x7f04d806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 --2- 172.21.15.93:0/1724216913 >> v2:172.21.15.125:3300/0 conn(0x7f04d815ce60 0x7f04d806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 >> v1:172.21.15.125:6789/0 conn(0x7f04d806bd30 legacy=0x7f04d8160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80cba00 con 0x7f04d80cf160 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f04d00019f0 con 0x7f04d80cf160 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 >> v1:172.21.15.93:6789/0 conn(0x7f04d80cf160 legacy=0x7f04d80cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 0x7f04c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c00047c0 0x7f04c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04c0005180 0x7f04c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d80cbde0 con 0x7f04c0003970 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c000c020 con 0x7f04c0005180 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c000c1e0 con 0x7f04c00047c0 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 0x7f04c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04dcc82640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04c0005180 0x7f04c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d77fe640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c00047c0 0x7f04c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 -- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c00047c0 msgr2=0x7f04c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c00047c0 0x7f04c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 -- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04c0005180 msgr2=0x7f04c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04c0005180 0x7f04c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04d7fff640 1 -- 172.21.15.93:0/1724216913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0003520 con 0x7f04c0003970 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04dcc82640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04c0005180 0x7f04c000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.807+0000 7f04dcc82640 1 -- 172.21.15.93:0/1724216913 reap_dead start 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.808+0000 7f04d7fff640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 0x7f04c0003d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009ac0 tx=0x7f04c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5bc02befdc707c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.808+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c802c6b0 con 0x7f04c0003970 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.808+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c802c810 con 0x7f04c0003970 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.808+0000 7f04d6ffd640 1 -- 172.21.15.93:0/1724216913 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c802cba0 con 0x7f04c0003970 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 -- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 msgr2=0x7f04c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 0x7f04c0003d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009ac0 tx=0x7f04c00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 -- 172.21.15.93:0/1724216913 shutdown_connections 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 --2- 172.21.15.93:0/1724216913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04c0003970 0x7f04c0003d90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 -- 172.21.15.93:0/1724216913 >> 172.21.15.93:0/1724216913 conn(0x7f04d806ea90 msgr2=0x7f04d806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 -- 172.21.15.93:0/1724216913 shutdown_connections 2023-11-04T01:37:37.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.809+0000 7f04de6e5640 1 -- 172.21.15.93:0/1724216913 wait complete. 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.810+0000 7f04de6e5640 1 Processor -- start 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.810+0000 7f04de6e5640 1 -- start start 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c0003970 0x7f04d8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d80b65f0 0x7f04d80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d815e4a0 con 0x7f04d80b60a0 2023-11-04T01:37:37.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d815d5d0 con 0x7f04d80b65f0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04de6e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d80c7e90 con 0x7f04c0003970 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43104/0 (socket says 172.21.15.93:43104) 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 -- 172.21.15.93:0/4251174094 learned_addr learned my addr 172.21.15.93:0/4251174094 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 -- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c0003970 msgr2=0x7f04d8159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c0003970 0x7f04d8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 -- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d80b65f0 msgr2=0x7f04d80b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d80b65f0 0x7f04d80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 -- 172.21.15.93:0/4251174094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d815d820 con 0x7f04d80b60a0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.811+0000 7f04dcc82640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f04d80d1c10 tx=0x7f04d0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.812+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000ea20 con 0x7f04d80b60a0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.812+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000eb80 con 0x7f04d80b60a0 2023-11-04T01:37:37.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.812+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d815db00 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.812+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0013420 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.812+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d815e0c0 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.813+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d815e280 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.813+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04d0013580 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.813+0000 7f04d4ff9640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 0x7f04c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.814+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f04d00898b0 con 0x7f04d80b60a0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.814+0000 7f04d7fff640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 0x7f04c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.814+0000 7f04d7fff640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 0x7f04c406d360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04c8036000 tx=0x7f04c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:37.818+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04d0054b60 con 0x7f04d80b60a0 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.046+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f04d8074290 con 0x7f04d80b60a0 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.046+0000 7f04d4ff9640 1 -- 172.21.15.93:0/4251174094 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f04d0058180 con 0x7f04d80b60a0 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: "auth_dump": [ 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.a", 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA==", 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.048 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.b", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q==", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:38.049 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.c", 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA==", 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.d", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A==", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.0", 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng==", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.1", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg==", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.2", 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ==", 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.053 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.3", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw==", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.4", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw==", 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.054 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.5", 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig==", 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.055 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.6", 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q==", 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.056 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.7", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg==", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.0", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA==", 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.057 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow r", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.1", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA==", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:38.058 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.2", 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA==", 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:38.059 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.3", 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA==", 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.060 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.admin", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC8n0VlXE3tMRAAENuvCH1TV9mwClMjb99rXg==", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.x", 2023-11-04T01:37:38.061 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA==", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.y", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA==", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:38.062 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:37:38.063 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.063 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:38.063 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-11-04T01:37:38.063 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:38.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 msgr2=0x7f04c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 0x7f04c406d360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04c8036000 tx=0x7f04c802e000 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 msgr2=0x7f04d80b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f04d80d1c10 tx=0x7f04d0007bc0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 shutdown_connections 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c406aea0 0x7f04c406d360 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04d80b60a0 0x7f04d80b1b90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d80b65f0 0x7f04d80b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 --2- 172.21.15.93:0/4251174094 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04c0003970 0x7f04d8159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 >> 172.21.15.93:0/4251174094 conn(0x7f04d806ea90 msgr2=0x7f04d8160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.048+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 shutdown_connections 2023-11-04T01:37:38.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.049+0000 7f04de6e5640 1 -- 172.21.15.93:0/4251174094 wait complete. 2023-11-04T01:37:38.066 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:38.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.163+0000 7f1c54da5640 1 Processor -- start 2023-11-04T01:37:38.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.163+0000 7f1c54da5640 1 -- start start 2023-11-04T01:37:38.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c54da5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c500cde60 0x7f1c5015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c54da5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c500ce240 0x7f1c500d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c54da5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5015e000 con 0x7f1c5015daa0 2023-11-04T01:37:38.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c54da5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5015e5c0 con 0x7f1c500ce240 2023-11-04T01:37:38.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c54da5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5015e2e0 con 0x7f1c500cde60 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.164+0000 7f1c4ed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c500ce240 0x7f1c500d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4dd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1c5015daa0 0x7f1c50157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55056/0 (socket says 172.21.15.93:55056) 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4dd9b640 1 -- 172.21.15.93:0/3969278557 learned_addr learned my addr 172.21.15.93:0/3969278557 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4ed9d640 1 -- 172.21.15.93:0/3969278557 >> v2:172.21.15.125:3300/0 conn(0x7f1c500cde60 msgr2=0x7f1c5015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4ed9d640 1 --2- 172.21.15.93:0/3969278557 >> v2:172.21.15.125:3300/0 conn(0x7f1c500cde60 0x7f1c5015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4ed9d640 1 -- 172.21.15.93:0/3969278557 >> v1:172.21.15.93:6789/0 conn(0x7f1c5015daa0 legacy=0x7f1c50157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4ed9d640 1 -- 172.21.15.93:0/3969278557 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500d1120 con 0x7f1c500ce240 2023-11-04T01:37:38.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4d59a640 1 -- 172.21.15.93:0/3969278557 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387561769 0 0) 0x7f1c5015e000 con 0x7f1c5015daa0 2023-11-04T01:37:38.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.165+0000 7f1c4ed9d640 1 --2- 172.21.15.93:0/3969278557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500d1920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1c500b5550 tx=0x7f1c4002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf34e5faf6fd5096 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c4d59a640 1 -- 172.21.15.93:0/3969278557 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40031830 con 0x7f1c500ce240 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c4d59a640 1 -- 172.21.15.93:0/3969278557 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40031990 con 0x7f1c500ce240 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c4d59a640 1 -- 172.21.15.93:0/3969278557 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40031d20 con 0x7f1c500ce240 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 -- 172.21.15.93:0/3969278557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 msgr2=0x7f1c500d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 --2- 172.21.15.93:0/3969278557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500d1920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1c500b5550 tx=0x7f1c4002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 -- 172.21.15.93:0/3969278557 shutdown_connections 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 --2- 172.21.15.93:0/3969278557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500d1920 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 --2- 172.21.15.93:0/3969278557 >> v2:172.21.15.125:3300/0 conn(0x7f1c500cde60 0x7f1c5015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 -- 172.21.15.93:0/3969278557 >> 172.21.15.93:0/3969278557 conn(0x7f1c50071f30 msgr2=0x7f1c500cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 -- 172.21.15.93:0/3969278557 shutdown_connections 2023-11-04T01:37:38.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.166+0000 7f1c54da5640 1 -- 172.21.15.93:0/3969278557 wait complete. 2023-11-04T01:37:38.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.167+0000 7f1c54da5640 1 Processor -- start 2023-11-04T01:37:38.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 -- start start 2023-11-04T01:37:38.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c500cde60 0x7f1c501589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 0x7f1c500c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50158f00 con 0x7f1c500ce240 2023-11-04T01:37:38.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501f3a90 con 0x7f1c500cde60 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c54da5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c501f3d70 con 0x7f1c5015daa0 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c4dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c4dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43136/0 (socket says 172.21.15.93:43136) 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c4dd9b640 1 -- 172.21.15.93:0/4029876977 learned_addr learned my addr 172.21.15.93:0/4029876977 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c4e59c640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c500cde60 0x7f1c501589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.168+0000 7f1c4ed9d640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 0x7f1c500c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 -- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 msgr2=0x7f1c500c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 0x7f1c500c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 -- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c500cde60 msgr2=0x7f1c501589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c500cde60 0x7f1c501589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 -- 172.21.15.93:0/4029876977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40009400 con 0x7f1c500ce240 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4ed9d640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 0x7f1c500c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:38.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c4dd9b640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c410 tx=0x7f1c4400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440074e0 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44007660 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c501f4050 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44004a20 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.169+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c501f4610 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.170+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50074290 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.170+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c44004b80 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.171+0000 7f1c3effd640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 0x7f1c3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.171+0000 7f1c4e59c640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 0x7f1c3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.171+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1c44089220 con 0x7f1c500ce240 2023-11-04T01:37:38.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.171+0000 7f1c4e59c640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 0x7f1c3006d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c500c8280 tx=0x7f1c4800d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.175+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c44057e10 con 0x7f1c500ce240 2023-11-04T01:37:38.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.343+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c501f47d0 con 0x7f1c500ce240 2023-11-04T01:37:38.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.344+0000 7f1c3effd640 1 -- 172.21.15.93:0/4029876977 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14827 (secure 0 0 0) 0x7f1c440579a0 con 0x7f1c500ce240 2023-11-04T01:37:38.345 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:38.345 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":50,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:37.689676+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:38.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 msgr2=0x7f1c3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 0x7f1c3006d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c500c8280 tx=0x7f1c4800d040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 msgr2=0x7f1c500c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c410 tx=0x7f1c4400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 shutdown_connections 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c3006aea0 0x7f1c3006d360 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c5015daa0 0x7f1c500c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c500ce240 0x7f1c500c76a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 --2- 172.21.15.93:0/4029876977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c500cde60 0x7f1c501589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 >> 172.21.15.93:0/4029876977 conn(0x7f1c50071f30 msgr2=0x7f1c50156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 shutdown_connections 2023-11-04T01:37:38.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.346+0000 7f1c54da5640 1 -- 172.21.15.93:0/4029876977 wait complete. 2023-11-04T01:37:38.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:38.358 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:38.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.460+0000 7f0754090640 1 Processor -- start 2023-11-04T01:37:38.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.460+0000 7f0754090640 1 -- start start 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0754090640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0754090640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0754090640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c15aff0 con 0x7f074c159c00 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0754090640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0ae460 con 0x7f074c0c4ff0 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0754090640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c15a3e0 con 0x7f074c0adac0 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f075262d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f075162b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f075262d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:58106/0 (socket says 172.21.15.93:58106) 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f075162b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:58656/0 (socket says 172.21.15.93:58656) 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f0751e2c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f074c159c00 0x7f074c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:54282/0 (socket says 172.21.15.93:54282) 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.461+0000 7f075262d640 1 -- 172.21.15.93:0/206033308 learned_addr learned my addr 172.21.15.93:0/206033308 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.462+0000 7f075262d640 1 -- 172.21.15.93:0/206033308 >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 msgr2=0x7f074c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.462+0000 7f075262d640 1 --2- 172.21.15.93:0/206033308 >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.462+0000 7f075262d640 1 -- 172.21.15.93:0/206033308 >> v1:172.21.15.125:6789/0 conn(0x7f074c159c00 legacy=0x7f074c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.462+0000 7f075262d640 1 -- 172.21.15.93:0/206033308 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c15a6c0 con 0x7f074c0adac0 2023-11-04T01:37:38.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.462+0000 7f075162b640 1 --2- 172.21.15.93:0/206033308 >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f075262d640 1 --2- 172.21.15.93:0/206033308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0744009870 tx=0x7f074402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c31d6c8c78c5b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0750e2a640 1 -- 172.21.15.93:0/206033308 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744030840 con 0x7f074c0adac0 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0750e2a640 1 -- 172.21.15.93:0/206033308 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07440309a0 con 0x7f074c0adac0 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0750e2a640 1 -- 172.21.15.93:0/206033308 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744030d30 con 0x7f074c0adac0 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 -- 172.21.15.93:0/206033308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 msgr2=0x7f074c0adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 --2- 172.21.15.93:0/206033308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0744009870 tx=0x7f074402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:38.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 -- 172.21.15.93:0/206033308 shutdown_connections 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 --2- 172.21.15.93:0/206033308 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0adac0 0x7f074c0adf20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 --2- 172.21.15.93:0/206033308 >> v2:172.21.15.125:3300/0 conn(0x7f074c0c4ff0 0x7f074c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 -- 172.21.15.93:0/206033308 >> 172.21.15.93:0/206033308 conn(0x7f074c0ce950 msgr2=0x7f074c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 -- 172.21.15.93:0/206033308 shutdown_connections 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.463+0000 7f0754090640 1 -- 172.21.15.93:0/206033308 wait complete. 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 Processor -- start 2023-11-04T01:37:38.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 -- start start 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0c4ff0 0x7f074c0c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f074c159c00 0x7f074c0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c8800 con 0x7f074c0adac0 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c64a0 con 0x7f074c159c00 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0754090640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c7e60 con 0x7f074c0c4ff0 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0751e2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0751e2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43150/0 (socket says 172.21.15.93:43150) 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f0751e2c640 1 -- 172.21.15.93:0/3260299584 learned_addr learned my addr 172.21.15.93:0/3260299584 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f075262d640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f074c159c00 0x7f074c0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.465+0000 7f075162b640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0c4ff0 0x7f074c0c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 -- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0c4ff0 msgr2=0x7f074c0c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0c4ff0 0x7f074c0c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 -- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f074c159c00 msgr2=0x7f074c0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f074c159c00 0x7f074c0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 -- 172.21.15.93:0/3260299584 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009400 con 0x7f074c0adac0 2023-11-04T01:37:38.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0751e2c640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f074800c7d0 tx=0x7f074800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800a640 con 0x7f074c0adac0 2023-11-04T01:37:38.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07440094d0 con 0x7f074c0adac0 2023-11-04T01:37:38.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800a7a0 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800ab10 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.466+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c0c7b60 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.467+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c0c8080 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.467+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f074800ac70 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.468+0000 7f07427fc640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 0x7f073006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.468+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0748088c80 con 0x7f074c0adac0 2023-11-04T01:37:38.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.468+0000 7f075162b640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 0x7f073006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.468+0000 7f075162b640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 0x7f073006d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f074c0b4a60 tx=0x7f073c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.472+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0748053ea0 con 0x7f074c0adac0 2023-11-04T01:37:38.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.636+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f074c074290 con 0x7f074c0adac0 2023-11-04T01:37:38.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.636+0000 7f07427fc640 1 -- 172.21.15.93:0/3260299584 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07480170a0 con 0x7f074c0adac0 2023-11-04T01:37:38.638 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 msgr2=0x7f073006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 0x7f073006d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f074c0b4a60 tx=0x7f073c009190 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 msgr2=0x7f074c14c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f074800c7d0 tx=0x7f074800cc90 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 shutdown_connections 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073006ae70 0x7f073006d330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f074c159c00 0x7f074c0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f074c0c4ff0 0x7f074c0c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 --2- 172.21.15.93:0/3260299584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f074c0adac0 0x7f074c14c060 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 >> 172.21.15.93:0/3260299584 conn(0x7f074c0ce950 msgr2=0x7f074c06c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 shutdown_connections 2023-11-04T01:37:38.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.638+0000 7f0754090640 1 -- 172.21.15.93:0/3260299584 wait complete. 2023-11-04T01:37:38.650 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:38.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.751+0000 7f8d242b4640 1 Processor -- start 2023-11-04T01:37:38.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.751+0000 7f8d242b4640 1 -- start start 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d242b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d1c153e60 0x7f8d1c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d242b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d1c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d242b4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c0cde60 con 0x7f8d1c0b4880 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d242b4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c160f90 con 0x7f8d1c153e60 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d242b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c15e400 con 0x7f8d1c0cd6d0 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d22851640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d1c0b4880 0x7f8d1c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55072/0 (socket says 172.21.15.93:55072) 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d22851640 1 -- 172.21.15.93:0/1836062850 learned_addr learned my addr 172.21.15.93:0/1836062850 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322389874 0 0) 0x7f8d1c0cde60 con 0x7f8d1c0b4880 2023-11-04T01:37:38.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d08003520 con 0x7f8d1c0b4880 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2184f640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d1c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d22050640 1 --2- 172.21.15.93:0/1836062850 >> v2:172.21.15.125:3300/0 conn(0x7f8d1c153e60 0x7f8d1c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1886911311 0 0) 0x7f8d08003520 con 0x7f8d1c0b4880 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 msgr2=0x7f8d1c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d1c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 >> v2:172.21.15.125:3300/0 conn(0x7f8d1c153e60 msgr2=0x7f8d1c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 --2- 172.21.15.93:0/1836062850 >> v2:172.21.15.125:3300/0 conn(0x7f8d1c153e60 0x7f8d1c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c161960 con 0x7f8d1c0b4880 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8d140019f0 con 0x7f8d1c0b4880 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 >> v1:172.21.15.93:6789/0 conn(0x7f8d1c0b4880 legacy=0x7f8d1c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08003970 0x7f8d08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.752+0000 7f8d2104e640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c160f90 con 0x7f8d08004d00 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c15e400 con 0x7f8d08003970 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0800bae0 con 0x7f8d1c0cd6d0 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22050640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08003970 0x7f8d08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d2184f640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 -- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 msgr2=0x7f8d080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cd6d0 0x7f8d080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 -- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08003970 msgr2=0x7f8d08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08003970 0x7f8d08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.753+0000 7f8d22851640 1 -- 172.21.15.93:0/1836062850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08003520 con 0x7f8d08004d00 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d22851640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400a770 tx=0x7f8d080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eae507a919b4dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14034630 con 0x7f8d08004d00 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1402f070 con 0x7f8d08004d00 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d2104e640 1 -- 172.21.15.93:0/1836062850 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14034a10 con 0x7f8d08004d00 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 -- 172.21.15.93:0/1836062850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d08004d00 msgr2=0x7f8d08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 --2- 172.21.15.93:0/1836062850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d08004d00 0x7f8d08005180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400a770 tx=0x7f8d080057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d22851640 1 -- 172.21.15.93:0/1836062850 reap_dead start 2023-11-04T01:37:38.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 -- 172.21.15.93:0/1836062850 shutdown_connections 2023-11-04T01:37:38.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 -- 172.21.15.93:0/1836062850 >> 172.21.15.93:0/1836062850 conn(0x7f8d1c0cf880 msgr2=0x7f8d1c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 -- 172.21.15.93:0/1836062850 shutdown_connections 2023-11-04T01:37:38.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.754+0000 7f8d242b4640 1 -- 172.21.15.93:0/1836062850 wait complete. 2023-11-04T01:37:38.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.755+0000 7f8d242b4640 1 Processor -- start 2023-11-04T01:37:38.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.755+0000 7f8d242b4640 1 -- start start 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08004d00 0x7f8d1c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cc280 0x7f8d1c0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1f2a10 con 0x7f8d1c153430 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0ccc40 con 0x7f8d08004d00 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d242b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c153890 con 0x7f8d1c0cc280 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d2184f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d2184f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43160/0 (socket says 172.21.15.93:43160) 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.756+0000 7f8d2184f640 1 -- 172.21.15.93:0/3792684740 learned_addr learned my addr 172.21.15.93:0/3792684740 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d22851640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cc280 0x7f8d1c0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d22050640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08004d00 0x7f8d1c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 -- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cc280 msgr2=0x7f8d1c0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cc280 0x7f8d1c0cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 -- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08004d00 msgr2=0x7f8d1c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08004d00 0x7f8d1c156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 -- 172.21.15.93:0/3792684740 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0cba60 con 0x7f8d1c153430 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d2184f640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b7f0 tx=0x7f8d0c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c010830 con 0x7f8d1c153430 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c010990 con 0x7f8d1c153430 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c1f2c90 con 0x7f8d1c153430 2023-11-04T01:37:38.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c010d20 con 0x7f8d1c153430 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.757+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c0cb4a0 con 0x7f8d1c153430 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.758+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c074290 con 0x7f8d1c153430 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.758+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d0c014430 con 0x7f8d1c153430 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.759+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.759+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8d0c089de0 con 0x7f8d1c153430 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.759+0000 7f8d22050640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.759+0000 7f8d22050640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d18006fd0 tx=0x7f8d18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.763+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d0c054f40 con 0x7f8d1c153430 2023-11-04T01:37:38.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.927+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f8d1c0b57e0 con 0x7f8d1c153430 2023-11-04T01:37:38.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.927+0000 7f8d12ffd640 1 -- 172.21.15.93:0/3792684740 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v50) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d0c0220a0 con 0x7f8d1c153430 2023-11-04T01:37:38.929 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 msgr2=0x7f8d0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d18006fd0 tx=0x7f8d18008040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 msgr2=0x7f8d1c0ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b7f0 tx=0x7f8d0c00bcb0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 shutdown_connections 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1c0cc280 0x7f8d1c0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c153430 0x7f8d1c0ca8e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 --2- 172.21.15.93:0/3792684740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d08004d00 0x7f8d1c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 >> 172.21.15.93:0/3792684740 conn(0x7f8d1c0cf880 msgr2=0x7f8d1c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 shutdown_connections 2023-11-04T01:37:38.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:38.929+0000 7f8d242b4640 1 -- 172.21.15.93:0/3792684740 wait complete. 2023-11-04T01:37:38.942 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.042+0000 7fdd721e2640 1 Processor -- start 2023-11-04T01:37:39.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.042+0000 7fdd721e2640 1 -- start start 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd721e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd6c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd721e2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0cc450 con 0x7fdd6c0cd860 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd721e2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c15f400 con 0x7fdd6c15ae40 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd721e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c15b220 con 0x7fdd6c15bfb0 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd6bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdd6c0cd860 0x7fdd6c0ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55076/0 (socket says 172.21.15.93:55076) 2023-11-04T01:37:39.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.043+0000 7fdd6bfff640 1 -- 172.21.15.93:0/1000116701 learned_addr learned my addr 172.21.15.93:0/1000116701 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842751358 0 0) 0x7fdd64001490 con 0x7fdd6c0cd860 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd6c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd58003520 con 0x7fdd6c0cd860 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446450751 0 0) 0x7fdd58003520 con 0x7fdd6c0cd860 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 msgr2=0x7fdd6c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd6c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 >> v1:172.21.15.125:6789/0 conn(0x7fdd6c15ae40 legacy=0x7fdd6c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c15f890 con 0x7fdd6c0cd860 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fdd64001b80 con 0x7fdd6c0cd860 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 >> v1:172.21.15.93:6789/0 conn(0x7fdd6c0cd860 legacy=0x7fdd6c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd58004d00 0x7fdd58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c15b220 con 0x7fdd58003fd0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800bb40 con 0x7fdd58004d00 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800bd00 con 0x7fdd6c15bfb0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6b7fe640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6bfff640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd58004d00 0x7fdd58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 -- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 msgr2=0x7fdd580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c15bfb0 0x7fdd580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 -- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd58004d00 msgr2=0x7fdd58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd58004d00 0x7fdd58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd62ffd640 1 -- 172.21.15.93:0/1000116701 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58003520 con 0x7fdd58003fd0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.044+0000 7fdd6bfff640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd58004d00 0x7fdd58005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.045+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd580047c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ba30 tx=0x7fdd580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dbe1320bcd0c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.045+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54032640 con 0x7fdd58003fd0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.045+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd540327a0 con 0x7fdd58003fd0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.045+0000 7fdd6affd640 1 -- 172.21.15.93:0/1000116701 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54032b30 con 0x7fdd58003fd0 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 -- 172.21.15.93:0/1000116701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 msgr2=0x7fdd580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 --2- 172.21.15.93:0/1000116701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd580047c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ba30 tx=0x7fdd580057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd6bfff640 1 -- 172.21.15.93:0/1000116701 reap_dead start 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 -- 172.21.15.93:0/1000116701 shutdown_connections 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 -- 172.21.15.93:0/1000116701 >> 172.21.15.93:0/1000116701 conn(0x7fdd6c06ea90 msgr2=0x7fdd6c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 -- 172.21.15.93:0/1000116701 shutdown_connections 2023-11-04T01:37:39.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.046+0000 7fdd721e2640 1 -- 172.21.15.93:0/1000116701 wait complete. 2023-11-04T01:37:39.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.047+0000 7fdd721e2640 1 Processor -- start 2023-11-04T01:37:39.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.047+0000 7fdd721e2640 1 -- start start 2023-11-04T01:37:39.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 0x7fdd6c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6c150380 0x7fdd6c0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0c81b0 con 0x7fdd58003fd0 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c06b420 con 0x7fdd6c150380 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd721e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c06b700 con 0x7fdd6c14ff00 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43180/0 (socket says 172.21.15.93:43180) 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 -- 172.21.15.93:0/2474270097 learned_addr learned my addr 172.21.15.93:0/2474270097 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6bfff640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6c150380 0x7fdd6c0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 0x7fdd6c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 -- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 msgr2=0x7fdd6c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 0x7fdd6c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 -- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6c150380 msgr2=0x7fdd6c0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6c150380 0x7fdd6c0b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 -- 172.21.15.93:0/2474270097 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c06b9e0 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 0x7fdd6c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.048+0000 7fdd6b7fe640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00f820 tx=0x7fdd5c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.049+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0050d0 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.049+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c005230 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.049+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00d730 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.049+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c06bcc0 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.049+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0b0f20 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.050+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c0ce2d0 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.050+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd5c00d890 con 0x7fdd58003fd0 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.050+0000 7fdd68ff9640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 0x7fdd4c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.050+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdd5c089500 con 0x7fdd58003fd0 2023-11-04T01:37:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.050+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 0x7fdd4c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.051+0000 7fdd62ffd640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 0x7fdd4c06d360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ba00 tx=0x7fdd54030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.054+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd5c054660 con 0x7fdd58003fd0 2023-11-04T01:37:39.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.222+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd6c074290 con 0x7fdd58003fd0 2023-11-04T01:37:39.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.223+0000 7fdd68ff9640 1 -- 172.21.15.93:0/2474270097 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+137 (secure 0 0 0) 0x7fdd5c057c80 con 0x7fdd58003fd0 2023-11-04T01:37:39.224 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:39.224 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:37:39.224 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 7, 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "snap-test-pool" 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:39.225 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:37:39.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 msgr2=0x7fdd4c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 0x7fdd4c06d360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400ba00 tx=0x7fdd54030000 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 msgr2=0x7fdd6c0c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00f820 tx=0x7fdd5c00fce0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 shutdown_connections 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdd4c06aea0 0x7fdd4c06d360 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6c150380 0x7fdd6c0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdd6c14ff00 0x7fdd6c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 --2- 172.21.15.93:0/2474270097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd58003fd0 0x7fdd6c0c7c70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 >> 172.21.15.93:0/2474270097 conn(0x7fdd6c06ea90 msgr2=0x7fdd6c0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 shutdown_connections 2023-11-04T01:37:39.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.225+0000 7fdd721e2640 1 -- 172.21.15.93:0/2474270097 wait complete. 2023-11-04T01:37:39.237 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:37:39.237 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:37:39.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.339+0000 7fbbab087640 1 Processor -- start 2023-11-04T01:37:39.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.339+0000 7fbbab087640 1 -- start start 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbbab087640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbba40cb270 0x7fbba40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbbab087640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbba40cb650 0x7fbba40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbbab087640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba40cdc30 con 0x7fbba40b14d0 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbbab087640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40caa00 con 0x7fbba40cb650 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbbab087640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40cd620 con 0x7fbba40cb270 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbba40cb650 0x7fbba40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbba40cb650 0x7fbba40ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43182/0 (socket says 172.21.15.93:43182) 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 -- 172.21.15.93:0/3691791652 learned_addr learned my addr 172.21.15.93:0/3691791652 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:39.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba8e23640 1 --2- 172.21.15.93:0/3691791652 >> v2:172.21.15.125:3300/0 conn(0x7fbba40cb270 0x7fbba40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 -- 172.21.15.93:0/3691791652 >> v2:172.21.15.125:3300/0 conn(0x7fbba40cb270 msgr2=0x7fbba40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 --2- 172.21.15.93:0/3691791652 >> v2:172.21.15.125:3300/0 conn(0x7fbba40cb270 0x7fbba40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 -- 172.21.15.93:0/3691791652 >> v1:172.21.15.125:6789/0 conn(0x7fbba40b14d0 legacy=0x7fbba406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.340+0000 7fbba3fff640 1 -- 172.21.15.93:0/3691791652 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba406fe00 con 0x7fbba40cb650 2023-11-04T01:37:39.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.341+0000 7fbba3fff640 1 --2- 172.21.15.93:0/3691791652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40cb650 0x7fbba40ca4c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbba40cd570 tx=0x7fbb9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b60183716619e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.341+0000 7fbba37fe640 1 -- 172.21.15.93:0/3691791652 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90031870 con 0x7fbba40cb650 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.341+0000 7fbba37fe640 1 -- 172.21.15.93:0/3691791652 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900319d0 con 0x7fbba40cb650 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.341+0000 7fbba37fe640 1 -- 172.21.15.93:0/3691791652 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90031d60 con 0x7fbba40cb650 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 -- 172.21.15.93:0/3691791652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40cb650 msgr2=0x7fbba40ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 --2- 172.21.15.93:0/3691791652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40cb650 0x7fbba40ca4c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbba40cd570 tx=0x7fbb9002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:39.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 -- 172.21.15.93:0/3691791652 shutdown_connections 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 --2- 172.21.15.93:0/3691791652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40cb650 0x7fbba40ca4c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 --2- 172.21.15.93:0/3691791652 >> v2:172.21.15.125:3300/0 conn(0x7fbba40cb270 0x7fbba40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 -- 172.21.15.93:0/3691791652 >> 172.21.15.93:0/3691791652 conn(0x7fbba406d820 msgr2=0x7fbba406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 -- 172.21.15.93:0/3691791652 shutdown_connections 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.342+0000 7fbbab087640 1 -- 172.21.15.93:0/3691791652 wait complete. 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.343+0000 7fbbab087640 1 Processor -- start 2023-11-04T01:37:39.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.343+0000 7fbbab087640 1 -- start start 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba40cb270 0x7fbba415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba40cb650 0x7fbba40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40c85c0 con 0x7fbba40b14d0 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40c88a0 con 0x7fbba40cb270 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40c6bc0 con 0x7fbba40cb650 2023-11-04T01:37:39.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43198/0 (socket says 172.21.15.93:43198) 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 -- 172.21.15.93:0/2316291089 learned_addr learned my addr 172.21.15.93:0/2316291089 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba9624640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba40cb650 0x7fbba40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba3fff640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba40cb270 0x7fbba415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 -- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba40cb650 msgr2=0x7fbba40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba40cb650 0x7fbba40c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 -- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba40cb270 msgr2=0x7fbba415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba40cb270 0x7fbba415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 -- 172.21.15.93:0/2316291089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb900094d0 con 0x7fbba40b14d0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba8e23640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d800 tx=0x7fbb9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800b6c0 con 0x7fbba40b14d0 2023-11-04T01:37:39.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800b820 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba40c6ea0 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800bbb0 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.344+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba415cc10 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.345+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba404e490 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.346+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb9800bd10 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.346+0000 7fbba17fa640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 0x7fbb8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.346+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbb98089ac0 con 0x7fbba40b14d0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.346+0000 7fbba3fff640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 0x7fbb8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.347+0000 7fbba3fff640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 0x7fbb8806d360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb90036000 tx=0x7fbb9003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.350+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb98054c20 con 0x7fbba40b14d0 2023-11-04T01:37:39.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.516+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbba40b59d0 con 0x7fbba40b14d0 2023-11-04T01:37:39.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.696+0000 7fbba17fa640 1 -- 172.21.15.93:0/2316291089 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbb98089e60 con 0x7fbba40b14d0 2023-11-04T01:37:39.698 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:37:39.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.699+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 msgr2=0x7fbb8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.699+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 0x7fbb8806d360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb90036000 tx=0x7fbb9003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:39.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.699+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 msgr2=0x7fbba40c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.699+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d800 tx=0x7fbb9800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 shutdown_connections 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8806aea0 0x7fbb8806d360 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba40cb650 0x7fbba40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba40cb270 0x7fbba415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 --2- 172.21.15.93:0/2316291089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba40b14d0 0x7fbba40c76a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 >> 172.21.15.93:0/2316291089 conn(0x7fbba406d820 msgr2=0x7fbba40b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 shutdown_connections 2023-11-04T01:37:39.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.700+0000 7fbbab087640 1 -- 172.21.15.93:0/2316291089 wait complete. 2023-11-04T01:37:39.715 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.820+0000 7fa875b39640 1 Processor -- start 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.820+0000 7fa875b39640 1 -- start start 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa875b39640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa87015ad40 0x7fa87006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa875b39640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8700c9b60 0x7fa870070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa875b39640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa870065df0 con 0x7fa87015b120 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa875b39640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87006bc40 con 0x7fa87015ad40 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa875b39640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa870066040 con 0x7fa8700c9b60 2023-11-04T01:37:39.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa87015ad40 0x7fa87006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa87015ad40 0x7fa87006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43200/0 (socket says 172.21.15.93:43200) 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 -- 172.21.15.93:0/1741018792 learned_addr learned my addr 172.21.15.93:0/1741018792 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86ffff640 1 --2- 172.21.15.93:0/1741018792 >> v2:172.21.15.125:3300/0 conn(0x7fa8700c9b60 0x7fa870070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 -- 172.21.15.93:0/1741018792 >> v2:172.21.15.125:3300/0 conn(0x7fa8700c9b60 msgr2=0x7fa870070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 --2- 172.21.15.93:0/1741018792 >> v2:172.21.15.125:3300/0 conn(0x7fa8700c9b60 0x7fa870070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 -- 172.21.15.93:0/1741018792 >> v1:172.21.15.125:6789/0 conn(0x7fa87015b120 legacy=0x7fa87015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.821+0000 7fa86f7fe640 1 -- 172.21.15.93:0/1741018792 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870066320 con 0x7fa87015ad40 2023-11-04T01:37:39.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.822+0000 7fa86f7fe640 1 --2- 172.21.15.93:0/1741018792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa87006b700 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8700c2b00 tx=0x7fa86002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6429e6f4e54d8f29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.822+0000 7fa86e7fc640 1 -- 172.21.15.93:0/1741018792 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860031870 con 0x7fa87015ad40 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.822+0000 7fa86e7fc640 1 -- 172.21.15.93:0/1741018792 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600319d0 con 0x7fa87015ad40 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.822+0000 7fa86e7fc640 1 -- 172.21.15.93:0/1741018792 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860031d60 con 0x7fa87015ad40 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 -- 172.21.15.93:0/1741018792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 msgr2=0x7fa87006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 --2- 172.21.15.93:0/1741018792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa87006b700 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8700c2b00 tx=0x7fa86002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 -- 172.21.15.93:0/1741018792 shutdown_connections 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 --2- 172.21.15.93:0/1741018792 >> v2:172.21.15.125:3300/0 conn(0x7fa8700c9b60 0x7fa870070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 --2- 172.21.15.93:0/1741018792 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa87006b700 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 -- 172.21.15.93:0/1741018792 >> 172.21.15.93:0/1741018792 conn(0x7fa8700cbc90 msgr2=0x7fa8700cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 -- 172.21.15.93:0/1741018792 shutdown_connections 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.823+0000 7fa875b39640 1 -- 172.21.15.93:0/1741018792 wait complete. 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.824+0000 7fa875b39640 1 Processor -- start 2023-11-04T01:37:39.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.824+0000 7fa875b39640 1 -- start start 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8700c9b60 0x7fa870154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa87015b120 0x7fa8700c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c8280 con 0x7fa87015ad40 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c8d30 con 0x7fa87015b120 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c8490 con 0x7fa8700c9b60 2023-11-04T01:37:39.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43210/0 (socket says 172.21.15.93:43210) 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 -- 172.21.15.93:0/4268188782 learned_addr learned my addr 172.21.15.93:0/4268188782 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86ffff640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa87015b120 0x7fa8700c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86f7fe640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8700c9b60 0x7fa870154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 -- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8700c9b60 msgr2=0x7fa870154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8700c9b60 0x7fa870154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 -- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa87015b120 msgr2=0x7fa8700c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa87015b120 0x7fa8700c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 -- 172.21.15.93:0/4268188782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600094d0 con 0x7fa87015ad40 2023-11-04T01:37:39.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa86effd640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b3c0 tx=0x7fa86400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864011830 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864011990 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864011d60 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.825+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8700c8770 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.826+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8701516f0 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.826+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870151880 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.827+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa86401b460 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.827+0000 7fa857fff640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 0x7fa85c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.828+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fa864089fd0 con 0x7fa87015ad40 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.828+0000 7fa86f7fe640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 0x7fa85c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.828+0000 7fa86f7fe640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 0x7fa85c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa860036000 tx=0x7fa86003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.831+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa864055010 con 0x7fa87015ad40 2023-11-04T01:37:39.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:39.997+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa870074290 con 0x7fa87015ad40 2023-11-04T01:37:40.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.699+0000 7fa857fff640 1 -- 172.21.15.93:0/4268188782 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa864058630 con 0x7fa87015ad40 2023-11-04T01:37:40.700 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:37:40.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 msgr2=0x7fa85c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 0x7fa85c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa860036000 tx=0x7fa86003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 msgr2=0x7fa8700c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b3c0 tx=0x7fa86400b880 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 shutdown_connections 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa85c06ae70 0x7fa85c06d330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa87015b120 0x7fa8700c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa87015ad40 0x7fa8700c7d40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 --2- 172.21.15.93:0/4268188782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8700c9b60 0x7fa870154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 >> 172.21.15.93:0/4268188782 conn(0x7fa8700cbc90 msgr2=0x7fa870156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.702+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 shutdown_connections 2023-11-04T01:37:40.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.703+0000 7fa875b39640 1 -- 172.21.15.93:0/4268188782 wait complete. 2023-11-04T01:37:40.730 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:37:40.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.835+0000 7f04e3f65640 1 Processor -- start 2023-11-04T01:37:40.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.835+0000 7f04e3f65640 1 -- start start 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e3f65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e3f65640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04dc0722a0 0x7f04dc0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e3f65640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0cdf80 con 0x7f04dc1603d0 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e3f65640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0b19d0 con 0x7f04dc0722a0 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e3f65640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc072730 con 0x7f04dc06a830 2023-11-04T01:37:40.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e2502640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04dc0722a0 0x7f04dc0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e2502640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f04dc0722a0 0x7f04dc0ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43222/0 (socket says 172.21.15.93:43222) 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e2502640 1 -- 172.21.15.93:0/306845218 learned_addr learned my addr 172.21.15.93:0/306845218 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.836+0000 7f04e1d01640 1 --1- 172.21.15.93:0/306845218 >> v1:172.21.15.93:6789/0 conn(0x7f04dc1603d0 0x7f04dc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55080/0 (socket says 172.21.15.93:55080) 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e1500640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e2502640 1 -- 172.21.15.93:0/306845218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 msgr2=0x7f04dc0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e2502640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e2502640 1 -- 172.21.15.93:0/306845218 >> v1:172.21.15.93:6789/0 conn(0x7f04dc1603d0 legacy=0x7f04dc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e0cff640 1 -- 172.21.15.93:0/306845218 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322785017 0 0) 0x7f04dc0cdf80 con 0x7f04dc1603d0 2023-11-04T01:37:40.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e2502640 1 -- 172.21.15.93:0/306845218 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0ce6f0 con 0x7f04dc0722a0 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.837+0000 7f04e2502640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0ca380 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009870 tx=0x7f04d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bc67a0c780702f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e0cff640 1 -- 172.21.15.93:0/306845218 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4031640 con 0x7f04dc0722a0 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e0cff640 1 -- 172.21.15.93:0/306845218 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40317a0 con 0x7f04dc0722a0 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e0cff640 1 -- 172.21.15.93:0/306845218 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4031b30 con 0x7f04dc0722a0 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 -- 172.21.15.93:0/306845218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 msgr2=0x7f04dc0ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0ca380 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009870 tx=0x7f04d402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 -- 172.21.15.93:0/306845218 shutdown_connections 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0ca380 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 --2- 172.21.15.93:0/306845218 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 -- 172.21.15.93:0/306845218 >> 172.21.15.93:0/306845218 conn(0x7f04dc06d800 msgr2=0x7f04dc06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 -- 172.21.15.93:0/306845218 shutdown_connections 2023-11-04T01:37:40.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.838+0000 7f04e3f65640 1 -- 172.21.15.93:0/306845218 wait complete. 2023-11-04T01:37:40.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.839+0000 7f04e3f65640 1 Processor -- start 2023-11-04T01:37:40.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.839+0000 7f04e3f65640 1 -- start start 2023-11-04T01:37:40.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 0x7f04dc148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c3b90 con 0x7f04dc0722a0 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1492f0 con 0x7f04dc1603d0 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e3f65640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0b4500 con 0x7f04dc06a830 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43228/0 (socket says 172.21.15.93:43228) 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 -- 172.21.15.93:0/2646603302 learned_addr learned my addr 172.21.15.93:0/2646603302 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e2502640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 0x7f04dc148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1d01640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 -- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 msgr2=0x7f04dc0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 -- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 msgr2=0x7f04dc148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 0x7f04dc148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e1500640 1 -- 172.21.15.93:0/2646603302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40094d0 con 0x7f04dc0722a0 2023-11-04T01:37:40.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.840+0000 7f04e2502640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 0x7f04dc148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04e1500640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d800 tx=0x7f04cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00b6c0 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00b820 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0b47e0 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00bbb0 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.841+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc0b4da0 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.842+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc0b5990 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.842+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04cc00bd10 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.842+0000 7f04d27fc640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 0x7f04c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.843+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f04cc089de0 con 0x7f04dc0722a0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.843+0000 7f04e1d01640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 0x7f04c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.843+0000 7f04e1d01640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 0x7f04c006d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04d80012e0 tx=0x7f04d8005eb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:40.847+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04cc054c50 con 0x7f04dc0722a0 2023-11-04T01:37:41.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.048+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f04dc0ca8b0 con 0x7f04dc0722a0 2023-11-04T01:37:41.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.725+0000 7f04d27fc640 1 -- 172.21.15.93:0/2646603302 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f04cc058270 con 0x7f04dc0722a0 2023-11-04T01:37:41.727 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 8 and data pool 9 2023-11-04T01:37:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.731+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 msgr2=0x7f04c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.731+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 0x7f04c006d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04d80012e0 tx=0x7f04d8005eb0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.731+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 msgr2=0x7f04dc0c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.731+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d800 tx=0x7f04cc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 shutdown_connections 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f04c006ae70 0x7f04c006d330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04dc1603d0 0x7f04dc148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04dc0722a0 0x7f04dc0c3650 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 --2- 172.21.15.93:0/2646603302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f04dc06a830 0x7f04dc0b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.738+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 >> 172.21.15.93:0/2646603302 conn(0x7f04dc06d800 msgr2=0x7f04dc15db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.739+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 shutdown_connections 2023-11-04T01:37:41.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.740+0000 7f04e3f65640 1 -- 172.21.15.93:0/2646603302 wait complete. 2023-11-04T01:37:41.760 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:41.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.857+0000 7f84096b4640 1 Processor -- start 2023-11-04T01:37:41.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.857+0000 7f84096b4640 1 -- start start 2023-11-04T01:37:41.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84096b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84096b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f84040ce240 0x7f84040d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84096b4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840415e000 con 0x7f840415daa0 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84096b4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840415e5c0 con 0x7f84040ce240 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84096b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840415e2e0 con 0x7f84040cde60 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f8402ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84037fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f84040ce240 0x7f84040d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84027fc640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f840415daa0 0x7f8404157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:53736/0 (socket says 172.21.15.93:53736) 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84027fc640 1 -- 172.21.15.93:0/1806042840 learned_addr learned my addr 172.21.15.93:0/1806042840 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f84037fe640 1 --2- 172.21.15.93:0/1806042840 >> v2:172.21.15.125:3300/0 conn(0x7f84040ce240 0x7f84040d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:48436/0 (socket says 172.21.15.93:48436) 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.858+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:39722/0 (socket says 172.21.15.93:39722) 2023-11-04T01:37:41.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f8401ffb640 1 -- 172.21.15.93:0/1806042840 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623079811 0 0) 0x7f840415e000 con 0x7f840415daa0 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f8401ffb640 1 -- 172.21.15.93:0/1806042840 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec003520 con 0x7f840415daa0 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f84037fe640 1 -- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 msgr2=0x7f840415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f84037fe640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f84037fe640 1 -- 172.21.15.93:0/1806042840 >> v1:172.21.15.125:6789/0 conn(0x7f840415daa0 legacy=0x7f8404157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f84037fe640 1 -- 172.21.15.93:0/1806042840 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040d1120 con 0x7f84040ce240 2023-11-04T01:37:41.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.859+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84037fe640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040ce240 0x7f84040d1920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0097a0 tx=0x7f83fc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f68d2d438311764 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f8401ffb640 1 -- 172.21.15.93:0/1806042840 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc031830 con 0x7f84040ce240 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f8401ffb640 1 -- 172.21.15.93:0/1806042840 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc031990 con 0x7f84040ce240 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f8401ffb640 1 -- 172.21.15.93:0/1806042840 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc031d00 con 0x7f84040ce240 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 -- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040ce240 msgr2=0x7f84040d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040ce240 0x7f84040d1920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0097a0 tx=0x7f83fc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 -- 172.21.15.93:0/1806042840 shutdown_connections 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040ce240 0x7f84040d1920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 --2- 172.21.15.93:0/1806042840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040cde60 0x7f840415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 -- 172.21.15.93:0/1806042840 >> 172.21.15.93:0/1806042840 conn(0x7f8404071f30 msgr2=0x7f84040cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 -- 172.21.15.93:0/1806042840 shutdown_connections 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.860+0000 7f84096b4640 1 -- 172.21.15.93:0/1806042840 wait complete. 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 Processor -- start 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 -- start start 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 0x7f84041f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040ce240 0x7f84040cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8404147600 con 0x7f840415daa0 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8404146a10 con 0x7f84040cde60 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.862+0000 7f84096b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8404146c60 con 0x7f84040ce240 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55648/0 (socket says 172.21.15.93:55648) 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 -- 172.21.15.93:0/1084526916 learned_addr learned my addr 172.21.15.93:0/1084526916 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:41.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 0x7f84041f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84027fc640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040ce240 0x7f84040cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 -- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040ce240 msgr2=0x7f84040cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040ce240 0x7f84040cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 -- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 msgr2=0x7f84041f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 0x7f84041f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 -- 172.21.15.93:0/1084526916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009a70 con 0x7f840415daa0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 0x7f84041f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84037fe640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f83fc02b910 tx=0x7f83fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc03a630 con 0x7f840415daa0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc03a7b0 con 0x7f840415daa0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc009400 con 0x7f840415daa0 2023-11-04T01:37:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc03ab60 con 0x7f840415daa0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.863+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8404147220 con 0x7f840415daa0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.864+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8404147740 con 0x7f840415daa0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.865+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83fc03acc0 con 0x7f840415daa0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.865+0000 7f83eb7fe640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 0x7f83f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.865+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 0x7f83f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.865+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f83fc0ab5b0 con 0x7f840415daa0 2023-11-04T01:37:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.866+0000 7f8402ffd640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 0x7f83f006d360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009fd0 tx=0x7f83f400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:41.870+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8404147740 con 0x7f840415daa0 2023-11-04T01:37:42.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.038+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8404147740 con 0x7f840415daa0 2023-11-04T01:37:42.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.039+0000 7f83eb7fe640 1 -- 172.21.15.93:0/1084526916 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18548 (secure 0 0 0) 0x7f8404147740 con 0x7f840415daa0 2023-11-04T01:37:42.041 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:42.041 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":53,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:41.048946+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 msgr2=0x7f83f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 0x7f83f006d360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009fd0 tx=0x7f83f400b040 comp rx=0 tx=0).stop 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 msgr2=0x7f84040cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f83fc02b910 tx=0x7f83fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 shutdown_connections 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f83f006aea0 0x7f83f006d360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f840415daa0 0x7f84040cc440 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84040ce240 0x7f84040cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 --2- 172.21.15.93:0/1084526916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84040cde60 0x7f84041f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 >> 172.21.15.93:0/1084526916 conn(0x7f8404071f30 msgr2=0x7f84040b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 shutdown_connections 2023-11-04T01:37:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.041+0000 7f84096b4640 1 -- 172.21.15.93:0/1084526916 wait complete. 2023-11-04T01:37:42.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:42.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.152+0000 7f0787a90640 1 Processor -- start 2023-11-04T01:37:42.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.152+0000 7f0787a90640 1 -- start start 2023-11-04T01:37:42.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f0787a90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07800cda60 0x7f07800ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f0787a90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0780070d40 0x7f078006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f0787a90640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07800cc990 con 0x7f07800b0cd0 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f0787a90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800ccc70 con 0x7f0780070d40 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f0787a90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800c9ce0 con 0x7f07800cda60 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0780070d40 0x7f078006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0780070d40 0x7f078006c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55654/0 (socket says 172.21.15.93:55654) 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 -- 172.21.15.93:0/1826027021 learned_addr learned my addr 172.21.15.93:0/1826027021 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078582c640 1 --2- 172.21.15.93:0/1826027021 >> v2:172.21.15.125:3300/0 conn(0x7f07800cda60 0x7f07800ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 -- 172.21.15.93:0/1826027021 >> v2:172.21.15.125:3300/0 conn(0x7f07800cda60 msgr2=0x7f07800ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 --2- 172.21.15.93:0/1826027021 >> v2:172.21.15.125:3300/0 conn(0x7f07800cda60 0x7f07800ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 -- 172.21.15.93:0/1826027021 >> v1:172.21.15.125:6789/0 conn(0x7f07800b0cd0 legacy=0x7f0780070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.153+0000 7f078602d640 1 -- 172.21.15.93:0/1826027021 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800c9fc0 con 0x7f0780070d40 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f078602d640 1 --2- 172.21.15.93:0/1826027021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f078006c200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f07800cf800 tx=0x7f077802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4928f7729c78703d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f078482a640 1 -- 172.21.15.93:0/1826027021 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077802ec90 con 0x7f0780070d40 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f078482a640 1 -- 172.21.15.93:0/1826027021 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077802edf0 con 0x7f0780070d40 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f078482a640 1 -- 172.21.15.93:0/1826027021 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778036610 con 0x7f0780070d40 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f0787a90640 1 -- 172.21.15.93:0/1826027021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 msgr2=0x7f078006c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.154+0000 7f0787a90640 1 --2- 172.21.15.93:0/1826027021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f078006c200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f07800cf800 tx=0x7f077802e0f0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 -- 172.21.15.93:0/1826027021 shutdown_connections 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 --2- 172.21.15.93:0/1826027021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f078006c200 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 --2- 172.21.15.93:0/1826027021 >> v2:172.21.15.125:3300/0 conn(0x7f07800cda60 0x7f07800ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 -- 172.21.15.93:0/1826027021 >> 172.21.15.93:0/1826027021 conn(0x7f07800ce950 msgr2=0x7f07800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 -- 172.21.15.93:0/1826027021 shutdown_connections 2023-11-04T01:37:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.155+0000 7f0787a90640 1 -- 172.21.15.93:0/1826027021 wait complete. 2023-11-04T01:37:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 Processor -- start 2023-11-04T01:37:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 -- start start 2023-11-04T01:37:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07800b0cd0 0x7f07800c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07800cda60 0x7f0780156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07800c6d80 con 0x7f0780070d40 2023-11-04T01:37:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07800c7750 con 0x7f07800cda60 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.156+0000 7f0787a90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07800c5ed0 con 0x7f07800b0cd0 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55664/0 (socket says 172.21.15.93:55664) 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 -- 172.21.15.93:0/1683490565 learned_addr learned my addr 172.21.15.93:0/1683490565 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078602d640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07800cda60 0x7f0780156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 -- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07800b0cd0 msgr2=0x7f07800c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07800b0cd0 0x7f07800c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 -- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07800cda60 msgr2=0x7f0780156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07800cda60 0x7f0780156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 -- 172.21.15.93:0/1683490565 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778009b30 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f078582c640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f077c00d830 tx=0x7f077c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00b6c0 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00b820 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07800c6170 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00bbb0 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.157+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07800c6730 con 0x7f0780070d40 2023-11-04T01:37:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.158+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780074290 con 0x7f0780070d40 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.159+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f077c01e460 con 0x7f0780070d40 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.159+0000 7f07767fc640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 0x7f076406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.159+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f077c08a050 con 0x7f0780070d40 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.159+0000 7f078502b640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 0x7f076406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.159+0000 7f078502b640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 0x7f076406d330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f07800b0240 tx=0x7f07700079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.163+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f077c054e40 con 0x7f0780070d40 2023-11-04T01:37:42.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.332+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07800cdff0 con 0x7f0780070d40 2023-11-04T01:37:42.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.334+0000 7f07767fc640 1 -- 172.21.15.93:0/1683490565 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18548 (secure 0 0 0) 0x7f077c058460 con 0x7f0780070d40 2023-11-04T01:37:42.335 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:42.335 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":53,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:41.048946+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:42.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 msgr2=0x7f076406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 0x7f076406d330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f07800b0240 tx=0x7f07700079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 msgr2=0x7f07800c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f077c00d830 tx=0x7f077c00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 shutdown_connections 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f076406ae70 0x7f076406d330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07800cda60 0x7f0780156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07800b0cd0 0x7f07800c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 --2- 172.21.15.93:0/1683490565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0780070d40 0x7f07800c7210 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 >> 172.21.15.93:0/1683490565 conn(0x7f07800ce950 msgr2=0x7f0780070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 shutdown_connections 2023-11-04T01:37:42.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.336+0000 7f0787a90640 1 -- 172.21.15.93:0/1683490565 wait complete. 2023-11-04T01:37:42.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:37:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.449+0000 7fbd12b00640 1 Processor -- start 2023-11-04T01:37:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 -- start start 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd0c153e60 0x7fbd0c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 0x7fbd0c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0cde60 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c160f90 con 0x7fbd0c153e60 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd12b00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0b5200 con 0x7fbd0c0b4880 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd1089c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd0c153e60 0x7fbd0c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd1089c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd0c153e60 0x7fbd0c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55674/0 (socket says 172.21.15.93:55674) 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.450+0000 7fbd1089c640 1 -- 172.21.15.93:0/2611906383 learned_addr learned my addr 172.21.15.93:0/2611906383 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1089c640 1 -- 172.21.15.93:0/2611906383 >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 msgr2=0x7fbd0c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1109d640 1 --2- 172.21.15.93:0/2611906383 >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 0x7fbd0c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1089c640 1 --2- 172.21.15.93:0/2611906383 >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 0x7fbd0c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1089c640 1 -- 172.21.15.93:0/2611906383 >> v1:172.21.15.125:6789/0 conn(0x7fbd0c0cd6d0 legacy=0x7fbd0c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1089c640 1 -- 172.21.15.93:0/2611906383 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c15e400 con 0x7fbd0c153e60 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1109d640 1 --2- 172.21.15.93:0/2611906383 >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 0x7fbd0c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.451+0000 7fbd1089c640 1 --2- 172.21.15.93:0/2611906383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c153e60 0x7fbd0c15dec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0b8f40 tx=0x7fbcfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ace2a12df21984b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd0b7fe640 1 -- 172.21.15.93:0/2611906383 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc031870 con 0x7fbd0c153e60 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd0b7fe640 1 -- 172.21.15.93:0/2611906383 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc0319d0 con 0x7fbd0c153e60 2023-11-04T01:37:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd0b7fe640 1 -- 172.21.15.93:0/2611906383 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc031d60 con 0x7fbd0c153e60 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 -- 172.21.15.93:0/2611906383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c153e60 msgr2=0x7fbd0c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 --2- 172.21.15.93:0/2611906383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c153e60 0x7fbd0c15dec0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0b8f40 tx=0x7fbcfc02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 -- 172.21.15.93:0/2611906383 shutdown_connections 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 --2- 172.21.15.93:0/2611906383 >> v2:172.21.15.125:3300/0 conn(0x7fbd0c0b4880 0x7fbd0c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 --2- 172.21.15.93:0/2611906383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c153e60 0x7fbd0c15dec0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 -- 172.21.15.93:0/2611906383 >> 172.21.15.93:0/2611906383 conn(0x7fbd0c0cf880 msgr2=0x7fbd0c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 -- 172.21.15.93:0/2611906383 shutdown_connections 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.452+0000 7fbd12b00640 1 -- 172.21.15.93:0/2611906383 wait complete. 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.453+0000 7fbd12b00640 1 Processor -- start 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.453+0000 7fbd12b00640 1 -- start start 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd0c0b4880 0x7fbd0c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd0c153e60 0x7fbd0c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c150560 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c150a70 con 0x7fbd0c0b4880 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd12b00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0caab0 con 0x7fbd0c153e60 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd0bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd0bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55690/0 (socket says 172.21.15.93:55690) 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.454+0000 7fbd0bfff640 1 -- 172.21.15.93:0/970274951 learned_addr learned my addr 172.21.15.93:0/970274951 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd1109d640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd0c153e60 0x7fbd0c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd1089c640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd0c0b4880 0x7fbd0c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 -- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd0c153e60 msgr2=0x7fbd0c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd0c153e60 0x7fbd0c0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 -- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd0c0b4880 msgr2=0x7fbd0c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd0c0b4880 0x7fbd0c150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 -- 172.21.15.93:0/970274951 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc0094d0 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd0bfff640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c400 tx=0x7fbd0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011790 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00011930 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c0cad90 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011ce0 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.455+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c0cb350 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.456+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c074290 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.456+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd0001c460 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.457+0000 7fbd097fa640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 0x7fbcf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.457+0000 7fbd1089c640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 0x7fbcf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.457+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbd00089740 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.457+0000 7fbd1089c640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 0x7fbcf806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc036000 tx=0x7fbcfc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.461+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd000545e0 con 0x7fbd0c0cd6d0 2023-11-04T01:37:42.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:42.662+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbd0c0d0b80 con 0x7fbd0c0cd6d0 2023-11-04T01:37:43.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.034+0000 7fbd097fa640 1 -- 172.21.15.93:0/970274951 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbd00057c00 con 0x7fbd0c0cd6d0 2023-11-04T01:37:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 msgr2=0x7fbcf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 0x7fbcf806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc036000 tx=0x7fbcfc03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 msgr2=0x7fbd0c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c400 tx=0x7fbd0000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 shutdown_connections 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbcf806ae70 0x7fbcf806d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbd0c153e60 0x7fbd0c0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd0c0cd6d0 0x7fbd0c0c9ed0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 --2- 172.21.15.93:0/970274951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd0c0b4880 0x7fbd0c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 >> 172.21.15.93:0/970274951 conn(0x7fbd0c0cf880 msgr2=0x7fbd0c15ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 shutdown_connections 2023-11-04T01:37:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.036+0000 7fbd12b00640 1 -- 172.21.15.93:0/970274951 wait complete. 2023-11-04T01:37:43.050 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:37:43.050 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:37:43.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.154+0000 7fccc3810640 1 Processor -- start 2023-11-04T01:37:43.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.154+0000 7fccc3810640 1 -- start start 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc3810640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 0x7fccbc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc3810640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc3810640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccbc15aff0 con 0x7fccbc0c48e0 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc3810640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccbc0c52a0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc3810640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc15a3e0 con 0x7fccbc159c00 2023-11-04T01:37:43.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55692/0 (socket says 172.21.15.93:55692) 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 -- 172.21.15.93:0/2962389878 learned_addr learned my addr 172.21.15.93:0/2962389878 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc15ac640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 0x7fccbc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 -- 172.21.15.93:0/2962389878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 msgr2=0x7fccbc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 0x7fccbc0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 -- 172.21.15.93:0/2962389878 >> v1:172.21.15.125:6789/0 conn(0x7fccbc0c48e0 legacy=0x7fccbc0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc1dad640 1 -- 172.21.15.93:0/2962389878 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc15a6c0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.155+0000 7fccc15ac640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 0x7fccbc0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc1dad640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009870 tx=0x7fccb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74422c0977ab56be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccb3fff640 1 -- 172.21.15.93:0/2962389878 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4031640 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccb3fff640 1 -- 172.21.15.93:0/2962389878 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40317a0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccb3fff640 1 -- 172.21.15.93:0/2962389878 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4031b30 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc3810640 1 -- 172.21.15.93:0/2962389878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 msgr2=0x7fccbc0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc3810640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009870 tx=0x7fccb402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc3810640 1 -- 172.21.15.93:0/2962389878 shutdown_connections 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc3810640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc0c4d60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.156+0000 7fccc3810640 1 --2- 172.21.15.93:0/2962389878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc159c00 0x7fccbc0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.157+0000 7fccc3810640 1 -- 172.21.15.93:0/2962389878 >> 172.21.15.93:0/2962389878 conn(0x7fccbc0ce950 msgr2=0x7fccbc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.157+0000 7fccc3810640 1 -- 172.21.15.93:0/2962389878 shutdown_connections 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.157+0000 7fccc3810640 1 -- 172.21.15.93:0/2962389878 wait complete. 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 Processor -- start 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 -- start start 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc0c48e0 0x7fccbc158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc159c00 0x7fccbc141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc158360 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc157ed0 con 0x7fccbc159c00 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.158+0000 7fccc3810640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc159470 con 0x7fccbc0c48e0 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55708/0 (socket says 172.21.15.93:55708) 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 -- 172.21.15.93:0/3110253092 learned_addr learned my addr 172.21.15.93:0/3110253092 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:43.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 -- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc0c48e0 msgr2=0x7fccbc158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc0c48e0 0x7fccbc158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 -- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc159c00 msgr2=0x7fccbc141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc159c00 0x7fccbc141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 -- 172.21.15.93:0/3110253092 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40094d0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc15ac640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccb800cf90 tx=0x7fccb800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800d840 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb800d9a0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc1572c0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800dd30 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.159+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc157880 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.160+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc074290 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.161+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccb8015440 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.161+0000 7fccb1ffb640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 0x7fcca006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.161+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccb808a1c0 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.161+0000 7fccc0dab640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 0x7fcca006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.162+0000 7fccc0dab640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 0x7fcca006d360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fccbc158750 tx=0x7fccac0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.165+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fccb8055080 con 0x7fccbc0ae1d0 2023-11-04T01:37:43.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:43.366+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fccbc0c3be0 con 0x7fccbc0ae1d0 2023-11-04T01:37:44.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.039+0000 7fccb1ffb640 1 -- 172.21.15.93:0/3110253092 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fccb80586a0 con 0x7fccbc0ae1d0 2023-11-04T01:37:44.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 msgr2=0x7fcca006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 0x7fcca006d360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fccbc158750 tx=0x7fccac0079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 msgr2=0x7fccbc156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccb800cf90 tx=0x7fccb800a7d0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 shutdown_connections 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcca006aea0 0x7fcca006d360 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fccbc159c00 0x7fccbc141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fccbc0c48e0 0x7fccbc158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 --2- 172.21.15.93:0/3110253092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccbc0ae1d0 0x7fccbc156c30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 >> 172.21.15.93:0/3110253092 conn(0x7fccbc0ce950 msgr2=0x7fccbc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 shutdown_connections 2023-11-04T01:37:44.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.041+0000 7fccc3810640 1 -- 172.21.15.93:0/3110253092 wait complete. 2023-11-04T01:37:44.056 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:37:44.057 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:44.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.157+0000 7f47e1dce640 1 Processor -- start 2023-11-04T01:37:44.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.157+0000 7f47e1dce640 1 -- start start 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47e1dce640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f47dc15ad80 0x7f47dc06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47e1dce640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f47dc0b42c0 0x7f47dc0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47e1dce640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc06cd00 con 0x7f47dc0c9c40 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47e1dce640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc0ca020 con 0x7f47dc0b42c0 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47e1dce640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc06cfa0 con 0x7f47dc15ad80 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f47dc0b42c0 0x7f47dc0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47dbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f47dc0c9c40 0x7f47dc070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44762/0 (socket says 172.21.15.93:44762) 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f47dc0b42c0 0x7f47dc0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55716/0 (socket says 172.21.15.93:55716) 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47dbfff640 1 -- 172.21.15.93:0/1714059544 learned_addr learned my addr 172.21.15.93:0/1714059544 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47db7fe640 1 --2- 172.21.15.93:0/1714059544 >> v2:172.21.15.125:3300/0 conn(0x7f47dc15ad80 0x7f47dc06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 -- 172.21.15.93:0/1714059544 >> v2:172.21.15.125:3300/0 conn(0x7f47dc15ad80 msgr2=0x7f47dc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 --2- 172.21.15.93:0/1714059544 >> v2:172.21.15.125:3300/0 conn(0x7f47dc15ad80 0x7f47dc06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 -- 172.21.15.93:0/1714059544 >> v1:172.21.15.93:6789/0 conn(0x7f47dc0c9c40 legacy=0x7f47dc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47daffd640 1 -- 172.21.15.93:0/1714059544 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc06d280 con 0x7f47dc0b42c0 2023-11-04T01:37:44.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.158+0000 7f47da7fc640 1 -- 172.21.15.93:0/1714059544 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829200795 0 0) 0x7f47dc06cd00 con 0x7f47dc0c9c40 2023-11-04T01:37:44.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.159+0000 7f47daffd640 1 --2- 172.21.15.93:0/1714059544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc0b42c0 0x7f47dc0c9700 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0b4ac0 tx=0x7f47d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443d26bb04802fa6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.159+0000 7f47da7fc640 1 -- 172.21.15.93:0/1714059544 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0030610 con 0x7f47dc0b42c0 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.159+0000 7f47da7fc640 1 -- 172.21.15.93:0/1714059544 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0030770 con 0x7f47dc0b42c0 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.159+0000 7f47da7fc640 1 -- 172.21.15.93:0/1714059544 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0030b00 con 0x7f47dc0b42c0 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 -- 172.21.15.93:0/1714059544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc0b42c0 msgr2=0x7f47dc0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1714059544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc0b42c0 0x7f47dc0c9700 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0b4ac0 tx=0x7f47d002b960 comp rx=0 tx=0).stop 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 -- 172.21.15.93:0/1714059544 shutdown_connections 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1714059544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc0b42c0 0x7f47dc0c9700 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1714059544 >> v2:172.21.15.125:3300/0 conn(0x7f47dc15ad80 0x7f47dc06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 -- 172.21.15.93:0/1714059544 >> 172.21.15.93:0/1714059544 conn(0x7f47dc0ce950 msgr2=0x7f47dc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 -- 172.21.15.93:0/1714059544 shutdown_connections 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.160+0000 7f47e1dce640 1 -- 172.21.15.93:0/1714059544 wait complete. 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.161+0000 7f47e1dce640 1 Processor -- start 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.161+0000 7f47e1dce640 1 -- start start 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f47dc0b42c0 0x7f47dc0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 0x7f47dc0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0acb60 con 0x7f47dc15ad80 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15cbe0 con 0x7f47dc0c9c40 2023-11-04T01:37:44.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47e1dce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15c8d0 con 0x7f47dc0b42c0 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55728/0 (socket says 172.21.15.93:55728) 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 -- 172.21.15.93:0/1490210188 learned_addr learned my addr 172.21.15.93:0/1490210188 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 -- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f47dc0b42c0 msgr2=0x7f47dc0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f47dc0b42c0 0x7f47dc0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 -- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 msgr2=0x7f47dc0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47daffd640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 0x7f47dc0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 0x7f47dc0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 -- 172.21.15.93:0/1490210188 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0009400 con 0x7f47dc15ad80 2023-11-04T01:37:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47daffd640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 0x7f47dc0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.162+0000 7f47dbfff640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47d400cb60 tx=0x7f47d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.163+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400ad40 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.163+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4012400 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.163+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc0ac2c0 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.163+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40127b0 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.163+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc0ac880 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.164+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc074290 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.164+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47d4007070 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.164+0000 7f47c3fff640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 0x7f47c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.164+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f47d4089870 con 0x7f47dc15ad80 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.165+0000 7f47db7fe640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 0x7f47c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.165+0000 7f47db7fe640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 0x7f47c806d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f47cc006fd0 tx=0x7f47cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.169+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47d4054710 con 0x7f47dc15ad80 2023-11-04T01:37:44.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.371+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47dc06d810 con 0x7f47dc15ad80 2023-11-04T01:37:44.373 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.371+0000 7f47c3fff640 1 -- 172.21.15.93:0/1490210188 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f47d4057d30 con 0x7f47dc15ad80 2023-11-04T01:37:44.373 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:44.373 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:44.373 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:44.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 msgr2=0x7f47c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 0x7f47c806d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f47cc006fd0 tx=0x7f47cc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:44.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 msgr2=0x7f47dc0cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47d400cb60 tx=0x7f47d400a430 comp rx=0 tx=0).stop 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 shutdown_connections 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f47c806ae70 0x7f47c806d330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47dc15ad80 0x7f47dc0cdfb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f47dc0c9c40 0x7f47dc0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 --2- 172.21.15.93:0/1490210188 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f47dc0b42c0 0x7f47dc0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.373+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 >> 172.21.15.93:0/1490210188 conn(0x7f47dc0ce950 msgr2=0x7f47dc0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.374+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 shutdown_connections 2023-11-04T01:37:44.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.374+0000 7f47e1dce640 1 -- 172.21.15.93:0/1490210188 wait complete. 2023-11-04T01:37:44.386 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:44.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.483+0000 7f7ec67a9640 1 Processor -- start 2023-11-04T01:37:44.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 -- start start 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ec00cde60 0x7f7ec015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 0x7f7ec0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec015e5c0 con 0x7f7ec00cde60 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0157a80 con 0x7f7ec015daa0 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ec67a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec015e000 con 0x7f7ec00ce240 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.484+0000 7f7ebffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ec00cde60 0x7f7ec015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ec00cde60 0x7f7ec015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55744/0 (socket says 172.21.15.93:55744) 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 -- 172.21.15.93:0/2572528906 learned_addr learned my addr 172.21.15.93:0/2572528906 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebf7fe640 1 --2- 172.21.15.93:0/2572528906 >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 0x7f7ec0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ec4d46640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 -- 172.21.15.93:0/2572528906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 msgr2=0x7f7ec0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec0157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 -- 172.21.15.93:0/2572528906 >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 msgr2=0x7f7ec0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 --2- 172.21.15.93:0/2572528906 >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 0x7f7ec0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebffff640 1 -- 172.21.15.93:0/2572528906 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec015e2e0 con 0x7f7ec00cde60 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.485+0000 7f7ebf7fe640 1 --2- 172.21.15.93:0/2572528906 >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 0x7f7ec0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ebffff640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec00cde60 0x7f7ec015d560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00cf5f0 tx=0x7f7eb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5575371c2f16e1ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ebeffd640 1 -- 172.21.15.93:0/2572528906 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0031870 con 0x7f7ec00cde60 2023-11-04T01:37:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ebeffd640 1 -- 172.21.15.93:0/2572528906 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb00319d0 con 0x7f7ec00cde60 2023-11-04T01:37:44.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ebeffd640 1 -- 172.21.15.93:0/2572528906 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0031d60 con 0x7f7ec00cde60 2023-11-04T01:37:44.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 -- 172.21.15.93:0/2572528906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec00cde60 msgr2=0x7f7ec015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec00cde60 0x7f7ec015d560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00cf5f0 tx=0x7f7eb002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:44.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 -- 172.21.15.93:0/2572528906 shutdown_connections 2023-11-04T01:37:44.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/2572528906 >> v2:172.21.15.125:3300/0 conn(0x7f7ec015daa0 0x7f7ec0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/2572528906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec00cde60 0x7f7ec015d560 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 -- 172.21.15.93:0/2572528906 >> 172.21.15.93:0/2572528906 conn(0x7f7ec0071f30 msgr2=0x7f7ec00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 -- 172.21.15.93:0/2572528906 shutdown_connections 2023-11-04T01:37:44.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.486+0000 7f7ec67a9640 1 -- 172.21.15.93:0/2572528906 wait complete. 2023-11-04T01:37:44.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.487+0000 7f7ec67a9640 1 Processor -- start 2023-11-04T01:37:44.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 -- start start 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec00cde60 0x7f7ec015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec015c9b0 con 0x7f7ec015daa0 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0157f60 con 0x7f7ec00cde60 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec67a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0158240 con 0x7f7ec00ce240 2023-11-04T01:37:44.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.488+0000 7f7ec4d46640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55752/0 (socket says 172.21.15.93:55752) 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 -- 172.21.15.93:0/634993384 learned_addr learned my addr 172.21.15.93:0/634993384 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ebffff640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec00cde60 0x7f7ec015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ebf7fe640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 -- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 msgr2=0x7f7ec00c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec00c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 -- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec00cde60 msgr2=0x7f7ec015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec00cde60 0x7f7ec015c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 -- 172.21.15.93:0/634993384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00094d0 con 0x7f7ec015daa0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec4d46640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007e30 tx=0x7f7eb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8014420 con 0x7f7ec015daa0 2023-11-04T01:37:44.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8014580 con 0x7f7ec015daa0 2023-11-04T01:37:44.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0158520 con 0x7f7ec015daa0 2023-11-04T01:37:44.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8014930 con 0x7f7ec015daa0 2023-11-04T01:37:44.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.489+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec0158ae0 con 0x7f7ec015daa0 2023-11-04T01:37:44.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.490+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec0074290 con 0x7f7ec015daa0 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.491+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7eb8014a90 con 0x7f7ec015daa0 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.491+0000 7f7ebcff9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 0x7f7eac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.491+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7eb808a070 con 0x7f7ec015daa0 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.491+0000 7f7ebffff640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 0x7f7eac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.492+0000 7f7ebffff640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 0x7f7eac06d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0036000 tx=0x7f7eb003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.495+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7eb8054f30 con 0x7f7ec015daa0 2023-11-04T01:37:44.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.662+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec00d2740 con 0x7f7ec015daa0 2023-11-04T01:37:44.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.663+0000 7f7ebcff9640 1 -- 172.21.15.93:0/634993384 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f7eb8058550 con 0x7f7ec015daa0 2023-11-04T01:37:44.665 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:44.665 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:42.715268+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 msgr2=0x7f7eac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 0x7f7eac06d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0036000 tx=0x7f7eb003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 msgr2=0x7f7ec00b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007e30 tx=0x7f7eb800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 shutdown_connections 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7eac06ae70 0x7f7eac06d330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ec015daa0 0x7f7ec00b3f00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ec00ce240 0x7f7ec00c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 --2- 172.21.15.93:0/634993384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ec00cde60 0x7f7ec015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 >> 172.21.15.93:0/634993384 conn(0x7f7ec0071f30 msgr2=0x7f7ec0156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 shutdown_connections 2023-11-04T01:37:44.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.665+0000 7f7ec67a9640 1 -- 172.21.15.93:0/634993384 wait complete. 2023-11-04T01:37:44.679 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:37:44.679 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:44.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.776+0000 7f680c0f2640 1 Processor -- start 2023-11-04T01:37:44.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.776+0000 7f680c0f2640 1 -- start start 2023-11-04T01:37:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680c0f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6804159c70 0x7f68040ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680c0f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68040b0ae0 0x7f680415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680c0f2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b4110 con 0x7f680406db20 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680c0f2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b49b0 con 0x7f6804159c70 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680c0f2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b43f0 con 0x7f68040b0ae0 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6804159c70 0x7f68040ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6804159c70 0x7f68040ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55762/0 (socket says 172.21.15.93:55762) 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 -- 172.21.15.93:0/2963224879 learned_addr learned my addr 172.21.15.93:0/2963224879 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f680a68f640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68040b0ae0 0x7f680415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 -- 172.21.15.93:0/2963224879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68040b0ae0 msgr2=0x7f680415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68040b0ae0 0x7f680415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.777+0000 7f6809e8e640 1 -- 172.21.15.93:0/2963224879 >> v1:172.21.15.125:6789/0 conn(0x7f680406db20 legacy=0x7f68040b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.778+0000 7f6809e8e640 1 -- 172.21.15.93:0/2963224879 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040b46d0 con 0x7f6804159c70 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.778+0000 7f6809e8e640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68040ce370 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f680000bb10 tx=0x7f680002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eb092353a0e484 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.778+0000 7f6808e8c640 1 -- 172.21.15.93:0/2963224879 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680002ee70 con 0x7f6804159c70 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.778+0000 7f6808e8c640 1 -- 172.21.15.93:0/2963224879 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800036440 con 0x7f6804159c70 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.778+0000 7f6808e8c640 1 -- 172.21.15.93:0/2963224879 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000367d0 con 0x7f6804159c70 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 -- 172.21.15.93:0/2963224879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 msgr2=0x7f68040ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68040ce370 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f680000bb10 tx=0x7f680002e0c0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 -- 172.21.15.93:0/2963224879 shutdown_connections 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68040b0ae0 0x7f680415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2963224879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68040ce370 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 -- 172.21.15.93:0/2963224879 >> 172.21.15.93:0/2963224879 conn(0x7f68040ce950 msgr2=0x7f68040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 -- 172.21.15.93:0/2963224879 shutdown_connections 2023-11-04T01:37:44.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.779+0000 7f680c0f2640 1 -- 172.21.15.93:0/2963224879 wait complete. 2023-11-04T01:37:44.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.780+0000 7f680c0f2640 1 Processor -- start 2023-11-04T01:37:44.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.780+0000 7f680c0f2640 1 -- start start 2023-11-04T01:37:44.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680406db20 0x7f68040c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68040b0ae0 0x7f680414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804155510 con 0x7f6804159c70 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680415b7f0 con 0x7f68040b0ae0 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680c0f2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680415bad0 con 0x7f680406db20 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55770/0 (socket says 172.21.15.93:55770) 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 -- 172.21.15.93:0/2456498161 learned_addr learned my addr 172.21.15.93:0/2456498161 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:44.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f6809e8e640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680406db20 0x7f68040c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 -- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680406db20 msgr2=0x7f68040c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680968d640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68040b0ae0 0x7f680414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680406db20 0x7f68040c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 -- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68040b0ae0 msgr2=0x7f680414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68040b0ae0 0x7f680414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 -- 172.21.15.93:0/2456498161 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680000b770 con 0x7f6804159c70 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.781+0000 7f680a68f640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00cd70 tx=0x7f67fc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc003b90 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc003cf0 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680415bdb0 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc004240 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040c4f60 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.782+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680406df90 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.783+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67fc0043a0 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.783+0000 7f67fa7fc640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 0x7f67e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.783+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67fc012070 con 0x7f6804159c70 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.783+0000 7f6809e8e640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 0x7f67e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.784+0000 7f6809e8e640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 0x7f67e806d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6800038000 tx=0x7f6800032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.788+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f680406df90 con 0x7f6804159c70 2023-11-04T01:37:44.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.949+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68040cde50 con 0x7f67e806ae70 2023-11-04T01:37:44.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.958+0000 7f67fa7fc640 1 -- 172.21.15.93:0/2456498161 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355697 (secure 0 0 0) 0x7f6800034340 con 0x7f67e806ae70 2023-11-04T01:37:44.963 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:44.965 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 msgr2=0x7f67e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 0x7f67e806d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6800038000 tx=0x7f6800032000 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 msgr2=0x7f68041526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00cd70 tx=0x7f67fc00a660 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 shutdown_connections 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67e806ae70 0x7f67e806d330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6804159c70 0x7f68041526e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68040b0ae0 0x7f680414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 --2- 172.21.15.93:0/2456498161 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f680406db20 0x7f68040c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 >> 172.21.15.93:0/2456498161 conn(0x7f68040ce950 msgr2=0x7f6804070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 shutdown_connections 2023-11-04T01:37:44.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:44.961+0000 7f680c0f2640 1 -- 172.21.15.93:0/2456498161 wait complete. 2023-11-04T01:37:44.973 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:37:43.349604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221964,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752756,"statfs":{"total":773094113280,"available":772866822144,"internally_reserved":0,"allocated":5894144,"data_stored":3280186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000622"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497499+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:37:37.497499+0000","last_peered":"2023-11-04T01:37:37.497499+0000","last_clean":"2023-11-04T01:37:37.497499+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:37:37.497499+0000","last_undegraded":"2023-11-04T01:37:37.497499+0000","last_fullsized":"2023-11-04T01:37:37.497499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059379+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:37:38.059379+0000","last_peered":"2023-11-04T01:37:38.059379+0000","last_clean":"2023-11-04T01:37:38.059379+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:37:38.059379+0000","last_undegraded":"2023-11-04T01:37:38.059379+0000","last_fullsized":"2023-11-04T01:37:38.059379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531081+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:37:37.531081+0000","last_peered":"2023-11-04T01:37:37.531081+0000","last_clean":"2023-11-04T01:37:37.531081+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:37:37.531081+0000","last_undegraded":"2023-11-04T01:37:37.531081+0000","last_fullsized":"2023-11-04T01:37:37.531081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497423+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:37:37.497423+0000","last_peered":"2023-11-04T01:37:37.497423+0000","last_clean":"2023-11-04T01:37:37.497423+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:37:37.497423+0000","last_undegraded":"2023-11-04T01:37:37.497423+0000","last_fullsized":"2023-11-04T01:37:37.497423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.530996+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:37:37.530996+0000","last_peered":"2023-11-04T01:37:37.530996+0000","last_clean":"2023-11-04T01:37:37.530996+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:37:37.530996+0000","last_undegraded":"2023-11-04T01:37:37.530996+0000","last_fullsized":"2023-11-04T01:37:37.530996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694013+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:37:36.694013+0000","last_peered":"2023-11-04T01:37:36.694013+0000","last_clean":"2023-11-04T01:37:36.694013+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:37:36.694013+0000","last_undegraded":"2023-11-04T01:37:36.694013+0000","last_fullsized":"2023-11-04T01:37:36.694013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.693964+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:37:36.693964+0000","last_peered":"2023-11-04T01:37:36.693964+0000","last_clean":"2023-11-04T01:37:36.693964+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:37:36.693964+0000","last_undegraded":"2023-11-04T01:37:36.693964+0000","last_fullsized":"2023-11-04T01:37:36.693964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692023+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:37:36.692023+0000","last_peered":"2023-11-04T01:37:36.692023+0000","last_clean":"2023-11-04T01:37:36.692023+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:37:36.692023+0000","last_undegraded":"2023-11-04T01:37:36.692023+0000","last_fullsized":"2023-11-04T01:37:36.692023+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059497+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:37:38.059497+0000","last_peered":"2023-11-04T01:37:38.059497+0000","last_clean":"2023-11-04T01:37:38.059497+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:37:38.059497+0000","last_undegraded":"2023-11-04T01:37:38.059497+0000","last_fullsized":"2023-11-04T01:37:38.059497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685685+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:37:37.685685+0000","last_peered":"2023-11-04T01:37:37.685685+0000","last_clean":"2023-11-04T01:37:37.685685+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:37:37.685685+0000","last_undegraded":"2023-11-04T01:37:37.685685+0000","last_fullsized":"2023-11-04T01:37:37.685685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059540+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:37:38.059540+0000","last_peered":"2023-11-04T01:37:38.059540+0000","last_clean":"2023-11-04T01:37:38.059540+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:37:38.059540+0000","last_undegraded":"2023-11-04T01:37:38.059540+0000","last_fullsized":"2023-11-04T01:37:38.059540+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692057+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:37:36.692057+0000","last_peered":"2023-11-04T01:37:36.692057+0000","last_clean":"2023-11-04T01:37:36.692057+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:37:36.692057+0000","last_undegraded":"2023-11-04T01:37:36.692057+0000","last_fullsized":"2023-11-04T01:37:36.692057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059537+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:37:38.059537+0000","last_peered":"2023-11-04T01:37:38.059537+0000","last_clean":"2023-11-04T01:37:38.059537+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:37:38.059537+0000","last_undegraded":"2023-11-04T01:37:38.059537+0000","last_fullsized":"2023-11-04T01:37:38.059537+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685550+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:37:37.685550+0000","last_peered":"2023-11-04T01:37:37.685550+0000","last_clean":"2023-11-04T01:37:37.685550+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:37:37.685550+0000","last_undegraded":"2023-11-04T01:37:37.685550+0000","last_fullsized":"2023-11-04T01:37:37.685550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694326+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:37:36.694326+0000","last_peered":"2023-11-04T01:37:36.694326+0000","last_clean":"2023-11-04T01:37:36.694326+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:37:36.694326+0000","last_undegraded":"2023-11-04T01:37:36.694326+0000","last_fullsized":"2023-11-04T01:37:36.694326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531054+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:37:37.531054+0000","last_peered":"2023-11-04T01:37:37.531054+0000","last_clean":"2023-11-04T01:37:37.531054+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:37:37.531054+0000","last_undegraded":"2023-11-04T01:37:37.531054+0000","last_fullsized":"2023-11-04T01:37:37.531054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531066+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:37:37.531066+0000","last_peered":"2023-11-04T01:37:37.531066+0000","last_clean":"2023-11-04T01:37:37.531066+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:37:37.531066+0000","last_undegraded":"2023-11-04T01:37:37.531066+0000","last_fullsized":"2023-11-04T01:37:37.531066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531045+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:37:37.531045+0000","last_peered":"2023-11-04T01:37:37.531045+0000","last_clean":"2023-11-04T01:37:37.531045+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:37:37.531045+0000","last_undegraded":"2023-11-04T01:37:37.531045+0000","last_fullsized":"2023-11-04T01:37:37.531045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694294+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:37:36.694294+0000","last_peered":"2023-11-04T01:37:36.694294+0000","last_clean":"2023-11-04T01:37:36.694294+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:37:36.694294+0000","last_undegraded":"2023-11-04T01:37:36.694294+0000","last_fullsized":"2023-11-04T01:37:36.694294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692047+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:37:36.692047+0000","last_peered":"2023-11-04T01:37:36.692047+0000","last_clean":"2023-11-04T01:37:36.692047+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:37:36.692047+0000","last_undegraded":"2023-11-04T01:37:36.692047+0000","last_fullsized":"2023-11-04T01:37:36.692047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.693976+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:37:36.693976+0000","last_peered":"2023-11-04T01:37:36.693976+0000","last_clean":"2023-11-04T01:37:36.693976+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:37:36.693976+0000","last_undegraded":"2023-11-04T01:37:36.693976+0000","last_fullsized":"2023-11-04T01:37:36.693976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.691959+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:37:36.691959+0000","last_peered":"2023-11-04T01:37:36.691959+0000","last_clean":"2023-11-04T01:37:36.691959+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:37:36.691959+0000","last_undegraded":"2023-11-04T01:37:36.691959+0000","last_fullsized":"2023-11-04T01:37:36.691959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497406+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:37:37.497406+0000","last_peered":"2023-11-04T01:37:37.497406+0000","last_clean":"2023-11-04T01:37:37.497406+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:37:37.497406+0000","last_undegraded":"2023-11-04T01:37:37.497406+0000","last_fullsized":"2023-11-04T01:37:37.497406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685559+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:37:37.685559+0000","last_peered":"2023-11-04T01:37:37.685559+0000","last_clean":"2023-11-04T01:37:37.685559+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:37:37.685559+0000","last_undegraded":"2023-11-04T01:37:37.685559+0000","last_fullsized":"2023-11-04T01:37:37.685559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059575+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:37:38.059575+0000","last_peered":"2023-11-04T01:37:38.059575+0000","last_clean":"2023-11-04T01:37:38.059575+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:37:38.059575+0000","last_undegraded":"2023-11-04T01:37:38.059575+0000","last_fullsized":"2023-11-04T01:37:38.059575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694051+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:37:36.694051+0000","last_peered":"2023-11-04T01:37:36.694051+0000","last_clean":"2023-11-04T01:37:36.694051+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:37:36.694051+0000","last_undegraded":"2023-11-04T01:37:36.694051+0000","last_fullsized":"2023-11-04T01:37:36.694051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531087+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:37:37.531087+0000","last_peered":"2023-11-04T01:37:37.531087+0000","last_clean":"2023-11-04T01:37:37.531087+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:37:37.531087+0000","last_undegraded":"2023-11-04T01:37:37.531087+0000","last_fullsized":"2023-11-04T01:37:37.531087+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692069+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:37:36.692069+0000","last_peered":"2023-11-04T01:37:36.692069+0000","last_clean":"2023-11-04T01:37:36.692069+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:37:36.692069+0000","last_undegraded":"2023-11-04T01:37:36.692069+0000","last_fullsized":"2023-11-04T01:37:36.692069+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059347+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:37:38.059347+0000","last_peered":"2023-11-04T01:37:38.059347+0000","last_clean":"2023-11-04T01:37:38.059347+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:37:38.059347+0000","last_undegraded":"2023-11-04T01:37:38.059347+0000","last_fullsized":"2023-11-04T01:37:38.059347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685593+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:37:37.685593+0000","last_peered":"2023-11-04T01:37:37.685593+0000","last_clean":"2023-11-04T01:37:37.685593+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:37:37.685593+0000","last_undegraded":"2023-11-04T01:37:37.685593+0000","last_fullsized":"2023-11-04T01:37:37.685593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685561+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:37:37.685561+0000","last_peered":"2023-11-04T01:37:37.685561+0000","last_clean":"2023-11-04T01:37:37.685561+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:37:37.685561+0000","last_undegraded":"2023-11-04T01:37:37.685561+0000","last_fullsized":"2023-11-04T01:37:37.685561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694196+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:37:36.694196+0000","last_peered":"2023-11-04T01:37:36.694196+0000","last_clean":"2023-11-04T01:37:36.694196+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:37:36.694196+0000","last_undegraded":"2023-11-04T01:37:36.694196+0000","last_fullsized":"2023-11-04T01:37:36.694196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059489+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:38.059489+0000","last_peered":"2023-11-04T01:37:38.059489+0000","last_clean":"2023-11-04T01:37:38.059489+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:38.059489+0000","last_undegraded":"2023-11-04T01:37:38.059489+0000","last_fullsized":"2023-11-04T01:37:38.059489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1175552,"data_stored":849429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.626},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":258042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.495},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.624}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.75}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.79000000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.623}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.442}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.376},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28000000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.253},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":259061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.432}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.626}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1183744,"data_stored":854210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.37}]},{"osd":2,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.629},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:44.982 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:45.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.112+0000 7f5a59864640 1 Processor -- start 2023-11-04T01:37:45.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.112+0000 7f5a59864640 1 -- start start 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a59864640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a5415e1c0 0x7f5a5406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a59864640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b3da0 0x7f5a5406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a59864640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a540b1b80 con 0x7f5a540b14a0 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a59864640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540b1e60 con 0x7f5a5415e1c0 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a59864640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540b2140 con 0x7f5a540b3da0 2023-11-04T01:37:45.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a52ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a5415e1c0 0x7f5a5406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a52ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a5415e1c0 0x7f5a5406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55776/0 (socket says 172.21.15.93:55776) 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.113+0000 7f5a52ffd640 1 -- 172.21.15.93:0/1403690760 learned_addr learned my addr 172.21.15.93:0/1403690760 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a537fe640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b3da0 0x7f5a5406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a52ffd640 1 -- 172.21.15.93:0/1403690760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b3da0 msgr2=0x7f5a5406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a52ffd640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b3da0 0x7f5a5406a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a52ffd640 1 -- 172.21.15.93:0/1403690760 >> v1:172.21.15.125:6789/0 conn(0x7f5a540b14a0 legacy=0x7f5a540cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a52ffd640 1 -- 172.21.15.93:0/1403690760 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a540ca990 con 0x7f5a5415e1c0 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.114+0000 7f5a52ffd640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a5406a120 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e50 tx=0x7f5a4402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aef56d8a2a1378b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a51ffb640 1 -- 172.21.15.93:0/1403690760 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4402cb00 con 0x7f5a5415e1c0 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a51ffb640 1 -- 172.21.15.93:0/1403690760 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4402cc60 con 0x7f5a5415e1c0 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a51ffb640 1 -- 172.21.15.93:0/1403690760 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440343f0 con 0x7f5a5415e1c0 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 -- 172.21.15.93:0/1403690760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 msgr2=0x7f5a5406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a5406a120 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009e50 tx=0x7f5a4402bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 -- 172.21.15.93:0/1403690760 shutdown_connections 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b3da0 0x7f5a5406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 --2- 172.21.15.93:0/1403690760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a5406a120 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 -- 172.21.15.93:0/1403690760 >> 172.21.15.93:0/1403690760 conn(0x7f5a5406d8b0 msgr2=0x7f5a5406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 -- 172.21.15.93:0/1403690760 shutdown_connections 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.115+0000 7f5a59864640 1 -- 172.21.15.93:0/1403690760 wait complete. 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.116+0000 7f5a59864640 1 Processor -- start 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 -- start start 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b14a0 0x7f5a5414f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540b3da0 0x7f5a540c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540c8e60 con 0x7f5a5415e1c0 2023-11-04T01:37:45.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540c3550 con 0x7f5a540b3da0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a59864640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a540c3830 con 0x7f5a540b14a0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55790/0 (socket says 172.21.15.93:55790) 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a537fe640 1 -- 172.21.15.93:0/416535482 learned_addr learned my addr 172.21.15.93:0/416535482 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a52ffd640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b14a0 0x7f5a5414f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.117+0000 7f5a527fc640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540b3da0 0x7f5a540c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 -- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b14a0 msgr2=0x7f5a5414f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b14a0 0x7f5a5414f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 -- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540b3da0 msgr2=0x7f5a540c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540b3da0 0x7f5a540c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 -- 172.21.15.93:0/416535482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44009b30 con 0x7f5a5415e1c0 2023-11-04T01:37:45.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a537fe640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00d5d0 tx=0x7f5a4c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0125f0 con 0x7f5a5415e1c0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c012750 con 0x7f5a5415e1c0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a540c3b10 con 0x7f5a5415e1c0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c012b00 con 0x7f5a5415e1c0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.118+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a540c8aa0 con 0x7f5a5415e1c0 2023-11-04T01:37:45.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.119+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a540c4030 con 0x7f5a5415e1c0 2023-11-04T01:37:45.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.119+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a4c012c60 con 0x7f5a5415e1c0 2023-11-04T01:37:45.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.120+0000 7f5a3bfff640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 0x7f5a4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.120+0000 7f5a52ffd640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 0x7f5a4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.120+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5a4c089ca0 con 0x7f5a5415e1c0 2023-11-04T01:37:45.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.120+0000 7f5a52ffd640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 0x7f5a4006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a44035000 tx=0x7f5a44030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.124+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a540c4030 con 0x7f5a5415e1c0 2023-11-04T01:37:45.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.287+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a540c36c0 con 0x7f5a4006ae70 2023-11-04T01:37:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.295+0000 7f5a3bfff640 1 -- 172.21.15.93:0/416535482 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355697 (secure 0 0 0) 0x7f5a540c36c0 con 0x7f5a4006ae70 2023-11-04T01:37:45.300 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:45.302 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.298+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 msgr2=0x7f5a4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.298+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 0x7f5a4006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a44035000 tx=0x7f5a44030000 comp rx=0 tx=0).stop 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.298+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 msgr2=0x7f5a540b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.298+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00d5d0 tx=0x7f5a4c00da90 comp rx=0 tx=0).stop 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 shutdown_connections 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a4006ae70 0x7f5a4006d330 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a5415e1c0 0x7f5a540b0690 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540b3da0 0x7f5a540c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 --2- 172.21.15.93:0/416535482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a540b14a0 0x7f5a5414f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 >> 172.21.15.93:0/416535482 conn(0x7f5a5406d8b0 msgr2=0x7f5a540b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 shutdown_connections 2023-11-04T01:37:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.299+0000 7f5a59864640 1 -- 172.21.15.93:0/416535482 wait complete. 2023-11-04T01:37:45.311 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:37:43.349604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221964,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752756,"statfs":{"total":773094113280,"available":772866822144,"internally_reserved":0,"allocated":5894144,"data_stored":3280186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000622"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497499+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:37:37.497499+0000","last_peered":"2023-11-04T01:37:37.497499+0000","last_clean":"2023-11-04T01:37:37.497499+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:37:37.497499+0000","last_undegraded":"2023-11-04T01:37:37.497499+0000","last_fullsized":"2023-11-04T01:37:37.497499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059379+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:37:38.059379+0000","last_peered":"2023-11-04T01:37:38.059379+0000","last_clean":"2023-11-04T01:37:38.059379+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:37:38.059379+0000","last_undegraded":"2023-11-04T01:37:38.059379+0000","last_fullsized":"2023-11-04T01:37:38.059379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531081+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:37:37.531081+0000","last_peered":"2023-11-04T01:37:37.531081+0000","last_clean":"2023-11-04T01:37:37.531081+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:37:37.531081+0000","last_undegraded":"2023-11-04T01:37:37.531081+0000","last_fullsized":"2023-11-04T01:37:37.531081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497423+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:37:37.497423+0000","last_peered":"2023-11-04T01:37:37.497423+0000","last_clean":"2023-11-04T01:37:37.497423+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:37:37.497423+0000","last_undegraded":"2023-11-04T01:37:37.497423+0000","last_fullsized":"2023-11-04T01:37:37.497423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.530996+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:37:37.530996+0000","last_peered":"2023-11-04T01:37:37.530996+0000","last_clean":"2023-11-04T01:37:37.530996+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:37:37.530996+0000","last_undegraded":"2023-11-04T01:37:37.530996+0000","last_fullsized":"2023-11-04T01:37:37.530996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694013+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:37:36.694013+0000","last_peered":"2023-11-04T01:37:36.694013+0000","last_clean":"2023-11-04T01:37:36.694013+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:37:36.694013+0000","last_undegraded":"2023-11-04T01:37:36.694013+0000","last_fullsized":"2023-11-04T01:37:36.694013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.693964+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:37:36.693964+0000","last_peered":"2023-11-04T01:37:36.693964+0000","last_clean":"2023-11-04T01:37:36.693964+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:37:36.693964+0000","last_undegraded":"2023-11-04T01:37:36.693964+0000","last_fullsized":"2023-11-04T01:37:36.693964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692023+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:37:36.692023+0000","last_peered":"2023-11-04T01:37:36.692023+0000","last_clean":"2023-11-04T01:37:36.692023+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:37:36.692023+0000","last_undegraded":"2023-11-04T01:37:36.692023+0000","last_fullsized":"2023-11-04T01:37:36.692023+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059497+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:37:38.059497+0000","last_peered":"2023-11-04T01:37:38.059497+0000","last_clean":"2023-11-04T01:37:38.059497+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:37:38.059497+0000","last_undegraded":"2023-11-04T01:37:38.059497+0000","last_fullsized":"2023-11-04T01:37:38.059497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685685+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:37:37.685685+0000","last_peered":"2023-11-04T01:37:37.685685+0000","last_clean":"2023-11-04T01:37:37.685685+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:37:37.685685+0000","last_undegraded":"2023-11-04T01:37:37.685685+0000","last_fullsized":"2023-11-04T01:37:37.685685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059540+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:37:38.059540+0000","last_peered":"2023-11-04T01:37:38.059540+0000","last_clean":"2023-11-04T01:37:38.059540+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:37:38.059540+0000","last_undegraded":"2023-11-04T01:37:38.059540+0000","last_fullsized":"2023-11-04T01:37:38.059540+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692057+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:37:36.692057+0000","last_peered":"2023-11-04T01:37:36.692057+0000","last_clean":"2023-11-04T01:37:36.692057+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:37:36.692057+0000","last_undegraded":"2023-11-04T01:37:36.692057+0000","last_fullsized":"2023-11-04T01:37:36.692057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059537+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:37:38.059537+0000","last_peered":"2023-11-04T01:37:38.059537+0000","last_clean":"2023-11-04T01:37:38.059537+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:37:38.059537+0000","last_undegraded":"2023-11-04T01:37:38.059537+0000","last_fullsized":"2023-11-04T01:37:38.059537+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685550+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:37:37.685550+0000","last_peered":"2023-11-04T01:37:37.685550+0000","last_clean":"2023-11-04T01:37:37.685550+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:37:37.685550+0000","last_undegraded":"2023-11-04T01:37:37.685550+0000","last_fullsized":"2023-11-04T01:37:37.685550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694326+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:37:36.694326+0000","last_peered":"2023-11-04T01:37:36.694326+0000","last_clean":"2023-11-04T01:37:36.694326+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:37:36.694326+0000","last_undegraded":"2023-11-04T01:37:36.694326+0000","last_fullsized":"2023-11-04T01:37:36.694326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531054+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:37:37.531054+0000","last_peered":"2023-11-04T01:37:37.531054+0000","last_clean":"2023-11-04T01:37:37.531054+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:37:37.531054+0000","last_undegraded":"2023-11-04T01:37:37.531054+0000","last_fullsized":"2023-11-04T01:37:37.531054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531066+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:37:37.531066+0000","last_peered":"2023-11-04T01:37:37.531066+0000","last_clean":"2023-11-04T01:37:37.531066+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:37:37.531066+0000","last_undegraded":"2023-11-04T01:37:37.531066+0000","last_fullsized":"2023-11-04T01:37:37.531066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531045+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:37:37.531045+0000","last_peered":"2023-11-04T01:37:37.531045+0000","last_clean":"2023-11-04T01:37:37.531045+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:37:37.531045+0000","last_undegraded":"2023-11-04T01:37:37.531045+0000","last_fullsized":"2023-11-04T01:37:37.531045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694294+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:37:36.694294+0000","last_peered":"2023-11-04T01:37:36.694294+0000","last_clean":"2023-11-04T01:37:36.694294+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:37:36.694294+0000","last_undegraded":"2023-11-04T01:37:36.694294+0000","last_fullsized":"2023-11-04T01:37:36.694294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692047+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:37:36.692047+0000","last_peered":"2023-11-04T01:37:36.692047+0000","last_clean":"2023-11-04T01:37:36.692047+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:37:36.692047+0000","last_undegraded":"2023-11-04T01:37:36.692047+0000","last_fullsized":"2023-11-04T01:37:36.692047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.693976+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:37:36.693976+0000","last_peered":"2023-11-04T01:37:36.693976+0000","last_clean":"2023-11-04T01:37:36.693976+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:37:36.693976+0000","last_undegraded":"2023-11-04T01:37:36.693976+0000","last_fullsized":"2023-11-04T01:37:36.693976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.691959+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:37:36.691959+0000","last_peered":"2023-11-04T01:37:36.691959+0000","last_clean":"2023-11-04T01:37:36.691959+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:37:36.691959+0000","last_undegraded":"2023-11-04T01:37:36.691959+0000","last_fullsized":"2023-11-04T01:37:36.691959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.497406+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:37:37.497406+0000","last_peered":"2023-11-04T01:37:37.497406+0000","last_clean":"2023-11-04T01:37:37.497406+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:37:37.497406+0000","last_undegraded":"2023-11-04T01:37:37.497406+0000","last_fullsized":"2023-11-04T01:37:37.497406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685559+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:37:37.685559+0000","last_peered":"2023-11-04T01:37:37.685559+0000","last_clean":"2023-11-04T01:37:37.685559+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:37:37.685559+0000","last_undegraded":"2023-11-04T01:37:37.685559+0000","last_fullsized":"2023-11-04T01:37:37.685559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059575+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:37:38.059575+0000","last_peered":"2023-11-04T01:37:38.059575+0000","last_clean":"2023-11-04T01:37:38.059575+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:37:38.059575+0000","last_undegraded":"2023-11-04T01:37:38.059575+0000","last_fullsized":"2023-11-04T01:37:38.059575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694051+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:37:36.694051+0000","last_peered":"2023-11-04T01:37:36.694051+0000","last_clean":"2023-11-04T01:37:36.694051+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:37:36.694051+0000","last_undegraded":"2023-11-04T01:37:36.694051+0000","last_fullsized":"2023-11-04T01:37:36.694051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.531087+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:37:37.531087+0000","last_peered":"2023-11-04T01:37:37.531087+0000","last_clean":"2023-11-04T01:37:37.531087+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:37:37.531087+0000","last_undegraded":"2023-11-04T01:37:37.531087+0000","last_fullsized":"2023-11-04T01:37:37.531087+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.692069+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:37:36.692069+0000","last_peered":"2023-11-04T01:37:36.692069+0000","last_clean":"2023-11-04T01:37:36.692069+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:37:36.692069+0000","last_undegraded":"2023-11-04T01:37:36.692069+0000","last_fullsized":"2023-11-04T01:37:36.692069+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059347+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:37:38.059347+0000","last_peered":"2023-11-04T01:37:38.059347+0000","last_clean":"2023-11-04T01:37:38.059347+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:37:38.059347+0000","last_undegraded":"2023-11-04T01:37:38.059347+0000","last_fullsized":"2023-11-04T01:37:38.059347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685593+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:37:37.685593+0000","last_peered":"2023-11-04T01:37:37.685593+0000","last_clean":"2023-11-04T01:37:37.685593+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:37:37.685593+0000","last_undegraded":"2023-11-04T01:37:37.685593+0000","last_fullsized":"2023-11-04T01:37:37.685593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:37.685561+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:37:37.685561+0000","last_peered":"2023-11-04T01:37:37.685561+0000","last_clean":"2023-11-04T01:37:37.685561+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:37:37.685561+0000","last_undegraded":"2023-11-04T01:37:37.685561+0000","last_fullsized":"2023-11-04T01:37:37.685561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:40.697230+0000","last_change":"2023-11-04T01:37:40.697230+0000","last_active":"2023-11-04T01:37:40.697230+0000","last_peered":"2023-11-04T01:37:40.697230+0000","last_clean":"2023-11-04T01:37:40.697230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:40.697230+0000","last_undegraded":"2023-11-04T01:37:40.697230+0000","last_fullsized":"2023-11-04T01:37:40.697230+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:37:39.692728+0000","last_change":"2023-11-04T01:37:39.692728+0000","last_active":"2023-11-04T01:37:39.692728+0000","last_peered":"2023-11-04T01:37:39.692728+0000","last_clean":"2023-11-04T01:37:39.692728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:37:39.692728+0000","last_undegraded":"2023-11-04T01:37:39.692728+0000","last_fullsized":"2023-11-04T01:37:39.692728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:36.694196+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:37:36.694196+0000","last_peered":"2023-11-04T01:37:36.694196+0000","last_clean":"2023-11-04T01:37:36.694196+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:37:36.694196+0000","last_undegraded":"2023-11-04T01:37:36.694196+0000","last_fullsized":"2023-11-04T01:37:36.694196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:37:38.059489+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:38.059489+0000","last_peered":"2023-11-04T01:37:38.059489+0000","last_clean":"2023-11-04T01:37:38.059489+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:38.059489+0000","last_undegraded":"2023-11-04T01:37:38.059489+0000","last_fullsized":"2023-11-04T01:37:38.059489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1175552,"data_stored":849429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.626},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":258042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.495},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.624}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.75}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.79000000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.623}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.442}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.376},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28000000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.253},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":581632,"data_stored":259061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.432}]},{"osd":7,"last update":"Sat Nov 4 01:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.626}]},{"osd":5,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:36:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1183744,"data_stored":854210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.37}]},{"osd":2,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.629},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:45.317 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:45.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.450+0000 7f3bb4500640 1 Processor -- start 2023-11-04T01:37:45.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.450+0000 7f3bb4500640 1 -- start start 2023-11-04T01:37:45.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb4500640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3bac160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb4500640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac06bf00 con 0x7f3bac15ce60 2023-11-04T01:37:45.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb4500640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac1615d0 con 0x7f3bac0cf160 2023-11-04T01:37:45.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb4500640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0cbde0 con 0x7f3bac160b10 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb229c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3bac15ce60 0x7f3bac06b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44768/0 (socket says 172.21.15.93:44768) 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.451+0000 7f3bb229c640 1 -- 172.21.15.93:0/1429980430 learned_addr learned my addr 172.21.15.93:0/1429980430 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969587007 0 0) 0x7f3bac06bf00 con 0x7f3bac15ce60 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b94003520 con 0x7f3bac15ce60 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb1a9b640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3bac160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807169795 0 0) 0x7f3b94003520 con 0x7f3bac15ce60 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 msgr2=0x7f3bac160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3bac160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 >> v1:172.21.15.125:6789/0 conn(0x7f3bac0cf160 legacy=0x7f3bac0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac1618b0 con 0x7f3bac15ce60 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3b9c0019f0 con 0x7f3bac15ce60 2023-11-04T01:37:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 >> v1:172.21.15.93:6789/0 conn(0x7f3bac15ce60 legacy=0x7f3bac06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b940039a0 0x7f3b94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3b940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b94004d00 0x7f3b94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0cbde0 con 0x7f3b94004d00 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400ba30 con 0x7f3b940039a0 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9400bbf0 con 0x7f3bac160b10 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b94004d00 0x7f3b94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb1a9b640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3b940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb229c640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b940039a0 0x7f3b94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 msgr2=0x7f3b940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3b940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b940039a0 msgr2=0x7f3b94003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b940039a0 0x7f3b94003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/1429980430 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94003520 con 0x7f3b94004d00 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.452+0000 7f3bb1a9b640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac160b10 0x7f3b940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.453+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b94004d00 0x7f3b94005180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4001720 tx=0x7f3b940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7699c436f7dc9ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.453+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40052d0 con 0x7f3b94004d00 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.453+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba402e050 con 0x7f3b94004d00 2023-11-04T01:37:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.453+0000 7f3bb129a640 1 -- 172.21.15.93:0/1429980430 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40035f0 con 0x7f3b94004d00 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 -- 172.21.15.93:0/1429980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b94004d00 msgr2=0x7f3b94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 --2- 172.21.15.93:0/1429980430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3b94004d00 0x7f3b94005180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4001720 tx=0x7f3b940057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/1429980430 reap_dead start 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 -- 172.21.15.93:0/1429980430 shutdown_connections 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 -- 172.21.15.93:0/1429980430 >> 172.21.15.93:0/1429980430 conn(0x7f3bac06ea90 msgr2=0x7f3bac06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 -- 172.21.15.93:0/1429980430 shutdown_connections 2023-11-04T01:37:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.454+0000 7f3bb4500640 1 -- 172.21.15.93:0/1429980430 wait complete. 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.455+0000 7f3bb4500640 1 Processor -- start 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.455+0000 7f3bb4500640 1 -- start start 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b94004d00 0x7f3bac150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 0x7f3bac0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0b6790 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0b40c0 con 0x7f3b94004d00 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac151540 con 0x7f3bac0b3720 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55794/0 (socket says 172.21.15.93:55794) 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/2595582580 learned_addr learned my addr 172.21.15.93:0/2595582580 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb229c640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b94004d00 0x7f3bac150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb1a9b640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 0x7f3bac0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 msgr2=0x7f3bac0b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 0x7f3bac0b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b94004d00 msgr2=0x7f3bac150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b94004d00 0x7f3bac150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 -- 172.21.15.93:0/2595582580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0b42e0 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb1a9b640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 0x7f3bac0b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb2a9d640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4005040 tx=0x7f3ba4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4007a30 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba40067d0 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4006b60 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.456+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac0b45c0 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.457+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac0b4b80 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.457+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac074290 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.458+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ba4006cc0 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.458+0000 7f3baaffd640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 0x7f3b9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.458+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3ba40ab1b0 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.458+0000 7f3bb229c640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 0x7f3b9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.459+0000 7f3bb229c640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 0x7f3b9806d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c004d20 tx=0x7f3b9c006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.462+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ba4075f30 con 0x7f3bac0b5dd0 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.624+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bac0ce970 con 0x7f3b9806ae70 2023-11-04T01:37:45.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.633+0000 7f3baaffd640 1 -- 172.21.15.93:0/2595582580 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370572 (secure 0 0 0) 0x7f3b9c004d50 con 0x7f3b9806ae70 2023-11-04T01:37:45.638 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:45.641 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:45.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 msgr2=0x7f3b9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 0x7f3b9806d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c004d20 tx=0x7f3b9c006040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 msgr2=0x7f3bac0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4005040 tx=0x7f3ba4001120 comp rx=0 tx=0).stop 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 shutdown_connections 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b9806ae70 0x7f3b9806d330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3bac0b5dd0 0x7f3bac0b6250 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3bac0b3720 0x7f3bac0b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 --2- 172.21.15.93:0/2595582580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b94004d00 0x7f3bac150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 >> 172.21.15.93:0/2595582580 conn(0x7f3bac06ea90 msgr2=0x7f3bac072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 shutdown_connections 2023-11-04T01:37:45.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.636+0000 7f3bb4500640 1 -- 172.21.15.93:0/2595582580 wait complete. 2023-11-04T01:37:45.648 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:37:45.349975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222452,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752268,"statfs":{"total":773094113280,"available":772866322432,"internally_reserved":0,"allocated":6389760,"data_stored":3525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.652378"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774653+0000","last_change":"2023-11-04T01:37:41.742330+0000","last_active":"2023-11-04T01:37:42.774653+0000","last_peered":"2023-11-04T01:37:42.774653+0000","last_clean":"2023-11-04T01:37:42.774653+0000","last_became_active":"2023-11-04T01:37:41.742024+0000","last_became_peered":"2023-11-04T01:37:41.742024+0000","last_unstale":"2023-11-04T01:37:42.774653+0000","last_undegraded":"2023-11-04T01:37:42.774653+0000","last_fullsized":"2023-11-04T01:37:42.774653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:54.535366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775738+0000","last_change":"2023-11-04T01:37:41.741184+0000","last_active":"2023-11-04T01:37:42.775738+0000","last_peered":"2023-11-04T01:37:42.775738+0000","last_clean":"2023-11-04T01:37:42.775738+0000","last_became_active":"2023-11-04T01:37:41.740929+0000","last_became_peered":"2023-11-04T01:37:41.740929+0000","last_unstale":"2023-11-04T01:37:42.775738+0000","last_undegraded":"2023-11-04T01:37:42.775738+0000","last_fullsized":"2023-11-04T01:37:42.775738+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:36.888749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725072+0000","last_change":"2023-11-04T01:37:41.731319+0000","last_active":"2023-11-04T01:37:42.725072+0000","last_peered":"2023-11-04T01:37:42.725072+0000","last_clean":"2023-11-04T01:37:42.725072+0000","last_became_active":"2023-11-04T01:37:41.731029+0000","last_became_peered":"2023-11-04T01:37:41.731029+0000","last_unstale":"2023-11-04T01:37:42.725072+0000","last_undegraded":"2023-11-04T01:37:42.725072+0000","last_fullsized":"2023-11-04T01:37:42.725072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724561+0000","last_change":"2023-11-04T01:37:41.741326+0000","last_active":"2023-11-04T01:37:42.724561+0000","last_peered":"2023-11-04T01:37:42.724561+0000","last_clean":"2023-11-04T01:37:42.724561+0000","last_became_active":"2023-11-04T01:37:41.741066+0000","last_became_peered":"2023-11-04T01:37:41.741066+0000","last_unstale":"2023-11-04T01:37:42.724561+0000","last_undegraded":"2023-11-04T01:37:42.724561+0000","last_fullsized":"2023-11-04T01:37:42.724561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774914+0000","last_change":"2023-11-04T01:37:41.736955+0000","last_active":"2023-11-04T01:37:42.774914+0000","last_peered":"2023-11-04T01:37:42.774914+0000","last_clean":"2023-11-04T01:37:42.774914+0000","last_became_active":"2023-11-04T01:37:41.736717+0000","last_became_peered":"2023-11-04T01:37:41.736717+0000","last_unstale":"2023-11-04T01:37:42.774914+0000","last_undegraded":"2023-11-04T01:37:42.774914+0000","last_fullsized":"2023-11-04T01:37:42.774914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:32.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775061+0000","last_change":"2023-11-04T01:37:41.733823+0000","last_active":"2023-11-04T01:37:42.775061+0000","last_peered":"2023-11-04T01:37:42.775061+0000","last_clean":"2023-11-04T01:37:42.775061+0000","last_became_active":"2023-11-04T01:37:41.733540+0000","last_became_peered":"2023-11-04T01:37:41.733540+0000","last_unstale":"2023-11-04T01:37:42.775061+0000","last_undegraded":"2023-11-04T01:37:42.775061+0000","last_fullsized":"2023-11-04T01:37:42.775061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774827+0000","last_change":"2023-11-04T01:37:41.734749+0000","last_active":"2023-11-04T01:37:42.774827+0000","last_peered":"2023-11-04T01:37:42.774827+0000","last_clean":"2023-11-04T01:37:42.774827+0000","last_became_active":"2023-11-04T01:37:41.734486+0000","last_became_peered":"2023-11-04T01:37:41.734486+0000","last_unstale":"2023-11-04T01:37:42.774827+0000","last_undegraded":"2023-11-04T01:37:42.774827+0000","last_fullsized":"2023-11-04T01:37:42.774827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774564+0000","last_change":"2023-11-04T01:37:41.737034+0000","last_active":"2023-11-04T01:37:42.774564+0000","last_peered":"2023-11-04T01:37:42.774564+0000","last_clean":"2023-11-04T01:37:42.774564+0000","last_became_active":"2023-11-04T01:37:41.736007+0000","last_became_peered":"2023-11-04T01:37:41.736007+0000","last_unstale":"2023-11-04T01:37:42.774564+0000","last_undegraded":"2023-11-04T01:37:42.774564+0000","last_fullsized":"2023-11-04T01:37:42.774564+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:13.495100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775132+0000","last_change":"2023-11-04T01:37:41.725939+0000","last_active":"2023-11-04T01:37:42.775132+0000","last_peered":"2023-11-04T01:37:42.775132+0000","last_clean":"2023-11-04T01:37:42.775132+0000","last_became_active":"2023-11-04T01:37:41.725642+0000","last_became_peered":"2023-11-04T01:37:41.725642+0000","last_unstale":"2023-11-04T01:37:42.775132+0000","last_undegraded":"2023-11-04T01:37:42.775132+0000","last_fullsized":"2023-11-04T01:37:42.775132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718431+0000","last_change":"2023-11-04T01:37:41.734129+0000","last_active":"2023-11-04T01:37:42.718431+0000","last_peered":"2023-11-04T01:37:42.718431+0000","last_clean":"2023-11-04T01:37:42.718431+0000","last_became_active":"2023-11-04T01:37:41.733898+0000","last_became_peered":"2023-11-04T01:37:41.733898+0000","last_unstale":"2023-11-04T01:37:42.718431+0000","last_undegraded":"2023-11-04T01:37:42.718431+0000","last_fullsized":"2023-11-04T01:37:42.718431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718546+0000","last_change":"2023-11-04T01:37:41.735286+0000","last_active":"2023-11-04T01:37:42.718546+0000","last_peered":"2023-11-04T01:37:42.718546+0000","last_clean":"2023-11-04T01:37:42.718546+0000","last_became_active":"2023-11-04T01:37:41.735026+0000","last_became_peered":"2023-11-04T01:37:41.735026+0000","last_unstale":"2023-11-04T01:37:42.718546+0000","last_undegraded":"2023-11-04T01:37:42.718546+0000","last_fullsized":"2023-11-04T01:37:42.718546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724285+0000","last_change":"2023-11-04T01:37:41.739990+0000","last_active":"2023-11-04T01:37:42.724285+0000","last_peered":"2023-11-04T01:37:42.724285+0000","last_clean":"2023-11-04T01:37:42.724285+0000","last_became_active":"2023-11-04T01:37:41.739736+0000","last_became_peered":"2023-11-04T01:37:41.739736+0000","last_unstale":"2023-11-04T01:37:42.724285+0000","last_undegraded":"2023-11-04T01:37:42.724285+0000","last_fullsized":"2023-11-04T01:37:42.724285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775489+0000","last_change":"2023-11-04T01:37:41.744264+0000","last_active":"2023-11-04T01:37:42.775489+0000","last_peered":"2023-11-04T01:37:42.775489+0000","last_clean":"2023-11-04T01:37:42.775489+0000","last_became_active":"2023-11-04T01:37:41.743951+0000","last_became_peered":"2023-11-04T01:37:41.743951+0000","last_unstale":"2023-11-04T01:37:42.775489+0000","last_undegraded":"2023-11-04T01:37:42.775489+0000","last_fullsized":"2023-11-04T01:37:42.775489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:44.059690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775130+0000","last_change":"2023-11-04T01:37:41.737149+0000","last_active":"2023-11-04T01:37:42.775130+0000","last_peered":"2023-11-04T01:37:42.775130+0000","last_clean":"2023-11-04T01:37:42.775130+0000","last_became_active":"2023-11-04T01:37:41.736867+0000","last_became_peered":"2023-11-04T01:37:41.736867+0000","last_unstale":"2023-11-04T01:37:42.775130+0000","last_undegraded":"2023-11-04T01:37:42.775130+0000","last_fullsized":"2023-11-04T01:37:42.775130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774890+0000","last_change":"2023-11-04T01:37:41.730504+0000","last_active":"2023-11-04T01:37:42.774890+0000","last_peered":"2023-11-04T01:37:42.774890+0000","last_clean":"2023-11-04T01:37:42.774890+0000","last_became_active":"2023-11-04T01:37:41.730246+0000","last_became_peered":"2023-11-04T01:37:41.730246+0000","last_unstale":"2023-11-04T01:37:42.774890+0000","last_undegraded":"2023-11-04T01:37:42.774890+0000","last_fullsized":"2023-11-04T01:37:42.774890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774846+0000","last_change":"2023-11-04T01:37:41.734311+0000","last_active":"2023-11-04T01:37:42.774846+0000","last_peered":"2023-11-04T01:37:42.774846+0000","last_clean":"2023-11-04T01:37:42.774846+0000","last_became_active":"2023-11-04T01:37:41.734033+0000","last_became_peered":"2023-11-04T01:37:41.734033+0000","last_unstale":"2023-11-04T01:37:42.774846+0000","last_undegraded":"2023-11-04T01:37:42.774846+0000","last_fullsized":"2023-11-04T01:37:42.774846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775812+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.775812+0000","last_peered":"2023-11-04T01:37:42.775812+0000","last_clean":"2023-11-04T01:37:42.775812+0000","last_became_active":"2023-11-04T01:37:41.740374+0000","last_became_peered":"2023-11-04T01:37:41.740374+0000","last_unstale":"2023-11-04T01:37:42.775812+0000","last_undegraded":"2023-11-04T01:37:42.775812+0000","last_fullsized":"2023-11-04T01:37:42.775812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:50.653572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725334+0000","last_change":"2023-11-04T01:37:41.736475+0000","last_active":"2023-11-04T01:37:42.725334+0000","last_peered":"2023-11-04T01:37:42.725334+0000","last_clean":"2023-11-04T01:37:42.725334+0000","last_became_active":"2023-11-04T01:37:41.736160+0000","last_became_peered":"2023-11-04T01:37:41.736160+0000","last_unstale":"2023-11-04T01:37:42.725334+0000","last_undegraded":"2023-11-04T01:37:42.725334+0000","last_fullsized":"2023-11-04T01:37:42.725334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774692+0000","last_change":"2023-11-04T01:37:41.743289+0000","last_active":"2023-11-04T01:37:42.774692+0000","last_peered":"2023-11-04T01:37:42.774692+0000","last_clean":"2023-11-04T01:37:42.774692+0000","last_became_active":"2023-11-04T01:37:41.743037+0000","last_became_peered":"2023-11-04T01:37:41.743037+0000","last_unstale":"2023-11-04T01:37:42.774692+0000","last_undegraded":"2023-11-04T01:37:42.774692+0000","last_fullsized":"2023-11-04T01:37:42.774692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:22.226162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775874+0000","last_change":"2023-11-04T01:37:41.745593+0000","last_active":"2023-11-04T01:37:42.775874+0000","last_peered":"2023-11-04T01:37:42.775874+0000","last_clean":"2023-11-04T01:37:42.775874+0000","last_became_active":"2023-11-04T01:37:41.745287+0000","last_became_peered":"2023-11-04T01:37:41.745287+0000","last_unstale":"2023-11-04T01:37:42.775874+0000","last_undegraded":"2023-11-04T01:37:42.775874+0000","last_fullsized":"2023-11-04T01:37:42.775874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:44.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724097+0000","last_change":"2023-11-04T01:37:41.736933+0000","last_active":"2023-11-04T01:37:42.724097+0000","last_peered":"2023-11-04T01:37:42.724097+0000","last_clean":"2023-11-04T01:37:42.724097+0000","last_became_active":"2023-11-04T01:37:41.736665+0000","last_became_peered":"2023-11-04T01:37:41.736665+0000","last_unstale":"2023-11-04T01:37:42.724097+0000","last_undegraded":"2023-11-04T01:37:42.724097+0000","last_fullsized":"2023-11-04T01:37:42.724097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:16.408827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774452+0000","last_change":"2023-11-04T01:37:41.740885+0000","last_active":"2023-11-04T01:37:42.774452+0000","last_peered":"2023-11-04T01:37:42.774452+0000","last_clean":"2023-11-04T01:37:42.774452+0000","last_became_active":"2023-11-04T01:37:41.740616+0000","last_became_peered":"2023-11-04T01:37:41.740616+0000","last_unstale":"2023-11-04T01:37:42.774452+0000","last_undegraded":"2023-11-04T01:37:42.774452+0000","last_fullsized":"2023-11-04T01:37:42.774452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:27.908510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724454+0000","last_change":"2023-11-04T01:37:41.738833+0000","last_active":"2023-11-04T01:37:42.724454+0000","last_peered":"2023-11-04T01:37:42.724454+0000","last_clean":"2023-11-04T01:37:42.724454+0000","last_became_active":"2023-11-04T01:37:41.738228+0000","last_became_peered":"2023-11-04T01:37:41.738228+0000","last_unstale":"2023-11-04T01:37:42.724454+0000","last_undegraded":"2023-11-04T01:37:42.724454+0000","last_fullsized":"2023-11-04T01:37:42.724454+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774617+0000","last_change":"2023-11-04T01:37:41.739216+0000","last_active":"2023-11-04T01:37:42.774617+0000","last_peered":"2023-11-04T01:37:42.774617+0000","last_clean":"2023-11-04T01:37:42.774617+0000","last_became_active":"2023-11-04T01:37:41.738936+0000","last_became_peered":"2023-11-04T01:37:41.738936+0000","last_unstale":"2023-11-04T01:37:42.774617+0000","last_undegraded":"2023-11-04T01:37:42.774617+0000","last_fullsized":"2023-11-04T01:37:42.774617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:47.340021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774762+0000","last_change":"2023-11-04T01:37:41.737112+0000","last_active":"2023-11-04T01:37:42.774762+0000","last_peered":"2023-11-04T01:37:42.774762+0000","last_clean":"2023-11-04T01:37:42.774762+0000","last_became_active":"2023-11-04T01:37:41.736367+0000","last_became_peered":"2023-11-04T01:37:41.736367+0000","last_unstale":"2023-11-04T01:37:42.774762+0000","last_undegraded":"2023-11-04T01:37:42.774762+0000","last_fullsized":"2023-11-04T01:37:42.774762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:44.241121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725006+0000","last_change":"2023-11-04T01:37:41.734429+0000","last_active":"2023-11-04T01:37:42.725006+0000","last_peered":"2023-11-04T01:37:42.725006+0000","last_clean":"2023-11-04T01:37:42.725006+0000","last_became_active":"2023-11-04T01:37:41.734119+0000","last_became_peered":"2023-11-04T01:37:41.734119+0000","last_unstale":"2023-11-04T01:37:42.725006+0000","last_undegraded":"2023-11-04T01:37:42.725006+0000","last_fullsized":"2023-11-04T01:37:42.725006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775451+0000","last_change":"2023-11-04T01:37:41.733926+0000","last_active":"2023-11-04T01:37:42.775451+0000","last_peered":"2023-11-04T01:37:42.775451+0000","last_clean":"2023-11-04T01:37:42.775451+0000","last_became_active":"2023-11-04T01:37:41.733669+0000","last_became_peered":"2023-11-04T01:37:41.733669+0000","last_unstale":"2023-11-04T01:37:42.775451+0000","last_undegraded":"2023-11-04T01:37:42.775451+0000","last_fullsized":"2023-11-04T01:37:42.775451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775024+0000","last_change":"2023-11-04T01:37:41.731513+0000","last_active":"2023-11-04T01:37:42.775024+0000","last_peered":"2023-11-04T01:37:42.775024+0000","last_clean":"2023-11-04T01:37:42.775024+0000","last_became_active":"2023-11-04T01:37:41.731250+0000","last_became_peered":"2023-11-04T01:37:41.731250+0000","last_unstale":"2023-11-04T01:37:42.775024+0000","last_undegraded":"2023-11-04T01:37:42.775024+0000","last_fullsized":"2023-11-04T01:37:42.775024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:07.463931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775834+0000","last_change":"2023-11-04T01:37:41.738065+0000","last_active":"2023-11-04T01:37:42.775834+0000","last_peered":"2023-11-04T01:37:42.775834+0000","last_clean":"2023-11-04T01:37:42.775834+0000","last_became_active":"2023-11-04T01:37:41.737822+0000","last_became_peered":"2023-11-04T01:37:41.737822+0000","last_unstale":"2023-11-04T01:37:42.775834+0000","last_undegraded":"2023-11-04T01:37:42.775834+0000","last_fullsized":"2023-11-04T01:37:42.775834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:51.662220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724161+0000","last_change":"2023-11-04T01:37:41.731426+0000","last_active":"2023-11-04T01:37:42.724161+0000","last_peered":"2023-11-04T01:37:42.724161+0000","last_clean":"2023-11-04T01:37:42.724161+0000","last_became_active":"2023-11-04T01:37:41.731069+0000","last_became_peered":"2023-11-04T01:37:41.731069+0000","last_unstale":"2023-11-04T01:37:42.724161+0000","last_undegraded":"2023-11-04T01:37:42.724161+0000","last_fullsized":"2023-11-04T01:37:42.724161+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:41.036435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774559+0000","last_change":"2023-11-04T01:37:41.735428+0000","last_active":"2023-11-04T01:37:42.774559+0000","last_peered":"2023-11-04T01:37:42.774559+0000","last_clean":"2023-11-04T01:37:42.774559+0000","last_became_active":"2023-11-04T01:37:41.735191+0000","last_became_peered":"2023-11-04T01:37:41.735191+0000","last_unstale":"2023-11-04T01:37:42.774559+0000","last_undegraded":"2023-11-04T01:37:42.774559+0000","last_fullsized":"2023-11-04T01:37:42.774559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:05:09.029109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774727+0000","last_change":"2023-11-04T01:37:41.733806+0000","last_active":"2023-11-04T01:37:42.774727+0000","last_peered":"2023-11-04T01:37:42.774727+0000","last_clean":"2023-11-04T01:37:42.774727+0000","last_became_active":"2023-11-04T01:37:41.733493+0000","last_became_peered":"2023-11-04T01:37:41.733493+0000","last_unstale":"2023-11-04T01:37:42.774727+0000","last_undegraded":"2023-11-04T01:37:42.774727+0000","last_fullsized":"2023-11-04T01:37:42.774727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724230+0000","last_change":"2023-11-04T01:37:41.733345+0000","last_active":"2023-11-04T01:37:42.724230+0000","last_peered":"2023-11-04T01:37:42.724230+0000","last_clean":"2023-11-04T01:37:42.724230+0000","last_became_active":"2023-11-04T01:37:41.732815+0000","last_became_peered":"2023-11-04T01:37:41.732815+0000","last_unstale":"2023-11-04T01:37:42.724230+0000","last_undegraded":"2023-11-04T01:37:42.724230+0000","last_fullsized":"2023-11-04T01:37:42.724230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:59.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774805+0000","last_change":"2023-11-04T01:37:40.716577+0000","last_active":"2023-11-04T01:37:42.774805+0000","last_peered":"2023-11-04T01:37:42.774805+0000","last_clean":"2023-11-04T01:37:42.774805+0000","last_became_active":"2023-11-04T01:37:40.716326+0000","last_became_peered":"2023-11-04T01:37:40.716326+0000","last_unstale":"2023-11-04T01:37:42.774805+0000","last_undegraded":"2023-11-04T01:37:42.774805+0000","last_fullsized":"2023-11-04T01:37:42.774805+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:51.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717410+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:37:41.717410+0000","last_peered":"2023-11-04T01:37:41.717410+0000","last_clean":"2023-11-04T01:37:41.717410+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:37:41.717410+0000","last_undegraded":"2023-11-04T01:37:41.717410+0000","last_fullsized":"2023-11-04T01:37:41.717410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723916+0000","last_change":"2023-11-04T01:37:41.740877+0000","last_active":"2023-11-04T01:37:42.723916+0000","last_peered":"2023-11-04T01:37:42.723916+0000","last_clean":"2023-11-04T01:37:42.723916+0000","last_became_active":"2023-11-04T01:37:41.740615+0000","last_became_peered":"2023-11-04T01:37:41.740615+0000","last_unstale":"2023-11-04T01:37:42.723916+0000","last_undegraded":"2023-11-04T01:37:42.723916+0000","last_fullsized":"2023-11-04T01:37:42.723916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775635+0000","last_change":"2023-11-04T01:37:40.721750+0000","last_active":"2023-11-04T01:37:42.775635+0000","last_peered":"2023-11-04T01:37:42.775635+0000","last_clean":"2023-11-04T01:37:42.775635+0000","last_became_active":"2023-11-04T01:37:40.721397+0000","last_became_peered":"2023-11-04T01:37:40.721397+0000","last_unstale":"2023-11-04T01:37:42.775635+0000","last_undegraded":"2023-11-04T01:37:42.775635+0000","last_fullsized":"2023-11-04T01:37:42.775635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:07.237728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727913+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:37:41.727913+0000","last_peered":"2023-11-04T01:37:41.727913+0000","last_clean":"2023-11-04T01:37:41.727913+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:37:41.727913+0000","last_undegraded":"2023-11-04T01:37:41.727913+0000","last_fullsized":"2023-11-04T01:37:41.727913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724604+0000","last_change":"2023-11-04T01:37:41.737701+0000","last_active":"2023-11-04T01:37:42.724604+0000","last_peered":"2023-11-04T01:37:42.724604+0000","last_clean":"2023-11-04T01:37:42.724604+0000","last_became_active":"2023-11-04T01:37:41.736021+0000","last_became_peered":"2023-11-04T01:37:41.736021+0000","last_unstale":"2023-11-04T01:37:42.724604+0000","last_undegraded":"2023-11-04T01:37:42.724604+0000","last_fullsized":"2023-11-04T01:37:42.724604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723814+0000","last_change":"2023-11-04T01:37:40.718760+0000","last_active":"2023-11-04T01:37:42.723814+0000","last_peered":"2023-11-04T01:37:42.723814+0000","last_clean":"2023-11-04T01:37:42.723814+0000","last_became_active":"2023-11-04T01:37:40.718466+0000","last_became_peered":"2023-11-04T01:37:40.718466+0000","last_unstale":"2023-11-04T01:37:42.723814+0000","last_undegraded":"2023-11-04T01:37:42.723814+0000","last_fullsized":"2023-11-04T01:37:42.723814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728518+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:37:41.728518+0000","last_peered":"2023-11-04T01:37:41.728518+0000","last_clean":"2023-11-04T01:37:41.728518+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:37:41.728518+0000","last_undegraded":"2023-11-04T01:37:41.728518+0000","last_fullsized":"2023-11-04T01:37:41.728518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775362+0000","last_change":"2023-11-04T01:37:41.737582+0000","last_active":"2023-11-04T01:37:42.775362+0000","last_peered":"2023-11-04T01:37:42.775362+0000","last_clean":"2023-11-04T01:37:42.775362+0000","last_became_active":"2023-11-04T01:37:41.737076+0000","last_became_peered":"2023-11-04T01:37:41.737076+0000","last_unstale":"2023-11-04T01:37:42.775362+0000","last_undegraded":"2023-11-04T01:37:42.775362+0000","last_fullsized":"2023-11-04T01:37:42.775362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724776+0000","last_change":"2023-11-04T01:37:40.716846+0000","last_active":"2023-11-04T01:37:42.724776+0000","last_peered":"2023-11-04T01:37:42.724776+0000","last_clean":"2023-11-04T01:37:42.724776+0000","last_became_active":"2023-11-04T01:37:40.716588+0000","last_became_peered":"2023-11-04T01:37:40.716588+0000","last_unstale":"2023-11-04T01:37:42.724776+0000","last_undegraded":"2023-11-04T01:37:42.724776+0000","last_fullsized":"2023-11-04T01:37:42.724776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717017+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:37:41.717017+0000","last_peered":"2023-11-04T01:37:41.717017+0000","last_clean":"2023-11-04T01:37:41.717017+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:37:41.717017+0000","last_undegraded":"2023-11-04T01:37:41.717017+0000","last_fullsized":"2023-11-04T01:37:41.717017+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724829+0000","last_change":"2023-11-04T01:37:41.730410+0000","last_active":"2023-11-04T01:37:42.724829+0000","last_peered":"2023-11-04T01:37:42.724829+0000","last_clean":"2023-11-04T01:37:42.724829+0000","last_became_active":"2023-11-04T01:37:41.729963+0000","last_became_peered":"2023-11-04T01:37:41.729963+0000","last_unstale":"2023-11-04T01:37:42.724829+0000","last_undegraded":"2023-11-04T01:37:42.724829+0000","last_fullsized":"2023-11-04T01:37:42.724829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775817+0000","last_change":"2023-11-04T01:37:40.722525+0000","last_active":"2023-11-04T01:37:42.775817+0000","last_peered":"2023-11-04T01:37:42.775817+0000","last_clean":"2023-11-04T01:37:42.775817+0000","last_became_active":"2023-11-04T01:37:40.722295+0000","last_became_peered":"2023-11-04T01:37:40.722295+0000","last_unstale":"2023-11-04T01:37:42.775817+0000","last_undegraded":"2023-11-04T01:37:42.775817+0000","last_fullsized":"2023-11-04T01:37:42.775817+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:12.752146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728156+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:37:41.728156+0000","last_peered":"2023-11-04T01:37:41.728156+0000","last_clean":"2023-11-04T01:37:41.728156+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:37:41.728156+0000","last_undegraded":"2023-11-04T01:37:41.728156+0000","last_fullsized":"2023-11-04T01:37:41.728156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775290+0000","last_change":"2023-11-04T01:37:41.730844+0000","last_active":"2023-11-04T01:37:42.775290+0000","last_peered":"2023-11-04T01:37:42.775290+0000","last_clean":"2023-11-04T01:37:42.775290+0000","last_became_active":"2023-11-04T01:37:41.730579+0000","last_became_peered":"2023-11-04T01:37:41.730579+0000","last_unstale":"2023-11-04T01:37:42.775290+0000","last_undegraded":"2023-11-04T01:37:42.775290+0000","last_fullsized":"2023-11-04T01:37:42.775290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724915+0000","last_change":"2023-11-04T01:37:40.724705+0000","last_active":"2023-11-04T01:37:42.724915+0000","last_peered":"2023-11-04T01:37:42.724915+0000","last_clean":"2023-11-04T01:37:42.724915+0000","last_became_active":"2023-11-04T01:37:40.724498+0000","last_became_peered":"2023-11-04T01:37:40.724498+0000","last_unstale":"2023-11-04T01:37:42.724915+0000","last_undegraded":"2023-11-04T01:37:42.724915+0000","last_fullsized":"2023-11-04T01:37:42.724915+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:06.972960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720435+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:37:41.720435+0000","last_peered":"2023-11-04T01:37:41.720435+0000","last_clean":"2023-11-04T01:37:41.720435+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:37:41.720435+0000","last_undegraded":"2023-11-04T01:37:41.720435+0000","last_fullsized":"2023-11-04T01:37:41.720435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725329+0000","last_change":"2023-11-04T01:37:41.737099+0000","last_active":"2023-11-04T01:37:42.725329+0000","last_peered":"2023-11-04T01:37:42.725329+0000","last_clean":"2023-11-04T01:37:42.725329+0000","last_became_active":"2023-11-04T01:37:41.736643+0000","last_became_peered":"2023-11-04T01:37:41.736643+0000","last_unstale":"2023-11-04T01:37:42.725329+0000","last_undegraded":"2023-11-04T01:37:42.725329+0000","last_fullsized":"2023-11-04T01:37:42.725329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775388+0000","last_change":"2023-11-04T01:37:40.723502+0000","last_active":"2023-11-04T01:37:42.775388+0000","last_peered":"2023-11-04T01:37:42.775388+0000","last_clean":"2023-11-04T01:37:42.775388+0000","last_became_active":"2023-11-04T01:37:40.723256+0000","last_became_peered":"2023-11-04T01:37:40.723256+0000","last_unstale":"2023-11-04T01:37:42.775388+0000","last_undegraded":"2023-11-04T01:37:42.775388+0000","last_fullsized":"2023-11-04T01:37:42.775388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:55.289904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720058+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:37:41.720058+0000","last_peered":"2023-11-04T01:37:41.720058+0000","last_clean":"2023-11-04T01:37:41.720058+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:37:41.720058+0000","last_undegraded":"2023-11-04T01:37:41.720058+0000","last_fullsized":"2023-11-04T01:37:41.720058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718305+0000","last_change":"2023-11-04T01:37:41.726825+0000","last_active":"2023-11-04T01:37:42.718305+0000","last_peered":"2023-11-04T01:37:42.718305+0000","last_clean":"2023-11-04T01:37:42.718305+0000","last_became_active":"2023-11-04T01:37:41.726578+0000","last_became_peered":"2023-11-04T01:37:41.726578+0000","last_unstale":"2023-11-04T01:37:42.718305+0000","last_undegraded":"2023-11-04T01:37:42.718305+0000","last_fullsized":"2023-11-04T01:37:42.718305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725108+0000","last_change":"2023-11-04T01:37:40.722814+0000","last_active":"2023-11-04T01:37:42.725108+0000","last_peered":"2023-11-04T01:37:42.725108+0000","last_clean":"2023-11-04T01:37:42.725108+0000","last_became_active":"2023-11-04T01:37:40.722574+0000","last_became_peered":"2023-11-04T01:37:40.722574+0000","last_unstale":"2023-11-04T01:37:42.725108+0000","last_undegraded":"2023-11-04T01:37:42.725108+0000","last_fullsized":"2023-11-04T01:37:42.725108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:38:32.195159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720807+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:37:41.720807+0000","last_peered":"2023-11-04T01:37:41.720807+0000","last_clean":"2023-11-04T01:37:41.720807+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:37:41.720807+0000","last_undegraded":"2023-11-04T01:37:41.720807+0000","last_fullsized":"2023-11-04T01:37:41.720807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775649+0000","last_change":"2023-11-04T01:37:41.744612+0000","last_active":"2023-11-04T01:37:42.775649+0000","last_peered":"2023-11-04T01:37:42.775649+0000","last_clean":"2023-11-04T01:37:42.775649+0000","last_became_active":"2023-11-04T01:37:41.744358+0000","last_became_peered":"2023-11-04T01:37:41.744358+0000","last_unstale":"2023-11-04T01:37:42.775649+0000","last_undegraded":"2023-11-04T01:37:42.775649+0000","last_fullsized":"2023-11-04T01:37:42.775649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:31.384440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775021+0000","last_change":"2023-11-04T01:37:40.717411+0000","last_active":"2023-11-04T01:37:42.775021+0000","last_peered":"2023-11-04T01:37:42.775021+0000","last_clean":"2023-11-04T01:37:42.775021+0000","last_became_active":"2023-11-04T01:37:40.717151+0000","last_became_peered":"2023-11-04T01:37:40.717151+0000","last_unstale":"2023-11-04T01:37:42.775021+0000","last_undegraded":"2023-11-04T01:37:42.775021+0000","last_fullsized":"2023-11-04T01:37:42.775021+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722024+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:37:41.722024+0000","last_peered":"2023-11-04T01:37:41.722024+0000","last_clean":"2023-11-04T01:37:41.722024+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:37:41.722024+0000","last_undegraded":"2023-11-04T01:37:41.722024+0000","last_fullsized":"2023-11-04T01:37:41.722024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775563+0000","last_change":"2023-11-04T01:37:41.740907+0000","last_active":"2023-11-04T01:37:42.775563+0000","last_peered":"2023-11-04T01:37:42.775563+0000","last_clean":"2023-11-04T01:37:42.775563+0000","last_became_active":"2023-11-04T01:37:41.740260+0000","last_became_peered":"2023-11-04T01:37:41.740260+0000","last_unstale":"2023-11-04T01:37:42.775563+0000","last_undegraded":"2023-11-04T01:37:42.775563+0000","last_fullsized":"2023-11-04T01:37:42.775563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:59.311487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775239+0000","last_change":"2023-11-04T01:37:40.720151+0000","last_active":"2023-11-04T01:37:42.775239+0000","last_peered":"2023-11-04T01:37:42.775239+0000","last_clean":"2023-11-04T01:37:42.775239+0000","last_became_active":"2023-11-04T01:37:40.719886+0000","last_became_peered":"2023-11-04T01:37:40.719886+0000","last_unstale":"2023-11-04T01:37:42.775239+0000","last_undegraded":"2023-11-04T01:37:42.775239+0000","last_fullsized":"2023-11-04T01:37:42.775239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.736575+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:37:41.736575+0000","last_peered":"2023-11-04T01:37:41.736575+0000","last_clean":"2023-11-04T01:37:41.736575+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:37:41.736575+0000","last_undegraded":"2023-11-04T01:37:41.736575+0000","last_fullsized":"2023-11-04T01:37:41.736575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.735013+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.734725+0000","last_became_peered":"2023-11-04T01:37:41.734725+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:24:38.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775180+0000","last_change":"2023-11-04T01:37:40.715916+0000","last_active":"2023-11-04T01:37:42.775180+0000","last_peered":"2023-11-04T01:37:42.775180+0000","last_clean":"2023-11-04T01:37:42.775180+0000","last_became_active":"2023-11-04T01:37:40.715674+0000","last_became_peered":"2023-11-04T01:37:40.715674+0000","last_unstale":"2023-11-04T01:37:42.775180+0000","last_undegraded":"2023-11-04T01:37:42.775180+0000","last_fullsized":"2023-11-04T01:37:42.775180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:29.538943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722256+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:37:41.722256+0000","last_peered":"2023-11-04T01:37:41.722256+0000","last_clean":"2023-11-04T01:37:41.722256+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:37:41.722256+0000","last_undegraded":"2023-11-04T01:37:41.722256+0000","last_fullsized":"2023-11-04T01:37:41.722256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774706+0000","last_change":"2023-11-04T01:37:41.739459+0000","last_active":"2023-11-04T01:37:42.774706+0000","last_peered":"2023-11-04T01:37:42.774706+0000","last_clean":"2023-11-04T01:37:42.774706+0000","last_became_active":"2023-11-04T01:37:41.738951+0000","last_became_peered":"2023-11-04T01:37:41.738951+0000","last_unstale":"2023-11-04T01:37:42.774706+0000","last_undegraded":"2023-11-04T01:37:42.774706+0000","last_fullsized":"2023-11-04T01:37:42.774706+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:19.507645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724689+0000","last_change":"2023-11-04T01:37:40.718656+0000","last_active":"2023-11-04T01:37:42.724689+0000","last_peered":"2023-11-04T01:37:42.724689+0000","last_clean":"2023-11-04T01:37:42.724689+0000","last_became_active":"2023-11-04T01:37:40.718417+0000","last_became_peered":"2023-11-04T01:37:40.718417+0000","last_unstale":"2023-11-04T01:37:42.724689+0000","last_undegraded":"2023-11-04T01:37:42.724689+0000","last_fullsized":"2023-11-04T01:37:42.724689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723715+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:37:41.723715+0000","last_peered":"2023-11-04T01:37:41.723715+0000","last_clean":"2023-11-04T01:37:41.723715+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:37:41.723715+0000","last_undegraded":"2023-11-04T01:37:41.723715+0000","last_fullsized":"2023-11-04T01:37:41.723715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718472+0000","last_change":"2023-11-04T01:37:41.725262+0000","last_active":"2023-11-04T01:37:42.718472+0000","last_peered":"2023-11-04T01:37:42.718472+0000","last_clean":"2023-11-04T01:37:42.718472+0000","last_became_active":"2023-11-04T01:37:41.725012+0000","last_became_peered":"2023-11-04T01:37:41.725012+0000","last_unstale":"2023-11-04T01:37:42.718472+0000","last_undegraded":"2023-11-04T01:37:42.718472+0000","last_fullsized":"2023-11-04T01:37:42.718472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775772+0000","last_change":"2023-11-04T01:37:40.712958+0000","last_active":"2023-11-04T01:37:42.775772+0000","last_peered":"2023-11-04T01:37:42.775772+0000","last_clean":"2023-11-04T01:37:42.775772+0000","last_became_active":"2023-11-04T01:37:40.712701+0000","last_became_peered":"2023-11-04T01:37:40.712701+0000","last_unstale":"2023-11-04T01:37:42.775772+0000","last_undegraded":"2023-11-04T01:37:42.775772+0000","last_fullsized":"2023-11-04T01:37:42.775772+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:41.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.724545+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:37:41.724545+0000","last_peered":"2023-11-04T01:37:41.724545+0000","last_clean":"2023-11-04T01:37:41.724545+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:37:41.724545+0000","last_undegraded":"2023-11-04T01:37:41.724545+0000","last_fullsized":"2023-11-04T01:37:41.724545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775317+0000","last_change":"2023-11-04T01:37:41.738188+0000","last_active":"2023-11-04T01:37:42.775317+0000","last_peered":"2023-11-04T01:37:42.775317+0000","last_clean":"2023-11-04T01:37:42.775317+0000","last_became_active":"2023-11-04T01:37:41.737940+0000","last_became_peered":"2023-11-04T01:37:41.737940+0000","last_unstale":"2023-11-04T01:37:42.775317+0000","last_undegraded":"2023-11-04T01:37:42.775317+0000","last_fullsized":"2023-11-04T01:37:42.775317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774924+0000","last_change":"2023-11-04T01:37:40.720157+0000","last_active":"2023-11-04T01:37:42.774924+0000","last_peered":"2023-11-04T01:37:42.774924+0000","last_clean":"2023-11-04T01:37:42.774924+0000","last_became_active":"2023-11-04T01:37:40.719881+0000","last_became_peered":"2023-11-04T01:37:40.719881+0000","last_unstale":"2023-11-04T01:37:42.774924+0000","last_undegraded":"2023-11-04T01:37:42.774924+0000","last_fullsized":"2023-11-04T01:37:42.774924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:07:40.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729385+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:37:41.729385+0000","last_peered":"2023-11-04T01:37:41.729385+0000","last_clean":"2023-11-04T01:37:41.729385+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:37:41.729385+0000","last_undegraded":"2023-11-04T01:37:41.729385+0000","last_fullsized":"2023-11-04T01:37:41.729385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.731662+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.731410+0000","last_became_peered":"2023-11-04T01:37:41.731410+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724373+0000","last_change":"2023-11-04T01:37:40.721013+0000","last_active":"2023-11-04T01:37:42.724373+0000","last_peered":"2023-11-04T01:37:42.724373+0000","last_clean":"2023-11-04T01:37:42.724373+0000","last_became_active":"2023-11-04T01:37:40.720505+0000","last_became_peered":"2023-11-04T01:37:40.720505+0000","last_unstale":"2023-11-04T01:37:42.724373+0000","last_undegraded":"2023-11-04T01:37:42.724373+0000","last_fullsized":"2023-11-04T01:37:42.724373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:20.590973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720137+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:37:41.720137+0000","last_peered":"2023-11-04T01:37:41.720137+0000","last_clean":"2023-11-04T01:37:41.720137+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:37:41.720137+0000","last_undegraded":"2023-11-04T01:37:41.720137+0000","last_fullsized":"2023-11-04T01:37:41.720137+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775495+0000","last_change":"2023-11-04T01:37:41.721425+0000","last_active":"2023-11-04T01:37:42.775495+0000","last_peered":"2023-11-04T01:37:42.775495+0000","last_clean":"2023-11-04T01:37:42.775495+0000","last_became_active":"2023-11-04T01:37:41.721145+0000","last_became_peered":"2023-11-04T01:37:41.721145+0000","last_unstale":"2023-11-04T01:37:42.775495+0000","last_undegraded":"2023-11-04T01:37:42.775495+0000","last_fullsized":"2023-11-04T01:37:42.775495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775437+0000","last_change":"2023-11-04T01:37:40.723770+0000","last_active":"2023-11-04T01:37:42.775437+0000","last_peered":"2023-11-04T01:37:42.775437+0000","last_clean":"2023-11-04T01:37:42.775437+0000","last_became_active":"2023-11-04T01:37:40.723481+0000","last_became_peered":"2023-11-04T01:37:40.723481+0000","last_unstale":"2023-11-04T01:37:42.775437+0000","last_undegraded":"2023-11-04T01:37:42.775437+0000","last_fullsized":"2023-11-04T01:37:42.775437+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728097+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:37:41.728097+0000","last_peered":"2023-11-04T01:37:41.728097+0000","last_clean":"2023-11-04T01:37:41.728097+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:37:41.728097+0000","last_undegraded":"2023-11-04T01:37:41.728097+0000","last_fullsized":"2023-11-04T01:37:41.728097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724308+0000","last_change":"2023-11-04T01:37:41.737253+0000","last_active":"2023-11-04T01:37:42.724308+0000","last_peered":"2023-11-04T01:37:42.724308+0000","last_clean":"2023-11-04T01:37:42.724308+0000","last_became_active":"2023-11-04T01:37:41.736156+0000","last_became_peered":"2023-11-04T01:37:41.736156+0000","last_unstale":"2023-11-04T01:37:42.724308+0000","last_undegraded":"2023-11-04T01:37:42.724308+0000","last_fullsized":"2023-11-04T01:37:42.724308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:57.077859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775093+0000","last_change":"2023-11-04T01:37:40.723713+0000","last_active":"2023-11-04T01:37:42.775093+0000","last_peered":"2023-11-04T01:37:42.775093+0000","last_clean":"2023-11-04T01:37:42.775093+0000","last_became_active":"2023-11-04T01:37:40.723495+0000","last_became_peered":"2023-11-04T01:37:40.723495+0000","last_unstale":"2023-11-04T01:37:42.775093+0000","last_undegraded":"2023-11-04T01:37:42.775093+0000","last_fullsized":"2023-11-04T01:37:42.775093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:46.335518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728628+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:37:41.728628+0000","last_peered":"2023-11-04T01:37:41.728628+0000","last_clean":"2023-11-04T01:37:41.728628+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:37:41.728628+0000","last_undegraded":"2023-11-04T01:37:41.728628+0000","last_fullsized":"2023-11-04T01:37:41.728628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775927+0000","last_change":"2023-11-04T01:37:41.744489+0000","last_active":"2023-11-04T01:37:42.775927+0000","last_peered":"2023-11-04T01:37:42.775927+0000","last_clean":"2023-11-04T01:37:42.775927+0000","last_became_active":"2023-11-04T01:37:41.744234+0000","last_became_peered":"2023-11-04T01:37:41.744234+0000","last_unstale":"2023-11-04T01:37:42.775927+0000","last_undegraded":"2023-11-04T01:37:42.775927+0000","last_fullsized":"2023-11-04T01:37:42.775927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:49.180920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718124+0000","last_change":"2023-11-04T01:37:40.722082+0000","last_active":"2023-11-04T01:37:42.718124+0000","last_peered":"2023-11-04T01:37:42.718124+0000","last_clean":"2023-11-04T01:37:42.718124+0000","last_became_active":"2023-11-04T01:37:40.721801+0000","last_became_peered":"2023-11-04T01:37:40.721801+0000","last_unstale":"2023-11-04T01:37:42.718124+0000","last_undegraded":"2023-11-04T01:37:42.718124+0000","last_fullsized":"2023-11-04T01:37:42.718124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:25.067674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727701+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:37:41.727701+0000","last_peered":"2023-11-04T01:37:41.727701+0000","last_clean":"2023-11-04T01:37:41.727701+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:37:41.727701+0000","last_undegraded":"2023-11-04T01:37:41.727701+0000","last_fullsized":"2023-11-04T01:37:41.727701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.736774+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.736541+0000","last_became_peered":"2023-11-04T01:37:41.736541+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:39.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774436+0000","last_change":"2023-11-04T01:37:40.718660+0000","last_active":"2023-11-04T01:37:42.774436+0000","last_peered":"2023-11-04T01:37:42.774436+0000","last_clean":"2023-11-04T01:37:42.774436+0000","last_became_active":"2023-11-04T01:37:40.718172+0000","last_became_peered":"2023-11-04T01:37:40.718172+0000","last_unstale":"2023-11-04T01:37:42.774436+0000","last_undegraded":"2023-11-04T01:37:42.774436+0000","last_fullsized":"2023-11-04T01:37:42.774436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:23.612529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720523+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:37:41.720523+0000","last_peered":"2023-11-04T01:37:41.720523+0000","last_clean":"2023-11-04T01:37:41.720523+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:37:41.720523+0000","last_undegraded":"2023-11-04T01:37:41.720523+0000","last_fullsized":"2023-11-04T01:37:41.720523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718105+0000","last_change":"2023-11-04T01:37:41.733565+0000","last_active":"2023-11-04T01:37:42.718105+0000","last_peered":"2023-11-04T01:37:42.718105+0000","last_clean":"2023-11-04T01:37:42.718105+0000","last_became_active":"2023-11-04T01:37:41.733324+0000","last_became_peered":"2023-11-04T01:37:41.733324+0000","last_unstale":"2023-11-04T01:37:42.718105+0000","last_undegraded":"2023-11-04T01:37:42.718105+0000","last_fullsized":"2023-11-04T01:37:42.718105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718054+0000","last_change":"2023-11-04T01:37:40.717532+0000","last_active":"2023-11-04T01:37:42.718054+0000","last_peered":"2023-11-04T01:37:42.718054+0000","last_clean":"2023-11-04T01:37:42.718054+0000","last_became_active":"2023-11-04T01:37:40.717239+0000","last_became_peered":"2023-11-04T01:37:40.717239+0000","last_unstale":"2023-11-04T01:37:42.718054+0000","last_undegraded":"2023-11-04T01:37:42.718054+0000","last_fullsized":"2023-11-04T01:37:42.718054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:23.982905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726577+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:37:41.726577+0000","last_peered":"2023-11-04T01:37:41.726577+0000","last_clean":"2023-11-04T01:37:41.726577+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:37:41.726577+0000","last_undegraded":"2023-11-04T01:37:41.726577+0000","last_fullsized":"2023-11-04T01:37:41.726577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725502+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.725502+0000","last_peered":"2023-11-04T01:37:42.725502+0000","last_clean":"2023-11-04T01:37:42.725502+0000","last_became_active":"2023-11-04T01:37:41.740391+0000","last_became_peered":"2023-11-04T01:37:41.740391+0000","last_unstale":"2023-11-04T01:37:42.725502+0000","last_undegraded":"2023-11-04T01:37:42.725502+0000","last_fullsized":"2023-11-04T01:37:42.725502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775426+0000","last_change":"2023-11-04T01:37:40.715703+0000","last_active":"2023-11-04T01:37:42.775426+0000","last_peered":"2023-11-04T01:37:42.775426+0000","last_clean":"2023-11-04T01:37:42.775426+0000","last_became_active":"2023-11-04T01:37:40.715413+0000","last_became_peered":"2023-11-04T01:37:40.715413+0000","last_unstale":"2023-11-04T01:37:42.775426+0000","last_undegraded":"2023-11-04T01:37:42.775426+0000","last_fullsized":"2023-11-04T01:37:42.775426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.719877+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:37:41.719877+0000","last_peered":"2023-11-04T01:37:41.719877+0000","last_clean":"2023-11-04T01:37:41.719877+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:37:41.719877+0000","last_undegraded":"2023-11-04T01:37:41.719877+0000","last_fullsized":"2023-11-04T01:37:41.719877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725148+0000","last_change":"2023-11-04T01:37:41.741732+0000","last_active":"2023-11-04T01:37:42.725148+0000","last_peered":"2023-11-04T01:37:42.725148+0000","last_clean":"2023-11-04T01:37:42.725148+0000","last_became_active":"2023-11-04T01:37:41.741365+0000","last_became_peered":"2023-11-04T01:37:41.741365+0000","last_unstale":"2023-11-04T01:37:42.725148+0000","last_undegraded":"2023-11-04T01:37:42.725148+0000","last_fullsized":"2023-11-04T01:37:42.725148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718487+0000","last_change":"2023-11-04T01:37:40.711455+0000","last_active":"2023-11-04T01:37:42.718487+0000","last_peered":"2023-11-04T01:37:42.718487+0000","last_clean":"2023-11-04T01:37:42.718487+0000","last_became_active":"2023-11-04T01:37:40.711174+0000","last_became_peered":"2023-11-04T01:37:40.711174+0000","last_unstale":"2023-11-04T01:37:42.718487+0000","last_undegraded":"2023-11-04T01:37:42.718487+0000","last_fullsized":"2023-11-04T01:37:42.718487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726070+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:37:41.726070+0000","last_peered":"2023-11-04T01:37:41.726070+0000","last_clean":"2023-11-04T01:37:41.726070+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:37:41.726070+0000","last_undegraded":"2023-11-04T01:37:41.726070+0000","last_fullsized":"2023-11-04T01:37:41.726070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775357+0000","last_change":"2023-11-04T01:37:41.731096+0000","last_active":"2023-11-04T01:37:42.775357+0000","last_peered":"2023-11-04T01:37:42.775357+0000","last_clean":"2023-11-04T01:37:42.775357+0000","last_became_active":"2023-11-04T01:37:41.730821+0000","last_became_peered":"2023-11-04T01:37:41.730821+0000","last_unstale":"2023-11-04T01:37:42.775357+0000","last_undegraded":"2023-11-04T01:37:42.775357+0000","last_fullsized":"2023-11-04T01:37:42.775357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724453+0000","last_change":"2023-11-04T01:37:40.718691+0000","last_active":"2023-11-04T01:37:42.724453+0000","last_peered":"2023-11-04T01:37:42.724453+0000","last_clean":"2023-11-04T01:37:42.724453+0000","last_became_active":"2023-11-04T01:37:40.718437+0000","last_became_peered":"2023-11-04T01:37:40.718437+0000","last_unstale":"2023-11-04T01:37:42.724453+0000","last_undegraded":"2023-11-04T01:37:42.724453+0000","last_fullsized":"2023-11-04T01:37:42.724453+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.716777+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:37:41.716777+0000","last_peered":"2023-11-04T01:37:41.716777+0000","last_clean":"2023-11-04T01:37:41.716777+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:37:41.716777+0000","last_undegraded":"2023-11-04T01:37:41.716777+0000","last_fullsized":"2023-11-04T01:37:41.716777+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718460+0000","last_change":"2023-11-04T01:37:41.732320+0000","last_active":"2023-11-04T01:37:42.718460+0000","last_peered":"2023-11-04T01:37:42.718460+0000","last_clean":"2023-11-04T01:37:42.718460+0000","last_became_active":"2023-11-04T01:37:41.732070+0000","last_became_peered":"2023-11-04T01:37:41.732070+0000","last_unstale":"2023-11-04T01:37:42.718460+0000","last_undegraded":"2023-11-04T01:37:42.718460+0000","last_fullsized":"2023-11-04T01:37:42.718460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775464+0000","last_change":"2023-11-04T01:37:40.719241+0000","last_active":"2023-11-04T01:37:42.775464+0000","last_peered":"2023-11-04T01:37:42.775464+0000","last_clean":"2023-11-04T01:37:42.775464+0000","last_became_active":"2023-11-04T01:37:40.718976+0000","last_became_peered":"2023-11-04T01:37:40.718976+0000","last_unstale":"2023-11-04T01:37:42.775464+0000","last_undegraded":"2023-11-04T01:37:42.775464+0000","last_fullsized":"2023-11-04T01:37:42.775464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:13.045356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729935+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:37:41.729935+0000","last_peered":"2023-11-04T01:37:41.729935+0000","last_clean":"2023-11-04T01:37:41.729935+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:37:41.729935+0000","last_undegraded":"2023-11-04T01:37:41.729935+0000","last_fullsized":"2023-11-04T01:37:41.729935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.734683+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.734409+0000","last_became_peered":"2023-11-04T01:37:41.734409+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718236+0000","last_change":"2023-11-04T01:37:40.722816+0000","last_active":"2023-11-04T01:37:42.718236+0000","last_peered":"2023-11-04T01:37:42.718236+0000","last_clean":"2023-11-04T01:37:42.718236+0000","last_became_active":"2023-11-04T01:37:40.722545+0000","last_became_peered":"2023-11-04T01:37:40.722545+0000","last_unstale":"2023-11-04T01:37:42.718236+0000","last_undegraded":"2023-11-04T01:37:42.718236+0000","last_fullsized":"2023-11-04T01:37:42.718236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723429+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:37:41.723429+0000","last_peered":"2023-11-04T01:37:41.723429+0000","last_clean":"2023-11-04T01:37:41.723429+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:37:41.723429+0000","last_undegraded":"2023-11-04T01:37:41.723429+0000","last_fullsized":"2023-11-04T01:37:41.723429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724073+0000","last_change":"2023-11-04T01:37:41.740269+0000","last_active":"2023-11-04T01:37:42.724073+0000","last_peered":"2023-11-04T01:37:42.724073+0000","last_clean":"2023-11-04T01:37:42.724073+0000","last_became_active":"2023-11-04T01:37:41.740007+0000","last_became_peered":"2023-11-04T01:37:41.740007+0000","last_unstale":"2023-11-04T01:37:42.724073+0000","last_undegraded":"2023-11-04T01:37:42.724073+0000","last_fullsized":"2023-11-04T01:37:42.724073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775961+0000","last_change":"2023-11-04T01:37:40.719473+0000","last_active":"2023-11-04T01:37:42.775961+0000","last_peered":"2023-11-04T01:37:42.775961+0000","last_clean":"2023-11-04T01:37:42.775961+0000","last_became_active":"2023-11-04T01:37:40.719196+0000","last_became_peered":"2023-11-04T01:37:40.719196+0000","last_unstale":"2023-11-04T01:37:42.775961+0000","last_undegraded":"2023-11-04T01:37:42.775961+0000","last_fullsized":"2023-11-04T01:37:42.775961+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:13.458744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720006+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:37:41.720006+0000","last_peered":"2023-11-04T01:37:41.720006+0000","last_clean":"2023-11-04T01:37:41.720006+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:37:41.720006+0000","last_undegraded":"2023-11-04T01:37:41.720006+0000","last_fullsized":"2023-11-04T01:37:41.720006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774691+0000","last_change":"2023-11-04T01:37:41.737451+0000","last_active":"2023-11-04T01:37:42.774691+0000","last_peered":"2023-11-04T01:37:42.774691+0000","last_clean":"2023-11-04T01:37:42.774691+0000","last_became_active":"2023-11-04T01:37:41.737137+0000","last_became_peered":"2023-11-04T01:37:41.737137+0000","last_unstale":"2023-11-04T01:37:42.774691+0000","last_undegraded":"2023-11-04T01:37:42.774691+0000","last_fullsized":"2023-11-04T01:37:42.774691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724047+0000","last_change":"2023-11-04T01:37:40.721797+0000","last_active":"2023-11-04T01:37:42.724047+0000","last_peered":"2023-11-04T01:37:42.724047+0000","last_clean":"2023-11-04T01:37:42.724047+0000","last_became_active":"2023-11-04T01:37:40.721610+0000","last_became_peered":"2023-11-04T01:37:40.721610+0000","last_unstale":"2023-11-04T01:37:42.724047+0000","last_undegraded":"2023-11-04T01:37:42.724047+0000","last_fullsized":"2023-11-04T01:37:42.724047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728593+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:37:41.728593+0000","last_peered":"2023-11-04T01:37:41.728593+0000","last_clean":"2023-11-04T01:37:41.728593+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:37:41.728593+0000","last_undegraded":"2023-11-04T01:37:41.728593+0000","last_fullsized":"2023-11-04T01:37:41.728593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725422+0000","last_change":"2023-11-04T01:37:41.743494+0000","last_active":"2023-11-04T01:37:42.725422+0000","last_peered":"2023-11-04T01:37:42.725422+0000","last_clean":"2023-11-04T01:37:42.725422+0000","last_became_active":"2023-11-04T01:37:41.743202+0000","last_became_peered":"2023-11-04T01:37:41.743202+0000","last_unstale":"2023-11-04T01:37:42.725422+0000","last_undegraded":"2023-11-04T01:37:42.725422+0000","last_fullsized":"2023-11-04T01:37:42.725422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775311+0000","last_change":"2023-11-04T01:37:40.720430+0000","last_active":"2023-11-04T01:37:42.775311+0000","last_peered":"2023-11-04T01:37:42.775311+0000","last_clean":"2023-11-04T01:37:42.775311+0000","last_became_active":"2023-11-04T01:37:40.720147+0000","last_became_peered":"2023-11-04T01:37:40.720147+0000","last_unstale":"2023-11-04T01:37:42.775311+0000","last_undegraded":"2023-11-04T01:37:42.775311+0000","last_fullsized":"2023-11-04T01:37:42.775311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722621+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:37:41.722621+0000","last_peered":"2023-11-04T01:37:41.722621+0000","last_clean":"2023-11-04T01:37:41.722621+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:37:41.722621+0000","last_undegraded":"2023-11-04T01:37:41.722621+0000","last_fullsized":"2023-11-04T01:37:41.722621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725190+0000","last_change":"2023-11-04T01:37:41.736870+0000","last_active":"2023-11-04T01:37:42.725190+0000","last_peered":"2023-11-04T01:37:42.725190+0000","last_clean":"2023-11-04T01:37:42.725190+0000","last_became_active":"2023-11-04T01:37:41.736603+0000","last_became_peered":"2023-11-04T01:37:41.736603+0000","last_unstale":"2023-11-04T01:37:42.725190+0000","last_undegraded":"2023-11-04T01:37:42.725190+0000","last_fullsized":"2023-11-04T01:37:42.725190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775895+0000","last_change":"2023-11-04T01:37:40.723529+0000","last_active":"2023-11-04T01:37:42.775895+0000","last_peered":"2023-11-04T01:37:42.775895+0000","last_clean":"2023-11-04T01:37:42.775895+0000","last_became_active":"2023-11-04T01:37:40.723260+0000","last_became_peered":"2023-11-04T01:37:40.723260+0000","last_unstale":"2023-11-04T01:37:42.775895+0000","last_undegraded":"2023-11-04T01:37:42.775895+0000","last_fullsized":"2023-11-04T01:37:42.775895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:16.821204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729600+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:37:41.729600+0000","last_peered":"2023-11-04T01:37:41.729600+0000","last_clean":"2023-11-04T01:37:41.729600+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:37:41.729600+0000","last_undegraded":"2023-11-04T01:37:41.729600+0000","last_fullsized":"2023-11-04T01:37:41.729600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724985+0000","last_change":"2023-11-04T01:37:41.736914+0000","last_active":"2023-11-04T01:37:42.724985+0000","last_peered":"2023-11-04T01:37:42.724985+0000","last_clean":"2023-11-04T01:37:42.724985+0000","last_became_active":"2023-11-04T01:37:41.736343+0000","last_became_peered":"2023-11-04T01:37:41.736343+0000","last_unstale":"2023-11-04T01:37:42.724985+0000","last_undegraded":"2023-11-04T01:37:42.724985+0000","last_fullsized":"2023-11-04T01:37:42.724985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775473+0000","last_change":"2023-11-04T01:37:40.722000+0000","last_active":"2023-11-04T01:37:42.775473+0000","last_peered":"2023-11-04T01:37:42.775473+0000","last_clean":"2023-11-04T01:37:42.775473+0000","last_became_active":"2023-11-04T01:37:40.721730+0000","last_became_peered":"2023-11-04T01:37:40.721730+0000","last_unstale":"2023-11-04T01:37:42.775473+0000","last_undegraded":"2023-11-04T01:37:42.775473+0000","last_fullsized":"2023-11-04T01:37:42.775473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730251+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:37:41.730251+0000","last_peered":"2023-11-04T01:37:41.730251+0000","last_clean":"2023-11-04T01:37:41.730251+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:37:41.730251+0000","last_undegraded":"2023-11-04T01:37:41.730251+0000","last_fullsized":"2023-11-04T01:37:41.730251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775689+0000","last_change":"2023-11-04T01:37:41.747748+0000","last_active":"2023-11-04T01:37:42.775689+0000","last_peered":"2023-11-04T01:37:42.775689+0000","last_clean":"2023-11-04T01:37:42.775689+0000","last_became_active":"2023-11-04T01:37:41.745825+0000","last_became_peered":"2023-11-04T01:37:41.745825+0000","last_unstale":"2023-11-04T01:37:42.775689+0000","last_undegraded":"2023-11-04T01:37:42.775689+0000","last_fullsized":"2023-11-04T01:37:42.775689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:10.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724901+0000","last_change":"2023-11-04T01:37:40.716899+0000","last_active":"2023-11-04T01:37:42.724901+0000","last_peered":"2023-11-04T01:37:42.724901+0000","last_clean":"2023-11-04T01:37:42.724901+0000","last_became_active":"2023-11-04T01:37:40.716638+0000","last_became_peered":"2023-11-04T01:37:40.716638+0000","last_unstale":"2023-11-04T01:37:42.724901+0000","last_undegraded":"2023-11-04T01:37:42.724901+0000","last_fullsized":"2023-11-04T01:37:42.724901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:46.871803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730007+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:37:41.730007+0000","last_peered":"2023-11-04T01:37:41.730007+0000","last_clean":"2023-11-04T01:37:41.730007+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:37:41.730007+0000","last_undegraded":"2023-11-04T01:37:41.730007+0000","last_fullsized":"2023-11-04T01:37:41.730007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774463+0000","last_change":"2023-11-04T01:37:41.745270+0000","last_active":"2023-11-04T01:37:42.774463+0000","last_peered":"2023-11-04T01:37:42.774463+0000","last_clean":"2023-11-04T01:37:42.774463+0000","last_became_active":"2023-11-04T01:37:41.744977+0000","last_became_peered":"2023-11-04T01:37:41.744977+0000","last_unstale":"2023-11-04T01:37:42.774463+0000","last_undegraded":"2023-11-04T01:37:42.774463+0000","last_fullsized":"2023-11-04T01:37:42.774463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:12.659640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775117+0000","last_change":"2023-11-04T01:37:40.718777+0000","last_active":"2023-11-04T01:37:42.775117+0000","last_peered":"2023-11-04T01:37:42.775117+0000","last_clean":"2023-11-04T01:37:42.775117+0000","last_became_active":"2023-11-04T01:37:40.718533+0000","last_became_peered":"2023-11-04T01:37:40.718533+0000","last_unstale":"2023-11-04T01:37:42.775117+0000","last_undegraded":"2023-11-04T01:37:42.775117+0000","last_fullsized":"2023-11-04T01:37:42.775117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720646+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:37:41.720646+0000","last_peered":"2023-11-04T01:37:41.720646+0000","last_clean":"2023-11-04T01:37:41.720646+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:37:41.720646+0000","last_undegraded":"2023-11-04T01:37:41.720646+0000","last_fullsized":"2023-11-04T01:37:41.720646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723952+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:42.723952+0000","last_peered":"2023-11-04T01:37:42.723952+0000","last_clean":"2023-11-04T01:37:42.723952+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:42.723952+0000","last_undegraded":"2023-11-04T01:37:42.723952+0000","last_fullsized":"2023-11-04T01:37:42.723952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.502}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":291693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65100000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.62,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.499},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.752}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":294324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79500000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71199999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.133,"15min":1.133},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.71699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.36599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.316},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.38600000000000001,"5min":0.495,"15min":0.495},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40799999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47099999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.254}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78300000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.876,"15min":0.876},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73799999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.313}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1249280,"data_stored":884255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.316,"15min":0.32200000000000001},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.251},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.442,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.313}]},{"osd":2,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.36499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379}]},{"osd":4,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.048,"15min":1.048},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.874,"15min":0.874},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:45.656 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:37:45.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.786+0000 7ff60e89b640 1 Processor -- start 2023-11-04T01:37:45.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60e89b640 1 -- start start 2023-11-04T01:37:45.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60e89b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6080cb5c0 0x7ff6080ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60e89b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60806a120 con 0x7ff60815d250 2023-11-04T01:37:45.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60e89b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6080c9f40 con 0x7ff60815ce70 2023-11-04T01:37:45.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60e89b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080cdc10 con 0x7ff6080cb5c0 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60ce38640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6080cb5c0 0x7ff6080ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff6077fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff60815d250 0x7ff6080c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44778/0 (socket says 172.21.15.93:44778) 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff60ce38640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6080cb5c0 0x7ff6080ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55810/0 (socket says 172.21.15.93:55810) 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.787+0000 7ff6077fe640 1 -- 172.21.15.93:0/1060323382 learned_addr learned my addr 172.21.15.93:0/1060323382 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.788+0000 7ff60ce38640 1 -- 172.21.15.93:0/1060323382 >> v1:172.21.15.125:6789/0 conn(0x7ff60815ce70 legacy=0x7ff60806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.788+0000 7ff60ce38640 1 -- 172.21.15.93:0/1060323382 >> v1:172.21.15.93:6789/0 conn(0x7ff60815d250 legacy=0x7ff6080c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.788+0000 7ff60ce38640 1 -- 172.21.15.93:0/1060323382 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60806a370 con 0x7ff6080cb5c0 2023-11-04T01:37:45.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.788+0000 7ff606ffd640 1 -- 172.21.15.93:0/1060323382 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870761744 0 0) 0x7ff60806a120 con 0x7ff60815d250 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.788+0000 7ff60ce38640 1 --2- 172.21.15.93:0/1060323382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080ccdb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff600009d90 tx=0x7ff60002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8860e2ba00090f33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff606ffd640 1 -- 172.21.15.93:0/1060323382 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60002cc60 con 0x7ff6080cb5c0 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff606ffd640 1 -- 172.21.15.93:0/1060323382 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60002cdc0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff606ffd640 1 -- 172.21.15.93:0/1060323382 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600034660 con 0x7ff6080cb5c0 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 -- 172.21.15.93:0/1060323382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 msgr2=0x7ff6080ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 --2- 172.21.15.93:0/1060323382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080ccdb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff600009d90 tx=0x7ff60002beb0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 -- 172.21.15.93:0/1060323382 shutdown_connections 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 --2- 172.21.15.93:0/1060323382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080ccdb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 -- 172.21.15.93:0/1060323382 >> 172.21.15.93:0/1060323382 conn(0x7ff6080b0cd0 msgr2=0x7ff6080b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 -- 172.21.15.93:0/1060323382 shutdown_connections 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.789+0000 7ff60e89b640 1 -- 172.21.15.93:0/1060323382 wait complete. 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.790+0000 7ff60e89b640 1 Processor -- start 2023-11-04T01:37:45.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 -- start start 2023-11-04T01:37:45.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 0x7ff608146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff60815d250 0x7ff6080c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081578b0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080c8f00 con 0x7ff60815d250 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff60e89b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080c7940 con 0x7ff60815ce70 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff607fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff607fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55818/0 (socket says 172.21.15.93:55818) 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.791+0000 7ff607fff640 1 -- 172.21.15.93:0/2905454035 learned_addr learned my addr 172.21.15.93:0/2905454035 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:45.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff60ce38640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff60815d250 0x7ff6080c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff6077fe640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 0x7ff608146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 -- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 msgr2=0x7ff608146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 0x7ff608146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 -- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff60815d250 msgr2=0x7ff6080c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff60815d250 0x7ff6080c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 -- 172.21.15.93:0/2905454035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600009a70 con 0x7ff6080cb5c0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff6077fe640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 0x7ff608146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff607fff640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c410 tx=0x7ff5fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0035f0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc003750 con 0x7ff6080cb5c0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc003b40 con 0x7ff6080cb5c0 2023-11-04T01:37:45.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6080c7c20 con 0x7ff6080cb5c0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.792+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6080c81e0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.793+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff608074290 con 0x7ff6080cb5c0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.793+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5fc003ca0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.794+0000 7ff604ff9640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.794+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff5fc088ac0 con 0x7ff6080cb5c0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.794+0000 7ff6077fe640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.794+0000 7ff6077fe640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 0x7ff5f406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff60806d750 tx=0x7ff5f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:45.798+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5fc0538d0 con 0x7ff6080cb5c0 2023-11-04T01:37:46.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.029+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff608066170 con 0x7ff6080cb5c0 2023-11-04T01:37:46.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.030+0000 7ff604ff9640 1 -- 172.21.15.93:0/2905454035 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1168 (secure 0 0 0) 0x7ff5fc088080 con 0x7ff6080cb5c0 2023-11-04T01:37:46.031 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:46.032 INFO:teuthology.orchestra.run.smithi093.stdout:{"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":138,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061738,"num_in_osds":8,"osd_in_since":1699061729,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":33}],"num_pgs":129,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":227291136,"bytes_avail":772866822144,"bytes_total":773094113280,"unknown_pgs_ratio":0.74418604373931885},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-04T01:36:57.340624+0000","services":{}},"progress_events":{}} 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 msgr2=0x7ff5f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 0x7ff5f406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff60806d750 tx=0x7ff5f8009040 comp rx=0 tx=0).stop 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 msgr2=0x7ff6080c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c410 tx=0x7ff5fc00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 shutdown_connections 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff60815d250 0x7ff6080c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff60815ce70 0x7ff608146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 --2- 172.21.15.93:0/2905454035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6080cb5c0 0x7ff6080c89c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 >> 172.21.15.93:0/2905454035 conn(0x7ff6080b0cd0 msgr2=0x7ff6080c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 shutdown_connections 2023-11-04T01:37:46.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.032+0000 7ff60e89b640 1 -- 172.21.15.93:0/2905454035 wait complete. 2023-11-04T01:37:46.044 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:37:46.044 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:46.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.142+0000 7f52349a9640 1 Processor -- start 2023-11-04T01:37:46.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.142+0000 7f52349a9640 1 -- start start 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f52349a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f52300b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f52349a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300c9880 con 0x7f523015cf10 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f52349a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523006d0f0 con 0x7f52300ca2b0 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f52349a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b11b0 con 0x7f52300b07f0 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522e59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f523015cf10 0x7f523006c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44790/0 (socket says 172.21.15.93:44790) 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522e59c640 1 -- 172.21.15.93:0/1481678033 learned_addr learned my addr 172.21.15.93:0/1481678033 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515012930 0 0) 0x7f52300c9880 con 0x7f523015cf10 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c003520 con 0x7f523015cf10 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f5227fff640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f52300b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2840330253 0 0) 0x7f521c003520 con 0x7f523015cf10 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 msgr2=0x7f52300b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f52300b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 >> v1:172.21.15.125:6789/0 conn(0x7f52300ca2b0 legacy=0x7f52300ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300cd650 con 0x7f523015cf10 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5220001670 con 0x7f523015cf10 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 >> v1:172.21.15.93:6789/0 conn(0x7f523015cf10 legacy=0x7f523006c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f521c0039a0 0x7f521c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0047c0 0x7f521c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f521c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b11b0 con 0x7f521c0039a0 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c00bab0 con 0x7f521c0047c0 2023-11-04T01:37:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.143+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c00bc70 con 0x7f52300b07f0 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f521c0039a0 0x7f521c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f5227fff640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0047c0 0x7f521c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522ed9d640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f521c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 -- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 msgr2=0x7f521c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b07f0 0x7f521c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 -- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0047c0 msgr2=0x7f521c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0047c0 0x7f521c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 -- 172.21.15.93:0/1481678033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c003520 con 0x7f521c0039a0 2023-11-04T01:37:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f5227fff640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0047c0 0x7f521c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.144+0000 7f522e59c640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f521c0039a0 0x7f521c003dc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f522000c240 tx=0x7f521c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fd482f632888fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220005ad0 con 0x7f521c0039a0 2023-11-04T01:37:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220005c30 con 0x7f521c0039a0 2023-11-04T01:37:46.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f522dd9b640 1 -- 172.21.15.93:0/1481678033 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522002c8b0 con 0x7f521c0039a0 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 -- 172.21.15.93:0/1481678033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f521c0039a0 msgr2=0x7f521c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 --2- 172.21.15.93:0/1481678033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f521c0039a0 0x7f521c003dc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f522000c240 tx=0x7f521c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f522ed9d640 1 -- 172.21.15.93:0/1481678033 reap_dead start 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 -- 172.21.15.93:0/1481678033 shutdown_connections 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 -- 172.21.15.93:0/1481678033 >> 172.21.15.93:0/1481678033 conn(0x7f52300cb7f0 msgr2=0x7f52300cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 -- 172.21.15.93:0/1481678033 shutdown_connections 2023-11-04T01:37:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.145+0000 7f52349a9640 1 -- 172.21.15.93:0/1481678033 wait complete. 2023-11-04T01:37:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.146+0000 7f52349a9640 1 Processor -- start 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.146+0000 7f52349a9640 1 -- start start 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 0x7f5230153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 0x7f52300b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b2410 con 0x7f52300b1ed0 2023-11-04T01:37:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b26f0 con 0x7f521c0039a0 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f52349a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b29d0 con 0x7f52300b34b0 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f522ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f522ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55828/0 (socket says 172.21.15.93:55828) 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f522ed9d640 1 -- 172.21.15.93:0/4157085033 learned_addr learned my addr 172.21.15.93:0/4157085033 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f522e59c640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 0x7f5230153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.147+0000 7f5227fff640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 0x7f52300b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 -- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 msgr2=0x7f52300b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 0x7f52300b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 -- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 msgr2=0x7f5230153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 0x7f5230153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 -- 172.21.15.93:0/4157085033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300b2cb0 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522e59c640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 0x7f5230153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f5227fff640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 0x7f52300b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f522ed9d640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f52300cc560 tx=0x7f522800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228003b80 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228003ce0 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300b2f90 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228005310 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.148+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5230153670 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.149+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5230074290 con 0x7f52300b1ed0 2023-11-04T01:37:46.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.149+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5228005470 con 0x7f52300b1ed0 2023-11-04T01:37:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.150+0000 7f5226ffd640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 0x7f521006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.150+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f52280895c0 con 0x7f52300b1ed0 2023-11-04T01:37:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.150+0000 7f522e59c640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 0x7f521006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.150+0000 7f522e59c640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 0x7f521006d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5220034000 tx=0x7f5220009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.154+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52280543d0 con 0x7f52300b1ed0 2023-11-04T01:37:46.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.318+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52300c9ab0 con 0x7f521006ae70 2023-11-04T01:37:46.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.326+0000 7f5226ffd640 1 -- 172.21.15.93:0/4157085033 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370572 (secure 0 0 0) 0x7f52200059c0 con 0x7f521006ae70 2023-11-04T01:37:46.331 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 msgr2=0x7f521006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 0x7f521006d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5220034000 tx=0x7f5220009030 comp rx=0 tx=0).stop 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 msgr2=0x7f52300b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f52300cc560 tx=0x7f522800e960 comp rx=0 tx=0).stop 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 shutdown_connections 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f521006ae70 0x7f521006d330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52300b1ed0 0x7f52300b3970 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52300b34b0 0x7f52300b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 --2- 172.21.15.93:0/4157085033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521c0039a0 0x7f5230153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 >> 172.21.15.93:0/4157085033 conn(0x7f52300cb7f0 msgr2=0x7f5230159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 shutdown_connections 2023-11-04T01:37:46.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:46.330+0000 7f52349a9640 1 -- 172.21.15.93:0/4157085033 wait complete. 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:37:45.349975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222452,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752268,"statfs":{"total":773094113280,"available":772866322432,"internally_reserved":0,"allocated":6389760,"data_stored":3525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.652378"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774653+0000","last_change":"2023-11-04T01:37:41.742330+0000","last_active":"2023-11-04T01:37:42.774653+0000","last_peered":"2023-11-04T01:37:42.774653+0000","last_clean":"2023-11-04T01:37:42.774653+0000","last_became_active":"2023-11-04T01:37:41.742024+0000","last_became_peered":"2023-11-04T01:37:41.742024+0000","last_unstale":"2023-11-04T01:37:42.774653+0000","last_undegraded":"2023-11-04T01:37:42.774653+0000","last_fullsized":"2023-11-04T01:37:42.774653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:54.535366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775738+0000","last_change":"2023-11-04T01:37:41.741184+0000","last_active":"2023-11-04T01:37:42.775738+0000","last_peered":"2023-11-04T01:37:42.775738+0000","last_clean":"2023-11-04T01:37:42.775738+0000","last_became_active":"2023-11-04T01:37:41.740929+0000","last_became_peered":"2023-11-04T01:37:41.740929+0000","last_unstale":"2023-11-04T01:37:42.775738+0000","last_undegraded":"2023-11-04T01:37:42.775738+0000","last_fullsized":"2023-11-04T01:37:42.775738+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:36.888749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725072+0000","last_change":"2023-11-04T01:37:41.731319+0000","last_active":"2023-11-04T01:37:42.725072+0000","last_peered":"2023-11-04T01:37:42.725072+0000","last_clean":"2023-11-04T01:37:42.725072+0000","last_became_active":"2023-11-04T01:37:41.731029+0000","last_became_peered":"2023-11-04T01:37:41.731029+0000","last_unstale":"2023-11-04T01:37:42.725072+0000","last_undegraded":"2023-11-04T01:37:42.725072+0000","last_fullsized":"2023-11-04T01:37:42.725072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724561+0000","last_change":"2023-11-04T01:37:41.741326+0000","last_active":"2023-11-04T01:37:42.724561+0000","last_peered":"2023-11-04T01:37:42.724561+0000","last_clean":"2023-11-04T01:37:42.724561+0000","last_became_active":"2023-11-04T01:37:41.741066+0000","last_became_peered":"2023-11-04T01:37:41.741066+0000","last_unstale":"2023-11-04T01:37:42.724561+0000","last_undegraded":"2023-11-04T01:37:42.724561+0000","last_fullsized":"2023-11-04T01:37:42.724561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774914+0000","last_change":"2023-11-04T01:37:41.736955+0000","last_active":"2023-11-04T01:37:42.774914+0000","last_peered":"2023-11-04T01:37:42.774914+0000","last_clean":"2023-11-04T01:37:42.774914+0000","last_became_active":"2023-11-04T01:37:41.736717+0000","last_became_peered":"2023-11-04T01:37:41.736717+0000","last_unstale":"2023-11-04T01:37:42.774914+0000","last_undegraded":"2023-11-04T01:37:42.774914+0000","last_fullsized":"2023-11-04T01:37:42.774914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:32.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775061+0000","last_change":"2023-11-04T01:37:41.733823+0000","last_active":"2023-11-04T01:37:42.775061+0000","last_peered":"2023-11-04T01:37:42.775061+0000","last_clean":"2023-11-04T01:37:42.775061+0000","last_became_active":"2023-11-04T01:37:41.733540+0000","last_became_peered":"2023-11-04T01:37:41.733540+0000","last_unstale":"2023-11-04T01:37:42.775061+0000","last_undegraded":"2023-11-04T01:37:42.775061+0000","last_fullsized":"2023-11-04T01:37:42.775061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774827+0000","last_change":"2023-11-04T01:37:41.734749+0000","last_active":"2023-11-04T01:37:42.774827+0000","last_peered":"2023-11-04T01:37:42.774827+0000","last_clean":"2023-11-04T01:37:42.774827+0000","last_became_active":"2023-11-04T01:37:41.734486+0000","last_became_peered":"2023-11-04T01:37:41.734486+0000","last_unstale":"2023-11-04T01:37:42.774827+0000","last_undegraded":"2023-11-04T01:37:42.774827+0000","last_fullsized":"2023-11-04T01:37:42.774827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774564+0000","last_change":"2023-11-04T01:37:41.737034+0000","last_active":"2023-11-04T01:37:42.774564+0000","last_peered":"2023-11-04T01:37:42.774564+0000","last_clean":"2023-11-04T01:37:42.774564+0000","last_became_active":"2023-11-04T01:37:41.736007+0000","last_became_peered":"2023-11-04T01:37:41.736007+0000","last_unstale":"2023-11-04T01:37:42.774564+0000","last_undegraded":"2023-11-04T01:37:42.774564+0000","last_fullsized":"2023-11-04T01:37:42.774564+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:13.495100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775132+0000","last_change":"2023-11-04T01:37:41.725939+0000","last_active":"2023-11-04T01:37:42.775132+0000","last_peered":"2023-11-04T01:37:42.775132+0000","last_clean":"2023-11-04T01:37:42.775132+0000","last_became_active":"2023-11-04T01:37:41.725642+0000","last_became_peered":"2023-11-04T01:37:41.725642+0000","last_unstale":"2023-11-04T01:37:42.775132+0000","last_undegraded":"2023-11-04T01:37:42.775132+0000","last_fullsized":"2023-11-04T01:37:42.775132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718431+0000","last_change":"2023-11-04T01:37:41.734129+0000","last_active":"2023-11-04T01:37:42.718431+0000","last_peered":"2023-11-04T01:37:42.718431+0000","last_clean":"2023-11-04T01:37:42.718431+0000","last_became_active":"2023-11-04T01:37:41.733898+0000","last_became_peered":"2023-11-04T01:37:41.733898+0000","last_unstale":"2023-11-04T01:37:42.718431+0000","last_undegraded":"2023-11-04T01:37:42.718431+0000","last_fullsized":"2023-11-04T01:37:42.718431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718546+0000","last_change":"2023-11-04T01:37:41.735286+0000","last_active":"2023-11-04T01:37:42.718546+0000","last_peered":"2023-11-04T01:37:42.718546+0000","last_clean":"2023-11-04T01:37:42.718546+0000","last_became_active":"2023-11-04T01:37:41.735026+0000","last_became_peered":"2023-11-04T01:37:41.735026+0000","last_unstale":"2023-11-04T01:37:42.718546+0000","last_undegraded":"2023-11-04T01:37:42.718546+0000","last_fullsized":"2023-11-04T01:37:42.718546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724285+0000","last_change":"2023-11-04T01:37:41.739990+0000","last_active":"2023-11-04T01:37:42.724285+0000","last_peered":"2023-11-04T01:37:42.724285+0000","last_clean":"2023-11-04T01:37:42.724285+0000","last_became_active":"2023-11-04T01:37:41.739736+0000","last_became_peered":"2023-11-04T01:37:41.739736+0000","last_unstale":"2023-11-04T01:37:42.724285+0000","last_undegraded":"2023-11-04T01:37:42.724285+0000","last_fullsized":"2023-11-04T01:37:42.724285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775489+0000","last_change":"2023-11-04T01:37:41.744264+0000","last_active":"2023-11-04T01:37:42.775489+0000","last_peered":"2023-11-04T01:37:42.775489+0000","last_clean":"2023-11-04T01:37:42.775489+0000","last_became_active":"2023-11-04T01:37:41.743951+0000","last_became_peered":"2023-11-04T01:37:41.743951+0000","last_unstale":"2023-11-04T01:37:42.775489+0000","last_undegraded":"2023-11-04T01:37:42.775489+0000","last_fullsized":"2023-11-04T01:37:42.775489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:44.059690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775130+0000","last_change":"2023-11-04T01:37:41.737149+0000","last_active":"2023-11-04T01:37:42.775130+0000","last_peered":"2023-11-04T01:37:42.775130+0000","last_clean":"2023-11-04T01:37:42.775130+0000","last_became_active":"2023-11-04T01:37:41.736867+0000","last_became_peered":"2023-11-04T01:37:41.736867+0000","last_unstale":"2023-11-04T01:37:42.775130+0000","last_undegraded":"2023-11-04T01:37:42.775130+0000","last_fullsized":"2023-11-04T01:37:42.775130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774890+0000","last_change":"2023-11-04T01:37:41.730504+0000","last_active":"2023-11-04T01:37:42.774890+0000","last_peered":"2023-11-04T01:37:42.774890+0000","last_clean":"2023-11-04T01:37:42.774890+0000","last_became_active":"2023-11-04T01:37:41.730246+0000","last_became_peered":"2023-11-04T01:37:41.730246+0000","last_unstale":"2023-11-04T01:37:42.774890+0000","last_undegraded":"2023-11-04T01:37:42.774890+0000","last_fullsized":"2023-11-04T01:37:42.774890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774846+0000","last_change":"2023-11-04T01:37:41.734311+0000","last_active":"2023-11-04T01:37:42.774846+0000","last_peered":"2023-11-04T01:37:42.774846+0000","last_clean":"2023-11-04T01:37:42.774846+0000","last_became_active":"2023-11-04T01:37:41.734033+0000","last_became_peered":"2023-11-04T01:37:41.734033+0000","last_unstale":"2023-11-04T01:37:42.774846+0000","last_undegraded":"2023-11-04T01:37:42.774846+0000","last_fullsized":"2023-11-04T01:37:42.774846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775812+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.775812+0000","last_peered":"2023-11-04T01:37:42.775812+0000","last_clean":"2023-11-04T01:37:42.775812+0000","last_became_active":"2023-11-04T01:37:41.740374+0000","last_became_peered":"2023-11-04T01:37:41.740374+0000","last_unstale":"2023-11-04T01:37:42.775812+0000","last_undegraded":"2023-11-04T01:37:42.775812+0000","last_fullsized":"2023-11-04T01:37:42.775812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:50.653572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725334+0000","last_change":"2023-11-04T01:37:41.736475+0000","last_active":"2023-11-04T01:37:42.725334+0000","last_peered":"2023-11-04T01:37:42.725334+0000","last_clean":"2023-11-04T01:37:42.725334+0000","last_became_active":"2023-11-04T01:37:41.736160+0000","last_became_peered":"2023-11-04T01:37:41.736160+0000","last_unstale":"2023-11-04T01:37:42.725334+0000","last_undegraded":"2023-11-04T01:37:42.725334+0000","last_fullsized":"2023-11-04T01:37:42.725334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774692+0000","last_change":"2023-11-04T01:37:41.743289+0000","last_active":"2023-11-04T01:37:42.774692+0000","last_peered":"2023-11-04T01:37:42.774692+0000","last_clean":"2023-11-04T01:37:42.774692+0000","last_became_active":"2023-11-04T01:37:41.743037+0000","last_became_peered":"2023-11-04T01:37:41.743037+0000","last_unstale":"2023-11-04T01:37:42.774692+0000","last_undegraded":"2023-11-04T01:37:42.774692+0000","last_fullsized":"2023-11-04T01:37:42.774692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:22.226162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775874+0000","last_change":"2023-11-04T01:37:41.745593+0000","last_active":"2023-11-04T01:37:42.775874+0000","last_peered":"2023-11-04T01:37:42.775874+0000","last_clean":"2023-11-04T01:37:42.775874+0000","last_became_active":"2023-11-04T01:37:41.745287+0000","last_became_peered":"2023-11-04T01:37:41.745287+0000","last_unstale":"2023-11-04T01:37:42.775874+0000","last_undegraded":"2023-11-04T01:37:42.775874+0000","last_fullsized":"2023-11-04T01:37:42.775874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:44.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724097+0000","last_change":"2023-11-04T01:37:41.736933+0000","last_active":"2023-11-04T01:37:42.724097+0000","last_peered":"2023-11-04T01:37:42.724097+0000","last_clean":"2023-11-04T01:37:42.724097+0000","last_became_active":"2023-11-04T01:37:41.736665+0000","last_became_peered":"2023-11-04T01:37:41.736665+0000","last_unstale":"2023-11-04T01:37:42.724097+0000","last_undegraded":"2023-11-04T01:37:42.724097+0000","last_fullsized":"2023-11-04T01:37:42.724097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:16.408827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774452+0000","last_change":"2023-11-04T01:37:41.740885+0000","last_active":"2023-11-04T01:37:42.774452+0000","last_peered":"2023-11-04T01:37:42.774452+0000","last_clean":"2023-11-04T01:37:42.774452+0000","last_became_active":"2023-11-04T01:37:41.740616+0000","last_became_peered":"2023-11-04T01:37:41.740616+0000","last_unstale":"2023-11-04T01:37:42.774452+0000","last_undegraded":"2023-11-04T01:37:42.774452+0000","last_fullsized":"2023-11-04T01:37:42.774452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:27.908510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724454+0000","last_change":"2023-11-04T01:37:41.738833+0000","last_active":"2023-11-04T01:37:42.724454+0000","last_peered":"2023-11-04T01:37:42.724454+0000","last_clean":"2023-11-04T01:37:42.724454+0000","last_became_active":"2023-11-04T01:37:41.738228+0000","last_became_peered":"2023-11-04T01:37:41.738228+0000","last_unstale":"2023-11-04T01:37:42.724454+0000","last_undegraded":"2023-11-04T01:37:42.724454+0000","last_fullsized":"2023-11-04T01:37:42.724454+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774617+0000","last_change":"2023-11-04T01:37:41.739216+0000","last_active":"2023-11-04T01:37:42.774617+0000","last_peered":"2023-11-04T01:37:42.774617+0000","last_clean":"2023-11-04T01:37:42.774617+0000","last_became_active":"2023-11-04T01:37:41.738936+0000","last_became_peered":"2023-11-04T01:37:41.738936+0000","last_unstale":"2023-11-04T01:37:42.774617+0000","last_undegraded":"2023-11-04T01:37:42.774617+0000","last_fullsized":"2023-11-04T01:37:42.774617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:47.340021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774762+0000","last_change":"2023-11-04T01:37:41.737112+0000","last_active":"2023-11-04T01:37:42.774762+0000","last_peered":"2023-11-04T01:37:42.774762+0000","last_clean":"2023-11-04T01:37:42.774762+0000","last_became_active":"2023-11-04T01:37:41.736367+0000","last_became_peered":"2023-11-04T01:37:41.736367+0000","last_unstale":"2023-11-04T01:37:42.774762+0000","last_undegraded":"2023-11-04T01:37:42.774762+0000","last_fullsized":"2023-11-04T01:37:42.774762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:44.241121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725006+0000","last_change":"2023-11-04T01:37:41.734429+0000","last_active":"2023-11-04T01:37:42.725006+0000","last_peered":"2023-11-04T01:37:42.725006+0000","last_clean":"2023-11-04T01:37:42.725006+0000","last_became_active":"2023-11-04T01:37:41.734119+0000","last_became_peered":"2023-11-04T01:37:41.734119+0000","last_unstale":"2023-11-04T01:37:42.725006+0000","last_undegraded":"2023-11-04T01:37:42.725006+0000","last_fullsized":"2023-11-04T01:37:42.725006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775451+0000","last_change":"2023-11-04T01:37:41.733926+0000","last_active":"2023-11-04T01:37:42.775451+0000","last_peered":"2023-11-04T01:37:42.775451+0000","last_clean":"2023-11-04T01:37:42.775451+0000","last_became_active":"2023-11-04T01:37:41.733669+0000","last_became_peered":"2023-11-04T01:37:41.733669+0000","last_unstale":"2023-11-04T01:37:42.775451+0000","last_undegraded":"2023-11-04T01:37:42.775451+0000","last_fullsized":"2023-11-04T01:37:42.775451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775024+0000","last_change":"2023-11-04T01:37:41.731513+0000","last_active":"2023-11-04T01:37:42.775024+0000","last_peered":"2023-11-04T01:37:42.775024+0000","last_clean":"2023-11-04T01:37:42.775024+0000","last_became_active":"2023-11-04T01:37:41.731250+0000","last_became_peered":"2023-11-04T01:37:41.731250+0000","last_unstale":"2023-11-04T01:37:42.775024+0000","last_undegraded":"2023-11-04T01:37:42.775024+0000","last_fullsized":"2023-11-04T01:37:42.775024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:07.463931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775834+0000","last_change":"2023-11-04T01:37:41.738065+0000","last_active":"2023-11-04T01:37:42.775834+0000","last_peered":"2023-11-04T01:37:42.775834+0000","last_clean":"2023-11-04T01:37:42.775834+0000","last_became_active":"2023-11-04T01:37:41.737822+0000","last_became_peered":"2023-11-04T01:37:41.737822+0000","last_unstale":"2023-11-04T01:37:42.775834+0000","last_undegraded":"2023-11-04T01:37:42.775834+0000","last_fullsized":"2023-11-04T01:37:42.775834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:51.662220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724161+0000","last_change":"2023-11-04T01:37:41.731426+0000","last_active":"2023-11-04T01:37:42.724161+0000","last_peered":"2023-11-04T01:37:42.724161+0000","last_clean":"2023-11-04T01:37:42.724161+0000","last_became_active":"2023-11-04T01:37:41.731069+0000","last_became_peered":"2023-11-04T01:37:41.731069+0000","last_unstale":"2023-11-04T01:37:42.724161+0000","last_undegraded":"2023-11-04T01:37:42.724161+0000","last_fullsized":"2023-11-04T01:37:42.724161+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:41.036435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774559+0000","last_change":"2023-11-04T01:37:41.735428+0000","last_active":"2023-11-04T01:37:42.774559+0000","last_peered":"2023-11-04T01:37:42.774559+0000","last_clean":"2023-11-04T01:37:42.774559+0000","last_became_active":"2023-11-04T01:37:41.735191+0000","last_became_peered":"2023-11-04T01:37:41.735191+0000","last_unstale":"2023-11-04T01:37:42.774559+0000","last_undegraded":"2023-11-04T01:37:42.774559+0000","last_fullsized":"2023-11-04T01:37:42.774559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:05:09.029109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774727+0000","last_change":"2023-11-04T01:37:41.733806+0000","last_active":"2023-11-04T01:37:42.774727+0000","last_peered":"2023-11-04T01:37:42.774727+0000","last_clean":"2023-11-04T01:37:42.774727+0000","last_became_active":"2023-11-04T01:37:41.733493+0000","last_became_peered":"2023-11-04T01:37:41.733493+0000","last_unstale":"2023-11-04T01:37:42.774727+0000","last_undegraded":"2023-11-04T01:37:42.774727+0000","last_fullsized":"2023-11-04T01:37:42.774727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724230+0000","last_change":"2023-11-04T01:37:41.733345+0000","last_active":"2023-11-04T01:37:42.724230+0000","last_peered":"2023-11-04T01:37:42.724230+0000","last_clean":"2023-11-04T01:37:42.724230+0000","last_became_active":"2023-11-04T01:37:41.732815+0000","last_became_peered":"2023-11-04T01:37:41.732815+0000","last_unstale":"2023-11-04T01:37:42.724230+0000","last_undegraded":"2023-11-04T01:37:42.724230+0000","last_fullsized":"2023-11-04T01:37:42.724230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:59.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774805+0000","last_change":"2023-11-04T01:37:40.716577+0000","last_active":"2023-11-04T01:37:42.774805+0000","last_peered":"2023-11-04T01:37:42.774805+0000","last_clean":"2023-11-04T01:37:42.774805+0000","last_became_active":"2023-11-04T01:37:40.716326+0000","last_became_peered":"2023-11-04T01:37:40.716326+0000","last_unstale":"2023-11-04T01:37:42.774805+0000","last_undegraded":"2023-11-04T01:37:42.774805+0000","last_fullsized":"2023-11-04T01:37:42.774805+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:51.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717410+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:37:41.717410+0000","last_peered":"2023-11-04T01:37:41.717410+0000","last_clean":"2023-11-04T01:37:41.717410+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:37:41.717410+0000","last_undegraded":"2023-11-04T01:37:41.717410+0000","last_fullsized":"2023-11-04T01:37:41.717410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723916+0000","last_change":"2023-11-04T01:37:41.740877+0000","last_active":"2023-11-04T01:37:42.723916+0000","last_peered":"2023-11-04T01:37:42.723916+0000","last_clean":"2023-11-04T01:37:42.723916+0000","last_became_active":"2023-11-04T01:37:41.740615+0000","last_became_peered":"2023-11-04T01:37:41.740615+0000","last_unstale":"2023-11-04T01:37:42.723916+0000","last_undegraded":"2023-11-04T01:37:42.723916+0000","last_fullsized":"2023-11-04T01:37:42.723916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775635+0000","last_change":"2023-11-04T01:37:40.721750+0000","last_active":"2023-11-04T01:37:42.775635+0000","last_peered":"2023-11-04T01:37:42.775635+0000","last_clean":"2023-11-04T01:37:42.775635+0000","last_became_active":"2023-11-04T01:37:40.721397+0000","last_became_peered":"2023-11-04T01:37:40.721397+0000","last_unstale":"2023-11-04T01:37:42.775635+0000","last_undegraded":"2023-11-04T01:37:42.775635+0000","last_fullsized":"2023-11-04T01:37:42.775635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:07.237728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727913+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:37:41.727913+0000","last_peered":"2023-11-04T01:37:41.727913+0000","last_clean":"2023-11-04T01:37:41.727913+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:37:41.727913+0000","last_undegraded":"2023-11-04T01:37:41.727913+0000","last_fullsized":"2023-11-04T01:37:41.727913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724604+0000","last_change":"2023-11-04T01:37:41.737701+0000","last_active":"2023-11-04T01:37:42.724604+0000","last_peered":"2023-11-04T01:37:42.724604+0000","last_clean":"2023-11-04T01:37:42.724604+0000","last_became_active":"2023-11-04T01:37:41.736021+0000","last_became_peered":"2023-11-04T01:37:41.736021+0000","last_unstale":"2023-11-04T01:37:42.724604+0000","last_undegraded":"2023-11-04T01:37:42.724604+0000","last_fullsized":"2023-11-04T01:37:42.724604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723814+0000","last_change":"2023-11-04T01:37:40.718760+0000","last_active":"2023-11-04T01:37:42.723814+0000","last_peered":"2023-11-04T01:37:42.723814+0000","last_clean":"2023-11-04T01:37:42.723814+0000","last_became_active":"2023-11-04T01:37:40.718466+0000","last_became_peered":"2023-11-04T01:37:40.718466+0000","last_unstale":"2023-11-04T01:37:42.723814+0000","last_undegraded":"2023-11-04T01:37:42.723814+0000","last_fullsized":"2023-11-04T01:37:42.723814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728518+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:37:41.728518+0000","last_peered":"2023-11-04T01:37:41.728518+0000","last_clean":"2023-11-04T01:37:41.728518+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:37:41.728518+0000","last_undegraded":"2023-11-04T01:37:41.728518+0000","last_fullsized":"2023-11-04T01:37:41.728518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775362+0000","last_change":"2023-11-04T01:37:41.737582+0000","last_active":"2023-11-04T01:37:42.775362+0000","last_peered":"2023-11-04T01:37:42.775362+0000","last_clean":"2023-11-04T01:37:42.775362+0000","last_became_active":"2023-11-04T01:37:41.737076+0000","last_became_peered":"2023-11-04T01:37:41.737076+0000","last_unstale":"2023-11-04T01:37:42.775362+0000","last_undegraded":"2023-11-04T01:37:42.775362+0000","last_fullsized":"2023-11-04T01:37:42.775362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724776+0000","last_change":"2023-11-04T01:37:40.716846+0000","last_active":"2023-11-04T01:37:42.724776+0000","last_peered":"2023-11-04T01:37:42.724776+0000","last_clean":"2023-11-04T01:37:42.724776+0000","last_became_active":"2023-11-04T01:37:40.716588+0000","last_became_peered":"2023-11-04T01:37:40.716588+0000","last_unstale":"2023-11-04T01:37:42.724776+0000","last_undegraded":"2023-11-04T01:37:42.724776+0000","last_fullsized":"2023-11-04T01:37:42.724776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717017+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:37:41.717017+0000","last_peered":"2023-11-04T01:37:41.717017+0000","last_clean":"2023-11-04T01:37:41.717017+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:37:41.717017+0000","last_undegraded":"2023-11-04T01:37:41.717017+0000","last_fullsized":"2023-11-04T01:37:41.717017+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724829+0000","last_change":"2023-11-04T01:37:41.730410+0000","last_active":"2023-11-04T01:37:42.724829+0000","last_peered":"2023-11-04T01:37:42.724829+0000","last_clean":"2023-11-04T01:37:42.724829+0000","last_became_active":"2023-11-04T01:37:41.729963+0000","last_became_peered":"2023-11-04T01:37:41.729963+0000","last_unstale":"2023-11-04T01:37:42.724829+0000","last_undegraded":"2023-11-04T01:37:42.724829+0000","last_fullsized":"2023-11-04T01:37:42.724829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775817+0000","last_change":"2023-11-04T01:37:40.722525+0000","last_active":"2023-11-04T01:37:42.775817+0000","last_peered":"2023-11-04T01:37:42.775817+0000","last_clean":"2023-11-04T01:37:42.775817+0000","last_became_active":"2023-11-04T01:37:40.722295+0000","last_became_peered":"2023-11-04T01:37:40.722295+0000","last_unstale":"2023-11-04T01:37:42.775817+0000","last_undegraded":"2023-11-04T01:37:42.775817+0000","last_fullsized":"2023-11-04T01:37:42.775817+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:12.752146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728156+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:37:41.728156+0000","last_peered":"2023-11-04T01:37:41.728156+0000","last_clean":"2023-11-04T01:37:41.728156+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:37:41.728156+0000","last_undegraded":"2023-11-04T01:37:41.728156+0000","last_fullsized":"2023-11-04T01:37:41.728156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775290+0000","last_change":"2023-11-04T01:37:41.730844+0000","last_active":"2023-11-04T01:37:42.775290+0000","last_peered":"2023-11-04T01:37:42.775290+0000","last_clean":"2023-11-04T01:37:42.775290+0000","last_became_active":"2023-11-04T01:37:41.730579+0000","last_became_peered":"2023-11-04T01:37:41.730579+0000","last_unstale":"2023-11-04T01:37:42.775290+0000","last_undegraded":"2023-11-04T01:37:42.775290+0000","last_fullsized":"2023-11-04T01:37:42.775290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724915+0000","last_change":"2023-11-04T01:37:40.724705+0000","last_active":"2023-11-04T01:37:42.724915+0000","last_peered":"2023-11-04T01:37:42.724915+0000","last_clean":"2023-11-04T01:37:42.724915+0000","last_became_active":"2023-11-04T01:37:40.724498+0000","last_became_peered":"2023-11-04T01:37:40.724498+0000","last_unstale":"2023-11-04T01:37:42.724915+0000","last_undegraded":"2023-11-04T01:37:42.724915+0000","last_fullsized":"2023-11-04T01:37:42.724915+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:06.972960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720435+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:37:41.720435+0000","last_peered":"2023-11-04T01:37:41.720435+0000","last_clean":"2023-11-04T01:37:41.720435+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:37:41.720435+0000","last_undegraded":"2023-11-04T01:37:41.720435+0000","last_fullsized":"2023-11-04T01:37:41.720435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725329+0000","last_change":"2023-11-04T01:37:41.737099+0000","last_active":"2023-11-04T01:37:42.725329+0000","last_peered":"2023-11-04T01:37:42.725329+0000","last_clean":"2023-11-04T01:37:42.725329+0000","last_became_active":"2023-11-04T01:37:41.736643+0000","last_became_peered":"2023-11-04T01:37:41.736643+0000","last_unstale":"2023-11-04T01:37:42.725329+0000","last_undegraded":"2023-11-04T01:37:42.725329+0000","last_fullsized":"2023-11-04T01:37:42.725329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775388+0000","last_change":"2023-11-04T01:37:40.723502+0000","last_active":"2023-11-04T01:37:42.775388+0000","last_peered":"2023-11-04T01:37:42.775388+0000","last_clean":"2023-11-04T01:37:42.775388+0000","last_became_active":"2023-11-04T01:37:40.723256+0000","last_became_peered":"2023-11-04T01:37:40.723256+0000","last_unstale":"2023-11-04T01:37:42.775388+0000","last_undegraded":"2023-11-04T01:37:42.775388+0000","last_fullsized":"2023-11-04T01:37:42.775388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:55.289904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720058+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:37:41.720058+0000","last_peered":"2023-11-04T01:37:41.720058+0000","last_clean":"2023-11-04T01:37:41.720058+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:37:41.720058+0000","last_undegraded":"2023-11-04T01:37:41.720058+0000","last_fullsized":"2023-11-04T01:37:41.720058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718305+0000","last_change":"2023-11-04T01:37:41.726825+0000","last_active":"2023-11-04T01:37:42.718305+0000","last_peered":"2023-11-04T01:37:42.718305+0000","last_clean":"2023-11-04T01:37:42.718305+0000","last_became_active":"2023-11-04T01:37:41.726578+0000","last_became_peered":"2023-11-04T01:37:41.726578+0000","last_unstale":"2023-11-04T01:37:42.718305+0000","last_undegraded":"2023-11-04T01:37:42.718305+0000","last_fullsized":"2023-11-04T01:37:42.718305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725108+0000","last_change":"2023-11-04T01:37:40.722814+0000","last_active":"2023-11-04T01:37:42.725108+0000","last_peered":"2023-11-04T01:37:42.725108+0000","last_clean":"2023-11-04T01:37:42.725108+0000","last_became_active":"2023-11-04T01:37:40.722574+0000","last_became_peered":"2023-11-04T01:37:40.722574+0000","last_unstale":"2023-11-04T01:37:42.725108+0000","last_undegraded":"2023-11-04T01:37:42.725108+0000","last_fullsized":"2023-11-04T01:37:42.725108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:38:32.195159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720807+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:37:41.720807+0000","last_peered":"2023-11-04T01:37:41.720807+0000","last_clean":"2023-11-04T01:37:41.720807+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:37:41.720807+0000","last_undegraded":"2023-11-04T01:37:41.720807+0000","last_fullsized":"2023-11-04T01:37:41.720807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775649+0000","last_change":"2023-11-04T01:37:41.744612+0000","last_active":"2023-11-04T01:37:42.775649+0000","last_peered":"2023-11-04T01:37:42.775649+0000","last_clean":"2023-11-04T01:37:42.775649+0000","last_became_active":"2023-11-04T01:37:41.744358+0000","last_became_peered":"2023-11-04T01:37:41.744358+0000","last_unstale":"2023-11-04T01:37:42.775649+0000","last_undegraded":"2023-11-04T01:37:42.775649+0000","last_fullsized":"2023-11-04T01:37:42.775649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:31.384440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775021+0000","last_change":"2023-11-04T01:37:40.717411+0000","last_active":"2023-11-04T01:37:42.775021+0000","last_peered":"2023-11-04T01:37:42.775021+0000","last_clean":"2023-11-04T01:37:42.775021+0000","last_became_active":"2023-11-04T01:37:40.717151+0000","last_became_peered":"2023-11-04T01:37:40.717151+0000","last_unstale":"2023-11-04T01:37:42.775021+0000","last_undegraded":"2023-11-04T01:37:42.775021+0000","last_fullsized":"2023-11-04T01:37:42.775021+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722024+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:37:41.722024+0000","last_peered":"2023-11-04T01:37:41.722024+0000","last_clean":"2023-11-04T01:37:41.722024+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:37:41.722024+0000","last_undegraded":"2023-11-04T01:37:41.722024+0000","last_fullsized":"2023-11-04T01:37:41.722024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775563+0000","last_change":"2023-11-04T01:37:41.740907+0000","last_active":"2023-11-04T01:37:42.775563+0000","last_peered":"2023-11-04T01:37:42.775563+0000","last_clean":"2023-11-04T01:37:42.775563+0000","last_became_active":"2023-11-04T01:37:41.740260+0000","last_became_peered":"2023-11-04T01:37:41.740260+0000","last_unstale":"2023-11-04T01:37:42.775563+0000","last_undegraded":"2023-11-04T01:37:42.775563+0000","last_fullsized":"2023-11-04T01:37:42.775563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:59.311487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775239+0000","last_change":"2023-11-04T01:37:40.720151+0000","last_active":"2023-11-04T01:37:42.775239+0000","last_peered":"2023-11-04T01:37:42.775239+0000","last_clean":"2023-11-04T01:37:42.775239+0000","last_became_active":"2023-11-04T01:37:40.719886+0000","last_became_peered":"2023-11-04T01:37:40.719886+0000","last_unstale":"2023-11-04T01:37:42.775239+0000","last_undegraded":"2023-11-04T01:37:42.775239+0000","last_fullsized":"2023-11-04T01:37:42.775239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.736575+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:37:41.736575+0000","last_peered":"2023-11-04T01:37:41.736575+0000","last_clean":"2023-11-04T01:37:41.736575+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:37:41.736575+0000","last_undegraded":"2023-11-04T01:37:41.736575+0000","last_fullsized":"2023-11-04T01:37:41.736575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.735013+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.734725+0000","last_became_peered":"2023-11-04T01:37:41.734725+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:24:38.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775180+0000","last_change":"2023-11-04T01:37:40.715916+0000","last_active":"2023-11-04T01:37:42.775180+0000","last_peered":"2023-11-04T01:37:42.775180+0000","last_clean":"2023-11-04T01:37:42.775180+0000","last_became_active":"2023-11-04T01:37:40.715674+0000","last_became_peered":"2023-11-04T01:37:40.715674+0000","last_unstale":"2023-11-04T01:37:42.775180+0000","last_undegraded":"2023-11-04T01:37:42.775180+0000","last_fullsized":"2023-11-04T01:37:42.775180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:29.538943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722256+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:37:41.722256+0000","last_peered":"2023-11-04T01:37:41.722256+0000","last_clean":"2023-11-04T01:37:41.722256+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:37:41.722256+0000","last_undegraded":"2023-11-04T01:37:41.722256+0000","last_fullsized":"2023-11-04T01:37:41.722256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774706+0000","last_change":"2023-11-04T01:37:41.739459+0000","last_active":"2023-11-04T01:37:42.774706+0000","last_peered":"2023-11-04T01:37:42.774706+0000","last_clean":"2023-11-04T01:37:42.774706+0000","last_became_active":"2023-11-04T01:37:41.738951+0000","last_became_peered":"2023-11-04T01:37:41.738951+0000","last_unstale":"2023-11-04T01:37:42.774706+0000","last_undegraded":"2023-11-04T01:37:42.774706+0000","last_fullsized":"2023-11-04T01:37:42.774706+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:19.507645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724689+0000","last_change":"2023-11-04T01:37:40.718656+0000","last_active":"2023-11-04T01:37:42.724689+0000","last_peered":"2023-11-04T01:37:42.724689+0000","last_clean":"2023-11-04T01:37:42.724689+0000","last_became_active":"2023-11-04T01:37:40.718417+0000","last_became_peered":"2023-11-04T01:37:40.718417+0000","last_unstale":"2023-11-04T01:37:42.724689+0000","last_undegraded":"2023-11-04T01:37:42.724689+0000","last_fullsized":"2023-11-04T01:37:42.724689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723715+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:37:41.723715+0000","last_peered":"2023-11-04T01:37:41.723715+0000","last_clean":"2023-11-04T01:37:41.723715+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:37:41.723715+0000","last_undegraded":"2023-11-04T01:37:41.723715+0000","last_fullsized":"2023-11-04T01:37:41.723715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718472+0000","last_change":"2023-11-04T01:37:41.725262+0000","last_active":"2023-11-04T01:37:42.718472+0000","last_peered":"2023-11-04T01:37:42.718472+0000","last_clean":"2023-11-04T01:37:42.718472+0000","last_became_active":"2023-11-04T01:37:41.725012+0000","last_became_peered":"2023-11-04T01:37:41.725012+0000","last_unstale":"2023-11-04T01:37:42.718472+0000","last_undegraded":"2023-11-04T01:37:42.718472+0000","last_fullsized":"2023-11-04T01:37:42.718472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775772+0000","last_change":"2023-11-04T01:37:40.712958+0000","last_active":"2023-11-04T01:37:42.775772+0000","last_peered":"2023-11-04T01:37:42.775772+0000","last_clean":"2023-11-04T01:37:42.775772+0000","last_became_active":"2023-11-04T01:37:40.712701+0000","last_became_peered":"2023-11-04T01:37:40.712701+0000","last_unstale":"2023-11-04T01:37:42.775772+0000","last_undegraded":"2023-11-04T01:37:42.775772+0000","last_fullsized":"2023-11-04T01:37:42.775772+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:41.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.724545+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:37:41.724545+0000","last_peered":"2023-11-04T01:37:41.724545+0000","last_clean":"2023-11-04T01:37:41.724545+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:37:41.724545+0000","last_undegraded":"2023-11-04T01:37:41.724545+0000","last_fullsized":"2023-11-04T01:37:41.724545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775317+0000","last_change":"2023-11-04T01:37:41.738188+0000","last_active":"2023-11-04T01:37:42.775317+0000","last_peered":"2023-11-04T01:37:42.775317+0000","last_clean":"2023-11-04T01:37:42.775317+0000","last_became_active":"2023-11-04T01:37:41.737940+0000","last_became_peered":"2023-11-04T01:37:41.737940+0000","last_unstale":"2023-11-04T01:37:42.775317+0000","last_undegraded":"2023-11-04T01:37:42.775317+0000","last_fullsized":"2023-11-04T01:37:42.775317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774924+0000","last_change":"2023-11-04T01:37:40.720157+0000","last_active":"2023-11-04T01:37:42.774924+0000","last_peered":"2023-11-04T01:37:42.774924+0000","last_clean":"2023-11-04T01:37:42.774924+0000","last_became_active":"2023-11-04T01:37:40.719881+0000","last_became_peered":"2023-11-04T01:37:40.719881+0000","last_unstale":"2023-11-04T01:37:42.774924+0000","last_undegraded":"2023-11-04T01:37:42.774924+0000","last_fullsized":"2023-11-04T01:37:42.774924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:07:40.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729385+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:37:41.729385+0000","last_peered":"2023-11-04T01:37:41.729385+0000","last_clean":"2023-11-04T01:37:41.729385+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:37:41.729385+0000","last_undegraded":"2023-11-04T01:37:41.729385+0000","last_fullsized":"2023-11-04T01:37:41.729385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.731662+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.731410+0000","last_became_peered":"2023-11-04T01:37:41.731410+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724373+0000","last_change":"2023-11-04T01:37:40.721013+0000","last_active":"2023-11-04T01:37:42.724373+0000","last_peered":"2023-11-04T01:37:42.724373+0000","last_clean":"2023-11-04T01:37:42.724373+0000","last_became_active":"2023-11-04T01:37:40.720505+0000","last_became_peered":"2023-11-04T01:37:40.720505+0000","last_unstale":"2023-11-04T01:37:42.724373+0000","last_undegraded":"2023-11-04T01:37:42.724373+0000","last_fullsized":"2023-11-04T01:37:42.724373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:20.590973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720137+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:37:41.720137+0000","last_peered":"2023-11-04T01:37:41.720137+0000","last_clean":"2023-11-04T01:37:41.720137+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:37:41.720137+0000","last_undegraded":"2023-11-04T01:37:41.720137+0000","last_fullsized":"2023-11-04T01:37:41.720137+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775495+0000","last_change":"2023-11-04T01:37:41.721425+0000","last_active":"2023-11-04T01:37:42.775495+0000","last_peered":"2023-11-04T01:37:42.775495+0000","last_clean":"2023-11-04T01:37:42.775495+0000","last_became_active":"2023-11-04T01:37:41.721145+0000","last_became_peered":"2023-11-04T01:37:41.721145+0000","last_unstale":"2023-11-04T01:37:42.775495+0000","last_undegraded":"2023-11-04T01:37:42.775495+0000","last_fullsized":"2023-11-04T01:37:42.775495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775437+0000","last_change":"2023-11-04T01:37:40.723770+0000","last_active":"2023-11-04T01:37:42.775437+0000","last_peered":"2023-11-04T01:37:42.775437+0000","last_clean":"2023-11-04T01:37:42.775437+0000","last_became_active":"2023-11-04T01:37:40.723481+0000","last_became_peered":"2023-11-04T01:37:40.723481+0000","last_unstale":"2023-11-04T01:37:42.775437+0000","last_undegraded":"2023-11-04T01:37:42.775437+0000","last_fullsized":"2023-11-04T01:37:42.775437+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728097+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:37:41.728097+0000","last_peered":"2023-11-04T01:37:41.728097+0000","last_clean":"2023-11-04T01:37:41.728097+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:37:41.728097+0000","last_undegraded":"2023-11-04T01:37:41.728097+0000","last_fullsized":"2023-11-04T01:37:41.728097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724308+0000","last_change":"2023-11-04T01:37:41.737253+0000","last_active":"2023-11-04T01:37:42.724308+0000","last_peered":"2023-11-04T01:37:42.724308+0000","last_clean":"2023-11-04T01:37:42.724308+0000","last_became_active":"2023-11-04T01:37:41.736156+0000","last_became_peered":"2023-11-04T01:37:41.736156+0000","last_unstale":"2023-11-04T01:37:42.724308+0000","last_undegraded":"2023-11-04T01:37:42.724308+0000","last_fullsized":"2023-11-04T01:37:42.724308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:57.077859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775093+0000","last_change":"2023-11-04T01:37:40.723713+0000","last_active":"2023-11-04T01:37:42.775093+0000","last_peered":"2023-11-04T01:37:42.775093+0000","last_clean":"2023-11-04T01:37:42.775093+0000","last_became_active":"2023-11-04T01:37:40.723495+0000","last_became_peered":"2023-11-04T01:37:40.723495+0000","last_unstale":"2023-11-04T01:37:42.775093+0000","last_undegraded":"2023-11-04T01:37:42.775093+0000","last_fullsized":"2023-11-04T01:37:42.775093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:46.335518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728628+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:37:41.728628+0000","last_peered":"2023-11-04T01:37:41.728628+0000","last_clean":"2023-11-04T01:37:41.728628+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:37:41.728628+0000","last_undegraded":"2023-11-04T01:37:41.728628+0000","last_fullsized":"2023-11-04T01:37:41.728628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775927+0000","last_change":"2023-11-04T01:37:41.744489+0000","last_active":"2023-11-04T01:37:42.775927+0000","last_peered":"2023-11-04T01:37:42.775927+0000","last_clean":"2023-11-04T01:37:42.775927+0000","last_became_active":"2023-11-04T01:37:41.744234+0000","last_became_peered":"2023-11-04T01:37:41.744234+0000","last_unstale":"2023-11-04T01:37:42.775927+0000","last_undegraded":"2023-11-04T01:37:42.775927+0000","last_fullsized":"2023-11-04T01:37:42.775927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:49.180920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718124+0000","last_change":"2023-11-04T01:37:40.722082+0000","last_active":"2023-11-04T01:37:42.718124+0000","last_peered":"2023-11-04T01:37:42.718124+0000","last_clean":"2023-11-04T01:37:42.718124+0000","last_became_active":"2023-11-04T01:37:40.721801+0000","last_became_peered":"2023-11-04T01:37:40.721801+0000","last_unstale":"2023-11-04T01:37:42.718124+0000","last_undegraded":"2023-11-04T01:37:42.718124+0000","last_fullsized":"2023-11-04T01:37:42.718124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:25.067674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727701+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:37:41.727701+0000","last_peered":"2023-11-04T01:37:41.727701+0000","last_clean":"2023-11-04T01:37:41.727701+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:37:41.727701+0000","last_undegraded":"2023-11-04T01:37:41.727701+0000","last_fullsized":"2023-11-04T01:37:41.727701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.736774+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.736541+0000","last_became_peered":"2023-11-04T01:37:41.736541+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:39.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774436+0000","last_change":"2023-11-04T01:37:40.718660+0000","last_active":"2023-11-04T01:37:42.774436+0000","last_peered":"2023-11-04T01:37:42.774436+0000","last_clean":"2023-11-04T01:37:42.774436+0000","last_became_active":"2023-11-04T01:37:40.718172+0000","last_became_peered":"2023-11-04T01:37:40.718172+0000","last_unstale":"2023-11-04T01:37:42.774436+0000","last_undegraded":"2023-11-04T01:37:42.774436+0000","last_fullsized":"2023-11-04T01:37:42.774436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:23.612529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720523+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:37:41.720523+0000","last_peered":"2023-11-04T01:37:41.720523+0000","last_clean":"2023-11-04T01:37:41.720523+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:37:41.720523+0000","last_undegraded":"2023-11-04T01:37:41.720523+0000","last_fullsized":"2023-11-04T01:37:41.720523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718105+0000","last_change":"2023-11-04T01:37:41.733565+0000","last_active":"2023-11-04T01:37:42.718105+0000","last_peered":"2023-11-04T01:37:42.718105+0000","last_clean":"2023-11-04T01:37:42.718105+0000","last_became_active":"2023-11-04T01:37:41.733324+0000","last_became_peered":"2023-11-04T01:37:41.733324+0000","last_unstale":"2023-11-04T01:37:42.718105+0000","last_undegraded":"2023-11-04T01:37:42.718105+0000","last_fullsized":"2023-11-04T01:37:42.718105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718054+0000","last_change":"2023-11-04T01:37:40.717532+0000","last_active":"2023-11-04T01:37:42.718054+0000","last_peered":"2023-11-04T01:37:42.718054+0000","last_clean":"2023-11-04T01:37:42.718054+0000","last_became_active":"2023-11-04T01:37:40.717239+0000","last_became_peered":"2023-11-04T01:37:40.717239+0000","last_unstale":"2023-11-04T01:37:42.718054+0000","last_undegraded":"2023-11-04T01:37:42.718054+0000","last_fullsized":"2023-11-04T01:37:42.718054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:23.982905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726577+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:37:41.726577+0000","last_peered":"2023-11-04T01:37:41.726577+0000","last_clean":"2023-11-04T01:37:41.726577+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:37:41.726577+0000","last_undegraded":"2023-11-04T01:37:41.726577+0000","last_fullsized":"2023-11-04T01:37:41.726577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725502+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.725502+0000","last_peered":"2023-11-04T01:37:42.725502+0000","last_clean":"2023-11-04T01:37:42.725502+0000","last_became_active":"2023-11-04T01:37:41.740391+0000","last_became_peered":"2023-11-04T01:37:41.740391+0000","last_unstale":"2023-11-04T01:37:42.725502+0000","last_undegraded":"2023-11-04T01:37:42.725502+0000","last_fullsized":"2023-11-04T01:37:42.725502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775426+0000","last_change":"2023-11-04T01:37:40.715703+0000","last_active":"2023-11-04T01:37:42.775426+0000","last_peered":"2023-11-04T01:37:42.775426+0000","last_clean":"2023-11-04T01:37:42.775426+0000","last_became_active":"2023-11-04T01:37:40.715413+0000","last_became_peered":"2023-11-04T01:37:40.715413+0000","last_unstale":"2023-11-04T01:37:42.775426+0000","last_undegraded":"2023-11-04T01:37:42.775426+0000","last_fullsized":"2023-11-04T01:37:42.775426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.719877+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:37:41.719877+0000","last_peered":"2023-11-04T01:37:41.719877+0000","last_clean":"2023-11-04T01:37:41.719877+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:37:41.719877+0000","last_undegraded":"2023-11-04T01:37:41.719877+0000","last_fullsized":"2023-11-04T01:37:41.719877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725148+0000","last_change":"2023-11-04T01:37:41.741732+0000","last_active":"2023-11-04T01:37:42.725148+0000","last_peered":"2023-11-04T01:37:42.725148+0000","last_clean":"2023-11-04T01:37:42.725148+0000","last_became_active":"2023-11-04T01:37:41.741365+0000","last_became_peered":"2023-11-04T01:37:41.741365+0000","last_unstale":"2023-11-04T01:37:42.725148+0000","last_undegraded":"2023-11-04T01:37:42.725148+0000","last_fullsized":"2023-11-04T01:37:42.725148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718487+0000","last_change":"2023-11-04T01:37:40.711455+0000","last_active":"2023-11-04T01:37:42.718487+0000","last_peered":"2023-11-04T01:37:42.718487+0000","last_clean":"2023-11-04T01:37:42.718487+0000","last_became_active":"2023-11-04T01:37:40.711174+0000","last_became_peered":"2023-11-04T01:37:40.711174+0000","last_unstale":"2023-11-04T01:37:42.718487+0000","last_undegraded":"2023-11-04T01:37:42.718487+0000","last_fullsized":"2023-11-04T01:37:42.718487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726070+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:37:41.726070+0000","last_peered":"2023-11-04T01:37:41.726070+0000","last_clean":"2023-11-04T01:37:41.726070+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:37:41.726070+0000","last_undegraded":"2023-11-04T01:37:41.726070+0000","last_fullsized":"2023-11-04T01:37:41.726070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775357+0000","last_change":"2023-11-04T01:37:41.731096+0000","last_active":"2023-11-04T01:37:42.775357+0000","last_peered":"2023-11-04T01:37:42.775357+0000","last_clean":"2023-11-04T01:37:42.775357+0000","last_became_active":"2023-11-04T01:37:41.730821+0000","last_became_peered":"2023-11-04T01:37:41.730821+0000","last_unstale":"2023-11-04T01:37:42.775357+0000","last_undegraded":"2023-11-04T01:37:42.775357+0000","last_fullsized":"2023-11-04T01:37:42.775357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724453+0000","last_change":"2023-11-04T01:37:40.718691+0000","last_active":"2023-11-04T01:37:42.724453+0000","last_peered":"2023-11-04T01:37:42.724453+0000","last_clean":"2023-11-04T01:37:42.724453+0000","last_became_active":"2023-11-04T01:37:40.718437+0000","last_became_peered":"2023-11-04T01:37:40.718437+0000","last_unstale":"2023-11-04T01:37:42.724453+0000","last_undegraded":"2023-11-04T01:37:42.724453+0000","last_fullsized":"2023-11-04T01:37:42.724453+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.716777+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:37:41.716777+0000","last_peered":"2023-11-04T01:37:41.716777+0000","last_clean":"2023-11-04T01:37:41.716777+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:37:41.716777+0000","last_undegraded":"2023-11-04T01:37:41.716777+0000","last_fullsized":"2023-11-04T01:37:41.716777+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718460+0000","last_change":"2023-11-04T01:37:41.732320+0000","last_active":"2023-11-04T01:37:42.718460+0000","last_peered":"2023-11-04T01:37:42.718460+0000","last_clean":"2023-11-04T01:37:42.718460+0000","last_became_active":"2023-11-04T01:37:41.732070+0000","last_became_peered":"2023-11-04T01:37:41.732070+0000","last_unstale":"2023-11-04T01:37:42.718460+0000","last_undegraded":"2023-11-04T01:37:42.718460+0000","last_fullsized":"2023-11-04T01:37:42.718460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775464+0000","last_change":"2023-11-04T01:37:40.719241+0000","last_active":"2023-11-04T01:37:42.775464+0000","last_peered":"2023-11-04T01:37:42.775464+0000","last_clean":"2023-11-04T01:37:42.775464+0000","last_became_active":"2023-11-04T01:37:40.718976+0000","last_became_peered":"2023-11-04T01:37:40.718976+0000","last_unstale":"2023-11-04T01:37:42.775464+0000","last_undegraded":"2023-11-04T01:37:42.775464+0000","last_fullsized":"2023-11-04T01:37:42.775464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:13.045356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729935+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:37:41.729935+0000","last_peered":"2023-11-04T01:37:41.729935+0000","last_clean":"2023-11-04T01:37:41.729935+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:37:41.729935+0000","last_undegraded":"2023-11-04T01:37:41.729935+0000","last_fullsized":"2023-11-04T01:37:41.729935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.734683+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.734409+0000","last_became_peered":"2023-11-04T01:37:41.734409+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718236+0000","last_change":"2023-11-04T01:37:40.722816+0000","last_active":"2023-11-04T01:37:42.718236+0000","last_peered":"2023-11-04T01:37:42.718236+0000","last_clean":"2023-11-04T01:37:42.718236+0000","last_became_active":"2023-11-04T01:37:40.722545+0000","last_became_peered":"2023-11-04T01:37:40.722545+0000","last_unstale":"2023-11-04T01:37:42.718236+0000","last_undegraded":"2023-11-04T01:37:42.718236+0000","last_fullsized":"2023-11-04T01:37:42.718236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723429+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:37:41.723429+0000","last_peered":"2023-11-04T01:37:41.723429+0000","last_clean":"2023-11-04T01:37:41.723429+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:37:41.723429+0000","last_undegraded":"2023-11-04T01:37:41.723429+0000","last_fullsized":"2023-11-04T01:37:41.723429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724073+0000","last_change":"2023-11-04T01:37:41.740269+0000","last_active":"2023-11-04T01:37:42.724073+0000","last_peered":"2023-11-04T01:37:42.724073+0000","last_clean":"2023-11-04T01:37:42.724073+0000","last_became_active":"2023-11-04T01:37:41.740007+0000","last_became_peered":"2023-11-04T01:37:41.740007+0000","last_unstale":"2023-11-04T01:37:42.724073+0000","last_undegraded":"2023-11-04T01:37:42.724073+0000","last_fullsized":"2023-11-04T01:37:42.724073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775961+0000","last_change":"2023-11-04T01:37:40.719473+0000","last_active":"2023-11-04T01:37:42.775961+0000","last_peered":"2023-11-04T01:37:42.775961+0000","last_clean":"2023-11-04T01:37:42.775961+0000","last_became_active":"2023-11-04T01:37:40.719196+0000","last_became_peered":"2023-11-04T01:37:40.719196+0000","last_unstale":"2023-11-04T01:37:42.775961+0000","last_undegraded":"2023-11-04T01:37:42.775961+0000","last_fullsized":"2023-11-04T01:37:42.775961+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:13.458744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720006+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:37:41.720006+0000","last_peered":"2023-11-04T01:37:41.720006+0000","last_clean":"2023-11-04T01:37:41.720006+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:37:41.720006+0000","last_undegraded":"2023-11-04T01:37:41.720006+0000","last_fullsized":"2023-11-04T01:37:41.720006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774691+0000","last_change":"2023-11-04T01:37:41.737451+0000","last_active":"2023-11-04T01:37:42.774691+0000","last_peered":"2023-11-04T01:37:42.774691+0000","last_clean":"2023-11-04T01:37:42.774691+0000","last_became_active":"2023-11-04T01:37:41.737137+0000","last_became_peered":"2023-11-04T01:37:41.737137+0000","last_unstale":"2023-11-04T01:37:42.774691+0000","last_undegraded":"2023-11-04T01:37:42.774691+0000","last_fullsized":"2023-11-04T01:37:42.774691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724047+0000","last_change":"2023-11-04T01:37:40.721797+0000","last_active":"2023-11-04T01:37:42.724047+0000","last_peered":"2023-11-04T01:37:42.724047+0000","last_clean":"2023-11-04T01:37:42.724047+0000","last_became_active":"2023-11-04T01:37:40.721610+0000","last_became_peered":"2023-11-04T01:37:40.721610+0000","last_unstale":"2023-11-04T01:37:42.724047+0000","last_undegraded":"2023-11-04T01:37:42.724047+0000","last_fullsized":"2023-11-04T01:37:42.724047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728593+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:37:41.728593+0000","last_peered":"2023-11-04T01:37:41.728593+0000","last_clean":"2023-11-04T01:37:41.728593+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:37:41.728593+0000","last_undegraded":"2023-11-04T01:37:41.728593+0000","last_fullsized":"2023-11-04T01:37:41.728593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725422+0000","last_change":"2023-11-04T01:37:41.743494+0000","last_active":"2023-11-04T01:37:42.725422+0000","last_peered":"2023-11-04T01:37:42.725422+0000","last_clean":"2023-11-04T01:37:42.725422+0000","last_became_active":"2023-11-04T01:37:41.743202+0000","last_became_peered":"2023-11-04T01:37:41.743202+0000","last_unstale":"2023-11-04T01:37:42.725422+0000","last_undegraded":"2023-11-04T01:37:42.725422+0000","last_fullsized":"2023-11-04T01:37:42.725422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775311+0000","last_change":"2023-11-04T01:37:40.720430+0000","last_active":"2023-11-04T01:37:42.775311+0000","last_peered":"2023-11-04T01:37:42.775311+0000","last_clean":"2023-11-04T01:37:42.775311+0000","last_became_active":"2023-11-04T01:37:40.720147+0000","last_became_peered":"2023-11-04T01:37:40.720147+0000","last_unstale":"2023-11-04T01:37:42.775311+0000","last_undegraded":"2023-11-04T01:37:42.775311+0000","last_fullsized":"2023-11-04T01:37:42.775311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722621+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:37:41.722621+0000","last_peered":"2023-11-04T01:37:41.722621+0000","last_clean":"2023-11-04T01:37:41.722621+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:37:41.722621+0000","last_undegraded":"2023-11-04T01:37:41.722621+0000","last_fullsized":"2023-11-04T01:37:41.722621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725190+0000","last_change":"2023-11-04T01:37:41.736870+0000","last_active":"2023-11-04T01:37:42.725190+0000","last_peered":"2023-11-04T01:37:42.725190+0000","last_clean":"2023-11-04T01:37:42.725190+0000","last_became_active":"2023-11-04T01:37:41.736603+0000","last_became_peered":"2023-11-04T01:37:41.736603+0000","last_unstale":"2023-11-04T01:37:42.725190+0000","last_undegraded":"2023-11-04T01:37:42.725190+0000","last_fullsized":"2023-11-04T01:37:42.725190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775895+0000","last_change":"2023-11-04T01:37:40.723529+0000","last_active":"2023-11-04T01:37:42.775895+0000","last_peered":"2023-11-04T01:37:42.775895+0000","last_clean":"2023-11-04T01:37:42.775895+0000","last_became_active":"2023-11-04T01:37:40.723260+0000","last_became_peered":"2023-11-04T01:37:40.723260+0000","last_unstale":"2023-11-04T01:37:42.775895+0000","last_undegraded":"2023-11-04T01:37:42.775895+0000","last_fullsized":"2023-11-04T01:37:42.775895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:16.821204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729600+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:37:41.729600+0000","last_peered":"2023-11-04T01:37:41.729600+0000","last_clean":"2023-11-04T01:37:41.729600+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:37:41.729600+0000","last_undegraded":"2023-11-04T01:37:41.729600+0000","last_fullsized":"2023-11-04T01:37:41.729600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724985+0000","last_change":"2023-11-04T01:37:41.736914+0000","last_active":"2023-11-04T01:37:42.724985+0000","last_peered":"2023-11-04T01:37:42.724985+0000","last_clean":"2023-11-04T01:37:42.724985+0000","last_became_active":"2023-11-04T01:37:41.736343+0000","last_became_peered":"2023-11-04T01:37:41.736343+0000","last_unstale":"2023-11-04T01:37:42.724985+0000","last_undegraded":"2023-11-04T01:37:42.724985+0000","last_fullsized":"2023-11-04T01:37:42.724985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775473+0000","last_change":"2023-11-04T01:37:40.722000+0000","last_active":"2023-11-04T01:37:42.775473+0000","last_peered":"2023-11-04T01:37:42.775473+0000","last_clean":"2023-11-04T01:37:42.775473+0000","last_became_active":"2023-11-04T01:37:40.721730+0000","last_became_peered":"2023-11-04T01:37:40.721730+0000","last_unstale":"2023-11-04T01:37:42.775473+0000","last_undegraded":"2023-11-04T01:37:42.775473+0000","last_fullsized":"2023-11-04T01:37:42.775473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730251+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:37:41.730251+0000","last_peered":"2023-11-04T01:37:41.730251+0000","last_clean":"2023-11-04T01:37:41.730251+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:37:41.730251+0000","last_undegraded":"2023-11-04T01:37:41.730251+0000","last_fullsized":"2023-11-04T01:37:41.730251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775689+0000","last_change":"2023-11-04T01:37:41.747748+0000","last_active":"2023-11-04T01:37:42.775689+0000","last_peered":"2023-11-04T01:37:42.775689+0000","last_clean":"2023-11-04T01:37:42.775689+0000","last_became_active":"2023-11-04T01:37:41.745825+0000","last_became_peered":"2023-11-04T01:37:41.745825+0000","last_unstale":"2023-11-04T01:37:42.775689+0000","last_undegraded":"2023-11-04T01:37:42.775689+0000","last_fullsized":"2023-11-04T01:37:42.775689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:10.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724901+0000","last_change":"2023-11-04T01:37:40.716899+0000","last_active":"2023-11-04T01:37:42.724901+0000","last_peered":"2023-11-04T01:37:42.724901+0000","last_clean":"2023-11-04T01:37:42.724901+0000","last_became_active":"2023-11-04T01:37:40.716638+0000","last_became_peered":"2023-11-04T01:37:40.716638+0000","last_unstale":"2023-11-04T01:37:42.724901+0000","last_undegraded":"2023-11-04T01:37:42.724901+0000","last_fullsized":"2023-11-04T01:37:42.724901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:46.871803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730007+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:37:41.730007+0000","last_peered":"2023-11-04T01:37:41.730007+0000","last_clean":"2023-11-04T01:37:41.730007+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:37:41.730007+0000","last_undegraded":"2023-11-04T01:37:41.730007+0000","last_fullsized":"2023-11-04T01:37:41.730007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774463+0000","last_change":"2023-11-04T01:37:41.745270+0000","last_active":"2023-11-04T01:37:42.774463+0000","last_peered":"2023-11-04T01:37:42.774463+0000","last_clean":"2023-11-04T01:37:42.774463+0000","last_became_active":"2023-11-04T01:37:41.744977+0000","last_became_peered":"2023-11-04T01:37:41.744977+0000","last_unstale":"2023-11-04T01:37:42.774463+0000","last_undegraded":"2023-11-04T01:37:42.774463+0000","last_fullsized":"2023-11-04T01:37:42.774463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:12.659640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775117+0000","last_change":"2023-11-04T01:37:40.718777+0000","last_active":"2023-11-04T01:37:42.775117+0000","last_peered":"2023-11-04T01:37:42.775117+0000","last_clean":"2023-11-04T01:37:42.775117+0000","last_became_active":"2023-11-04T01:37:40.718533+0000","last_became_peered":"2023-11-04T01:37:40.718533+0000","last_unstale":"2023-11-04T01:37:42.775117+0000","last_undegraded":"2023-11-04T01:37:42.775117+0000","last_fullsized":"2023-11-04T01:37:42.775117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720646+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:37:41.720646+0000","last_peered":"2023-11-04T01:37:41.720646+0000","last_clean":"2023-11-04T01:37:41.720646+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:37:41.720646+0000","last_undegraded":"2023-11-04T01:37:41.720646+0000","last_fullsized":"2023-11-04T01:37:41.720646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723952+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:42.723952+0000","last_peered":"2023-11-04T01:37:42.723952+0000","last_clean":"2023-11-04T01:37:42.723952+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:42.723952+0000","last_undegraded":"2023-11-04T01:37:42.723952+0000","last_fullsized":"2023-11-04T01:37:42.723952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.502}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":291693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65100000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.62,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.499},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.752}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":294324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79500000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71199999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.133,"15min":1.133},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.71699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.36599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.316},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.38600000000000001,"5min":0.495,"15min":0.495},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40799999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47099999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.254}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78300000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.876,"15min":0.876},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73799999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.313}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1249280,"data_stored":884255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.316,"15min":0.32200000000000001},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.251},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.442,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.313}]},{"osd":2,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.36499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379}]},{"osd":4,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.048,"15min":1.048},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.874,"15min":0.874},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:46.991 INFO:tasks.ceph.mds.a.smithi093.stderr:2023-11-04T01:37:46.989+0000 7f866996f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:49.350 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:49.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.459+0000 7fd4a9c56640 1 Processor -- start 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.459+0000 7fd4a9c56640 1 -- start start 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a9c56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4a415ce70 0x7fd4a406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a9c56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a9c56640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a406a120 con 0x7fd4a415d250 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a9c56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40cdc10 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a9c56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a406def0 con 0x7fd4a415ce70 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55844/0 (socket says 172.21.15.93:55844) 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 -- 172.21.15.93:0/4146428218 learned_addr learned my addr 172.21.15.93:0/4146428218 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a37fe640 1 --2- 172.21.15.93:0/4146428218 >> v2:172.21.15.125:3300/0 conn(0x7fd4a415ce70 0x7fd4a406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 -- 172.21.15.93:0/4146428218 >> v2:172.21.15.125:3300/0 conn(0x7fd4a415ce70 msgr2=0x7fd4a406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 --2- 172.21.15.93:0/4146428218 >> v2:172.21.15.125:3300/0 conn(0x7fd4a415ce70 0x7fd4a406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 -- 172.21.15.93:0/4146428218 >> v1:172.21.15.125:6789/0 conn(0x7fd4a415d250 legacy=0x7fd4a40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.460+0000 7fd4a3fff640 1 -- 172.21.15.93:0/4146428218 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40c9f40 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.461+0000 7fd4a3fff640 1 --2- 172.21.15.93:0/4146428218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4065ea0 tx=0x7fd49c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59ed739080fcd16 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.461+0000 7fd4a27fc640 1 -- 172.21.15.93:0/4146428218 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c02ca80 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.461+0000 7fd4a27fc640 1 -- 172.21.15.93:0/4146428218 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c02cbe0 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.461+0000 7fd4a27fc640 1 -- 172.21.15.93:0/4146428218 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0343f0 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 -- 172.21.15.93:0/4146428218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a40cb5c0 msgr2=0x7fd4a40ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/4146428218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4065ea0 tx=0x7fd49c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 -- 172.21.15.93:0/4146428218 shutdown_connections 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/4146428218 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40ccdb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/4146428218 >> v2:172.21.15.125:3300/0 conn(0x7fd4a415ce70 0x7fd4a406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 -- 172.21.15.93:0/4146428218 >> 172.21.15.93:0/4146428218 conn(0x7fd4a40b0cd0 msgr2=0x7fd4a40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 -- 172.21.15.93:0/4146428218 shutdown_connections 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.462+0000 7fd4a9c56640 1 -- 172.21.15.93:0/4146428218 wait complete. 2023-11-04T01:37:49.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.463+0000 7fd4a9c56640 1 Processor -- start 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.463+0000 7fd4a9c56640 1 -- start start 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4a415ce70 0x7fd4a4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4157ad0 con 0x7fd4a415d250 2023-11-04T01:37:49.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4157da0 con 0x7fd4a40cb5c0 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a9c56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4158080 con 0x7fd4a415ce70 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55856/0 (socket says 172.21.15.93:55856) 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 -- 172.21.15.93:0/615012783 learned_addr learned my addr 172.21.15.93:0/615012783 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a2ffd640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4a415ce70 0x7fd4a4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 -- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4a415ce70 msgr2=0x7fd4a4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4a415ce70 0x7fd4a4157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a37fe640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 -- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4a40cb5c0 msgr2=0x7fd4a40c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.464+0000 7fd4a3fff640 1 -- 172.21.15.93:0/615012783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c009b30 con 0x7fd4a415d250 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd4a3fff640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd49c036040 tx=0x7fd49c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c009510 con 0x7fd4a415d250 2023-11-04T01:37:49.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c03e450 con 0x7fd4a415d250 2023-11-04T01:37:49.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c03e7e0 con 0x7fd4a415d250 2023-11-04T01:37:49.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a4158360 con 0x7fd4a415d250 2023-11-04T01:37:49.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.465+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a4158920 con 0x7fd4a415d250 2023-11-04T01:37:49.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.466+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a4074290 con 0x7fd4a415d250 2023-11-04T01:37:49.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.466+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd49c02cd50 con 0x7fd4a415d250 2023-11-04T01:37:49.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.467+0000 7fd48bfff640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 0x7fd49006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.467+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd49c0ac320 con 0x7fd4a415d250 2023-11-04T01:37:49.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.467+0000 7fd4a37fe640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 0x7fd49006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.467+0000 7fd4a37fe640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 0x7fd49006d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd494006fd0 tx=0x7fd494008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.471+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd49c0772e0 con 0x7fd4a415d250 2023-11-04T01:37:49.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.634+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4a40b1790 con 0x7fd49006ae70 2023-11-04T01:37:49.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.643+0000 7fd48bfff640 1 -- 172.21.15.93:0/615012783 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370572 (secure 0 0 0) 0x7fd4a40b1790 con 0x7fd49006ae70 2023-11-04T01:37:49.648 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:37:49.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 msgr2=0x7fd49006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 0x7fd49006d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd494006fd0 tx=0x7fd494008040 comp rx=0 tx=0).stop 2023-11-04T01:37:49.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 msgr2=0x7fd4a4157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd49c036040 tx=0x7fd49c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 shutdown_connections 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd49006ae70 0x7fd49006d330 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4a415d250 0x7fd4a4157590 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4a415ce70 0x7fd4a4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 --2- 172.21.15.93:0/615012783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4a40cb5c0 0x7fd4a40c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 >> 172.21.15.93:0/615012783 conn(0x7fd4a40b0cd0 msgr2=0x7fd4a406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 shutdown_connections 2023-11-04T01:37:49.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.646+0000 7fd4a9c56640 1 -- 172.21.15.93:0/615012783 wait complete. 2023-11-04T01:37:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-04T01:37:49.351146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222452,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752268,"statfs":{"total":773094113280,"available":772866322432,"internally_reserved":0,"allocated":6389760,"data_stored":3525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001886"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774653+0000","last_change":"2023-11-04T01:37:41.742330+0000","last_active":"2023-11-04T01:37:42.774653+0000","last_peered":"2023-11-04T01:37:42.774653+0000","last_clean":"2023-11-04T01:37:42.774653+0000","last_became_active":"2023-11-04T01:37:41.742024+0000","last_became_peered":"2023-11-04T01:37:41.742024+0000","last_unstale":"2023-11-04T01:37:42.774653+0000","last_undegraded":"2023-11-04T01:37:42.774653+0000","last_fullsized":"2023-11-04T01:37:42.774653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:54.535366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775738+0000","last_change":"2023-11-04T01:37:41.741184+0000","last_active":"2023-11-04T01:37:42.775738+0000","last_peered":"2023-11-04T01:37:42.775738+0000","last_clean":"2023-11-04T01:37:42.775738+0000","last_became_active":"2023-11-04T01:37:41.740929+0000","last_became_peered":"2023-11-04T01:37:41.740929+0000","last_unstale":"2023-11-04T01:37:42.775738+0000","last_undegraded":"2023-11-04T01:37:42.775738+0000","last_fullsized":"2023-11-04T01:37:42.775738+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:36.888749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725072+0000","last_change":"2023-11-04T01:37:41.731319+0000","last_active":"2023-11-04T01:37:42.725072+0000","last_peered":"2023-11-04T01:37:42.725072+0000","last_clean":"2023-11-04T01:37:42.725072+0000","last_became_active":"2023-11-04T01:37:41.731029+0000","last_became_peered":"2023-11-04T01:37:41.731029+0000","last_unstale":"2023-11-04T01:37:42.725072+0000","last_undegraded":"2023-11-04T01:37:42.725072+0000","last_fullsized":"2023-11-04T01:37:42.725072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724561+0000","last_change":"2023-11-04T01:37:41.741326+0000","last_active":"2023-11-04T01:37:42.724561+0000","last_peered":"2023-11-04T01:37:42.724561+0000","last_clean":"2023-11-04T01:37:42.724561+0000","last_became_active":"2023-11-04T01:37:41.741066+0000","last_became_peered":"2023-11-04T01:37:41.741066+0000","last_unstale":"2023-11-04T01:37:42.724561+0000","last_undegraded":"2023-11-04T01:37:42.724561+0000","last_fullsized":"2023-11-04T01:37:42.724561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774914+0000","last_change":"2023-11-04T01:37:41.736955+0000","last_active":"2023-11-04T01:37:42.774914+0000","last_peered":"2023-11-04T01:37:42.774914+0000","last_clean":"2023-11-04T01:37:42.774914+0000","last_became_active":"2023-11-04T01:37:41.736717+0000","last_became_peered":"2023-11-04T01:37:41.736717+0000","last_unstale":"2023-11-04T01:37:42.774914+0000","last_undegraded":"2023-11-04T01:37:42.774914+0000","last_fullsized":"2023-11-04T01:37:42.774914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:32.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775061+0000","last_change":"2023-11-04T01:37:41.733823+0000","last_active":"2023-11-04T01:37:42.775061+0000","last_peered":"2023-11-04T01:37:42.775061+0000","last_clean":"2023-11-04T01:37:42.775061+0000","last_became_active":"2023-11-04T01:37:41.733540+0000","last_became_peered":"2023-11-04T01:37:41.733540+0000","last_unstale":"2023-11-04T01:37:42.775061+0000","last_undegraded":"2023-11-04T01:37:42.775061+0000","last_fullsized":"2023-11-04T01:37:42.775061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774827+0000","last_change":"2023-11-04T01:37:41.734749+0000","last_active":"2023-11-04T01:37:42.774827+0000","last_peered":"2023-11-04T01:37:42.774827+0000","last_clean":"2023-11-04T01:37:42.774827+0000","last_became_active":"2023-11-04T01:37:41.734486+0000","last_became_peered":"2023-11-04T01:37:41.734486+0000","last_unstale":"2023-11-04T01:37:42.774827+0000","last_undegraded":"2023-11-04T01:37:42.774827+0000","last_fullsized":"2023-11-04T01:37:42.774827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774564+0000","last_change":"2023-11-04T01:37:41.737034+0000","last_active":"2023-11-04T01:37:42.774564+0000","last_peered":"2023-11-04T01:37:42.774564+0000","last_clean":"2023-11-04T01:37:42.774564+0000","last_became_active":"2023-11-04T01:37:41.736007+0000","last_became_peered":"2023-11-04T01:37:41.736007+0000","last_unstale":"2023-11-04T01:37:42.774564+0000","last_undegraded":"2023-11-04T01:37:42.774564+0000","last_fullsized":"2023-11-04T01:37:42.774564+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:13.495100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775132+0000","last_change":"2023-11-04T01:37:41.725939+0000","last_active":"2023-11-04T01:37:42.775132+0000","last_peered":"2023-11-04T01:37:42.775132+0000","last_clean":"2023-11-04T01:37:42.775132+0000","last_became_active":"2023-11-04T01:37:41.725642+0000","last_became_peered":"2023-11-04T01:37:41.725642+0000","last_unstale":"2023-11-04T01:37:42.775132+0000","last_undegraded":"2023-11-04T01:37:42.775132+0000","last_fullsized":"2023-11-04T01:37:42.775132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718431+0000","last_change":"2023-11-04T01:37:41.734129+0000","last_active":"2023-11-04T01:37:42.718431+0000","last_peered":"2023-11-04T01:37:42.718431+0000","last_clean":"2023-11-04T01:37:42.718431+0000","last_became_active":"2023-11-04T01:37:41.733898+0000","last_became_peered":"2023-11-04T01:37:41.733898+0000","last_unstale":"2023-11-04T01:37:42.718431+0000","last_undegraded":"2023-11-04T01:37:42.718431+0000","last_fullsized":"2023-11-04T01:37:42.718431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718546+0000","last_change":"2023-11-04T01:37:41.735286+0000","last_active":"2023-11-04T01:37:42.718546+0000","last_peered":"2023-11-04T01:37:42.718546+0000","last_clean":"2023-11-04T01:37:42.718546+0000","last_became_active":"2023-11-04T01:37:41.735026+0000","last_became_peered":"2023-11-04T01:37:41.735026+0000","last_unstale":"2023-11-04T01:37:42.718546+0000","last_undegraded":"2023-11-04T01:37:42.718546+0000","last_fullsized":"2023-11-04T01:37:42.718546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724285+0000","last_change":"2023-11-04T01:37:41.739990+0000","last_active":"2023-11-04T01:37:42.724285+0000","last_peered":"2023-11-04T01:37:42.724285+0000","last_clean":"2023-11-04T01:37:42.724285+0000","last_became_active":"2023-11-04T01:37:41.739736+0000","last_became_peered":"2023-11-04T01:37:41.739736+0000","last_unstale":"2023-11-04T01:37:42.724285+0000","last_undegraded":"2023-11-04T01:37:42.724285+0000","last_fullsized":"2023-11-04T01:37:42.724285+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775489+0000","last_change":"2023-11-04T01:37:41.744264+0000","last_active":"2023-11-04T01:37:42.775489+0000","last_peered":"2023-11-04T01:37:42.775489+0000","last_clean":"2023-11-04T01:37:42.775489+0000","last_became_active":"2023-11-04T01:37:41.743951+0000","last_became_peered":"2023-11-04T01:37:41.743951+0000","last_unstale":"2023-11-04T01:37:42.775489+0000","last_undegraded":"2023-11-04T01:37:42.775489+0000","last_fullsized":"2023-11-04T01:37:42.775489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:44.059690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775130+0000","last_change":"2023-11-04T01:37:41.737149+0000","last_active":"2023-11-04T01:37:42.775130+0000","last_peered":"2023-11-04T01:37:42.775130+0000","last_clean":"2023-11-04T01:37:42.775130+0000","last_became_active":"2023-11-04T01:37:41.736867+0000","last_became_peered":"2023-11-04T01:37:41.736867+0000","last_unstale":"2023-11-04T01:37:42.775130+0000","last_undegraded":"2023-11-04T01:37:42.775130+0000","last_fullsized":"2023-11-04T01:37:42.775130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:12.675482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774890+0000","last_change":"2023-11-04T01:37:41.730504+0000","last_active":"2023-11-04T01:37:42.774890+0000","last_peered":"2023-11-04T01:37:42.774890+0000","last_clean":"2023-11-04T01:37:42.774890+0000","last_became_active":"2023-11-04T01:37:41.730246+0000","last_became_peered":"2023-11-04T01:37:41.730246+0000","last_unstale":"2023-11-04T01:37:42.774890+0000","last_undegraded":"2023-11-04T01:37:42.774890+0000","last_fullsized":"2023-11-04T01:37:42.774890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774846+0000","last_change":"2023-11-04T01:37:41.734311+0000","last_active":"2023-11-04T01:37:42.774846+0000","last_peered":"2023-11-04T01:37:42.774846+0000","last_clean":"2023-11-04T01:37:42.774846+0000","last_became_active":"2023-11-04T01:37:41.734033+0000","last_became_peered":"2023-11-04T01:37:41.734033+0000","last_unstale":"2023-11-04T01:37:42.774846+0000","last_undegraded":"2023-11-04T01:37:42.774846+0000","last_fullsized":"2023-11-04T01:37:42.774846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775812+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.775812+0000","last_peered":"2023-11-04T01:37:42.775812+0000","last_clean":"2023-11-04T01:37:42.775812+0000","last_became_active":"2023-11-04T01:37:41.740374+0000","last_became_peered":"2023-11-04T01:37:41.740374+0000","last_unstale":"2023-11-04T01:37:42.775812+0000","last_undegraded":"2023-11-04T01:37:42.775812+0000","last_fullsized":"2023-11-04T01:37:42.775812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:50.653572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725334+0000","last_change":"2023-11-04T01:37:41.736475+0000","last_active":"2023-11-04T01:37:42.725334+0000","last_peered":"2023-11-04T01:37:42.725334+0000","last_clean":"2023-11-04T01:37:42.725334+0000","last_became_active":"2023-11-04T01:37:41.736160+0000","last_became_peered":"2023-11-04T01:37:41.736160+0000","last_unstale":"2023-11-04T01:37:42.725334+0000","last_undegraded":"2023-11-04T01:37:42.725334+0000","last_fullsized":"2023-11-04T01:37:42.725334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774692+0000","last_change":"2023-11-04T01:37:41.743289+0000","last_active":"2023-11-04T01:37:42.774692+0000","last_peered":"2023-11-04T01:37:42.774692+0000","last_clean":"2023-11-04T01:37:42.774692+0000","last_became_active":"2023-11-04T01:37:41.743037+0000","last_became_peered":"2023-11-04T01:37:41.743037+0000","last_unstale":"2023-11-04T01:37:42.774692+0000","last_undegraded":"2023-11-04T01:37:42.774692+0000","last_fullsized":"2023-11-04T01:37:42.774692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:22.226162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775874+0000","last_change":"2023-11-04T01:37:41.745593+0000","last_active":"2023-11-04T01:37:42.775874+0000","last_peered":"2023-11-04T01:37:42.775874+0000","last_clean":"2023-11-04T01:37:42.775874+0000","last_became_active":"2023-11-04T01:37:41.745287+0000","last_became_peered":"2023-11-04T01:37:41.745287+0000","last_unstale":"2023-11-04T01:37:42.775874+0000","last_undegraded":"2023-11-04T01:37:42.775874+0000","last_fullsized":"2023-11-04T01:37:42.775874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:44.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724097+0000","last_change":"2023-11-04T01:37:41.736933+0000","last_active":"2023-11-04T01:37:42.724097+0000","last_peered":"2023-11-04T01:37:42.724097+0000","last_clean":"2023-11-04T01:37:42.724097+0000","last_became_active":"2023-11-04T01:37:41.736665+0000","last_became_peered":"2023-11-04T01:37:41.736665+0000","last_unstale":"2023-11-04T01:37:42.724097+0000","last_undegraded":"2023-11-04T01:37:42.724097+0000","last_fullsized":"2023-11-04T01:37:42.724097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:16.408827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774452+0000","last_change":"2023-11-04T01:37:41.740885+0000","last_active":"2023-11-04T01:37:42.774452+0000","last_peered":"2023-11-04T01:37:42.774452+0000","last_clean":"2023-11-04T01:37:42.774452+0000","last_became_active":"2023-11-04T01:37:41.740616+0000","last_became_peered":"2023-11-04T01:37:41.740616+0000","last_unstale":"2023-11-04T01:37:42.774452+0000","last_undegraded":"2023-11-04T01:37:42.774452+0000","last_fullsized":"2023-11-04T01:37:42.774452+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:27.908510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724454+0000","last_change":"2023-11-04T01:37:41.738833+0000","last_active":"2023-11-04T01:37:42.724454+0000","last_peered":"2023-11-04T01:37:42.724454+0000","last_clean":"2023-11-04T01:37:42.724454+0000","last_became_active":"2023-11-04T01:37:41.738228+0000","last_became_peered":"2023-11-04T01:37:41.738228+0000","last_unstale":"2023-11-04T01:37:42.724454+0000","last_undegraded":"2023-11-04T01:37:42.724454+0000","last_fullsized":"2023-11-04T01:37:42.724454+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774617+0000","last_change":"2023-11-04T01:37:41.739216+0000","last_active":"2023-11-04T01:37:42.774617+0000","last_peered":"2023-11-04T01:37:42.774617+0000","last_clean":"2023-11-04T01:37:42.774617+0000","last_became_active":"2023-11-04T01:37:41.738936+0000","last_became_peered":"2023-11-04T01:37:41.738936+0000","last_unstale":"2023-11-04T01:37:42.774617+0000","last_undegraded":"2023-11-04T01:37:42.774617+0000","last_fullsized":"2023-11-04T01:37:42.774617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:47.340021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774762+0000","last_change":"2023-11-04T01:37:41.737112+0000","last_active":"2023-11-04T01:37:42.774762+0000","last_peered":"2023-11-04T01:37:42.774762+0000","last_clean":"2023-11-04T01:37:42.774762+0000","last_became_active":"2023-11-04T01:37:41.736367+0000","last_became_peered":"2023-11-04T01:37:41.736367+0000","last_unstale":"2023-11-04T01:37:42.774762+0000","last_undegraded":"2023-11-04T01:37:42.774762+0000","last_fullsized":"2023-11-04T01:37:42.774762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:44.241121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725006+0000","last_change":"2023-11-04T01:37:41.734429+0000","last_active":"2023-11-04T01:37:42.725006+0000","last_peered":"2023-11-04T01:37:42.725006+0000","last_clean":"2023-11-04T01:37:42.725006+0000","last_became_active":"2023-11-04T01:37:41.734119+0000","last_became_peered":"2023-11-04T01:37:41.734119+0000","last_unstale":"2023-11-04T01:37:42.725006+0000","last_undegraded":"2023-11-04T01:37:42.725006+0000","last_fullsized":"2023-11-04T01:37:42.725006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775451+0000","last_change":"2023-11-04T01:37:41.733926+0000","last_active":"2023-11-04T01:37:42.775451+0000","last_peered":"2023-11-04T01:37:42.775451+0000","last_clean":"2023-11-04T01:37:42.775451+0000","last_became_active":"2023-11-04T01:37:41.733669+0000","last_became_peered":"2023-11-04T01:37:41.733669+0000","last_unstale":"2023-11-04T01:37:42.775451+0000","last_undegraded":"2023-11-04T01:37:42.775451+0000","last_fullsized":"2023-11-04T01:37:42.775451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775024+0000","last_change":"2023-11-04T01:37:41.731513+0000","last_active":"2023-11-04T01:37:42.775024+0000","last_peered":"2023-11-04T01:37:42.775024+0000","last_clean":"2023-11-04T01:37:42.775024+0000","last_became_active":"2023-11-04T01:37:41.731250+0000","last_became_peered":"2023-11-04T01:37:41.731250+0000","last_unstale":"2023-11-04T01:37:42.775024+0000","last_undegraded":"2023-11-04T01:37:42.775024+0000","last_fullsized":"2023-11-04T01:37:42.775024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:07.463931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775834+0000","last_change":"2023-11-04T01:37:41.738065+0000","last_active":"2023-11-04T01:37:42.775834+0000","last_peered":"2023-11-04T01:37:42.775834+0000","last_clean":"2023-11-04T01:37:42.775834+0000","last_became_active":"2023-11-04T01:37:41.737822+0000","last_became_peered":"2023-11-04T01:37:41.737822+0000","last_unstale":"2023-11-04T01:37:42.775834+0000","last_undegraded":"2023-11-04T01:37:42.775834+0000","last_fullsized":"2023-11-04T01:37:42.775834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:51.662220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724161+0000","last_change":"2023-11-04T01:37:41.731426+0000","last_active":"2023-11-04T01:37:42.724161+0000","last_peered":"2023-11-04T01:37:42.724161+0000","last_clean":"2023-11-04T01:37:42.724161+0000","last_became_active":"2023-11-04T01:37:41.731069+0000","last_became_peered":"2023-11-04T01:37:41.731069+0000","last_unstale":"2023-11-04T01:37:42.724161+0000","last_undegraded":"2023-11-04T01:37:42.724161+0000","last_fullsized":"2023-11-04T01:37:42.724161+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:41.036435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774559+0000","last_change":"2023-11-04T01:37:41.735428+0000","last_active":"2023-11-04T01:37:42.774559+0000","last_peered":"2023-11-04T01:37:42.774559+0000","last_clean":"2023-11-04T01:37:42.774559+0000","last_became_active":"2023-11-04T01:37:41.735191+0000","last_became_peered":"2023-11-04T01:37:41.735191+0000","last_unstale":"2023-11-04T01:37:42.774559+0000","last_undegraded":"2023-11-04T01:37:42.774559+0000","last_fullsized":"2023-11-04T01:37:42.774559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:05:09.029109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774727+0000","last_change":"2023-11-04T01:37:41.733806+0000","last_active":"2023-11-04T01:37:42.774727+0000","last_peered":"2023-11-04T01:37:42.774727+0000","last_clean":"2023-11-04T01:37:42.774727+0000","last_became_active":"2023-11-04T01:37:41.733493+0000","last_became_peered":"2023-11-04T01:37:41.733493+0000","last_unstale":"2023-11-04T01:37:42.774727+0000","last_undegraded":"2023-11-04T01:37:42.774727+0000","last_fullsized":"2023-11-04T01:37:42.774727+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724230+0000","last_change":"2023-11-04T01:37:41.733345+0000","last_active":"2023-11-04T01:37:42.724230+0000","last_peered":"2023-11-04T01:37:42.724230+0000","last_clean":"2023-11-04T01:37:42.724230+0000","last_became_active":"2023-11-04T01:37:41.732815+0000","last_became_peered":"2023-11-04T01:37:41.732815+0000","last_unstale":"2023-11-04T01:37:42.724230+0000","last_undegraded":"2023-11-04T01:37:42.724230+0000","last_fullsized":"2023-11-04T01:37:42.724230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:59.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774805+0000","last_change":"2023-11-04T01:37:40.716577+0000","last_active":"2023-11-04T01:37:42.774805+0000","last_peered":"2023-11-04T01:37:42.774805+0000","last_clean":"2023-11-04T01:37:42.774805+0000","last_became_active":"2023-11-04T01:37:40.716326+0000","last_became_peered":"2023-11-04T01:37:40.716326+0000","last_unstale":"2023-11-04T01:37:42.774805+0000","last_undegraded":"2023-11-04T01:37:42.774805+0000","last_fullsized":"2023-11-04T01:37:42.774805+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:51.581764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717410+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:37:41.717410+0000","last_peered":"2023-11-04T01:37:41.717410+0000","last_clean":"2023-11-04T01:37:41.717410+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:37:41.717410+0000","last_undegraded":"2023-11-04T01:37:41.717410+0000","last_fullsized":"2023-11-04T01:37:41.717410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723916+0000","last_change":"2023-11-04T01:37:41.740877+0000","last_active":"2023-11-04T01:37:42.723916+0000","last_peered":"2023-11-04T01:37:42.723916+0000","last_clean":"2023-11-04T01:37:42.723916+0000","last_became_active":"2023-11-04T01:37:41.740615+0000","last_became_peered":"2023-11-04T01:37:41.740615+0000","last_unstale":"2023-11-04T01:37:42.723916+0000","last_undegraded":"2023-11-04T01:37:42.723916+0000","last_fullsized":"2023-11-04T01:37:42.723916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775635+0000","last_change":"2023-11-04T01:37:40.721750+0000","last_active":"2023-11-04T01:37:42.775635+0000","last_peered":"2023-11-04T01:37:42.775635+0000","last_clean":"2023-11-04T01:37:42.775635+0000","last_became_active":"2023-11-04T01:37:40.721397+0000","last_became_peered":"2023-11-04T01:37:40.721397+0000","last_unstale":"2023-11-04T01:37:42.775635+0000","last_undegraded":"2023-11-04T01:37:42.775635+0000","last_fullsized":"2023-11-04T01:37:42.775635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:07.237728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727913+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:37:41.727913+0000","last_peered":"2023-11-04T01:37:41.727913+0000","last_clean":"2023-11-04T01:37:41.727913+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:37:41.727913+0000","last_undegraded":"2023-11-04T01:37:41.727913+0000","last_fullsized":"2023-11-04T01:37:41.727913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724604+0000","last_change":"2023-11-04T01:37:41.737701+0000","last_active":"2023-11-04T01:37:42.724604+0000","last_peered":"2023-11-04T01:37:42.724604+0000","last_clean":"2023-11-04T01:37:42.724604+0000","last_became_active":"2023-11-04T01:37:41.736021+0000","last_became_peered":"2023-11-04T01:37:41.736021+0000","last_unstale":"2023-11-04T01:37:42.724604+0000","last_undegraded":"2023-11-04T01:37:42.724604+0000","last_fullsized":"2023-11-04T01:37:42.724604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:08.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723814+0000","last_change":"2023-11-04T01:37:40.718760+0000","last_active":"2023-11-04T01:37:42.723814+0000","last_peered":"2023-11-04T01:37:42.723814+0000","last_clean":"2023-11-04T01:37:42.723814+0000","last_became_active":"2023-11-04T01:37:40.718466+0000","last_became_peered":"2023-11-04T01:37:40.718466+0000","last_unstale":"2023-11-04T01:37:42.723814+0000","last_undegraded":"2023-11-04T01:37:42.723814+0000","last_fullsized":"2023-11-04T01:37:42.723814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728518+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:37:41.728518+0000","last_peered":"2023-11-04T01:37:41.728518+0000","last_clean":"2023-11-04T01:37:41.728518+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:37:41.728518+0000","last_undegraded":"2023-11-04T01:37:41.728518+0000","last_fullsized":"2023-11-04T01:37:41.728518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775362+0000","last_change":"2023-11-04T01:37:41.737582+0000","last_active":"2023-11-04T01:37:42.775362+0000","last_peered":"2023-11-04T01:37:42.775362+0000","last_clean":"2023-11-04T01:37:42.775362+0000","last_became_active":"2023-11-04T01:37:41.737076+0000","last_became_peered":"2023-11-04T01:37:41.737076+0000","last_unstale":"2023-11-04T01:37:42.775362+0000","last_undegraded":"2023-11-04T01:37:42.775362+0000","last_fullsized":"2023-11-04T01:37:42.775362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:26.513618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724776+0000","last_change":"2023-11-04T01:37:40.716846+0000","last_active":"2023-11-04T01:37:42.724776+0000","last_peered":"2023-11-04T01:37:42.724776+0000","last_clean":"2023-11-04T01:37:42.724776+0000","last_became_active":"2023-11-04T01:37:40.716588+0000","last_became_peered":"2023-11-04T01:37:40.716588+0000","last_unstale":"2023-11-04T01:37:42.724776+0000","last_undegraded":"2023-11-04T01:37:42.724776+0000","last_fullsized":"2023-11-04T01:37:42.724776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.717017+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:37:41.717017+0000","last_peered":"2023-11-04T01:37:41.717017+0000","last_clean":"2023-11-04T01:37:41.717017+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:37:41.717017+0000","last_undegraded":"2023-11-04T01:37:41.717017+0000","last_fullsized":"2023-11-04T01:37:41.717017+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724829+0000","last_change":"2023-11-04T01:37:41.730410+0000","last_active":"2023-11-04T01:37:42.724829+0000","last_peered":"2023-11-04T01:37:42.724829+0000","last_clean":"2023-11-04T01:37:42.724829+0000","last_became_active":"2023-11-04T01:37:41.729963+0000","last_became_peered":"2023-11-04T01:37:41.729963+0000","last_unstale":"2023-11-04T01:37:42.724829+0000","last_undegraded":"2023-11-04T01:37:42.724829+0000","last_fullsized":"2023-11-04T01:37:42.724829+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:42.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775817+0000","last_change":"2023-11-04T01:37:40.722525+0000","last_active":"2023-11-04T01:37:42.775817+0000","last_peered":"2023-11-04T01:37:42.775817+0000","last_clean":"2023-11-04T01:37:42.775817+0000","last_became_active":"2023-11-04T01:37:40.722295+0000","last_became_peered":"2023-11-04T01:37:40.722295+0000","last_unstale":"2023-11-04T01:37:42.775817+0000","last_undegraded":"2023-11-04T01:37:42.775817+0000","last_fullsized":"2023-11-04T01:37:42.775817+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:12.752146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728156+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:37:41.728156+0000","last_peered":"2023-11-04T01:37:41.728156+0000","last_clean":"2023-11-04T01:37:41.728156+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:37:41.728156+0000","last_undegraded":"2023-11-04T01:37:41.728156+0000","last_fullsized":"2023-11-04T01:37:41.728156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775290+0000","last_change":"2023-11-04T01:37:41.730844+0000","last_active":"2023-11-04T01:37:42.775290+0000","last_peered":"2023-11-04T01:37:42.775290+0000","last_clean":"2023-11-04T01:37:42.775290+0000","last_became_active":"2023-11-04T01:37:41.730579+0000","last_became_peered":"2023-11-04T01:37:41.730579+0000","last_unstale":"2023-11-04T01:37:42.775290+0000","last_undegraded":"2023-11-04T01:37:42.775290+0000","last_fullsized":"2023-11-04T01:37:42.775290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724915+0000","last_change":"2023-11-04T01:37:40.724705+0000","last_active":"2023-11-04T01:37:42.724915+0000","last_peered":"2023-11-04T01:37:42.724915+0000","last_clean":"2023-11-04T01:37:42.724915+0000","last_became_active":"2023-11-04T01:37:40.724498+0000","last_became_peered":"2023-11-04T01:37:40.724498+0000","last_unstale":"2023-11-04T01:37:42.724915+0000","last_undegraded":"2023-11-04T01:37:42.724915+0000","last_fullsized":"2023-11-04T01:37:42.724915+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:06.972960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720435+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:37:41.720435+0000","last_peered":"2023-11-04T01:37:41.720435+0000","last_clean":"2023-11-04T01:37:41.720435+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:37:41.720435+0000","last_undegraded":"2023-11-04T01:37:41.720435+0000","last_fullsized":"2023-11-04T01:37:41.720435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725329+0000","last_change":"2023-11-04T01:37:41.737099+0000","last_active":"2023-11-04T01:37:42.725329+0000","last_peered":"2023-11-04T01:37:42.725329+0000","last_clean":"2023-11-04T01:37:42.725329+0000","last_became_active":"2023-11-04T01:37:41.736643+0000","last_became_peered":"2023-11-04T01:37:41.736643+0000","last_unstale":"2023-11-04T01:37:42.725329+0000","last_undegraded":"2023-11-04T01:37:42.725329+0000","last_fullsized":"2023-11-04T01:37:42.725329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775388+0000","last_change":"2023-11-04T01:37:40.723502+0000","last_active":"2023-11-04T01:37:42.775388+0000","last_peered":"2023-11-04T01:37:42.775388+0000","last_clean":"2023-11-04T01:37:42.775388+0000","last_became_active":"2023-11-04T01:37:40.723256+0000","last_became_peered":"2023-11-04T01:37:40.723256+0000","last_unstale":"2023-11-04T01:37:42.775388+0000","last_undegraded":"2023-11-04T01:37:42.775388+0000","last_fullsized":"2023-11-04T01:37:42.775388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:55.289904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720058+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:37:41.720058+0000","last_peered":"2023-11-04T01:37:41.720058+0000","last_clean":"2023-11-04T01:37:41.720058+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:37:41.720058+0000","last_undegraded":"2023-11-04T01:37:41.720058+0000","last_fullsized":"2023-11-04T01:37:41.720058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718305+0000","last_change":"2023-11-04T01:37:41.726825+0000","last_active":"2023-11-04T01:37:42.718305+0000","last_peered":"2023-11-04T01:37:42.718305+0000","last_clean":"2023-11-04T01:37:42.718305+0000","last_became_active":"2023-11-04T01:37:41.726578+0000","last_became_peered":"2023-11-04T01:37:41.726578+0000","last_unstale":"2023-11-04T01:37:42.718305+0000","last_undegraded":"2023-11-04T01:37:42.718305+0000","last_fullsized":"2023-11-04T01:37:42.718305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:39.645563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725108+0000","last_change":"2023-11-04T01:37:40.722814+0000","last_active":"2023-11-04T01:37:42.725108+0000","last_peered":"2023-11-04T01:37:42.725108+0000","last_clean":"2023-11-04T01:37:42.725108+0000","last_became_active":"2023-11-04T01:37:40.722574+0000","last_became_peered":"2023-11-04T01:37:40.722574+0000","last_unstale":"2023-11-04T01:37:42.725108+0000","last_undegraded":"2023-11-04T01:37:42.725108+0000","last_fullsized":"2023-11-04T01:37:42.725108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:38:32.195159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720807+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:37:41.720807+0000","last_peered":"2023-11-04T01:37:41.720807+0000","last_clean":"2023-11-04T01:37:41.720807+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:37:41.720807+0000","last_undegraded":"2023-11-04T01:37:41.720807+0000","last_fullsized":"2023-11-04T01:37:41.720807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775649+0000","last_change":"2023-11-04T01:37:41.744612+0000","last_active":"2023-11-04T01:37:42.775649+0000","last_peered":"2023-11-04T01:37:42.775649+0000","last_clean":"2023-11-04T01:37:42.775649+0000","last_became_active":"2023-11-04T01:37:41.744358+0000","last_became_peered":"2023-11-04T01:37:41.744358+0000","last_unstale":"2023-11-04T01:37:42.775649+0000","last_undegraded":"2023-11-04T01:37:42.775649+0000","last_fullsized":"2023-11-04T01:37:42.775649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:31.384440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775021+0000","last_change":"2023-11-04T01:37:40.717411+0000","last_active":"2023-11-04T01:37:42.775021+0000","last_peered":"2023-11-04T01:37:42.775021+0000","last_clean":"2023-11-04T01:37:42.775021+0000","last_became_active":"2023-11-04T01:37:40.717151+0000","last_became_peered":"2023-11-04T01:37:40.717151+0000","last_unstale":"2023-11-04T01:37:42.775021+0000","last_undegraded":"2023-11-04T01:37:42.775021+0000","last_fullsized":"2023-11-04T01:37:42.775021+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722024+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:37:41.722024+0000","last_peered":"2023-11-04T01:37:41.722024+0000","last_clean":"2023-11-04T01:37:41.722024+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:37:41.722024+0000","last_undegraded":"2023-11-04T01:37:41.722024+0000","last_fullsized":"2023-11-04T01:37:41.722024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775563+0000","last_change":"2023-11-04T01:37:41.740907+0000","last_active":"2023-11-04T01:37:42.775563+0000","last_peered":"2023-11-04T01:37:42.775563+0000","last_clean":"2023-11-04T01:37:42.775563+0000","last_became_active":"2023-11-04T01:37:41.740260+0000","last_became_peered":"2023-11-04T01:37:41.740260+0000","last_unstale":"2023-11-04T01:37:42.775563+0000","last_undegraded":"2023-11-04T01:37:42.775563+0000","last_fullsized":"2023-11-04T01:37:42.775563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:59.311487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775239+0000","last_change":"2023-11-04T01:37:40.720151+0000","last_active":"2023-11-04T01:37:42.775239+0000","last_peered":"2023-11-04T01:37:42.775239+0000","last_clean":"2023-11-04T01:37:42.775239+0000","last_became_active":"2023-11-04T01:37:40.719886+0000","last_became_peered":"2023-11-04T01:37:40.719886+0000","last_unstale":"2023-11-04T01:37:42.775239+0000","last_undegraded":"2023-11-04T01:37:42.775239+0000","last_fullsized":"2023-11-04T01:37:42.775239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.736575+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:37:41.736575+0000","last_peered":"2023-11-04T01:37:41.736575+0000","last_clean":"2023-11-04T01:37:41.736575+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:37:41.736575+0000","last_undegraded":"2023-11-04T01:37:41.736575+0000","last_fullsized":"2023-11-04T01:37:41.736575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.735013+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.734725+0000","last_became_peered":"2023-11-04T01:37:41.734725+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:24:38.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775180+0000","last_change":"2023-11-04T01:37:40.715916+0000","last_active":"2023-11-04T01:37:42.775180+0000","last_peered":"2023-11-04T01:37:42.775180+0000","last_clean":"2023-11-04T01:37:42.775180+0000","last_became_active":"2023-11-04T01:37:40.715674+0000","last_became_peered":"2023-11-04T01:37:40.715674+0000","last_unstale":"2023-11-04T01:37:42.775180+0000","last_undegraded":"2023-11-04T01:37:42.775180+0000","last_fullsized":"2023-11-04T01:37:42.775180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:29.538943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722256+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:37:41.722256+0000","last_peered":"2023-11-04T01:37:41.722256+0000","last_clean":"2023-11-04T01:37:41.722256+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:37:41.722256+0000","last_undegraded":"2023-11-04T01:37:41.722256+0000","last_fullsized":"2023-11-04T01:37:41.722256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774706+0000","last_change":"2023-11-04T01:37:41.739459+0000","last_active":"2023-11-04T01:37:42.774706+0000","last_peered":"2023-11-04T01:37:42.774706+0000","last_clean":"2023-11-04T01:37:42.774706+0000","last_became_active":"2023-11-04T01:37:41.738951+0000","last_became_peered":"2023-11-04T01:37:41.738951+0000","last_unstale":"2023-11-04T01:37:42.774706+0000","last_undegraded":"2023-11-04T01:37:42.774706+0000","last_fullsized":"2023-11-04T01:37:42.774706+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:19.507645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724689+0000","last_change":"2023-11-04T01:37:40.718656+0000","last_active":"2023-11-04T01:37:42.724689+0000","last_peered":"2023-11-04T01:37:42.724689+0000","last_clean":"2023-11-04T01:37:42.724689+0000","last_became_active":"2023-11-04T01:37:40.718417+0000","last_became_peered":"2023-11-04T01:37:40.718417+0000","last_unstale":"2023-11-04T01:37:42.724689+0000","last_undegraded":"2023-11-04T01:37:42.724689+0000","last_fullsized":"2023-11-04T01:37:42.724689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723715+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:37:41.723715+0000","last_peered":"2023-11-04T01:37:41.723715+0000","last_clean":"2023-11-04T01:37:41.723715+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:37:41.723715+0000","last_undegraded":"2023-11-04T01:37:41.723715+0000","last_fullsized":"2023-11-04T01:37:41.723715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718472+0000","last_change":"2023-11-04T01:37:41.725262+0000","last_active":"2023-11-04T01:37:42.718472+0000","last_peered":"2023-11-04T01:37:42.718472+0000","last_clean":"2023-11-04T01:37:42.718472+0000","last_became_active":"2023-11-04T01:37:41.725012+0000","last_became_peered":"2023-11-04T01:37:41.725012+0000","last_unstale":"2023-11-04T01:37:42.718472+0000","last_undegraded":"2023-11-04T01:37:42.718472+0000","last_fullsized":"2023-11-04T01:37:42.718472+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:07.977462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775772+0000","last_change":"2023-11-04T01:37:40.712958+0000","last_active":"2023-11-04T01:37:42.775772+0000","last_peered":"2023-11-04T01:37:42.775772+0000","last_clean":"2023-11-04T01:37:42.775772+0000","last_became_active":"2023-11-04T01:37:40.712701+0000","last_became_peered":"2023-11-04T01:37:40.712701+0000","last_unstale":"2023-11-04T01:37:42.775772+0000","last_undegraded":"2023-11-04T01:37:42.775772+0000","last_fullsized":"2023-11-04T01:37:42.775772+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:41.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.724545+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:37:41.724545+0000","last_peered":"2023-11-04T01:37:41.724545+0000","last_clean":"2023-11-04T01:37:41.724545+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:37:41.724545+0000","last_undegraded":"2023-11-04T01:37:41.724545+0000","last_fullsized":"2023-11-04T01:37:41.724545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775317+0000","last_change":"2023-11-04T01:37:41.738188+0000","last_active":"2023-11-04T01:37:42.775317+0000","last_peered":"2023-11-04T01:37:42.775317+0000","last_clean":"2023-11-04T01:37:42.775317+0000","last_became_active":"2023-11-04T01:37:41.737940+0000","last_became_peered":"2023-11-04T01:37:41.737940+0000","last_unstale":"2023-11-04T01:37:42.775317+0000","last_undegraded":"2023-11-04T01:37:42.775317+0000","last_fullsized":"2023-11-04T01:37:42.775317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:47.109277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774924+0000","last_change":"2023-11-04T01:37:40.720157+0000","last_active":"2023-11-04T01:37:42.774924+0000","last_peered":"2023-11-04T01:37:42.774924+0000","last_clean":"2023-11-04T01:37:42.774924+0000","last_became_active":"2023-11-04T01:37:40.719881+0000","last_became_peered":"2023-11-04T01:37:40.719881+0000","last_unstale":"2023-11-04T01:37:42.774924+0000","last_undegraded":"2023-11-04T01:37:42.774924+0000","last_fullsized":"2023-11-04T01:37:42.774924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:07:40.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729385+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:37:41.729385+0000","last_peered":"2023-11-04T01:37:41.729385+0000","last_clean":"2023-11-04T01:37:41.729385+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:37:41.729385+0000","last_undegraded":"2023-11-04T01:37:41.729385+0000","last_fullsized":"2023-11-04T01:37:41.729385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.731662+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.731410+0000","last_became_peered":"2023-11-04T01:37:41.731410+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724373+0000","last_change":"2023-11-04T01:37:40.721013+0000","last_active":"2023-11-04T01:37:42.724373+0000","last_peered":"2023-11-04T01:37:42.724373+0000","last_clean":"2023-11-04T01:37:42.724373+0000","last_became_active":"2023-11-04T01:37:40.720505+0000","last_became_peered":"2023-11-04T01:37:40.720505+0000","last_unstale":"2023-11-04T01:37:42.724373+0000","last_undegraded":"2023-11-04T01:37:42.724373+0000","last_fullsized":"2023-11-04T01:37:42.724373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:20.590973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720137+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:37:41.720137+0000","last_peered":"2023-11-04T01:37:41.720137+0000","last_clean":"2023-11-04T01:37:41.720137+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:37:41.720137+0000","last_undegraded":"2023-11-04T01:37:41.720137+0000","last_fullsized":"2023-11-04T01:37:41.720137+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775495+0000","last_change":"2023-11-04T01:37:41.721425+0000","last_active":"2023-11-04T01:37:42.775495+0000","last_peered":"2023-11-04T01:37:42.775495+0000","last_clean":"2023-11-04T01:37:42.775495+0000","last_became_active":"2023-11-04T01:37:41.721145+0000","last_became_peered":"2023-11-04T01:37:41.721145+0000","last_unstale":"2023-11-04T01:37:42.775495+0000","last_undegraded":"2023-11-04T01:37:42.775495+0000","last_fullsized":"2023-11-04T01:37:42.775495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775437+0000","last_change":"2023-11-04T01:37:40.723770+0000","last_active":"2023-11-04T01:37:42.775437+0000","last_peered":"2023-11-04T01:37:42.775437+0000","last_clean":"2023-11-04T01:37:42.775437+0000","last_became_active":"2023-11-04T01:37:40.723481+0000","last_became_peered":"2023-11-04T01:37:40.723481+0000","last_unstale":"2023-11-04T01:37:42.775437+0000","last_undegraded":"2023-11-04T01:37:42.775437+0000","last_fullsized":"2023-11-04T01:37:42.775437+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:56.073356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728097+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:37:41.728097+0000","last_peered":"2023-11-04T01:37:41.728097+0000","last_clean":"2023-11-04T01:37:41.728097+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:37:41.728097+0000","last_undegraded":"2023-11-04T01:37:41.728097+0000","last_fullsized":"2023-11-04T01:37:41.728097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724308+0000","last_change":"2023-11-04T01:37:41.737253+0000","last_active":"2023-11-04T01:37:42.724308+0000","last_peered":"2023-11-04T01:37:42.724308+0000","last_clean":"2023-11-04T01:37:42.724308+0000","last_became_active":"2023-11-04T01:37:41.736156+0000","last_became_peered":"2023-11-04T01:37:41.736156+0000","last_unstale":"2023-11-04T01:37:42.724308+0000","last_undegraded":"2023-11-04T01:37:42.724308+0000","last_fullsized":"2023-11-04T01:37:42.724308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:25:57.077859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775093+0000","last_change":"2023-11-04T01:37:40.723713+0000","last_active":"2023-11-04T01:37:42.775093+0000","last_peered":"2023-11-04T01:37:42.775093+0000","last_clean":"2023-11-04T01:37:42.775093+0000","last_became_active":"2023-11-04T01:37:40.723495+0000","last_became_peered":"2023-11-04T01:37:40.723495+0000","last_unstale":"2023-11-04T01:37:42.775093+0000","last_undegraded":"2023-11-04T01:37:42.775093+0000","last_fullsized":"2023-11-04T01:37:42.775093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:46.335518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728628+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:37:41.728628+0000","last_peered":"2023-11-04T01:37:41.728628+0000","last_clean":"2023-11-04T01:37:41.728628+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:37:41.728628+0000","last_undegraded":"2023-11-04T01:37:41.728628+0000","last_fullsized":"2023-11-04T01:37:41.728628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775927+0000","last_change":"2023-11-04T01:37:41.744489+0000","last_active":"2023-11-04T01:37:42.775927+0000","last_peered":"2023-11-04T01:37:42.775927+0000","last_clean":"2023-11-04T01:37:42.775927+0000","last_became_active":"2023-11-04T01:37:41.744234+0000","last_became_peered":"2023-11-04T01:37:41.744234+0000","last_unstale":"2023-11-04T01:37:42.775927+0000","last_undegraded":"2023-11-04T01:37:42.775927+0000","last_fullsized":"2023-11-04T01:37:42.775927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:49.180920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718124+0000","last_change":"2023-11-04T01:37:40.722082+0000","last_active":"2023-11-04T01:37:42.718124+0000","last_peered":"2023-11-04T01:37:42.718124+0000","last_clean":"2023-11-04T01:37:42.718124+0000","last_became_active":"2023-11-04T01:37:40.721801+0000","last_became_peered":"2023-11-04T01:37:40.721801+0000","last_unstale":"2023-11-04T01:37:42.718124+0000","last_undegraded":"2023-11-04T01:37:42.718124+0000","last_fullsized":"2023-11-04T01:37:42.718124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:25.067674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.727701+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:37:41.727701+0000","last_peered":"2023-11-04T01:37:41.727701+0000","last_clean":"2023-11-04T01:37:41.727701+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:37:41.727701+0000","last_undegraded":"2023-11-04T01:37:41.727701+0000","last_fullsized":"2023-11-04T01:37:41.727701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775371+0000","last_change":"2023-11-04T01:37:41.736774+0000","last_active":"2023-11-04T01:37:42.775371+0000","last_peered":"2023-11-04T01:37:42.775371+0000","last_clean":"2023-11-04T01:37:42.775371+0000","last_became_active":"2023-11-04T01:37:41.736541+0000","last_became_peered":"2023-11-04T01:37:41.736541+0000","last_unstale":"2023-11-04T01:37:42.775371+0000","last_undegraded":"2023-11-04T01:37:42.775371+0000","last_fullsized":"2023-11-04T01:37:42.775371+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:39.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774436+0000","last_change":"2023-11-04T01:37:40.718660+0000","last_active":"2023-11-04T01:37:42.774436+0000","last_peered":"2023-11-04T01:37:42.774436+0000","last_clean":"2023-11-04T01:37:42.774436+0000","last_became_active":"2023-11-04T01:37:40.718172+0000","last_became_peered":"2023-11-04T01:37:40.718172+0000","last_unstale":"2023-11-04T01:37:42.774436+0000","last_undegraded":"2023-11-04T01:37:42.774436+0000","last_fullsized":"2023-11-04T01:37:42.774436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:23.612529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720523+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:37:41.720523+0000","last_peered":"2023-11-04T01:37:41.720523+0000","last_clean":"2023-11-04T01:37:41.720523+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:37:41.720523+0000","last_undegraded":"2023-11-04T01:37:41.720523+0000","last_fullsized":"2023-11-04T01:37:41.720523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718105+0000","last_change":"2023-11-04T01:37:41.733565+0000","last_active":"2023-11-04T01:37:42.718105+0000","last_peered":"2023-11-04T01:37:42.718105+0000","last_clean":"2023-11-04T01:37:42.718105+0000","last_became_active":"2023-11-04T01:37:41.733324+0000","last_became_peered":"2023-11-04T01:37:41.733324+0000","last_unstale":"2023-11-04T01:37:42.718105+0000","last_undegraded":"2023-11-04T01:37:42.718105+0000","last_fullsized":"2023-11-04T01:37:42.718105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:50.780053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718054+0000","last_change":"2023-11-04T01:37:40.717532+0000","last_active":"2023-11-04T01:37:42.718054+0000","last_peered":"2023-11-04T01:37:42.718054+0000","last_clean":"2023-11-04T01:37:42.718054+0000","last_became_active":"2023-11-04T01:37:40.717239+0000","last_became_peered":"2023-11-04T01:37:40.717239+0000","last_unstale":"2023-11-04T01:37:42.718054+0000","last_undegraded":"2023-11-04T01:37:42.718054+0000","last_fullsized":"2023-11-04T01:37:42.718054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:23.982905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726577+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:37:41.726577+0000","last_peered":"2023-11-04T01:37:41.726577+0000","last_clean":"2023-11-04T01:37:41.726577+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:37:41.726577+0000","last_undegraded":"2023-11-04T01:37:41.726577+0000","last_fullsized":"2023-11-04T01:37:41.726577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725502+0000","last_change":"2023-11-04T01:37:41.740673+0000","last_active":"2023-11-04T01:37:42.725502+0000","last_peered":"2023-11-04T01:37:42.725502+0000","last_clean":"2023-11-04T01:37:42.725502+0000","last_became_active":"2023-11-04T01:37:41.740391+0000","last_became_peered":"2023-11-04T01:37:41.740391+0000","last_unstale":"2023-11-04T01:37:42.725502+0000","last_undegraded":"2023-11-04T01:37:42.725502+0000","last_fullsized":"2023-11-04T01:37:42.725502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:25.919672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775426+0000","last_change":"2023-11-04T01:37:40.715703+0000","last_active":"2023-11-04T01:37:42.775426+0000","last_peered":"2023-11-04T01:37:42.775426+0000","last_clean":"2023-11-04T01:37:42.775426+0000","last_became_active":"2023-11-04T01:37:40.715413+0000","last_became_peered":"2023-11-04T01:37:40.715413+0000","last_unstale":"2023-11-04T01:37:42.775426+0000","last_undegraded":"2023-11-04T01:37:42.775426+0000","last_fullsized":"2023-11-04T01:37:42.775426+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.719877+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:37:41.719877+0000","last_peered":"2023-11-04T01:37:41.719877+0000","last_clean":"2023-11-04T01:37:41.719877+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:37:41.719877+0000","last_undegraded":"2023-11-04T01:37:41.719877+0000","last_fullsized":"2023-11-04T01:37:41.719877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725148+0000","last_change":"2023-11-04T01:37:41.741732+0000","last_active":"2023-11-04T01:37:42.725148+0000","last_peered":"2023-11-04T01:37:42.725148+0000","last_clean":"2023-11-04T01:37:42.725148+0000","last_became_active":"2023-11-04T01:37:41.741365+0000","last_became_peered":"2023-11-04T01:37:41.741365+0000","last_unstale":"2023-11-04T01:37:42.725148+0000","last_undegraded":"2023-11-04T01:37:42.725148+0000","last_fullsized":"2023-11-04T01:37:42.725148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718487+0000","last_change":"2023-11-04T01:37:40.711455+0000","last_active":"2023-11-04T01:37:42.718487+0000","last_peered":"2023-11-04T01:37:42.718487+0000","last_clean":"2023-11-04T01:37:42.718487+0000","last_became_active":"2023-11-04T01:37:40.711174+0000","last_became_peered":"2023-11-04T01:37:40.711174+0000","last_unstale":"2023-11-04T01:37:42.718487+0000","last_undegraded":"2023-11-04T01:37:42.718487+0000","last_fullsized":"2023-11-04T01:37:42.718487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:18.503142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.726070+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:37:41.726070+0000","last_peered":"2023-11-04T01:37:41.726070+0000","last_clean":"2023-11-04T01:37:41.726070+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:37:41.726070+0000","last_undegraded":"2023-11-04T01:37:41.726070+0000","last_fullsized":"2023-11-04T01:37:41.726070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775357+0000","last_change":"2023-11-04T01:37:41.731096+0000","last_active":"2023-11-04T01:37:42.775357+0000","last_peered":"2023-11-04T01:37:42.775357+0000","last_clean":"2023-11-04T01:37:42.775357+0000","last_became_active":"2023-11-04T01:37:41.730821+0000","last_became_peered":"2023-11-04T01:37:41.730821+0000","last_unstale":"2023-11-04T01:37:42.775357+0000","last_undegraded":"2023-11-04T01:37:42.775357+0000","last_fullsized":"2023-11-04T01:37:42.775357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:14.463247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724453+0000","last_change":"2023-11-04T01:37:40.718691+0000","last_active":"2023-11-04T01:37:42.724453+0000","last_peered":"2023-11-04T01:37:42.724453+0000","last_clean":"2023-11-04T01:37:42.724453+0000","last_became_active":"2023-11-04T01:37:40.718437+0000","last_became_peered":"2023-11-04T01:37:40.718437+0000","last_unstale":"2023-11-04T01:37:42.724453+0000","last_undegraded":"2023-11-04T01:37:42.724453+0000","last_fullsized":"2023-11-04T01:37:42.724453+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:38.220096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.716777+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:37:41.716777+0000","last_peered":"2023-11-04T01:37:41.716777+0000","last_clean":"2023-11-04T01:37:41.716777+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:37:41.716777+0000","last_undegraded":"2023-11-04T01:37:41.716777+0000","last_fullsized":"2023-11-04T01:37:41.716777+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718460+0000","last_change":"2023-11-04T01:37:41.732320+0000","last_active":"2023-11-04T01:37:42.718460+0000","last_peered":"2023-11-04T01:37:42.718460+0000","last_clean":"2023-11-04T01:37:42.718460+0000","last_became_active":"2023-11-04T01:37:41.732070+0000","last_became_peered":"2023-11-04T01:37:41.732070+0000","last_unstale":"2023-11-04T01:37:42.718460+0000","last_undegraded":"2023-11-04T01:37:42.718460+0000","last_fullsized":"2023-11-04T01:37:42.718460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:51.670730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775464+0000","last_change":"2023-11-04T01:37:40.719241+0000","last_active":"2023-11-04T01:37:42.775464+0000","last_peered":"2023-11-04T01:37:42.775464+0000","last_clean":"2023-11-04T01:37:42.775464+0000","last_became_active":"2023-11-04T01:37:40.718976+0000","last_became_peered":"2023-11-04T01:37:40.718976+0000","last_unstale":"2023-11-04T01:37:42.775464+0000","last_undegraded":"2023-11-04T01:37:42.775464+0000","last_fullsized":"2023-11-04T01:37:42.775464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:13.045356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729935+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:37:41.729935+0000","last_peered":"2023-11-04T01:37:41.729935+0000","last_clean":"2023-11-04T01:37:41.729935+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:37:41.729935+0000","last_undegraded":"2023-11-04T01:37:41.729935+0000","last_fullsized":"2023-11-04T01:37:41.729935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775244+0000","last_change":"2023-11-04T01:37:41.734683+0000","last_active":"2023-11-04T01:37:42.775244+0000","last_peered":"2023-11-04T01:37:42.775244+0000","last_clean":"2023-11-04T01:37:42.775244+0000","last_became_active":"2023-11-04T01:37:41.734409+0000","last_became_peered":"2023-11-04T01:37:41.734409+0000","last_unstale":"2023-11-04T01:37:42.775244+0000","last_undegraded":"2023-11-04T01:37:42.775244+0000","last_fullsized":"2023-11-04T01:37:42.775244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:24.617031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.718236+0000","last_change":"2023-11-04T01:37:40.722816+0000","last_active":"2023-11-04T01:37:42.718236+0000","last_peered":"2023-11-04T01:37:42.718236+0000","last_clean":"2023-11-04T01:37:42.718236+0000","last_became_active":"2023-11-04T01:37:40.722545+0000","last_became_peered":"2023-11-04T01:37:40.722545+0000","last_unstale":"2023-11-04T01:37:42.718236+0000","last_undegraded":"2023-11-04T01:37:42.718236+0000","last_fullsized":"2023-11-04T01:37:42.718236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.723429+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:37:41.723429+0000","last_peered":"2023-11-04T01:37:41.723429+0000","last_clean":"2023-11-04T01:37:41.723429+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:37:41.723429+0000","last_undegraded":"2023-11-04T01:37:41.723429+0000","last_fullsized":"2023-11-04T01:37:41.723429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724073+0000","last_change":"2023-11-04T01:37:41.740269+0000","last_active":"2023-11-04T01:37:42.724073+0000","last_peered":"2023-11-04T01:37:42.724073+0000","last_clean":"2023-11-04T01:37:42.724073+0000","last_became_active":"2023-11-04T01:37:41.740007+0000","last_became_peered":"2023-11-04T01:37:41.740007+0000","last_unstale":"2023-11-04T01:37:42.724073+0000","last_undegraded":"2023-11-04T01:37:42.724073+0000","last_fullsized":"2023-11-04T01:37:42.724073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775961+0000","last_change":"2023-11-04T01:37:40.719473+0000","last_active":"2023-11-04T01:37:42.775961+0000","last_peered":"2023-11-04T01:37:42.775961+0000","last_clean":"2023-11-04T01:37:42.775961+0000","last_became_active":"2023-11-04T01:37:40.719196+0000","last_became_peered":"2023-11-04T01:37:40.719196+0000","last_unstale":"2023-11-04T01:37:42.775961+0000","last_undegraded":"2023-11-04T01:37:42.775961+0000","last_fullsized":"2023-11-04T01:37:42.775961+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:13.458744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720006+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:37:41.720006+0000","last_peered":"2023-11-04T01:37:41.720006+0000","last_clean":"2023-11-04T01:37:41.720006+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:37:41.720006+0000","last_undegraded":"2023-11-04T01:37:41.720006+0000","last_fullsized":"2023-11-04T01:37:41.720006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774691+0000","last_change":"2023-11-04T01:37:41.737451+0000","last_active":"2023-11-04T01:37:42.774691+0000","last_peered":"2023-11-04T01:37:42.774691+0000","last_clean":"2023-11-04T01:37:42.774691+0000","last_became_active":"2023-11-04T01:37:41.737137+0000","last_became_peered":"2023-11-04T01:37:41.737137+0000","last_unstale":"2023-11-04T01:37:42.774691+0000","last_undegraded":"2023-11-04T01:37:42.774691+0000","last_fullsized":"2023-11-04T01:37:42.774691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.466471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724047+0000","last_change":"2023-11-04T01:37:40.721797+0000","last_active":"2023-11-04T01:37:42.724047+0000","last_peered":"2023-11-04T01:37:42.724047+0000","last_clean":"2023-11-04T01:37:42.724047+0000","last_became_active":"2023-11-04T01:37:40.721610+0000","last_became_peered":"2023-11-04T01:37:40.721610+0000","last_unstale":"2023-11-04T01:37:42.724047+0000","last_undegraded":"2023-11-04T01:37:42.724047+0000","last_fullsized":"2023-11-04T01:37:42.724047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:40.031932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.728593+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:37:41.728593+0000","last_peered":"2023-11-04T01:37:41.728593+0000","last_clean":"2023-11-04T01:37:41.728593+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:37:41.728593+0000","last_undegraded":"2023-11-04T01:37:41.728593+0000","last_fullsized":"2023-11-04T01:37:41.728593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725422+0000","last_change":"2023-11-04T01:37:41.743494+0000","last_active":"2023-11-04T01:37:42.725422+0000","last_peered":"2023-11-04T01:37:42.725422+0000","last_clean":"2023-11-04T01:37:42.725422+0000","last_became_active":"2023-11-04T01:37:41.743202+0000","last_became_peered":"2023-11-04T01:37:41.743202+0000","last_unstale":"2023-11-04T01:37:42.725422+0000","last_undegraded":"2023-11-04T01:37:42.725422+0000","last_fullsized":"2023-11-04T01:37:42.725422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:00.984632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775311+0000","last_change":"2023-11-04T01:37:40.720430+0000","last_active":"2023-11-04T01:37:42.775311+0000","last_peered":"2023-11-04T01:37:42.775311+0000","last_clean":"2023-11-04T01:37:42.775311+0000","last_became_active":"2023-11-04T01:37:40.720147+0000","last_became_peered":"2023-11-04T01:37:40.720147+0000","last_unstale":"2023-11-04T01:37:42.775311+0000","last_undegraded":"2023-11-04T01:37:42.775311+0000","last_fullsized":"2023-11-04T01:37:42.775311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:58.164564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.722621+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:37:41.722621+0000","last_peered":"2023-11-04T01:37:41.722621+0000","last_clean":"2023-11-04T01:37:41.722621+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:37:41.722621+0000","last_undegraded":"2023-11-04T01:37:41.722621+0000","last_fullsized":"2023-11-04T01:37:41.722621+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.725190+0000","last_change":"2023-11-04T01:37:41.736870+0000","last_active":"2023-11-04T01:37:42.725190+0000","last_peered":"2023-11-04T01:37:42.725190+0000","last_clean":"2023-11-04T01:37:42.725190+0000","last_became_active":"2023-11-04T01:37:41.736603+0000","last_became_peered":"2023-11-04T01:37:41.736603+0000","last_unstale":"2023-11-04T01:37:42.725190+0000","last_undegraded":"2023-11-04T01:37:42.725190+0000","last_fullsized":"2023-11-04T01:37:42.725190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:54.341861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775895+0000","last_change":"2023-11-04T01:37:40.723529+0000","last_active":"2023-11-04T01:37:42.775895+0000","last_peered":"2023-11-04T01:37:42.775895+0000","last_clean":"2023-11-04T01:37:42.775895+0000","last_became_active":"2023-11-04T01:37:40.723260+0000","last_became_peered":"2023-11-04T01:37:40.723260+0000","last_unstale":"2023-11-04T01:37:42.775895+0000","last_undegraded":"2023-11-04T01:37:42.775895+0000","last_fullsized":"2023-11-04T01:37:42.775895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:16.821204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.729600+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:37:41.729600+0000","last_peered":"2023-11-04T01:37:41.729600+0000","last_clean":"2023-11-04T01:37:41.729600+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:37:41.729600+0000","last_undegraded":"2023-11-04T01:37:41.729600+0000","last_fullsized":"2023-11-04T01:37:41.729600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724985+0000","last_change":"2023-11-04T01:37:41.736914+0000","last_active":"2023-11-04T01:37:42.724985+0000","last_peered":"2023-11-04T01:37:42.724985+0000","last_clean":"2023-11-04T01:37:42.724985+0000","last_became_active":"2023-11-04T01:37:41.736343+0000","last_became_peered":"2023-11-04T01:37:41.736343+0000","last_unstale":"2023-11-04T01:37:42.724985+0000","last_undegraded":"2023-11-04T01:37:42.724985+0000","last_fullsized":"2023-11-04T01:37:42.724985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:13.756649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775473+0000","last_change":"2023-11-04T01:37:40.722000+0000","last_active":"2023-11-04T01:37:42.775473+0000","last_peered":"2023-11-04T01:37:42.775473+0000","last_clean":"2023-11-04T01:37:42.775473+0000","last_became_active":"2023-11-04T01:37:40.721730+0000","last_became_peered":"2023-11-04T01:37:40.721730+0000","last_unstale":"2023-11-04T01:37:42.775473+0000","last_undegraded":"2023-11-04T01:37:42.775473+0000","last_fullsized":"2023-11-04T01:37:42.775473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:17.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730251+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:37:41.730251+0000","last_peered":"2023-11-04T01:37:41.730251+0000","last_clean":"2023-11-04T01:37:41.730251+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:37:41.730251+0000","last_undegraded":"2023-11-04T01:37:41.730251+0000","last_fullsized":"2023-11-04T01:37:41.730251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775689+0000","last_change":"2023-11-04T01:37:41.747748+0000","last_active":"2023-11-04T01:37:42.775689+0000","last_peered":"2023-11-04T01:37:42.775689+0000","last_clean":"2023-11-04T01:37:42.775689+0000","last_became_active":"2023-11-04T01:37:41.745825+0000","last_became_peered":"2023-11-04T01:37:41.745825+0000","last_unstale":"2023-11-04T01:37:42.775689+0000","last_undegraded":"2023-11-04T01:37:42.775689+0000","last_fullsized":"2023-11-04T01:37:42.775689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:10.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.724901+0000","last_change":"2023-11-04T01:37:40.716899+0000","last_active":"2023-11-04T01:37:42.724901+0000","last_peered":"2023-11-04T01:37:42.724901+0000","last_clean":"2023-11-04T01:37:42.724901+0000","last_became_active":"2023-11-04T01:37:40.716638+0000","last_became_peered":"2023-11-04T01:37:40.716638+0000","last_unstale":"2023-11-04T01:37:42.724901+0000","last_undegraded":"2023-11-04T01:37:42.724901+0000","last_fullsized":"2023-11-04T01:37:42.724901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:46.871803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.730007+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:37:41.730007+0000","last_peered":"2023-11-04T01:37:41.730007+0000","last_clean":"2023-11-04T01:37:41.730007+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:37:41.730007+0000","last_undegraded":"2023-11-04T01:37:41.730007+0000","last_fullsized":"2023-11-04T01:37:41.730007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.774463+0000","last_change":"2023-11-04T01:37:41.745270+0000","last_active":"2023-11-04T01:37:42.774463+0000","last_peered":"2023-11-04T01:37:42.774463+0000","last_clean":"2023-11-04T01:37:42.774463+0000","last_became_active":"2023-11-04T01:37:41.744977+0000","last_became_peered":"2023-11-04T01:37:41.744977+0000","last_unstale":"2023-11-04T01:37:42.774463+0000","last_undegraded":"2023-11-04T01:37:42.774463+0000","last_fullsized":"2023-11-04T01:37:42.774463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:40.697230+0000","last_clean_scrub_stamp":"2023-11-04T01:37:40.697230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:12.659640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.775117+0000","last_change":"2023-11-04T01:37:40.718777+0000","last_active":"2023-11-04T01:37:42.775117+0000","last_peered":"2023-11-04T01:37:42.775117+0000","last_clean":"2023-11-04T01:37:42.775117+0000","last_became_active":"2023-11-04T01:37:40.718533+0000","last_became_peered":"2023-11-04T01:37:40.718533+0000","last_unstale":"2023-11-04T01:37:42.775117+0000","last_undegraded":"2023-11-04T01:37:42.775117+0000","last_fullsized":"2023-11-04T01:37:42.775117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:39.692728+0000","last_clean_scrub_stamp":"2023-11-04T01:37:39.692728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:56.067548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:37:41.720646+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:37:41.720646+0000","last_peered":"2023-11-04T01:37:41.720646+0000","last_clean":"2023-11-04T01:37:41.720646+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:37:41.720646+0000","last_undegraded":"2023-11-04T01:37:41.720646+0000","last_fullsized":"2023-11-04T01:37:41.720646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:37:42.723952+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:37:42.723952+0000","last_peered":"2023-11-04T01:37:42.723952+0000","last_clean":"2023-11-04T01:37:42.723952+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:37:42.723952+0000","last_undegraded":"2023-11-04T01:37:42.723952+0000","last_fullsized":"2023-11-04T01:37:42.723952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":3,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66200000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.502}]},{"osd":6,"last update":"Sat Nov 4 01:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":291693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65100000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.62,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.499},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.752}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":294324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79500000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71199999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.133,"15min":1.133},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.71699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.36599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.316},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.38600000000000001,"5min":0.495,"15min":0.495},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40799999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47099999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.254}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78300000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.876,"15min":0.876},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73799999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.39600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.313}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1249280,"data_stored":884255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.316,"15min":0.32200000000000001},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.251},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.442,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.313}]},{"osd":2,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.36499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379}]},{"osd":4,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.048,"15min":1.048},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.874,"15min":0.874},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.437}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:37:49.665 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:37:49.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.805+0000 7fbf5afc5640 1 Processor -- start 2023-11-04T01:37:49.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.805+0000 7fbf5afc5640 1 -- start start 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 0x7fbf5406e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbf5415b140 0x7fbf5406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540b24f0 con 0x7fbf5415b140 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5406d4f0 con 0x7fbf5406cbd0 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf5afc5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540ce220 con 0x7fbf54067090 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbf5415b140 0x7fbf5406cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbf5415b140 0x7fbf5406cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55858/0 (socket says 172.21.15.93:55858) 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 -- 172.21.15.93:0/1500078845 learned_addr learned my addr 172.21.15.93:0/1500078845 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:49.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 -- 172.21.15.93:0/1500078845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 msgr2=0x7fbf540cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 --2- 172.21.15.93:0/1500078845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 -- 172.21.15.93:0/1500078845 >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 msgr2=0x7fbf5406e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf58d61640 1 --2- 172.21.15.93:0/1500078845 >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 0x7fbf5406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 --2- 172.21.15.93:0/1500078845 >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 0x7fbf5406e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf53fff640 1 -- 172.21.15.93:0/1500078845 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540cdc60 con 0x7fbf5415b140 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.806+0000 7fbf58d61640 1 --2- 172.21.15.93:0/1500078845 >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 0x7fbf5406e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf53fff640 1 --2- 172.21.15.93:0/1500078845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf5406cfb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbf540707f0 tx=0x7fbf4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ad4b8eefc4be8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf537fe640 1 -- 172.21.15.93:0/1500078845 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400317e0 con 0x7fbf5415b140 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf537fe640 1 -- 172.21.15.93:0/1500078845 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40031940 con 0x7fbf5415b140 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf537fe640 1 -- 172.21.15.93:0/1500078845 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031cd0 con 0x7fbf5415b140 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1500078845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 msgr2=0x7fbf5406cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1500078845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf5406cfb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbf540707f0 tx=0x7fbf4002b880 comp rx=0 tx=0).stop 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1500078845 shutdown_connections 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1500078845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf5406cfb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1500078845 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1500078845 >> v2:172.21.15.125:3300/0 conn(0x7fbf5406cbd0 0x7fbf5406e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.807+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1500078845 >> 172.21.15.93:0/1500078845 conn(0x7fbf5406a120 msgr2=0x7fbf5406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.808+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1500078845 shutdown_connections 2023-11-04T01:37:49.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.808+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1500078845 wait complete. 2023-11-04T01:37:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 Processor -- start 2023-11-04T01:37:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 -- start start 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5406cbd0 0x7fbf540c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54153000 con 0x7fbf5415b140 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c5e00 con 0x7fbf5406cbd0 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.809+0000 7fbf5afc5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c60e0 con 0x7fbf54067090 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55870/0 (socket says 172.21.15.93:55870) 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 -- 172.21.15.93:0/1561998745 learned_addr learned my addr 172.21.15.93:0/1561998745 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf58d61640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf53fff640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5406cbd0 0x7fbf540c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 -- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 msgr2=0x7fbf540afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 -- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5406cbd0 msgr2=0x7fbf540c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5406cbd0 0x7fbf540c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 -- 172.21.15.93:0/1561998745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094d0 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf59562640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00b970 tx=0x7fbf4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00cb40 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00ccc0 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c014680 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf540c63c0 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.810+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf540c6980 con 0x7fbf5415b140 2023-11-04T01:37:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.811+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf54074290 con 0x7fbf5415b140 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.812+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf4c01d3b0 con 0x7fbf5415b140 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.812+0000 7fbf517fa640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 0x7fbf3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.812+0000 7fbf58d61640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 0x7fbf3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.812+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbf4c089720 con 0x7fbf5415b140 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.813+0000 7fbf58d61640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 0x7fbf3806d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf5406d410 tx=0x7fbf48008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:49.816+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf4c054670 con 0x7fbf5415b140 2023-11-04T01:37:50.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.044+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbf5406aef0 con 0x7fbf5415b140 2023-11-04T01:37:50.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.046+0000 7fbf517fa640 1 -- 172.21.15.93:0/1561998745 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbf4c0190b0 con 0x7fbf5415b140 2023-11-04T01:37:50.047 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:37:50.048 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:37:50.048 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow" 2023-11-04T01:37:50.048 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow r" 2023-11-04T01:37:50.048 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:50.048 INFO:teuthology.orchestra.run.smithi093.stderr:updated caps for client.0 2023-11-04T01:37:50.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 msgr2=0x7fbf3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 0x7fbf3806d330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf5406d410 tx=0x7fbf48008040 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 msgr2=0x7fbf541593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00b970 tx=0x7fbf4c00be30 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 shutdown_connections 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbf3806ae70 0x7fbf3806d330 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5415b140 0x7fbf541593d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf5406cbd0 0x7fbf540c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 --2- 172.21.15.93:0/1561998745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbf54067090 0x7fbf540afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 >> 172.21.15.93:0/1561998745 conn(0x7fbf5406a120 msgr2=0x7fbf5415a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 shutdown_connections 2023-11-04T01:37:50.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.048+0000 7fbf5afc5640 1 -- 172.21.15.93:0/1561998745 wait complete. 2023-11-04T01:37:50.060 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:50.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.158+0000 7fd63207c640 1 Processor -- start 2023-11-04T01:37:50.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.158+0000 7fd63207c640 1 -- start start 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd62c15ad80 0x7fd62c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd62c0b42c0 0x7fd62c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0ca050 con 0x7fd62c0b42c0 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c06cd00 con 0x7fd62c15ad80 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd63207c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c06cfa0 con 0x7fd62c0c9c40 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd62c0b42c0 0x7fd62c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd62c0b42c0 0x7fd62c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55876/0 (socket says 172.21.15.93:55876) 2023-11-04T01:37:50.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 -- 172.21.15.93:0/2293752430 learned_addr learned my addr 172.21.15.93:0/2293752430 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 -- 172.21.15.93:0/2293752430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 msgr2=0x7fd62c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 --2- 172.21.15.93:0/2293752430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 -- 172.21.15.93:0/2293752430 >> v2:172.21.15.125:3300/0 conn(0x7fd62c15ad80 msgr2=0x7fd62c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 --2- 172.21.15.93:0/2293752430 >> v2:172.21.15.125:3300/0 conn(0x7fd62c15ad80 0x7fd62c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.159+0000 7fd62affd640 1 -- 172.21.15.93:0/2293752430 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c06d280 con 0x7fd62c0b42c0 2023-11-04T01:37:50.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.160+0000 7fd62affd640 1 --2- 172.21.15.93:0/2293752430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c9700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0b4ac0 tx=0x7fd62002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f21b3ad1ec1bba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.160+0000 7fd62a7fc640 1 -- 172.21.15.93:0/2293752430 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620030860 con 0x7fd62c0b42c0 2023-11-04T01:37:50.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.160+0000 7fd62a7fc640 1 -- 172.21.15.93:0/2293752430 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6200309c0 con 0x7fd62c0b42c0 2023-11-04T01:37:50.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.160+0000 7fd62a7fc640 1 -- 172.21.15.93:0/2293752430 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620030d50 con 0x7fd62c0b42c0 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 -- 172.21.15.93:0/2293752430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c0b42c0 msgr2=0x7fd62c0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 --2- 172.21.15.93:0/2293752430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c9700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0b4ac0 tx=0x7fd62002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 -- 172.21.15.93:0/2293752430 shutdown_connections 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 --2- 172.21.15.93:0/2293752430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c9700 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 --2- 172.21.15.93:0/2293752430 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 --2- 172.21.15.93:0/2293752430 >> v2:172.21.15.125:3300/0 conn(0x7fd62c15ad80 0x7fd62c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 -- 172.21.15.93:0/2293752430 >> 172.21.15.93:0/2293752430 conn(0x7fd62c0ce950 msgr2=0x7fd62c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 -- 172.21.15.93:0/2293752430 shutdown_connections 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.161+0000 7fd63207c640 1 -- 172.21.15.93:0/2293752430 wait complete. 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.162+0000 7fd63207c640 1 Processor -- start 2023-11-04T01:37:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.162+0000 7fd63207c640 1 -- start start 2023-11-04T01:37:50.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c3440 con 0x7fd62c15ad80 2023-11-04T01:37:50.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c3690 con 0x7fd62c0b42c0 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd63207c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c3970 con 0x7fd62c0c9c40 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55878/0 (socket says 172.21.15.93:55878) 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 -- 172.21.15.93:0/1804419599 learned_addr learned my addr 172.21.15.93:0/1804419599 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62b7fe640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62affd640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 -- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 msgr2=0x7fd62c0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 -- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd62c0b42c0 msgr2=0x7fd62c0c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 -- 172.21.15.93:0/1804419599 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200094d0 con 0x7fd62c15ad80 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.163+0000 7fd62bfff640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b970 tx=0x7fd62400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.164+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400cb40 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.164+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400ccc0 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.164+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0c3c50 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.164+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624014680 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.164+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0c4210 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.165+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c06d540 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.165+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd62401d3b0 con 0x7fd62c15ad80 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.165+0000 7fd613fff640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 0x7fd61806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.165+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd624089860 con 0x7fd62c15ad80 2023-11-04T01:37:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.165+0000 7fd62b7fe640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 0x7fd61806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.166+0000 7fd62b7fe640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 0x7fd61806d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009890 tx=0x7fd61c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.170+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd62c06d540 con 0x7fd62c15ad80 2023-11-04T01:37:50.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.370+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd62c06d540 con 0x7fd62c15ad80 2023-11-04T01:37:50.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.371+0000 7fd613fff640 1 -- 172.21.15.93:0/1804419599 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd62c06d540 con 0x7fd62c15ad80 2023-11-04T01:37:50.372 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:50.372 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:50.372 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:50.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 msgr2=0x7fd61806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 0x7fd61806d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009890 tx=0x7fd61c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:50.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 msgr2=0x7fd62c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b970 tx=0x7fd62400be30 comp rx=0 tx=0).stop 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 shutdown_connections 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd61806ae70 0x7fd61806d330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd62c15ad80 0x7fd62c15da00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd62c0c9c40 0x7fd62c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 --2- 172.21.15.93:0/1804419599 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd62c0b42c0 0x7fd62c0c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 >> 172.21.15.93:0/1804419599 conn(0x7fd62c0ce950 msgr2=0x7fd62c0b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 shutdown_connections 2023-11-04T01:37:50.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.373+0000 7fd63207c640 1 -- 172.21.15.93:0/1804419599 wait complete. 2023-11-04T01:37:50.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:37:41.049261+0000', 'modified': '2023-11-04T01:37:43.366887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6006}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6006': {'gid': 6006, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6836/1137152814', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 1137152814}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 1137152814}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:37:50.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:37:50.788 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:37:50.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.888+0000 7fa5844d4640 1 Processor -- start 2023-11-04T01:37:50.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.888+0000 7fa5844d4640 1 -- start start 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa5844d4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa57c153850 0x7fa57c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa5844d4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa5844d4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c0c3860 con 0x7fa57c0cc520 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa5844d4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0c9250 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa5844d4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c153c30 con 0x7fa57c153850 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55890/0 (socket says 172.21.15.93:55890) 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 -- 172.21.15.93:0/3301897383 learned_addr learned my addr 172.21.15.93:0/3301897383 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582270640 1 --2- 172.21.15.93:0/3301897383 >> v2:172.21.15.125:3300/0 conn(0x7fa57c153850 0x7fa57c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 -- 172.21.15.93:0/3301897383 >> v2:172.21.15.125:3300/0 conn(0x7fa57c153850 msgr2=0x7fa57c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 --2- 172.21.15.93:0/3301897383 >> v2:172.21.15.125:3300/0 conn(0x7fa57c153850 0x7fa57c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 -- 172.21.15.93:0/3301897383 >> v1:172.21.15.125:6789/0 conn(0x7fa57c0cc520 legacy=0x7fa57c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.889+0000 7fa582a71640 1 -- 172.21.15.93:0/3301897383 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c15a700 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa582a71640 1 --2- 172.21.15.93:0/3301897383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0c5710 tx=0x7fa57402e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f8e1b84d756c94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa58126e640 1 -- 172.21.15.93:0/3301897383 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574038400 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa58126e640 1 -- 172.21.15.93:0/3301897383 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574032070 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa58126e640 1 -- 172.21.15.93:0/3301897383 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574038780 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa5844d4640 1 -- 172.21.15.93:0/3301897383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c0cc9d0 msgr2=0x7fa57c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.890+0000 7fa5844d4640 1 --2- 172.21.15.93:0/3301897383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0c5710 tx=0x7fa57402e180 comp rx=0 tx=0).stop 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 -- 172.21.15.93:0/3301897383 shutdown_connections 2023-11-04T01:37:50.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 --2- 172.21.15.93:0/3301897383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0c3cf0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 --2- 172.21.15.93:0/3301897383 >> v2:172.21.15.125:3300/0 conn(0x7fa57c153850 0x7fa57c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 -- 172.21.15.93:0/3301897383 >> 172.21.15.93:0/3301897383 conn(0x7fa57c0ce950 msgr2=0x7fa57c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 -- 172.21.15.93:0/3301897383 shutdown_connections 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.891+0000 7fa5844d4640 1 -- 172.21.15.93:0/3301897383 wait complete. 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 Processor -- start 2023-11-04T01:37:50.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 -- start start 2023-11-04T01:37:50.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa57c0cc520 0x7fa57c1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0c5a20 con 0x7fa57c153850 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0c5cc0 con 0x7fa57c0cc9d0 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.892+0000 7fa5844d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c148820 con 0x7fa57c0cc520 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55902/0 (socket says 172.21.15.93:55902) 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 -- 172.21.15.93:0/4014480520 learned_addr learned my addr 172.21.15.93:0/4014480520 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582270640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa57c0cc520 0x7fa57c1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa581a6f640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 -- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa57c0cc520 msgr2=0x7fa57c1482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa57c0cc520 0x7fa57c1482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 -- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 msgr2=0x7fa57c0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 -- 172.21.15.93:0/4014480520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57400bd40 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa581a6f640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa582a71640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa57402e790 tx=0x7fa574004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa572ffd640 1 -- 172.21.15.93:0/4014480520 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574043850 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa572ffd640 1 -- 172.21.15.93:0/4014480520 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740439b0 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c0b00a0 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa572ffd640 1 -- 172.21.15.93:0/4014480520 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574043d60 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.893+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c0b0660 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.895+0000 7fa572ffd640 1 -- 172.21.15.93:0/4014480520 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa574041410 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.895+0000 7fa572ffd640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 0x7fa56006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.895+0000 7fa572ffd640 1 -- 172.21.15.93:0/4014480520 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa5740ae200 con 0x7fa57c153850 2023-11-04T01:37:50.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.895+0000 7fa582270640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 0x7fa56006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.896+0000 7fa582270640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 0x7fa56006d330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa578006fd0 tx=0x7fa578008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.896+0000 7fa587063740 1 Processor -- start 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.896+0000 7fa587063740 1 -- start start 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d897e40 0x56389d8c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d7a3740 con 0x56389d8bfc10 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d8058d0 con 0x56389d8e03d0 2023-11-04T01:37:50.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56389d802fc0 con 0x56389d897e40 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55908/0 (socket says 172.21.15.93:55908) 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 -- 172.21.15.93:0/3336163571 learned_addr learned my addr 172.21.15.93:0/3336163571 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa582270640 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa582a71640 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d897e40 0x56389d8c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 -- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d897e40 msgr2=0x56389d8c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d897e40 0x56389d8c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 -- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 msgr2=0x56389d8ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.897+0000 7fa581a6f640 1 -- 172.21.15.93:0/3336163571 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389d7c1ca0 con 0x56389d8bfc10 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa581a6f640 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0016a0 tx=0x7fa56c001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f459897df3410533 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa55ffff640 1 -- 172.21.15.93:0/3336163571 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0052e0 con 0x56389d8bfc10 2023-11-04T01:37:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa55ffff640 1 -- 172.21.15.93:0/3336163571 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c005440 con 0x56389d8bfc10 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa55ffff640 1 -- 172.21.15.93:0/3336163571 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00e960 con 0x56389d8bfc10 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 -- 172.21.15.93:0/3336163571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 msgr2=0x56389d897900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0016a0 tx=0x7fa56c001b60 comp rx=0 tx=0).stop 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 -- 172.21.15.93:0/3336163571 shutdown_connections 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d897e40 0x56389d8c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d897900 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 --2- 172.21.15.93:0/3336163571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.898+0000 7fa587063740 1 -- 172.21.15.93:0/3336163571 >> 172.21.15.93:0/3336163571 conn(0x56389d894a60 msgr2=0x56389d8dd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.899+0000 7fa587063740 1 -- 172.21.15.93:0/3336163571 shutdown_connections 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.899+0000 7fa587063740 1 -- 172.21.15.93:0/3336163571 wait complete. 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.899+0000 7fa587063740 1 -- start start 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.899+0000 7fa587063740 1 Processor -- start 2023-11-04T01:37:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 0x56389d8d9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d7fe8b0 con 0x56389d8e03d0 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d7b8c80 con 0x56389d8bbc70 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56389d7b8920 con 0x56389d8bfc10 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa587063740 10 client.0 _ll_register_callbacks cb 0x56389d510ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55922/0 (socket says 172.21.15.93:55922) 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 -- 172.21.15.93:0/917309840 learned_addr learned my addr 172.21.15.93:0/917309840 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa582a71640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 0x56389d8d9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa582270640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 -- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 msgr2=0x56389d8d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 -- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 msgr2=0x56389d8d9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 0x56389d8d9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa581a6f640 1 -- 172.21.15.93:0/917309840 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c00f040 con 0x56389d8e03d0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa582a71640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 0x56389d8d9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.900+0000 7fa582270640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa581a6f640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e530 tx=0x7fa56c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a315a6753a368a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0012e0 con 0x56389d8e03d0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa56c00ed30 con 0x56389d8e03d0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56389d7aabf0 con 0x56389d8e03d0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa56c0035f0 con 0x56389d8e03d0 2023-11-04T01:37:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 10 client.6180 fetch_fsmap learned FSMap version 23 2023-11-04T01:37:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56389d7fcf30 con 0x56389d8e03d0 2023-11-04T01:37:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56389d7aabf0 con 0x56389d8e03d0 2023-11-04T01:37:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa56c003750 con 0x56389d8e03d0 2023-11-04T01:37:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 10 client.6180 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:37:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 10 client.6180 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 20 client.6180 populate_metadata read hostname 'smithi093' 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c5610 0x56389d8c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 4 client.6180 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 --> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56389d7f7890 con 0x56389d8c5610 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.901+0000 7fa582270640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c5610 0x56389d8c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa55d7fa640 10 client.6180 ms_handle_connect on v2:172.21.15.93:6834/1137152814 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa582270640 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c5610 0x56389d8c59f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb59d1ca5e8c5b4 server_cookie=49436784ab760b8c in_seq=0 out_seq=0 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa55d7fa640 1 -- 172.21.15.93:0/917309840 <== mds.0 v2:172.21.15.93:6834/1137152814 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56389d7f7890 con 0x56389d8c5610 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa55d7fa640 10 client.6180 handle_command_reply: tid=0 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 client.6180 shutdown 2023-11-04T01:37:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 msgr2=0x56389d8d9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e530 tx=0x7fa56c000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 shutdown_connections 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c5610 0x56389d8c59f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8bbc70 0x56389d8d9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8e03d0 0x56389d8d9700 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa55d7fa640 0 client.6180 ms_handle_reset on v2:172.21.15.93:6834/1137152814 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 --2- 172.21.15.93:0/917309840 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 >> 172.21.15.93:0/917309840 conn(0x56389d897e40 msgr2=0x56389d8e07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.902+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 shutdown_connections 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.903+0000 7fa587063740 1 -- 172.21.15.93:0/917309840 wait complete. 2023-11-04T01:37:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.903+0000 7fa587063740 20 client.6180 trim_cache size 0 max 16384 2023-11-04T01:37:50.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.918+0000 7fa587063740 1 Processor -- start 2023-11-04T01:37:50.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.918+0000 7fa587063740 1 -- start start 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d77e280 con 0x56389d8bbc70 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d8e0c00 con 0x56389d8e03d0 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56389d895ff0 con 0x56389d8bfc10 2023-11-04T01:37:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55930/0 (socket says 172.21.15.93:55930) 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 -- 172.21.15.93:0/3542963965 learned_addr learned my addr 172.21.15.93:0/3542963965 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa581a6f640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 -- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 msgr2=0x56389d8d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582a71640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 -- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 msgr2=0x56389d8d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 -- 172.21.15.93:0/3542963965 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389d79ad10 con 0x56389d8bbc70 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa581a6f640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582a71640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa582270640 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa57800fca0 tx=0x7fa578015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88a2bba8c53dde4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa570ff9640 1 -- 172.21.15.93:0/3542963965 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578028070 con 0x56389d8bbc70 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa570ff9640 1 -- 172.21.15.93:0/3542963965 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800fed0 con 0x56389d8bbc70 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.919+0000 7fa570ff9640 1 -- 172.21.15.93:0/3542963965 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578023640 con 0x56389d8bbc70 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- 172.21.15.93:0/3542963965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 msgr2=0x56389d8dd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa57800fca0 tx=0x7fa578015000 comp rx=0 tx=0).stop 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- 172.21.15.93:0/3542963965 shutdown_connections 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bfc10 0x56389d8d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 --2- 172.21.15.93:0/3542963965 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bbc70 0x56389d8dd6f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- 172.21.15.93:0/3542963965 >> 172.21.15.93:0/3542963965 conn(0x56389d897e40 msgr2=0x56389d8dad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- 172.21.15.93:0/3542963965 shutdown_connections 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- 172.21.15.93:0/3542963965 wait complete. 2023-11-04T01:37:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 -- start start 2023-11-04T01:37:50.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.920+0000 7fa587063740 1 Processor -- start 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bbc70 0x56389d8d7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d897410 con 0x56389d8bfc10 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389d8c3690 con 0x56389d8e03d0 2023-11-04T01:37:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56389d946950 con 0x56389d8bbc70 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa587063740 10 client.0 _ll_register_callbacks cb 0x7fa56c007f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa581a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55936/0 (socket says 172.21.15.93:55936) 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa581a6f640 1 -- 172.21.15.93:0/2197897535 learned_addr learned my addr 172.21.15.93:0/2197897535 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa582270640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bbc70 0x56389d8d7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.921+0000 7fa582a71640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 -- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bbc70 msgr2=0x56389d8d7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bbc70 0x56389d8d7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 -- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 msgr2=0x56389d8c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 -- 172.21.15.93:0/2197897535 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57800e040 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa581a6f640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e530 tx=0x7fa56c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f92cf78c09c4c9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007db0 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa56c001510 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa56c005440 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa56c0012e0 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 10 client.6186 fetch_fsmap learned FSMap version 23 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56389d7c0500 con 0x56389d8bfc10 2023-11-04T01:37:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c005440 con 0x56389d8bfc10 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa56c0273f0 con 0x56389d8bfc10 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 10 client.6186 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 10 client.6186 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 20 client.6186 populate_metadata read hostname 'smithi093' 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c6740 0x56389d8c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 4 client.6186 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.922+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 --> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56389d7f75b0 con 0x56389d8c6740 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa582270640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c6740 0x56389d8c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa55d7fa640 10 client.6186 ms_handle_connect on v2:172.21.15.93:6834/1137152814 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa582270640 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c6740 0x56389d8c2c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a118148fe391d16 server_cookie=645ecbb785a778be in_seq=0 out_seq=0 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa55d7fa640 1 -- 172.21.15.93:0/2197897535 <== mds.0 v2:172.21.15.93:6834/1137152814 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56389d7f75b0 con 0x56389d8c6740 2023-11-04T01:37:50.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa55d7fa640 10 client.6186 handle_command_reply: tid=0 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 client.6186 shutdown 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 msgr2=0x56389d8d7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e530 tx=0x7fa56c012000 comp rx=0 tx=0).stop 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 shutdown_connections 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:6834/1137152814,v1:172.21.15.93:6836/1137152814] conn(0x56389d8c6740 0x56389d8c2c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56389d8e03d0 0x56389d8c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56389d8bfc10 0x56389d8d7880 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 --2- 172.21.15.93:0/2197897535 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56389d8bbc70 0x56389d8d7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa55d7fa640 0 client.6186 ms_handle_reset on v2:172.21.15.93:6834/1137152814 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 >> 172.21.15.93:0/2197897535 conn(0x56389d897e40 msgr2=0x56389d8db0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 shutdown_connections 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 1 -- 172.21.15.93:0/2197897535 wait complete. 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.923+0000 7fa587063740 20 client.6186 trim_cache size 0 max 16384 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:37:50.933 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 6006, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 9.1986467730000001, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 23, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 54, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 54, 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 14.273806480999999 2023-11-04T01:37:50.934 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 msgr2=0x7fa56006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 0x7fa56006d330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa578006fd0 tx=0x7fa578008040 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 msgr2=0x7fa57c156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa57402e790 tx=0x7fa574004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 shutdown_connections 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa56006ae70 0x7fa56006d330 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa57c153850 0x7fa57c156000 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa57c0cc9d0 0x7fa57c0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 --2- 172.21.15.93:0/4014480520 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa57c0cc520 0x7fa57c1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 >> 172.21.15.93:0/4014480520 conn(0x7fa57c0ce950 msgr2=0x7fa57c152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 shutdown_connections 2023-11-04T01:37:50.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:50.924+0000 7fa5844d4640 1 -- 172.21.15.93:0/4014480520 wait complete. 2023-11-04T01:37:50.937 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.034+0000 7ff657e4f640 1 Processor -- start 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 -- start start 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6500ce240 0x7ff650157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff6500d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65015e000 con 0x7ff6500cde60 2023-11-04T01:37:51.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65015e5c0 con 0x7ff6500ce240 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.035+0000 7ff657e4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65015e2e0 con 0x7ff650157540 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6500ce240 0x7ff650157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6500ce240 0x7ff650157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55950/0 (socket says 172.21.15.93:55950) 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 -- 172.21.15.93:0/238486720 learned_addr learned my addr 172.21.15.93:0/238486720 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6563ec640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff6500d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 -- 172.21.15.93:0/238486720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 msgr2=0x7ff6500d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff6500d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 -- 172.21.15.93:0/238486720 >> v1:172.21.15.125:6789/0 conn(0x7ff6500cde60 legacy=0x7ff65015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6553ea640 1 -- 172.21.15.93:0/238486720 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6500d1120 con 0x7ff6500ce240 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.036+0000 7ff6563ec640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff6500d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff6553ea640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500ce240 0x7ff650157000 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff640009870 tx=0x7ff64002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365b1b1c553626cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff654be9640 1 -- 172.21.15.93:0/238486720 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640031640 con 0x7ff6500ce240 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff654be9640 1 -- 172.21.15.93:0/238486720 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400317a0 con 0x7ff6500ce240 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff654be9640 1 -- 172.21.15.93:0/238486720 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640031b30 con 0x7ff6500ce240 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 -- 172.21.15.93:0/238486720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500ce240 msgr2=0x7ff650157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500ce240 0x7ff650157000 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff640009870 tx=0x7ff64002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 -- 172.21.15.93:0/238486720 shutdown_connections 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff6500d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 --2- 172.21.15.93:0/238486720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500ce240 0x7ff650157000 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 -- 172.21.15.93:0/238486720 >> 172.21.15.93:0/238486720 conn(0x7ff650071f30 msgr2=0x7ff6500cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 -- 172.21.15.93:0/238486720 shutdown_connections 2023-11-04T01:37:51.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.037+0000 7ff657e4f640 1 -- 172.21.15.93:0/238486720 wait complete. 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 Processor -- start 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 -- start start 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6500ce240 0x7ff650151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff65015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650151640 con 0x7ff6500cde60 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff650152440 con 0x7ff6500ce240 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff657e4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff650150360 con 0x7ff650157540 2023-11-04T01:37:51.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff655beb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff655beb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55960/0 (socket says 172.21.15.93:55960) 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.039+0000 7ff655beb640 1 -- 172.21.15.93:0/2944639773 learned_addr learned my addr 172.21.15.93:0/2944639773 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6563ec640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff65015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6553ea640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6500ce240 0x7ff650151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 -- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 msgr2=0x7ff65015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff65015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 -- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6500ce240 msgr2=0x7ff650151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6500ce240 0x7ff650151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 -- 172.21.15.93:0/2944639773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400094d0 con 0x7ff6500cde60 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6563ec640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff65015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff655beb640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c460 tx=0x7ff64c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c012830 con 0x7ff6500cde60 2023-11-04T01:37:51.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c0129d0 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff650151830 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c012d80 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.040+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff650151df0 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.041+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff650074290 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.041+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff64c01a3b0 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.042+0000 7ff6467fc640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 0x7ff63406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.042+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff64c0897c0 con 0x7ff6500cde60 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.042+0000 7ff6553ea640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 0x7ff63406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.042+0000 7ff6553ea640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 0x7ff63406d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff640036000 tx=0x7ff64003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.046+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff64c0545d0 con 0x7ff6500cde60 2023-11-04T01:37:51.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.248+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff65006a750 con 0x7ff6500cde60 2023-11-04T01:37:51.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.248+0000 7ff6467fc640 1 -- 172.21.15.93:0/2944639773 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff64c057bf0 con 0x7ff6500cde60 2023-11-04T01:37:51.250 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 msgr2=0x7ff63406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 0x7ff63406d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff640036000 tx=0x7ff64003c040 comp rx=0 tx=0).stop 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 msgr2=0x7ff65014f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c460 tx=0x7ff64c00c920 comp rx=0 tx=0).stop 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 shutdown_connections 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff63406ae70 0x7ff63406d330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff650157540 0x7ff65015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6500ce240 0x7ff650151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 --2- 172.21.15.93:0/2944639773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6500cde60 0x7ff65014f530 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 >> 172.21.15.93:0/2944639773 conn(0x7ff650071f30 msgr2=0x7ff6500d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 shutdown_connections 2023-11-04T01:37:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:51.250+0000 7ff657e4f640 1 -- 172.21.15.93:0/2944639773 wait complete. 2023-11-04T01:37:51.262 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:51.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:51.263 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:51.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.263 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:37:51.279 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:51.279 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:51.279 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:51.279 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.279 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:51.280 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41729sec preferred_lft 41729sec 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.281 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:51.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.283 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:51.300 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:51.322 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:51.344 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:37:51.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.346 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:51.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:51.427 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:37:51.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.521 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:37:51.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:37:51.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:37:51.536 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:51.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.536 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:37:51.602 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:37:51.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:51.603 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:51.657 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:51.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:51.658 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:51.712 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:51.768 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:51.769 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:51.770 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:51.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.772 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:51.824 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:51.824 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:37:51.867 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:51.882 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:51.883 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:51.884 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:51.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:51.885 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:51.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:37:51.954+0000 7fe75866f480 -1 init, newargv = 0x5628cee39810 newargc=15 2023-11-04T01:37:51.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[138591]: starting ceph client 2023-11-04T01:37:51.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[138591]: starting fuse 2023-11-04T01:37:53.038 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:37:53.058 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:53.059 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:37:53.060 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:53.061 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:53.061 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:53.061 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:53.061 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:53.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:53.062 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:37:53.116 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:37:53.116 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:37:53.116 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:53.117 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:37:53.118 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:37:53.244 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.138591.asok 2023-11-04T01:37:53.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:53.255 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.138591.asok 2023-11-04T01:37:53.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:53.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.138591.asok status 2023-11-04T01:37:53.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "138591", 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 6195, 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 6195 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 424965372 2023-11-04T01:37:53.425 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 424965372 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.6195 192.168.0.1:0/424965372", 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/424965372", 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 23, 2023-11-04T01:37:53.426 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 54, 2023-11-04T01:37:53.427 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:53.427 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:37:53.427 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:37:53.427 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:37:53.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:53.437 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:53.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:53.437 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:53.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:53.495 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:37:53.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:53.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:53.502 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:53.502 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:53.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:53.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:53.568 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:37:53.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 Processor -- start 2023-11-04T01:37:53.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 -- start start 2023-11-04T01:37:53.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe3ed0 0x56374cf0f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe7350 0x56374cf53f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374cec2ac0 con 0x7f1890003a70 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374cebe3b0 con 0x56374cfe7350 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a583bf40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56374ce58650 con 0x56374cfe3ed0 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a2b27640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a2b27640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46792/0 (socket says 172.21.15.93:46792) 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a2b27640 1 -- 172.21.15.93:0/583492382 learned_addr learned my addr 172.21.15.93:0/583492382 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f189bfff640 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe3ed0 0x56374cf0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.607+0000 7f18a3328640 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe7350 0x56374cf53f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 -- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe3ed0 msgr2=0x56374cf0f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe3ed0 0x56374cf0f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 -- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe7350 msgr2=0x56374cf53f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe7350 0x56374cf53f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 -- 172.21.15.93:0/583492382 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56374ce57930 con 0x7f1890003a70 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a2b27640 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1894009840 tx=0x7f1894005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49eb4a06c5224f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a1b25640 1 -- 172.21.15.93:0/583492382 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400f050 con 0x7f1890003a70 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a1b25640 1 -- 172.21.15.93:0/583492382 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894010040 con 0x7f1890003a70 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a1b25640 1 -- 172.21.15.93:0/583492382 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894008b90 con 0x7f1890003a70 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 -- 172.21.15.93:0/583492382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 msgr2=0x56374cf3bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1894009840 tx=0x7f1894005a00 comp rx=0 tx=0).stop 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 -- 172.21.15.93:0/583492382 shutdown_connections 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe7350 0x56374cf53f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe3ed0 0x56374cf0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 --2- 172.21.15.93:0/583492382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf3bb90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 -- 172.21.15.93:0/583492382 >> 172.21.15.93:0/583492382 conn(0x56374cf57670 msgr2=0x56374cf59630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 -- 172.21.15.93:0/583492382 shutdown_connections 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.608+0000 7f18a583bf40 1 -- 172.21.15.93:0/583492382 wait complete. 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.609+0000 7f18a583bf40 1 Processor -- start 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.609+0000 7f18a583bf40 1 -- start start 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe3ed0 0x56374cf3f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 0x56374cfd78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ce582f0 con 0x7f1890003a70 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ce384f0 con 0x56374cfe3ed0 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56374cfe6d40 con 0x56374cfe7350 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46796/0 (socket says 172.21.15.93:46796) 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 -- 172.21.15.93:0/1167913466 learned_addr learned my addr 172.21.15.93:0/1167913466 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a2b27640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe3ed0 0x56374cf3f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f189bfff640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 0x56374cfd78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 -- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 msgr2=0x56374cfd78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 0x56374cfd78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 -- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe3ed0 msgr2=0x56374cf3f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe3ed0 0x56374cf3f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 -- 172.21.15.93:0/1167913466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009410 con 0x7f1890003a70 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f189bfff640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 0x56374cfd78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a3328640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f189c001740 tx=0x7f18900040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c05e670 con 0x7f1890003a70 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c05e7f0 con 0x7f1890003a70 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c05eba0 con 0x7f1890003a70 2023-11-04T01:37:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56374ce57390 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.610+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56374cfe6f50 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f189c05ed00 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a0b23640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 0x7f188406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a2b27640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 0x7f188406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f189c0c9220 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(create snap pool 9 tid 1 name snap1 v0) v4 -- 0x56374cec8330 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.612+0000 7f18a0b23640 1 -- 172.21.15.93:0/1167913466 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7f189c0941a0 con 0x7f1890003a70 2023-11-04T01:37:53.623 INFO:teuthology.orchestra.run.smithi093.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a2b27640 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 0x7f188406bce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f189400c010 tx=0x7f1894014000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 msgr2=0x7f188406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 0x7f188406bce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f189400c010 tx=0x7f1894014000 comp rx=0 tx=0).stop 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 msgr2=0x56374cf0de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f189c001740 tx=0x7f18900040e0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 shutdown_connections 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1884069820 0x7f188406bce0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1890003a70 0x56374cf0de30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56374cfe7350 0x56374cfd78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 --2- 172.21.15.93:0/1167913466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56374cfe3ed0 0x56374cf3f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 >> 172.21.15.93:0/1167913466 conn(0x56374cf57670 msgr2=0x56374cf59630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 shutdown_connections 2023-11-04T01:37:53.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.613+0000 7f18a583bf40 1 -- 172.21.15.93:0/1167913466 wait complete. 2023-11-04T01:37:53.626 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:37:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.698+0000 7ff3df04ff40 1 Processor -- start 2023-11-04T01:37:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.698+0000 7ff3df04ff40 1 -- start start 2023-11-04T01:37:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3c4002260 0x55731811d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557318122320 0x55731807d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557318005ac0 con 0x55731809add0 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573180013b0 con 0x557318122320 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x557317f9b650 con 0x7ff3c4002260 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46812/0 (socket says 172.21.15.93:46812) 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1141065943 learned_addr learned my addr 172.21.15.93:0/1141065943 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3c4002260 msgr2=0x55731811d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3c4002260 0x55731811d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557318122320 msgr2=0x55731807d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557318122320 0x55731807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1141065943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557317f9a930 con 0x55731809add0 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5573180803b0 tx=0x7ff3d4001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07a7a0a0fde1d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dac18640 1 -- 172.21.15.93:0/1141065943 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4015030 con 0x55731809add0 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dac18640 1 -- 172.21.15.93:0/1141065943 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400f650 con 0x55731809add0 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.699+0000 7ff3dac18640 1 -- 172.21.15.93:0/1141065943 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400fa00 con 0x55731809add0 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1141065943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 msgr2=0x5573181247c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5573180803b0 tx=0x7ff3d4001760 comp rx=0 tx=0).stop 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1141065943 shutdown_connections 2023-11-04T01:37:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55731809add0 0x5573181247c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557318122320 0x55731807d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1141065943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3c4002260 0x55731811d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1141065943 >> 172.21.15.93:0/1141065943 conn(0x55731807df40 msgr2=0x557318122fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1141065943 shutdown_connections 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1141065943 wait complete. 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 Processor -- start 2023-11-04T01:37:53.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.700+0000 7ff3df04ff40 1 -- start start 2023-11-04T01:37:53.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:53.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 0x557318119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 0x55731807cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557317f9b2f0 con 0x7ff3c4002260 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x557317f7b4f0 con 0x55731809add0 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3df04ff40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573180965c0 con 0x557318122320 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46818/0 (socket says 172.21.15.93:46818) 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1992478088 learned_addr learned my addr 172.21.15.93:0/1992478088 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dbc1a640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 0x55731807cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dc41b640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 0x557318119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 msgr2=0x55731807cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 0x55731807cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 msgr2=0x557318119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 0x557318119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 -- 172.21.15.93:0/1992478088 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557317fa7780 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dc41b640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 0x557318119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dbc1a640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 0x55731807cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.701+0000 7ff3dcc1c640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4016040 tx=0x557318080100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.702+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401c910 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.702+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d401ca70 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.702+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557317f9a390 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.702+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401cde0 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.702+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557318096b80 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.703+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3d4018070 con 0x7ff3c4002260 2023-11-04T01:37:53.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.703+0000 7ff3d9c16640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 0x7ff3c806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.703+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff3d4016070 con 0x7ff3c4002260 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.703+0000 7ff3dc41b640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 0x7ff3c806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.703+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(create snap pool 8 tid 1 name snap2 v0) v4 -- 0x55731800b330 con 0x7ff3c4002260 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3d9c16640 1 -- 172.21.15.93:0/1992478088 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7ff3d40556e0 con 0x7ff3c4002260 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 msgr2=0x7ff3c806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3dc41b640 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 0x7ff3c806bce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc054000 tx=0x7ff3cc04c070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 0x7ff3c806bce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc054000 tx=0x7ff3cc04c070 comp rx=0 tx=0).stop 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 msgr2=0x5573180532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4016040 tx=0x557318080100 comp rx=0 tx=0).stop 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 shutdown_connections 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c8069820 0x7ff3c806bce0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3c4002260 0x5573180532b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x557318122320 0x55731807cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 --2- 172.21.15.93:0/1992478088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55731809add0 0x557318119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 >> 172.21.15.93:0/1992478088 conn(0x55731807df40 msgr2=0x5573180506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 shutdown_connections 2023-11-04T01:37:53.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.704+0000 7ff3df04ff40 1 -- 172.21.15.93:0/1992478088 wait complete. 2023-11-04T01:37:53.712 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:37:53.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.850+0000 7f52123d7640 1 Processor -- start 2023-11-04T01:37:53.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.850+0000 7f52123d7640 1 -- start start 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f52123d7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f520c153850 0x7f520c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f52123d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f52123d7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0c3860 con 0x7f520c0cc9a0 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f52123d7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0c9250 con 0x7f520c153850 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f52123d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c153c30 con 0x7f520c0cc520 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f520c153850 0x7f520c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f520c153850 0x7f520c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46822/0 (socket says 172.21.15.93:46822) 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520bfff640 1 -- 172.21.15.93:0/3034671831 learned_addr learned my addr 172.21.15.93:0/3034671831 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520b7fe640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520bfff640 1 -- 172.21.15.93:0/3034671831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 msgr2=0x7f520c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.851+0000 7f520bfff640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520bfff640 1 -- 172.21.15.93:0/3034671831 >> v1:172.21.15.125:6789/0 conn(0x7f520c0cc9a0 legacy=0x7f520c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520bfff640 1 -- 172.21.15.93:0/3034671831 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c15a700 con 0x7f520c153850 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520b7fe640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520bfff640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c15a1c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d41f8a5b74f31a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520affd640 1 -- 172.21.15.93:0/3034671831 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc031640 con 0x7f520c153850 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520affd640 1 -- 172.21.15.93:0/3034671831 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0317a0 con 0x7f520c153850 2023-11-04T01:37:53.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.852+0000 7f520affd640 1 -- 172.21.15.93:0/3034671831 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc031b30 con 0x7f520c153850 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 -- 172.21.15.93:0/3034671831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 msgr2=0x7f520c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c15a1c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 -- 172.21.15.93:0/3034671831 shutdown_connections 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 --2- 172.21.15.93:0/3034671831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c15a1c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 -- 172.21.15.93:0/3034671831 >> 172.21.15.93:0/3034671831 conn(0x7f520c0ce950 msgr2=0x7f520c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 -- 172.21.15.93:0/3034671831 shutdown_connections 2023-11-04T01:37:53.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.853+0000 7f52123d7640 1 -- 172.21.15.93:0/3034671831 wait complete. 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.854+0000 7f52123d7640 1 Processor -- start 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.854+0000 7f52123d7640 1 -- start start 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c06c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520c0cc9a0 0x7f520c13de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c13e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c13e910 con 0x7f520c153850 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0c6dd0 con 0x7f520c0cc9a0 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f52123d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1ef670 con 0x7f520c0cc520 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c13e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c13e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46834/0 (socket says 172.21.15.93:46834) 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 -- 172.21.15.93:0/536763476 learned_addr learned my addr 172.21.15.93:0/536763476 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f520b7fe640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520c0cc9a0 0x7f520c13de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f520bfff640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 -- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 msgr2=0x7f520c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f520c0cc520 0x7f520c06c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 -- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520c0cc9a0 msgr2=0x7f520c13de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f520c0cc9a0 0x7f520c13de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.855+0000 7f5210974640 1 -- 172.21.15.93:0/536763476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc0094d0 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f5210974640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f520c153850 0x7f520c13e3d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f520400c6d0 tx=0x7f520400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400a840 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520400a9a0 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f52123d7640 1 -- 172.21.15.93:0/536763476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c155ba0 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400ad50 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.856+0000 7f52123d7640 1 -- 172.21.15.93:0/536763476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c0c7310 con 0x7f520c153850 2023-11-04T01:37:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.857+0000 7f52123d7640 1 -- 172.21.15.93:0/536763476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c074290 con 0x7f520c153850 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.857+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5204012630 con 0x7f520c153850 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.857+0000 7f5208ff9640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f806ae70 0x7f51f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.858+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5204089ed0 con 0x7f520c153850 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.858+0000 7f520bfff640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f806ae70 0x7f51f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.858+0000 7f520bfff640 1 --2- 172.21.15.93:0/536763476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f51f806ae70 0x7f51f806d330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51fc036000 tx=0x7f51fc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:53.862+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5204054e20 con 0x7f520c153850 2023-11-04T01:37:54.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.027+0000 7f52123d7640 1 -- 172.21.15.93:0/536763476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f520c0c5010 con 0x7f520c153850 2023-11-04T01:37:54.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.028+0000 7f5208ff9640 1 -- 172.21.15.93:0/536763476 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v54) v1 ==== 131+0+0 (secure 0 0 0) 0x7f5204016070 con 0x7f520c153850 2023-11-04T01:37:54.029 INFO:teuthology.orchestra.run.smithi093.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:37:54.034 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:37:54.035 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:37:54.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.135+0000 7f733b8e5640 1 Processor -- start 2023-11-04T01:37:54.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.135+0000 7f733b8e5640 1 -- start start 2023-11-04T01:37:54.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73341605b0 0x7f73340ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73340b1a40 0x7f733406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73340ca560 0x7f733406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7334160990 con 0x7f73340ca560 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73340cc7c0 con 0x7f73340b1a40 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f733b8e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340cd750 con 0x7f73341605b0 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f7339e82640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73340ca560 0x7f733406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f7339e82640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73340ca560 0x7f733406a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46844/0 (socket says 172.21.15.93:46844) 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f7339e82640 1 -- 172.21.15.93:0/2327507391 learned_addr learned my addr 172.21.15.93:0/2327507391 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f7339681640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73341605b0 0x7f73340ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.136+0000 7f7338e80640 1 --2- 172.21.15.93:0/2327507391 >> v2:172.21.15.125:3300/0 conn(0x7f73340b1a40 0x7f733406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 -- 172.21.15.93:0/2327507391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73341605b0 msgr2=0x7f73340ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73341605b0 0x7f73340ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 -- 172.21.15.93:0/2327507391 >> v2:172.21.15.125:3300/0 conn(0x7f73340b1a40 msgr2=0x7f733406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 --2- 172.21.15.93:0/2327507391 >> v2:172.21.15.125:3300/0 conn(0x7f73340b1a40 0x7f733406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 -- 172.21.15.93:0/2327507391 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340cc4e0 con 0x7f73340ca560 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f7339e82640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73340ca560 0x7f733406a660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f733406edd0 tx=0x7f732c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed05f8e292302f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f732bfff640 1 -- 172.21.15.93:0/2327507391 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c02c950 con 0x7f73340ca560 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f732bfff640 1 -- 172.21.15.93:0/2327507391 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c02cab0 con 0x7f73340ca560 2023-11-04T01:37:54.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.137+0000 7f732bfff640 1 -- 172.21.15.93:0/2327507391 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c02ce40 con 0x7f73340ca560 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 -- 172.21.15.93:0/2327507391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73340ca560 msgr2=0x7f733406a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73340ca560 0x7f733406a660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f733406edd0 tx=0x7f732c02bdb0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 -- 172.21.15.93:0/2327507391 shutdown_connections 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73340ca560 0x7f733406a660 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 --2- 172.21.15.93:0/2327507391 >> v2:172.21.15.125:3300/0 conn(0x7f73340b1a40 0x7f733406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 --2- 172.21.15.93:0/2327507391 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73341605b0 0x7f73340ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 -- 172.21.15.93:0/2327507391 >> 172.21.15.93:0/2327507391 conn(0x7f7334071820 msgr2=0x7f7334071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 -- 172.21.15.93:0/2327507391 shutdown_connections 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.138+0000 7f733b8e5640 1 -- 172.21.15.93:0/2327507391 wait complete. 2023-11-04T01:37:54.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.139+0000 7f733b8e5640 1 Processor -- start 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.139+0000 7f733b8e5640 1 -- start start 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73340ca560 0x7f7334158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73341605b0 0x7f73340ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73340ade30 0x7f73340af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340ab8e0 con 0x7f73341605b0 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340abbc0 con 0x7f73340ade30 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f733b8e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340abea0 con 0x7f73340ca560 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73341605b0 0x7f73340ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73341605b0 0x7f73340ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46854/0 (socket says 172.21.15.93:46854) 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 -- 172.21.15.93:0/3910697044 learned_addr learned my addr 172.21.15.93:0/3910697044 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 -- 172.21.15.93:0/3910697044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73340ca560 msgr2=0x7f7334158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73340ca560 0x7f7334158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 -- 172.21.15.93:0/3910697044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73340ade30 msgr2=0x7f73340af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73340ade30 0x7f73340af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 -- 172.21.15.93:0/3910697044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009b30 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.140+0000 7f7338e80640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73341605b0 0x7f73340ad8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f732400d800 tx=0x7f732400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.141+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73240096a0 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.141+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324009800 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.141+0000 7f733b8e5640 1 -- 172.21.15.93:0/3910697044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73340ac180 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.141+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324009990 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.141+0000 7f733b8e5640 1 -- 172.21.15.93:0/3910697044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73340ac740 con 0x7f73341605b0 2023-11-04T01:37:54.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.142+0000 7f733b8e5640 1 -- 172.21.15.93:0/3910697044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73340672a0 con 0x7f73341605b0 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.142+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7324009af0 con 0x7f73341605b0 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.142+0000 7f7329ffb640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f731806ae70 0x7f731806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.143+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7324089d00 con 0x7f73341605b0 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.143+0000 7f7339681640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f731806ae70 0x7f731806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.143+0000 7f7339681640 1 --2- 172.21.15.93:0/3910697044 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f731806ae70 0x7f731806d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7330006fd0 tx=0x7f7330008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.147+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7324054ba0 con 0x7f73341605b0 2023-11-04T01:37:54.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.312+0000 7f733b8e5640 1 -- 172.21.15.93:0/3910697044 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f7334074290 con 0x7f73341605b0 2023-11-04T01:37:54.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.312+0000 7f7329ffb640 1 -- 172.21.15.93:0/3910697044 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v54) v1 ==== 135+0+0 (secure 0 0 0) 0x7f73240581c0 con 0x7f73341605b0 2023-11-04T01:37:54.313 INFO:teuthology.orchestra.run.smithi093.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:37:54.318 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:37:54.319 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:54.319 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:54.370 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:54.432 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:54.432 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:54.432 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:54.447 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:54.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.585+0000 7f1834ac9640 1 Processor -- start 2023-11-04T01:37:54.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.585+0000 7f1834ac9640 1 -- start start 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1834ac9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1834ac9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1834ac9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300cc990 con 0x7f18300cda60 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1834ac9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300ccc70 con 0x7f18300cde40 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1834ac9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300c9ce0 con 0x7f18300b0cd0 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46858/0 (socket says 172.21.15.93:46858) 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 -- 172.21.15.93:0/209609017 learned_addr learned my addr 172.21.15.93:0/209609017 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f1827fff640 1 --2- 172.21.15.93:0/209609017 >> v2:172.21.15.125:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 -- 172.21.15.93:0/209609017 >> v2:172.21.15.125:3300/0 conn(0x7f18300b0cd0 msgr2=0x7f1830070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 --2- 172.21.15.93:0/209609017 >> v2:172.21.15.125:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 -- 172.21.15.93:0/209609017 >> v1:172.21.15.125:6789/0 conn(0x7f18300cda60 legacy=0x7f18300ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.586+0000 7f182ed9d640 1 -- 172.21.15.93:0/209609017 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300c9fc0 con 0x7f18300cde40 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f182ed9d640 1 --2- 172.21.15.93:0/209609017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830070b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f183006e330 tx=0x7f182802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3791790b824ece server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f182dd9b640 1 -- 172.21.15.93:0/209609017 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182802ca80 con 0x7f18300cde40 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f182dd9b640 1 -- 172.21.15.93:0/209609017 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182802cbe0 con 0x7f18300cde40 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f182dd9b640 1 -- 172.21.15.93:0/209609017 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280343f0 con 0x7f18300cde40 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f1834ac9640 1 -- 172.21.15.93:0/209609017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 msgr2=0x7f1830070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.587+0000 7f1834ac9640 1 --2- 172.21.15.93:0/209609017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830070b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f183006e330 tx=0x7f182802bee0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 -- 172.21.15.93:0/209609017 shutdown_connections 2023-11-04T01:37:54.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 --2- 172.21.15.93:0/209609017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 --2- 172.21.15.93:0/209609017 >> v2:172.21.15.125:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 -- 172.21.15.93:0/209609017 >> 172.21.15.93:0/209609017 conn(0x7f18300ce950 msgr2=0x7f18300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 -- 172.21.15.93:0/209609017 shutdown_connections 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.588+0000 7f1834ac9640 1 -- 172.21.15.93:0/209609017 wait complete. 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.589+0000 7f1834ac9640 1 Processor -- start 2023-11-04T01:37:54.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.589+0000 7f1834ac9640 1 -- start start 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0cd0 0x7f18301f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18300cda60 0x7f1830159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f2b70 con 0x7f18300cde40 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300b1510 con 0x7f18300cda60 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300b17f0 con 0x7f18300b0cd0 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46874/0 (socket says 172.21.15.93:46874) 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 -- 172.21.15.93:0/2424219730 learned_addr learned my addr 172.21.15.93:0/2424219730 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1827fff640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18300cda60 0x7f1830159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182e59c640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0cd0 0x7f18301f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 -- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0cd0 msgr2=0x7f18301f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0cd0 0x7f18301f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 -- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18300cda60 msgr2=0x7f1830159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18300cda60 0x7f1830159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 -- 172.21.15.93:0/2424219730 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009b30 con 0x7f18300cde40 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f182ed9d640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1828036040 tx=0x7f1828004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828009510 con 0x7f18300cde40 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182803e450 con 0x7f18300cde40 2023-11-04T01:37:54.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182803e800 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.590+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18300b1ad0 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.591+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300b2090 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.591+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830074290 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.592+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f182802cd50 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.592+0000 7f1826ffd640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 0x7f181006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.592+0000 7f182e59c640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 0x7f181006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.592+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f18280ac410 con 0x7f18300cde40 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.593+0000 7f182e59c640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 0x7f181006d360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1820007fd0 tx=0x7f1820009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.596+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1828077360 con 0x7f18300cde40 2023-11-04T01:37:54.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.766+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18300c1de0 con 0x7f18300cde40 2023-11-04T01:37:54.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.767+0000 7f1826ffd640 1 -- 172.21.15.93:0/2424219730 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f182807a980 con 0x7f18300cde40 2023-11-04T01:37:54.768 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:42.715268+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:54.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 msgr2=0x7f181006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 0x7f181006d360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1820007fd0 tx=0x7f1820009040 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 msgr2=0x7f1830151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1828036040 tx=0x7f1828004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 shutdown_connections 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181006aea0 0x7f181006d360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300cde40 0x7f1830151150 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18300cda60 0x7f1830159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 --2- 172.21.15.93:0/2424219730 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0cd0 0x7f18301f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 >> 172.21.15.93:0/2424219730 conn(0x7f18300ce950 msgr2=0x7f18300afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 shutdown_connections 2023-11-04T01:37:54.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.769+0000 7f1834ac9640 1 -- 172.21.15.93:0/2424219730 wait complete. 2023-11-04T01:37:54.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:39.534714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:40.014955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:54.782 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:54.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.883+0000 7f6492355640 1 Processor -- start 2023-11-04T01:37:54.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.883+0000 7f6492355640 1 -- start start 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f6492355640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f648c0c4ff0 0x7f648c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f6492355640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c15aff0 con 0x7f648c159c00 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f6492355640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c15a3e0 con 0x7f648c0adac0 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f6492355640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c15a6c0 con 0x7f648c0c4ff0 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f648c159c00 0x7f648c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46250/0 (socket says 172.21.15.93:46250) 2023-11-04T01:37:54.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648bfff640 1 -- 172.21.15.93:0/2423691956 learned_addr learned my addr 172.21.15.93:0/2423691956 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038453262 0 0) 0x7f648c15aff0 con 0x7f648c159c00 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474003520 con 0x7f648c159c00 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2423691956 >> v2:172.21.15.125:3300/0 conn(0x7f648c0c4ff0 0x7f648c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830296089 0 0) 0x7f6474003520 con 0x7f648c159c00 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 >> v2:172.21.15.125:3300/0 conn(0x7f648c0c4ff0 msgr2=0x7f648c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 --2- 172.21.15.93:0/2423691956 >> v2:172.21.15.125:3300/0 conn(0x7f648c0c4ff0 0x7f648c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 >> v1:172.21.15.125:6789/0 conn(0x7f648c0adac0 legacy=0x7f648c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c15a9a0 con 0x7f648c159c00 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f647c001670 con 0x7f648c159c00 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 >> v1:172.21.15.93:6789/0 conn(0x7f648c159c00 legacy=0x7f648c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474003970 0x7f6474003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f647400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15a6c0 con 0x7f6474005180 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647400c020 con 0x7f64740047c0 2023-11-04T01:37:54.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.884+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647400c1e0 con 0x7f6474003970 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f647400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f648bfff640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474003970 0x7f6474003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 -- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474003970 msgr2=0x7f6474003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474003970 0x7f6474003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 -- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64740047c0 msgr2=0x7f6474004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 -- 172.21.15.93:0/2423691956 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474003520 con 0x7f6474005180 2023-11-04T01:37:54.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f648bfff640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6474003970 0x7f6474003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:54.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.885+0000 7f64908f2640 1 -- 172.21.15.93:0/2423691956 reap_dead start 2023-11-04T01:37:54.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f64908f2640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f647400b980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6484001e50 tx=0x7f64740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05a753bc4269b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484003b70 con 0x7f6474005180 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6484003d10 con 0x7f6474005180 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f648affd640 1 -- 172.21.15.93:0/2423691956 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484005310 con 0x7f6474005180 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 -- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 msgr2=0x7f647400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f647400b980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6484001e50 tx=0x7f64740057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 -- 172.21.15.93:0/2423691956 shutdown_connections 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 --2- 172.21.15.93:0/2423691956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f647400b980 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 -- 172.21.15.93:0/2423691956 >> 172.21.15.93:0/2423691956 conn(0x7f648c0ce950 msgr2=0x7f648c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 -- 172.21.15.93:0/2423691956 shutdown_connections 2023-11-04T01:37:54.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.886+0000 7f6492355640 1 -- 172.21.15.93:0/2423691956 wait complete. 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.887+0000 7f6492355640 1 Processor -- start 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 -- start start 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 0x7f648c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f648c0c7f70 0x7f648c140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c1594e0 con 0x7f6474005180 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c83f0 con 0x7f648c0c7f70 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f6492355640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c13de40 con 0x7f648c1f4590 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f648bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f648bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46890/0 (socket says 172.21.15.93:46890) 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.888+0000 7f648bfff640 1 -- 172.21.15.93:0/2250722489 learned_addr learned my addr 172.21.15.93:0/2250722489 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f64908f2640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f648c0c7f70 0x7f648c140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 0x7f648c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 -- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 msgr2=0x7f648c0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 0x7f648c0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 -- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f648c0c7f70 msgr2=0x7f648c140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f648c0c7f70 0x7f648c140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 -- 172.21.15.93:0/2250722489 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c14e5d0 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 0x7f648c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f648bfff640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e820 tx=0x7f647c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00eed0 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c00c870 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c14e8b0 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00cbe0 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.889+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c14ee70 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.890+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c13e0d0 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.891+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f647c00cd40 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.891+0000 7f6488ff9640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 0x7f647806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.891+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f647c089490 con 0x7f6474005180 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.891+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 0x7f647806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.891+0000 7f648b7fe640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 0x7f647806d360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f648c14f8f0 tx=0x7f6480008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:54.895+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f648c13e0d0 con 0x7f6474005180 2023-11-04T01:37:55.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.060+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f648c13e0d0 con 0x7f6474005180 2023-11-04T01:37:55.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.061+0000 7f6488ff9640 1 -- 172.21.15.93:0/2250722489 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f648c13e0d0 con 0x7f6474005180 2023-11-04T01:37:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:55.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 msgr2=0x7f647806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 0x7f647806d360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f648c14f8f0 tx=0x7f6480008040 comp rx=0 tx=0).stop 2023-11-04T01:37:55.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 msgr2=0x7f648c158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e820 tx=0x7f647c00ece0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 shutdown_connections 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f647806aea0 0x7f647806d360 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f648c0c7f70 0x7f648c140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f648c1f4590 0x7f648c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 --2- 172.21.15.93:0/2250722489 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6474005180 0x7f648c158fa0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 >> 172.21.15.93:0/2250722489 conn(0x7f648c0ce950 msgr2=0x7f648c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 shutdown_connections 2023-11-04T01:37:55.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.063+0000 7f6492355640 1 -- 172.21.15.93:0/2250722489 wait complete. 2023-11-04T01:37:55.075 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:55.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.174+0000 7ff7c8355640 1 Processor -- start 2023-11-04T01:37:55.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.174+0000 7ff7c8355640 1 -- start start 2023-11-04T01:37:55.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c8355640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7c00cc520 0x7ff7c0070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c8355640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00c3860 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c8355640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00c9250 con 0x7ff7c0153850 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c8355640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c0153c30 con 0x7ff7c00cc520 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c58f0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7c00cc520 0x7ff7c0070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c68f2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff7c00cc9d0 0x7ff7c00c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46266/0 (socket says 172.21.15.93:46266) 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c68f2640 1 -- 172.21.15.93:0/1094183825 learned_addr learned my addr 172.21.15.93:0/1094183825 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c58f0640 1 -- 172.21.15.93:0/1094183825 >> v1:172.21.15.125:6789/0 conn(0x7ff7c0153850 legacy=0x7ff7c015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c58f0640 1 -- 172.21.15.93:0/1094183825 >> v1:172.21.15.93:6789/0 conn(0x7ff7c00cc9d0 legacy=0x7ff7c00c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c50ef640 1 -- 172.21.15.93:0/1094183825 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779626051 0 0) 0x7ff7c00c3860 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.175+0000 7ff7c58f0640 1 -- 172.21.15.93:0/1094183825 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00ce590 con 0x7ff7c00cc520 2023-11-04T01:37:55.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.176+0000 7ff7c58f0640 1 --2- 172.21.15.93:0/1094183825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc520 0x7ff7c0070fa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000a940 tx=0x7ff7b002cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16aea0826a9d8624 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.176+0000 7ff7c50ef640 1 -- 172.21.15.93:0/1094183825 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b002db40 con 0x7ff7c00cc520 2023-11-04T01:37:55.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.176+0000 7ff7c50ef640 1 -- 172.21.15.93:0/1094183825 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b002dca0 con 0x7ff7c00cc520 2023-11-04T01:37:55.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.176+0000 7ff7c50ef640 1 -- 172.21.15.93:0/1094183825 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0035660 con 0x7ff7c00cc520 2023-11-04T01:37:55.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 -- 172.21.15.93:0/1094183825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc520 msgr2=0x7ff7c0070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 --2- 172.21.15.93:0/1094183825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc520 0x7ff7c0070fa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000a940 tx=0x7ff7b002cd90 comp rx=0 tx=0).stop 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 -- 172.21.15.93:0/1094183825 shutdown_connections 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 --2- 172.21.15.93:0/1094183825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc520 0x7ff7c0070fa0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 -- 172.21.15.93:0/1094183825 >> 172.21.15.93:0/1094183825 conn(0x7ff7c00ce950 msgr2=0x7ff7c00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 -- 172.21.15.93:0/1094183825 shutdown_connections 2023-11-04T01:37:55.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.177+0000 7ff7c8355640 1 -- 172.21.15.93:0/1094183825 wait complete. 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.178+0000 7ff7c8355640 1 Processor -- start 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.178+0000 7ff7c8355640 1 -- start start 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 0x7ff7c01eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 0x7ff7c0153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01571d0 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01565c0 con 0x7ff7c0153850 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01568a0 con 0x7ff7c00cc520 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46904/0 (socket says 172.21.15.93:46904) 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 -- 172.21.15.93:0/2152839980 learned_addr learned my addr 172.21.15.93:0/2152839980 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 -- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 msgr2=0x7ff7c01eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c68f2640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 0x7ff7c0153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c60f1640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 0x7ff7c01eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 0x7ff7c01eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 -- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 msgr2=0x7ff7c0153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 0x7ff7c0153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 -- 172.21.15.93:0/2152839980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b000a5a0 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c68f2640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 0x7ff7c0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c60f1640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 0x7ff7c01eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c58f0640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0038040 tx=0x7ff7b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b003f610 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b003f790 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0156b80 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b003fb40 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.179+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c01ef520 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.180+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0074290 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.181+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7b003c050 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.181+0000 7ff7b6ffd640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 0x7ff7a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.181+0000 7ff7c60f1640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 0x7ff7a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.181+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff7b00ad1d0 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.181+0000 7ff7c60f1640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 0x7ff7a406d360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00a810 tx=0x7ff7bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.185+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7b0078100 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.350+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff7c00c5010 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.351+0000 7ff7b6ffd640 1 -- 172.21.15.93:0/2152839980 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7b007b720 con 0x7ff7c00cc9d0 2023-11-04T01:37:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:55.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 msgr2=0x7ff7a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 0x7ff7a406d360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00a810 tx=0x7ff7bc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:55.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 msgr2=0x7ff7c0155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0038040 tx=0x7ff7b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 shutdown_connections 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff7a406aea0 0x7ff7a406d360 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7c0153850 0x7ff7c0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c00cc9d0 0x7ff7c0155cc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 --2- 172.21.15.93:0/2152839980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff7c00cc520 0x7ff7c01eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 >> 172.21.15.93:0/2152839980 conn(0x7ff7c00ce950 msgr2=0x7ff7c00cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 shutdown_connections 2023-11-04T01:37:55.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.353+0000 7ff7c8355640 1 -- 172.21.15.93:0/2152839980 wait complete. 2023-11-04T01:37:55.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.466+0000 7ff21a0a9640 1 Processor -- start 2023-11-04T01:37:55.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.466+0000 7ff21a0a9640 1 -- start start 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff21a0a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff214070ff0 0x7ff2140cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff21a0a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff21406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff21a0a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140c9bf0 con 0x7ff21415d1b0 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff21a0a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140cd890 con 0x7ff214070ff0 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff21a0a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140cdb30 con 0x7ff214066000 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2137fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff214070ff0 0x7ff2140cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff212ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff21415d1b0 0x7ff2140713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46282/0 (socket says 172.21.15.93:46282) 2023-11-04T01:37:55.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff212ffd640 1 -- 172.21.15.93:0/2848171935 learned_addr learned my addr 172.21.15.93:0/2848171935 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff213fff640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff21406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2137fe640 1 -- 172.21.15.93:0/2848171935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 msgr2=0x7ff21406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2137fe640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff21406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2137fe640 1 -- 172.21.15.93:0/2848171935 >> v1:172.21.15.93:6789/0 conn(0x7ff21415d1b0 legacy=0x7ff2140713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2137fe640 1 -- 172.21.15.93:0/2848171935 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140cde10 con 0x7ff214070ff0 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.467+0000 7ff2127fc640 1 -- 172.21.15.93:0/2848171935 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728268446 0 0) 0x7ff2140c9bf0 con 0x7ff21415d1b0 2023-11-04T01:37:55.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.468+0000 7ff2137fe640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff2140cb4e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e1ed3317b319b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.468+0000 7ff2127fc640 1 -- 172.21.15.93:0/2848171935 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204031830 con 0x7ff214070ff0 2023-11-04T01:37:55.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.468+0000 7ff2127fc640 1 -- 172.21.15.93:0/2848171935 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204031990 con 0x7ff214070ff0 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.468+0000 7ff2127fc640 1 -- 172.21.15.93:0/2848171935 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204031d20 con 0x7ff214070ff0 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 -- 172.21.15.93:0/2848171935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 msgr2=0x7ff2140cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff2140cb4e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 -- 172.21.15.93:0/2848171935 shutdown_connections 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff21406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/2848171935 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff2140cb4e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 -- 172.21.15.93:0/2848171935 >> 172.21.15.93:0/2848171935 conn(0x7ff2140cbc90 msgr2=0x7ff2140cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 -- 172.21.15.93:0/2848171935 shutdown_connections 2023-11-04T01:37:55.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.469+0000 7ff21a0a9640 1 -- 172.21.15.93:0/2848171935 wait complete. 2023-11-04T01:37:55.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.470+0000 7ff21a0a9640 1 Processor -- start 2023-11-04T01:37:55.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.470+0000 7ff21a0a9640 1 -- start start 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff2141f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff21415d1b0 0x7ff2140c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140b22b0 con 0x7ff214070ff0 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c4cc0 con 0x7ff21415d1b0 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff21a0a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c4700 con 0x7ff214066000 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46932/0 (socket says 172.21.15.93:46932) 2023-11-04T01:37:55.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 -- 172.21.15.93:0/1122792677 learned_addr learned my addr 172.21.15.93:0/1122792677 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 -- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 msgr2=0x7ff2141f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff2141f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 -- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff21415d1b0 msgr2=0x7ff2140c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff21415d1b0 0x7ff2140c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 -- 172.21.15.93:0/1122792677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009400 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff212ffd640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c4b0 tx=0x7ff20800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.471+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080074e0 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.472+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208007660 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.472+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208004a20 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.472+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140c49e0 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.472+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141f3ea0 con 0x7ff214070ff0 2023-11-04T01:37:55.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.473+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2140b23f0 con 0x7ff214070ff0 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.473+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff208004b80 con 0x7ff214070ff0 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.473+0000 7ff1fbfff640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 0x7ff20006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.473+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff208088a20 con 0x7ff214070ff0 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.473+0000 7ff2137fe640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 0x7ff20006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.474+0000 7ff2137fe640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 0x7ff20006d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff204036000 tx=0x7ff204030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.477+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2140b23f0 con 0x7ff214070ff0 2023-11-04T01:37:55.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.644+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2140b23f0 con 0x7ff214070ff0 2023-11-04T01:37:55.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.644+0000 7ff1fbfff640 1 -- 172.21.15.93:0/1122792677 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2140b23f0 con 0x7ff214070ff0 2023-11-04T01:37:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 msgr2=0x7ff20006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 0x7ff20006d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff204036000 tx=0x7ff204030000 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 msgr2=0x7ff21415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c4b0 tx=0x7ff20800c970 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 shutdown_connections 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff20006ae70 0x7ff20006d330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff21415d1b0 0x7ff2140c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff214070ff0 0x7ff21415b870 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 --2- 172.21.15.93:0/1122792677 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff214066000 0x7ff2141f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 >> 172.21.15.93:0/1122792677 conn(0x7ff2140cbc90 msgr2=0x7ff214160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 shutdown_connections 2023-11-04T01:37:55.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.646+0000 7ff21a0a9640 1 -- 172.21.15.93:0/1122792677 wait complete. 2023-11-04T01:37:55.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:55.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.759+0000 7f3a69ca9640 1 Processor -- start 2023-11-04T01:37:55.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.759+0000 7f3a69ca9640 1 -- start start 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a69ca9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a6415e430 0x7f3a640cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a69ca9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a69ca9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a640d0280 con 0x7f3a640cf160 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a69ca9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640cf670 con 0x7f3a6415e430 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a69ca9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640cf950 con 0x7f3a640d0710 2023-11-04T01:37:55.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a637fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a6415e430 0x7f3a640cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a637fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3a6415e430 0x7f3a640cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46936/0 (socket says 172.21.15.93:46936) 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a637fe640 1 -- 172.21.15.93:0/4011588604 learned_addr learned my addr 172.21.15.93:0/4011588604 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.760+0000 7f3a63fff640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a637fe640 1 -- 172.21.15.93:0/4011588604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 msgr2=0x7f3a640b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a637fe640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a637fe640 1 -- 172.21.15.93:0/4011588604 >> v1:172.21.15.125:6789/0 conn(0x7f3a640cf160 legacy=0x7f3a640cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a637fe640 1 -- 172.21.15.93:0/4011588604 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640cfc30 con 0x7f3a6415e430 2023-11-04T01:37:55.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a637fe640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a640cec20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009870 tx=0x7f3a5402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb90b3ff24057d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a62ffd640 1 -- 172.21.15.93:0/4011588604 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54030840 con 0x7f3a6415e430 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a62ffd640 1 -- 172.21.15.93:0/4011588604 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540309a0 con 0x7f3a6415e430 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.761+0000 7f3a62ffd640 1 -- 172.21.15.93:0/4011588604 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54030d30 con 0x7f3a6415e430 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 -- 172.21.15.93:0/4011588604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 msgr2=0x7f3a640cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a640cec20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009870 tx=0x7f3a5402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 -- 172.21.15.93:0/4011588604 shutdown_connections 2023-11-04T01:37:55.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/4011588604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a640cec20 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 -- 172.21.15.93:0/4011588604 >> 172.21.15.93:0/4011588604 conn(0x7f3a6406ea20 msgr2=0x7f3a6406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 -- 172.21.15.93:0/4011588604 shutdown_connections 2023-11-04T01:37:55.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.762+0000 7f3a69ca9640 1 -- 172.21.15.93:0/4011588604 wait complete. 2023-11-04T01:37:55.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.763+0000 7f3a69ca9640 1 Processor -- start 2023-11-04T01:37:55.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.763+0000 7f3a69ca9640 1 -- start start 2023-11-04T01:37:55.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a640cf160 0x7f3a64158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64155930 con 0x7f3a6415e430 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b1840 con 0x7f3a640cf160 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a69ca9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b1b20 con 0x7f3a640d0710 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46950/0 (socket says 172.21.15.93:46950) 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 -- 172.21.15.93:0/799996929 learned_addr learned my addr 172.21.15.93:0/799996929 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a637fe640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a640cf160 0x7f3a64158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a5affd640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 -- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 msgr2=0x7f3a640b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 -- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a640cf160 msgr2=0x7f3a64158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a640cf160 0x7f3a64158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.764+0000 7f3a63fff640 1 -- 172.21.15.93:0/799996929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540094d0 con 0x7f3a6415e430 2023-11-04T01:37:55.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a63fff640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c007e30 tx=0x7f3a5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c014620 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00ee90 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a640b1e00 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0149c0 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.765+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a640b1500 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.766+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a640b2040 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.766+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a5c014b20 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.767+0000 7f3a60ff9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 0x7f3a4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.767+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3a5c08a210 con 0x7f3a6415e430 2023-11-04T01:37:55.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.767+0000 7f3a637fe640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 0x7f3a4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.767+0000 7f3a637fe640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 0x7f3a4406d330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a54036000 tx=0x7f3a54008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.771+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a640b2040 con 0x7f3a6415e430 2023-11-04T01:37:55.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.935+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a640c42a0 con 0x7f3a6415e430 2023-11-04T01:37:55.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.935+0000 7f3a60ff9640 1 -- 172.21.15.93:0/799996929 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a640c42a0 con 0x7f3a6415e430 2023-11-04T01:37:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 msgr2=0x7f3a4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 0x7f3a4406d330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a54036000 tx=0x7f3a54008030 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 msgr2=0x7f3a641f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c007e30 tx=0x7f3a5c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 shutdown_connections 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3a4406ae70 0x7f3a4406d330 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a6415e430 0x7f3a641f39f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3a640d0710 0x7f3a640b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 --2- 172.21.15.93:0/799996929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a640cf160 0x7f3a64158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 >> 172.21.15.93:0/799996929 conn(0x7f3a6406ea20 msgr2=0x7f3a640b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 shutdown_connections 2023-11-04T01:37:55.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:55.937+0000 7f3a69ca9640 1 -- 172.21.15.93:0/799996929 wait complete. 2023-11-04T01:37:55.949 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:56.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.048+0000 7f2f02583640 1 Processor -- start 2023-11-04T01:37:56.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.048+0000 7f2f02583640 1 -- start start 2023-11-04T01:37:56.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2f02583640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2efc15ad30 0x7f2efc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2f02583640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2efc15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2f02583640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0c3900 con 0x7f2efc0ad730 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2f02583640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0ae260 con 0x7f2efc15ad30 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2f02583640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c3be0 con 0x7f2efc070e20 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2efb7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2efc0ad730 0x7f2efc070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46286/0 (socket says 172.21.15.93:46286) 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.049+0000 7f2efb7fe640 1 -- 172.21.15.93:0/74403156 learned_addr learned my addr 172.21.15.93:0/74403156 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efbfff640 1 --2- 172.21.15.93:0/74403156 >> v2:172.21.15.125:3300/0 conn(0x7f2efc15ad30 0x7f2efc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273348188 0 0) 0x7f2efc0c3900 con 0x7f2efc0ad730 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee4003520 con 0x7f2efc0ad730 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2efc15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128423004 0 0) 0x7f2ee4003520 con 0x7f2efc0ad730 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 msgr2=0x7f2efc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2efc15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 >> v2:172.21.15.125:3300/0 conn(0x7f2efc15ad30 msgr2=0x7f2efc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 --2- 172.21.15.93:0/74403156 >> v2:172.21.15.125:3300/0 conn(0x7f2efc15ad30 0x7f2efc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0c3ec0 con 0x7f2efc0ad730 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f2ef0001670 con 0x7f2efc0ad730 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 >> v1:172.21.15.93:6789/0 conn(0x7f2efc0ad730 legacy=0x7f2efc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee4003970 0x7f2ee4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2ee40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ee4004d00 0x7f2ee4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0ae260 con 0x7f2ee4004d00 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c3be0 con 0x7f2ee4003970 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400b9d0 con 0x7f2efc070e20 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ee4004d00 0x7f2ee4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2ee40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2efbfff640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee4003970 0x7f2ee4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 -- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 msgr2=0x7f2ee40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc070e20 0x7f2ee40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 -- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee4003970 msgr2=0x7f2ee4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ee4003970 0x7f2ee4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.050+0000 7f2f00b20640 1 -- 172.21.15.93:0/74403156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4003520 con 0x7f2ee4004d00 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.051+0000 7f2f00b20640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ee4004d00 0x7f2ee4005180 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400e170 tx=0x7f2ee40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fad1b8f3d51255 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.051+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef402cbf0 con 0x7f2ee4004d00 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.051+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400f040 con 0x7f2ee4004d00 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.051+0000 7f2efaffd640 1 -- 172.21.15.93:0/74403156 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4034440 con 0x7f2ee4004d00 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 -- 172.21.15.93:0/74403156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ee4004d00 msgr2=0x7f2ee4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 --2- 172.21.15.93:0/74403156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ee4004d00 0x7f2ee4005180 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400e170 tx=0x7f2ee40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f00b20640 1 -- 172.21.15.93:0/74403156 reap_dead start 2023-11-04T01:37:56.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 -- 172.21.15.93:0/74403156 shutdown_connections 2023-11-04T01:37:56.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 -- 172.21.15.93:0/74403156 >> 172.21.15.93:0/74403156 conn(0x7f2efc0ce950 msgr2=0x7f2efc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 -- 172.21.15.93:0/74403156 shutdown_connections 2023-11-04T01:37:56.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.052+0000 7f2f02583640 1 -- 172.21.15.93:0/74403156 wait complete. 2023-11-04T01:37:56.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.053+0000 7f2f02583640 1 Processor -- start 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.053+0000 7f2f02583640 1 -- start start 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 0x7f2efc1f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc154a90 0x7f2efc14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1f0da0 con 0x7f2efc1f1770 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1f0a50 con 0x7f2efc15a220 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc153aa0 con 0x7f2efc154a90 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46968/0 (socket says 172.21.15.93:46968) 2023-11-04T01:37:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 -- 172.21.15.93:0/1945839235 learned_addr learned my addr 172.21.15.93:0/1945839235 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efbfff640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 0x7f2efc1f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f00b20640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc154a90 0x7f2efc14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 -- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc154a90 msgr2=0x7f2efc14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc154a90 0x7f2efc14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 -- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 msgr2=0x7f2efc1f1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 0x7f2efc1f1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 -- 172.21.15.93:0/1945839235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc153d80 con 0x7f2efc1f1770 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efbfff640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 0x7f2efc1f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0007290 tx=0x7f2ef0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000f9a0 con 0x7f2efc1f1770 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000fb00 con 0x7f2efc1f1770 2023-11-04T01:37:56.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc154060 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.054+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000feb0 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.055+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc14de70 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.056+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc074290 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.056+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ef001d460 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.056+0000 7f2ef8ff9640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 0x7f2ee806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.056+0000 7f2efbfff640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 0x7f2ee806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.056+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2ef0089b70 con 0x7f2efc1f1770 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.057+0000 7f2efbfff640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 0x7f2ee806d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2efc159920 tx=0x7f2eec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.061+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ef0054980 con 0x7f2efc1f1770 2023-11-04T01:37:56.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.241+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2efc14f1d0 con 0x7f2efc1f1770 2023-11-04T01:37:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.241+0000 7f2ef8ff9640 1 -- 172.21.15.93:0/1945839235 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ef0057fa0 con 0x7f2efc1f1770 2023-11-04T01:37:56.243 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 msgr2=0x7f2ee806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 0x7f2ee806d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2efc159920 tx=0x7f2eec008040 comp rx=0 tx=0).stop 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 msgr2=0x7f2efc154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0007290 tx=0x7f2ef0007750 comp rx=0 tx=0).stop 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 shutdown_connections 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806aea0 0x7f2ee806d360 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc154a90 0x7f2efc14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc1f1770 0x7f2efc154550 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 --2- 172.21.15.93:0/1945839235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc15a220 0x7f2efc1f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 >> 172.21.15.93:0/1945839235 conn(0x7f2efc0ce950 msgr2=0x7f2efc15b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 shutdown_connections 2023-11-04T01:37:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.243+0000 7f2f02583640 1 -- 172.21.15.93:0/1945839235 wait complete. 2023-11-04T01:37:56.255 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:37:56.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:56.255 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:56.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:56.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[138591]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:56.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:56.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:56.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:37:56.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.322 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:37:56.336 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:56.337 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:56.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:56.356 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:37:56.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.356 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:37:56.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:56.413 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:37:56.413 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:37:56.413 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:56.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:37:56.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:37:56.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.429 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:37:56.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:56.486 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:37:56.486 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:37:56.486 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:56.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:37:56.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:37:56.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.505 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:37:56.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:56.564 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:37:56.564 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:56.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.661+0000 7f580ce5d640 1 Processor -- start 2023-11-04T01:37:56.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.661+0000 7f580ce5d640 1 -- start start 2023-11-04T01:37:56.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f580ce5d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f580815bfb0 0x7f58080cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f580ce5d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080cc450 con 0x7f58080cd860 2023-11-04T01:37:56.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f580ce5d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580815f400 con 0x7f580815ae40 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f580ce5d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580815b220 con 0x7f580815bfb0 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f5806d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f58080cd860 0x7f58080ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46302/0 (socket says 172.21.15.93:46302) 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f5806d9d640 1 -- 172.21.15.93:0/1697062988 learned_addr learned my addr 172.21.15.93:0/1697062988 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.662+0000 7f5805d9b640 1 --2- 172.21.15.93:0/1697062988 >> v2:172.21.15.125:3300/0 conn(0x7f580815bfb0 0x7f58080cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463640322 0 0) 0x7f57f8001110 con 0x7f58080cd860 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f0003520 con 0x7f58080cd860 2023-11-04T01:37:56.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 388859695 0 0) 0x7f57f0003520 con 0x7f58080cd860 2023-11-04T01:37:56.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 >> v2:172.21.15.125:3300/0 conn(0x7f580815bfb0 msgr2=0x7f58080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 --2- 172.21.15.93:0/1697062988 >> v2:172.21.15.125:3300/0 conn(0x7f580815bfb0 0x7f58080cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 >> v1:172.21.15.125:6789/0 conn(0x7f580815ae40 legacy=0x7f58080cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580815f890 con 0x7f58080cd860 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f57f8001800 con 0x7f58080cd860 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 >> v1:172.21.15.93:6789/0 conn(0x7f58080cd860 legacy=0x7f58080ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57f0005180 0x7f57f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580815b220 con 0x7f57f0003970 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f000c020 con 0x7f57f00047c0 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f000c1e0 con 0x7f57f0005180 2023-11-04T01:37:56.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f5805d9b640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f5806d9d640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57f0005180 0x7f57f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 -- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57f0005180 msgr2=0x7f57f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57f0005180 0x7f57f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 -- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57f00047c0 msgr2=0x7f57f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f580659c640 1 -- 172.21.15.93:0/1697062988 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f0003520 con 0x7f57f0003970 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f5806d9d640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f57f0005180 0x7f57f000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.663+0000 7f5806d9d640 1 -- 172.21.15.93:0/1697062988 reap_dead start 2023-11-04T01:37:56.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.664+0000 7f580659c640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5800001e50 tx=0x7f57f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605747c882fa951 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.664+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800003b70 con 0x7f57f0003970 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.664+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800003cd0 con 0x7f57f0003970 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.664+0000 7f580559a640 1 -- 172.21.15.93:0/1697062988 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800005310 con 0x7f57f0003970 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 -- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 msgr2=0x7f57f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5800001e50 tx=0x7f57f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 -- 172.21.15.93:0/1697062988 shutdown_connections 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1697062988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 -- 172.21.15.93:0/1697062988 >> 172.21.15.93:0/1697062988 conn(0x7f580806ea90 msgr2=0x7f580806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 -- 172.21.15.93:0/1697062988 shutdown_connections 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.665+0000 7f580ce5d640 1 -- 172.21.15.93:0/1697062988 wait complete. 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.666+0000 7f580ce5d640 1 Processor -- start 2023-11-04T01:37:56.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.666+0000 7f580ce5d640 1 -- start start 2023-11-04T01:37:56.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580814ebd0 0x7f58080c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58080ca300 0x7f58080c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c9ee0 con 0x7f57f0003970 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c6d00 con 0x7f580814ebd0 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580ce5d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580814f010 con 0x7f58080ca300 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46988/0 (socket says 172.21.15.93:46988) 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 -- 172.21.15.93:0/1119584736 learned_addr learned my addr 172.21.15.93:0/1119584736 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f5806d9d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58080ca300 0x7f58080c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f5805d9b640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580814ebd0 0x7f58080c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 -- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58080ca300 msgr2=0x7f58080c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58080ca300 0x7f58080c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 -- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580814ebd0 msgr2=0x7f58080c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580814ebd0 0x7f58080c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.667+0000 7f580659c640 1 -- 172.21.15.93:0/1119584736 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080c8920 con 0x7f57f0003970 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f580659c640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5800000f80 tx=0x7f58000014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580003e070 con 0x7f57f0003970 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580002f440 con 0x7f57f0003970 2023-11-04T01:37:56.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080c8c00 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580002f7d0 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.668+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080ca7b0 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.669+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080ce2d0 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.669+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f580002f930 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.670+0000 7f57f6ffd640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 0x7f57e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.670+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58000aaf00 con 0x7f57f0003970 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.670+0000 7f5805d9b640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 0x7f57e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.670+0000 7f5805d9b640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 0x7f57e806d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5808072b90 tx=0x7f57fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.674+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5800075da0 con 0x7f57f0003970 2023-11-04T01:37:56.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.878+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5808074290 con 0x7f57f0003970 2023-11-04T01:37:56.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.878+0000 7f57f6ffd640 1 -- 172.21.15.93:0/1119584736 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f5800047090 con 0x7f57f0003970 2023-11-04T01:37:56.881 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:56.883 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:56.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 msgr2=0x7f57e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 0x7f57e806d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5808072b90 tx=0x7f57fc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 msgr2=0x7f58080b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5800000f80 tx=0x7f58000014a0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 shutdown_connections 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f57e806ae70 0x7f57e806d330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f58080ca300 0x7f58080c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f580814ebd0 0x7f58080c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 --2- 172.21.15.93:0/1119584736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57f0003970 0x7f58080b2f10 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 >> 172.21.15.93:0/1119584736 conn(0x7f580806ea90 msgr2=0x7f580815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 shutdown_connections 2023-11-04T01:37:56.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.880+0000 7f580ce5d640 1 -- 172.21.15.93:0/1119584736 wait complete. 2023-11-04T01:37:56.896 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:56.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.993+0000 7f72c8ba9640 1 Processor -- start 2023-11-04T01:37:56.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.993+0000 7f72c8ba9640 1 -- start start 2023-11-04T01:37:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c8ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72c40b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c8ba9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40b1b80 con 0x7f72c40b14a0 2023-11-04T01:37:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c8ba9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40b1e60 con 0x7f72c415e1c0 2023-11-04T01:37:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c8ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b2140 con 0x7f72c406a830 2023-11-04T01:37:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c2d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f72c40b14a0 0x7f72c40b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46316/0 (socket says 172.21.15.93:46316) 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.994+0000 7f72c2d9d640 1 -- 172.21.15.93:0/3066127725 learned_addr learned my addr 172.21.15.93:0/3066127725 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72c40b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198277820 0 0) 0x7f72c40b1b80 con 0x7f72c40b14a0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003520 con 0x7f72c40b14a0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035975970 0 0) 0x7f72ac003520 con 0x7f72c40b14a0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 msgr2=0x7f72c40b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72c40b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 >> v1:172.21.15.125:6789/0 conn(0x7f72c415e1c0 legacy=0x7f72c406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40ca990 con 0x7f72c40b14a0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f72bc001670 con 0x7f72c40b14a0 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 >> v1:172.21.15.93:6789/0 conn(0x7f72c40b14a0 legacy=0x7f72c40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72ac0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72ac003ee0 0x7f72ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004d00 0x7f72ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b2140 con 0x7f72ac003ee0 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00b9e0 con 0x7f72ac004d00 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00bba0 con 0x7f72c406a830 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72ac003ee0 0x7f72ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c259c640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72ac0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c2d9d640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004d00 0x7f72ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 -- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 msgr2=0x7f72ac0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72c406a830 0x7f72ac0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 -- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004d00 msgr2=0x7f72ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004d00 0x7f72ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.995+0000 7f72c1d9b640 1 -- 172.21.15.93:0/3066127725 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac003520 con 0x7f72ac003ee0 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.996+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72ac003ee0 0x7f72ac0047c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009ac0 tx=0x7f72ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e972a9a9a7fa8917 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.996+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b802c600 con 0x7f72ac003ee0 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.996+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b802c760 con 0x7f72ac003ee0 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.996+0000 7f72c159a640 1 -- 172.21.15.93:0/3066127725 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b802caf0 con 0x7f72ac003ee0 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 -- 172.21.15.93:0/3066127725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72ac003ee0 msgr2=0x7f72ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/3066127725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72ac003ee0 0x7f72ac0047c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009ac0 tx=0x7f72ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c2d9d640 1 -- 172.21.15.93:0/3066127725 reap_dead start 2023-11-04T01:37:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 -- 172.21.15.93:0/3066127725 shutdown_connections 2023-11-04T01:37:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 -- 172.21.15.93:0/3066127725 >> 172.21.15.93:0/3066127725 conn(0x7f72c406d8b0 msgr2=0x7f72c406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 -- 172.21.15.93:0/3066127725 shutdown_connections 2023-11-04T01:37:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.997+0000 7f72c8ba9640 1 -- 172.21.15.93:0/3066127725 wait complete. 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.998+0000 7f72c8ba9640 1 Processor -- start 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.998+0000 7f72c8ba9640 1 -- start start 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72ac003ee0 0x7f72c40b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c40b4460 0x7f72c40cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b4910 con 0x7f72c40b31d0 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40cda00 con 0x7f72c40b4460 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c8ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b3670 con 0x7f72ac003ee0 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47010/0 (socket says 172.21.15.93:47010) 2023-11-04T01:37:57.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 -- 172.21.15.93:0/2685454042 learned_addr learned my addr 172.21.15.93:0/2685454042 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c2d9d640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c40b4460 0x7f72c40cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c259c640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72ac003ee0 0x7f72c40b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 -- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72ac003ee0 msgr2=0x7f72c40b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72ac003ee0 0x7f72c40b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 -- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c40b4460 msgr2=0x7f72c40cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c40b4460 0x7f72c40cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 -- 172.21.15.93:0/2685454042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40b3950 con 0x7f72c40b31d0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72c1d9b640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f72b802c1a0 tx=0x7f72b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:56.999+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8003810 con 0x7f72c40b31d0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.000+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8003970 con 0x7f72c40b31d0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.000+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c40b3c30 con 0x7f72c40b31d0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.000+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8003ce0 con 0x7f72c40b31d0 2023-11-04T01:37:57.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.000+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c41e47b0 con 0x7f72c40b31d0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.001+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c41e4970 con 0x7f72c40b31d0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.001+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72b8034440 con 0x7f72c40b31d0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.001+0000 7f72b2ffd640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.001+0000 7f72c259c640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.002+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f72b80ab7b0 con 0x7f72c40b31d0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.002+0000 7f72c259c640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 0x7f72a406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72c406ff30 tx=0x7f72b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.006+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72b80766e0 con 0x7f72c40b31d0 2023-11-04T01:37:57.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.176+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c40b4870 con 0x7f72c40b31d0 2023-11-04T01:37:57.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.177+0000 7f72b2ffd640 1 -- 172.21.15.93:0/2685454042 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f72b80a9e60 con 0x7f72c40b31d0 2023-11-04T01:37:57.181 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:42.715268+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:57.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 msgr2=0x7f72a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 0x7f72a406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72c406ff30 tx=0x7f72b4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:57.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 msgr2=0x7f72c40b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f72b802c1a0 tx=0x7f72b8004730 comp rx=0 tx=0).stop 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 shutdown_connections 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f72a406ae70 0x7f72a406d330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c40b4460 0x7f72c40cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72c40b31d0 0x7f72c40b3f20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 --2- 172.21.15.93:0/2685454042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f72ac003ee0 0x7f72c40b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 >> 172.21.15.93:0/2685454042 conn(0x7f72c406d8b0 msgr2=0x7f72c415b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 shutdown_connections 2023-11-04T01:37:57.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.179+0000 7f72c8ba9640 1 -- 172.21.15.93:0/2685454042 wait complete. 2023-11-04T01:37:57.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:39.534714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:40.014955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:57.193 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:57.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.294+0000 7f661cb33640 1 Processor -- start 2023-11-04T01:37:57.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.294+0000 7f661cb33640 1 -- start start 2023-11-04T01:37:57.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661cb33640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f661815d1b0 0x7f66180cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661cb33640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180c9bf0 con 0x7f6618070ff0 2023-11-04T01:37:57.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661cb33640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180cd890 con 0x7f6618066000 2023-11-04T01:37:57.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661cb33640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180cdb30 con 0x7f661815d1b0 2023-11-04T01:37:57.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661659c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6618070ff0 0x7f66180713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46318/0 (socket says 172.21.15.93:46318) 2023-11-04T01:37:57.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661659c640 1 -- 172.21.15.93:0/1353716680 learned_addr learned my addr 172.21.15.93:0/1353716680 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:57.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f6615d9b640 1 --2- 172.21.15.93:0/1353716680 >> v2:172.21.15.125:3300/0 conn(0x7f661815d1b0 0x7f66180cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337547267 0 0) 0x7f66180c9bf0 con 0x7f6618070ff0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.295+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6600003520 con 0x7f6618070ff0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522698279 0 0) 0x7f6600003520 con 0x7f6618070ff0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 >> v2:172.21.15.125:3300/0 conn(0x7f661815d1b0 msgr2=0x7f66180cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 --2- 172.21.15.93:0/1353716680 >> v2:172.21.15.125:3300/0 conn(0x7f661815d1b0 0x7f66180cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 >> v1:172.21.15.125:6789/0 conn(0x7f6618066000 legacy=0x7f661806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180cde10 con 0x7f6618070ff0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6608001670 con 0x7f6618070ff0 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 >> v1:172.21.15.93:6789/0 conn(0x7f6618070ff0 legacy=0x7f66180713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6600003970 0x7f6600003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 0x7f6600004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6600005180 0x7f660000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180cdb30 con 0x7f66000047c0 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660000c020 con 0x7f6600003970 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660000c1e0 con 0x7f6600005180 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 0x7f6600004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f661659c640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6600003970 0x7f6600003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6616d9d640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6600005180 0x7f660000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 -- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6600005180 msgr2=0x7f660000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6600005180 0x7f660000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 -- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6600003970 msgr2=0x7f6600003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6600003970 0x7f6600003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6615d9b640 1 -- 172.21.15.93:0/1353716680 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600003520 con 0x7f66000047c0 2023-11-04T01:37:57.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.296+0000 7f6616d9d640 1 -- 172.21.15.93:0/1353716680 reap_dead start 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.297+0000 7f6615d9b640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 0x7f6600004c40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f660c009a90 tx=0x7f66000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c09a8b48c2086ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.297+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c02c6b0 con 0x7f66000047c0 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.297+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c02c810 con 0x7f66000047c0 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.297+0000 7f661559a640 1 -- 172.21.15.93:0/1353716680 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c02cba0 con 0x7f66000047c0 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 -- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 msgr2=0x7f6600004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 0x7f6600004c40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f660c009a90 tx=0x7f66000057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 -- 172.21.15.93:0/1353716680 shutdown_connections 2023-11-04T01:37:57.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 --2- 172.21.15.93:0/1353716680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66000047c0 0x7f6600004c40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 -- 172.21.15.93:0/1353716680 >> 172.21.15.93:0/1353716680 conn(0x7f66180cbc90 msgr2=0x7f66180cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 -- 172.21.15.93:0/1353716680 shutdown_connections 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.298+0000 7f661cb33640 1 -- 172.21.15.93:0/1353716680 wait complete. 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.299+0000 7f661cb33640 1 Processor -- start 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.299+0000 7f661cb33640 1 -- start start 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66000047c0 0x7f66180c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66180c6820 0x7f66180b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180c6ca0 con 0x7f66180c3960 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180c5110 con 0x7f66180c6820 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66180b2f20 con 0x7f66000047c0 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47032/0 (socket says 172.21.15.93:47032) 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 -- 172.21.15.93:0/2902845546 learned_addr learned my addr 172.21.15.93:0/2902845546 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 -- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66000047c0 msgr2=0x7f66180c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66000047c0 0x7f66180c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 -- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66180c6820 msgr2=0x7f66180b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66180c6820 0x7f66180b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 -- 172.21.15.93:0/2902845546 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180b3200 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6615d9b640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f660c02c250 tx=0x7f660c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c003810 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c003970 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66180b34e0 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c003ce0 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.300+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66180c4d20 con 0x7f66180c3960 2023-11-04T01:37:57.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.301+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66180c4eb0 con 0x7f66180c3960 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.302+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f660c040450 con 0x7f66180c3960 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.302+0000 7f6606ffd640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 0x7f65f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.302+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f660c0ab7b0 con 0x7f66180c3960 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.302+0000 7f661659c640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 0x7f65f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.302+0000 7f661659c640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 0x7f65f806d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f66080011e0 tx=0x7f6608001150 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.306+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f660c0765c0 con 0x7f66180c3960 2023-11-04T01:37:57.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.472+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6618074290 con 0x7f66180c3960 2023-11-04T01:37:57.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.473+0000 7f6606ffd640 1 -- 172.21.15.93:0/2902845546 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f660c0a9e60 con 0x7f66180c3960 2023-11-04T01:37:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:37:57.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.474+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 msgr2=0x7f65f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.474+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 0x7f65f806d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f66080011e0 tx=0x7f6608001150 comp rx=0 tx=0).stop 2023-11-04T01:37:57.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 msgr2=0x7f66180c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f660c02c250 tx=0x7f660c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:57.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 shutdown_connections 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f65f806ae70 0x7f65f806d330 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66180c6820 0x7f66180b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180c3960 0x7f66180c62e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 --2- 172.21.15.93:0/2902845546 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66000047c0 0x7f66180c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 >> 172.21.15.93:0/2902845546 conn(0x7f66180cbc90 msgr2=0x7f6618160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 shutdown_connections 2023-11-04T01:37:57.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.475+0000 7f661cb33640 1 -- 172.21.15.93:0/2902845546 wait complete. 2023-11-04T01:37:57.488 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:37:57.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.588+0000 7f4befba5640 1 Processor -- start 2023-11-04T01:37:57.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.588+0000 7f4befba5640 1 -- start start 2023-11-04T01:37:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.588+0000 7f4befba5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4be815e3f0 0x7f4be80b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4befba5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4be80ca0a0 0x7f4be80cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4befba5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be80caa20 con 0x7f4be80cc300 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4befba5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be80cb230 con 0x7f4be80ca0a0 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4befba5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be80ca530 con 0x7f4be815e3f0 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed140640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4be80ca0a0 0x7f4be80cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bee142640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4be80cc300 0x7f4be80b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46330/0 (socket says 172.21.15.93:46330) 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bee142640 1 -- 172.21.15.93:0/1500699769 learned_addr learned my addr 172.21.15.93:0/1500699769 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed140640 1 -- 172.21.15.93:0/1500699769 >> v2:172.21.15.125:3300/0 conn(0x7f4be815e3f0 msgr2=0x7f4be80b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed941640 1 --2- 172.21.15.93:0/1500699769 >> v2:172.21.15.125:3300/0 conn(0x7f4be815e3f0 0x7f4be80b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed140640 1 --2- 172.21.15.93:0/1500699769 >> v2:172.21.15.125:3300/0 conn(0x7f4be815e3f0 0x7f4be80b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bec93f640 1 -- 172.21.15.93:0/1500699769 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083832249 0 0) 0x7f4be80caa20 con 0x7f4be80cc300 2023-11-04T01:37:57.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed140640 1 -- 172.21.15.93:0/1500699769 >> v1:172.21.15.93:6789/0 conn(0x7f4be80cc300 legacy=0x7f4be80b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.589+0000 7f4bed140640 1 -- 172.21.15.93:0/1500699769 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80cac70 con 0x7f4be80ca0a0 2023-11-04T01:37:57.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4bed140640 1 --2- 172.21.15.93:0/1500699769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be80ca0a0 0x7f4be80cc920 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4be80b5bc0 tx=0x7f4be402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a766fc2596cecc3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4bec93f640 1 -- 172.21.15.93:0/1500699769 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4031830 con 0x7f4be80ca0a0 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4bec93f640 1 -- 172.21.15.93:0/1500699769 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4031990 con 0x7f4be80ca0a0 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4bec93f640 1 -- 172.21.15.93:0/1500699769 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4031d20 con 0x7f4be80ca0a0 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 -- 172.21.15.93:0/1500699769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be80ca0a0 msgr2=0x7f4be80cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 --2- 172.21.15.93:0/1500699769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be80ca0a0 0x7f4be80cc920 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4be80b5bc0 tx=0x7f4be402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 -- 172.21.15.93:0/1500699769 shutdown_connections 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 --2- 172.21.15.93:0/1500699769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be80ca0a0 0x7f4be80cc920 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 --2- 172.21.15.93:0/1500699769 >> v2:172.21.15.125:3300/0 conn(0x7f4be815e3f0 0x7f4be80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.590+0000 7f4befba5640 1 -- 172.21.15.93:0/1500699769 >> 172.21.15.93:0/1500699769 conn(0x7f4be8071820 msgr2=0x7f4be8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.591+0000 7f4befba5640 1 -- 172.21.15.93:0/1500699769 shutdown_connections 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.591+0000 7f4befba5640 1 -- 172.21.15.93:0/1500699769 wait complete. 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 Processor -- start 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 -- start start 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4be80cc300 0x7f4be80b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be814f2b0 0x7f4be814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be814cbb0 con 0x7f4be815e3f0 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81e56e0 con 0x7f4be814f2b0 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.592+0000 7f4befba5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81e5120 con 0x7f4be80cc300 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47054/0 (socket says 172.21.15.93:47054) 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 -- 172.21.15.93:0/2065978695 learned_addr learned my addr 172.21.15.93:0/2065978695 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed941640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4be80cc300 0x7f4be80b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 -- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4be80cc300 msgr2=0x7f4be80b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4be80cc300 0x7f4be80b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 -- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be814f2b0 msgr2=0x7f4be814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be814f2b0 0x7f4be814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 -- 172.21.15.93:0/2065978695 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009400 con 0x7f4be815e3f0 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bed140640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000c00 tx=0x7f4be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4004230 con 0x7f4be815e3f0 2023-11-04T01:37:57.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4004390 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be403a920 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be81e5400 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.593+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be80cd9a0 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.594+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be8074290 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.594+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4be403aa80 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.595+0000 7f4bda7fc640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 0x7f4bcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.595+0000 7f4bed941640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 0x7f4bcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.595+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4be40ac0c0 con 0x7f4be815e3f0 2023-11-04T01:37:57.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.595+0000 7f4bed941640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 0x7f4bcc06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00b7c0 tx=0x7f4bdc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.599+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4be4076e50 con 0x7f4be815e3f0 2023-11-04T01:37:57.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.768+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f4be814d280 con 0x7f4be815e3f0 2023-11-04T01:37:57.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.768+0000 7f4bda7fc640 1 -- 172.21.15.93:0/2065978695 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4be407a470 con 0x7f4be815e3f0 2023-11-04T01:37:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 msgr2=0x7f4bcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 0x7f4bcc06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00b7c0 tx=0x7f4bdc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 msgr2=0x7f4be81e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000c00 tx=0x7f4be40046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 shutdown_connections 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4bcc06ae70 0x7f4bcc06d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be814f2b0 0x7f4be814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4be815e3f0 0x7f4be81e4a40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 --2- 172.21.15.93:0/2065978695 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4be80cc300 0x7f4be80b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 >> 172.21.15.93:0/2065978695 conn(0x7f4be8071820 msgr2=0x7f4be815afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 shutdown_connections 2023-11-04T01:37:57.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.770+0000 7f4befba5640 1 -- 172.21.15.93:0/2065978695 wait complete. 2023-11-04T01:37:57.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:57.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.883+0000 7fe5f7256640 1 Processor -- start 2023-11-04T01:37:57.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.883+0000 7fe5f7256640 1 -- start start 2023-11-04T01:37:57.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f7256640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 0x7fe5f0070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f7256640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f7256640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00c3860 con 0x7fe5f0153850 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f7256640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00c9250 con 0x7fe5f00cc520 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f7256640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0153c30 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5effff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 0x7fe5f0070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:38838/0 (socket says 172.21.15.93:38838) 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f4ff2640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe5f0153850 0x7fe5f015a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38078/0 (socket says 172.21.15.93:38078) 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 -- 172.21.15.93:0/1008020278 learned_addr learned my addr 172.21.15.93:0/1008020278 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5effff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 0x7fe5f0070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:38370/0 (socket says 172.21.15.93:38370) 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 -- 172.21.15.93:0/1008020278 >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 msgr2=0x7fe5f0070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 --2- 172.21.15.93:0/1008020278 >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 0x7fe5f0070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 -- 172.21.15.93:0/1008020278 >> v1:172.21.15.125:6789/0 conn(0x7fe5f0153850 legacy=0x7fe5f015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.884+0000 7fe5f57f3640 1 -- 172.21.15.93:0/1008020278 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00ce590 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.885+0000 7fe5f57f3640 1 --2- 172.21.15.93:0/1008020278 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800af60 tx=0x7fe5e802d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a542f0388649108a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.885+0000 7fe5ef7fe640 1 -- 172.21.15.93:0/1008020278 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e802da10 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.885+0000 7fe5ef7fe640 1 -- 172.21.15.93:0/1008020278 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e802db70 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.885+0000 7fe5ef7fe640 1 -- 172.21.15.93:0/1008020278 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8008500 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 -- 172.21.15.93:0/1008020278 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 msgr2=0x7fe5f00714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1008020278 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800af60 tx=0x7fe5e802d070 comp rx=0 tx=0).stop 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 -- 172.21.15.93:0/1008020278 shutdown_connections 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1008020278 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f00714e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1008020278 >> v2:172.21.15.125:3300/0 conn(0x7fe5f00cc520 0x7fe5f0070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 -- 172.21.15.93:0/1008020278 >> 172.21.15.93:0/1008020278 conn(0x7fe5f00ce950 msgr2=0x7fe5f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:57.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 -- 172.21.15.93:0/1008020278 shutdown_connections 2023-11-04T01:37:57.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.886+0000 7fe5f7256640 1 -- 172.21.15.93:0/1008020278 wait complete. 2023-11-04T01:37:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.887+0000 7fe5f7256640 1 Processor -- start 2023-11-04T01:37:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.887+0000 7fe5f7256640 1 -- start start 2023-11-04T01:37:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f0158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f0153850 0x7fe5f01507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00ac5c0 con 0x7fe5f00cc520 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00abc60 con 0x7fe5f0153850 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f7256640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00abf00 con 0x7fe5f00cc9d0 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47064/0 (socket says 172.21.15.93:47064) 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 -- 172.21.15.93:0/1343591235 learned_addr learned my addr 172.21.15.93:0/1343591235 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f57f3640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f0153850 0x7fe5f01507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5effff640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f0158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 -- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 msgr2=0x7fe5f0158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f0158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 -- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f0153850 msgr2=0x7fe5f01507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f0153850 0x7fe5f01507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:57.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5f4ff2640 1 -- 172.21.15.93:0/1343591235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e800ac40 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.888+0000 7fe5effff640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f0158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5f4ff2640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c4d0 tx=0x7fe5e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4007480 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40075e0 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00ac1e0 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40049e0 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.889+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f0144270 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.890+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00cada0 con 0x7fe5f00cc520 2023-11-04T01:37:57.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.890+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5e4004b40 con 0x7fe5f00cc520 2023-11-04T01:37:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.890+0000 7fe5ed7fa640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 0x7fe5d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.891+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe5e4088d60 con 0x7fe5f00cc520 2023-11-04T01:37:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.891+0000 7fe5effff640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 0x7fe5d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:57.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.891+0000 7fe5effff640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 0x7fe5d406d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0150540 tx=0x7fe5dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:57.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:57.895+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5f00cada0 con 0x7fe5f00cc520 2023-11-04T01:37:58.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.062+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5f00cada0 con 0x7fe5f00cc520 2023-11-04T01:37:58.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.062+0000 7fe5ed7fa640 1 -- 172.21.15.93:0/1343591235 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5e4018020 con 0x7fe5f00cc520 2023-11-04T01:37:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 msgr2=0x7fe5d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 0x7fe5d406d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0150540 tx=0x7fe5dc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 msgr2=0x7fe5f0143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c4d0 tx=0x7fe5e400c990 comp rx=0 tx=0).stop 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 shutdown_connections 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe5d406ae70 0x7fe5d406d330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f0153850 0x7fe5f01507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe5f00cc9d0 0x7fe5f0158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 --2- 172.21.15.93:0/1343591235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5f00cc520 0x7fe5f0143d30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 >> 172.21.15.93:0/1343591235 conn(0x7fe5f00ce950 msgr2=0x7fe5f0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 shutdown_connections 2023-11-04T01:37:58.068 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.064+0000 7fe5f7256640 1 -- 172.21.15.93:0/1343591235 wait complete. 2023-11-04T01:37:58.077 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:58.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.177+0000 7fd64ba90640 1 Processor -- start 2023-11-04T01:37:58.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.177+0000 7fd64ba90640 1 -- start start 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64ba90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd644160430 0x7fd6440b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64ba90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6440b2b60 0x7fd64406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64ba90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440b2fc0 con 0x7fd64406c1d0 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64ba90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440cb580 con 0x7fd644160430 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64ba90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64406ca40 con 0x7fd6440b2b60 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64982c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd644160430 0x7fd6440b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64a02d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd64406c1d0 0x7fd644160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46332/0 (socket says 172.21.15.93:46332) 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.178+0000 7fd64a02d640 1 -- 172.21.15.93:0/3558766174 learned_addr learned my addr 172.21.15.93:0/3558766174 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:58.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64982c640 1 -- 172.21.15.93:0/3558766174 >> v2:172.21.15.125:3300/0 conn(0x7fd6440b2b60 msgr2=0x7fd64406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64982c640 1 --2- 172.21.15.93:0/3558766174 >> v2:172.21.15.125:3300/0 conn(0x7fd6440b2b60 0x7fd64406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64982c640 1 -- 172.21.15.93:0/3558766174 >> v1:172.21.15.93:6789/0 conn(0x7fd64406c1d0 legacy=0x7fd644160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64982c640 1 -- 172.21.15.93:0/3558766174 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64406cd20 con 0x7fd644160430 2023-11-04T01:37:58.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64882a640 1 -- 172.21.15.93:0/3558766174 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189648143 0 0) 0x7fd6440b2fc0 con 0x7fd64406c1d0 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.179+0000 7fd64982c640 1 --2- 172.21.15.93:0/3558766174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd6440b2620 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd64406e5b0 tx=0x7fd64002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbe73abe44238b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64882a640 1 -- 172.21.15.93:0/3558766174 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64002cc80 con 0x7fd644160430 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64882a640 1 -- 172.21.15.93:0/3558766174 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64002cde0 con 0x7fd644160430 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64882a640 1 -- 172.21.15.93:0/3558766174 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640034660 con 0x7fd644160430 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 -- 172.21.15.93:0/3558766174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 msgr2=0x7fd6440b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 --2- 172.21.15.93:0/3558766174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd6440b2620 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd64406e5b0 tx=0x7fd64002bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 -- 172.21.15.93:0/3558766174 shutdown_connections 2023-11-04T01:37:58.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 --2- 172.21.15.93:0/3558766174 >> v2:172.21.15.125:3300/0 conn(0x7fd6440b2b60 0x7fd64406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 --2- 172.21.15.93:0/3558766174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd6440b2620 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 -- 172.21.15.93:0/3558766174 >> 172.21.15.93:0/3558766174 conn(0x7fd64406ea20 msgr2=0x7fd64406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 -- 172.21.15.93:0/3558766174 shutdown_connections 2023-11-04T01:37:58.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.180+0000 7fd64ba90640 1 -- 172.21.15.93:0/3558766174 wait complete. 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.181+0000 7fd64ba90640 1 Processor -- start 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.181+0000 7fd64ba90640 1 -- start start 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 0x7fd644152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 0x7fd6440b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64415ca40 con 0x7fd644160430 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6441544a0 con 0x7fd64406c1d0 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64ba90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd644153920 con 0x7fd6440b2b60 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47082/0 (socket says 172.21.15.93:47082) 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 -- 172.21.15.93:0/1274701891 learned_addr learned my addr 172.21.15.93:0/1274701891 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64982c640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 0x7fd644152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 -- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 msgr2=0x7fd6440b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64902b640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 0x7fd6440b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 0x7fd6440b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 -- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 msgr2=0x7fd644152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 0x7fd644152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64a02d640 1 -- 172.21.15.93:0/1274701891 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009a70 con 0x7fd644160430 2023-11-04T01:37:58.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64982c640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 0x7fd644152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.182+0000 7fd64902b640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 0x7fd6440b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd64a02d640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c480 tx=0x7fd63c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0074e0 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c007660 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd644153c00 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c004a20 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.183+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6441541c0 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.184+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64415cbb0 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.184+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd63c004b80 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.184+0000 7fd63a7fc640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 0x7fd62806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.184+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd63c088db0 con 0x7fd644160430 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.184+0000 7fd64982c640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 0x7fd62806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.185+0000 7fd64982c640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 0x7fd62806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd640036000 tx=0x7fd640030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.189+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd64415cbb0 con 0x7fd644160430 2023-11-04T01:37:58.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.356+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd64415cb80 con 0x7fd644160430 2023-11-04T01:37:58.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.357+0000 7fd63a7fc640 1 -- 172.21.15.93:0/1274701891 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd63c018020 con 0x7fd644160430 2023-11-04T01:37:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.358+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 msgr2=0x7fd62806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.358+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 0x7fd62806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd640036000 tx=0x7fd640030000 comp rx=0 tx=0).stop 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.358+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 msgr2=0x7fd644154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.358+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c480 tx=0x7fd63c00c940 comp rx=0 tx=0).stop 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 shutdown_connections 2023-11-04T01:37:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd62806ae70 0x7fd62806d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd644160430 0x7fd644154fc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd6440b2b60 0x7fd6440b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 --2- 172.21.15.93:0/1274701891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd64406c1d0 0x7fd644152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 >> 172.21.15.93:0/1274701891 conn(0x7fd64406ea20 msgr2=0x7fd6440b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 shutdown_connections 2023-11-04T01:37:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.359+0000 7fd64ba90640 1 -- 172.21.15.93:0/1274701891 wait complete. 2023-11-04T01:37:58.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 Processor -- start 2023-11-04T01:37:58.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 -- start start 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa0f0157540 0x7fa0f00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f015e000 con 0x7fa0f00cde60 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f015e5c0 con 0x7fa0f0157540 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0f6058640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f015e2e0 con 0x7fa0f00ce240 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.469+0000 7fa0ef7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa0f00cde60 0x7fa0f015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46342/0 (socket says 172.21.15.93:46342) 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0ef7fe640 1 -- 172.21.15.93:0/633933777 learned_addr learned my addr 172.21.15.93:0/633933777 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0effff640 1 --2- 172.21.15.93:0/633933777 >> v2:172.21.15.93:3300/0 conn(0x7fa0f0157540 0x7fa0f00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0e6ffd640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0effff640 1 -- 172.21.15.93:0/633933777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 msgr2=0x7fa0f0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0effff640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0effff640 1 -- 172.21.15.93:0/633933777 >> v1:172.21.15.93:6789/0 conn(0x7fa0f00cde60 legacy=0x7fa0f015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.470+0000 7fa0effff640 1 -- 172.21.15.93:0/633933777 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f00d1120 con 0x7fa0f0157540 2023-11-04T01:37:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0effff640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f00d1920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009d90 tx=0x7fa0e802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4466e7406e15e542 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0eeffd640 1 -- 172.21.15.93:0/633933777 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e802cc50 con 0x7fa0f0157540 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0eeffd640 1 -- 172.21.15.93:0/633933777 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e802cdb0 con 0x7fa0f0157540 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0eeffd640 1 -- 172.21.15.93:0/633933777 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8034660 con 0x7fa0f0157540 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 -- 172.21.15.93:0/633933777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 msgr2=0x7fa0f00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f00d1920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009d90 tx=0x7fa0e802bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 -- 172.21.15.93:0/633933777 shutdown_connections 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f00d1920 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 --2- 172.21.15.93:0/633933777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 -- 172.21.15.93:0/633933777 >> 172.21.15.93:0/633933777 conn(0x7fa0f0071f30 msgr2=0x7fa0f00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 -- 172.21.15.93:0/633933777 shutdown_connections 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.471+0000 7fa0f6058640 1 -- 172.21.15.93:0/633933777 wait complete. 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.472+0000 7fa0f6058640 1 Processor -- start 2023-11-04T01:37:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 -- start start 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f00cde60 0x7fa0f01f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f01f24d0 con 0x7fa0f0157540 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00b8010 con 0x7fa0f00cde60 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0f6058640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f0159150 con 0x7fa0f00ce240 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0effff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0effff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47106/0 (socket says 172.21.15.93:47106) 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0effff640 1 -- 172.21.15.93:0/2667013286 learned_addr learned my addr 172.21.15.93:0/2667013286 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.473+0000 7fa0ef7fe640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f00cde60 0x7fa0f01f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0e6ffd640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 -- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 msgr2=0x7fa0f015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 -- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f00cde60 msgr2=0x7fa0f01f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f00cde60 0x7fa0f01f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 -- 172.21.15.93:0/2667013286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8009a70 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0effff640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009d90 tx=0x7fa0e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8040650 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80407d0 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f00b7d30 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8040b80 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.474+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f0158de0 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.475+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f01592c0 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.476+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0e8040ce0 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.476+0000 7fa0ecff9640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 0x7fa0d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.476+0000 7fa0ef7fe640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 0x7fa0d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.476+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa0e80ac4e0 con 0x7fa0f0157540 2023-11-04T01:37:58.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.476+0000 7fa0ef7fe640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 0x7fa0d006d360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0005880 tx=0x7fa0e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.480+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0e8077430 con 0x7fa0f0157540 2023-11-04T01:37:58.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.680+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0f0074290 con 0x7fa0f0157540 2023-11-04T01:37:58.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.681+0000 7fa0ecff9640 1 -- 172.21.15.93:0/2667013286 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fa0e807aa50 con 0x7fa0f0157540 2023-11-04T01:37:58.683 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:58.684 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:58.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 msgr2=0x7fa0d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 0x7fa0d006d360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0005880 tx=0x7fa0e0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:58.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 msgr2=0x7fa0f015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009d90 tx=0x7fa0e8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 shutdown_connections 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa0d006aea0 0x7fa0d006d360 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0f0157540 0x7fa0f015b8c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0f00ce240 0x7fa0f015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 --2- 172.21.15.93:0/2667013286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0f00cde60 0x7fa0f01f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 >> 172.21.15.93:0/2667013286 conn(0x7fa0f0071f30 msgr2=0x7fa0f00cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 shutdown_connections 2023-11-04T01:37:58.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.683+0000 7fa0f6058640 1 -- 172.21.15.93:0/2667013286 wait complete. 2023-11-04T01:37:58.696 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:58.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.792+0000 7f250a6c2640 1 Processor -- start 2023-11-04T01:37:58.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.792+0000 7f250a6c2640 1 -- start start 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f250a6c2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25040b42c0 0x7f25040c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f250a6c2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25040ca050 con 0x7f25040c9c40 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f250a6c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250406cfa0 con 0x7f250415ad80 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f250a6c2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250406d280 con 0x7f25040b42c0 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f25037fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25040b42c0 0x7f25040c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f2508c5f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f25040c9c40 0x7f25040b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46352/0 (socket says 172.21.15.93:46352) 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f2508c5f640 1 -- 172.21.15.93:0/3049335532 learned_addr learned my addr 172.21.15.93:0/3049335532 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:58.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.793+0000 7f25037fe640 1 -- 172.21.15.93:0/3049335532 >> v1:172.21.15.125:6789/0 conn(0x7f250415ad80 legacy=0x7f250406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f25037fe640 1 -- 172.21.15.93:0/3049335532 >> v1:172.21.15.93:6789/0 conn(0x7f25040c9c40 legacy=0x7f25040b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f25037fe640 1 -- 172.21.15.93:0/3049335532 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250406d560 con 0x7f25040b42c0 2023-11-04T01:37:58.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f2502ffd640 1 -- 172.21.15.93:0/3049335532 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742071747 0 0) 0x7f25040ca050 con 0x7f25040c9c40 2023-11-04T01:37:58.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f25037fe640 1 --2- 172.21.15.93:0/3049335532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25040b42c0 0x7f25040c9700 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097a0 tx=0x7f24f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775c6675c925c2ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f2502ffd640 1 -- 172.21.15.93:0/3049335532 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8030610 con 0x7f25040b42c0 2023-11-04T01:37:58.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f2502ffd640 1 -- 172.21.15.93:0/3049335532 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8030770 con 0x7f25040b42c0 2023-11-04T01:37:58.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.794+0000 7f2502ffd640 1 -- 172.21.15.93:0/3049335532 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8030b00 con 0x7f25040b42c0 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 -- 172.21.15.93:0/3049335532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25040b42c0 msgr2=0x7f25040c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 --2- 172.21.15.93:0/3049335532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25040b42c0 0x7f25040c9700 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097a0 tx=0x7f24f802b960 comp rx=0 tx=0).stop 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 -- 172.21.15.93:0/3049335532 shutdown_connections 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 --2- 172.21.15.93:0/3049335532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25040b42c0 0x7f25040c9700 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 -- 172.21.15.93:0/3049335532 >> 172.21.15.93:0/3049335532 conn(0x7f25040ce950 msgr2=0x7f25040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 -- 172.21.15.93:0/3049335532 shutdown_connections 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.795+0000 7f250a6c2640 1 -- 172.21.15.93:0/3049335532 wait complete. 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.796+0000 7f250a6c2640 1 Processor -- start 2023-11-04T01:37:58.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.796+0000 7f250a6c2640 1 -- start start 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25040b42c0 0x7f25041519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 0x7f250415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25040c8ad0 con 0x7f250415ad80 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250415c920 con 0x7f25040c9c40 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f250a6c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250415bd10 con 0x7f25040b42c0 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47126/0 (socket says 172.21.15.93:47126) 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 -- 172.21.15.93:0/1248911716 learned_addr learned my addr 172.21.15.93:0/1248911716 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2503fff640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25040b42c0 0x7f25041519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f25037fe640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 0x7f250415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 -- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25040b42c0 msgr2=0x7f25041519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25040b42c0 0x7f25041519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 -- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 msgr2=0x7f250415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 0x7f250415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 -- 172.21.15.93:0/1248911716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8009400 con 0x7f250415ad80 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f25037fe640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 0x7f250415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:58.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.797+0000 7f2508c5f640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c810 tx=0x7f24fc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.798+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00a640 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.798+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00a7c0 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.798+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250415bff0 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.798+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00ab70 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.798+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250415c5b0 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.799+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2504074290 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.799+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24fc00acd0 con 0x7f250415ad80 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.800+0000 7f2500ff9640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 0x7f24f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.800+0000 7f2503fff640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 0x7f24f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.800+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24fc0890a0 con 0x7f250415ad80 2023-11-04T01:37:58.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.800+0000 7f2503fff640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 0x7f24f006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24f4006fd0 tx=0x7f24f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.804+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24fc053eb0 con 0x7f250415ad80 2023-11-04T01:37:58.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.971+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25040b4880 con 0x7f250415ad80 2023-11-04T01:37:58.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.972+0000 7f2500ff9640 1 -- 172.21.15.93:0/1248911716 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18535 (secure 0 0 0) 0x7f24fc0574d0 con 0x7f250415ad80 2023-11-04T01:37:58.975 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:42.715268+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 msgr2=0x7f24f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 0x7f24f006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24f4006fd0 tx=0x7f24f4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 msgr2=0x7f25040c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00c810 tx=0x7f24fc00ccd0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 shutdown_connections 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f24f006ae70 0x7f24f006d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f250415ad80 0x7f25040c7af0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25040c9c40 0x7f250415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 --2- 172.21.15.93:0/1248911716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25040b42c0 0x7f25041519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.974+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 >> 172.21.15.93:0/1248911716 conn(0x7f25040ce950 msgr2=0x7f25040ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.975+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 shutdown_connections 2023-11-04T01:37:58.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:58.975+0000 7f250a6c2640 1 -- 172.21.15.93:0/1248911716 wait complete. 2023-11-04T01:37:58.988 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:58.988 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:59.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.084+0000 7f3ba5e6f640 1 Processor -- start 2023-11-04T01:37:59.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.084+0000 7f3ba5e6f640 1 -- start start 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.085+0000 7f3ba5e6f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.085+0000 7f3ba5e6f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.085+0000 7f3ba5e6f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00cc450 con 0x7f3ba00cbc00 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.085+0000 7f3ba5e6f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba015f400 con 0x7f3ba015ae40 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.085+0000 7f3ba5e6f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015b220 con 0x7f3ba00cda30 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9f7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:38884/0 (socket says 172.21.15.93:38884) 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9f7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:38416/0 (socket says 172.21.15.93:38416) 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 -- 172.21.15.93:0/3990267147 learned_addr learned my addr 172.21.15.93:0/3990267147 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9effd640 1 --1- 172.21.15.93:0/3990267147 >> v1:172.21.15.125:6789/0 conn(0x7f3ba00cbc00 0x7f3ba00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38094/0 (socket says 172.21.15.93:38094) 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 -- 172.21.15.93:0/3990267147 >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 msgr2=0x7f3ba015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 --2- 172.21.15.93:0/3990267147 >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 -- 172.21.15.93:0/3990267147 >> v1:172.21.15.125:6789/0 conn(0x7f3ba00cbc00 legacy=0x7f3ba00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9ffff640 1 -- 172.21.15.93:0/3990267147 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba015f890 con 0x7f3ba00cda30 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.086+0000 7f3b9f7fe640 1 --2- 172.21.15.93:0/3990267147 >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:59.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.087+0000 7f3b9ffff640 1 --2- 172.21.15.93:0/3990267147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009e50 tx=0x7f3b9802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa0ad55cb26701 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.088+0000 7f3b9e7fc640 1 -- 172.21.15.93:0/3990267147 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9802cb00 con 0x7f3ba00cda30 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.088+0000 7f3b9e7fc640 1 -- 172.21.15.93:0/3990267147 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9802cc60 con 0x7f3ba00cda30 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.088+0000 7f3b9e7fc640 1 -- 172.21.15.93:0/3990267147 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980343f0 con 0x7f3ba00cda30 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/3990267147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 msgr2=0x7f3ba00ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/3990267147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009e50 tx=0x7f3b9802bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/3990267147 shutdown_connections 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/3990267147 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00ced70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/3990267147 >> v2:172.21.15.125:3300/0 conn(0x7f3ba015ae40 0x7f3ba015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/3990267147 >> 172.21.15.93:0/3990267147 conn(0x7f3ba006ea90 msgr2=0x7f3ba006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/3990267147 shutdown_connections 2023-11-04T01:37:59.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.089+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/3990267147 wait complete. 2023-11-04T01:37:59.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.090+0000 7f3ba5e6f640 1 Processor -- start 2023-11-04T01:37:59.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 -- start start 2023-11-04T01:37:59.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ba015ae40 0x7f3ba00c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00b2aa0 con 0x7f3ba00cbc00 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba006c170 con 0x7f3ba015ae40 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3ba5e6f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba006c450 con 0x7f3ba00cda30 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3b9f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3b9f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47138/0 (socket says 172.21.15.93:47138) 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3b9f7fe640 1 -- 172.21.15.93:0/495574220 learned_addr learned my addr 172.21.15.93:0/495574220 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3b9effd640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.091+0000 7f3b9ffff640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ba015ae40 0x7f3ba00c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 -- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 msgr2=0x7f3ba00c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 -- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ba015ae40 msgr2=0x7f3ba00c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ba015ae40 0x7f3ba00c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 -- 172.21.15.93:0/495574220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009400 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b9f7fe640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000e960 tx=0x7f3b9000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000ca00 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9000cb60 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90013470 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b98009b30 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.092+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba006ca10 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.093+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00b08e0 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.094+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b900135d0 con 0x7f3ba00cbc00 2023-11-04T01:37:59.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.094+0000 7f3b87fff640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.094+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b90089a00 con 0x7f3ba00cbc00 2023-11-04T01:37:59.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.094+0000 7f3b9effd640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.094+0000 7f3b9effd640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 0x7f3b8c06d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00b01e0 tx=0x7f3b94000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.098+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b900548c0 con 0x7f3ba00cbc00 2023-11-04T01:37:59.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.300+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ba00ce2d0 con 0x7f3ba00cbc00 2023-11-04T01:37:59.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.300+0000 7f3b87fff640 1 -- 172.21.15.93:0/495574220 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3b90017090 con 0x7f3ba00cbc00 2023-11-04T01:37:59.304 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 msgr2=0x7f3b8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 0x7f3b8c06d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00b01e0 tx=0x7f3b94000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 msgr2=0x7f3ba00b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000e960 tx=0x7f3b9000ee20 comp rx=0 tx=0).stop 2023-11-04T01:37:59.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 shutdown_connections 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ba015ae40 0x7f3ba00c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3ba00cda30 0x7f3ba00c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 --2- 172.21.15.93:0/495574220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3ba00cbc00 0x7f3ba00b2e60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 >> 172.21.15.93:0/495574220 conn(0x7f3ba006ea90 msgr2=0x7f3ba015dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 shutdown_connections 2023-11-04T01:37:59.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.302+0000 7f3ba5e6f640 1 -- 172.21.15.93:0/495574220 wait complete. 2023-11-04T01:37:59.316 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.414+0000 7fa699056640 1 Processor -- start 2023-11-04T01:37:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.414+0000 7fa699056640 1 -- start start 2023-11-04T01:37:59.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa699056640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa69406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa699056640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69406e060 con 0x7fa6940b0ae0 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa699056640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940b4110 con 0x7fa694159c70 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa699056640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b49b0 con 0x7fa6940ce370 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa69259c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa6940b0ae0 0x7fa69415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46366/0 (socket says 172.21.15.93:46366) 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.415+0000 7fa69259c640 1 -- 172.21.15.93:0/2130661312 learned_addr learned my addr 172.21.15.93:0/2130661312 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69359e640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa69406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462101091 0 0) 0x7fa69406e060 con 0x7fa6940b0ae0 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa680003520 con 0x7fa6940b0ae0 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276314923 0 0) 0x7fa680003520 con 0x7fa6940b0ae0 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 msgr2=0x7fa69406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa69406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 >> v1:172.21.15.125:6789/0 conn(0x7fa694159c70 legacy=0x7fa6940b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940b43f0 con 0x7fa6940b0ae0 2023-11-04T01:37:59.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa67c001670 con 0x7fa6940b0ae0 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 >> v1:172.21.15.93:6789/0 conn(0x7fa6940b0ae0 legacy=0x7fa69415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa6800039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa680003f20 0x7fa6800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa680004d00 0x7fa680005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b49b0 con 0x7fa680003f20 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000ba60 con 0x7fa680004d00 2023-11-04T01:37:59.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000bc20 con 0x7fa6940ce370 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa680003f20 0x7fa6800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa692d9d640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa6800039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69359e640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa680004d00 0x7fa680005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 -- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 msgr2=0x7fa6800039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6940ce370 0x7fa6800039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 -- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa680004d00 msgr2=0x7fa680005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa680004d00 0x7fa680005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.416+0000 7fa69259c640 1 -- 172.21.15.93:0/2130661312 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680003520 con 0x7fa680003f20 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.417+0000 7fa69259c640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa680003f20 0x7fa6800047c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa67c001050 tx=0x7fa6800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c907ddbf22cb704 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.417+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c005ad0 con 0x7fa680003f20 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.417+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c005c30 con 0x7fa680003f20 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.417+0000 7fa691d9b640 1 -- 172.21.15.93:0/2130661312 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c02cad0 con 0x7fa680003f20 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 -- 172.21.15.93:0/2130661312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa680003f20 msgr2=0x7fa6800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 --2- 172.21.15.93:0/2130661312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa680003f20 0x7fa6800047c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa67c001050 tx=0x7fa6800057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa69359e640 1 -- 172.21.15.93:0/2130661312 reap_dead start 2023-11-04T01:37:59.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 -- 172.21.15.93:0/2130661312 shutdown_connections 2023-11-04T01:37:59.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 -- 172.21.15.93:0/2130661312 >> 172.21.15.93:0/2130661312 conn(0x7fa6940ce950 msgr2=0x7fa6940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 -- 172.21.15.93:0/2130661312 shutdown_connections 2023-11-04T01:37:59.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.418+0000 7fa699056640 1 -- 172.21.15.93:0/2130661312 wait complete. 2023-11-04T01:37:59.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.419+0000 7fa699056640 1 Processor -- start 2023-11-04T01:37:59.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.419+0000 7fa699056640 1 -- start start 2023-11-04T01:37:59.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa680003f20 0x7fa694143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6940c3e50 0x7fa6940c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940c4810 con 0x7fa6940b1e00 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694143690 con 0x7fa6940c3e50 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa699056640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b27c0 con 0x7fa680003f20 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47154/0 (socket says 172.21.15.93:47154) 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 -- 172.21.15.93:0/3931169986 learned_addr learned my addr 172.21.15.93:0/3931169986 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69259c640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6940c3e50 0x7fa6940c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 -- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa680003f20 msgr2=0x7fa694143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa680003f20 0x7fa694143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 -- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6940c3e50 msgr2=0x7fa6940c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6940c3e50 0x7fa6940c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 -- 172.21.15.93:0/3931169986 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694169b80 con 0x7fa6940b1e00 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.420+0000 7fa69359e640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa69406d3c0 tx=0x7fa6840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.421+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400e070 con 0x7fa6940b1e00 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.421+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684011e40 con 0x7fa6940b1e00 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.421+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69414cc20 con 0x7fa6940b1e00 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.421+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684003990 con 0x7fa6940b1e00 2023-11-04T01:37:59.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.421+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69414c2f0 con 0x7fa6940b1e00 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.422+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa694074290 con 0x7fa6940b1e00 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.422+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa684003b10 con 0x7fa6940b1e00 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.422+0000 7fa68b7fe640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 0x7fa67406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.423+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa684089f20 con 0x7fa6940b1e00 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.423+0000 7fa692d9d640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 0x7fa67406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.423+0000 7fa692d9d640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 0x7fa67406d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa68c001750 tx=0x7fa68c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.427+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa684054d30 con 0x7fa6940b1e00 2023-11-04T01:37:59.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.628+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa69406d3f0 con 0x7fa6940b1e00 2023-11-04T01:37:59.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.629+0000 7fa68b7fe640 1 -- 172.21.15.93:0/3931169986 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fa684058350 con 0x7fa6940b1e00 2023-11-04T01:37:59.631 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:41.049261+0000","modified":"2023-11-04T01:37:43.366887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/1137152814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1137152814},{"type":"v1","addr":"172.21.15.93:6836","nonce":1137152814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:37:59.632 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 23 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 msgr2=0x7fa67406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 0x7fa67406d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa68c001750 tx=0x7fa68c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 msgr2=0x7fa6940b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa69406d3c0 tx=0x7fa6840115a0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 shutdown_connections 2023-11-04T01:37:59.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa67406ae70 0x7fa67406d330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6940b1e00 0x7fa6940b2280 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6940c3e50 0x7fa6940c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 --2- 172.21.15.93:0/3931169986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa680003f20 0x7fa694143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 >> 172.21.15.93:0/3931169986 conn(0x7fa6940ce950 msgr2=0x7fa6940caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 shutdown_connections 2023-11-04T01:37:59.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.631+0000 7fa699056640 1 -- 172.21.15.93:0/3931169986 wait complete. 2023-11-04T01:37:59.644 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:59.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.740+0000 7fdde87cc640 1 Processor -- start 2023-11-04T01:37:59.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.740+0000 7fdde87cc640 1 -- start start 2023-11-04T01:37:59.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde87cc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdde00aec80 0x7fdde00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde87cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde00cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde87cc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00b1590 con 0x7fdde00af060 2023-11-04T01:37:59.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde87cc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde0155a40 con 0x7fdde00aec80 2023-11-04T01:37:59.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde87cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde006a8e0 con 0x7fdde006ef40 2023-11-04T01:37:59.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6568640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdde00aec80 0x7fdde00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6d69640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde00cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6568640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdde00aec80 0x7fdde00b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:38446/0 (socket says 172.21.15.93:38446) 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6568640 1 -- 172.21.15.93:0/260194081 learned_addr learned my addr 172.21.15.93:0/260194081 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6568640 1 -- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 msgr2=0x7fdde00cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.741+0000 7fdde6568640 1 --2- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde00cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.742+0000 7fdde6568640 1 -- 172.21.15.93:0/260194081 >> v1:172.21.15.125:6789/0 conn(0x7fdde00af060 legacy=0x7fdde006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.742+0000 7fdde5566640 1 -- 172.21.15.93:0/260194081 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243516133 0 0) 0x7fdde00b1590 con 0x7fdde00af060 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.742+0000 7fdde6568640 1 -- 172.21.15.93:0/260194081 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00b1800 con 0x7fdde00aec80 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.742+0000 7fdde6568640 1 --2- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde00b1fe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009850 tx=0x7fdddc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c4e4b0f5f1593b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.742+0000 7fdde5566640 1 -- 172.21.15.93:0/260194081 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc004230 con 0x7fdde00aec80 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde5566640 1 -- 172.21.15.93:0/260194081 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc004390 con 0x7fdde00aec80 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde5566640 1 -- 172.21.15.93:0/260194081 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc003810 con 0x7fdde00aec80 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 -- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 msgr2=0x7fdde00b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 --2- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde00b1fe0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009850 tx=0x7fdddc02b960 comp rx=0 tx=0).stop 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 -- 172.21.15.93:0/260194081 shutdown_connections 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 --2- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde00cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 --2- 172.21.15.93:0/260194081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde00b1fe0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 -- 172.21.15.93:0/260194081 >> 172.21.15.93:0/260194081 conn(0x7fdde0098d40 msgr2=0x7fdde00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 -- 172.21.15.93:0/260194081 shutdown_connections 2023-11-04T01:37:59.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.743+0000 7fdde87cc640 1 -- 172.21.15.93:0/260194081 wait complete. 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.744+0000 7fdde87cc640 1 Processor -- start 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.744+0000 7fdde87cc640 1 -- start start 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde015f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00b3380 con 0x7fdde00af060 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00c7a50 con 0x7fdde00aec80 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde87cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00c7d30 con 0x7fdde006ef40 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47170/0 (socket says 172.21.15.93:47170) 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 -- 172.21.15.93:0/3450571732 learned_addr learned my addr 172.21.15.93:0/3450571732 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6568640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde5d67640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 -- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 msgr2=0x7fdde015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 -- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 msgr2=0x7fdde014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.745+0000 7fdde6d69640 1 -- 172.21.15.93:0/3450571732 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009460 con 0x7fdde00af060 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fdde6d69640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fddd800efc0 tx=0x7fddd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8014480 con 0x7fdde00af060 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd800f040 con 0x7fdde00af060 2023-11-04T01:37:59.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00c8010 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8014820 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.746+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde00c85d0 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.747+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde00c87c0 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.747+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fddd8014980 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.748+0000 7fddd6ffd640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 0x7fddc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.748+0000 7fdde6568640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 0x7fddc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.748+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fddd808a3b0 con 0x7fdde00af060 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.748+0000 7fdde6568640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 0x7fddc406d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdddc035000 tx=0x7fdddc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.752+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fddd80551f0 con 0x7fdde00af060 2023-11-04T01:37:59.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.917+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde0074290 con 0x7fdde00af060 2023-11-04T01:37:59.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.918+0000 7fddd6ffd640 1 -- 172.21.15.93:0/3450571732 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18535 (secure 0 0 0) 0x7fddd8058810 con 0x7fdde00af060 2023-11-04T01:37:59.920 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:37:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":54,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:37:42.715268+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:39.534714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:40.014955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:59.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 msgr2=0x7fddc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 0x7fddc406d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdddc035000 tx=0x7fdddc008030 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 msgr2=0x7fdde00cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fddd800efc0 tx=0x7fddd800c490 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 shutdown_connections 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fddc406ae70 0x7fddc406d330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdde00af060 0x7fdde00cf7c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde00aec80 0x7fdde014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 --2- 172.21.15.93:0/3450571732 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdde006ef40 0x7fdde015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 >> 172.21.15.93:0/3450571732 conn(0x7fdde0098d40 msgr2=0x7fdde00c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 shutdown_connections 2023-11-04T01:37:59.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:37:59.920+0000 7fdde87cc640 1 -- 172.21.15.93:0/3450571732 wait complete. 2023-11-04T01:37:59.933 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:00.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 Processor -- start 2023-11-04T01:38:00.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 -- start start 2023-11-04T01:38:00.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1f2c153e60 0x7f1f2c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0cd6d0 0x7f1f2c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0cde60 con 0x7f1f2c0b4880 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c160f90 con 0x7f1f2c153e60 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.032+0000 7f1f30d6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15e400 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1f2c153e60 0x7f1f2c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2ad9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1f2c0b4880 0x7f1f2c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46368/0 (socket says 172.21.15.93:46368) 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2ad9d640 1 -- 172.21.15.93:0/2292819925 learned_addr learned my addr 172.21.15.93:0/2292819925 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1f2c153e60 0x7f1f2c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47186/0 (socket says 172.21.15.93:47186) 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 -- 172.21.15.93:0/2292819925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0cd6d0 msgr2=0x7f1f2c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/2292819925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0cd6d0 0x7f1f2c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 -- 172.21.15.93:0/2292819925 >> v1:172.21.15.93:6789/0 conn(0x7f1f2c0b4880 legacy=0x7f1f2c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f29d9b640 1 -- 172.21.15.93:0/2292819925 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271808198 0 0) 0x7f1f2c0cde60 con 0x7f1f2c0b4880 2023-11-04T01:38:00.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.033+0000 7f1f2a59c640 1 -- 172.21.15.93:0/2292819925 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c161960 con 0x7f1f2c153e60 2023-11-04T01:38:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/2292819925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c153e60 0x7f1f2c15dec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0097a0 tx=0x7f1f1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2f52d4c91460dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f29d9b640 1 -- 172.21.15.93:0/2292819925 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c031830 con 0x7f1f2c153e60 2023-11-04T01:38:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f29d9b640 1 -- 172.21.15.93:0/2292819925 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c031990 con 0x7f1f2c153e60 2023-11-04T01:38:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f29d9b640 1 -- 172.21.15.93:0/2292819925 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c031d20 con 0x7f1f2c153e60 2023-11-04T01:38:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 -- 172.21.15.93:0/2292819925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c153e60 msgr2=0x7f1f2c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/2292819925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c153e60 0x7f1f2c15dec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0097a0 tx=0x7f1f1c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 -- 172.21.15.93:0/2292819925 shutdown_connections 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/2292819925 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0cd6d0 0x7f1f2c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/2292819925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c153e60 0x7f1f2c15dec0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 -- 172.21.15.93:0/2292819925 >> 172.21.15.93:0/2292819925 conn(0x7f1f2c0cf880 msgr2=0x7f1f2c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 -- 172.21.15.93:0/2292819925 shutdown_connections 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.034+0000 7f1f30d6c640 1 -- 172.21.15.93:0/2292819925 wait complete. 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 Processor -- start 2023-11-04T01:38:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 -- start start 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 0x7f1f2c0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 0x7f1f2c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c8020 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c9760 con 0x7f1f2c153e60 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f30d6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c73a0 con 0x7f1f2c0b4880 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f23fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f23fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47202/0 (socket says 172.21.15.93:47202) 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.036+0000 7f1f23fff640 1 -- 172.21.15.93:0/3979627321 learned_addr learned my addr 172.21.15.93:0/3979627321 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 0x7f1f2c0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f2ad9d640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 0x7f1f2c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 -- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 msgr2=0x7f1f2c0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 0x7f1f2c0c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 -- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 msgr2=0x7f1f2c157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 0x7f1f2c157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 -- 172.21.15.93:0/3979627321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c009400 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f2ad9d640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 0x7f1f2c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 0x7f1f2c0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f23fff640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b4a0 tx=0x7f1f1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14010610 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f14010770 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c0c7680 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14010b20 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.037+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c0c7c40 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.038+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c0c8160 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.038+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f14010c80 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.039+0000 7f1f22ffd640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 0x7f1f0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.039+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 0x7f1f0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.039+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1f140894d0 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.039+0000 7f1f2a59c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 0x7f1f0c06d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c036000 tx=0x7f1f1c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.043+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f2c0c8160 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.245+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f2c0c8160 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.248 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:38:00.246+0000 7f76f40f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:00.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.247+0000 7f1f22ffd640 1 -- 172.21.15.93:0/3979627321 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f2c0c8160 con 0x7f1f2c0cd6d0 2023-11-04T01:38:00.249 INFO:teuthology.orchestra.run.smithi093.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:00.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.249+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 msgr2=0x7f1f0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.249+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 0x7f1f0c06d360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c036000 tx=0x7f1f1c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.249+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 msgr2=0x7f1f2c157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.249+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b4a0 tx=0x7f1f1400b960 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 shutdown_connections 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1f0c06aea0 0x7f1f0c06d360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f2c153e60 0x7f1f2c157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f2c0cd6d0 0x7f1f2c157010 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 --2- 172.21.15.93:0/3979627321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1f2c0b4880 0x7f1f2c0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 >> 172.21.15.93:0/3979627321 conn(0x7f1f2c0cf880 msgr2=0x7f1f2c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 shutdown_connections 2023-11-04T01:38:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.250+0000 7f1f30d6c640 1 -- 172.21.15.93:0/3979627321 wait complete. 2023-11-04T01:38:00.254 INFO:tasks.ceph.mds.a.smithi093.stderr: -630> 2023-11-04T01:37:46.989+0000 7f866996f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:00.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:00.277 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:38:00.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.362+0000 7f97e3b00640 1 Processor -- start 2023-11-04T01:38:00.365 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.362+0000 7f97e3b00640 1 -- start start 2023-11-04T01:38:00.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e3b00640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f97dc072370 0x7f97dc0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e3b00640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0b1cc0 con 0x7f97dc15add0 2023-11-04T01:38:00.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e3b00640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc15a2f0 con 0x7f97dc071f90 2023-11-04T01:38:00.366 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e3b00640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc0b1fa0 con 0x7f97dc072370 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e109b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f97dc15add0 0x7f97dc0cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46376/0 (socket says 172.21.15.93:46376) 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e109b640 1 -- 172.21.15.93:0/2671211506 learned_addr learned my addr 172.21.15.93:0/2671211506 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.363+0000 7f97e209d640 1 --2- 172.21.15.93:0/2671211506 >> v2:172.21.15.125:3300/0 conn(0x7f97dc072370 0x7f97dc0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663333286 0 0) 0x7f97dc0b1cc0 con 0x7f97dc15add0 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c8003520 con 0x7f97dc15add0 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250695591 0 0) 0x7f97dc15a2f0 con 0x7f97dc071f90 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc0b1cc0 con 0x7f97dc071f90 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986489903 0 0) 0x7f97c8003520 con 0x7f97dc15add0 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e209d640 1 -- 172.21.15.93:0/2671211506 >> v1:172.21.15.125:6789/0 conn(0x7f97dc071f90 legacy=0x7f97dc0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e209d640 1 -- 172.21.15.93:0/2671211506 >> v1:172.21.15.93:6789/0 conn(0x7f97dc15add0 legacy=0x7f97dc0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.364+0000 7f97e209d640 1 -- 172.21.15.93:0/2671211506 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc15a5d0 con 0x7f97dc072370 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e209d640 1 --2- 172.21.15.93:0/2671211506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc0cf3d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009d90 tx=0x7f97d402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9aeed0b6fe0d79a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc001670 con 0x7f97dc072370 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d402c940 con 0x7f97dc072370 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e089a640 1 -- 172.21.15.93:0/2671211506 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d402ccb0 con 0x7f97dc072370 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 -- 172.21.15.93:0/2671211506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 msgr2=0x7f97dc0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2671211506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc0cf3d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009d90 tx=0x7f97d402be10 comp rx=0 tx=0).stop 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 -- 172.21.15.93:0/2671211506 shutdown_connections 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2671211506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc0cf3d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 -- 172.21.15.93:0/2671211506 >> 172.21.15.93:0/2671211506 conn(0x7f97dc06d800 msgr2=0x7f97dc06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 -- 172.21.15.93:0/2671211506 shutdown_connections 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.365+0000 7f97e3b00640 1 -- 172.21.15.93:0/2671211506 wait complete. 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 Processor -- start 2023-11-04T01:38:00.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 -- start start 2023-11-04T01:38:00.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97dc071f90 0x7f97dc14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc1f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1f13c0 con 0x7f97dc15add0 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0c6500 con 0x7f97dc072370 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e3b00640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1f0d70 con 0x7f97dc071f90 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e209d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e209d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47238/0 (socket says 172.21.15.93:47238) 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.367+0000 7f97e209d640 1 -- 172.21.15.93:0/2809187999 learned_addr learned my addr 172.21.15.93:0/2809187999 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e109b640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc1f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e189c640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97dc071f90 0x7f97dc14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 -- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97dc071f90 msgr2=0x7f97dc14df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97dc071f90 0x7f97dc14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 -- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 msgr2=0x7f97dc1f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc1f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 -- 172.21.15.93:0/2809187999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009a70 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e209d640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009eb0 tx=0x7f97d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4035e60 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4009450 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d403e630 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc1f1050 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.368+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc0c5ff0 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.369+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0d03b0 con 0x7f97dc15add0 2023-11-04T01:38:00.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.369+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97d403b050 con 0x7f97dc15add0 2023-11-04T01:38:00.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.370+0000 7f97d27fc640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 0x7f97c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.370+0000 7f97e189c640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 0x7f97c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.370+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f97d40ab8f0 con 0x7f97dc15add0 2023-11-04T01:38:00.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.370+0000 7f97e189c640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 0x7f97c006d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97d8007fd0 tx=0x7f97d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.374+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97d4076680 con 0x7f97dc15add0 2023-11-04T01:38:00.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:00.578+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f97dc1f1500 con 0x7f97dc15add0 2023-11-04T01:38:01.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.248+0000 7f97d27fc640 1 -- 172.21.15.93:0/2809187999 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f97d4079ca0 con 0x7f97dc15add0 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 msgr2=0x7f97c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 0x7f97c006d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97d8007fd0 tx=0x7f97d8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 msgr2=0x7f97dc0c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009eb0 tx=0x7f97d4004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 shutdown_connections 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f97c006ae70 0x7f97c006d330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97dc15add0 0x7f97dc0c5ab0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc072370 0x7f97dc1f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 --2- 172.21.15.93:0/2809187999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97dc071f90 0x7f97dc14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 >> 172.21.15.93:0/2809187999 conn(0x7f97dc06d800 msgr2=0x7f97dc15ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 shutdown_connections 2023-11-04T01:38:01.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.250+0000 7f97e3b00640 1 -- 172.21.15.93:0/2809187999 wait complete. 2023-11-04T01:38:01.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:01.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.407+0000 7f2a6dce0640 1 Processor -- start 2023-11-04T01:38:01.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.407+0000 7f2a6dce0640 1 -- start start 2023-11-04T01:38:01.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a6dce0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a680cd9f0 0x7f2a680cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a6dce0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680d1320 con 0x7f2a680d27c0 2023-11-04T01:38:01.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a6dce0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680b5600 con 0x7f2a6815d4b0 2023-11-04T01:38:01.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a6dce0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6815e4d0 con 0x7f2a680cd9f0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a67fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2a680d27c0 0x7f2a680b4ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56682/0 (socket says 172.21.15.93:56682) 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.408+0000 7f2a67fff640 1 -- 172.21.15.93:0/3274955525 learned_addr learned my addr 172.21.15.93:0/3274955525 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560069020 0 0) 0x7f2a680d1320 con 0x7f2a680d27c0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a50003520 con 0x7f2a680d27c0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a677fe640 1 --2- 172.21.15.93:0/3274955525 >> v2:172.21.15.125:3300/0 conn(0x7f2a680cd9f0 0x7f2a680cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2511607347 0 0) 0x7f2a50003520 con 0x7f2a680d27c0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 >> v2:172.21.15.125:3300/0 conn(0x7f2a680cd9f0 msgr2=0x7f2a680cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 --2- 172.21.15.93:0/3274955525 >> v2:172.21.15.125:3300/0 conn(0x7f2a680cd9f0 0x7f2a680cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 >> v1:172.21.15.125:6789/0 conn(0x7f2a6815d4b0 legacy=0x7f2a680b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680ce310 con 0x7f2a680d27c0 2023-11-04T01:38:01.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f2a600019f0 con 0x7f2a680d27c0 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 >> v1:172.21.15.93:6789/0 conn(0x7f2a680d27c0 legacy=0x7f2a680b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50003970 0x7f2a50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500047c0 0x7f2a50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6815e4d0 con 0x7f2a50005180 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5000c0b0 con 0x7f2a50003970 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5000c270 con 0x7f2a500047c0 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a677fe640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50003970 0x7f2a50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a66ffd640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500047c0 0x7f2a50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 -- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500047c0 msgr2=0x7f2a50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a500047c0 0x7f2a50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 -- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50003970 msgr2=0x7f2a50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a50003970 0x7f2a50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.409+0000 7f2a67fff640 1 -- 172.21.15.93:0/3274955525 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50003520 con 0x7f2a50005180 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.410+0000 7f2a67fff640 1 -- 172.21.15.93:0/3274955525 reap_dead start 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.410+0000 7f2a67fff640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a5000b980 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000a7c0 tx=0x7f2a500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74872e5b5bcdf8b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.410+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60034630 con 0x7f2a50005180 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.410+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6002f070 con 0x7f2a50005180 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.410+0000 7f2a667fc640 1 -- 172.21.15.93:0/3274955525 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a600349f0 con 0x7f2a50005180 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 msgr2=0x7f2a5000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a5000b980 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000a7c0 tx=0x7f2a500057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3274955525 shutdown_connections 2023-11-04T01:38:01.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3274955525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a5000b980 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3274955525 >> 172.21.15.93:0/3274955525 conn(0x7f2a68071c40 msgr2=0x7f2a68072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3274955525 shutdown_connections 2023-11-04T01:38:01.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.411+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3274955525 wait complete. 2023-11-04T01:38:01.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.412+0000 7f2a6dce0640 1 Processor -- start 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.412+0000 7f2a6dce0640 1 -- start start 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6814cd00 0x7f2a6814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a680ca0b0 0x7f2a680ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680a9e40 con 0x7f2a50005180 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680cade0 con 0x7f2a6814cd00 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680cb0c0 con 0x7f2a680ca0b0 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43582/0 (socket says 172.21.15.93:43582) 2023-11-04T01:38:01.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 -- 172.21.15.93:0/3429932144 learned_addr learned my addr 172.21.15.93:0/3429932144 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a66ffd640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6814cd00 0x7f2a6814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 -- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a680ca0b0 msgr2=0x7f2a680ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a67fff640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a680ca0b0 0x7f2a680ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a680ca0b0 0x7f2a680ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 -- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6814cd00 msgr2=0x7f2a6814d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6814cd00 0x7f2a6814d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 -- 172.21.15.93:0/3429932144 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680a9780 con 0x7f2a50005180 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a677fe640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800b7c0 tx=0x7f2a5800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58010830 con 0x7f2a50005180 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58010990 con 0x7f2a50005180 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58010d20 con 0x7f2a50005180 2023-11-04T01:38:01.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680a9a60 con 0x7f2a50005180 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.413+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680caa50 con 0x7f2a50005180 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.414+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6804e490 con 0x7f2a50005180 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.415+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a58014430 con 0x7f2a50005180 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.415+0000 7f2a4ffff640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 0x7f2a5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.415+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f2a58089e80 con 0x7f2a50005180 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.415+0000 7f2a66ffd640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 0x7f2a5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.416+0000 7f2a66ffd640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 0x7f2a5406d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2a68156280 tx=0x7f2a5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.419+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a58054cc0 con 0x7f2a50005180 2023-11-04T01:38:01.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:01.586+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a680d0cd0 con 0x7f2a50005180 2023-11-04T01:38:02.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.252+0000 7f2a4ffff640 1 -- 172.21.15.93:0/3429932144 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2a580220d0 con 0x7f2a50005180 2023-11-04T01:38:02.255 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:02.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.257+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 msgr2=0x7f2a5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.257+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 0x7f2a5406d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2a68156280 tx=0x7f2a5c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:02.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.257+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 msgr2=0x7f2a6815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.257+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800b7c0 tx=0x7f2a5800bc80 comp rx=0 tx=0).stop 2023-11-04T01:38:02.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 shutdown_connections 2023-11-04T01:38:02.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a5406ae70 0x7f2a5406d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a680ca0b0 0x7f2a680ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6814cd00 0x7f2a6814d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 --2- 172.21.15.93:0/3429932144 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a50005180 0x7f2a6815efb0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.258+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 >> 172.21.15.93:0/3429932144 conn(0x7f2a68071c40 msgr2=0x7f2a6815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.259+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 shutdown_connections 2023-11-04T01:38:02.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.259+0000 7f2a6dce0640 1 -- 172.21.15.93:0/3429932144 wait complete. 2023-11-04T01:38:02.275 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:02.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.378+0000 7ffad5b39640 1 Processor -- start 2023-11-04T01:38:02.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.378+0000 7ffad5b39640 1 -- start start 2023-11-04T01:38:02.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 0x7ffad00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 0x7ffad00b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffad00cd740 0x7ffad006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00b5250 con 0x7ffad00cd740 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad006ed30 con 0x7ffad006f4a0 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffad5b39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad006f260 con 0x7ffad00cd360 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffacffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffad00cd740 0x7ffad006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffacffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffad00cd740 0x7ffad006ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43592/0 (socket says 172.21.15.93:43592) 2023-11-04T01:38:02.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffacffff640 1 -- 172.21.15.93:0/964014612 learned_addr learned my addr 172.21.15.93:0/964014612 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 0x7ffad00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffaceffd640 1 --2- 172.21.15.93:0/964014612 >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 0x7ffad00b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.379+0000 7ffacffff640 1 -- 172.21.15.93:0/964014612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 msgr2=0x7ffad00b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacffff640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 0x7ffad00b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacffff640 1 -- 172.21.15.93:0/964014612 >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 msgr2=0x7ffad00b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacffff640 1 --2- 172.21.15.93:0/964014612 >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 0x7ffad00b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacffff640 1 -- 172.21.15.93:0/964014612 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad006a8a0 con 0x7ffad00cd740 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 0x7ffad00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:02.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffaceffd640 1 --2- 172.21.15.93:0/964014612 >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 0x7ffad00b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7ffacffff640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad006ad30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffad0070b50 tx=0x7ffac802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357f4fe81cb18b3c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7fface7fc640 1 -- 172.21.15.93:0/964014612 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac802ca70 con 0x7ffad00cd740 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7fface7fc640 1 -- 172.21.15.93:0/964014612 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac802cbd0 con 0x7ffad00cd740 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.380+0000 7fface7fc640 1 -- 172.21.15.93:0/964014612 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80343f0 con 0x7ffad00cd740 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 -- 172.21.15.93:0/964014612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 msgr2=0x7ffad006ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad006ad30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffad0070b50 tx=0x7ffac802bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 -- 172.21.15.93:0/964014612 shutdown_connections 2023-11-04T01:38:02.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad006ad30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 --2- 172.21.15.93:0/964014612 >> v2:172.21.15.125:3300/0 conn(0x7ffad006f4a0 0x7ffad00b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 --2- 172.21.15.93:0/964014612 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad00cd360 0x7ffad00b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 -- 172.21.15.93:0/964014612 >> 172.21.15.93:0/964014612 conn(0x7ffad00b0ce0 msgr2=0x7ffad00b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 -- 172.21.15.93:0/964014612 shutdown_connections 2023-11-04T01:38:02.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.381+0000 7ffad5b39640 1 -- 172.21.15.93:0/964014612 wait complete. 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.382+0000 7ffad5b39640 1 Processor -- start 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.382+0000 7ffad5b39640 1 -- start start 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 0x7ffad01e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffad00cd360 0x7ffad0150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01f4da0 con 0x7ffad00cd740 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01e4c20 con 0x7ffad00cd360 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffad5b39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01e2e40 con 0x7ffad006f4a0 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43602/0 (socket says 172.21.15.93:43602) 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 -- 172.21.15.93:0/4272997049 learned_addr learned my addr 172.21.15.93:0/4272997049 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffaceffd640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffad00cd360 0x7ffad0150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 0x7ffad01e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 -- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 msgr2=0x7ffad01e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 0x7ffad01e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 -- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffad00cd360 msgr2=0x7ffad0150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffad00cd360 0x7ffad0150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacffff640 1 -- 172.21.15.93:0/4272997049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8009b30 con 0x7ffad00cd740 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.383+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 0x7ffad01e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffacffff640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ffac8036040 tx=0x7ffac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8040670 con 0x7ffad00cd740 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac80407d0 con 0x7ffad00cd740 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad01e3120 con 0x7ffad00cd740 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8040b80 con 0x7ffad00cd740 2023-11-04T01:38:02.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.384+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad01e5670 con 0x7ffad00cd740 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.385+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad01e3640 con 0x7ffad00cd740 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.385+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffac8040ce0 con 0x7ffad00cd740 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.386+0000 7ffab7fff640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 0x7ffabc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.386+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6030+0+0 (secure 0 0 0) 0x7ffac80ac7f0 con 0x7ffad00cd740 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.386+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 0x7ffabc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.386+0000 7ffacf7fe640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 0x7ffabc06d360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffac000a990 tx=0x7ffac0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.390+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffad01e3640 con 0x7ffad00cd740 2023-11-04T01:38:02.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:02.560+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffad01e3640 con 0x7ffad00cd740 2023-11-04T01:38:03.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.253+0000 7ffab7fff640 1 -- 172.21.15.93:0/4272997049 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffad01e3640 con 0x7ffad00cd740 2023-11-04T01:38:03.259 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:03.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.257+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 msgr2=0x7ffabc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.257+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 0x7ffabc06d360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffac000a990 tx=0x7ffac0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.257+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 msgr2=0x7ffad01f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.257+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ffac8036040 tx=0x7ffac8004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 shutdown_connections 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffabc06aea0 0x7ffabc06d360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffad00cd740 0x7ffad01f4860 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffad00cd360 0x7ffad0150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 --2- 172.21.15.93:0/4272997049 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffad006f4a0 0x7ffad01e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.259+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 >> 172.21.15.93:0/4272997049 conn(0x7ffad00b0ce0 msgr2=0x7ffad00b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.260+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 shutdown_connections 2023-11-04T01:38:03.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.260+0000 7ffad5b39640 1 -- 172.21.15.93:0/4272997049 wait complete. 2023-11-04T01:38:03.276 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:03.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.376+0000 7fcfb9464640 1 Processor -- start 2023-11-04T01:38:03.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.376+0000 7fcfb9464640 1 -- start start 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb9464640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfb4153e60 0x7fcfb415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb9464640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40cde60 con 0x7fcfb40b4880 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb9464640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb4160f90 con 0x7fcfb40cd6d0 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb9464640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb415e400 con 0x7fcfb4153e60 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcfb40b4880 0x7fcfb40d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56692/0 (socket says 172.21.15.93:56692) 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb37fe640 1 -- 172.21.15.93:0/3003651299 learned_addr learned my addr 172.21.15.93:0/3003651299 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb2ffd640 1 --2- 172.21.15.93:0/3003651299 >> v2:172.21.15.125:3300/0 conn(0x7fcfb4153e60 0x7fcfb415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976773131 0 0) 0x7fcfb40cde60 con 0x7fcfb40b4880 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf9c003520 con 0x7fcfb40b4880 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281049724 0 0) 0x7fcf9c003520 con 0x7fcfb40b4880 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 >> v2:172.21.15.125:3300/0 conn(0x7fcfb4153e60 msgr2=0x7fcfb415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 --2- 172.21.15.93:0/3003651299 >> v2:172.21.15.125:3300/0 conn(0x7fcfb4153e60 0x7fcfb415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 >> v1:172.21.15.125:6789/0 conn(0x7fcfb40cd6d0 legacy=0x7fcfb4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40ce090 con 0x7fcfb40b4880 2023-11-04T01:38:03.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fcfac001670 con 0x7fcfb40b4880 2023-11-04T01:38:03.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 >> v1:172.21.15.93:6789/0 conn(0x7fcfb40b4880 legacy=0x7fcfb40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf9c003970 0x7fcf9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.377+0000 7fcfb1ffb640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c0047c0 0x7fcf9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb1ffb640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 0x7fcf9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb415e400 con 0x7fcf9c005180 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c00c020 con 0x7fcf9c0047c0 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c00c1e0 con 0x7fcf9c003970 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 0x7fcf9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb27fc640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c0047c0 0x7fcf9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb2ffd640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf9c003970 0x7fcf9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 -- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf9c003970 msgr2=0x7fcf9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcf9c003970 0x7fcf9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 -- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c0047c0 msgr2=0x7fcf9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c0047c0 0x7fcf9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.378+0000 7fcfb37fe640 1 -- 172.21.15.93:0/3003651299 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c003520 con 0x7fcf9c005180 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb37fe640 1 -- 172.21.15.93:0/3003651299 reap_dead start 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 0x7fcf9c00b980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c240 tx=0x7fcf9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1c8c6d661efc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac005ad0 con 0x7fcf9c005180 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac005c70 con 0x7fcf9c005180 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb1ffb640 1 -- 172.21.15.93:0/3003651299 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac02c8b0 con 0x7fcf9c005180 2023-11-04T01:38:03.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 -- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 msgr2=0x7fcf9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 0x7fcf9c00b980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c240 tx=0x7fcf9c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 -- 172.21.15.93:0/3003651299 shutdown_connections 2023-11-04T01:38:03.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 --2- 172.21.15.93:0/3003651299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf9c005180 0x7fcf9c00b980 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 -- 172.21.15.93:0/3003651299 >> 172.21.15.93:0/3003651299 conn(0x7fcfb40cf880 msgr2=0x7fcfb40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 -- 172.21.15.93:0/3003651299 shutdown_connections 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.379+0000 7fcfb9464640 1 -- 172.21.15.93:0/3003651299 wait complete. 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 Processor -- start 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 -- start start 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c005180 0x7fcfb40c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 0x7fcfb4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41428f0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41423d0 con 0x7fcf9c005180 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb9464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41561b0 con 0x7fcfb4141a10 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43628/0 (socket says 172.21.15.93:43628) 2023-11-04T01:38:03.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.381+0000 7fcfb37fe640 1 -- 172.21.15.93:0/2594901682 learned_addr learned my addr 172.21.15.93:0/2594901682 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb2ffd640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c005180 0x7fcfb40c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb27fc640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 0x7fcfb4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 -- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 msgr2=0x7fcfb4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 0x7fcfb4141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 -- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c005180 msgr2=0x7fcfb40c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c005180 0x7fcfb40c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 -- 172.21.15.93:0/2594901682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb413fe20 con 0x7fcfb4154fe0 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb27fc640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 0x7fcfb4141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb37fe640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c360 tx=0x7fcfac001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0049e0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac004b40 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb41559a0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac001640 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.382+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40c5f50 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.383+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb413ffb0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.383+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfac032070 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.384+0000 7fcf9b7fe640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 0x7fcfa006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.384+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcfac03c070 con 0x7fcfb4154fe0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.384+0000 7fcfb2ffd640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 0x7fcfa006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.384+0000 7fcfb2ffd640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 0x7fcfa006d360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4014450 tx=0x7fcfa400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.388+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfac0759f0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.555+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcfb4074290 con 0x7fcfb4154fe0 2023-11-04T01:38:03.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.558+0000 7fcf9b7fe640 1 -- 172.21.15.93:0/2594901682 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcfac0450a0 con 0x7fcfb4154fe0 2023-11-04T01:38:03.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 msgr2=0x7fcfa006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 0x7fcfa006d360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4014450 tx=0x7fcfa400b040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 msgr2=0x7fcfb4155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c360 tx=0x7fcfac001a00 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 shutdown_connections 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfa006aea0 0x7fcfa006d360 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfb4154fe0 0x7fcfb4155460 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfb4141a10 0x7fcfb4141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 --2- 172.21.15.93:0/2594901682 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf9c005180 0x7fcfb40c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 >> 172.21.15.93:0/2594901682 conn(0x7fcfb40cf880 msgr2=0x7fcfb40d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 shutdown_connections 2023-11-04T01:38:03.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.560+0000 7fcfb9464640 1 -- 172.21.15.93:0/2594901682 wait complete. 2023-11-04T01:38:03.573 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:38:03.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.671+0000 7ffabd5d0640 1 Processor -- start 2023-11-04T01:38:03.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.671+0000 7ffabd5d0640 1 -- start start 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffabd5d0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffab80ce070 0x7ffab80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffabd5d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffab80b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffabd5d0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80b5e20 con 0x7ffab815d0a0 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffabd5d0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80ce4d0 con 0x7ffab80ce070 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffabd5d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80b51e0 con 0x7ffab80b4d50 2023-11-04T01:38:03.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffab815d0a0 0x7ffab80d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56702/0 (socket says 172.21.15.93:56702) 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab6ffd640 1 -- 172.21.15.93:0/1568655274 learned_addr learned my addr 172.21.15.93:0/1568655274 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577331834 0 0) 0x7ffab80b5e20 con 0x7ffab815d0a0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa0003520 con 0x7ffab815d0a0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1568655274 >> v2:172.21.15.125:3300/0 conn(0x7ffab80ce070 0x7ffab80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab77fe640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffab80b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1533103775 0 0) 0x7ffaa0003520 con 0x7ffab815d0a0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 msgr2=0x7ffab80b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffab80b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 >> v2:172.21.15.125:3300/0 conn(0x7ffab80ce070 msgr2=0x7ffab80b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 --2- 172.21.15.93:0/1568655274 >> v2:172.21.15.125:3300/0 conn(0x7ffab80ce070 0x7ffab80b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80b60e0 con 0x7ffab815d0a0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.672+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ffaa8001670 con 0x7ffab815d0a0 2023-11-04T01:38:03.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 >> v1:172.21.15.93:6789/0 conn(0x7ffab815d0a0 legacy=0x7ffab80d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa0003970 0x7ffaa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaa00047c0 0x7ffaa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffaa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ce4d0 con 0x7ffaa00047c0 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80b51e0 con 0x7ffaa0003970 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa000b980 con 0x7ffab80b4d50 2023-11-04T01:38:03.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaa00047c0 0x7ffaa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab6ffd640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa0003970 0x7ffaa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab77fe640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffaa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 -- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 msgr2=0x7ffaa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffab80b4d50 0x7ffaa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 -- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa0003970 msgr2=0x7ffaa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa0003970 0x7ffaa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.673+0000 7ffab67fc640 1 -- 172.21.15.93:0/1568655274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0003520 con 0x7ffaa00047c0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaa00047c0 0x7ffaa0004c40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009ac0 tx=0x7ffaa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372642e5854b82b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac02c710 con 0x7ffaa00047c0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac02c870 con 0x7ffaa00047c0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffab5ffb640 1 -- 172.21.15.93:0/1568655274 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac02cc00 con 0x7ffaa00047c0 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1568655274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaa00047c0 msgr2=0x7ffaa0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1568655274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffaa00047c0 0x7ffaa0004c40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009ac0 tx=0x7ffaa00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.674+0000 7ffab77fe640 1 -- 172.21.15.93:0/1568655274 reap_dead start 2023-11-04T01:38:03.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.675+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1568655274 shutdown_connections 2023-11-04T01:38:03.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.675+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1568655274 >> 172.21.15.93:0/1568655274 conn(0x7ffab80cf810 msgr2=0x7ffab80cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.675+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1568655274 shutdown_connections 2023-11-04T01:38:03.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.675+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1568655274 wait complete. 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.676+0000 7ffabd5d0640 1 Processor -- start 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.676+0000 7ffabd5d0640 1 -- start start 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 0x7ffab8155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab81558f0 0x7ffab8158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81588e0 con 0x7ffab80c9560 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8158320 con 0x7ffab81558f0 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8158600 con 0x7ffaa00047c0 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43660/0 (socket says 172.21.15.93:43660) 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 -- 172.21.15.93:0/1536470621 learned_addr learned my addr 172.21.15.93:0/1536470621 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:03.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab6ffd640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 0x7ffab8155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab67fc640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab81558f0 0x7ffab8158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 -- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 msgr2=0x7ffab8155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 0x7ffab8155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 -- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab81558f0 msgr2=0x7ffab8158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab81558f0 0x7ffab8158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 -- 172.21.15.93:0/1536470621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80c9f00 con 0x7ffab80c9560 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab6ffd640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 0x7ffab8155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffab77fe640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ffab80cf7e0 tx=0x7ffab000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab000e040 con 0x7ffab80c9560 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab000f040 con 0x7ffab80c9560 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab80ca1e0 con 0x7ffab80c9560 2023-11-04T01:38:03.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0015430 con 0x7ffab80c9560 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.677+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab8159090 con 0x7ffab80c9560 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.678+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8074290 con 0x7ffab80c9560 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.679+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffab0015590 con 0x7ffab80c9560 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.679+0000 7ffa9f7fe640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 0x7ffaa406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.679+0000 7ffab6ffd640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 0x7ffaa406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.679+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ffab0089f30 con 0x7ffab80c9560 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.680+0000 7ffab6ffd640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 0x7ffaa406d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8007fd0 tx=0x7ffaa8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.683+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffab0055180 con 0x7ffab80c9560 2023-11-04T01:38:03.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:03.914+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7ffab80b6aa0 con 0x7ffab80c9560 2023-11-04T01:38:04.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.264+0000 7ffa9f7fe640 1 -- 172.21.15.93:0/1536470621 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v148) v1 ==== 178+0+0 (secure 0 0 0) 0x7ffab00587a0 con 0x7ffab80c9560 2023-11-04T01:38:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 msgr2=0x7ffaa406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 0x7ffaa406d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8007fd0 tx=0x7ffaa8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 msgr2=0x7ffab80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ffab80cf7e0 tx=0x7ffab000f580 comp rx=0 tx=0).stop 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 shutdown_connections 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffaa406ae70 0x7ffaa406d330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80c9560 0x7ffab80cb5c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab81558f0 0x7ffab8158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 --2- 172.21.15.93:0/1536470621 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffaa00047c0 0x7ffab8155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.267+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 >> 172.21.15.93:0/1536470621 conn(0x7ffab80cf810 msgr2=0x7ffab815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.268+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 shutdown_connections 2023-11-04T01:38:04.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.268+0000 7ffabd5d0640 1 -- 172.21.15.93:0/1536470621 wait complete. 2023-11-04T01:38:04.281 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:38:04.281 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:38:04.281 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:38:04.282 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:04.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.379+0000 7f46d75d7640 1 Processor -- start 2023-11-04T01:38:04.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.379+0000 7f46d75d7640 1 -- start start 2023-11-04T01:38:04.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d75d7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d015ce70 0x7f46d006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d75d7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46d015d250 0x7f46d00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d75d7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d006a120 con 0x7f46d00c9d70 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d75d7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00cdc10 con 0x7f46d015ce70 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d75d7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d006def0 con 0x7f46d015d250 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d015ce70 0x7f46d006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5b74640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f46d00c9d70 0x7f46d00ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56710/0 (socket says 172.21.15.93:56710) 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d015ce70 0x7f46d006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43666/0 (socket says 172.21.15.93:43666) 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5b74640 1 -- 172.21.15.93:0/2731434518 learned_addr learned my addr 172.21.15.93:0/2731434518 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 -- 172.21.15.93:0/2731434518 >> v2:172.21.15.125:3300/0 conn(0x7f46d015d250 msgr2=0x7f46d00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 --2- 172.21.15.93:0/2731434518 >> v2:172.21.15.125:3300/0 conn(0x7f46d015d250 0x7f46d00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 -- 172.21.15.93:0/2731434518 >> v1:172.21.15.93:6789/0 conn(0x7f46d00c9d70 legacy=0x7f46d00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46c7fff640 1 -- 172.21.15.93:0/2731434518 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547614721 0 0) 0x7f46d006a120 con 0x7f46d00c9d70 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.380+0000 7f46d5373640 1 -- 172.21.15.93:0/2731434518 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d006a370 con 0x7f46d015ce70 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.381+0000 7f46d5373640 1 --2- 172.21.15.93:0/2731434518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d006d9b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f46d00d02c0 tx=0x7f46cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7d5b5a57fe852b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.381+0000 7f46c7fff640 1 -- 172.21.15.93:0/2731434518 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc031830 con 0x7f46d015ce70 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.381+0000 7f46c7fff640 1 -- 172.21.15.93:0/2731434518 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc031990 con 0x7f46d015ce70 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.381+0000 7f46c7fff640 1 -- 172.21.15.93:0/2731434518 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc031d20 con 0x7f46d015ce70 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 -- 172.21.15.93:0/2731434518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 msgr2=0x7f46d006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 --2- 172.21.15.93:0/2731434518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d006d9b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f46d00d02c0 tx=0x7f46cc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 -- 172.21.15.93:0/2731434518 shutdown_connections 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 --2- 172.21.15.93:0/2731434518 >> v2:172.21.15.125:3300/0 conn(0x7f46d015d250 0x7f46d00c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 --2- 172.21.15.93:0/2731434518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d006d9b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 -- 172.21.15.93:0/2731434518 >> 172.21.15.93:0/2731434518 conn(0x7f46d00b0cd0 msgr2=0x7f46d00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 -- 172.21.15.93:0/2731434518 shutdown_connections 2023-11-04T01:38:04.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.382+0000 7f46d75d7640 1 -- 172.21.15.93:0/2731434518 wait complete. 2023-11-04T01:38:04.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.383+0000 7f46d75d7640 1 Processor -- start 2023-11-04T01:38:04.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.383+0000 7f46d75d7640 1 -- start start 2023-11-04T01:38:04.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d015d250 0x7f46d01e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d00c6ca0 0x7f46d00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c7690 con 0x7f46d015ce70 2023-11-04T01:38:04.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d0153ef0 con 0x7f46d00c6ca0 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d01f6290 con 0x7f46d015d250 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43668/0 (socket says 172.21.15.93:43668) 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 -- 172.21.15.93:0/1061701640 learned_addr learned my addr 172.21.15.93:0/1061701640 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 -- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d015d250 msgr2=0x7f46d01e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d015d250 0x7f46d01e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 -- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d00c6ca0 msgr2=0x7f46d00c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d00c6ca0 0x7f46d00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 -- 172.21.15.93:0/1061701640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009400 con 0x7f46d015ce70 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d5373640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009890 tx=0x7f46cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc03ba70 con 0x7f46d015ce70 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc03bbf0 con 0x7f46d015ce70 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d01f6530 con 0x7f46d015ce70 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.384+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0453f0 con 0x7f46d015ce70 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.385+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d01f6af0 con 0x7f46d015ce70 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.386+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d0074290 con 0x7f46d015ce70 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.386+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46cc045550 con 0x7f46d015ce70 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.386+0000 7f46c5ffb640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 0x7f46b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.387+0000 7f46d4b72640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 0x7f46b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.387+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f46cc0ab800 con 0x7f46d015ce70 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.387+0000 7f46d4b72640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 0x7f46b406d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f46d00c64d0 tx=0x7f46c0006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.391+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46cc076ac0 con 0x7f46d015ce70 2023-11-04T01:38:04.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.558+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46d0066170 con 0x7f46d015ce70 2023-11-04T01:38:04.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.559+0000 7f46c5ffb640 1 -- 172.21.15.93:0/1061701640 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14956 (secure 0 0 0) 0x7f46cc07a0e0 con 0x7f46d015ce70 2023-11-04T01:38:04.562 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:04.562 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":57,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:03.253838+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6836/1137152814":"2023-11-05T01:38:00.247192+0000","172.21.15.93:6834/1137152814":"2023-11-05T01:38:00.247192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 msgr2=0x7f46b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 0x7f46b406d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f46d00c64d0 tx=0x7f46c0006bf0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 msgr2=0x7f46d014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009890 tx=0x7f46cc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 shutdown_connections 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b406aea0 0x7f46b406d360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d00c6ca0 0x7f46d00c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d015d250 0x7f46d01e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 --2- 172.21.15.93:0/1061701640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d015ce70 0x7f46d014d210 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 >> 172.21.15.93:0/1061701640 conn(0x7f46d00b0cd0 msgr2=0x7f46d0155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.561+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 shutdown_connections 2023-11-04T01:38:04.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.562+0000 7f46d75d7640 1 -- 172.21.15.93:0/1061701640 wait complete. 2023-11-04T01:38:04.575 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:04.575 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:04.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.675+0000 7f4c3d78e640 1 Processor -- start 2023-11-04T01:38:04.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.675+0000 7f4c3d78e640 1 -- start start 2023-11-04T01:38:04.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c3d78e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c3815e430 0x7f4c380cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c3d78e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4c380d0710 0x7f4c380b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c3d78e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380d0280 con 0x7f4c380cf160 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c3d78e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380cf670 con 0x7f4c380d0710 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c3d78e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380cf950 con 0x7f4c3815e430 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4c380d0710 0x7f4c380b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4c380d0710 0x7f4c380b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43676/0 (socket says 172.21.15.93:43676) 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c367fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4c380cf160 0x7f4c380cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56724/0 (socket says 172.21.15.93:56724) 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 -- 172.21.15.93:0/3597840631 learned_addr learned my addr 172.21.15.93:0/3597840631 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c36ffd640 1 --2- 172.21.15.93:0/3597840631 >> v2:172.21.15.125:3300/0 conn(0x7f4c3815e430 0x7f4c380cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 -- 172.21.15.93:0/3597840631 >> v2:172.21.15.125:3300/0 conn(0x7f4c3815e430 msgr2=0x7f4c380cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 --2- 172.21.15.93:0/3597840631 >> v2:172.21.15.125:3300/0 conn(0x7f4c3815e430 0x7f4c380cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 -- 172.21.15.93:0/3597840631 >> v1:172.21.15.93:6789/0 conn(0x7f4c380cf160 legacy=0x7f4c380cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c377fe640 1 -- 172.21.15.93:0/3597840631 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380cfc30 con 0x7f4c380d0710 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.676+0000 7f4c35ffb640 1 -- 172.21.15.93:0/3597840631 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933516322 0 0) 0x7f4c380d0280 con 0x7f4c380cf160 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.677+0000 7f4c377fe640 1 --2- 172.21.15.93:0/3597840631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c380b3d40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4c3806e5b0 tx=0x7f4c3002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65aa04316386b33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.677+0000 7f4c35ffb640 1 -- 172.21.15.93:0/3597840631 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3002cb20 con 0x7f4c380d0710 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.677+0000 7f4c35ffb640 1 -- 172.21.15.93:0/3597840631 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3002cc80 con 0x7f4c380d0710 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.677+0000 7f4c35ffb640 1 -- 172.21.15.93:0/3597840631 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300343f0 con 0x7f4c380d0710 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 -- 172.21.15.93:0/3597840631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 msgr2=0x7f4c380b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/3597840631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c380b3d40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4c3806e5b0 tx=0x7f4c3002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:04.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 -- 172.21.15.93:0/3597840631 shutdown_connections 2023-11-04T01:38:04.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/3597840631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c380b3d40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/3597840631 >> v2:172.21.15.125:3300/0 conn(0x7f4c3815e430 0x7f4c380cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 -- 172.21.15.93:0/3597840631 >> 172.21.15.93:0/3597840631 conn(0x7f4c3806ea20 msgr2=0x7f4c3806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 -- 172.21.15.93:0/3597840631 shutdown_connections 2023-11-04T01:38:04.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.678+0000 7f4c3d78e640 1 -- 172.21.15.93:0/3597840631 wait complete. 2023-11-04T01:38:04.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.679+0000 7f4c3d78e640 1 Processor -- start 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.679+0000 7f4c3d78e640 1 -- start start 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c380cf160 0x7f4c380b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c3815e430 0x7f4c380b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b19e0 con 0x7f4c380d0710 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b1c80 con 0x7f4c380cf160 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b1f60 con 0x7f4c3815e430 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43684/0 (socket says 172.21.15.93:43684) 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 -- 172.21.15.93:0/4088592830 learned_addr learned my addr 172.21.15.93:0/4088592830 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:04.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 -- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c3815e430 msgr2=0x7f4c380b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c3815e430 0x7f4c380b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 -- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c380cf160 msgr2=0x7f4c380b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c380cf160 0x7f4c380b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 -- 172.21.15.93:0/4088592830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009b30 con 0x7f4c380d0710 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c367fc640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c430 tx=0x7f4c2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0074e0 con 0x7f4c380d0710 2023-11-04T01:38:04.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c007660 con 0x7f4c380d0710 2023-11-04T01:38:04.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.680+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380b2240 con 0x7f4c380d0710 2023-11-04T01:38:04.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.681+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c004a20 con 0x7f4c380d0710 2023-11-04T01:38:04.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.681+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380b2800 con 0x7f4c380d0710 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.682+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c380b2a20 con 0x7f4c380d0710 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.682+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c2c004b80 con 0x7f4c380d0710 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.682+0000 7f4c1f7fe640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.682+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4c2c0893e0 con 0x7f4c380d0710 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.682+0000 7f4c36ffd640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.683+0000 7f4c36ffd640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 0x7f4c2406d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c28006fd0 tx=0x7f4c28008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.687+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c2c0544f0 con 0x7f4c380d0710 2023-11-04T01:38:04.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.851+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c38074290 con 0x7f4c380d0710 2023-11-04T01:38:04.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.851+0000 7f4c1f7fe640 1 -- 172.21.15.93:0/4088592830 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c2c057b10 con 0x7f4c380d0710 2023-11-04T01:38:04.853 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:04.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 msgr2=0x7f4c2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 0x7f4c2406d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c28006fd0 tx=0x7f4c28008040 comp rx=0 tx=0).stop 2023-11-04T01:38:04.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 msgr2=0x7f4c381f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c430 tx=0x7f4c2c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 shutdown_connections 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c2406ae70 0x7f4c2406d330 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4c3815e430 0x7f4c380b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c380d0710 0x7f4c381f0070 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 --2- 172.21.15.93:0/4088592830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c380cf160 0x7f4c380b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 >> 172.21.15.93:0/4088592830 conn(0x7f4c3806ea20 msgr2=0x7f4c38150f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 shutdown_connections 2023-11-04T01:38:04.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.853+0000 7f4c3d78e640 1 -- 172.21.15.93:0/4088592830 wait complete. 2023-11-04T01:38:04.866 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:04.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.965+0000 7f4cbfe4f640 1 Processor -- start 2023-11-04T01:38:04.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.965+0000 7f4cbfe4f640 1 -- start start 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbfe4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4cb815e430 0x7f4cb80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbfe4f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80d0280 con 0x7f4cb80cf160 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbfe4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80cf670 con 0x7f4cb80d0710 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbfe4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80cf950 con 0x7f4cb815e430 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbdbeb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4cb815e430 0x7f4cb80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbd3ea640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4cb80cf160 0x7f4cb80cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56738/0 (socket says 172.21.15.93:56738) 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.966+0000 7f4cbd3ea640 1 -- 172.21.15.93:0/849526778 learned_addr learned my addr 172.21.15.93:0/849526778 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:04.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.967+0000 7f4cbdbeb640 1 -- 172.21.15.93:0/849526778 >> v1:172.21.15.125:6789/0 conn(0x7f4cb80d0710 legacy=0x7f4cb80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.967+0000 7f4cbdbeb640 1 -- 172.21.15.93:0/849526778 >> v1:172.21.15.93:6789/0 conn(0x7f4cb80cf160 legacy=0x7f4cb80cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.967+0000 7f4cbcbe9640 1 -- 172.21.15.93:0/849526778 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261734705 0 0) 0x7f4cb80d0280 con 0x7f4cb80cf160 2023-11-04T01:38:04.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.967+0000 7f4cbdbeb640 1 -- 172.21.15.93:0/849526778 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80cfc30 con 0x7f4cb815e430 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.967+0000 7f4cbdbeb640 1 --2- 172.21.15.93:0/849526778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb815e430 0x7f4cb80cec20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097a0 tx=0x7f4cb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eb4116c650ef40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbcbe9640 1 -- 172.21.15.93:0/849526778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4031830 con 0x7f4cb815e430 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbcbe9640 1 -- 172.21.15.93:0/849526778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb4031990 con 0x7f4cb815e430 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbcbe9640 1 -- 172.21.15.93:0/849526778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4031d20 con 0x7f4cb815e430 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/849526778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb815e430 msgr2=0x7f4cb80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/849526778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb815e430 0x7f4cb80cec20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097a0 tx=0x7f4cb402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/849526778 shutdown_connections 2023-11-04T01:38:04.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/849526778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb815e430 0x7f4cb80cec20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/849526778 >> 172.21.15.93:0/849526778 conn(0x7f4cb806ea20 msgr2=0x7f4cb806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/849526778 shutdown_connections 2023-11-04T01:38:04.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.968+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/849526778 wait complete. 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.969+0000 7f4cbfe4f640 1 Processor -- start 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.969+0000 7f4cbfe4f640 1 -- start start 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cb80cf160 0x7f4cb814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb815e430 0x7f4cb80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80b0ef0 con 0x7f4cb80d0710 2023-11-04T01:38:04.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80b05e0 con 0x7f4cb815e430 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbfe4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80c6de0 con 0x7f4cb80cf160 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43704/0 (socket says 172.21.15.93:43704) 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 -- 172.21.15.93:0/2631792654 learned_addr learned my addr 172.21.15.93:0/2631792654 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbdbeb640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cb80cf160 0x7f4cb814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbe3ec640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb815e430 0x7f4cb80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 -- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cb80cf160 msgr2=0x7f4cb814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cb80cf160 0x7f4cb814bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 -- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb815e430 msgr2=0x7f4cb80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.970+0000 7f4cbd3ea640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb815e430 0x7f4cb80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cbd3ea640 1 -- 172.21.15.93:0/2631792654 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009400 con 0x7f4cb80d0710 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cbd3ea640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c4d0 tx=0x7f4ca800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80074e0 con 0x7f4cb80d0710 2023-11-04T01:38:04.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8007660 con 0x7f4cb80d0710 2023-11-04T01:38:04.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb80b0830 con 0x7f4cb80d0710 2023-11-04T01:38:04.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8004a20 con 0x7f4cb80d0710 2023-11-04T01:38:04.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.971+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb814c510 con 0x7f4cb80d0710 2023-11-04T01:38:04.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.972+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb8074290 con 0x7f4cb80d0710 2023-11-04T01:38:04.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.972+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ca8004b80 con 0x7f4cb80d0710 2023-11-04T01:38:04.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.973+0000 7f4cae7fc640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 0x7f4c9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.973+0000 7f4cbdbeb640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 0x7f4c9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.973+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4ca8088a60 con 0x7f4cb80d0710 2023-11-04T01:38:04.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.973+0000 7f4cbdbeb640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 0x7f4c9c06d330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4036000 tx=0x7f4cb403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:04.977+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ca8053c00 con 0x7f4cb80d0710 2023-11-04T01:38:05.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.142+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f4cb815a840 con 0x7f4cb80d0710 2023-11-04T01:38:05.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.142+0000 7f4cae7fc640 1 -- 172.21.15.93:0/2631792654 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v57) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ca8018020 con 0x7f4cb80d0710 2023-11-04T01:38:05.145 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 msgr2=0x7f4c9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 0x7f4c9c06d330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4036000 tx=0x7f4cb403c040 comp rx=0 tx=0).stop 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 msgr2=0x7f4cb80c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c4d0 tx=0x7f4ca800c990 comp rx=0 tx=0).stop 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 shutdown_connections 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4c9c06ae70 0x7f4c9c06d330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb815e430 0x7f4cb80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cb80d0710 0x7f4cb80c6360 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 --2- 172.21.15.93:0/2631792654 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cb80cf160 0x7f4cb814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 >> 172.21.15.93:0/2631792654 conn(0x7f4cb806ea20 msgr2=0x7f4cb815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 shutdown_connections 2023-11-04T01:38:05.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.144+0000 7f4cbfe4f640 1 -- 172.21.15.93:0/2631792654 wait complete. 2023-11-04T01:38:05.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:38:05.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.254+0000 7ff18daa9640 1 Processor -- start 2023-11-04T01:38:05.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 -- start start 2023-11-04T01:38:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff1880ce240 0x7ff188157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff1880d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18815e000 con 0x7ff1880cde60 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18815e5c0 con 0x7ff1880ce240 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff18daa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18815e2e0 con 0x7ff188157540 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff17effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff1880ce240 0x7ff188157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff1877fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff1880cde60 0x7ff18815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56754/0 (socket says 172.21.15.93:56754) 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff17effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff1880ce240 0x7ff188157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43716/0 (socket says 172.21.15.93:43716) 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.255+0000 7ff1877fe640 1 -- 172.21.15.93:0/267677948 learned_addr learned my addr 172.21.15.93:0/267677948 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff17effd640 1 -- 172.21.15.93:0/267677948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 msgr2=0x7ff1880d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff187fff640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff1880d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff17effd640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff1880d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff186ffd640 1 -- 172.21.15.93:0/267677948 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358540723 0 0) 0x7ff18815e000 con 0x7ff1880cde60 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff17effd640 1 -- 172.21.15.93:0/267677948 >> v1:172.21.15.93:6789/0 conn(0x7ff1880cde60 legacy=0x7ff18815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff17effd640 1 -- 172.21.15.93:0/267677948 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880d1120 con 0x7ff1880ce240 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff187fff640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff1880d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.256+0000 7ff17effd640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880ce240 0x7ff188157000 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff17002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac850c09f3d39a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff186ffd640 1 -- 172.21.15.93:0/267677948 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170031830 con 0x7ff1880ce240 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff186ffd640 1 -- 172.21.15.93:0/267677948 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170031990 con 0x7ff1880ce240 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff186ffd640 1 -- 172.21.15.93:0/267677948 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170031d20 con 0x7ff1880ce240 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 -- 172.21.15.93:0/267677948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880ce240 msgr2=0x7ff188157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880ce240 0x7ff188157000 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff17002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 -- 172.21.15.93:0/267677948 shutdown_connections 2023-11-04T01:38:05.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff1880d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 --2- 172.21.15.93:0/267677948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880ce240 0x7ff188157000 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 -- 172.21.15.93:0/267677948 >> 172.21.15.93:0/267677948 conn(0x7ff188071f30 msgr2=0x7ff1880cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 -- 172.21.15.93:0/267677948 shutdown_connections 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.257+0000 7ff18daa9640 1 -- 172.21.15.93:0/267677948 wait complete. 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.258+0000 7ff18daa9640 1 Processor -- start 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 -- start start 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1880ce240 0x7ff18814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff18815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881482c0 con 0x7ff1880cde60 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18814b510 con 0x7ff1880ce240 2023-11-04T01:38:05.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff18daa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18814af50 con 0x7ff188157540 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff1877fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff1877fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43720/0 (socket says 172.21.15.93:43720) 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.259+0000 7ff1877fe640 1 -- 172.21.15.93:0/783871779 learned_addr learned my addr 172.21.15.93:0/783871779 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 -- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 msgr2=0x7ff18815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff18815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 -- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1880ce240 msgr2=0x7ff18814a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1880ce240 0x7ff18814a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 -- 172.21.15.93:0/783871779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff170009400 con 0x7ff1880cde60 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff1877fe640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c4d0 tx=0x7ff17800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780074e0 con 0x7ff1880cde60 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178007660 con 0x7ff1880cde60 2023-11-04T01:38:05.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178004a20 con 0x7ff1880cde60 2023-11-04T01:38:05.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18814b230 con 0x7ff1880cde60 2023-11-04T01:38:05.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.260+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1881f5d20 con 0x7ff1880cde60 2023-11-04T01:38:05.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.261+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1881f5f10 con 0x7ff1880cde60 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.261+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff178004b80 con 0x7ff1880cde60 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.262+0000 7ff184ff9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 0x7ff16806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.262+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff178088710 con 0x7ff1880cde60 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.262+0000 7ff17effd640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 0x7ff16806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.262+0000 7ff17effd640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 0x7ff16806d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff170036000 tx=0x7ff170030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.266+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1780538b0 con 0x7ff1880cde60 2023-11-04T01:38:05.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:05.498+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7ff188074290 con 0x7ff1880cde60 2023-11-04T01:38:06.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.272+0000 7ff184ff9640 1 -- 172.21.15.93:0/783871779 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v150) v1 ==== 176+0+0 (secure 0 0 0) 0x7ff1780180f0 con 0x7ff1880cde60 2023-11-04T01:38:06.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 msgr2=0x7ff16806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 0x7ff16806d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff170036000 tx=0x7ff170030000 comp rx=0 tx=0).stop 2023-11-04T01:38:06.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 msgr2=0x7ff1881f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c4d0 tx=0x7ff17800c990 comp rx=0 tx=0).stop 2023-11-04T01:38:06.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 shutdown_connections 2023-11-04T01:38:06.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff16806ae70 0x7ff16806d330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff188157540 0x7ff18815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1880ce240 0x7ff18814a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 --2- 172.21.15.93:0/783871779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1880cde60 0x7ff1881f6240 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 >> 172.21.15.93:0/783871779 conn(0x7ff188071f30 msgr2=0x7ff1880b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 shutdown_connections 2023-11-04T01:38:06.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.275+0000 7ff18daa9640 1 -- 172.21.15.93:0/783871779 wait complete. 2023-11-04T01:38:06.291 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:06.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.397+0000 7f0f87a56640 1 Processor -- start 2023-11-04T01:38:06.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 -- start start 2023-11-04T01:38:06.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 0x7f0f80161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0f800b4880 0x7f0f800b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800cde60 con 0x7f0f80153e60 2023-11-04T01:38:06.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f80160f90 con 0x7f0f800b4880 2023-11-04T01:38:06.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.398+0000 7f0f87a56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800b51e0 con 0x7f0f800cd6d0 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f85ff3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0f800b4880 0x7f0f800b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f84ff1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 0x7f0f80161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f857f2640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0f80153e60 0x7f0f8015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:55594/0 (socket says 172.21.15.93:55594) 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f857f2640 1 -- 172.21.15.93:0/1164163388 learned_addr learned my addr 172.21.15.93:0/1164163388 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f85ff3640 1 -- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 msgr2=0x7f0f80161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f85ff3640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 0x7f0f80161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f85ff3640 1 -- 172.21.15.93:0/1164163388 >> v1:172.21.15.125:6789/0 conn(0x7f0f80153e60 legacy=0x7f0f8015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f77fff640 1 -- 172.21.15.93:0/1164163388 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904223462 0 0) 0x7f0f800cde60 con 0x7f0f80153e60 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f85ff3640 1 -- 172.21.15.93:0/1164163388 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80161960 con 0x7f0f800b4880 2023-11-04T01:38:06.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.399+0000 7f0f84ff1640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 0x7f0f80161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:06.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.400+0000 7f0f85ff3640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f800b4ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009d90 tx=0x7f0f7802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8d91eec8999c741 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.400+0000 7f0f77fff640 1 -- 172.21.15.93:0/1164163388 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7802cc50 con 0x7f0f800b4880 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.400+0000 7f0f77fff640 1 -- 172.21.15.93:0/1164163388 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7802cdb0 con 0x7f0f800b4880 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.400+0000 7f0f77fff640 1 -- 172.21.15.93:0/1164163388 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78034660 con 0x7f0f800b4880 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 -- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 msgr2=0x7f0f800b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f800b4ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009d90 tx=0x7f0f7802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 -- 172.21.15.93:0/1164163388 shutdown_connections 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f800b4ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 --2- 172.21.15.93:0/1164163388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f800cd6d0 0x7f0f80161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 -- 172.21.15.93:0/1164163388 >> 172.21.15.93:0/1164163388 conn(0x7f0f800cf880 msgr2=0x7f0f800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 -- 172.21.15.93:0/1164163388 shutdown_connections 2023-11-04T01:38:06.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.401+0000 7f0f87a56640 1 -- 172.21.15.93:0/1164163388 wait complete. 2023-11-04T01:38:06.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.402+0000 7f0f87a56640 1 Processor -- start 2023-11-04T01:38:06.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.402+0000 7f0f87a56640 1 -- start start 2023-11-04T01:38:06.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f8015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f80153e60 0x7f0f801580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80151970 con 0x7f0f800cd6d0 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80151c50 con 0x7f0f800b4880 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80151f30 con 0x7f0f80153e60 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43734/0 (socket says 172.21.15.93:43734) 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 -- 172.21.15.93:0/2933872482 learned_addr learned my addr 172.21.15.93:0/2933872482 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f85ff3640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f80153e60 0x7f0f801580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f857f2640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f8015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 -- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f80153e60 msgr2=0x7f0f801580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f80153e60 0x7f0f801580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 -- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 msgr2=0x7f0f8015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f8015a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 -- 172.21.15.93:0/2933872482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70009400 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f857f2640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f8015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f84ff1640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000ebe0 tx=0x7f0f7000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70009760 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000cc30 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000eee0 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.403+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f78009a70 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.404+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f801524f0 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.405+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f80074290 con 0x7f0f800cd6d0 2023-11-04T01:38:06.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.405+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f70013470 con 0x7f0f800cd6d0 2023-11-04T01:38:06.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.405+0000 7f0f75ffb640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.406+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0f700897b0 con 0x7f0f800cd6d0 2023-11-04T01:38:06.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.406+0000 7f0f857f2640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.406+0000 7f0f857f2640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 0x7f0f6406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000f60 tx=0x7f0f7c007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.410+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f70054970 con 0x7f0f800cd6d0 2023-11-04T01:38:06.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.575+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0f800d0b80 con 0x7f0f800cd6d0 2023-11-04T01:38:06.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.578+0000 7f0f75ffb640 1 -- 172.21.15.93:0/2933872482 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f70057f90 con 0x7f0f800cd6d0 2023-11-04T01:38:06.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.580+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 msgr2=0x7f0f6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.580+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 0x7f0f6406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000f60 tx=0x7f0f7c007ca0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.580+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 msgr2=0x7f0f80157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.580+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000ebe0 tx=0x7f0f7000c520 comp rx=0 tx=0).stop 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.580+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 shutdown_connections 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f6406ae70 0x7f0f6406d330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f80153e60 0x7f0f801580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f800cd6d0 0x7f0f80157b70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 --2- 172.21.15.93:0/2933872482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f800b4880 0x7f0f8015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 >> 172.21.15.93:0/2933872482 conn(0x7f0f800cf880 msgr2=0x7f0f800d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 shutdown_connections 2023-11-04T01:38:06.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.581+0000 7f0f87a56640 1 -- 172.21.15.93:0/2933872482 wait complete. 2023-11-04T01:38:06.594 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:06.594 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:06.632 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:06.673 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:06.674 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:06.674 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:06.689 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:06.689 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:06.731 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:06.731 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:06.747 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:06.747 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:06.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:06.787 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:06.788 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.883+0000 7fbe69c56640 1 Processor -- start 2023-11-04T01:38:06.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 -- start start 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbe64159c70 0x7fbe640ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbe640b0ae0 0x7fbe6415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640b4110 con 0x7fbe6406db20 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640b49b0 con 0x7fbe64159c70 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe69c56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640b43f0 con 0x7fbe640b0ae0 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe637fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbe64159c70 0x7fbe640ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe637fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbe64159c70 0x7fbe640ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43750/0 (socket says 172.21.15.93:43750) 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.884+0000 7fbe62ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbe6406db20 0x7fbe640b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56764/0 (socket says 172.21.15.93:56764) 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe637fe640 1 -- 172.21.15.93:0/2129012001 learned_addr learned my addr 172.21.15.93:0/2129012001 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:06.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe63fff640 1 --2- 172.21.15.93:0/2129012001 >> v2:172.21.15.125:3300/0 conn(0x7fbe640b0ae0 0x7fbe6415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe637fe640 1 -- 172.21.15.93:0/2129012001 >> v2:172.21.15.125:3300/0 conn(0x7fbe640b0ae0 msgr2=0x7fbe6415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe637fe640 1 --2- 172.21.15.93:0/2129012001 >> v2:172.21.15.125:3300/0 conn(0x7fbe640b0ae0 0x7fbe6415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe637fe640 1 -- 172.21.15.93:0/2129012001 >> v1:172.21.15.93:6789/0 conn(0x7fbe6406db20 legacy=0x7fbe640b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe627fc640 1 -- 172.21.15.93:0/2129012001 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717091145 0 0) 0x7fbe640b4110 con 0x7fbe6406db20 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.885+0000 7fbe637fe640 1 -- 172.21.15.93:0/2129012001 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b46d0 con 0x7fbe64159c70 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe637fe640 1 --2- 172.21.15.93:0/2129012001 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe64159c70 0x7fbe640ce370 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbe640c5910 tx=0x7fbe5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8bc6275ad0f2af server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe627fc640 1 -- 172.21.15.93:0/2129012001 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030860 con 0x7fbe64159c70 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe627fc640 1 -- 172.21.15.93:0/2129012001 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540309c0 con 0x7fbe64159c70 2023-11-04T01:38:06.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe627fc640 1 -- 172.21.15.93:0/2129012001 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030d50 con 0x7fbe64159c70 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 -- 172.21.15.93:0/2129012001 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe64159c70 msgr2=0x7fbe640ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 --2- 172.21.15.93:0/2129012001 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe64159c70 0x7fbe640ce370 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbe640c5910 tx=0x7fbe5402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 -- 172.21.15.93:0/2129012001 shutdown_connections 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 --2- 172.21.15.93:0/2129012001 >> v2:172.21.15.125:3300/0 conn(0x7fbe640b0ae0 0x7fbe6415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 --2- 172.21.15.93:0/2129012001 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe64159c70 0x7fbe640ce370 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 -- 172.21.15.93:0/2129012001 >> 172.21.15.93:0/2129012001 conn(0x7fbe640ce950 msgr2=0x7fbe640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 -- 172.21.15.93:0/2129012001 shutdown_connections 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.886+0000 7fbe69c56640 1 -- 172.21.15.93:0/2129012001 wait complete. 2023-11-04T01:38:06.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.887+0000 7fbe69c56640 1 Processor -- start 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 -- start start 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 0x7fbe641f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe64159c70 0x7fbe640cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe641f4740 con 0x7fbe640b0ae0 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640c5990 con 0x7fbe64159c70 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe69c56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640c5c70 con 0x7fbe6406db20 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe62ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe62ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43754/0 (socket says 172.21.15.93:43754) 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe62ffd640 1 -- 172.21.15.93:0/3138518923 learned_addr learned my addr 172.21.15.93:0/3138518923 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.888+0000 7fbe637fe640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 0x7fbe641f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe63fff640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe64159c70 0x7fbe640cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 -- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 msgr2=0x7fbe641f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 0x7fbe641f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 -- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe64159c70 msgr2=0x7fbe640cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe64159c70 0x7fbe640cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 -- 172.21.15.93:0/3138518923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540094d0 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe637fe640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 0x7fbe641f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe62ffd640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580074e0 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58007660 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe640c5f50 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58004a20 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.889+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe640c6510 con 0x7fbe640b0ae0 2023-11-04T01:38:06.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.890+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64074290 con 0x7fbe640b0ae0 2023-11-04T01:38:06.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.890+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe58004b80 con 0x7fbe640b0ae0 2023-11-04T01:38:06.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.891+0000 7fbe4bfff640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 0x7fbe5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.891+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbe580893e0 con 0x7fbe640b0ae0 2023-11-04T01:38:06.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.891+0000 7fbe637fe640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 0x7fbe5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.891+0000 7fbe637fe640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 0x7fbe5006d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe54036000 tx=0x7fbe54008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:06.895+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe580544f0 con 0x7fbe640b0ae0 2023-11-04T01:38:07.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.097+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe64157330 con 0x7fbe640b0ae0 2023-11-04T01:38:07.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.097+0000 7fbe4bfff640 1 -- 172.21.15.93:0/3138518923 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fbe58057b10 con 0x7fbe640b0ae0 2023-11-04T01:38:07.100 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:07.100 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/229104984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":229104984},{"type":"v1","addr":"172.21.15.125:6834","nonce":229104984}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/976070459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":976070459},{"type":"v1","addr":"172.21.15.125:6835","nonce":976070459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3952695046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3952695046},{"type":"v1","addr":"172.21.15.93:6837","nonce":3952695046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3546128283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3546128283},{"type":"v1","addr":"172.21.15.93:6836","nonce":3546128283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-11-04T01:38:07.100 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 25 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 msgr2=0x7fbe5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 0x7fbe5006d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe54036000 tx=0x7fbe54008030 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 msgr2=0x7fbe640caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 shutdown_connections 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbe5006ae70 0x7fbe5006d330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe64159c70 0x7fbe640cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe640b0ae0 0x7fbe640caed0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 --2- 172.21.15.93:0/3138518923 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbe6406db20 0x7fbe641f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 >> 172.21.15.93:0/3138518923 conn(0x7fbe640ce950 msgr2=0x7fbe640ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 shutdown_connections 2023-11-04T01:38:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.099+0000 7fbe69c56640 1 -- 172.21.15.93:0/3138518923 wait complete. 2023-11-04T01:38:07.113 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:07.113 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:07.113 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:07.113 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:07.113 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:07.113 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:07.114 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:07.114 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:07.114 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:07.114 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:07.114 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:07.114 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:07.115 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:07.115 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:07.115 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:07.115 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:07.123 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:07.123 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:07.124 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:07.124 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:07.126 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:07.126 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:07.127 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:07.127 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:07.165 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:07.166 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:07.166 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:07.167 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:07.169 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:07.169 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:07.169 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:07.170 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:07.170 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:07.241 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:38:07.242 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:38:07.251 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:38:07.251 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:38:07.251 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:38:07.250+0000 7f1542135640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-04T01:38:07.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.274+0000 7f8d35600640 1 Processor -- start 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.274+0000 7f8d35600640 1 -- start start 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d35600640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d30153e60 0x7f8d3015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d35600640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d300b4880 0x7f8d300b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d35600640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300cde60 con 0x7f8d300cd6d0 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d35600640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d30160f90 con 0x7f8d30153e60 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d35600640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300b5200 con 0x7f8d300b4880 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d2effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d30153e60 0x7f8d3015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d2e7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d300cd6d0 0x7f8d30161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56774/0 (socket says 172.21.15.93:56774) 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d2e7fc640 1 -- 172.21.15.93:0/3598249891 learned_addr learned my addr 172.21.15.93:0/3598249891 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.275+0000 7f8d2f7fe640 1 --2- 172.21.15.93:0/3598249891 >> v2:172.21.15.125:3300/0 conn(0x7f8d300b4880 0x7f8d300b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.276+0000 7f8d2effd640 1 -- 172.21.15.93:0/3598249891 >> v2:172.21.15.125:3300/0 conn(0x7f8d300b4880 msgr2=0x7f8d300b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.276+0000 7f8d2effd640 1 --2- 172.21.15.93:0/3598249891 >> v2:172.21.15.125:3300/0 conn(0x7f8d300b4880 0x7f8d300b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.276+0000 7f8d2effd640 1 -- 172.21.15.93:0/3598249891 >> v1:172.21.15.93:6789/0 conn(0x7f8d300cd6d0 legacy=0x7f8d30161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.276+0000 7f8d2effd640 1 -- 172.21.15.93:0/3598249891 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3015e400 con 0x7f8d30153e60 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.276+0000 7f8d2effd640 1 --2- 172.21.15.93:0/3598249891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30153e60 0x7f8d3015dec0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8d300b8f40 tx=0x7f8d2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8856bbe04b384624 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.277+0000 7f8d2dffb640 1 -- 172.21.15.93:0/3598249891 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031830 con 0x7f8d30153e60 2023-11-04T01:38:07.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d2dffb640 1 -- 172.21.15.93:0/3598249891 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20031990 con 0x7f8d30153e60 2023-11-04T01:38:07.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d2dffb640 1 -- 172.21.15.93:0/3598249891 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031d20 con 0x7f8d30153e60 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 -- 172.21.15.93:0/3598249891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30153e60 msgr2=0x7f8d3015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 --2- 172.21.15.93:0/3598249891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30153e60 0x7f8d3015dec0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8d300b8f40 tx=0x7f8d2002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 -- 172.21.15.93:0/3598249891 shutdown_connections 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 --2- 172.21.15.93:0/3598249891 >> v2:172.21.15.125:3300/0 conn(0x7f8d300b4880 0x7f8d300b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 --2- 172.21.15.93:0/3598249891 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30153e60 0x7f8d3015dec0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 -- 172.21.15.93:0/3598249891 >> 172.21.15.93:0/3598249891 conn(0x7f8d300cf880 msgr2=0x7f8d300cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 -- 172.21.15.93:0/3598249891 shutdown_connections 2023-11-04T01:38:07.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.280+0000 7f8d35600640 1 -- 172.21.15.93:0/3598249891 wait complete. 2023-11-04T01:38:07.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.282+0000 7f8d35600640 1 Processor -- start 2023-11-04T01:38:07.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.282+0000 7f8d35600640 1 -- start start 2023-11-04T01:38:07.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d300b4880 0x7f8d300cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d30153e60 0x7f8d30157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3015a140 con 0x7f8d300cd6d0 2023-11-04T01:38:07.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301580b0 con 0x7f8d30153e60 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d35600640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300cbd20 con 0x7f8d300b4880 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d2e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d2e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43812/0 (socket says 172.21.15.93:43812) 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d2e7fc640 1 -- 172.21.15.93:0/1188636871 learned_addr learned my addr 172.21.15.93:0/1188636871 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d2f7fe640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d30153e60 0x7f8d30157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.283+0000 7f8d2e7fc640 1 -- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d300b4880 msgr2=0x7f8d300cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d2e7fc640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d300b4880 0x7f8d300cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d2e7fc640 1 -- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d30153e60 msgr2=0x7f8d30157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d2e7fc640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d30153e60 0x7f8d30157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d2e7fc640 1 -- 172.21.15.93:0/1188636871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009400 con 0x7f8d300cd6d0 2023-11-04T01:38:07.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d2e7fc640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c440 tx=0x7f8d24001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24005ce0 con 0x7f8d300cd6d0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d300cc000 con 0x7f8d300cd6d0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24005e40 con 0x7f8d300cd6d0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240072f0 con 0x7f8d300cd6d0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.284+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d300cc5c0 con 0x7f8d300cd6d0 2023-11-04T01:38:07.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.286+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d300cfd80 con 0x7f8d300cd6d0 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.286+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d240074d0 con 0x7f8d300cd6d0 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.286+0000 7f8d177fe640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 0x7f8d1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.286+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8d24088b90 con 0x7f8d300cd6d0 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.286+0000 7f8d2effd640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 0x7f8d1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.287+0000 7f8d2effd640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 0x7f8d1c06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8d20036000 tx=0x7f8d20030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.291+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d24053cd0 con 0x7f8d300cd6d0 2023-11-04T01:38:07.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:07.471+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8d30074290 con 0x7f8d300cd6d0 2023-11-04T01:38:08.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.296+0000 7f8d177fe640 1 -- 172.21.15.93:0/1188636871 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d240572f0 con 0x7f8d300cd6d0 2023-11-04T01:38:08.298 INFO:teuthology.orchestra.run.smithi093.stderr: removed all blocklist entries 2023-11-04T01:38:08.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.298+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 msgr2=0x7f8d1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 0x7f8d1c06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8d20036000 tx=0x7f8d20030000 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 msgr2=0x7f8d300c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c440 tx=0x7f8d24001e70 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 shutdown_connections 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d1c06ae70 0x7f8d1c06d330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d30153e60 0x7f8d30157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d300cd6d0 0x7f8d300c89b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 --2- 172.21.15.93:0/1188636871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d300b4880 0x7f8d300cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 >> 172.21.15.93:0/1188636871 conn(0x7f8d300cf880 msgr2=0x7f8d300d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 shutdown_connections 2023-11-04T01:38:08.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.299+0000 7f8d35600640 1 -- 172.21.15.93:0/1188636871 wait complete. 2023-11-04T01:38:08.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:08.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.416+0000 7f14f3925640 1 Processor -- start 2023-11-04T01:38:08.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.416+0000 7f14f3925640 1 -- start start 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f3925640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f3925640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f3925640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0b4110 con 0x7f14ec06db20 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f3925640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0b49b0 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f3925640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0b43f0 con 0x7f14ec159c70 2023-11-04T01:38:08.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f1ec2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f16c1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f16c1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:37754/0 (socket says 172.21.15.93:37754) 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f1ec2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:53166/0 (socket says 172.21.15.93:53166) 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f0ec0640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f14ec06db20 0x7f14ec0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:55618/0 (socket says 172.21.15.93:55618) 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.417+0000 7f14f1ec2640 1 -- 172.21.15.93:0/1170313146 learned_addr learned my addr 172.21.15.93:0/1170313146 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f16c1640 1 -- 172.21.15.93:0/1170313146 >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 msgr2=0x7f14ec15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f16c1640 1 --2- 172.21.15.93:0/1170313146 >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f16c1640 1 -- 172.21.15.93:0/1170313146 >> v1:172.21.15.125:6789/0 conn(0x7f14ec06db20 legacy=0x7f14ec0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f16c1640 1 -- 172.21.15.93:0/1170313146 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0b46d0 con 0x7f14ec159c70 2023-11-04T01:38:08.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f1ec2640 1 --2- 172.21.15.93:0/1170313146 >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:08.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.418+0000 7f14f16c1640 1 --2- 172.21.15.93:0/1170313146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009d90 tx=0x7f14e802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aea1564f09f383b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14e3fff640 1 -- 172.21.15.93:0/1170313146 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e802cc50 con 0x7f14ec159c70 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14e3fff640 1 -- 172.21.15.93:0/1170313146 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e802cdb0 con 0x7f14ec159c70 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14e3fff640 1 -- 172.21.15.93:0/1170313146 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8034660 con 0x7f14ec159c70 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 -- 172.21.15.93:0/1170313146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 msgr2=0x7f14ec0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 --2- 172.21.15.93:0/1170313146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009d90 tx=0x7f14e802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 -- 172.21.15.93:0/1170313146 shutdown_connections 2023-11-04T01:38:08.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 --2- 172.21.15.93:0/1170313146 >> v2:172.21.15.125:3300/0 conn(0x7f14ec0b0ae0 0x7f14ec15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 --2- 172.21.15.93:0/1170313146 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0ce370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 -- 172.21.15.93:0/1170313146 >> 172.21.15.93:0/1170313146 conn(0x7f14ec0ce950 msgr2=0x7f14ec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 -- 172.21.15.93:0/1170313146 shutdown_connections 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.419+0000 7f14f3925640 1 -- 172.21.15.93:0/1170313146 wait complete. 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.420+0000 7f14f3925640 1 Processor -- start 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.420+0000 7f14f3925640 1 -- start start 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 0x7f14ec0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0c5fa0 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0c5990 con 0x7f14ec06db20 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f3925640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0b37e0 con 0x7f14ec159c70 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.427 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43824/0 (socket says 172.21.15.93:43824) 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 -- 172.21.15.93:0/2668942800 learned_addr learned my addr 172.21.15.93:0/2668942800 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f16c1640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 0x7f14ec0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 -- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 msgr2=0x7f14ec0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f1ec2640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 -- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 msgr2=0x7f14ec0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 0x7f14ec0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f0ec0640 1 -- 172.21.15.93:0/2668942800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e400b770 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.421+0000 7f14f16c1640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 0x7f14ec0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14f0ec0640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c4d0 tx=0x7f14dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc007480 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0075e0 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0049e0 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8009a70 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.422+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec0c5c30 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.423+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec06df80 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.423+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14dc004b40 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.423+0000 7f14e1ffb640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 0x7f14d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.424+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f14dc088780 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.424+0000 7f14f16c1640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 0x7f14d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.424+0000 7f14f16c1640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 0x7f14d006d360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f14e8036000 tx=0x7f14e8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.428+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14dc053860 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.658+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f14ec074290 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.659+0000 7f14e1ffb640 1 -- 172.21.15.93:0/2668942800 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f14dc056e80 con 0x7f14ec0b0ae0 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: "auth_dump": [ 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.a", 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA==", 2023-11-04T01:38:08.661 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.b", 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q==", 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.662 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.c", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA==", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:08.663 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.d", 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A==", 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.664 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.0", 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng==", 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.665 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.666 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.1", 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg==", 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.2", 2023-11-04T01:38:08.667 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ==", 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.669 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.3", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw==", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.4", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw==", 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.670 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.5", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig==", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.671 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.6", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q==", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.7", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg==", 2023-11-04T01:38:08.672 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.0", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA==", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow r", 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:08.673 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.1", 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA==", 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:08.674 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.2", 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA==", 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.675 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.3", 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA==", 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.676 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.679 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.680 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.admin", 2023-11-04T01:38:08.680 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC8n0VlXE3tMRAAENuvCH1TV9mwClMjb99rXg==", 2023-11-04T01:38:08.680 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.680 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.x", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA==", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.681 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.y", 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA==", 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:08.682 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:08.684 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.684 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:08.684 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-11-04T01:38:08.684 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:08.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 msgr2=0x7f14d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 0x7f14d006d360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f14e8036000 tx=0x7f14e8030000 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 msgr2=0x7f14ec156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c4d0 tx=0x7f14dc00c990 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 shutdown_connections 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f14d006aea0 0x7f14d006d360 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f14ec159c70 0x7f14ec0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14ec0b0ae0 0x7f14ec156ae0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 --2- 172.21.15.93:0/2668942800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14ec06db20 0x7f14ec0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 >> 172.21.15.93:0/2668942800 conn(0x7f14ec0ce950 msgr2=0x7f14ec158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 shutdown_connections 2023-11-04T01:38:08.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.661+0000 7f14f3925640 1 -- 172.21.15.93:0/2668942800 wait complete. 2023-11-04T01:38:08.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:08.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.787+0000 7f692bce1640 1 Processor -- start 2023-11-04T01:38:08.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.787+0000 7f692bce1640 1 -- start start 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692bce1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 0x7f69240abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692bce1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f69240c9a40 0x7f69240c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692bce1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692406b720 con 0x7f692406a1b0 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692bce1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240ca430 con 0x7f69240c9a40 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692bce1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692406cf60 con 0x7f692415ad80 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692a27e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f69240c9a40 0x7f69240c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692927c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f692406a1b0 0x7f692406b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56776/0 (socket says 172.21.15.93:56776) 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692927c640 1 -- 172.21.15.93:0/2669138260 learned_addr learned my addr 172.21.15.93:0/2669138260 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f6929a7d640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 0x7f69240abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692a27e640 1 -- 172.21.15.93:0/2669138260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 msgr2=0x7f69240abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692a27e640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 0x7f69240abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692a27e640 1 -- 172.21.15.93:0/2669138260 >> v1:172.21.15.93:6789/0 conn(0x7f692406a1b0 legacy=0x7f692406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f692a27e640 1 -- 172.21.15.93:0/2669138260 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240ac390 con 0x7f69240c9a40 2023-11-04T01:38:08.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f6928a7b640 1 -- 172.21.15.93:0/2669138260 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520788246 0 0) 0x7f692406b720 con 0x7f692406a1b0 2023-11-04T01:38:08.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.788+0000 7f6929a7d640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 0x7f69240abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:08.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.789+0000 7f692a27e640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69240c9a40 0x7f69240c9ef0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f691c0097a0 tx=0x7f691c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c327c637c40446e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.789+0000 7f6928a7b640 1 -- 172.21.15.93:0/2669138260 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c031830 con 0x7f69240c9a40 2023-11-04T01:38:08.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.789+0000 7f6928a7b640 1 -- 172.21.15.93:0/2669138260 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c031990 con 0x7f69240c9a40 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.789+0000 7f6928a7b640 1 -- 172.21.15.93:0/2669138260 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c031d20 con 0x7f69240c9a40 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 -- 172.21.15.93:0/2669138260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69240c9a40 msgr2=0x7f69240c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69240c9a40 0x7f69240c9ef0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f691c0097a0 tx=0x7f691c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 -- 172.21.15.93:0/2669138260 shutdown_connections 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69240c9a40 0x7f69240c9ef0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 --2- 172.21.15.93:0/2669138260 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f692415ad80 0x7f69240abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 -- 172.21.15.93:0/2669138260 >> 172.21.15.93:0/2669138260 conn(0x7f69240b0cd0 msgr2=0x7f69240b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 -- 172.21.15.93:0/2669138260 shutdown_connections 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.790+0000 7f692bce1640 1 -- 172.21.15.93:0/2669138260 wait complete. 2023-11-04T01:38:08.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.791+0000 7f692bce1640 1 Processor -- start 2023-11-04T01:38:08.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.791+0000 7f692bce1640 1 -- start start 2023-11-04T01:38:08.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69240c9a40 0x7f692414b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f692415ad80 0x7f69240c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c8c30 con 0x7f692406a1b0 2023-11-04T01:38:08.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c80b0 con 0x7f692415ad80 2023-11-04T01:38:08.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c8390 con 0x7f69240c9a40 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43842/0 (socket says 172.21.15.93:43842) 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 -- 172.21.15.93:0/803882911 learned_addr learned my addr 172.21.15.93:0/803882911 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 -- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69240c9a40 msgr2=0x7f692414b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69240c9a40 0x7f692414b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 -- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f692415ad80 msgr2=0x7f69240c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f692415ad80 0x7f69240c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 -- 172.21.15.93:0/803882911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c009400 con 0x7f692406a1b0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f6929a7d640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f692000cf60 tx=0x7f692000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000d840 con 0x7f692406a1b0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692000d9a0 con 0x7f692406a1b0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.792+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240c8670 con 0x7f692406a1b0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.793+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000dd30 con 0x7f692406a1b0 2023-11-04T01:38:08.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.793+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692414bc10 con 0x7f692406a1b0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.793+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240cd210 con 0x7f692406a1b0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.794+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6920015440 con 0x7f692406a1b0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.794+0000 7f691a7fc640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 0x7f690806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.794+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6920089e50 con 0x7f692406a1b0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.794+0000 7f692927c640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 0x7f690806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.795+0000 7f692927c640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 0x7f690806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6914007fd0 tx=0x7f6914007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.798+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69240cd210 con 0x7f692406a1b0 2023-11-04T01:38:08.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.966+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69240cd210 con 0x7f692406a1b0 2023-11-04T01:38:08.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.967+0000 7f691a7fc640 1 -- 172.21.15.93:0/803882911 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14827 (secure 0 0 0) 0x7f69240cd210 con 0x7f692406a1b0 2023-11-04T01:38:08.969 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:08.969 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":62,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:08.293138+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 msgr2=0x7f690806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 0x7f690806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6914007fd0 tx=0x7f6914007960 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 msgr2=0x7f69240c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f692000cf60 tx=0x7f692000cf90 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 shutdown_connections 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f690806ae70 0x7f690806d330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f692415ad80 0x7f69240c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69240c9a40 0x7f692414b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 --2- 172.21.15.93:0/803882911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f692406a1b0 0x7f69240c1780 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.968+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 >> 172.21.15.93:0/803882911 conn(0x7f69240b0cd0 msgr2=0x7f6924154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.969+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 shutdown_connections 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:08.969+0000 7f692bce1640 1 -- 172.21.15.93:0/803882911 wait complete. 2023-11-04T01:38:08.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:08.982 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:09.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.083+0000 7fc2fd639640 1 Processor -- start 2023-11-04T01:38:09.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.083+0000 7fc2fd639640 1 -- start start 2023-11-04T01:38:09.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2fd639640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 0x7fc2f80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2fd639640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 0x7fc2f806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2fd639640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80c9bf0 con 0x7fc2f8070ff0 2023-11-04T01:38:09.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2fd639640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cd890 con 0x7fc2f8066000 2023-11-04T01:38:09.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2fd639640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80cdb30 con 0x7fc2f815d1b0 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2f67fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 0x7fc2f80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2f77fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 0x7fc2f806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2f6ffd640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc2f8070ff0 0x7fc2f80713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:55622/0 (socket says 172.21.15.93:55622) 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.084+0000 7fc2f6ffd640 1 -- 172.21.15.93:0/4099391388 learned_addr learned my addr 172.21.15.93:0/4099391388 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.085+0000 7fc2f67fc640 1 -- 172.21.15.93:0/4099391388 >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 msgr2=0x7fc2f806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.085+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/4099391388 >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 0x7fc2f806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.085+0000 7fc2f67fc640 1 -- 172.21.15.93:0/4099391388 >> v1:172.21.15.125:6789/0 conn(0x7fc2f8070ff0 legacy=0x7fc2f80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.085+0000 7fc2f67fc640 1 -- 172.21.15.93:0/4099391388 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80cde10 con 0x7fc2f815d1b0 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.085+0000 7fc2f77fe640 1 --2- 172.21.15.93:0/4099391388 >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 0x7fc2f806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/4099391388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 0x7fc2f80cb4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097a0 tx=0x7fc2ec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a964b2d97ea3ba51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2f5ffb640 1 -- 172.21.15.93:0/4099391388 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec031830 con 0x7fc2f815d1b0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2f5ffb640 1 -- 172.21.15.93:0/4099391388 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec031990 con 0x7fc2f815d1b0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2f5ffb640 1 -- 172.21.15.93:0/4099391388 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec031d20 con 0x7fc2f815d1b0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 -- 172.21.15.93:0/4099391388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 msgr2=0x7fc2f80cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 --2- 172.21.15.93:0/4099391388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 0x7fc2f80cb4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097a0 tx=0x7fc2ec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 -- 172.21.15.93:0/4099391388 shutdown_connections 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 --2- 172.21.15.93:0/4099391388 >> v2:172.21.15.125:3300/0 conn(0x7fc2f8066000 0x7fc2f806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 --2- 172.21.15.93:0/4099391388 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f815d1b0 0x7fc2f80cb4e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.086+0000 7fc2fd639640 1 -- 172.21.15.93:0/4099391388 >> 172.21.15.93:0/4099391388 conn(0x7fc2f80cbc90 msgr2=0x7fc2f80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.087+0000 7fc2fd639640 1 -- 172.21.15.93:0/4099391388 shutdown_connections 2023-11-04T01:38:09.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.087+0000 7fc2fd639640 1 -- 172.21.15.93:0/4099391388 wait complete. 2023-11-04T01:38:09.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.088+0000 7fc2fd639640 1 Processor -- start 2023-11-04T01:38:09.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.088+0000 7fc2fd639640 1 -- start start 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 0x7fc2f80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f815d1b0 0x7fc2f80c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80b1e30 con 0x7fc2f8066000 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814bb90 con 0x7fc2f815d1b0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80b2080 con 0x7fc2f8070ff0 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43858/0 (socket says 172.21.15.93:43858) 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 -- 172.21.15.93:0/2575272350 learned_addr learned my addr 172.21.15.93:0/2575272350 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 0x7fc2f80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f77fe640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f815d1b0 0x7fc2f80c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 -- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 msgr2=0x7fc2f80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 0x7fc2f80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 -- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f815d1b0 msgr2=0x7fc2f80c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f815d1b0 0x7fc2f80c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 -- 172.21.15.93:0/2575272350 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0009a70 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 0x7fc2f80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2f6ffd640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c4a0 tx=0x7fc2e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8005ce0 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8005e40 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec009400 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8007270 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.089+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80b2640 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.090+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f8074290 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.091+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2e8007490 con 0x7fc2f8066000 2023-11-04T01:38:09.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.091+0000 7fc2df7fe640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 0x7fc2e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.091+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc2e8088910 con 0x7fc2f8066000 2023-11-04T01:38:09.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.091+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 0x7fc2e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.092+0000 7fc2f67fc640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 0x7fc2e406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec036000 tx=0x7fc2ec03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.095+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2e8053bb0 con 0x7fc2f8066000 2023-11-04T01:38:09.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.261+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2f80b5190 con 0x7fc2f8066000 2023-11-04T01:38:09.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.261+0000 7fc2df7fe640 1 -- 172.21.15.93:0/2575272350 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2e8017020 con 0x7fc2f8066000 2023-11-04T01:38:09.264 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 msgr2=0x7fc2e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 0x7fc2e406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec036000 tx=0x7fc2ec03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 msgr2=0x7fc2f814b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c4a0 tx=0x7fc2e800c960 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 shutdown_connections 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc2e406ae70 0x7fc2e406d330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2f815d1b0 0x7fc2f80c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc2f8070ff0 0x7fc2f80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 --2- 172.21.15.93:0/2575272350 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2f8066000 0x7fc2f814b650 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 >> 172.21.15.93:0/2575272350 conn(0x7fc2f80cbc90 msgr2=0x7fc2f815fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 shutdown_connections 2023-11-04T01:38:09.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.263+0000 7fc2fd639640 1 -- 172.21.15.93:0/2575272350 wait complete. 2023-11-04T01:38:09.277 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:09.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.377+0000 7f5f53790640 1 Processor -- start 2023-11-04T01:38:09.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 -- start start 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f4c153850 0x7f5f4c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0c3860 con 0x7f5f4c0cc520 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c9250 con 0x7f5f4c153850 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f53790640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c153c30 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f5152c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f4c153850 0x7f5f4c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f50d2b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5f4c0cc520 0x7f5f4c070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56782/0 (socket says 172.21.15.93:56782) 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f50d2b640 1 -- 172.21.15.93:0/3223956061 learned_addr learned my addr 172.21.15.93:0/3223956061 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.378+0000 7f5f5152c640 1 --2- 172.21.15.93:0/3223956061 >> v2:172.21.15.93:3300/0 conn(0x7f5f4c153850 0x7f5f4c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43860/0 (socket says 172.21.15.93:43860) 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f51d2d640 1 --2- 172.21.15.93:0/3223956061 >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f5152c640 1 -- 172.21.15.93:0/3223956061 >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 msgr2=0x7f5f4c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f5152c640 1 --2- 172.21.15.93:0/3223956061 >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f5152c640 1 -- 172.21.15.93:0/3223956061 >> v1:172.21.15.93:6789/0 conn(0x7f5f4c0cc520 legacy=0x7f5f4c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f5152c640 1 -- 172.21.15.93:0/3223956061 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c15a700 con 0x7f5f4c153850 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f43fff640 1 -- 172.21.15.93:0/3223956061 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219988033 0 0) 0x7f5f4c0c3860 con 0x7f5f4c0cc520 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f51d2d640 1 --2- 172.21.15.93:0/3223956061 >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.379+0000 7f5f5152c640 1 --2- 172.21.15.93:0/3223956061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c153850 0x7f5f4c15a1c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ca7c0 tx=0x7f5f4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3048b461298dfa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f43fff640 1 -- 172.21.15.93:0/3223956061 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4802cc80 con 0x7f5f4c153850 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f43fff640 1 -- 172.21.15.93:0/3223956061 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4802cde0 con 0x7f5f4c153850 2023-11-04T01:38:09.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f43fff640 1 -- 172.21.15.93:0/3223956061 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48034660 con 0x7f5f4c153850 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 -- 172.21.15.93:0/3223956061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c153850 msgr2=0x7f5f4c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 --2- 172.21.15.93:0/3223956061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c153850 0x7f5f4c15a1c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ca7c0 tx=0x7f5f4802bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 -- 172.21.15.93:0/3223956061 shutdown_connections 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 --2- 172.21.15.93:0/3223956061 >> v2:172.21.15.125:3300/0 conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 --2- 172.21.15.93:0/3223956061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c153850 0x7f5f4c15a1c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 -- 172.21.15.93:0/3223956061 >> 172.21.15.93:0/3223956061 conn(0x7f5f4c0ce950 msgr2=0x7f5f4c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 -- 172.21.15.93:0/3223956061 shutdown_connections 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.380+0000 7f5f53790640 1 -- 172.21.15.93:0/3223956061 wait complete. 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.381+0000 7f5f53790640 1 Processor -- start 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.381+0000 7f5f53790640 1 -- start start 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4c0cc520 0x7f5f4c1e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4c153850 0x7f5f4c0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0b00f0 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1e3540 con 0x7f5f4c153850 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f53790640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1e3820 con 0x7f5f4c0cc520 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43872/0 (socket says 172.21.15.93:43872) 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 -- 172.21.15.93:0/1781117704 learned_addr learned my addr 172.21.15.93:0/1781117704 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f51d2d640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4c153850 0x7f5f4c0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 -- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4c0cc520 msgr2=0x7f5f4c1e4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4c0cc520 0x7f5f4c1e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 -- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4c153850 msgr2=0x7f5f4c0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.382+0000 7f5f50d2b640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4c153850 0x7f5f4c0c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f50d2b640 1 -- 172.21.15.93:0/1781117704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009a70 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f50d2b640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c4d0 tx=0x7f5f3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0074e0 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c007660 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c1e3b00 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c004a20 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.383+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c06df50 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.384+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c1e4020 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.384+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f3c004b80 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.385+0000 7f5f41ffb640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.385+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5f3c0886f0 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.385+0000 7f5f5152c640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.385+0000 7f5f5152c640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.389+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f4c1e4020 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.553+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f5f4c1e4020 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.554+0000 7f5f41ffb640 1 -- 172.21.15.93:0/1781117704 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v62) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5f4c1e4020 con 0x7f5f4c0cc9d0 2023-11-04T01:38:09.556 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 msgr2=0x7f5f3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f4802e000 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 msgr2=0x7f5f4c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c4d0 tx=0x7f5f3c00c990 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 shutdown_connections 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f4c153850 0x7f5f4c0c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f4c0cc9d0 0x7f5f4c0c3cf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 --2- 172.21.15.93:0/1781117704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f4c0cc520 0x7f5f4c1e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 >> 172.21.15.93:0/1781117704 conn(0x7f5f4c0ce950 msgr2=0x7f5f4c15aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 shutdown_connections 2023-11-04T01:38:09.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.556+0000 7f5f53790640 1 -- 172.21.15.93:0/1781117704 wait complete. 2023-11-04T01:38:09.569 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:09.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.666+0000 7f622f1dc640 1 Processor -- start 2023-11-04T01:38:09.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.666+0000 7f622f1dc640 1 -- start start 2023-11-04T01:38:09.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622f1dc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f622806a1b0 0x7f622806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622f1dc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62280c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622f1dc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622806cf60 con 0x7f622815ad80 2023-11-04T01:38:09.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622f1dc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62280ca430 con 0x7f622806a1b0 2023-11-04T01:38:09.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622f1dc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622815b160 con 0x7f62280c9a40 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622cf78640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f622815ad80 0x7f62280abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56794/0 (socket says 172.21.15.93:56794) 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622cf78640 1 -- 172.21.15.93:0/1087641519 learned_addr learned my addr 172.21.15.93:0/1087641519 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993499596 0 0) 0x7f622806cf60 con 0x7f622815ad80 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f6227fff640 1 --2- 172.21.15.93:0/1087641519 >> v2:172.21.15.125:3300/0 conn(0x7f622806a1b0 0x7f622806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f622d779640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62280c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.667+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003520 con 0x7f622815ad80 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274964079 0 0) 0x7f6210003520 con 0x7f622815ad80 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 msgr2=0x7f62280c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62280c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 >> v2:172.21.15.125:3300/0 conn(0x7f622806a1b0 msgr2=0x7f622806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 --2- 172.21.15.93:0/1087641519 >> v2:172.21.15.125:3300/0 conn(0x7f622806a1b0 0x7f622806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622806b9b0 con 0x7f622815ad80 2023-11-04T01:38:09.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6218001670 con 0x7f622815ad80 2023-11-04T01:38:09.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 >> v1:172.21.15.93:6789/0 conn(0x7f622815ad80 legacy=0x7f62280abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6210003970 0x7f6210003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6210004d00 0x7f6210005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280ca430 con 0x7f6210003970 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622815b160 con 0x7f6210004d00 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621000b980 con 0x7f62280c9a40 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6210003970 0x7f6210003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f6227fff640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622d779640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6210004d00 0x7f6210005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 -- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 msgr2=0x7f62100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62280c9a40 0x7f62100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 -- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6210004d00 msgr2=0x7f6210005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6210004d00 0x7f6210005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.668+0000 7f622cf78640 1 -- 172.21.15.93:0/1087641519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210003520 con 0x7f6210003970 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f622cf78640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6210003970 0x7f6210003d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f621800c240 tx=0x7f62100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe86f1d6a23cea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218005ad0 con 0x7f6210003970 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218005c30 con 0x7f6210003970 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f62277fe640 1 -- 172.21.15.93:0/1087641519 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621802c8b0 con 0x7f6210003970 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f622f1dc640 1 -- 172.21.15.93:0/1087641519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6210003970 msgr2=0x7f6210003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f622f1dc640 1 --2- 172.21.15.93:0/1087641519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6210003970 0x7f6210003d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f621800c240 tx=0x7f62100057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.669+0000 7f622d779640 1 -- 172.21.15.93:0/1087641519 reap_dead start 2023-11-04T01:38:09.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.670+0000 7f622f1dc640 1 -- 172.21.15.93:0/1087641519 shutdown_connections 2023-11-04T01:38:09.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.670+0000 7f622f1dc640 1 -- 172.21.15.93:0/1087641519 >> 172.21.15.93:0/1087641519 conn(0x7f62280b0cd0 msgr2=0x7f62280b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.670+0000 7f622f1dc640 1 -- 172.21.15.93:0/1087641519 shutdown_connections 2023-11-04T01:38:09.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.670+0000 7f622f1dc640 1 -- 172.21.15.93:0/1087641519 wait complete. 2023-11-04T01:38:09.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.671+0000 7f622f1dc640 1 Processor -- start 2023-11-04T01:38:09.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.671+0000 7f622f1dc640 1 -- start start 2023-11-04T01:38:09.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210003970 0x7f62280c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6228152260 0x7f62281526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c60e0 con 0x7f62280c2f40 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6228152c20 con 0x7f6228152260 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622814d300 con 0x7f6210003970 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43876/0 (socket says 172.21.15.93:43876) 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 -- 172.21.15.93:0/2378237432 learned_addr learned my addr 172.21.15.93:0/2378237432 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 -- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210003970 msgr2=0x7f62280c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210003970 0x7f62280c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 -- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6228152260 msgr2=0x7f62281526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6228152260 0x7f62281526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 -- 172.21.15.93:0/2378237432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280c5840 con 0x7f62280c2f40 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622d779640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f622806ceb0 tx=0x7f62200115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000e070 con 0x7f62280c2f40 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220011e40 con 0x7f62280c2f40 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220003990 con 0x7f62280c2f40 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62280c5b20 con 0x7f62280c2f40 2023-11-04T01:38:09.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.672+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62281507f0 con 0x7f62280c2f40 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.673+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6228074290 con 0x7f62280c2f40 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.674+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6220003b10 con 0x7f62280c2f40 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.674+0000 7f62257fa640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 0x7f621406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.674+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6220089b70 con 0x7f62280c2f40 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.674+0000 7f622cf78640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 0x7f621406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.675+0000 7f622cf78640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 0x7f621406d360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6218034000 tx=0x7f621802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.678+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6220054cd0 con 0x7f62280c2f40 2023-11-04T01:38:09.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.844+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6228066320 con 0x7f62280c2f40 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.844+0000 7f62257fa640 1 -- 172.21.15.93:0/2378237432 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+137 (secure 0 0 0) 0x7f62200582f0 con 0x7f62280c2f40 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:38:09.847 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 7, 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:09.848 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 msgr2=0x7f621406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 0x7f621406d360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6218034000 tx=0x7f621802e000 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 msgr2=0x7f62280c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f622806ceb0 tx=0x7f62200115a0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 shutdown_connections 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f621406aea0 0x7f621406d360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62280c2f40 0x7f62280c33c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6228152260 0x7f62281526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 --2- 172.21.15.93:0/2378237432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6210003970 0x7f62280c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 >> 172.21.15.93:0/2378237432 conn(0x7f62280b0cd0 msgr2=0x7f62280ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 shutdown_connections 2023-11-04T01:38:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.846+0000 7f622f1dc640 1 -- 172.21.15.93:0/2378237432 wait complete. 2023-11-04T01:38:09.860 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:09.860 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:09.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 Processor -- start 2023-11-04T01:38:09.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 -- start start 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfd40ade40 0x7fcfd40c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40c5890 con 0x7fcfd415e420 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd40cd8e0 con 0x7fcfd40ade40 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.961+0000 7fcfda178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40cdbc0 con 0x7fcfd4159be0 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfd40ade40 0x7fcfd40c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcfd40ade40 0x7fcfd40c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:53256/0 (socket says 172.21.15.93:53256) 2023-11-04T01:38:09.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 -- 172.21.15.93:0/3552484779 learned_addr learned my addr 172.21.15.93:0/3552484779 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:09.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd2ffd640 1 --1- 172.21.15.93:0/3552484779 >> v1:172.21.15.125:6789/0 conn(0x7fcfd415e420 0x7fcfd40ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:55638/0 (socket says 172.21.15.93:55638) 2023-11-04T01:38:09.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 -- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 msgr2=0x7fcfd40c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd40c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 -- 172.21.15.93:0/3552484779 >> v1:172.21.15.125:6789/0 conn(0x7fcfd415e420 legacy=0x7fcfd40ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd3fff640 1 -- 172.21.15.93:0/3552484779 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40cdea0 con 0x7fcfd40ade40 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.962+0000 7fcfd37fe640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.963+0000 7fcfd3fff640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd40c3840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35720424cb14dbd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.963+0000 7fcfd27fc640 1 -- 172.21.15.93:0/3552484779 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc02ca70 con 0x7fcfd40ade40 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.963+0000 7fcfd27fc640 1 -- 172.21.15.93:0/3552484779 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc02cbd0 con 0x7fcfd40ade40 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.963+0000 7fcfd27fc640 1 -- 172.21.15.93:0/3552484779 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0343f0 con 0x7fcfd40ade40 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 -- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 msgr2=0x7fcfd40c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd40c3840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 -- 172.21.15.93:0/3552484779 shutdown_connections 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd40c3840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 --2- 172.21.15.93:0/3552484779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 -- 172.21.15.93:0/3552484779 >> 172.21.15.93:0/3552484779 conn(0x7fcfd40b05d0 msgr2=0x7fcfd40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 -- 172.21.15.93:0/3552484779 shutdown_connections 2023-11-04T01:38:09.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.964+0000 7fcfda178640 1 -- 172.21.15.93:0/3552484779 wait complete. 2023-11-04T01:38:09.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.965+0000 7fcfda178640 1 Processor -- start 2023-11-04T01:38:09.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.965+0000 7fcfda178640 1 -- start start 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4140050 con 0x7fcfd415e420 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd414daa0 con 0x7fcfd40ade40 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfda178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd414dd80 con 0x7fcfd4159be0 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43890/0 (socket says 172.21.15.93:43890) 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 -- 172.21.15.93:0/2113991145 learned_addr learned my addr 172.21.15.93:0/2113991145 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd2ffd640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd37fe640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 -- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 msgr2=0x7fcfd413fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd413fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 -- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 msgr2=0x7fcfd414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd3fff640 1 -- 172.21.15.93:0/2113991145 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009400 con 0x7fcfd415e420 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.966+0000 7fcfd37fe640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfd3fff640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc009510 con 0x7fcfd415e420 2023-11-04T01:38:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc03e450 con 0x7fcfd415e420 2023-11-04T01:38:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc009b30 con 0x7fcfd415e420 2023-11-04T01:38:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc03e800 con 0x7fcfd415e420 2023-11-04T01:38:09.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.967+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd414e340 con 0x7fcfd415e420 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.968+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd404e490 con 0x7fcfd415e420 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.968+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfcc03e960 con 0x7fcfd415e420 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.969+0000 7fcfcbfff640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 0x7fcfb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.969+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcfcc0ac390 con 0x7fcfd415e420 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.969+0000 7fcfd37fe640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 0x7fcfb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.969+0000 7fcfd37fe640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 0x7fcfb406d360 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009d20 tx=0x7fcfbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:09.973+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfcc077340 con 0x7fcfd415e420 2023-11-04T01:38:10.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.138+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcfd40c4d40 con 0x7fcfd415e420 2023-11-04T01:38:10.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.302+0000 7fcfcbfff640 1 -- 172.21.15.93:0/2113991145 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcfcc07a960 con 0x7fcfd415e420 2023-11-04T01:38:10.304 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 msgr2=0x7fcfb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 0x7fcfb406d360 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc009d20 tx=0x7fcfbc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 msgr2=0x7fcfd40af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 shutdown_connections 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcfb406aea0 0x7fcfb406d360 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfd415e420 0x7fcfd40af080 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcfd4159be0 0x7fcfd413fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 --2- 172.21.15.93:0/2113991145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfd40ade40 0x7fcfd414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 >> 172.21.15.93:0/2113991145 conn(0x7fcfd40b05d0 msgr2=0x7fcfd40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.304+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 shutdown_connections 2023-11-04T01:38:10.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.305+0000 7fcfda178640 1 -- 172.21.15.93:0/2113991145 wait complete. 2023-11-04T01:38:10.321 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:10.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.426+0000 7f193325d640 1 Processor -- start 2023-11-04T01:38:10.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.426+0000 7f193325d640 1 -- start start 2023-11-04T01:38:10.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.426+0000 7f193325d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f192c153e60 0x7f192c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.426+0000 7f193325d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c0b4880 0x7f192c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f193325d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0cde60 con 0x7f192c0cd6d0 2023-11-04T01:38:10.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f193325d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c160f90 con 0x7f192c153e60 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f193325d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0b5200 con 0x7f192c0b4880 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f192c153e60 0x7f192c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f192c153e60 0x7f192c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43894/0 (socket says 172.21.15.93:43894) 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 -- 172.21.15.93:0/2724269046 learned_addr learned my addr 172.21.15.93:0/2724269046 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f19317fa640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c0b4880 0x7f192c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 -- 172.21.15.93:0/2724269046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c0b4880 msgr2=0x7f192c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c0b4880 0x7f192c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 -- 172.21.15.93:0/2724269046 >> v1:172.21.15.125:6789/0 conn(0x7f192c0cd6d0 legacy=0x7f192c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.427+0000 7f1930ff9640 1 -- 172.21.15.93:0/2724269046 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c15e400 con 0x7f192c153e60 2023-11-04T01:38:10.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f1930ff9640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c153e60 0x7f192c15dec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561b99f903c64be6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f192b7fe640 1 -- 172.21.15.93:0/2724269046 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920030840 con 0x7f192c153e60 2023-11-04T01:38:10.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f192b7fe640 1 -- 172.21.15.93:0/2724269046 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19200309a0 con 0x7f192c153e60 2023-11-04T01:38:10.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f192b7fe640 1 -- 172.21.15.93:0/2724269046 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920030d30 con 0x7f192c153e60 2023-11-04T01:38:10.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f193325d640 1 -- 172.21.15.93:0/2724269046 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c153e60 msgr2=0x7f192c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.428+0000 7f193325d640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c153e60 0x7f192c15dec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1920009870 tx=0x7f192002b980 comp rx=0 tx=0).stop 2023-11-04T01:38:10.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 -- 172.21.15.93:0/2724269046 shutdown_connections 2023-11-04T01:38:10.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c0b4880 0x7f192c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 --2- 172.21.15.93:0/2724269046 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c153e60 0x7f192c15dec0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 -- 172.21.15.93:0/2724269046 >> 172.21.15.93:0/2724269046 conn(0x7f192c0cf880 msgr2=0x7f192c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 -- 172.21.15.93:0/2724269046 shutdown_connections 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.429+0000 7f193325d640 1 -- 172.21.15.93:0/2724269046 wait complete. 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.430+0000 7f193325d640 1 Processor -- start 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.430+0000 7f193325d640 1 -- start start 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 0x7f192c1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c153e60 0x7f192c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1562f0 con 0x7f192c0cd6d0 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c152d20 con 0x7f192c0b4880 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c155670 con 0x7f192c153e60 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43908/0 (socket says 172.21.15.93:43908) 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 -- 172.21.15.93:0/3635115537 learned_addr learned my addr 172.21.15.93:0/3635115537 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f19317fa640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c153e60 0x7f192c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f1930ff9640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 0x7f192c1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 -- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c153e60 msgr2=0x7f192c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c153e60 0x7f192c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 -- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 msgr2=0x7f192c1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 0x7f192c1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 -- 172.21.15.93:0/3635115537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200094d0 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f1930ff9640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 0x7f192c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f192bfff640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f191800c400 tx=0x7f191800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180052d0 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918005430 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c155950 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918003830 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.431+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c155f10 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.432+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c156430 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.433+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1918003990 con 0x7f192c0cd6d0 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.433+0000 7f19297fa640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 0x7f191006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.433+0000 7f1930ff9640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 0x7f191006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.433+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f1918088bf0 con 0x7f192c0cd6d0 2023-11-04T01:38:10.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.434+0000 7f1930ff9640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 0x7f191006d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1920036000 tx=0x7f192003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.438+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f192c156430 con 0x7f192c0cd6d0 2023-11-04T01:38:10.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:10.605+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f192c156430 con 0x7f192c0cd6d0 2023-11-04T01:38:11.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.304+0000 7f19297fa640 1 -- 172.21.15.93:0/3635115537 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f192c156430 con 0x7f192c0cd6d0 2023-11-04T01:38:11.307 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 msgr2=0x7f191006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 0x7f191006d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1920036000 tx=0x7f192003b040 comp rx=0 tx=0).stop 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 msgr2=0x7f192c1f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f191800c400 tx=0x7f191800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 shutdown_connections 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f191006ae70 0x7f191006d330 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1920036000 tx=0x7f192003b040 comp rx=0 tx=0).stop 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f192c153e60 0x7f192c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f192c0cd6d0 0x7f192c1f36e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 --2- 172.21.15.93:0/3635115537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f192c0b4880 0x7f192c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.308+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 >> 172.21.15.93:0/3635115537 conn(0x7f192c0cf880 msgr2=0x7f192c15e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.309+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 shutdown_connections 2023-11-04T01:38:11.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.309+0000 7f193325d640 1 -- 172.21.15.93:0/3635115537 wait complete. 2023-11-04T01:38:11.335 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:11.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.440+0000 7f31ad032640 1 Processor -- start 2023-11-04T01:38:11.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.440+0000 7f31ad032640 1 -- start start 2023-11-04T01:38:11.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31ad032640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31a806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31ad032640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8065df0 con 0x7f31a815ad40 2023-11-04T01:38:11.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31ad032640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8066040 con 0x7f31a80c9b60 2023-11-04T01:38:11.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31ad032640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a806bc40 con 0x7f31a815b120 2023-11-04T01:38:11.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31a6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f31a815ad40 0x7f31a815f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52880/0 (socket says 172.21.15.93:52880) 2023-11-04T01:38:11.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.441+0000 7f31a6d9d640 1 -- 172.21.15.93:0/2949140863 learned_addr learned my addr 172.21.15.93:0/2949140863 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886530955 0 0) 0x7f31a8065df0 con 0x7f31a815ad40 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31a806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3190003520 con 0x7f31a815ad40 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884525422 0 0) 0x7f3190003520 con 0x7f31a815ad40 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 msgr2=0x7f31a806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31a806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 >> v1:172.21.15.125:6789/0 conn(0x7f31a80c9b60 legacy=0x7f31a8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8066320 con 0x7f31a815ad40 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f319c001670 con 0x7f31a815ad40 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 >> v1:172.21.15.93:6789/0 conn(0x7f31a815ad40 legacy=0x7f31a815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a806bc40 con 0x7f3190003f20 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319000ba60 con 0x7f3190004d00 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bc20 con 0x7f31a815b120 2023-11-04T01:38:11.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a6d9d640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a759e640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 -- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 msgr2=0x7f31900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31a815b120 0x7f31900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 -- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3190004d00 msgr2=0x7f3190005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a659c640 1 -- 172.21.15.93:0/2949140863 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190003520 con 0x7f3190003f20 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.442+0000 7f31a759e640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.443+0000 7f31a659c640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3190003f20 0x7f31900047c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3198009a90 tx=0x7f31900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f905017d8b8e19 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.443+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319802c680 con 0x7f3190003f20 2023-11-04T01:38:11.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.443+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319802c7e0 con 0x7f3190003f20 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.443+0000 7f31a5d9b640 1 -- 172.21.15.93:0/2949140863 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319802cb70 con 0x7f3190003f20 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 -- 172.21.15.93:0/2949140863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3190003f20 msgr2=0x7f31900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 --2- 172.21.15.93:0/2949140863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3190003f20 0x7f31900047c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3198009a90 tx=0x7f31900057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31a759e640 1 -- 172.21.15.93:0/2949140863 reap_dead start 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 -- 172.21.15.93:0/2949140863 shutdown_connections 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 -- 172.21.15.93:0/2949140863 >> 172.21.15.93:0/2949140863 conn(0x7f31a80cbc90 msgr2=0x7f31a80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 -- 172.21.15.93:0/2949140863 shutdown_connections 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.444+0000 7f31ad032640 1 -- 172.21.15.93:0/2949140863 wait complete. 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.445+0000 7f31ad032640 1 Processor -- start 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.445+0000 7f31ad032640 1 -- start start 2023-11-04T01:38:11.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3190003f20 0x7f31a814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a80c6cf0 0x7f31a81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a814fac0 con 0x7f31a80c7170 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7740 con 0x7f31a80c6cf0 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31ad032640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7a20 con 0x7f3190003f20 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52628/0 (socket says 172.21.15.93:52628) 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 -- 172.21.15.93:0/1972226392 learned_addr learned my addr 172.21.15.93:0/1972226392 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a659c640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a80c6cf0 0x7f31a81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a6d9d640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3190003f20 0x7f31a814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 -- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3190003f20 msgr2=0x7f31a814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3190003f20 0x7f31a814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 -- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a80c6cf0 msgr2=0x7f31a81592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a80c6cf0 0x7f31a81592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.446+0000 7f31a759e640 1 -- 172.21.15.93:0/1972226392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80c7d00 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f31a759e640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000f80 tx=0x7f31a000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017070 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0003b80 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a80c7fe0 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003d30 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.447+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a814fe00 con 0x7f31a80c7170 2023-11-04T01:38:11.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.448+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8074290 con 0x7f31a80c7170 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.448+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31a00050d0 con 0x7f31a80c7170 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.448+0000 7f318f7fe640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 0x7f319406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.449+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f31a0088c20 con 0x7f31a80c7170 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.449+0000 7f31a6d9d640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 0x7f319406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.449+0000 7f31a6d9d640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 0x7f319406d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f31a8159e30 tx=0x7f319c001c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.463 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.453+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31a0053a90 con 0x7f31a80c7170 2023-11-04T01:38:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:11.652+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f31a815dce0 con 0x7f31a80c7170 2023-11-04T01:38:12.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.316+0000 7f318f7fe640 1 -- 172.21.15.93:0/1972226392 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v27) v1 ==== 174+0+0 (secure 0 0 0) 0x7f31a00570b0 con 0x7f31a80c7170 2023-11-04T01:38:12.319 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 10 and data pool 11 2023-11-04T01:38:12.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.318+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 msgr2=0x7f319406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.318+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 0x7f319406d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f31a8159e30 tx=0x7f319c001c00 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.318+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 msgr2=0x7f31a8159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.318+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000f80 tx=0x7f31a000ead0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 shutdown_connections 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f319406ae70 0x7f319406d330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31a80c7170 0x7f31a8159820 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31a80c6cf0 0x7f31a81592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 --2- 172.21.15.93:0/1972226392 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3190003f20 0x7f31a814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 >> 172.21.15.93:0/1972226392 conn(0x7f31a80cbc90 msgr2=0x7f31a8072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 shutdown_connections 2023-11-04T01:38:12.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.319+0000 7f31ad032640 1 -- 172.21.15.93:0/1972226392 wait complete. 2023-11-04T01:38:12.337 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.434+0000 7ffa18d39640 1 Processor -- start 2023-11-04T01:38:12.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.435+0000 7ffa18d39640 1 -- start start 2023-11-04T01:38:12.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.435+0000 7ffa18d39640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa1415ce70 0x7ffa1406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa18d39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa140c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa18d39640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1406a120 con 0x7ffa140c9d70 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa18d39640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140cdc10 con 0x7ffa1415ce70 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa18d39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1406def0 con 0x7ffa1415d250 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa12d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffa140c9d70 0x7ffa140ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52894/0 (socket says 172.21.15.93:52894) 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa12d9d640 1 -- 172.21.15.93:0/3973323098 learned_addr learned my addr 172.21.15.93:0/3973323098 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1259c640 1 --2- 172.21.15.93:0/3973323098 >> v2:172.21.15.125:3300/0 conn(0x7ffa1415ce70 0x7ffa1406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa140c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463602237 0 0) 0x7ffa1406a120 con 0x7ffa140c9d70 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003520 con 0x7ffa140c9d70 2023-11-04T01:38:12.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735682712 0 0) 0x7ffa00003520 con 0x7ffa140c9d70 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 msgr2=0x7ffa140c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa140c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 >> v2:172.21.15.125:3300/0 conn(0x7ffa1415ce70 msgr2=0x7ffa1406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 --2- 172.21.15.93:0/3973323098 >> v2:172.21.15.125:3300/0 conn(0x7ffa1415ce70 0x7ffa1406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1406a370 con 0x7ffa140c9d70 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ffa04001670 con 0x7ffa140c9d70 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 >> v1:172.21.15.93:6789/0 conn(0x7ffa140c9d70 legacy=0x7ffa140ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa00003970 0x7ffa00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa000047c0 0x7ffa00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140cdc10 con 0x7ffa00003970 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1406def0 con 0x7ffa000047c0 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0000b980 con 0x7ffa1415d250 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.436+0000 7ffa1259c640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa00003970 0x7ffa00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa12d9d640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa000047c0 0x7ffa00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 -- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 msgr2=0x7ffa00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1415d250 0x7ffa00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 -- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa000047c0 msgr2=0x7ffa00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa000047c0 0x7ffa00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 -- 172.21.15.93:0/3973323098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00003520 con 0x7ffa00003970 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa000047c0 0x7ffa00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.437+0000 7ffa1259c640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa00003970 0x7ffa00003d90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009fc0 tx=0x7ffa000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d46169eb3d6fb2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c02cc60 con 0x7ffa00003970 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c00f040 con 0x7ffa00003970 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa1159a640 1 -- 172.21.15.93:0/3973323098 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c034440 con 0x7ffa00003970 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 -- 172.21.15.93:0/3973323098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa00003970 msgr2=0x7ffa00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 --2- 172.21.15.93:0/3973323098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa00003970 0x7ffa00003d90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009fc0 tx=0x7ffa000057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa12d9d640 1 -- 172.21.15.93:0/3973323098 reap_dead start 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 -- 172.21.15.93:0/3973323098 shutdown_connections 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 -- 172.21.15.93:0/3973323098 >> 172.21.15.93:0/3973323098 conn(0x7ffa140b0cd0 msgr2=0x7ffa140b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 -- 172.21.15.93:0/3973323098 shutdown_connections 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.438+0000 7ffa18d39640 1 -- 172.21.15.93:0/3973323098 wait complete. 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.439+0000 7ffa18d39640 1 Processor -- start 2023-11-04T01:38:12.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 -- start start 2023-11-04T01:38:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 0x7ffa14157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa140c8020 0x7ffa1414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14158f50 con 0x7ffa1414e1d0 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14158380 con 0x7ffa140c8020 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa18d39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14158620 con 0x7ffa00003970 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa11d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa11d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52650/0 (socket says 172.21.15.93:52650) 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.440+0000 7ffa11d9b640 1 -- 172.21.15.93:0/200154849 learned_addr learned my addr 172.21.15.93:0/200154849 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa12d9d640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa140c8020 0x7ffa1414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa1259c640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 0x7ffa14157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 -- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 msgr2=0x7ffa14157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 0x7ffa14157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 -- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa140c8020 msgr2=0x7ffa1414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa140c8020 0x7ffa1414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 -- 172.21.15.93:0/200154849 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14158900 con 0x7ffa1414e1d0 2023-11-04T01:38:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa1259c640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 0x7ffa14157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa11d9b640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0114e0 tx=0x7ff9fc0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc015870 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0159d0 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa14158be0 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc015d40 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.441+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa140c84a0 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.442+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa14159100 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.442+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9fc013400 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.443+0000 7ffa0affd640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 0x7ff9f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.443+0000 7ffa1259c640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 0x7ff9f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.443+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff9fc089c90 con 0x7ffa1414e1d0 2023-11-04T01:38:12.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.443+0000 7ffa1259c640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 0x7ff9f406d360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c036000 tx=0x7ffa0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.447+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa14159100 con 0x7ffa1414e1d0 2023-11-04T01:38:12.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.613+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa14074290 con 0x7ffa1414e1d0 2023-11-04T01:38:12.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.615+0000 7ffa0affd640 1 -- 172.21.15.93:0/200154849 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18551 (secure 0 0 0) 0x7ff9fc019090 con 0x7ffa1414e1d0 2023-11-04T01:38:12.618 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:12.618 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":65,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:11.654137+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.616+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 msgr2=0x7ff9f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 0x7ff9f406d360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c036000 tx=0x7ffa0c02e000 comp rx=0 tx=0).stop 2023-11-04T01:38:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 msgr2=0x7ffa140b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0114e0 tx=0x7ff9fc0118e0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 shutdown_connections 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9f406aea0 0x7ff9f406d360 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa140c8020 0x7ffa1414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1414e1d0 0x7ffa140b2990 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 --2- 172.21.15.93:0/200154849 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa00003970 0x7ffa14157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 >> 172.21.15.93:0/200154849 conn(0x7ffa140b0cd0 msgr2=0x7ffa140acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 shutdown_connections 2023-11-04T01:38:12.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.617+0000 7ffa18d39640 1 -- 172.21.15.93:0/200154849 wait complete. 2023-11-04T01:38:12.630 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:12.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.727+0000 7f8ae79a9640 1 Processor -- start 2023-11-04T01:38:12.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.727+0000 7f8ae79a9640 1 -- start start 2023-11-04T01:38:12.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae79a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8ae0160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae79a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae006bf00 con 0x7f8ae00cf160 2023-11-04T01:38:12.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae79a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae01615d0 con 0x7f8ae015ce60 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae79a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00cbde0 con 0x7f8ae0160b10 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae5f46640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8ae00cf160 0x7f8ae00cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52896/0 (socket says 172.21.15.93:52896) 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae5f46640 1 -- 172.21.15.93:0/975750691 learned_addr learned my addr 172.21.15.93:0/975750691 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8ae0160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257001894 0 0) 0x7f8ae006bf00 con 0x7f8ae00cf160 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc003520 con 0x7f8ae00cf160 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365368427 0 0) 0x7f8acc003520 con 0x7f8ae00cf160 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 msgr2=0x7f8ae0160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8ae0160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 >> v1:172.21.15.125:6789/0 conn(0x7f8ae015ce60 legacy=0x7f8ae006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae01618b0 con 0x7f8ae00cf160 2023-11-04T01:38:12.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8adc0019f0 con 0x7f8ae00cf160 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 >> v1:172.21.15.93:6789/0 conn(0x7f8ae00cf160 legacy=0x7f8ae00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8acc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8acc003f20 0x7f8acc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8acc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00cbde0 con 0x7f8acc004d00 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc00ba60 con 0x7f8acc003f20 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc00bc20 con 0x7f8ae0160b10 2023-11-04T01:38:12.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.728+0000 7f8ae5f46640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8acc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5745640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8acc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8acc003f20 0x7f8acc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 -- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 msgr2=0x7f8acc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae0160b10 0x7f8acc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 -- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8acc003f20 msgr2=0x7f8acc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8acc003f20 0x7f8acc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 -- 172.21.15.93:0/975750691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc003520 con 0x7f8acc004d00 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.729+0000 7f8ae5f46640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8acc005180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00a830 tx=0x7f8acc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b1fda85c429c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0072d0 con 0x7f8acc004d00 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc02f070 con 0x7f8acc004d00 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ad7fff640 1 -- 172.21.15.93:0/975750691 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0076f0 con 0x7f8acc004d00 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 -- 172.21.15.93:0/975750691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 msgr2=0x7f8acc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/975750691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8acc005180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00a830 tx=0x7f8acc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae5f46640 1 -- 172.21.15.93:0/975750691 reap_dead start 2023-11-04T01:38:12.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 -- 172.21.15.93:0/975750691 shutdown_connections 2023-11-04T01:38:12.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 -- 172.21.15.93:0/975750691 >> 172.21.15.93:0/975750691 conn(0x7f8ae006ea90 msgr2=0x7f8ae006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 -- 172.21.15.93:0/975750691 shutdown_connections 2023-11-04T01:38:12.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.730+0000 7f8ae79a9640 1 -- 172.21.15.93:0/975750691 wait complete. 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.731+0000 7f8ae79a9640 1 Processor -- start 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.731+0000 7f8ae79a9640 1 -- start start 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 0x7f8ae01f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ae01f2fa0 0x7f8ae01f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae01f3960 con 0x7f8acc004d00 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c83e0 con 0x7f8ae01f2fa0 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae79a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00b58f0 con 0x7f8ae00b5180 2023-11-04T01:38:12.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52670/0 (socket says 172.21.15.93:52670) 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 -- 172.21.15.93:0/4269767323 learned_addr learned my addr 172.21.15.93:0/4269767323 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5f46640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ae01f2fa0 0x7f8ae01f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 0x7f8ae01f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 -- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 msgr2=0x7f8ae01f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 0x7f8ae01f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 -- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ae01f2fa0 msgr2=0x7f8ae01f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ae01f2fa0 0x7f8ae01f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae5745640 1 -- 172.21.15.93:0/4269767323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00b5bd0 con 0x7f8acc004d00 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.732+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 0x7f8ae01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ae5745640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800f820 tx=0x7f8ad800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80050d0 con 0x7f8acc004d00 2023-11-04T01:38:12.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8005230 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae00b5eb0 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800d730 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.733+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae00c88e0 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.734+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae00b60c0 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.734+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ad800d890 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.735+0000 7f8ad5ffb640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 0x7f8ac406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.735+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8ad80897c0 con 0x7f8acc004d00 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.735+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 0x7f8ac406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.735+0000 7f8ae4f44640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 0x7f8ac406d360 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ca0f0 tx=0x7f8ad0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.739+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ad8054660 con 0x7f8acc004d00 2023-11-04T01:38:12.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.905+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ae0074290 con 0x7f8acc004d00 2023-11-04T01:38:12.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.906+0000 7f8ad5ffb640 1 -- 172.21.15.93:0/4269767323 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f8ad8057c80 con 0x7f8acc004d00 2023-11-04T01:38:12.910 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:12.910 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":65,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:11.654137+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 msgr2=0x7f8ac406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 0x7f8ac406d360 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00ca0f0 tx=0x7f8ad0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 msgr2=0x7f8ae00aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800f820 tx=0x7f8ad800fce0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 shutdown_connections 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8ac406aea0 0x7f8ac406d360 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ae01f2fa0 0x7f8ae01f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ae00b5180 0x7f8ae01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 --2- 172.21.15.93:0/4269767323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8acc004d00 0x7f8ae00aba70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 >> 172.21.15.93:0/4269767323 conn(0x7f8ae006ea90 msgr2=0x7f8ae015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 shutdown_connections 2023-11-04T01:38:12.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:12.908+0000 7f8ae79a9640 1 -- 172.21.15.93:0/4269767323 wait complete. 2023-11-04T01:38:12.922 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:38:13.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.021+0000 7fd77e690640 1 Processor -- start 2023-11-04T01:38:13.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.021+0000 7fd77e690640 1 -- start start 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77e690640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd778070ff0 0x7fd7780cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77e690640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd778066000 0x7fd77806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77e690640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7780c9bf0 con 0x7fd77815d1b0 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77e690640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7780cd890 con 0x7fd778070ff0 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77e690640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7780cdb30 con 0x7fd778066000 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd777fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd778070ff0 0x7fd7780cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd7777fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd77815d1b0 0x7fd7780713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52904/0 (socket says 172.21.15.93:52904) 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd7777fe640 1 -- 172.21.15.93:0/2657286925 learned_addr learned my addr 172.21.15.93:0/2657286925 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd77cc2d640 1 --2- 172.21.15.93:0/2657286925 >> v2:172.21.15.125:3300/0 conn(0x7fd778066000 0x7fd77806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd777fff640 1 -- 172.21.15.93:0/2657286925 >> v2:172.21.15.125:3300/0 conn(0x7fd778066000 msgr2=0x7fd77806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd777fff640 1 --2- 172.21.15.93:0/2657286925 >> v2:172.21.15.125:3300/0 conn(0x7fd778066000 0x7fd77806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd777fff640 1 -- 172.21.15.93:0/2657286925 >> v1:172.21.15.93:6789/0 conn(0x7fd77815d1b0 legacy=0x7fd7780713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.022+0000 7fd777fff640 1 -- 172.21.15.93:0/2657286925 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780cde10 con 0x7fd778070ff0 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.023+0000 7fd777fff640 1 --2- 172.21.15.93:0/2657286925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778070ff0 0x7fd7780cb4e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd77806e960 tx=0x7fd76802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63754ad84535d8b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.023+0000 7fd776ffd640 1 -- 172.21.15.93:0/2657286925 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768031830 con 0x7fd778070ff0 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.023+0000 7fd776ffd640 1 -- 172.21.15.93:0/2657286925 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd768031990 con 0x7fd778070ff0 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.023+0000 7fd776ffd640 1 -- 172.21.15.93:0/2657286925 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768031d20 con 0x7fd778070ff0 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 -- 172.21.15.93:0/2657286925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778070ff0 msgr2=0x7fd7780cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 --2- 172.21.15.93:0/2657286925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778070ff0 0x7fd7780cb4e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd77806e960 tx=0x7fd76802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 -- 172.21.15.93:0/2657286925 shutdown_connections 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 --2- 172.21.15.93:0/2657286925 >> v2:172.21.15.125:3300/0 conn(0x7fd778066000 0x7fd77806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 --2- 172.21.15.93:0/2657286925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd778070ff0 0x7fd7780cb4e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 -- 172.21.15.93:0/2657286925 >> 172.21.15.93:0/2657286925 conn(0x7fd7780cbc90 msgr2=0x7fd7780cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 -- 172.21.15.93:0/2657286925 shutdown_connections 2023-11-04T01:38:13.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.024+0000 7fd77e690640 1 -- 172.21.15.93:0/2657286925 wait complete. 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.025+0000 7fd77e690640 1 Processor -- start 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.025+0000 7fd77e690640 1 -- start start 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 0x7fd7780c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 0x7fd7780c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780c4d60 con 0x7fd77815d1b0 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780c5040 con 0x7fd778070ff0 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77e690640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780c5320 con 0x7fd778066000 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52688/0 (socket says 172.21.15.93:52688) 2023-11-04T01:38:13.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 -- 172.21.15.93:0/3426615462 learned_addr learned my addr 172.21.15.93:0/3426615462 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd7777fe640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 0x7fd7780c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd777fff640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 0x7fd7780c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 -- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 msgr2=0x7fd7780c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 0x7fd7780c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 -- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 msgr2=0x7fd7780c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 0x7fd7780c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd77cc2d640 1 -- 172.21.15.93:0/3426615462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768009400 con 0x7fd77815d1b0 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd7777fe640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 0x7fd7780c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.026+0000 7fd777fff640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 0x7fd7780c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd77cc2d640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd770007e60 tx=0x7fd77000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770014420 con 0x7fd77815d1b0 2023-11-04T01:38:13.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7700145a0 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780c5600 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770014950 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.027+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7780c73d0 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.028+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7780b2e10 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.028+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd770014ab0 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.029+0000 7fd774ff9640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 0x7fd76406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.029+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd77008a200 con 0x7fd77815d1b0 2023-11-04T01:38:13.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.029+0000 7fd777fff640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 0x7fd76406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.029+0000 7fd777fff640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 0x7fd76406d330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd768036000 tx=0x7fd768008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.033+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7780b2e10 con 0x7fd77815d1b0 2023-11-04T01:38:13.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.237+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd7780b2e10 con 0x7fd77815d1b0 2023-11-04T01:38:13.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.317+0000 7fd774ff9640 1 -- 172.21.15.93:0/3426615462 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd7780b2e10 con 0x7fd77815d1b0 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 msgr2=0x7fd76406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 0x7fd76406d330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd768036000 tx=0x7fd768008030 comp rx=0 tx=0).stop 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 msgr2=0x7fd7780afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd770007e60 tx=0x7fd77000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 shutdown_connections 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd76406ae70 0x7fd76406d330 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd77815d1b0 0x7fd7780afc50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd778070ff0 0x7fd7780c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 --2- 172.21.15.93:0/3426615462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd778066000 0x7fd7780c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 >> 172.21.15.93:0/3426615462 conn(0x7fd7780cbc90 msgr2=0x7fd778160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 shutdown_connections 2023-11-04T01:38:13.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.319+0000 7fd77e690640 1 -- 172.21.15.93:0/3426615462 wait complete. 2023-11-04T01:38:13.333 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:38:13.333 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:38:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.433+0000 7fabe9933640 1 Processor -- start 2023-11-04T01:38:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.433+0000 7fabe9933640 1 -- start start 2023-11-04T01:38:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe9933640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fabe415ad30 0x7fabe40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe9933640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40c3900 con 0x7fabe4070e20 2023-11-04T01:38:13.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe9933640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40c3be0 con 0x7fabe40ad730 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe9933640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40ae260 con 0x7fabe415ad30 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fabe415ad30 0x7fabe40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fabe4070e20 0x7fabe415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52908/0 (socket says 172.21.15.93:52908) 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.434+0000 7fabe37fe640 1 -- 172.21.15.93:0/1297485303 learned_addr learned my addr 172.21.15.93:0/1297485303 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe2ffd640 1 -- 172.21.15.93:0/1297485303 >> v1:172.21.15.125:6789/0 conn(0x7fabe40ad730 legacy=0x7fabe4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe2ffd640 1 -- 172.21.15.93:0/1297485303 >> v1:172.21.15.93:6789/0 conn(0x7fabe4070e20 legacy=0x7fabe415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe2ffd640 1 -- 172.21.15.93:0/1297485303 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40c3ec0 con 0x7fabe415ad30 2023-11-04T01:38:13.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe1ffb640 1 -- 172.21.15.93:0/1297485303 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898802589 0 0) 0x7fabe40c3900 con 0x7fabe4070e20 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe2ffd640 1 --2- 172.21.15.93:0/1297485303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe415ad30 0x7fabe40adc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009d90 tx=0x7fabd402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3975548fa7cec5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe1ffb640 1 -- 172.21.15.93:0/1297485303 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd402cc60 con 0x7fabe415ad30 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe1ffb640 1 -- 172.21.15.93:0/1297485303 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd402cdc0 con 0x7fabe415ad30 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.435+0000 7fabe1ffb640 1 -- 172.21.15.93:0/1297485303 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4034660 con 0x7fabe415ad30 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 -- 172.21.15.93:0/1297485303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe415ad30 msgr2=0x7fabe40adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 --2- 172.21.15.93:0/1297485303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe415ad30 0x7fabe40adc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009d90 tx=0x7fabd402beb0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 -- 172.21.15.93:0/1297485303 shutdown_connections 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 --2- 172.21.15.93:0/1297485303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe415ad30 0x7fabe40adc80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 -- 172.21.15.93:0/1297485303 >> 172.21.15.93:0/1297485303 conn(0x7fabe40ce950 msgr2=0x7fabe40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 -- 172.21.15.93:0/1297485303 shutdown_connections 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.436+0000 7fabe9933640 1 -- 172.21.15.93:0/1297485303 wait complete. 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.437+0000 7fabe9933640 1 Processor -- start 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.437+0000 7fabe9933640 1 -- start start 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fabe4070e20 0x7fabe4146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabe415ad30 0x7fabe40b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe41469c0 con 0x7fabe40ad730 2023-11-04T01:38:13.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40b1b00 con 0x7fabe415ad30 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe9933640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40b1de0 con 0x7fabe4070e20 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52708/0 (socket says 172.21.15.93:52708) 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 -- 172.21.15.93:0/4043718970 learned_addr learned my addr 172.21.15.93:0/4043718970 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 -- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fabe4070e20 msgr2=0x7fabe4146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fabe4070e20 0x7fabe4146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 -- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabe415ad30 msgr2=0x7fabe40b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabe415ad30 0x7fabe40b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.438+0000 7fabe27fc640 1 -- 172.21.15.93:0/4043718970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4009a70 con 0x7fabe40ad730 2023-11-04T01:38:13.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabe27fc640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c450 tx=0x7fabd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80052d0 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8005430 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8012870 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe40b20c0 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.439+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe40b2680 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.440+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe4074290 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.440+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabd80129d0 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.440+0000 7fabcbfff640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 0x7fabd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.441+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fabd8089350 con 0x7fabe40ad730 2023-11-04T01:38:13.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.441+0000 7fabe2ffd640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 0x7fabd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:13.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.441+0000 7fabe2ffd640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 0x7fabd006d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fabd4036000 tx=0x7fabd402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:13.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.445+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabd80541f0 con 0x7fabe40ad730 2023-11-04T01:38:13.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:13.647+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fabe4071970 con 0x7fabe40ad730 2023-11-04T01:38:14.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.327+0000 7fabcbfff640 1 -- 172.21.15.93:0/4043718970 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabd8057810 con 0x7fabe40ad730 2023-11-04T01:38:14.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 msgr2=0x7fabd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 0x7fabd006d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fabd4036000 tx=0x7fabd402e000 comp rx=0 tx=0).stop 2023-11-04T01:38:14.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 msgr2=0x7fabe40b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c450 tx=0x7fabd800c910 comp rx=0 tx=0).stop 2023-11-04T01:38:14.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 shutdown_connections 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fabd006ae70 0x7fabd006d330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabe415ad30 0x7fabe40b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fabe40ad730 0x7fabe40b12b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 --2- 172.21.15.93:0/4043718970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fabe4070e20 0x7fabe4146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 >> 172.21.15.93:0/4043718970 conn(0x7fabe40ce950 msgr2=0x7fabe40c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 shutdown_connections 2023-11-04T01:38:14.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.330+0000 7fabe9933640 1 -- 172.21.15.93:0/4043718970 wait complete. 2023-11-04T01:38:14.345 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:38:14.345 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.445+0000 7f2574e34640 1 Processor -- start 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.445+0000 7f2574e34640 1 -- start start 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f2574e34640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2570159c70 0x7f25700ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f2574e34640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25700b0ae0 0x7f257015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f2574e34640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b4110 con 0x7f257006db20 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f2574e34640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b49b0 con 0x7f2570159c70 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f2574e34640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b43f0 con 0x7f25700b0ae0 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256e59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2570159c70 0x7f25700ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256dd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f257006db20 0x7f25700b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52924/0 (socket says 172.21.15.93:52924) 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256dd9b640 1 -- 172.21.15.93:0/405741431 learned_addr learned my addr 172.21.15.93:0/405741431 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:14.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256e59c640 1 -- 172.21.15.93:0/405741431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25700b0ae0 msgr2=0x7f257015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256e59c640 1 --2- 172.21.15.93:0/405741431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25700b0ae0 0x7f257015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256e59c640 1 -- 172.21.15.93:0/405741431 >> v1:172.21.15.93:6789/0 conn(0x7f257006db20 legacy=0x7f25700b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256e59c640 1 -- 172.21.15.93:0/405741431 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700b46d0 con 0x7f2570159c70 2023-11-04T01:38:14.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.446+0000 7f256d59a640 1 -- 172.21.15.93:0/405741431 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857180723 0 0) 0x7f25700b4110 con 0x7f257006db20 2023-11-04T01:38:14.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.447+0000 7f256e59c640 1 --2- 172.21.15.93:0/405741431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2570159c70 0x7f25700ce370 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f25600097a0 tx=0x7f256002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399177cd145b469b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.447+0000 7f256d59a640 1 -- 172.21.15.93:0/405741431 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560031830 con 0x7f2570159c70 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.447+0000 7f256d59a640 1 -- 172.21.15.93:0/405741431 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560031990 con 0x7f2570159c70 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.447+0000 7f256d59a640 1 -- 172.21.15.93:0/405741431 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560031d20 con 0x7f2570159c70 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 -- 172.21.15.93:0/405741431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2570159c70 msgr2=0x7f25700ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 --2- 172.21.15.93:0/405741431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2570159c70 0x7f25700ce370 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f25600097a0 tx=0x7f256002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 -- 172.21.15.93:0/405741431 shutdown_connections 2023-11-04T01:38:14.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 --2- 172.21.15.93:0/405741431 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f25700b0ae0 0x7f257015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 --2- 172.21.15.93:0/405741431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2570159c70 0x7f25700ce370 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 -- 172.21.15.93:0/405741431 >> 172.21.15.93:0/405741431 conn(0x7f25700ce950 msgr2=0x7f25700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 -- 172.21.15.93:0/405741431 shutdown_connections 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.448+0000 7f2574e34640 1 -- 172.21.15.93:0/405741431 wait complete. 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.449+0000 7f2574e34640 1 Processor -- start 2023-11-04T01:38:14.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.449+0000 7f2574e34640 1 -- start start 2023-11-04T01:38:14.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257006db20 0x7f2570151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2570159c70 0x7f25701503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257014f340 con 0x7f25700b0ae0 2023-11-04T01:38:14.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257014f620 con 0x7f257006db20 2023-11-04T01:38:14.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f2574e34640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257014f900 con 0x7f2570159c70 2023-11-04T01:38:14.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52736/0 (socket says 172.21.15.93:52736) 2023-11-04T01:38:14.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 -- 172.21.15.93:0/927311099 learned_addr learned my addr 172.21.15.93:0/927311099 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256ed9d640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2570159c70 0x7f25701503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256e59c640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257006db20 0x7f2570151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 -- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2570159c70 msgr2=0x7f25701503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2570159c70 0x7f25701503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 -- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257006db20 msgr2=0x7f2570151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257006db20 0x7f2570151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 -- 172.21.15.93:0/927311099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009400 con 0x7f25700b0ae0 2023-11-04T01:38:14.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.450+0000 7f256dd9b640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f256400c4d0 tx=0x7f256400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.451+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640074e0 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.451+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564007660 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.451+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564004a20 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.451+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257014fbe0 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.451+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257014ef80 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.452+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2570150100 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.452+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2564004b80 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.452+0000 7f255effd640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.453+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2564088a50 con 0x7f25700b0ae0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.453+0000 7f256e59c640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.453+0000 7f256e59c640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 0x7f255006d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2560036000 tx=0x7f2560008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.457+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2570150100 con 0x7f25700b0ae0 2023-11-04T01:38:14.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.656+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2570150100 con 0x7f25700b0ae0 2023-11-04T01:38:14.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.657+0000 7f255effd640 1 -- 172.21.15.93:0/927311099 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f2570150100 con 0x7f25700b0ae0 2023-11-04T01:38:14.660 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:14.661 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:14.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 msgr2=0x7f255006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 0x7f255006d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2560036000 tx=0x7f2560008030 comp rx=0 tx=0).stop 2023-11-04T01:38:14.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 msgr2=0x7f25700c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f256400c4d0 tx=0x7f256400c990 comp rx=0 tx=0).stop 2023-11-04T01:38:14.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 shutdown_connections 2023-11-04T01:38:14.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2570159c70 0x7f25701503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b0ae0 0x7f25700c5990 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 --2- 172.21.15.93:0/927311099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257006db20 0x7f2570151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.658+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 >> 172.21.15.93:0/927311099 conn(0x7f25700ce950 msgr2=0x7f257015c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.659+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 shutdown_connections 2023-11-04T01:38:14.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.659+0000 7f2574e34640 1 -- 172.21.15.93:0/927311099 wait complete. 2023-11-04T01:38:14.672 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:14.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.769+0000 7f5716f4c640 1 Processor -- start 2023-11-04T01:38:14.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.769+0000 7f5716f4c640 1 -- start start 2023-11-04T01:38:14.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5716f4c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5710070d40 0x7f571006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5716f4c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57100cc990 con 0x7f57100cda60 2023-11-04T01:38:14.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5716f4c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57100ccc70 con 0x7f57100b0cd0 2023-11-04T01:38:14.775 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5716f4c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57100c9ce0 con 0x7f5710070d40 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5714ce8640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f57100cda60 0x7f57100ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52930/0 (socket says 172.21.15.93:52930) 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f5714ce8640 1 -- 172.21.15.93:0/3342154536 learned_addr learned my addr 172.21.15.93:0/3342154536 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.770+0000 7f57154e9640 1 --2- 172.21.15.93:0/3342154536 >> v2:172.21.15.125:3300/0 conn(0x7f5710070d40 0x7f571006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753279097 0 0) 0x7f57100cc990 con 0x7f57100cda60 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f8003520 con 0x7f57100cda60 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917267314 0 0) 0x7f56f8003520 con 0x7f57100cda60 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 >> v2:172.21.15.125:3300/0 conn(0x7f5710070d40 msgr2=0x7f571006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 --2- 172.21.15.93:0/3342154536 >> v2:172.21.15.125:3300/0 conn(0x7f5710070d40 0x7f571006c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 >> v1:172.21.15.125:6789/0 conn(0x7f57100b0cd0 legacy=0x7f5710070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100c9fc0 con 0x7f57100cda60 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5700001670 con 0x7f57100cda60 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 >> v1:172.21.15.93:6789/0 conn(0x7f57100cda60 legacy=0x7f57100ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56f8003970 0x7f56f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 0x7f56f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f8005180 0x7f56f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100c9ce0 con 0x7f56f80047c0 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800c020 con 0x7f56f8005180 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f800c1e0 con 0x7f56f8003970 2023-11-04T01:38:14.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 0x7f56f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f5714ce8640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56f8003970 0x7f56f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f57154e9640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f8005180 0x7f56f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 -- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56f8003970 msgr2=0x7f56f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56f8003970 0x7f56f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 -- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f8005180 msgr2=0x7f56f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f8005180 0x7f56f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f570ffff640 1 -- 172.21.15.93:0/3342154536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8003520 con 0x7f56f80047c0 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f5714ce8640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56f8003970 0x7f56f8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f57154e9640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f8005180 0x7f56f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.771+0000 7f57154e9640 1 -- 172.21.15.93:0/3342154536 reap_dead start 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.772+0000 7f570ffff640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 0x7f56f8004c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5704001720 tx=0x7f56f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c086b1dd13f6d6db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.772+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040052d0 con 0x7f56f80047c0 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.772+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570402e050 con 0x7f56f80047c0 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.772+0000 7f570f7fe640 1 -- 172.21.15.93:0/3342154536 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704003830 con 0x7f56f80047c0 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 -- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 msgr2=0x7f56f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 0x7f56f8004c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5704001720 tx=0x7f56f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 -- 172.21.15.93:0/3342154536 shutdown_connections 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 --2- 172.21.15.93:0/3342154536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80047c0 0x7f56f8004c40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 -- 172.21.15.93:0/3342154536 >> 172.21.15.93:0/3342154536 conn(0x7f57100ce950 msgr2=0x7f57100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 -- 172.21.15.93:0/3342154536 shutdown_connections 2023-11-04T01:38:14.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.773+0000 7f5716f4c640 1 -- 172.21.15.93:0/3342154536 wait complete. 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.774+0000 7f5716f4c640 1 Processor -- start 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.774+0000 7f5716f4c640 1 -- start start 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f80047c0 0x7f57100afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5710158290 0x7f571014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100b3e70 con 0x7f57100b34b0 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571014f330 con 0x7f56f80047c0 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5716f4c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5710159db0 con 0x7f5710158290 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52740/0 (socket says 172.21.15.93:52740) 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 -- 172.21.15.93:0/2099058953 learned_addr learned my addr 172.21.15.93:0/2099058953 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f5714ce8640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f80047c0 0x7f57100afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f570ffff640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5710158290 0x7f571014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 -- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5710158290 msgr2=0x7f571014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5710158290 0x7f571014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 -- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f80047c0 msgr2=0x7f57100afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f80047c0 0x7f57100afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 -- 172.21.15.93:0/2099058953 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571015a090 con 0x7f57100b34b0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f57154e9640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f571006e300 tx=0x7f5708010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800e050 con 0x7f57100b34b0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800f040 con 0x7f57100b34b0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.775+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708003990 con 0x7f57100b34b0 2023-11-04T01:38:14.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.776+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571015a370 con 0x7f57100b34b0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.776+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571015a930 con 0x7f57100b34b0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.777+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5710074290 con 0x7f57100b34b0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.777+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5708003af0 con 0x7f57100b34b0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.777+0000 7f570d7fa640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 0x7f56fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.778+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f570808a200 con 0x7f57100b34b0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.778+0000 7f5714ce8640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 0x7f56fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.778+0000 7f5714ce8640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 0x7f56fc06d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5700001c90 tx=0x7f5700007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.782+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57080550b0 con 0x7f57100b34b0 2023-11-04T01:38:14.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.947+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57100b48d0 con 0x7f57100b34b0 2023-11-04T01:38:14.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.948+0000 7f570d7fa640 1 -- 172.21.15.93:0/2099058953 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18538 (secure 0 0 0) 0x7f57080586d0 con 0x7f57100b34b0 2023-11-04T01:38:14.951 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:14.951 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":66,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:13.034582+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:14.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 msgr2=0x7f56fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 0x7f56fc06d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5700001c90 tx=0x7f5700007040 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 msgr2=0x7f57100b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f571006e300 tx=0x7f5708010590 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 shutdown_connections 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f56fc06ae70 0x7f56fc06d330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57100b34b0 0x7f57100b3930 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5710158290 0x7f571014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 --2- 172.21.15.93:0/2099058953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56f80047c0 0x7f57100afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 >> 172.21.15.93:0/2099058953 conn(0x7f57100ce950 msgr2=0x7f5710158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 shutdown_connections 2023-11-04T01:38:14.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:14.950+0000 7f5716f4c640 1 -- 172.21.15.93:0/2099058953 wait complete. 2023-11-04T01:38:14.963 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:38:14.964 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:15.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.061+0000 7f0465900640 1 Processor -- start 2023-11-04T01:38:15.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.061+0000 7f0465900640 1 -- start start 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0465900640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0460157710 0x7f0460167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0465900640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046015e000 con 0x7f04600ce240 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0465900640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046015e2e0 con 0x7f04600cde60 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0465900640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046015e5c0 con 0x7f0460157710 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0457fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f04600ce240 0x7f0460157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52934/0 (socket says 172.21.15.93:52934) 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f0457fff640 1 -- 172.21.15.93:0/363363533 learned_addr learned my addr 172.21.15.93:0/363363533 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f045f7fe640 1 --2- 172.21.15.93:0/363363533 >> v2:172.21.15.125:3300/0 conn(0x7f0460157710 0x7f0460167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560569103 0 0) 0x7f046015e000 con 0x7f04600ce240 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f044c003520 con 0x7f04600ce240 2023-11-04T01:38:15.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350809159 0 0) 0x7f044c003520 con 0x7f04600ce240 2023-11-04T01:38:15.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.062+0000 7f045f7fe640 1 -- 172.21.15.93:0/363363533 >> v1:172.21.15.125:6789/0 conn(0x7f04600cde60 legacy=0x7f046015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.063+0000 7f045f7fe640 1 -- 172.21.15.93:0/363363533 >> v1:172.21.15.93:6789/0 conn(0x7f04600ce240 legacy=0x7f0460157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.063+0000 7f045f7fe640 1 -- 172.21.15.93:0/363363533 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600d1120 con 0x7f0460157710 2023-11-04T01:38:15.070 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.063+0000 7f045f7fe640 1 --2- 172.21.15.93:0/363363533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0460157710 0x7f0460167b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f045802bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e987be5477a6039b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448001670 con 0x7f0460157710 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045802c7a0 con 0x7f0460157710 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f045e7fc640 1 -- 172.21.15.93:0/363363533 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045802cb10 con 0x7f0460157710 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 -- 172.21.15.93:0/363363533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0460157710 msgr2=0x7f0460167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 --2- 172.21.15.93:0/363363533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0460157710 0x7f0460167b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f045802bc70 comp rx=0 tx=0).stop 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 -- 172.21.15.93:0/363363533 shutdown_connections 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 --2- 172.21.15.93:0/363363533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0460157710 0x7f0460167b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 -- 172.21.15.93:0/363363533 >> 172.21.15.93:0/363363533 conn(0x7f0460071f30 msgr2=0x7f04600cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 -- 172.21.15.93:0/363363533 shutdown_connections 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.064+0000 7f0465900640 1 -- 172.21.15.93:0/363363533 wait complete. 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.065+0000 7f0465900640 1 Processor -- start 2023-11-04T01:38:15.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.065+0000 7f0465900640 1 -- start start 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 0x7f046014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0460157710 0x7f046015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046014fbe0 con 0x7f04600cde60 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460157be0 con 0x7f04600ce240 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0465900640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046015c370 con 0x7f0460157710 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52742/0 (socket says 172.21.15.93:52742) 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 -- 172.21.15.93:0/3968369572 learned_addr learned my addr 172.21.15.93:0/3968369572 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0457fff640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 0x7f046014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045f7fe640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0460157710 0x7f046015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 -- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0460157710 msgr2=0x7f046015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0460157710 0x7f046015be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 -- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 msgr2=0x7f046014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 0x7f046014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f045effd640 1 -- 172.21.15.93:0/3968369572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009a70 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.066+0000 7f0457fff640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 0x7f046014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f045effd640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f045000c780 tx=0x7f045000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450005270 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04500053f0 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046015c600 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000a880 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.067+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0460158110 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.068+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0460074290 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.068+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f045000a9e0 con 0x7f04600cde60 2023-11-04T01:38:15.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.069+0000 7f045cff9640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.069+0000 7f0457fff640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.069+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0450089050 con 0x7f04600cde60 2023-11-04T01:38:15.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.069+0000 7f0457fff640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 0x7f044006d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f04480011e0 tx=0x7f0448009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.073+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0450053de0 con 0x7f04600cde60 2023-11-04T01:38:15.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.236+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04600c61a0 con 0x7f044006ae70 2023-11-04T01:38:15.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.244+0000 7f045cff9640 1 -- 172.21.15.93:0/3968369572 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355731 (secure 0 0 0) 0x7f04600c61a0 con 0x7f044006ae70 2023-11-04T01:38:15.250 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:15.252 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 msgr2=0x7f044006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 0x7f044006d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f04480011e0 tx=0x7f0448009040 comp rx=0 tx=0).stop 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 msgr2=0x7f04600cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f045000c780 tx=0x7f045000cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 shutdown_connections 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f044006ae70 0x7f044006d330 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0460157710 0x7f046015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04600ce240 0x7f046014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 --2- 172.21.15.93:0/3968369572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04600cde60 0x7f04600cc580 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.247+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 >> 172.21.15.93:0/3968369572 conn(0x7f0460071f30 msgr2=0x7f04600b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.248+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 shutdown_connections 2023-11-04T01:38:15.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.248+0000 7f0465900640 1 -- 172.21.15.93:0/3968369572 wait complete. 2023-11-04T01:38:15.261 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-04T01:38:13.355768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223180,"kb_used_data":6960,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751540,"statfs":{"total":773094113280,"available":772865576960,"internally_reserved":0,"allocated":7127040,"data_stored":3893450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000649"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:08.101758+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:38:08.101758+0000","last_peered":"2023-11-04T01:38:08.101758+0000","last_clean":"2023-11-04T01:38:08.101758+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:38:08.101758+0000","last_undegraded":"2023-11-04T01:38:08.101758+0000","last_fullsized":"2023-11-04T01:38:08.101758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989610+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:38:07.989610+0000","last_peered":"2023-11-04T01:38:07.989610+0000","last_clean":"2023-11-04T01:38:07.989610+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:38:07.989610+0000","last_undegraded":"2023-11-04T01:38:07.989610+0000","last_fullsized":"2023-11-04T01:38:07.989610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835898+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:38:07.835898+0000","last_peered":"2023-11-04T01:38:07.835898+0000","last_clean":"2023-11-04T01:38:07.835898+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:38:07.835898+0000","last_undegraded":"2023-11-04T01:38:07.835898+0000","last_fullsized":"2023-11-04T01:38:07.835898+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:08.101723+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:38:08.101723+0000","last_peered":"2023-11-04T01:38:08.101723+0000","last_clean":"2023-11-04T01:38:08.101723+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:38:08.101723+0000","last_undegraded":"2023-11-04T01:38:08.101723+0000","last_fullsized":"2023-11-04T01:38:08.101723+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835915+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:38:07.835915+0000","last_peered":"2023-11-04T01:38:07.835915+0000","last_clean":"2023-11-04T01:38:07.835915+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:38:07.835915+0000","last_undegraded":"2023-11-04T01:38:07.835915+0000","last_fullsized":"2023-11-04T01:38:07.835915+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294541+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:38:07.294541+0000","last_peered":"2023-11-04T01:38:07.294541+0000","last_clean":"2023-11-04T01:38:07.294541+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:38:07.294541+0000","last_undegraded":"2023-11-04T01:38:07.294541+0000","last_fullsized":"2023-11-04T01:38:07.294541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294617+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:38:07.294617+0000","last_peered":"2023-11-04T01:38:07.294617+0000","last_clean":"2023-11-04T01:38:07.294617+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:38:07.294617+0000","last_undegraded":"2023-11-04T01:38:07.294617+0000","last_fullsized":"2023-11-04T01:38:07.294617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.296773+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:38:07.296773+0000","last_peered":"2023-11-04T01:38:07.296773+0000","last_clean":"2023-11-04T01:38:07.296773+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:38:07.296773+0000","last_undegraded":"2023-11-04T01:38:07.296773+0000","last_fullsized":"2023-11-04T01:38:07.296773+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989752+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:38:07.989752+0000","last_peered":"2023-11-04T01:38:07.989752+0000","last_clean":"2023-11-04T01:38:07.989752+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:38:07.989752+0000","last_undegraded":"2023-11-04T01:38:07.989752+0000","last_fullsized":"2023-11-04T01:38:07.989752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989225+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:38:07.989225+0000","last_peered":"2023-11-04T01:38:07.989225+0000","last_clean":"2023-11-04T01:38:07.989225+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:38:07.989225+0000","last_undegraded":"2023-11-04T01:38:07.989225+0000","last_fullsized":"2023-11-04T01:38:07.989225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989715+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:38:07.989715+0000","last_peered":"2023-11-04T01:38:07.989715+0000","last_clean":"2023-11-04T01:38:07.989715+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:38:07.989715+0000","last_undegraded":"2023-11-04T01:38:07.989715+0000","last_fullsized":"2023-11-04T01:38:07.989715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.296789+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:38:07.296789+0000","last_peered":"2023-11-04T01:38:07.296789+0000","last_clean":"2023-11-04T01:38:07.296789+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:38:07.296789+0000","last_undegraded":"2023-11-04T01:38:07.296789+0000","last_fullsized":"2023-11-04T01:38:07.296789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989672+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:38:07.989672+0000","last_peered":"2023-11-04T01:38:07.989672+0000","last_clean":"2023-11-04T01:38:07.989672+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:38:07.989672+0000","last_undegraded":"2023-11-04T01:38:07.989672+0000","last_fullsized":"2023-11-04T01:38:07.989672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989144+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:38:07.989144+0000","last_peered":"2023-11-04T01:38:07.989144+0000","last_clean":"2023-11-04T01:38:07.989144+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:38:07.989144+0000","last_undegraded":"2023-11-04T01:38:07.989144+0000","last_fullsized":"2023-11-04T01:38:07.989144+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294715+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:38:07.294715+0000","last_peered":"2023-11-04T01:38:07.294715+0000","last_clean":"2023-11-04T01:38:07.294715+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:38:07.294715+0000","last_undegraded":"2023-11-04T01:38:07.294715+0000","last_fullsized":"2023-11-04T01:38:07.294715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835885+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:38:07.835885+0000","last_peered":"2023-11-04T01:38:07.835885+0000","last_clean":"2023-11-04T01:38:07.835885+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:38:07.835885+0000","last_undegraded":"2023-11-04T01:38:07.835885+0000","last_fullsized":"2023-11-04T01:38:07.835885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835846+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:38:07.835846+0000","last_peered":"2023-11-04T01:38:07.835846+0000","last_clean":"2023-11-04T01:38:07.835846+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:38:07.835846+0000","last_undegraded":"2023-11-04T01:38:07.835846+0000","last_fullsized":"2023-11-04T01:38:07.835846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835939+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:38:07.835939+0000","last_peered":"2023-11-04T01:38:07.835939+0000","last_clean":"2023-11-04T01:38:07.835939+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:38:07.835939+0000","last_undegraded":"2023-11-04T01:38:07.835939+0000","last_fullsized":"2023-11-04T01:38:07.835939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294774+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:38:07.294774+0000","last_peered":"2023-11-04T01:38:07.294774+0000","last_clean":"2023-11-04T01:38:07.294774+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:38:07.294774+0000","last_undegraded":"2023-11-04T01:38:07.294774+0000","last_fullsized":"2023-11-04T01:38:07.294774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.299600+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:38:07.299600+0000","last_peered":"2023-11-04T01:38:07.299600+0000","last_clean":"2023-11-04T01:38:07.299600+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:38:07.299600+0000","last_undegraded":"2023-11-04T01:38:07.299600+0000","last_fullsized":"2023-11-04T01:38:07.299600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294563+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:38:07.294563+0000","last_peered":"2023-11-04T01:38:07.294563+0000","last_clean":"2023-11-04T01:38:07.294563+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:38:07.294563+0000","last_undegraded":"2023-11-04T01:38:07.294563+0000","last_fullsized":"2023-11-04T01:38:07.294563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.299540+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:38:07.299540+0000","last_peered":"2023-11-04T01:38:07.299540+0000","last_clean":"2023-11-04T01:38:07.299540+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:38:07.299540+0000","last_undegraded":"2023-11-04T01:38:07.299540+0000","last_fullsized":"2023-11-04T01:38:07.299540+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:08.101685+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:38:08.101685+0000","last_peered":"2023-11-04T01:38:08.101685+0000","last_clean":"2023-11-04T01:38:08.101685+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:38:08.101685+0000","last_undegraded":"2023-11-04T01:38:08.101685+0000","last_fullsized":"2023-11-04T01:38:08.101685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989136+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:38:07.989136+0000","last_peered":"2023-11-04T01:38:07.989136+0000","last_clean":"2023-11-04T01:38:07.989136+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:38:07.989136+0000","last_undegraded":"2023-11-04T01:38:07.989136+0000","last_fullsized":"2023-11-04T01:38:07.989136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989767+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:38:07.989767+0000","last_peered":"2023-11-04T01:38:07.989767+0000","last_clean":"2023-11-04T01:38:07.989767+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:38:07.989767+0000","last_undegraded":"2023-11-04T01:38:07.989767+0000","last_fullsized":"2023-11-04T01:38:07.989767+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294655+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:38:07.294655+0000","last_peered":"2023-11-04T01:38:07.294655+0000","last_clean":"2023-11-04T01:38:07.294655+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:38:07.294655+0000","last_undegraded":"2023-11-04T01:38:07.294655+0000","last_fullsized":"2023-11-04T01:38:07.294655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.835924+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:38:07.835924+0000","last_peered":"2023-11-04T01:38:07.835924+0000","last_clean":"2023-11-04T01:38:07.835924+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:38:07.835924+0000","last_undegraded":"2023-11-04T01:38:07.835924+0000","last_fullsized":"2023-11-04T01:38:07.835924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.296766+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:38:07.296766+0000","last_peered":"2023-11-04T01:38:07.296766+0000","last_clean":"2023-11-04T01:38:07.296766+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:38:07.296766+0000","last_undegraded":"2023-11-04T01:38:07.296766+0000","last_fullsized":"2023-11-04T01:38:07.296766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":33,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989558+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:38:07.989558+0000","last_peered":"2023-11-04T01:38:07.989558+0000","last_clean":"2023-11-04T01:38:07.989558+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:38:07.989558+0000","last_undegraded":"2023-11-04T01:38:07.989558+0000","last_fullsized":"2023-11-04T01:38:07.989558+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989147+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:38:07.989147+0000","last_peered":"2023-11-04T01:38:07.989147+0000","last_clean":"2023-11-04T01:38:07.989147+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:38:07.989147+0000","last_undegraded":"2023-11-04T01:38:07.989147+0000","last_fullsized":"2023-11-04T01:38:07.989147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989179+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:38:07.989179+0000","last_peered":"2023-11-04T01:38:07.989179+0000","last_clean":"2023-11-04T01:38:07.989179+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:38:07.989179+0000","last_undegraded":"2023-11-04T01:38:07.989179+0000","last_fullsized":"2023-11-04T01:38:07.989179+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:11.303684+0000","last_change":"2023-11-04T01:38:11.303684+0000","last_active":"2023-11-04T01:38:11.303684+0000","last_peered":"2023-11-04T01:38:11.303684+0000","last_clean":"2023-11-04T01:38:11.303684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:11.303684+0000","last_undegraded":"2023-11-04T01:38:11.303684+0000","last_fullsized":"2023-11-04T01:38:11.303684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:10.299068+0000","last_change":"2023-11-04T01:38:10.299068+0000","last_active":"2023-11-04T01:38:10.299068+0000","last_peered":"2023-11-04T01:38:10.299068+0000","last_clean":"2023-11-04T01:38:10.299068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:10.299068+0000","last_undegraded":"2023-11-04T01:38:10.299068+0000","last_fullsized":"2023-11-04T01:38:10.299068+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.294660+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:38:07.294660+0000","last_peered":"2023-11-04T01:38:07.294660+0000","last_clean":"2023-11-04T01:38:07.294660+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:38:07.294660+0000","last_undegraded":"2023-11-04T01:38:07.294660+0000","last_fullsized":"2023-11-04T01:38:07.294660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:07.989608+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:38:07.989608+0000","last_peered":"2023-11-04T01:38:07.989608+0000","last_clean":"2023-11-04T01:38:07.989608+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:38:07.989608+0000","last_undegraded":"2023-11-04T01:38:07.989608+0000","last_fullsized":"2023-11-04T01:38:07.989608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1343488,"data_stored":932614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.38},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70599999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69699999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":0.755},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.29299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.318},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45300000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":0.872,"15min":0.872},"last":0.27500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.36099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":745472,"data_stored":341227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.89700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65100000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.81200000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.62,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.83199999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":330630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.311}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.435}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":342246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79500000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71199999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.133,"15min":1.133},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.71699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":336446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.36599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.38600000000000001,"5min":0.495,"15min":0.495},"last":0.27800000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.313},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.25900000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40799999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47099999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.438},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.33100000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78300000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.876,"15min":0.876},"last":0.377},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73799999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.50800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":342246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.33300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.378}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.42499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.371},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.46100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":342246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.501},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.55200000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.877}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.77800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1327104,"data_stored":925795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.316,"15min":0.32200000000000001},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.442,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.246}]},{"osd":2,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.36499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.318}]},{"osd":4,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.048,"15min":1.048},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57999999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.874,"15min":0.874},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:15.268 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:15.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.399+0000 7f3539b89640 1 Processor -- start 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.399+0000 7f3539b89640 1 -- start start 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3534159c70 0x7f35340ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f353406db20 0x7f35340b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35340b0910 0x7f353415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340b49b0 con 0x7f353406db20 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340b0da0 con 0x7f3534159c70 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3539b89640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b4110 con 0x7f35340b0910 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3532ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f353406db20 0x7f35340b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3532ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f353406db20 0x7f35340b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52754/0 (socket says 172.21.15.93:52754) 2023-11-04T01:38:15.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3532ffd640 1 -- 172.21.15.93:0/1732808077 learned_addr learned my addr 172.21.15.93:0/1732808077 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f3533fff640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35340b0910 0x7f353415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.400+0000 7f35337fe640 1 --2- 172.21.15.93:0/1732808077 >> v2:172.21.15.125:3300/0 conn(0x7f3534159c70 0x7f35340ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 -- 172.21.15.93:0/1732808077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35340b0910 msgr2=0x7f353415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35340b0910 0x7f353415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 -- 172.21.15.93:0/1732808077 >> v2:172.21.15.125:3300/0 conn(0x7f3534159c70 msgr2=0x7f35340ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 --2- 172.21.15.93:0/1732808077 >> v2:172.21.15.125:3300/0 conn(0x7f3534159c70 0x7f35340ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 -- 172.21.15.93:0/1732808077 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340b43f0 con 0x7f353406db20 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f3532ffd640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f353406db20 0x7f35340b03d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f35340cc440 tx=0x7f352802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736e21fe393ccdb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f35327fc640 1 -- 172.21.15.93:0/1732808077 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528031870 con 0x7f353406db20 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f35327fc640 1 -- 172.21.15.93:0/1732808077 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280319d0 con 0x7f353406db20 2023-11-04T01:38:15.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.401+0000 7f35327fc640 1 -- 172.21.15.93:0/1732808077 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528031d60 con 0x7f353406db20 2023-11-04T01:38:15.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 -- 172.21.15.93:0/1732808077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f353406db20 msgr2=0x7f35340b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f353406db20 0x7f35340b03d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f35340cc440 tx=0x7f352802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 -- 172.21.15.93:0/1732808077 shutdown_connections 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f353406db20 0x7f35340b03d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 --2- 172.21.15.93:0/1732808077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f35340b0910 0x7f353415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 --2- 172.21.15.93:0/1732808077 >> v2:172.21.15.125:3300/0 conn(0x7f3534159c70 0x7f35340ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 -- 172.21.15.93:0/1732808077 >> 172.21.15.93:0/1732808077 conn(0x7f35340ce950 msgr2=0x7f35340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 -- 172.21.15.93:0/1732808077 shutdown_connections 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.402+0000 7f3539b89640 1 -- 172.21.15.93:0/1732808077 wait complete. 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.403+0000 7f3539b89640 1 Processor -- start 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.403+0000 7f3539b89640 1 -- start start 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f353406db20 0x7f353414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 0x7f35340c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534156050 con 0x7f3534159c70 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534156330 con 0x7f35340b0910 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3539b89640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340c76d0 con 0x7f353406db20 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52756/0 (socket says 172.21.15.93:52756) 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 -- 172.21.15.93:0/4272764717 learned_addr learned my addr 172.21.15.93:0/4272764717 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f35337fe640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f353406db20 0x7f353414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3532ffd640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 0x7f35340c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 -- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f353406db20 msgr2=0x7f353414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f353406db20 0x7f353414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 -- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 msgr2=0x7f35340c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 0x7f35340c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3533fff640 1 -- 172.21.15.93:0/4272764717 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280094d0 con 0x7f3534159c70 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.404+0000 7f3532ffd640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 0x7f35340c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:15.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f3533fff640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f352c007e60 tx=0x7f352c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c014620 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c00ee90 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35340c79b0 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0149e0 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.405+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35340c73c0 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.406+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35340c7bf0 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.406+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f352c014b40 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.406+0000 7f351bfff640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 0x7f352006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.407+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f352c08a210 con 0x7f3534159c70 2023-11-04T01:38:15.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.407+0000 7f35337fe640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 0x7f352006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.407+0000 7f35337fe640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 0x7f352006d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3524006fd0 tx=0x7f3524008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.411+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35340c7bf0 con 0x7f3534159c70 2023-11-04T01:38:15.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.573+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35340cdb70 con 0x7f352006ae70 2023-11-04T01:38:15.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.582+0000 7f351bfff640 1 -- 172.21.15.93:0/4272764717 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370587 (secure 0 0 0) 0x7f352400f860 con 0x7f352006ae70 2023-11-04T01:38:15.588 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:15.590 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 msgr2=0x7f352006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 0x7f352006d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3524006fd0 tx=0x7f3524008040 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 msgr2=0x7f353414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f352c007e60 tx=0x7f352c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 shutdown_connections 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f352006ae70 0x7f352006d330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3534159c70 0x7f353414f5f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35340b0910 0x7f35340c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 --2- 172.21.15.93:0/4272764717 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f353406db20 0x7f353414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 >> 172.21.15.93:0/4272764717 conn(0x7f35340ce950 msgr2=0x7f35340b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 shutdown_connections 2023-11-04T01:38:15.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.585+0000 7f3539b89640 1 -- 172.21.15.93:0/4272764717 wait complete. 2023-11-04T01:38:15.599 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-04T01:38:15.356082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":241,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227784,"kb_used_data":7420,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746936,"statfs":{"total":773094113280,"available":772860862464,"internally_reserved":0,"allocated":7598080,"data_stored":4123439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.051691"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038925+0000","last_change":"2023-11-04T01:38:12.048047+0000","last_active":"2023-11-04T01:38:13.038925+0000","last_peered":"2023-11-04T01:38:13.038925+0000","last_clean":"2023-11-04T01:38:13.038925+0000","last_became_active":"2023-11-04T01:38:12.047778+0000","last_became_peered":"2023-11-04T01:38:12.047778+0000","last_unstale":"2023-11-04T01:38:13.038925+0000","last_undegraded":"2023-11-04T01:38:13.038925+0000","last_fullsized":"2023-11-04T01:38:13.038925+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:22.012947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741758+0000","last_change":"2023-11-04T01:38:12.056999+0000","last_active":"2023-11-04T01:38:13.741758+0000","last_peered":"2023-11-04T01:38:13.741758+0000","last_clean":"2023-11-04T01:38:13.741758+0000","last_became_active":"2023-11-04T01:38:12.055765+0000","last_became_peered":"2023-11-04T01:38:12.055765+0000","last_unstale":"2023-11-04T01:38:13.741758+0000","last_undegraded":"2023-11-04T01:38:13.741758+0000","last_fullsized":"2023-11-04T01:38:13.741758+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:08.617317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090465+0000","last_change":"2023-11-04T01:38:12.041848+0000","last_active":"2023-11-04T01:38:13.090465+0000","last_peered":"2023-11-04T01:38:13.090465+0000","last_clean":"2023-11-04T01:38:13.090465+0000","last_became_active":"2023-11-04T01:38:12.041528+0000","last_became_peered":"2023-11-04T01:38:12.041528+0000","last_unstale":"2023-11-04T01:38:13.090465+0000","last_undegraded":"2023-11-04T01:38:13.090465+0000","last_fullsized":"2023-11-04T01:38:13.090465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:33:39.160154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740668+0000","last_change":"2023-11-04T01:38:12.048750+0000","last_active":"2023-11-04T01:38:13.740668+0000","last_peered":"2023-11-04T01:38:13.740668+0000","last_clean":"2023-11-04T01:38:13.740668+0000","last_became_active":"2023-11-04T01:38:12.048505+0000","last_became_peered":"2023-11-04T01:38:12.048505+0000","last_unstale":"2023-11-04T01:38:13.740668+0000","last_undegraded":"2023-11-04T01:38:13.740668+0000","last_fullsized":"2023-11-04T01:38:13.740668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:14.674258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.164888+0000","last_change":"2023-11-04T01:38:12.052483+0000","last_active":"2023-11-04T01:38:13.164888+0000","last_peered":"2023-11-04T01:38:13.164888+0000","last_clean":"2023-11-04T01:38:13.164888+0000","last_became_active":"2023-11-04T01:38:12.052242+0000","last_became_peered":"2023-11-04T01:38:12.052242+0000","last_unstale":"2023-11-04T01:38:13.164888+0000","last_undegraded":"2023-11-04T01:38:13.164888+0000","last_fullsized":"2023-11-04T01:38:13.164888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:11.635511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741077+0000","last_change":"2023-11-04T01:38:12.057637+0000","last_active":"2023-11-04T01:38:13.741077+0000","last_peered":"2023-11-04T01:38:13.741077+0000","last_clean":"2023-11-04T01:38:13.741077+0000","last_became_active":"2023-11-04T01:38:12.057350+0000","last_became_peered":"2023-11-04T01:38:12.057350+0000","last_unstale":"2023-11-04T01:38:13.741077+0000","last_undegraded":"2023-11-04T01:38:13.741077+0000","last_fullsized":"2023-11-04T01:38:13.741077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:22.600501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740498+0000","last_change":"2023-11-04T01:38:12.045773+0000","last_active":"2023-11-04T01:38:13.740498+0000","last_peered":"2023-11-04T01:38:13.740498+0000","last_clean":"2023-11-04T01:38:13.740498+0000","last_became_active":"2023-11-04T01:38:12.045465+0000","last_became_peered":"2023-11-04T01:38:12.045465+0000","last_unstale":"2023-11-04T01:38:13.740498+0000","last_undegraded":"2023-11-04T01:38:13.740498+0000","last_fullsized":"2023-11-04T01:38:13.740498+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:46.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741549+0000","last_change":"2023-11-04T01:38:12.049806+0000","last_active":"2023-11-04T01:38:13.741549+0000","last_peered":"2023-11-04T01:38:13.741549+0000","last_clean":"2023-11-04T01:38:13.741549+0000","last_became_active":"2023-11-04T01:38:12.049543+0000","last_became_peered":"2023-11-04T01:38:12.049543+0000","last_unstale":"2023-11-04T01:38:13.741549+0000","last_undegraded":"2023-11-04T01:38:13.741549+0000","last_fullsized":"2023-11-04T01:38:13.741549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:06.766462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165132+0000","last_change":"2023-11-04T01:38:12.048811+0000","last_active":"2023-11-04T01:38:13.165132+0000","last_peered":"2023-11-04T01:38:13.165132+0000","last_clean":"2023-11-04T01:38:13.165132+0000","last_became_active":"2023-11-04T01:38:12.048509+0000","last_became_peered":"2023-11-04T01:38:12.048509+0000","last_unstale":"2023-11-04T01:38:13.165132+0000","last_undegraded":"2023-11-04T01:38:13.165132+0000","last_fullsized":"2023-11-04T01:38:13.165132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:00.072924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039291+0000","last_change":"2023-11-04T01:38:12.048138+0000","last_active":"2023-11-04T01:38:13.039291+0000","last_peered":"2023-11-04T01:38:13.039291+0000","last_clean":"2023-11-04T01:38:13.039291+0000","last_became_active":"2023-11-04T01:38:12.047856+0000","last_became_peered":"2023-11-04T01:38:12.047856+0000","last_unstale":"2023-11-04T01:38:13.039291+0000","last_undegraded":"2023-11-04T01:38:13.039291+0000","last_fullsized":"2023-11-04T01:38:13.039291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:48.367263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038963+0000","last_change":"2023-11-04T01:38:12.045006+0000","last_active":"2023-11-04T01:38:13.038963+0000","last_peered":"2023-11-04T01:38:13.038963+0000","last_clean":"2023-11-04T01:38:13.038963+0000","last_became_active":"2023-11-04T01:38:12.044637+0000","last_became_peered":"2023-11-04T01:38:12.044637+0000","last_unstale":"2023-11-04T01:38:13.038963+0000","last_undegraded":"2023-11-04T01:38:13.038963+0000","last_fullsized":"2023-11-04T01:38:13.038963+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:49.471181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740696+0000","last_change":"2023-11-04T01:38:12.047084+0000","last_active":"2023-11-04T01:38:13.740696+0000","last_peered":"2023-11-04T01:38:13.740696+0000","last_clean":"2023-11-04T01:38:13.740696+0000","last_became_active":"2023-11-04T01:38:12.046806+0000","last_became_peered":"2023-11-04T01:38:12.046806+0000","last_unstale":"2023-11-04T01:38:13.740696+0000","last_undegraded":"2023-11-04T01:38:13.740696+0000","last_fullsized":"2023-11-04T01:38:13.740696+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:19.787373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.040012+0000","last_change":"2023-11-04T01:38:12.052457+0000","last_active":"2023-11-04T01:38:13.040012+0000","last_peered":"2023-11-04T01:38:13.040012+0000","last_clean":"2023-11-04T01:38:13.040012+0000","last_became_active":"2023-11-04T01:38:12.052147+0000","last_became_peered":"2023-11-04T01:38:12.052147+0000","last_unstale":"2023-11-04T01:38:13.040012+0000","last_undegraded":"2023-11-04T01:38:13.040012+0000","last_fullsized":"2023-11-04T01:38:13.040012+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.514839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165130+0000","last_change":"2023-11-04T01:38:12.048994+0000","last_active":"2023-11-04T01:38:13.165130+0000","last_peered":"2023-11-04T01:38:13.165130+0000","last_clean":"2023-11-04T01:38:13.165130+0000","last_became_active":"2023-11-04T01:38:12.048649+0000","last_became_peered":"2023-11-04T01:38:12.048649+0000","last_unstale":"2023-11-04T01:38:13.165130+0000","last_undegraded":"2023-11-04T01:38:13.165130+0000","last_fullsized":"2023-11-04T01:38:13.165130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:27.684312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039828+0000","last_change":"2023-11-04T01:38:12.046400+0000","last_active":"2023-11-04T01:38:13.039828+0000","last_peered":"2023-11-04T01:38:13.039828+0000","last_clean":"2023-11-04T01:38:13.039828+0000","last_became_active":"2023-11-04T01:38:12.046118+0000","last_became_peered":"2023-11-04T01:38:12.046118+0000","last_unstale":"2023-11-04T01:38:13.039828+0000","last_undegraded":"2023-11-04T01:38:13.039828+0000","last_fullsized":"2023-11-04T01:38:13.039828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:46.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038029+0000","last_change":"2023-11-04T01:38:12.050715+0000","last_active":"2023-11-04T01:38:13.038029+0000","last_peered":"2023-11-04T01:38:13.038029+0000","last_clean":"2023-11-04T01:38:13.038029+0000","last_became_active":"2023-11-04T01:38:12.050431+0000","last_became_peered":"2023-11-04T01:38:12.050431+0000","last_unstale":"2023-11-04T01:38:13.038029+0000","last_undegraded":"2023-11-04T01:38:13.038029+0000","last_fullsized":"2023-11-04T01:38:13.038029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:08.895838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165198+0000","last_change":"2023-11-04T01:38:12.045289+0000","last_active":"2023-11-04T01:38:13.165198+0000","last_peered":"2023-11-04T01:38:13.165198+0000","last_clean":"2023-11-04T01:38:13.165198+0000","last_became_active":"2023-11-04T01:38:12.045057+0000","last_became_peered":"2023-11-04T01:38:12.045057+0000","last_unstale":"2023-11-04T01:38:13.165198+0000","last_undegraded":"2023-11-04T01:38:13.165198+0000","last_fullsized":"2023-11-04T01:38:13.165198+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:38.848684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740769+0000","last_change":"2023-11-04T01:38:12.055679+0000","last_active":"2023-11-04T01:38:13.740769+0000","last_peered":"2023-11-04T01:38:13.740769+0000","last_clean":"2023-11-04T01:38:13.740769+0000","last_became_active":"2023-11-04T01:38:12.055446+0000","last_became_peered":"2023-11-04T01:38:12.055446+0000","last_unstale":"2023-11-04T01:38:13.740769+0000","last_undegraded":"2023-11-04T01:38:13.740769+0000","last_fullsized":"2023-11-04T01:38:13.740769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:22.600501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741724+0000","last_change":"2023-11-04T01:38:12.049051+0000","last_active":"2023-11-04T01:38:13.741724+0000","last_peered":"2023-11-04T01:38:13.741724+0000","last_clean":"2023-11-04T01:38:13.741724+0000","last_became_active":"2023-11-04T01:38:12.048783+0000","last_became_peered":"2023-11-04T01:38:12.048783+0000","last_unstale":"2023-11-04T01:38:13.741724+0000","last_undegraded":"2023-11-04T01:38:13.741724+0000","last_fullsized":"2023-11-04T01:38:13.741724+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:08.895838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039996+0000","last_change":"2023-11-04T01:38:12.051600+0000","last_active":"2023-11-04T01:38:13.039996+0000","last_peered":"2023-11-04T01:38:13.039996+0000","last_clean":"2023-11-04T01:38:13.039996+0000","last_became_active":"2023-11-04T01:38:12.051353+0000","last_became_peered":"2023-11-04T01:38:12.051353+0000","last_unstale":"2023-11-04T01:38:13.039996+0000","last_undegraded":"2023-11-04T01:38:13.039996+0000","last_fullsized":"2023-11-04T01:38:13.039996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:25.821449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038749+0000","last_change":"2023-11-04T01:38:12.042612+0000","last_active":"2023-11-04T01:38:13.038749+0000","last_peered":"2023-11-04T01:38:13.038749+0000","last_clean":"2023-11-04T01:38:13.038749+0000","last_became_active":"2023-11-04T01:38:12.042336+0000","last_became_peered":"2023-11-04T01:38:12.042336+0000","last_unstale":"2023-11-04T01:38:13.038749+0000","last_undegraded":"2023-11-04T01:38:13.038749+0000","last_fullsized":"2023-11-04T01:38:13.038749+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:53:08.522037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038529+0000","last_change":"2023-11-04T01:38:12.048722+0000","last_active":"2023-11-04T01:38:13.038529+0000","last_peered":"2023-11-04T01:38:13.038529+0000","last_clean":"2023-11-04T01:38:13.038529+0000","last_became_active":"2023-11-04T01:38:12.048464+0000","last_became_peered":"2023-11-04T01:38:12.048464+0000","last_unstale":"2023-11-04T01:38:13.038529+0000","last_undegraded":"2023-11-04T01:38:13.038529+0000","last_fullsized":"2023-11-04T01:38:13.038529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:08.617317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038382+0000","last_change":"2023-11-04T01:38:12.046216+0000","last_active":"2023-11-04T01:38:13.038382+0000","last_peered":"2023-11-04T01:38:13.038382+0000","last_clean":"2023-11-04T01:38:13.038382+0000","last_became_active":"2023-11-04T01:38:12.045778+0000","last_became_peered":"2023-11-04T01:38:12.045778+0000","last_unstale":"2023-11-04T01:38:13.038382+0000","last_undegraded":"2023-11-04T01:38:13.038382+0000","last_fullsized":"2023-11-04T01:38:13.038382+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.514839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039500+0000","last_change":"2023-11-04T01:38:12.056212+0000","last_active":"2023-11-04T01:38:13.039500+0000","last_peered":"2023-11-04T01:38:13.039500+0000","last_clean":"2023-11-04T01:38:13.039500+0000","last_became_active":"2023-11-04T01:38:12.055666+0000","last_became_peered":"2023-11-04T01:38:12.055666+0000","last_unstale":"2023-11-04T01:38:13.039500+0000","last_undegraded":"2023-11-04T01:38:13.039500+0000","last_fullsized":"2023-11-04T01:38:13.039500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:04.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039157+0000","last_change":"2023-11-04T01:38:12.050098+0000","last_active":"2023-11-04T01:38:13.039157+0000","last_peered":"2023-11-04T01:38:13.039157+0000","last_clean":"2023-11-04T01:38:13.039157+0000","last_became_active":"2023-11-04T01:38:12.049834+0000","last_became_peered":"2023-11-04T01:38:12.049834+0000","last_unstale":"2023-11-04T01:38:13.039157+0000","last_undegraded":"2023-11-04T01:38:13.039157+0000","last_fullsized":"2023-11-04T01:38:13.039157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:22.166648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741226+0000","last_change":"2023-11-04T01:38:12.056310+0000","last_active":"2023-11-04T01:38:13.741226+0000","last_peered":"2023-11-04T01:38:13.741226+0000","last_clean":"2023-11-04T01:38:13.741226+0000","last_became_active":"2023-11-04T01:38:12.055772+0000","last_became_peered":"2023-11-04T01:38:12.055772+0000","last_unstale":"2023-11-04T01:38:13.741226+0000","last_undegraded":"2023-11-04T01:38:13.741226+0000","last_fullsized":"2023-11-04T01:38:13.741226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:22.012947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090639+0000","last_change":"2023-11-04T01:38:12.048704+0000","last_active":"2023-11-04T01:38:13.090639+0000","last_peered":"2023-11-04T01:38:13.090639+0000","last_clean":"2023-11-04T01:38:13.090639+0000","last_became_active":"2023-11-04T01:38:12.048444+0000","last_became_peered":"2023-11-04T01:38:12.048444+0000","last_unstale":"2023-11-04T01:38:13.090639+0000","last_undegraded":"2023-11-04T01:38:13.090639+0000","last_fullsized":"2023-11-04T01:38:13.090639+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:16:54.444708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038950+0000","last_change":"2023-11-04T01:38:12.046470+0000","last_active":"2023-11-04T01:38:13.038950+0000","last_peered":"2023-11-04T01:38:13.038950+0000","last_clean":"2023-11-04T01:38:13.038950+0000","last_became_active":"2023-11-04T01:38:12.046195+0000","last_became_peered":"2023-11-04T01:38:12.046195+0000","last_unstale":"2023-11-04T01:38:13.038950+0000","last_undegraded":"2023-11-04T01:38:13.038950+0000","last_fullsized":"2023-11-04T01:38:13.038950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:41:52.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090380+0000","last_change":"2023-11-04T01:38:12.052937+0000","last_active":"2023-11-04T01:38:13.090380+0000","last_peered":"2023-11-04T01:38:13.090380+0000","last_clean":"2023-11-04T01:38:13.090380+0000","last_became_active":"2023-11-04T01:38:12.052576+0000","last_became_peered":"2023-11-04T01:38:12.052576+0000","last_unstale":"2023-11-04T01:38:13.090380+0000","last_undegraded":"2023-11-04T01:38:13.090380+0000","last_fullsized":"2023-11-04T01:38:13.090380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:08.009788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740646+0000","last_change":"2023-11-04T01:38:12.050568+0000","last_active":"2023-11-04T01:38:13.740646+0000","last_peered":"2023-11-04T01:38:13.740646+0000","last_clean":"2023-11-04T01:38:13.740646+0000","last_became_active":"2023-11-04T01:38:12.050303+0000","last_became_peered":"2023-11-04T01:38:12.050303+0000","last_unstale":"2023-11-04T01:38:13.740646+0000","last_undegraded":"2023-11-04T01:38:13.740646+0000","last_fullsized":"2023-11-04T01:38:13.740646+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:39.514839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740641+0000","last_change":"2023-11-04T01:38:12.046497+0000","last_active":"2023-11-04T01:38:13.740641+0000","last_peered":"2023-11-04T01:38:13.740641+0000","last_clean":"2023-11-04T01:38:13.740641+0000","last_became_active":"2023-11-04T01:38:12.046201+0000","last_became_peered":"2023-11-04T01:38:12.046201+0000","last_unstale":"2023-11-04T01:38:13.740641+0000","last_undegraded":"2023-11-04T01:38:13.740641+0000","last_fullsized":"2023-11-04T01:38:13.740641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:25.821449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741075+0000","last_change":"2023-11-04T01:38:12.048662+0000","last_active":"2023-11-04T01:38:13.741075+0000","last_peered":"2023-11-04T01:38:13.741075+0000","last_clean":"2023-11-04T01:38:13.741075+0000","last_became_active":"2023-11-04T01:38:12.048337+0000","last_became_peered":"2023-11-04T01:38:12.048337+0000","last_unstale":"2023-11-04T01:38:13.741075+0000","last_undegraded":"2023-11-04T01:38:13.741075+0000","last_fullsized":"2023-11-04T01:38:13.741075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:19.787373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.164791+0000","last_change":"2023-11-04T01:38:12.045352+0000","last_active":"2023-11-04T01:38:13.164791+0000","last_peered":"2023-11-04T01:38:13.164791+0000","last_clean":"2023-11-04T01:38:13.164791+0000","last_became_active":"2023-11-04T01:38:12.045122+0000","last_became_peered":"2023-11-04T01:38:12.045122+0000","last_unstale":"2023-11-04T01:38:13.164791+0000","last_undegraded":"2023-11-04T01:38:13.164791+0000","last_fullsized":"2023-11-04T01:38:13.164791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:15:09.831052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038133+0000","last_change":"2023-11-04T01:38:11.324662+0000","last_active":"2023-11-04T01:38:13.038133+0000","last_peered":"2023-11-04T01:38:13.038133+0000","last_clean":"2023-11-04T01:38:13.038133+0000","last_became_active":"2023-11-04T01:38:11.324406+0000","last_became_peered":"2023-11-04T01:38:11.324406+0000","last_unstale":"2023-11-04T01:38:13.038133+0000","last_undegraded":"2023-11-04T01:38:13.038133+0000","last_fullsized":"2023-11-04T01:38:13.038133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:06.490586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.035938+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:38:12.035938+0000","last_peered":"2023-11-04T01:38:12.035938+0000","last_clean":"2023-11-04T01:38:12.035938+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:38:12.035938+0000","last_undegraded":"2023-11-04T01:38:12.035938+0000","last_fullsized":"2023-11-04T01:38:12.035938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039822+0000","last_change":"2023-11-04T01:38:12.050920+0000","last_active":"2023-11-04T01:38:13.039822+0000","last_peered":"2023-11-04T01:38:13.039822+0000","last_clean":"2023-11-04T01:38:13.039822+0000","last_became_active":"2023-11-04T01:38:12.050666+0000","last_became_peered":"2023-11-04T01:38:12.050666+0000","last_unstale":"2023-11-04T01:38:13.039822+0000","last_undegraded":"2023-11-04T01:38:13.039822+0000","last_fullsized":"2023-11-04T01:38:13.039822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:48.827629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740571+0000","last_change":"2023-11-04T01:38:11.326598+0000","last_active":"2023-11-04T01:38:13.740571+0000","last_peered":"2023-11-04T01:38:13.740571+0000","last_clean":"2023-11-04T01:38:13.740571+0000","last_became_active":"2023-11-04T01:38:11.326334+0000","last_became_peered":"2023-11-04T01:38:11.326334+0000","last_unstale":"2023-11-04T01:38:13.740571+0000","last_undegraded":"2023-11-04T01:38:13.740571+0000","last_fullsized":"2023-11-04T01:38:13.740571+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:33.404727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.041305+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:38:12.041305+0000","last_peered":"2023-11-04T01:38:12.041305+0000","last_clean":"2023-11-04T01:38:12.041305+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:38:12.041305+0000","last_undegraded":"2023-11-04T01:38:12.041305+0000","last_fullsized":"2023-11-04T01:38:12.041305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741783+0000","last_change":"2023-11-04T01:38:12.055287+0000","last_active":"2023-11-04T01:38:13.741783+0000","last_peered":"2023-11-04T01:38:13.741783+0000","last_clean":"2023-11-04T01:38:13.741783+0000","last_became_active":"2023-11-04T01:38:12.055019+0000","last_became_peered":"2023-11-04T01:38:12.055019+0000","last_unstale":"2023-11-04T01:38:13.741783+0000","last_undegraded":"2023-11-04T01:38:13.741783+0000","last_fullsized":"2023-11-04T01:38:13.741783+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:27.704913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741181+0000","last_change":"2023-11-04T01:38:11.324265+0000","last_active":"2023-11-04T01:38:13.741181+0000","last_peered":"2023-11-04T01:38:13.741181+0000","last_clean":"2023-11-04T01:38:13.741181+0000","last_became_active":"2023-11-04T01:38:11.323995+0000","last_became_peered":"2023-11-04T01:38:11.323995+0000","last_unstale":"2023-11-04T01:38:13.741181+0000","last_undegraded":"2023-11-04T01:38:13.741181+0000","last_fullsized":"2023-11-04T01:38:13.741181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:57.510347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.044801+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:38:12.044801+0000","last_peered":"2023-11-04T01:38:12.044801+0000","last_clean":"2023-11-04T01:38:12.044801+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:38:12.044801+0000","last_undegraded":"2023-11-04T01:38:12.044801+0000","last_fullsized":"2023-11-04T01:38:12.044801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038106+0000","last_change":"2023-11-04T01:38:12.048261+0000","last_active":"2023-11-04T01:38:13.038106+0000","last_peered":"2023-11-04T01:38:13.038106+0000","last_clean":"2023-11-04T01:38:13.038106+0000","last_became_active":"2023-11-04T01:38:12.047984+0000","last_became_peered":"2023-11-04T01:38:12.047984+0000","last_unstale":"2023-11-04T01:38:13.038106+0000","last_undegraded":"2023-11-04T01:38:13.038106+0000","last_fullsized":"2023-11-04T01:38:13.038106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:46.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740556+0000","last_change":"2023-11-04T01:38:11.324661+0000","last_active":"2023-11-04T01:38:13.740556+0000","last_peered":"2023-11-04T01:38:13.740556+0000","last_clean":"2023-11-04T01:38:13.740556+0000","last_became_active":"2023-11-04T01:38:11.324348+0000","last_became_peered":"2023-11-04T01:38:11.324348+0000","last_unstale":"2023-11-04T01:38:13.740556+0000","last_undegraded":"2023-11-04T01:38:13.740556+0000","last_fullsized":"2023-11-04T01:38:13.740556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:26:00.986278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.036154+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:38:12.036154+0000","last_peered":"2023-11-04T01:38:12.036154+0000","last_clean":"2023-11-04T01:38:12.036154+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:38:12.036154+0000","last_undegraded":"2023-11-04T01:38:12.036154+0000","last_fullsized":"2023-11-04T01:38:12.036154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.164918+0000","last_change":"2023-11-04T01:38:12.046008+0000","last_active":"2023-11-04T01:38:13.164918+0000","last_peered":"2023-11-04T01:38:13.164918+0000","last_clean":"2023-11-04T01:38:13.164918+0000","last_became_active":"2023-11-04T01:38:12.045743+0000","last_became_peered":"2023-11-04T01:38:12.045743+0000","last_unstale":"2023-11-04T01:38:13.164918+0000","last_undegraded":"2023-11-04T01:38:13.164918+0000","last_fullsized":"2023-11-04T01:38:13.164918+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:47.015281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740803+0000","last_change":"2023-11-04T01:38:11.325069+0000","last_active":"2023-11-04T01:38:13.740803+0000","last_peered":"2023-11-04T01:38:13.740803+0000","last_clean":"2023-11-04T01:38:13.740803+0000","last_became_active":"2023-11-04T01:38:11.324813+0000","last_became_peered":"2023-11-04T01:38:11.324813+0000","last_unstale":"2023-11-04T01:38:13.740803+0000","last_undegraded":"2023-11-04T01:38:13.740803+0000","last_fullsized":"2023-11-04T01:38:13.740803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:06.490586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.041444+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:38:12.041444+0000","last_peered":"2023-11-04T01:38:12.041444+0000","last_clean":"2023-11-04T01:38:12.041444+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:38:12.041444+0000","last_undegraded":"2023-11-04T01:38:12.041444+0000","last_fullsized":"2023-11-04T01:38:12.041444+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741374+0000","last_change":"2023-11-04T01:38:12.056847+0000","last_active":"2023-11-04T01:38:13.741374+0000","last_peered":"2023-11-04T01:38:13.741374+0000","last_clean":"2023-11-04T01:38:13.741374+0000","last_became_active":"2023-11-04T01:38:12.055934+0000","last_became_peered":"2023-11-04T01:38:12.055934+0000","last_unstale":"2023-11-04T01:38:13.741374+0000","last_undegraded":"2023-11-04T01:38:13.741374+0000","last_fullsized":"2023-11-04T01:38:13.741374+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:41.072317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090601+0000","last_change":"2023-11-04T01:38:11.320446+0000","last_active":"2023-11-04T01:38:13.090601+0000","last_peered":"2023-11-04T01:38:13.090601+0000","last_clean":"2023-11-04T01:38:13.090601+0000","last_became_active":"2023-11-04T01:38:11.320184+0000","last_became_peered":"2023-11-04T01:38:11.320184+0000","last_unstale":"2023-11-04T01:38:13.090601+0000","last_undegraded":"2023-11-04T01:38:13.090601+0000","last_fullsized":"2023-11-04T01:38:13.090601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:56.142208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033022+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:38:12.033022+0000","last_peered":"2023-11-04T01:38:12.033022+0000","last_clean":"2023-11-04T01:38:12.033022+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:38:12.033022+0000","last_undegraded":"2023-11-04T01:38:12.033022+0000","last_fullsized":"2023-11-04T01:38:12.033022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039058+0000","last_change":"2023-11-04T01:38:12.049478+0000","last_active":"2023-11-04T01:38:13.039058+0000","last_peered":"2023-11-04T01:38:13.039058+0000","last_clean":"2023-11-04T01:38:13.039058+0000","last_became_active":"2023-11-04T01:38:12.049181+0000","last_became_peered":"2023-11-04T01:38:12.049181+0000","last_unstale":"2023-11-04T01:38:13.039058+0000","last_undegraded":"2023-11-04T01:38:13.039058+0000","last_fullsized":"2023-11-04T01:38:13.039058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:27.704913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741764+0000","last_change":"2023-11-04T01:38:11.329222+0000","last_active":"2023-11-04T01:38:13.741764+0000","last_peered":"2023-11-04T01:38:13.741764+0000","last_clean":"2023-11-04T01:38:13.741764+0000","last_became_active":"2023-11-04T01:38:11.328925+0000","last_became_peered":"2023-11-04T01:38:11.328925+0000","last_unstale":"2023-11-04T01:38:13.741764+0000","last_undegraded":"2023-11-04T01:38:13.741764+0000","last_fullsized":"2023-11-04T01:38:13.741764+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:29:20.255410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033355+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:38:12.033355+0000","last_peered":"2023-11-04T01:38:12.033355+0000","last_clean":"2023-11-04T01:38:12.033355+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:38:12.033355+0000","last_undegraded":"2023-11-04T01:38:12.033355+0000","last_fullsized":"2023-11-04T01:38:12.033355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741378+0000","last_change":"2023-11-04T01:38:12.052463+0000","last_active":"2023-11-04T01:38:13.741378+0000","last_peered":"2023-11-04T01:38:13.741378+0000","last_clean":"2023-11-04T01:38:13.741378+0000","last_became_active":"2023-11-04T01:38:12.052190+0000","last_became_peered":"2023-11-04T01:38:12.052190+0000","last_unstale":"2023-11-04T01:38:13.741378+0000","last_undegraded":"2023-11-04T01:38:13.741378+0000","last_fullsized":"2023-11-04T01:38:13.741378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:49.471181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039254+0000","last_change":"2023-11-04T01:38:11.316110+0000","last_active":"2023-11-04T01:38:13.039254+0000","last_peered":"2023-11-04T01:38:13.039254+0000","last_clean":"2023-11-04T01:38:13.039254+0000","last_became_active":"2023-11-04T01:38:11.315792+0000","last_became_peered":"2023-11-04T01:38:11.315792+0000","last_unstale":"2023-11-04T01:38:13.039254+0000","last_undegraded":"2023-11-04T01:38:13.039254+0000","last_fullsized":"2023-11-04T01:38:13.039254+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:49.381238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.036091+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:38:12.036091+0000","last_peered":"2023-11-04T01:38:12.036091+0000","last_clean":"2023-11-04T01:38:12.036091+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:38:12.036091+0000","last_undegraded":"2023-11-04T01:38:12.036091+0000","last_fullsized":"2023-11-04T01:38:12.036091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039804+0000","last_change":"2023-11-04T01:38:12.042637+0000","last_active":"2023-11-04T01:38:13.039804+0000","last_peered":"2023-11-04T01:38:13.039804+0000","last_clean":"2023-11-04T01:38:13.039804+0000","last_became_active":"2023-11-04T01:38:12.042382+0000","last_became_peered":"2023-11-04T01:38:12.042382+0000","last_unstale":"2023-11-04T01:38:13.039804+0000","last_undegraded":"2023-11-04T01:38:13.039804+0000","last_fullsized":"2023-11-04T01:38:13.039804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:07.207212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.164681+0000","last_change":"2023-11-04T01:38:11.325740+0000","last_active":"2023-11-04T01:38:13.164681+0000","last_peered":"2023-11-04T01:38:13.164681+0000","last_clean":"2023-11-04T01:38:13.164681+0000","last_became_active":"2023-11-04T01:38:11.323946+0000","last_became_peered":"2023-11-04T01:38:11.323946+0000","last_unstale":"2023-11-04T01:38:13.164681+0000","last_undegraded":"2023-11-04T01:38:13.164681+0000","last_fullsized":"2023-11-04T01:38:13.164681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:41.123191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.035530+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:38:12.035530+0000","last_peered":"2023-11-04T01:38:12.035530+0000","last_clean":"2023-11-04T01:38:12.035530+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:38:12.035530+0000","last_undegraded":"2023-11-04T01:38:12.035530+0000","last_fullsized":"2023-11-04T01:38:12.035530+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.164725+0000","last_change":"2023-11-04T01:38:12.054910+0000","last_active":"2023-11-04T01:38:13.164725+0000","last_peered":"2023-11-04T01:38:13.164725+0000","last_clean":"2023-11-04T01:38:13.164725+0000","last_became_active":"2023-11-04T01:38:12.054724+0000","last_became_peered":"2023-11-04T01:38:12.054724+0000","last_unstale":"2023-11-04T01:38:13.164725+0000","last_undegraded":"2023-11-04T01:38:13.164725+0000","last_fullsized":"2023-11-04T01:38:13.164725+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:18.482759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740461+0000","last_change":"2023-11-04T01:38:11.321459+0000","last_active":"2023-11-04T01:38:13.740461+0000","last_peered":"2023-11-04T01:38:13.740461+0000","last_clean":"2023-11-04T01:38:13.740461+0000","last_became_active":"2023-11-04T01:38:11.321211+0000","last_became_peered":"2023-11-04T01:38:11.321211+0000","last_unstale":"2023-11-04T01:38:13.740461+0000","last_undegraded":"2023-11-04T01:38:13.740461+0000","last_fullsized":"2023-11-04T01:38:13.740461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:09.541710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038276+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:38:12.038276+0000","last_peered":"2023-11-04T01:38:12.038276+0000","last_clean":"2023-11-04T01:38:12.038276+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:38:12.038276+0000","last_undegraded":"2023-11-04T01:38:12.038276+0000","last_fullsized":"2023-11-04T01:38:12.038276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038870+0000","last_change":"2023-11-04T01:38:12.050327+0000","last_active":"2023-11-04T01:38:13.038870+0000","last_peered":"2023-11-04T01:38:13.038870+0000","last_clean":"2023-11-04T01:38:13.038870+0000","last_became_active":"2023-11-04T01:38:12.049977+0000","last_became_peered":"2023-11-04T01:38:12.049977+0000","last_unstale":"2023-11-04T01:38:13.038870+0000","last_undegraded":"2023-11-04T01:38:13.038870+0000","last_fullsized":"2023-11-04T01:38:13.038870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:41.955237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741333+0000","last_change":"2023-11-04T01:38:11.328603+0000","last_active":"2023-11-04T01:38:13.741333+0000","last_peered":"2023-11-04T01:38:13.741333+0000","last_clean":"2023-11-04T01:38:13.741333+0000","last_became_active":"2023-11-04T01:38:11.328161+0000","last_became_peered":"2023-11-04T01:38:11.328161+0000","last_unstale":"2023-11-04T01:38:13.741333+0000","last_undegraded":"2023-11-04T01:38:13.741333+0000","last_fullsized":"2023-11-04T01:38:13.741333+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:43.096938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.037519+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:38:12.037519+0000","last_peered":"2023-11-04T01:38:12.037519+0000","last_clean":"2023-11-04T01:38:12.037519+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:38:12.037519+0000","last_undegraded":"2023-11-04T01:38:12.037519+0000","last_fullsized":"2023-11-04T01:38:12.037519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740989+0000","last_change":"2023-11-04T01:38:12.047621+0000","last_active":"2023-11-04T01:38:13.740989+0000","last_peered":"2023-11-04T01:38:13.740989+0000","last_clean":"2023-11-04T01:38:13.740989+0000","last_became_active":"2023-11-04T01:38:12.047310+0000","last_became_peered":"2023-11-04T01:38:12.047310+0000","last_unstale":"2023-11-04T01:38:13.740989+0000","last_undegraded":"2023-11-04T01:38:13.740989+0000","last_fullsized":"2023-11-04T01:38:13.740989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:16.739923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090584+0000","last_change":"2023-11-04T01:38:11.318299+0000","last_active":"2023-11-04T01:38:13.090584+0000","last_peered":"2023-11-04T01:38:13.090584+0000","last_clean":"2023-11-04T01:38:13.090584+0000","last_became_active":"2023-11-04T01:38:11.317840+0000","last_became_peered":"2023-11-04T01:38:11.317840+0000","last_unstale":"2023-11-04T01:38:13.090584+0000","last_undegraded":"2023-11-04T01:38:13.090584+0000","last_fullsized":"2023-11-04T01:38:13.090584+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:05.079340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.037163+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:38:12.037163+0000","last_peered":"2023-11-04T01:38:12.037163+0000","last_clean":"2023-11-04T01:38:12.037163+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:38:12.037163+0000","last_undegraded":"2023-11-04T01:38:12.037163+0000","last_fullsized":"2023-11-04T01:38:12.037163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039101+0000","last_change":"2023-11-04T01:38:12.038125+0000","last_active":"2023-11-04T01:38:13.039101+0000","last_peered":"2023-11-04T01:38:13.039101+0000","last_clean":"2023-11-04T01:38:13.039101+0000","last_became_active":"2023-11-04T01:38:12.037667+0000","last_became_peered":"2023-11-04T01:38:12.037667+0000","last_unstale":"2023-11-04T01:38:13.039101+0000","last_undegraded":"2023-11-04T01:38:13.039101+0000","last_fullsized":"2023-11-04T01:38:13.039101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:25.383541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741446+0000","last_change":"2023-11-04T01:38:11.324744+0000","last_active":"2023-11-04T01:38:13.741446+0000","last_peered":"2023-11-04T01:38:13.741446+0000","last_clean":"2023-11-04T01:38:13.741446+0000","last_became_active":"2023-11-04T01:38:11.324327+0000","last_became_peered":"2023-11-04T01:38:11.324327+0000","last_unstale":"2023-11-04T01:38:13.741446+0000","last_undegraded":"2023-11-04T01:38:13.741446+0000","last_fullsized":"2023-11-04T01:38:13.741446+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:09.541710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.037316+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:38:12.037316+0000","last_peered":"2023-11-04T01:38:12.037316+0000","last_clean":"2023-11-04T01:38:12.037316+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:38:12.037316+0000","last_undegraded":"2023-11-04T01:38:12.037316+0000","last_fullsized":"2023-11-04T01:38:12.037316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741338+0000","last_change":"2023-11-04T01:38:12.053329+0000","last_active":"2023-11-04T01:38:13.741338+0000","last_peered":"2023-11-04T01:38:13.741338+0000","last_clean":"2023-11-04T01:38:13.741338+0000","last_became_active":"2023-11-04T01:38:12.052884+0000","last_became_peered":"2023-11-04T01:38:12.052884+0000","last_unstale":"2023-11-04T01:38:13.741338+0000","last_undegraded":"2023-11-04T01:38:13.741338+0000","last_fullsized":"2023-11-04T01:38:13.741338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:20.126578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038992+0000","last_change":"2023-11-04T01:38:11.321555+0000","last_active":"2023-11-04T01:38:13.038992+0000","last_peered":"2023-11-04T01:38:13.038992+0000","last_clean":"2023-11-04T01:38:13.038992+0000","last_became_active":"2023-11-04T01:38:11.321313+0000","last_became_peered":"2023-11-04T01:38:11.321313+0000","last_unstale":"2023-11-04T01:38:13.038992+0000","last_undegraded":"2023-11-04T01:38:13.038992+0000","last_fullsized":"2023-11-04T01:38:13.038992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:26:00.986278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038642+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:38:12.038642+0000","last_peered":"2023-11-04T01:38:12.038642+0000","last_clean":"2023-11-04T01:38:12.038642+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:38:12.038642+0000","last_undegraded":"2023-11-04T01:38:12.038642+0000","last_fullsized":"2023-11-04T01:38:12.038642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165239+0000","last_change":"2023-11-04T01:38:12.049167+0000","last_active":"2023-11-04T01:38:13.165239+0000","last_peered":"2023-11-04T01:38:13.165239+0000","last_clean":"2023-11-04T01:38:13.165239+0000","last_became_active":"2023-11-04T01:38:12.048916+0000","last_became_peered":"2023-11-04T01:38:12.048916+0000","last_unstale":"2023-11-04T01:38:13.165239+0000","last_undegraded":"2023-11-04T01:38:13.165239+0000","last_fullsized":"2023-11-04T01:38:13.165239+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:13.059259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.040166+0000","last_change":"2023-11-04T01:38:11.324784+0000","last_active":"2023-11-04T01:38:13.040166+0000","last_peered":"2023-11-04T01:38:13.040166+0000","last_clean":"2023-11-04T01:38:13.040166+0000","last_became_active":"2023-11-04T01:38:11.324493+0000","last_became_peered":"2023-11-04T01:38:11.324493+0000","last_unstale":"2023-11-04T01:38:13.040166+0000","last_undegraded":"2023-11-04T01:38:13.040166+0000","last_fullsized":"2023-11-04T01:38:13.040166+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:46.425921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033450+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:38:12.033450+0000","last_peered":"2023-11-04T01:38:12.033450+0000","last_clean":"2023-11-04T01:38:12.033450+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:38:12.033450+0000","last_undegraded":"2023-11-04T01:38:12.033450+0000","last_fullsized":"2023-11-04T01:38:12.033450+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038404+0000","last_change":"2023-11-04T01:38:12.054923+0000","last_active":"2023-11-04T01:38:13.038404+0000","last_peered":"2023-11-04T01:38:13.038404+0000","last_clean":"2023-11-04T01:38:13.038404+0000","last_became_active":"2023-11-04T01:38:12.054651+0000","last_became_peered":"2023-11-04T01:38:12.054651+0000","last_unstale":"2023-11-04T01:38:13.038404+0000","last_undegraded":"2023-11-04T01:38:13.038404+0000","last_fullsized":"2023-11-04T01:38:13.038404+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:16.739923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039308+0000","last_change":"2023-11-04T01:38:11.327106+0000","last_active":"2023-11-04T01:38:13.039308+0000","last_peered":"2023-11-04T01:38:13.039308+0000","last_clean":"2023-11-04T01:38:13.039308+0000","last_became_active":"2023-11-04T01:38:11.326795+0000","last_became_peered":"2023-11-04T01:38:11.326795+0000","last_unstale":"2023-11-04T01:38:13.039308+0000","last_undegraded":"2023-11-04T01:38:13.039308+0000","last_fullsized":"2023-11-04T01:38:13.039308+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:47.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.044316+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:38:12.044316+0000","last_peered":"2023-11-04T01:38:12.044316+0000","last_clean":"2023-11-04T01:38:12.044316+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:38:12.044316+0000","last_undegraded":"2023-11-04T01:38:12.044316+0000","last_fullsized":"2023-11-04T01:38:12.044316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740992+0000","last_change":"2023-11-04T01:38:12.051319+0000","last_active":"2023-11-04T01:38:13.740992+0000","last_peered":"2023-11-04T01:38:13.740992+0000","last_clean":"2023-11-04T01:38:13.740992+0000","last_became_active":"2023-11-04T01:38:12.050980+0000","last_became_peered":"2023-11-04T01:38:12.050980+0000","last_unstale":"2023-11-04T01:38:13.740992+0000","last_undegraded":"2023-11-04T01:38:13.740992+0000","last_fullsized":"2023-11-04T01:38:13.740992+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:14.674258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741182+0000","last_change":"2023-11-04T01:38:11.323347+0000","last_active":"2023-11-04T01:38:13.741182+0000","last_peered":"2023-11-04T01:38:13.741182+0000","last_clean":"2023-11-04T01:38:13.741182+0000","last_became_active":"2023-11-04T01:38:11.322962+0000","last_became_peered":"2023-11-04T01:38:11.322962+0000","last_unstale":"2023-11-04T01:38:13.741182+0000","last_undegraded":"2023-11-04T01:38:13.741182+0000","last_fullsized":"2023-11-04T01:38:13.741182+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:26:00.986278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.045237+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:38:12.045237+0000","last_peered":"2023-11-04T01:38:12.045237+0000","last_clean":"2023-11-04T01:38:12.045237+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:38:12.045237+0000","last_undegraded":"2023-11-04T01:38:12.045237+0000","last_fullsized":"2023-11-04T01:38:12.045237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740539+0000","last_change":"2023-11-04T01:38:12.043257+0000","last_active":"2023-11-04T01:38:13.740539+0000","last_peered":"2023-11-04T01:38:13.740539+0000","last_clean":"2023-11-04T01:38:13.740539+0000","last_became_active":"2023-11-04T01:38:12.042996+0000","last_became_peered":"2023-11-04T01:38:12.042996+0000","last_unstale":"2023-11-04T01:38:13.740539+0000","last_undegraded":"2023-11-04T01:38:13.740539+0000","last_fullsized":"2023-11-04T01:38:13.740539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:22.268674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038090+0000","last_change":"2023-11-04T01:38:11.324044+0000","last_active":"2023-11-04T01:38:13.038090+0000","last_peered":"2023-11-04T01:38:13.038090+0000","last_clean":"2023-11-04T01:38:13.038090+0000","last_became_active":"2023-11-04T01:38:11.323772+0000","last_became_peered":"2023-11-04T01:38:11.323772+0000","last_unstale":"2023-11-04T01:38:13.038090+0000","last_undegraded":"2023-11-04T01:38:13.038090+0000","last_fullsized":"2023-11-04T01:38:13.038090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:40.365812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.044659+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:38:12.044659+0000","last_peered":"2023-11-04T01:38:12.044659+0000","last_clean":"2023-11-04T01:38:12.044659+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:38:12.044659+0000","last_undegraded":"2023-11-04T01:38:12.044659+0000","last_fullsized":"2023-11-04T01:38:12.044659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741173+0000","last_change":"2023-11-04T01:38:12.053700+0000","last_active":"2023-11-04T01:38:13.741173+0000","last_peered":"2023-11-04T01:38:13.741173+0000","last_clean":"2023-11-04T01:38:13.741173+0000","last_became_active":"2023-11-04T01:38:12.053410+0000","last_became_peered":"2023-11-04T01:38:12.053410+0000","last_unstale":"2023-11-04T01:38:13.741173+0000","last_undegraded":"2023-11-04T01:38:13.741173+0000","last_fullsized":"2023-11-04T01:38:13.741173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:50.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740484+0000","last_change":"2023-11-04T01:38:11.320817+0000","last_active":"2023-11-04T01:38:13.740484+0000","last_peered":"2023-11-04T01:38:13.740484+0000","last_clean":"2023-11-04T01:38:13.740484+0000","last_became_active":"2023-11-04T01:38:11.320574+0000","last_became_peered":"2023-11-04T01:38:11.320574+0000","last_unstale":"2023-11-04T01:38:13.740484+0000","last_undegraded":"2023-11-04T01:38:13.740484+0000","last_fullsized":"2023-11-04T01:38:13.740484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:08.483847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033586+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:38:12.033586+0000","last_peered":"2023-11-04T01:38:12.033586+0000","last_clean":"2023-11-04T01:38:12.033586+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:38:12.033586+0000","last_undegraded":"2023-11-04T01:38:12.033586+0000","last_fullsized":"2023-11-04T01:38:12.033586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165073+0000","last_change":"2023-11-04T01:38:12.044930+0000","last_active":"2023-11-04T01:38:13.165073+0000","last_peered":"2023-11-04T01:38:13.165073+0000","last_clean":"2023-11-04T01:38:13.165073+0000","last_became_active":"2023-11-04T01:38:12.044690+0000","last_became_peered":"2023-11-04T01:38:12.044690+0000","last_unstale":"2023-11-04T01:38:13.165073+0000","last_undegraded":"2023-11-04T01:38:13.165073+0000","last_fullsized":"2023-11-04T01:38:13.165073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:29.775520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165169+0000","last_change":"2023-11-04T01:38:11.325106+0000","last_active":"2023-11-04T01:38:13.165169+0000","last_peered":"2023-11-04T01:38:13.165169+0000","last_clean":"2023-11-04T01:38:13.165169+0000","last_became_active":"2023-11-04T01:38:11.324843+0000","last_became_peered":"2023-11-04T01:38:11.324843+0000","last_unstale":"2023-11-04T01:38:13.165169+0000","last_undegraded":"2023-11-04T01:38:13.165169+0000","last_fullsized":"2023-11-04T01:38:13.165169+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:47.876329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.043993+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:38:12.043993+0000","last_peered":"2023-11-04T01:38:12.043993+0000","last_clean":"2023-11-04T01:38:12.043993+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:38:12.043993+0000","last_undegraded":"2023-11-04T01:38:12.043993+0000","last_fullsized":"2023-11-04T01:38:12.043993+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039224+0000","last_change":"2023-11-04T01:38:12.047237+0000","last_active":"2023-11-04T01:38:13.039224+0000","last_peered":"2023-11-04T01:38:13.039224+0000","last_clean":"2023-11-04T01:38:13.039224+0000","last_became_active":"2023-11-04T01:38:12.046976+0000","last_became_peered":"2023-11-04T01:38:12.046976+0000","last_unstale":"2023-11-04T01:38:13.039224+0000","last_undegraded":"2023-11-04T01:38:13.039224+0000","last_fullsized":"2023-11-04T01:38:13.039224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:39.001710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.040098+0000","last_change":"2023-11-04T01:38:11.324112+0000","last_active":"2023-11-04T01:38:13.040098+0000","last_peered":"2023-11-04T01:38:13.040098+0000","last_clean":"2023-11-04T01:38:13.040098+0000","last_became_active":"2023-11-04T01:38:11.323235+0000","last_became_peered":"2023-11-04T01:38:11.323235+0000","last_unstale":"2023-11-04T01:38:13.040098+0000","last_undegraded":"2023-11-04T01:38:13.040098+0000","last_fullsized":"2023-11-04T01:38:13.040098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:33.404727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033574+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:38:12.033574+0000","last_peered":"2023-11-04T01:38:12.033574+0000","last_clean":"2023-11-04T01:38:12.033574+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:38:12.033574+0000","last_undegraded":"2023-11-04T01:38:12.033574+0000","last_fullsized":"2023-11-04T01:38:12.033574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038344+0000","last_change":"2023-11-04T01:38:12.049817+0000","last_active":"2023-11-04T01:38:13.038344+0000","last_peered":"2023-11-04T01:38:13.038344+0000","last_clean":"2023-11-04T01:38:13.038344+0000","last_became_active":"2023-11-04T01:38:12.049544+0000","last_became_peered":"2023-11-04T01:38:12.049544+0000","last_unstale":"2023-11-04T01:38:13.038344+0000","last_undegraded":"2023-11-04T01:38:13.038344+0000","last_fullsized":"2023-11-04T01:38:13.038344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:25.821449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165021+0000","last_change":"2023-11-04T01:38:11.326835+0000","last_active":"2023-11-04T01:38:13.165021+0000","last_peered":"2023-11-04T01:38:13.165021+0000","last_clean":"2023-11-04T01:38:13.165021+0000","last_became_active":"2023-11-04T01:38:11.326144+0000","last_became_peered":"2023-11-04T01:38:11.326144+0000","last_unstale":"2023-11-04T01:38:13.165021+0000","last_undegraded":"2023-11-04T01:38:13.165021+0000","last_fullsized":"2023-11-04T01:38:13.165021+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:41:29.568199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.043717+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:38:12.043717+0000","last_peered":"2023-11-04T01:38:12.043717+0000","last_clean":"2023-11-04T01:38:12.043717+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:38:12.043717+0000","last_undegraded":"2023-11-04T01:38:12.043717+0000","last_fullsized":"2023-11-04T01:38:12.043717+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741862+0000","last_change":"2023-11-04T01:38:12.047070+0000","last_active":"2023-11-04T01:38:13.741862+0000","last_peered":"2023-11-04T01:38:13.741862+0000","last_clean":"2023-11-04T01:38:13.741862+0000","last_became_active":"2023-11-04T01:38:12.046811+0000","last_became_peered":"2023-11-04T01:38:12.046811+0000","last_unstale":"2023-11-04T01:38:13.741862+0000","last_undegraded":"2023-11-04T01:38:13.741862+0000","last_fullsized":"2023-11-04T01:38:13.741862+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:25.383541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741476+0000","last_change":"2023-11-04T01:38:11.325968+0000","last_active":"2023-11-04T01:38:13.741476+0000","last_peered":"2023-11-04T01:38:13.741476+0000","last_clean":"2023-11-04T01:38:13.741476+0000","last_became_active":"2023-11-04T01:38:11.325703+0000","last_became_peered":"2023-11-04T01:38:11.325703+0000","last_unstale":"2023-11-04T01:38:13.741476+0000","last_undegraded":"2023-11-04T01:38:13.741476+0000","last_fullsized":"2023-11-04T01:38:13.741476+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:47.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.035876+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:38:12.035876+0000","last_peered":"2023-11-04T01:38:12.035876+0000","last_clean":"2023-11-04T01:38:12.035876+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:38:12.035876+0000","last_undegraded":"2023-11-04T01:38:12.035876+0000","last_fullsized":"2023-11-04T01:38:12.035876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.040183+0000","last_change":"2023-11-04T01:38:12.047397+0000","last_active":"2023-11-04T01:38:13.040183+0000","last_peered":"2023-11-04T01:38:13.040183+0000","last_clean":"2023-11-04T01:38:13.040183+0000","last_became_active":"2023-11-04T01:38:12.047138+0000","last_became_peered":"2023-11-04T01:38:12.047138+0000","last_unstale":"2023-11-04T01:38:13.040183+0000","last_undegraded":"2023-11-04T01:38:13.040183+0000","last_fullsized":"2023-11-04T01:38:13.040183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:16.739923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741555+0000","last_change":"2023-11-04T01:38:11.328918+0000","last_active":"2023-11-04T01:38:13.741555+0000","last_peered":"2023-11-04T01:38:13.741555+0000","last_clean":"2023-11-04T01:38:13.741555+0000","last_became_active":"2023-11-04T01:38:11.328644+0000","last_became_peered":"2023-11-04T01:38:11.328644+0000","last_unstale":"2023-11-04T01:38:13.741555+0000","last_undegraded":"2023-11-04T01:38:13.741555+0000","last_fullsized":"2023-11-04T01:38:13.741555+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:40.365812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038175+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:38:12.038175+0000","last_peered":"2023-11-04T01:38:12.038175+0000","last_clean":"2023-11-04T01:38:12.038175+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:38:12.038175+0000","last_undegraded":"2023-11-04T01:38:12.038175+0000","last_fullsized":"2023-11-04T01:38:12.038175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090417+0000","last_change":"2023-11-04T01:38:12.052835+0000","last_active":"2023-11-04T01:38:13.090417+0000","last_peered":"2023-11-04T01:38:13.090417+0000","last_clean":"2023-11-04T01:38:13.090417+0000","last_became_active":"2023-11-04T01:38:12.052304+0000","last_became_peered":"2023-11-04T01:38:12.052304+0000","last_unstale":"2023-11-04T01:38:13.090417+0000","last_undegraded":"2023-11-04T01:38:13.090417+0000","last_fullsized":"2023-11-04T01:38:13.090417+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:02.316821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039688+0000","last_change":"2023-11-04T01:38:11.327117+0000","last_active":"2023-11-04T01:38:13.039688+0000","last_peered":"2023-11-04T01:38:13.039688+0000","last_clean":"2023-11-04T01:38:13.039688+0000","last_became_active":"2023-11-04T01:38:11.326833+0000","last_became_peered":"2023-11-04T01:38:11.326833+0000","last_unstale":"2023-11-04T01:38:13.039688+0000","last_undegraded":"2023-11-04T01:38:13.039688+0000","last_fullsized":"2023-11-04T01:38:13.039688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:47.362648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.035630+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:38:12.035630+0000","last_peered":"2023-11-04T01:38:12.035630+0000","last_clean":"2023-11-04T01:38:12.035630+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:38:12.035630+0000","last_undegraded":"2023-11-04T01:38:12.035630+0000","last_fullsized":"2023-11-04T01:38:12.035630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090260+0000","last_change":"2023-11-04T01:38:12.049518+0000","last_active":"2023-11-04T01:38:13.090260+0000","last_peered":"2023-11-04T01:38:13.090260+0000","last_clean":"2023-11-04T01:38:13.090260+0000","last_became_active":"2023-11-04T01:38:12.049215+0000","last_became_peered":"2023-11-04T01:38:12.049215+0000","last_unstale":"2023-11-04T01:38:13.090260+0000","last_undegraded":"2023-11-04T01:38:13.090260+0000","last_fullsized":"2023-11-04T01:38:13.090260+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:47.317370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740665+0000","last_change":"2023-11-04T01:38:11.319353+0000","last_active":"2023-11-04T01:38:13.740665+0000","last_peered":"2023-11-04T01:38:13.740665+0000","last_clean":"2023-11-04T01:38:13.740665+0000","last_became_active":"2023-11-04T01:38:11.319106+0000","last_became_peered":"2023-11-04T01:38:11.319106+0000","last_unstale":"2023-11-04T01:38:13.740665+0000","last_undegraded":"2023-11-04T01:38:13.740665+0000","last_fullsized":"2023-11-04T01:38:13.740665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:46.425921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033777+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:38:12.033777+0000","last_peered":"2023-11-04T01:38:12.033777+0000","last_clean":"2023-11-04T01:38:12.033777+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:38:12.033777+0000","last_undegraded":"2023-11-04T01:38:12.033777+0000","last_fullsized":"2023-11-04T01:38:12.033777+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090595+0000","last_change":"2023-11-04T01:38:12.042275+0000","last_active":"2023-11-04T01:38:13.090595+0000","last_peered":"2023-11-04T01:38:13.090595+0000","last_clean":"2023-11-04T01:38:13.090595+0000","last_became_active":"2023-11-04T01:38:12.042025+0000","last_became_peered":"2023-11-04T01:38:12.042025+0000","last_unstale":"2023-11-04T01:38:13.090595+0000","last_undegraded":"2023-11-04T01:38:13.090595+0000","last_fullsized":"2023-11-04T01:38:13.090595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:34.371052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741633+0000","last_change":"2023-11-04T01:38:11.328610+0000","last_active":"2023-11-04T01:38:13.741633+0000","last_peered":"2023-11-04T01:38:13.741633+0000","last_clean":"2023-11-04T01:38:13.741633+0000","last_became_active":"2023-11-04T01:38:11.328336+0000","last_became_peered":"2023-11-04T01:38:11.328336+0000","last_unstale":"2023-11-04T01:38:13.741633+0000","last_undegraded":"2023-11-04T01:38:13.741633+0000","last_fullsized":"2023-11-04T01:38:13.741633+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:42.261478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.045019+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:38:12.045019+0000","last_peered":"2023-11-04T01:38:12.045019+0000","last_clean":"2023-11-04T01:38:12.045019+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:38:12.045019+0000","last_undegraded":"2023-11-04T01:38:12.045019+0000","last_fullsized":"2023-11-04T01:38:12.045019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.165007+0000","last_change":"2023-11-04T01:38:12.054997+0000","last_active":"2023-11-04T01:38:13.165007+0000","last_peered":"2023-11-04T01:38:13.165007+0000","last_clean":"2023-11-04T01:38:13.165007+0000","last_became_active":"2023-11-04T01:38:12.054777+0000","last_became_peered":"2023-11-04T01:38:12.054777+0000","last_unstale":"2023-11-04T01:38:13.165007+0000","last_undegraded":"2023-11-04T01:38:13.165007+0000","last_fullsized":"2023-11-04T01:38:13.165007+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:11.642888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.038440+0000","last_change":"2023-11-04T01:38:11.326486+0000","last_active":"2023-11-04T01:38:13.038440+0000","last_peered":"2023-11-04T01:38:13.038440+0000","last_clean":"2023-11-04T01:38:13.038440+0000","last_became_active":"2023-11-04T01:38:11.326238+0000","last_became_peered":"2023-11-04T01:38:11.326238+0000","last_unstale":"2023-11-04T01:38:13.038440+0000","last_undegraded":"2023-11-04T01:38:13.038440+0000","last_fullsized":"2023-11-04T01:38:13.038440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:56:14.463511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.034533+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:38:12.034533+0000","last_peered":"2023-11-04T01:38:12.034533+0000","last_clean":"2023-11-04T01:38:12.034533+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:38:12.034533+0000","last_undegraded":"2023-11-04T01:38:12.034533+0000","last_fullsized":"2023-11-04T01:38:12.034533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740810+0000","last_change":"2023-11-04T01:38:12.046420+0000","last_active":"2023-11-04T01:38:13.740810+0000","last_peered":"2023-11-04T01:38:13.740810+0000","last_clean":"2023-11-04T01:38:13.740810+0000","last_became_active":"2023-11-04T01:38:12.046155+0000","last_became_peered":"2023-11-04T01:38:12.046155+0000","last_unstale":"2023-11-04T01:38:13.740810+0000","last_undegraded":"2023-11-04T01:38:13.740810+0000","last_fullsized":"2023-11-04T01:38:13.740810+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:50.385854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.740810+0000","last_change":"2023-11-04T01:38:11.325111+0000","last_active":"2023-11-04T01:38:13.740810+0000","last_peered":"2023-11-04T01:38:13.740810+0000","last_clean":"2023-11-04T01:38:13.740810+0000","last_became_active":"2023-11-04T01:38:11.324823+0000","last_became_peered":"2023-11-04T01:38:11.324823+0000","last_unstale":"2023-11-04T01:38:13.740810+0000","last_undegraded":"2023-11-04T01:38:13.740810+0000","last_fullsized":"2023-11-04T01:38:13.740810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:06.490586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038922+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:38:12.038922+0000","last_peered":"2023-11-04T01:38:12.038922+0000","last_clean":"2023-11-04T01:38:12.038922+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:38:12.038922+0000","last_undegraded":"2023-11-04T01:38:12.038922+0000","last_fullsized":"2023-11-04T01:38:12.038922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039213+0000","last_change":"2023-11-04T01:38:12.041362+0000","last_active":"2023-11-04T01:38:13.039213+0000","last_peered":"2023-11-04T01:38:13.039213+0000","last_clean":"2023-11-04T01:38:13.039213+0000","last_became_active":"2023-11-04T01:38:12.041071+0000","last_became_peered":"2023-11-04T01:38:12.041071+0000","last_unstale":"2023-11-04T01:38:13.039213+0000","last_undegraded":"2023-11-04T01:38:13.039213+0000","last_fullsized":"2023-11-04T01:38:13.039213+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:57.954870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039561+0000","last_change":"2023-11-04T01:38:11.324863+0000","last_active":"2023-11-04T01:38:13.039561+0000","last_peered":"2023-11-04T01:38:13.039561+0000","last_clean":"2023-11-04T01:38:13.039561+0000","last_became_active":"2023-11-04T01:38:11.323495+0000","last_became_peered":"2023-11-04T01:38:11.323495+0000","last_unstale":"2023-11-04T01:38:13.039561+0000","last_undegraded":"2023-11-04T01:38:13.039561+0000","last_fullsized":"2023-11-04T01:38:13.039561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:19.121962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038281+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:38:12.038281+0000","last_peered":"2023-11-04T01:38:12.038281+0000","last_clean":"2023-11-04T01:38:12.038281+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:38:12.038281+0000","last_undegraded":"2023-11-04T01:38:12.038281+0000","last_fullsized":"2023-11-04T01:38:12.038281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.039426+0000","last_change":"2023-11-04T01:38:12.042729+0000","last_active":"2023-11-04T01:38:13.039426+0000","last_peered":"2023-11-04T01:38:13.039426+0000","last_clean":"2023-11-04T01:38:13.039426+0000","last_became_active":"2023-11-04T01:38:12.042279+0000","last_became_peered":"2023-11-04T01:38:12.042279+0000","last_unstale":"2023-11-04T01:38:13.039426+0000","last_undegraded":"2023-11-04T01:38:13.039426+0000","last_fullsized":"2023-11-04T01:38:13.039426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:26.303135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741436+0000","last_change":"2023-11-04T01:38:11.329499+0000","last_active":"2023-11-04T01:38:13.741436+0000","last_peered":"2023-11-04T01:38:13.741436+0000","last_clean":"2023-11-04T01:38:13.741436+0000","last_became_active":"2023-11-04T01:38:11.329213+0000","last_became_peered":"2023-11-04T01:38:11.329213+0000","last_unstale":"2023-11-04T01:38:13.741436+0000","last_undegraded":"2023-11-04T01:38:13.741436+0000","last_fullsized":"2023-11-04T01:38:13.741436+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:56:28.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.038194+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:38:12.038194+0000","last_peered":"2023-11-04T01:38:12.038194+0000","last_clean":"2023-11-04T01:38:12.038194+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:38:12.038194+0000","last_undegraded":"2023-11-04T01:38:12.038194+0000","last_fullsized":"2023-11-04T01:38:12.038194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.090403+0000","last_change":"2023-11-04T01:38:12.052410+0000","last_active":"2023-11-04T01:38:13.090403+0000","last_peered":"2023-11-04T01:38:13.090403+0000","last_clean":"2023-11-04T01:38:13.090403+0000","last_became_active":"2023-11-04T01:38:12.052038+0000","last_became_peered":"2023-11-04T01:38:12.052038+0000","last_unstale":"2023-11-04T01:38:13.090403+0000","last_undegraded":"2023-11-04T01:38:13.090403+0000","last_fullsized":"2023-11-04T01:38:13.090403+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:11.303684+0000","last_clean_scrub_stamp":"2023-11-04T01:38:11.303684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:12.085031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:13.741192+0000","last_change":"2023-11-04T01:38:11.325850+0000","last_active":"2023-11-04T01:38:13.741192+0000","last_peered":"2023-11-04T01:38:13.741192+0000","last_clean":"2023-11-04T01:38:13.741192+0000","last_became_active":"2023-11-04T01:38:11.325597+0000","last_became_peered":"2023-11-04T01:38:11.325597+0000","last_unstale":"2023-11-04T01:38:13.741192+0000","last_undegraded":"2023-11-04T01:38:13.741192+0000","last_fullsized":"2023-11-04T01:38:13.741192+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:10.299068+0000","last_clean_scrub_stamp":"2023-11-04T01:38:10.299068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:08.483847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.033958+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:38:12.033958+0000","last_peered":"2023-11-04T01:38:12.033958+0000","last_clean":"2023-11-04T01:38:12.033958+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:38:12.033958+0000","last_undegraded":"2023-11-04T01:38:12.033958+0000","last_fullsized":"2023-11-04T01:38:12.033958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:12.036305+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:38:12.036305+0000","last_peered":"2023-11-04T01:38:12.036305+0000","last_clean":"2023-11-04T01:38:12.036305+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:38:12.036305+0000","last_undegraded":"2023-11-04T01:38:12.036305+0000","last_fullsized":"2023-11-04T01:38:12.036305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1400832,"data_stored":961089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70599999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69699999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.499},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.435},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":0.755},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.29299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":0.872,"15min":0.872},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":362205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.501},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65100000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.41899999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.62,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68100000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":363222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.622}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68600000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.70999999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52600000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49299999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.435}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":370175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.373},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79500000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71199999999999997,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.501},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.312}]},{"osd":2,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.753,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.133,"15min":1.133},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.433}]},{"osd":5,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.33500000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.71699999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39100000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.32100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54200000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.42199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":370217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.23999999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.36599999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.33400000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.38600000000000001,"5min":0.495,"15min":0.495},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51900000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.40799999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47099999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.75900000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78300000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.62}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80800000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53800000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59899999999999998,"15min":0.60599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.876,"15min":0.876},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73799999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":371717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.372}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.309},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.254},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.45700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.53000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.20999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.29099999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.39700000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1388544,"data_stored":959454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.316,"15min":0.32200000000000001},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.442,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.251}]},{"osd":2,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.36799999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.36499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.33100000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39900000000000002,"15min":0.40600000000000003},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":1.048,"15min":1.048},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63}]},{"osd":6,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.44400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":0.874,"15min":0.874},"last":0.503}]},{"osd":7,"last update":"Sat Nov 4 01:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:15.605 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:38:15.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:38:15.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.743+0000 7fb4e69a9640 1 Processor -- start 2023-11-04T01:38:15.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.743+0000 7fb4e69a9640 1 -- start start 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e69a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4e00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e69a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e00c3900 con 0x7fb4e0070e20 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e69a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e00c3be0 con 0x7fb4e00ad730 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e69a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00ae260 con 0x7fb4e015ad30 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e4f46640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb4e0070e20 0x7fb4e015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52940/0 (socket says 172.21.15.93:52940) 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4e4f46640 1 -- 172.21.15.93:0/1301207099 learned_addr learned my addr 172.21.15.93:0/1301207099 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227233594 0 0) 0x7fb4e00c3900 con 0x7fb4e0070e20 2023-11-04T01:38:15.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c8003520 con 0x7fb4e0070e20 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4dffff640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4e00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855810621 0 0) 0x7fb4c8003520 con 0x7fb4e0070e20 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 msgr2=0x7fb4e00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4e00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 >> v1:172.21.15.125:6789/0 conn(0x7fb4e00ad730 legacy=0x7fb4e0070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00c3ec0 con 0x7fb4e0070e20 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fb4d80019f0 con 0x7fb4e0070e20 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 >> v1:172.21.15.93:6789/0 conn(0x7fb4e0070e20 legacy=0x7fb4e015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4c80039a0 0x7fb4c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.744+0000 7fb4deffd640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4deffd640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c8004d00 0x7fb4c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00ae260 con 0x7fb4c80039a0 2023-11-04T01:38:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c800bab0 con 0x7fb4c8004d00 2023-11-04T01:38:15.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c800bc70 con 0x7fb4e015ad30 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4c80039a0 0x7fb4c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4df7fe640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4e4f46640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c8004d00 0x7fb4c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 -- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 msgr2=0x7fb4c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e015ad30 0x7fb4c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 -- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c8004d00 msgr2=0x7fb4c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c8004d00 0x7fb4c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4dffff640 1 -- 172.21.15.93:0/1301207099 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8003520 con 0x7fb4c80039a0 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.745+0000 7fb4e4f46640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c8004d00 0x7fb4c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4dffff640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4c80039a0 0x7fb4c8003dc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009ac0 tx=0x7fb4c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12752bd14b4b33a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d002c600 con 0x7fb4c80039a0 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d002c760 con 0x7fb4c80039a0 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4deffd640 1 -- 172.21.15.93:0/1301207099 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d002caf0 con 0x7fb4c80039a0 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 -- 172.21.15.93:0/1301207099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4c80039a0 msgr2=0x7fb4c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/1301207099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4c80039a0 0x7fb4c8003dc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009ac0 tx=0x7fb4c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e4f46640 1 -- 172.21.15.93:0/1301207099 reap_dead start 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 -- 172.21.15.93:0/1301207099 shutdown_connections 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 -- 172.21.15.93:0/1301207099 >> 172.21.15.93:0/1301207099 conn(0x7fb4e00ce950 msgr2=0x7fb4e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 -- 172.21.15.93:0/1301207099 shutdown_connections 2023-11-04T01:38:15.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.746+0000 7fb4e69a9640 1 -- 172.21.15.93:0/1301207099 wait complete. 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.747+0000 7fb4e69a9640 1 Processor -- start 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 -- start start 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c80039a0 0x7fb4e0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 0x7fb4e014be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e014c370 con 0x7fb4e014e5e0 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0150ac0 con 0x7fb4c80039a0 2023-11-04T01:38:15.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4e69a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e014eba0 con 0x7fb4e014b9b0 2023-11-04T01:38:15.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4df7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4df7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52774/0 (socket says 172.21.15.93:52774) 2023-11-04T01:38:15.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.748+0000 7fb4df7fe640 1 -- 172.21.15.93:0/2180863132 learned_addr learned my addr 172.21.15.93:0/2180863132 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:15.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4dffff640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c80039a0 0x7fb4e0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4e4f46640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 0x7fb4e014be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 -- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 msgr2=0x7fb4e014be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 0x7fb4e014be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 -- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c80039a0 msgr2=0x7fb4e0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c80039a0 0x7fb4e0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 -- 172.21.15.93:0/2180863132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00cca90 con 0x7fb4e014e5e0 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4e4f46640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 0x7fb4e014be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4df7fe640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400e550 tx=0x7fb4d400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40052e0 con 0x7fb4e014e5e0 2023-11-04T01:38:15.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4005440 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e00ccd70 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4003810 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.749+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e0156d60 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.750+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e0074290 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.750+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4d4003970 con 0x7fb4e014e5e0 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.751+0000 7fb4dcff9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 0x7fb4cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:15.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.751+0000 7fb4dffff640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 0x7fb4cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:15.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.751+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb4d4089630 con 0x7fb4e014e5e0 2023-11-04T01:38:15.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.751+0000 7fb4dffff640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 0x7fb4cc06d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.755+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4d4054440 con 0x7fb4e014e5e0 2023-11-04T01:38:15.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.984+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb4e0071970 con 0x7fb4e014e5e0 2023-11-04T01:38:15.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.986+0000 7fb4dcff9640 1 -- 172.21.15.93:0/2180863132 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb4d4057a60 con 0x7fb4e014e5e0 2023-11-04T01:38:15.988 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:38:15.988 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:38:15.988 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow" 2023-11-04T01:38:15.989 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow r" 2023-11-04T01:38:15.989 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:15.989 INFO:teuthology.orchestra.run.smithi093.stderr:updated caps for client.0 2023-11-04T01:38:15.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 msgr2=0x7fb4cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 0x7fb4cc06d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d0030000 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 msgr2=0x7fb4e00b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400e550 tx=0x7fb4d400ea10 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 shutdown_connections 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb4cc06ae70 0x7fb4cc06d330 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4e014b9b0 0x7fb4e014be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4e014e5e0 0x7fb4e00b3c10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 --2- 172.21.15.93:0/2180863132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4c80039a0 0x7fb4e0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 >> 172.21.15.93:0/2180863132 conn(0x7fb4e00ce950 msgr2=0x7fb4e015bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 shutdown_connections 2023-11-04T01:38:15.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:15.988+0000 7fb4e69a9640 1 -- 172.21.15.93:0/2180863132 wait complete. 2023-11-04T01:38:16.001 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:16.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.098+0000 7f468b190640 1 Processor -- start 2023-11-04T01:38:16.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.098+0000 7f468b190640 1 -- start start 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.099+0000 7f468b190640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46840cc430 0x7f46840cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.099+0000 7f468b190640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840ccdb0 con 0x7f4684159da0 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.099+0000 7f468b190640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840cd690 con 0x7f46840ce730 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.099+0000 7f468b190640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840cd970 con 0x7f46840cc430 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.099+0000 7f4683fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46840cc430 0x7f46840cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4688f2c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4684159da0 0x7f46840b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52946/0 (socket says 172.21.15.93:52946) 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4688f2c640 1 -- 172.21.15.93:0/4230709065 learned_addr learned my addr 172.21.15.93:0/4230709065 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:16.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4683fff640 1 -- 172.21.15.93:0/4230709065 >> v1:172.21.15.125:6789/0 conn(0x7f46840ce730 legacy=0x7f46840ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4683fff640 1 -- 172.21.15.93:0/4230709065 >> v1:172.21.15.93:6789/0 conn(0x7f4684159da0 legacy=0x7f46840b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4683fff640 1 -- 172.21.15.93:0/4230709065 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840cdc50 con 0x7f46840cc430 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.100+0000 7f4683fff640 1 --2- 172.21.15.93:0/4230709065 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840cc430 0x7f46840cc870 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f46780097a0 tx=0x7f467802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd09f49dbd105ec5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f46837fe640 1 -- 172.21.15.93:0/4230709065 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678030610 con 0x7f46840cc430 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f46837fe640 1 -- 172.21.15.93:0/4230709065 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678030770 con 0x7f46840cc430 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f46837fe640 1 -- 172.21.15.93:0/4230709065 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678030b00 con 0x7f46840cc430 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 -- 172.21.15.93:0/4230709065 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840cc430 msgr2=0x7f46840cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 --2- 172.21.15.93:0/4230709065 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840cc430 0x7f46840cc870 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f46780097a0 tx=0x7f467802b960 comp rx=0 tx=0).stop 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 -- 172.21.15.93:0/4230709065 shutdown_connections 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 --2- 172.21.15.93:0/4230709065 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840cc430 0x7f46840cc870 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 -- 172.21.15.93:0/4230709065 >> 172.21.15.93:0/4230709065 conn(0x7f468406d8b0 msgr2=0x7f468406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 -- 172.21.15.93:0/4230709065 shutdown_connections 2023-11-04T01:38:16.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.101+0000 7f468b190640 1 -- 172.21.15.93:0/4230709065 wait complete. 2023-11-04T01:38:16.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.102+0000 7f468b190640 1 Processor -- start 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.102+0000 7f468b190640 1 -- start start 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 0x7f46841f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4684159da0 0x7f46840af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46841f3360 con 0x7f46840ce730 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684157e60 con 0x7f46840cc430 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f468b190640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46840ae3b0 con 0x7f4684159da0 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f4683fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f4683fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52782/0 (socket says 172.21.15.93:52782) 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.103+0000 7f4683fff640 1 -- 172.21.15.93:0/2698033497 learned_addr learned my addr 172.21.15.93:0/2698033497 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4688f2c640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 0x7f46841f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 -- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4684159da0 msgr2=0x7f46840af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4684159da0 0x7f46840af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 -- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 msgr2=0x7f46841f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 0x7f46841f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 -- 172.21.15.93:0/2698033497 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009400 con 0x7f46840ce730 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4688f2c640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 0x7f46841f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f4683fff640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f467802bf70 tx=0x7f4678004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467803e040 con 0x7f46840ce730 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678039cb0 con 0x7f46840ce730 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840b0040 con 0x7f46840ce730 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678044630 con 0x7f46840ce730 2023-11-04T01:38:16.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.104+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46841f2f80 con 0x7f46840ce730 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.105+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46841f34a0 con 0x7f46840ce730 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.105+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f467804d3b0 con 0x7f46840ce730 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.106+0000 7f46817fa640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 0x7f467006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.106+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f46780abf00 con 0x7f46840ce730 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.106+0000 7f4688f2c640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 0x7f467006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.106+0000 7f4688f2c640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 0x7f467006d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4674007fd0 tx=0x7f4674009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.110+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46841f34a0 con 0x7f46840ce730 2023-11-04T01:38:16.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.314+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46841f34a0 con 0x7f46840ce730 2023-11-04T01:38:16.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.315+0000 7f46817fa640 1 -- 172.21.15.93:0/2698033497 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f46841f34a0 con 0x7f46840ce730 2023-11-04T01:38:16.317 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:16.317 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:16.317 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:16.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 msgr2=0x7f467006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 0x7f467006d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4674007fd0 tx=0x7f4674009040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 msgr2=0x7f46841ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f467802bf70 tx=0x7f4678004730 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 shutdown_connections 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f467006ae70 0x7f467006d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4684159da0 0x7f46840af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46840ce730 0x7f46841ecad0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 --2- 172.21.15.93:0/2698033497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46840cc430 0x7f46841f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 >> 172.21.15.93:0/2698033497 conn(0x7f468406d8b0 msgr2=0x7f46840b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 shutdown_connections 2023-11-04T01:38:16.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.317+0000 7f468b190640 1 -- 172.21.15.93:0/2698033497 wait complete. 2023-11-04T01:38:16.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:11.654445+0000', 'modified': '2023-11-04T01:38:13.648845+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6438}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6438': {'gid': 6438, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6835/2577358209', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 2577358209}, {'type': 'v1', 'addr': '172.21.15.93:6835', 'nonce': 2577358209}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:16.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:16.733 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:38:16.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.836+0000 7f67e79ce640 1 Processor -- start 2023-11-04T01:38:16.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.836+0000 7f67e79ce640 1 -- start start 2023-11-04T01:38:16.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.836+0000 7f67e79ce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67e00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e79ce640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e015aff0 con 0x7f67e0159c00 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e79ce640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e015a3e0 con 0x7f67e00adac0 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e79ce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e015a6c0 con 0x7f67e00c4ff0 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e576a640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f67e0159c00 0x7f67e00c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52954/0 (socket says 172.21.15.93:52954) 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e576a640 1 -- 172.21.15.93:0/2878828116 learned_addr learned my addr 172.21.15.93:0/2878828116 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597739790 0 0) 0x7f67e015aff0 con 0x7f67e0159c00 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e4f69640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67e00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67cc003520 con 0x7f67e0159c00 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428663056 0 0) 0x7f67cc003520 con 0x7f67e0159c00 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 msgr2=0x7f67e00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67e00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 >> v1:172.21.15.125:6789/0 conn(0x7f67e00adac0 legacy=0x7f67e00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e015a9a0 con 0x7f67e0159c00 2023-11-04T01:38:16.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f67dc0019f0 con 0x7f67e0159c00 2023-11-04T01:38:16.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 >> v1:172.21.15.93:6789/0 conn(0x7f67e0159c00 legacy=0x7f67e00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc003f20 0x7f67cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67cc004d00 0x7f67cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e015a6c0 con 0x7f67cc004d00 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc00dc70 con 0x7f67cc003f20 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc00de30 con 0x7f67e00c4ff0 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67cc004d00 0x7f67cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e576a640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.837+0000 7f67e4f69640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc003f20 0x7f67cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 msgr2=0x7f67cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e00c4ff0 0x7f67cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc003f20 msgr2=0x7f67cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc003f20 0x7f67cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2878828116 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc003520 con 0x7f67cc004d00 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.838+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67cc004d00 0x7f67cc005180 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd4e3ab060b1220 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80052d0 con 0x7f67cc004d00 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d802e050 con 0x7f67cc004d00 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67d7fff640 1 -- 172.21.15.93:0/2878828116 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8003830 con 0x7f67cc004d00 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 -- 172.21.15.93:0/2878828116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67cc004d00 msgr2=0x7f67cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 --2- 172.21.15.93:0/2878828116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67cc004d00 0x7f67cc005180 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2878828116 reap_dead start 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 -- 172.21.15.93:0/2878828116 shutdown_connections 2023-11-04T01:38:16.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 -- 172.21.15.93:0/2878828116 >> 172.21.15.93:0/2878828116 conn(0x7f67e00ce950 msgr2=0x7f67e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 -- 172.21.15.93:0/2878828116 shutdown_connections 2023-11-04T01:38:16.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.839+0000 7f67e79ce640 1 -- 172.21.15.93:0/2878828116 wait complete. 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.840+0000 7f67e79ce640 1 Processor -- start 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.840+0000 7f67e79ce640 1 -- start start 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 0x7f67e0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e014e8e0 0x7f67e014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e0150a00 con 0x7f67e0141270 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e014dd70 con 0x7f67e014e8e0 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e79ce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e014f2a0 con 0x7f67e0141650 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52800/0 (socket says 172.21.15.93:52800) 2023-11-04T01:38:16.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 -- 172.21.15.93:0/1718460777 learned_addr learned my addr 172.21.15.93:0/1718460777 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e014e8e0 0x7f67e014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 0x7f67e0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 -- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 msgr2=0x7f67e0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 0x7f67e0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 -- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e014e8e0 msgr2=0x7f67e014ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e014e8e0 0x7f67e014ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 -- 172.21.15.93:0/1718460777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0150be0 con 0x7f67e0141270 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 0x7f67e0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.841+0000 7f67e576a640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00a570 tx=0x7f67dc00aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.842+0000 7f67d5ffb640 1 -- 172.21.15.93:0/1718460777 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc013600 con 0x7f67e0141270 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.842+0000 7f67d5ffb640 1 -- 172.21.15.93:0/1718460777 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc013760 con 0x7f67e0141270 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.842+0000 7f67d5ffb640 1 -- 172.21.15.93:0/1718460777 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc013af0 con 0x7f67e0141270 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.842+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e0150ec0 con 0x7f67e0141270 2023-11-04T01:38:16.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.842+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e0151480 con 0x7f67e0141270 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.843+0000 7f67d5ffb640 1 -- 172.21.15.93:0/1718460777 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67dc013c50 con 0x7f67e0141270 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.843+0000 7f67d5ffb640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 0x7f67c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.844+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 0x7f67c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.844+0000 7f67d5ffb640 1 -- 172.21.15.93:0/1718460777 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67dc08aa70 con 0x7f67e0141270 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.844+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 0x7f67c406d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67e014f7f0 tx=0x7f67d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 Processor -- start 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 -- start start 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092475750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.857 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559092386740 con 0x559092475c90 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590923e88d0 con 0x5590924a2c30 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590923e5fc0 con 0x5590924a2850 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.845+0000 7f67e5f6b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52804/0 (socket says 172.21.15.93:52804) 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 -- 172.21.15.93:0/1479656890 learned_addr learned my addr 172.21.15.93:0/1479656890 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e576a640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092475750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 -- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 msgr2=0x559092475750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092475750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.858 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 -- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 msgr2=0x5590924a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924a55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 -- 172.21.15.93:0/1479656890 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590923a4ca0 con 0x559092475c90 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e4f69640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67d802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f162d33758aa3e48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67c2ffd640 1 -- 172.21.15.93:0/1479656890 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8007a30 con 0x559092475c90 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67c2ffd640 1 -- 172.21.15.93:0/1479656890 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80050d0 con 0x559092475c90 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.846+0000 7f67c2ffd640 1 -- 172.21.15.93:0/1479656890 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8005440 con 0x559092475c90 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- 172.21.15.93:0/1479656890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 msgr2=0x5590924a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67d802f000 comp rx=0 tx=0).stop 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- 172.21.15.93:0/1479656890 shutdown_connections 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559092475c90 0x5590924a5b20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/1479656890 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092475750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- 172.21.15.93:0/1479656890 >> 172.21.15.93:0/1479656890 conn(0x559092477a60 msgr2=0x5590924c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- 172.21.15.93:0/1479656890 shutdown_connections 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- 172.21.15.93:0/1479656890 wait complete. 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 -- start start 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.847+0000 7f67ea1fd740 1 Processor -- start 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092490ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590923e18b0 con 0x5590924a7df0 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909239bc80 con 0x5590924a2c30 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55909239b920 con 0x5590924a2850 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67ea1fd740 10 client.0 _ll_register_callbacks cb 0x5590920f3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67e5f6b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67e5f6b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52818/0 (socket says 172.21.15.93:52818) 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2739135974 learned_addr learned my addr 172.21.15.93:0/2739135974 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67e4f69640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.848+0000 7f67e576a640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092490ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 msgr2=0x559092490ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092490ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 msgr2=0x5590924c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 -- 172.21.15.93:0/2739135974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc003520 con 0x5590924a7df0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001840 tx=0x7f67d8001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915f851066b648ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8007a30 con 0x5590924a7df0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67d80067d0 con 0x5590924a7df0 2023-11-04T01:38:16.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55909238dbf0 con 0x5590924a7df0 2023-11-04T01:38:16.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67d8006990 con 0x5590924a7df0 2023-11-04T01:38:16.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 10 client.6588 fetch_fsmap learned FSMap version 29 2023-11-04T01:38:16.862 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5590923dff30 con 0x5590924a7df0 2023-11-04T01:38:16.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55909238dbf0 con 0x5590924a7df0 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f67d8006af0 con 0x5590924a7df0 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 10 client.6588 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 10 client.6588 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 20 client.6588 populate_metadata read hostname 'smithi093' 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x5590924d46b0 0x5590924bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 4 client.6588 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 --> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590923da890 con 0x5590924d46b0 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.849+0000 7f67e576a640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x5590924d46b0 0x5590924bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67bbfff640 10 client.6588 ms_handle_connect on v2:172.21.15.93:6834/2577358209 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67e576a640 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x5590924d46b0 0x5590924bc430 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=430d52d7333f4286 server_cookie=734a001cb1745c3d in_seq=0 out_seq=0 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67bbfff640 1 -- 172.21.15.93:0/2739135974 <== mds.0 v2:172.21.15.93:6834/2577358209 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590923da890 con 0x5590924d46b0 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67bbfff640 10 client.6588 handle_command_reply: tid=0 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 client.6588 shutdown 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 msgr2=0x5590924a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001840 tx=0x7f67d8001190 comp rx=0 tx=0).stop 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 shutdown_connections 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x5590924d46b0 0x5590924bc430 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a7df0 0x5590924a8270 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67bbfff640 0 client.6588 ms_handle_reset on v2:172.21.15.93:6834/2577358209 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2c30 0x5590924c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/2739135974 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092490ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.850+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 >> 172.21.15.93:0/2739135974 conn(0x559092475c90 msgr2=0x5590924a55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.851+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 shutdown_connections 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.851+0000 7f67ea1fd740 1 -- 172.21.15.93:0/2739135974 wait complete. 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.851+0000 7f67ea1fd740 20 client.6588 trim_cache size 0 max 16384 2023-11-04T01:38:16.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.866+0000 7f67ea1fd740 1 Processor -- start 2023-11-04T01:38:16.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.866+0000 7f67ea1fd740 1 -- start start 2023-11-04T01:38:16.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092479c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a7df0 0x5590924e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559092361280 con 0x5590924a2c30 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590924a8a50 con 0x5590924a7df0 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590924babe0 con 0x5590924a2850 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52822/0 (socket says 172.21.15.93:52822) 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 -- 172.21.15.93:0/4087649639 learned_addr learned my addr 172.21.15.93:0/4087649639 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 -- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 msgr2=0x559092479c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092479c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 -- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a7df0 msgr2=0x5590924e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a7df0 0x5590924e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 -- 172.21.15.93:0/4087649639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909237dd10 con 0x5590924a2c30 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67e4f69640 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f67d0013df0 tx=0x7f67d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a3bb30001f6bc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67c37fe640 1 -- 172.21.15.93:0/4087649639 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d002c400 con 0x5590924a2c30 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67c37fe640 1 -- 172.21.15.93:0/4087649639 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d002c560 con 0x5590924a2c30 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.867+0000 7f67c37fe640 1 -- 172.21.15.93:0/4087649639 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d002c8d0 con 0x5590924a2c30 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- 172.21.15.93:0/4087649639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 msgr2=0x5590924968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f67d0013df0 tx=0x7f67d0016000 comp rx=0 tx=0).stop 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- 172.21.15.93:0/4087649639 shutdown_connections 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a7df0 0x5590924e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924968f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/4087649639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a2850 0x559092479c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- 172.21.15.93:0/4087649639 >> 172.21.15.93:0/4087649639 conn(0x559092475c90 msgr2=0x5590924d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- 172.21.15.93:0/4087649639 shutdown_connections 2023-11-04T01:38:16.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- 172.21.15.93:0/4087649639 wait complete. 2023-11-04T01:38:16.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.868+0000 7f67ea1fd740 1 -- start start 2023-11-04T01:38:16.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 Processor -- start 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 0x5590924da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a7df0 0x559092474a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590924e3a60 con 0x5590924a2c30 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590925302e0 con 0x5590924a2850 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.869+0000 7f67ea1fd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590924e3810 con 0x5590924a7df0 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67ea1fd740 10 client.0 _ll_register_callbacks cb 0x7f67cc0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52826/0 (socket says 172.21.15.93:52826) 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 -- 172.21.15.93:0/971014117 learned_addr learned my addr 172.21.15.93:0/971014117 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e5f6b640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a7df0 0x559092474a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e576a640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 0x5590924da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 -- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a7df0 msgr2=0x559092474a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a7df0 0x559092474a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 -- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 msgr2=0x5590924da3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 0x5590924da3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 -- 172.21.15.93:0/971014117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d0013aa0 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e576a640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 0x5590924da3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67e4f69640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f67d0028000 tx=0x7f67d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100c507070b92422 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0037470 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67d0033070 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67d80050d0 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67d00375d0 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67ea1fd740 10 client.6594 fetch_fsmap learned FSMap version 29 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5590923a3500 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.870+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80050d0 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f67d002a020 con 0x5590924a2c30 2023-11-04T01:38:16.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 10 client.6594 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 10 client.6594 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 20 client.6594 populate_metadata read hostname 'smithi093' 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x55909248f2a0 0x5590924cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 4 client.6594 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 --> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590923da5b0 con 0x55909248f2a0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67e576a640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x55909248f2a0 0x5590924cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67bbfff640 10 client.6594 ms_handle_connect on v2:172.21.15.93:6834/2577358209 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67e576a640 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x55909248f2a0 0x5590924cea30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f639dd7ac913c542 server_cookie=bf14ddd4698eae1e in_seq=0 out_seq=0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67bbfff640 1 -- 172.21.15.93:0/971014117 <== mds.0 v2:172.21.15.93:6834/2577358209 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5590923da5b0 con 0x55909248f2a0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67bbfff640 10 client.6594 handle_command_reply: tid=0 2023-11-04T01:38:16.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 client.6594 shutdown 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 msgr2=0x5590924744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f67d0028000 tx=0x7f67d0004730 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 shutdown_connections 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:6834/2577358209,v1:172.21.15.93:6835/2577358209] conn(0x55909248f2a0 0x5590924cea30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5590924a7df0 0x559092474a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67bbfff640 0 client.6594 ms_handle_reset on v2:172.21.15.93:6834/2577358209 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5590924a2c30 0x5590924744f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 --2- 172.21.15.93:0/971014117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5590924a2850 0x5590924da3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 >> 172.21.15.93:0/971014117 conn(0x559092475c90 msgr2=0x5590924d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 shutdown_connections 2023-11-04T01:38:16.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.871+0000 7f67ea1fd740 1 -- 172.21.15.93:0/971014117 wait complete. 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67ea1fd740 20 client.6594 trim_cache size 0 max 16384 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 6438, 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:38:16.883 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 4.5546324760000001, 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 29, 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 66, 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 66, 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 9.6310232589999991 2023-11-04T01:38:16.884 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:16.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 msgr2=0x7f67c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 0x7f67c406d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f67e014f7f0 tx=0x7f67d0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 msgr2=0x7f67e0153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00a570 tx=0x7f67dc00aa30 comp rx=0 tx=0).stop 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 shutdown_connections 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c406ae70 0x7f67c406d330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67e014e8e0 0x7f67e014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e0141650 0x7f67e0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 --2- 172.21.15.93:0/1718460777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e0141270 0x7f67e0153140 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 >> 172.21.15.93:0/1718460777 conn(0x7f67e00ce950 msgr2=0x7f67e00cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 shutdown_connections 2023-11-04T01:38:16.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.872+0000 7f67e79ce640 1 -- 172.21.15.93:0/1718460777 wait complete. 2023-11-04T01:38:16.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:16.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.983+0000 7fcd23256640 1 Processor -- start 2023-11-04T01:38:16.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.983+0000 7fcd23256640 1 -- start start 2023-11-04T01:38:16.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd23256640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd1c0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd23256640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0c9a40 0x7fcd1c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd23256640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c06b720 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd23256640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0ca430 con 0x7fcd1c0c9a40 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd23256640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c06cf60 con 0x7fcd1c15ad80 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcd1c06a1b0 0x7fcd1c06b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52958/0 (socket says 172.21.15.93:52958) 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1bfff640 1 -- 172.21.15.93:0/2920992343 learned_addr learned my addr 172.21.15.93:0/2920992343 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd1c0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd217f3640 1 --2- 172.21.15.93:0/2920992343 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0c9a40 0x7fcd1c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405224400 0 0) 0x7fcd1c06b720 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c003520 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3012642621 0 0) 0x7fcd0c003520 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 msgr2=0x7fcd1c0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd1c0abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0c9a40 msgr2=0x7fcd1c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 --2- 172.21.15.93:0/2920992343 >> v2:172.21.15.125:3300/0 conn(0x7fcd1c0c9a40 0x7fcd1c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0ac390 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fcd08001670 con 0x7fcd1c06a1b0 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.984+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 >> v1:172.21.15.93:6789/0 conn(0x7fcd1c06a1b0 legacy=0x7fcd1c06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c004d00 0x7fcd0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0ca430 con 0x7fcd0c003970 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c06cf60 con 0x7fcd0c004d00 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c00b980 con 0x7fcd1c15ad80 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd1bfff640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd217f3640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c004d00 0x7fcd0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 -- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 msgr2=0x7fcd0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c15ad80 0x7fcd0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 -- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c004d00 msgr2=0x7fcd0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c004d00 0x7fcd0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd20ff2640 1 -- 172.21.15.93:0/2920992343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c003520 con 0x7fcd0c003970 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.985+0000 7fcd217f3640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd0c004d00 0x7fcd0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd0c003d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009ac0 tx=0x7fcd0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5553059725dd40c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1002c6b0 con 0x7fcd0c003970 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1002c810 con 0x7fcd0c003970 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd1b7fe640 1 -- 172.21.15.93:0/2920992343 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1002cba0 con 0x7fcd0c003970 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 -- 172.21.15.93:0/2920992343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 msgr2=0x7fcd0c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 --2- 172.21.15.93:0/2920992343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd0c003d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009ac0 tx=0x7fcd0c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd217f3640 1 -- 172.21.15.93:0/2920992343 reap_dead start 2023-11-04T01:38:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 -- 172.21.15.93:0/2920992343 shutdown_connections 2023-11-04T01:38:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 -- 172.21.15.93:0/2920992343 >> 172.21.15.93:0/2920992343 conn(0x7fcd1c0b0cd0 msgr2=0x7fcd1c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 -- 172.21.15.93:0/2920992343 shutdown_connections 2023-11-04T01:38:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.986+0000 7fcd23256640 1 -- 172.21.15.93:0/2920992343 wait complete. 2023-11-04T01:38:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.987+0000 7fcd23256640 1 Processor -- start 2023-11-04T01:38:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 -- start start 2023-11-04T01:38:16.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 0x7fcd1c1e1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0c7a80 0x7fcd1c1e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e06e0 con 0x7fcd0c003970 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e0980 con 0x7fcd1c0c7a80 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd23256640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e0c60 con 0x7fcd1c0c7600 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.988+0000 7fcd20ff2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52850/0 (socket says 172.21.15.93:52850) 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 -- 172.21.15.93:0/943429773 learned_addr learned my addr 172.21.15.93:0/943429773 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd1bfff640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 0x7fcd1c1e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd217f3640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0c7a80 0x7fcd1c1e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 -- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 msgr2=0x7fcd1c1e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 0x7fcd1c1e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 -- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0c7a80 msgr2=0x7fcd1c1e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0c7a80 0x7fcd1c1e1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 -- 172.21.15.93:0/943429773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c1e0f40 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd1bfff640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 0x7fcd1c1e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd20ff2640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcd1002c250 tx=0x7fcd10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003810 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10003990 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c1e1220 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003d40 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.989+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c153950 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.990+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c074290 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.990+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd10040450 con 0x7fcd0c003970 2023-11-04T01:38:16.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.991+0000 7fcd197fa640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 0x7fcd0006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.991+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcd100ab6a0 con 0x7fcd0c003970 2023-11-04T01:38:16.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.991+0000 7fcd1bfff640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 0x7fcd0006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.991+0000 7fcd1bfff640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 0x7fcd0006d360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd08001050 tx=0x7fcd08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:16.995+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd100764b0 con 0x7fcd0c003970 2023-11-04T01:38:17.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.196+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd1c153950 con 0x7fcd0c003970 2023-11-04T01:38:17.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.196+0000 7fcd197fa640 1 -- 172.21.15.93:0/943429773 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd1c153950 con 0x7fcd0c003970 2023-11-04T01:38:17.199 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 msgr2=0x7fcd0006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 0x7fcd0006d360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd08001050 tx=0x7fcd08009040 comp rx=0 tx=0).stop 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 msgr2=0x7fcd1c153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcd1002c250 tx=0x7fcd10004730 comp rx=0 tx=0).stop 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 shutdown_connections 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.198+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd0006aea0 0x7fcd0006d360 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd1c0c7a80 0x7fcd1c1e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd1c0c7600 0x7fcd1c1e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 --2- 172.21.15.93:0/943429773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd0c003970 0x7fcd1c153230 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 >> 172.21.15.93:0/943429773 conn(0x7fcd1c0b0cd0 msgr2=0x7fcd1c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 shutdown_connections 2023-11-04T01:38:17.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:17.199+0000 7fcd23256640 1 -- 172.21.15.93:0/943429773 wait complete. 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:17.212 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:17.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.213 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:17.228 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41703sec preferred_lft 41703sec 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:38:17.229 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:17.231 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:17.231 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:38:17.231 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:17.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.231 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:17.295 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:38:17.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.296 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:17.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:38:17.354 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:38:17.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.448 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:38:17.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:17.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:17.464 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:17.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.465 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:38:17.531 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:17.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:17.531 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:17.585 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:17.586 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:17.586 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:17.641 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:17.696 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:17.696 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:17.696 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:17.696 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:17.696 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:17.697 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:17.698 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:17.699 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:17.699 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:17.699 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:17.699 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:17.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.699 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:17.750 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:17.751 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:17.793 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:17.809 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:17.809 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:17.809 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:17.809 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:17.810 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:17.811 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:17.812 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:17.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:38:17.880+0000 7f02f8210480 -1 init, newargv = 0x55a6437339a0 newargc=15 2023-11-04T01:38:17.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[141519]: starting ceph client 2023-11-04T01:38:17.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[141519]: starting fuse 2023-11-04T01:38:18.039 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:38:18.037+0000 7fad7ea53640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:18.966 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:18.986 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:18.987 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:18.988 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:18.989 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:18.989 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:18.989 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:18.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:18.989 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:19.045 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:38:19.045 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:38:19.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:38:19.046 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:19.047 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:38:19.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.141519.asok 2023-11-04T01:38:19.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:19.190 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141519.asok 2023-11-04T01:38:19.190 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:19.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.141519.asok status 2023-11-04T01:38:19.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:19.365 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "141519", 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:19.366 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 6606, 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 6606 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2378938517 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:19.367 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2378938517 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.6606 192.168.0.1:0/2378938517", 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/2378938517", 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 29, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 66, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:38:19.368 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:19.373 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:19.380 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:19.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:19.381 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:19.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:19.438 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:38:19.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:19.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:19.445 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:19.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:19.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:19.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:19.513 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:38:19.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.612+0000 7ff9be118640 1 Processor -- start 2023-11-04T01:38:19.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.612+0000 7ff9be118640 1 -- start start 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9be118640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9b815d1b0 0x7ff9b80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9be118640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9b806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9be118640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b80c9bf0 con 0x7ff9b8070ff0 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9be118640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80cd890 con 0x7ff9b815d1b0 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9be118640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80cdb30 con 0x7ff9b8066000 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff9b8070ff0 0x7ff9b80713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52972/0 (socket says 172.21.15.93:52972) 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b77fe640 1 -- 172.21.15.93:0/4212814256 learned_addr learned my addr 172.21.15.93:0/4212814256 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:19.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b7fff640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9b806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/4212814256 >> v2:172.21.15.125:3300/0 conn(0x7ff9b815d1b0 0x7ff9b80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169655112 0 0) 0x7ff9b80c9bf0 con 0x7ff9b8070ff0 2023-11-04T01:38:19.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a0003520 con 0x7ff9b8070ff0 2023-11-04T01:38:19.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.613+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744118725 0 0) 0x7ff9a0003520 con 0x7ff9b8070ff0 2023-11-04T01:38:19.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 msgr2=0x7ff9b806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9b806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 >> v2:172.21.15.125:3300/0 conn(0x7ff9b815d1b0 msgr2=0x7ff9b80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 --2- 172.21.15.93:0/4212814256 >> v2:172.21.15.125:3300/0 conn(0x7ff9b815d1b0 0x7ff9b80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80cde10 con 0x7ff9b8070ff0 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff9a8001670 con 0x7ff9b8070ff0 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 >> v1:172.21.15.93:6789/0 conn(0x7ff9b8070ff0 legacy=0x7ff9b80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9a0004d00 0x7ff9a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80cd890 con 0x7ff9a0003970 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80cdb30 con 0x7ff9a0004d00 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a000b980 con 0x7ff9b8066000 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b7fff640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9a0004d00 0x7ff9a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 -- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 msgr2=0x7ff9a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b8066000 0x7ff9a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 -- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9a0004d00 msgr2=0x7ff9a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9a0004d00 0x7ff9a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b77fe640 1 -- 172.21.15.93:0/4212814256 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0003520 con 0x7ff9a0003970 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.614+0000 7ff9b7fff640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9a0004d00 0x7ff9a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9a0003d90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c290 tx=0x7ff9a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff67c2306c60cba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8005ad0 con 0x7ff9a0003970 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8005c30 con 0x7ff9a0003970 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9b67fc640 1 -- 172.21.15.93:0/4212814256 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a802c8d0 con 0x7ff9a0003970 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 -- 172.21.15.93:0/4212814256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 msgr2=0x7ff9a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 --2- 172.21.15.93:0/4212814256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9a0003d90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c290 tx=0x7ff9a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9b7fff640 1 -- 172.21.15.93:0/4212814256 reap_dead start 2023-11-04T01:38:19.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 -- 172.21.15.93:0/4212814256 shutdown_connections 2023-11-04T01:38:19.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 -- 172.21.15.93:0/4212814256 >> 172.21.15.93:0/4212814256 conn(0x7ff9b80cbc90 msgr2=0x7ff9b80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 -- 172.21.15.93:0/4212814256 shutdown_connections 2023-11-04T01:38:19.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.615+0000 7ff9be118640 1 -- 172.21.15.93:0/4212814256 wait complete. 2023-11-04T01:38:19.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 Processor -- start 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 -- start start 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 0x7ff9b81f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 0x7ff9b81f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c3b60 con 0x7ff9a0003970 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c3230 con 0x7ff9b81f6300 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.617+0000 7ff9be118640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80c3510 con 0x7ff9b80ae3c0 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52864/0 (socket says 172.21.15.93:52864) 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 -- 172.21.15.93:0/2593873804 learned_addr learned my addr 172.21.15.93:0/2593873804 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b7fff640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 0x7ff9b81f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 0x7ff9b81f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 -- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 msgr2=0x7ff9b81f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 0x7ff9b81f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 -- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 msgr2=0x7ff9b81f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 0x7ff9b81f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 -- 172.21.15.93:0/2593873804 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80c37f0 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b7fff640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 0x7ff9b81f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 0x7ff9b81f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9b77fe640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c3b0 tx=0x7ff9a8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a802cce0 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8001ca0 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80072b0 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80c2f20 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.618+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80b39c0 con 0x7ff9a0003970 2023-11-04T01:38:19.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.619+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80c3980 con 0x7ff9a0003970 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.619+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9a8032070 con 0x7ff9a0003970 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.620+0000 7ff99ffff640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 0x7ff9a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.620+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff9a803c040 con 0x7ff9a0003970 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.620+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 0x7ff9a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.620+0000 7ff9b6ffd640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 0x7ff9a406d360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80c9e20 tx=0x7ff9ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.624+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9a8075870 con 0x7ff9a0003970 2023-11-04T01:38:19.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:19.789+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7ff9b80b3bb0 con 0x7ff9a0003970 2023-11-04T01:38:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.042+0000 7ff99ffff640 1 -- 172.21.15.93:0/2593873804 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff9a8045020 con 0x7ff9a0003970 2023-11-04T01:38:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'test_data_pool' created 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 msgr2=0x7ff9a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 0x7ff9a406d360 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80c9e20 tx=0x7ff9ac008040 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 msgr2=0x7ff9b81f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c3b0 tx=0x7ff9a8000fe0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 shutdown_connections 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9a406aea0 0x7ff9a406d360 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9b81f6300 0x7ff9b81f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9b80ae3c0 0x7ff9b81f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 --2- 172.21.15.93:0/2593873804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9a0003970 0x7ff9b81f1fa0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 >> 172.21.15.93:0/2593873804 conn(0x7ff9b80cbc90 msgr2=0x7ff9b80ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 shutdown_connections 2023-11-04T01:38:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.045+0000 7ff9be118640 1 -- 172.21.15.93:0/2593873804 wait complete. 2023-11-04T01:38:20.063 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:38:20.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.161+0000 7fe961161640 1 Processor -- start 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.161+0000 7fe961161640 1 -- start start 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe961161640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe95c160430 0x7fe95c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe961161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 0x7fe95c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe961161640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c0b2fc0 con 0x7fe95c0b2b60 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe961161640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c0cb580 con 0x7fe95c160430 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe961161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c06c7f0 con 0x7fe95c06c3a0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe95c160430 0x7fe95c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe95c160430 0x7fe95c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52880/0 (socket says 172.21.15.93:52880) 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 -- 172.21.15.93:0/534784498 learned_addr learned my addr 172.21.15.93:0/534784498 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95b59e640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 0x7fe95c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 -- 172.21.15.93:0/534784498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 msgr2=0x7fe95c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 0x7fe95c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 -- 172.21.15.93:0/534784498 >> v1:172.21.15.125:6789/0 conn(0x7fe95c0b2b60 legacy=0x7fe95c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95ad9d640 1 -- 172.21.15.93:0/534784498 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c06ca40 con 0x7fe95c160430 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.162+0000 7fe95b59e640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 0x7fe95c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.163+0000 7fe95ad9d640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c160430 0x7fe95c0b2620 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009e50 tx=0x7fe94c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be4a20a4f02f745 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.163+0000 7fe959d9b640 1 -- 172.21.15.93:0/534784498 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c02ca70 con 0x7fe95c160430 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.163+0000 7fe959d9b640 1 -- 172.21.15.93:0/534784498 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c02cbd0 con 0x7fe95c160430 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.163+0000 7fe959d9b640 1 -- 172.21.15.93:0/534784498 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0343f0 con 0x7fe95c160430 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 -- 172.21.15.93:0/534784498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c160430 msgr2=0x7fe95c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c160430 0x7fe95c0b2620 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009e50 tx=0x7fe94c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 -- 172.21.15.93:0/534784498 shutdown_connections 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c06c3a0 0x7fe95c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 --2- 172.21.15.93:0/534784498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c160430 0x7fe95c0b2620 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 -- 172.21.15.93:0/534784498 >> 172.21.15.93:0/534784498 conn(0x7fe95c06ea20 msgr2=0x7fe95c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 -- 172.21.15.93:0/534784498 shutdown_connections 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.164+0000 7fe961161640 1 -- 172.21.15.93:0/534784498 wait complete. 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.165+0000 7fe961161640 1 Processor -- start 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.165+0000 7fe961161640 1 -- start start 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 0x7fe95c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 0x7fe95c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0ca160 con 0x7fe95c06c3a0 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c9550 con 0x7fe95c0b2b60 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe961161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c9830 con 0x7fe95c160430 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52886/0 (socket says 172.21.15.93:52886) 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 -- 172.21.15.93:0/200424478 learned_addr learned my addr 172.21.15.93:0/200424478 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95b59e640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 0x7fe95c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95a59c640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 0x7fe95c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 -- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 msgr2=0x7fe95c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 0x7fe95c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 -- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 msgr2=0x7fe95c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 0x7fe95c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95ad9d640 1 -- 172.21.15.93:0/200424478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c009b30 con 0x7fe95c06c3a0 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95b59e640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 0x7fe95c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.166+0000 7fe95a59c640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 0x7fe95c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe95ad9d640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009e50 tx=0x7fe94c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c03e450 con 0x7fe95c06c3a0 2023-11-04T01:38:20.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c03e5f0 con 0x7fe95c06c3a0 2023-11-04T01:38:20.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c0c9b10 con 0x7fe95c06c3a0 2023-11-04T01:38:20.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c03e9a0 con 0x7fe95c06c3a0 2023-11-04T01:38:20.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.167+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c1525d0 con 0x7fe95c06c3a0 2023-11-04T01:38:20.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.168+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c074290 con 0x7fe95c06c3a0 2023-11-04T01:38:20.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.168+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe94c03eb00 con 0x7fe95c06c3a0 2023-11-04T01:38:20.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.169+0000 7fe9437fe640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 0x7fe94806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.169+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe94c0ac5f0 con 0x7fe95c06c3a0 2023-11-04T01:38:20.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.169+0000 7fe95a59c640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 0x7fe94806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.169+0000 7fe95a59c640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 0x7fe94806d360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0b0e80 tx=0x7fe950009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.173+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe94c077330 con 0x7fe95c06c3a0 2023-11-04T01:38:20.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:20.344+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7fe95c0c4020 con 0x7fe95c06c3a0 2023-11-04T01:38:21.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.049+0000 7fe9437fe640 1 -- 172.21.15.93:0/200424478 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v68) v1 ==== 126+0+0 (secure 0 0 0) 0x7fe94c03edb0 con 0x7fe95c06c3a0 2023-11-04T01:38:21.052 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'test_metadata_pool' created 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 msgr2=0x7fe94806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 0x7fe94806d360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0b0e80 tx=0x7fe950009040 comp rx=0 tx=0).stop 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 msgr2=0x7fe95c0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009e50 tx=0x7fe94c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 shutdown_connections 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe94806aea0 0x7fe94806d360 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe95c160430 0x7fe95c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe95c0b2b60 0x7fe95c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 --2- 172.21.15.93:0/200424478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe95c06c3a0 0x7fe95c0ca5f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 >> 172.21.15.93:0/200424478 conn(0x7fe95c06ea20 msgr2=0x7fe95c0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.053+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 shutdown_connections 2023-11-04T01:38:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.054+0000 7fe961161640 1 -- 172.21.15.93:0/200424478 wait complete. 2023-11-04T01:38:21.080 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:38:21.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 Processor -- start 2023-11-04T01:38:21.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 -- start start 2023-11-04T01:38:21.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e75530 0x563d56e71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e944f0 0x563d56e73a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d56d6fac0 con 0x563d56e94110 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d56d6b3b0 con 0x563d56e944f0 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.121+0000 7f711da48f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d56d05650 con 0x563d56e75530 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52910/0 (socket says 172.21.15.93:52910) 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 -- 172.21.15.93:0/205869943 learned_addr learned my addr 172.21.15.93:0/205869943 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711a60f640 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e75530 0x563d56e71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711b611640 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e944f0 0x563d56e73a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 -- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e75530 msgr2=0x563d56e71cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e75530 0x563d56e71cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 -- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e944f0 msgr2=0x563d56e73a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:21.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e944f0 0x563d56e73a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 -- 172.21.15.93:0/205869943 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d56d04930 con 0x563d56e94110 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711ae10640 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f710c009760 tx=0x7f710c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9592f2fd6ed3d78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711960d640 1 -- 172.21.15.93:0/205869943 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00f040 con 0x563d56e94110 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711960d640 1 -- 172.21.15.93:0/205869943 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c008930 con 0x563d56e94110 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.122+0000 7f711960d640 1 -- 172.21.15.93:0/205869943 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c008cc0 con 0x563d56e94110 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- 172.21.15.93:0/205869943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 msgr2=0x563d56e71770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f710c009760 tx=0x7f710c005a00 comp rx=0 tx=0).stop 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- 172.21.15.93:0/205869943 shutdown_connections 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e944f0 0x563d56e73a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e75530 0x563d56e71cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 --2- 172.21.15.93:0/205869943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e94110 0x563d56e71770 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- 172.21.15.93:0/205869943 >> 172.21.15.93:0/205869943 conn(0x563d56de7f40 msgr2=0x563d56e05560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- 172.21.15.93:0/205869943 shutdown_connections 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- 172.21.15.93:0/205869943 wait complete. 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 Processor -- start 2023-11-04T01:38:21.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.123+0000 7f711da48f40 1 -- start start 2023-11-04T01:38:21.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e94110 0x563d56e70bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e944f0 0x563d56de7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d56d052f0 con 0x563d56e75530 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d56ce54f0 con 0x563d56e94110 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711da48f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d56e89000 con 0x563d56e944f0 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52912/0 (socket says 172.21.15.93:52912) 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 -- 172.21.15.93:0/1010688214 learned_addr learned my addr 172.21.15.93:0/1010688214 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711b611640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e944f0 0x563d56de7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711a60f640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e94110 0x563d56e70bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 -- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e944f0 msgr2=0x563d56de7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e944f0 0x563d56de7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 -- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e94110 msgr2=0x563d56e70bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e94110 0x563d56e70bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.124+0000 7f711ae10640 1 -- 172.21.15.93:0/1010688214 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c009410 con 0x563d56e75530 2023-11-04T01:38:21.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f711ae10640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f710c005f30 tx=0x7f710c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00f040 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c015880 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c015c70 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d56d04390 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.125+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d56e87310 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.126+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f710c028460 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.126+0000 7f7103fff640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 0x7f710806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.126+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f710c08a8b0 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.126+0000 7f711a60f640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 0x7f710806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.127+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(create snap pool 12 tid 1 name snap4 v0) v4 -- 0x563d56d75330 con 0x563d56e75530 2023-11-04T01:38:21.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:21.127+0000 7f711a60f640 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 0x7f710806bce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7110002fd0 tx=0x7f7110001730 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.486 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:21.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:22.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.059+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v69) v1 ==== 43+0+0 (secure 0 0 0) 0x7f710c055530 con 0x563d56e75530 2023-11-04T01:38:22.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.059+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f7108073f00 con 0x563d56e75530 2023-11-04T01:38:22.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f7103fff640 1 -- 172.21.15.93:0/1010688214 <== mon.0 v2:172.21.15.93:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 718+0+0 (secure 0 0 0) 0x7f710c0591f0 con 0x563d56e75530 2023-11-04T01:38:22.062 INFO:teuthology.orchestra.run.smithi093.stdout:created pool test_data_pool snap snap4 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 msgr2=0x7f710806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 0x7f710806bce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7110002fd0 tx=0x7f7110001730 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 msgr2=0x563d56e87b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f710c005f30 tx=0x7f710c002fb0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 shutdown_connections 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7108069820 0x7f710806bce0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563d56e944f0 0x563d56de7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563d56e94110 0x563d56e70bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 --2- 172.21.15.93:0/1010688214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563d56e75530 0x563d56e87b80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 >> 172.21.15.93:0/1010688214 conn(0x563d56de7f40 msgr2=0x563d56e8e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 shutdown_connections 2023-11-04T01:38:22.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.060+0000 7f711da48f40 1 -- 172.21.15.93:0/1010688214 wait complete. 2023-11-04T01:38:22.068 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:38:22.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.178+0000 7f31f994c640 1 Processor -- start 2023-11-04T01:38:22.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.178+0000 7f31f994c640 1 -- start start 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f994c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31f4153e60 0x7f31f415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f994c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f994c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40cde60 con 0x7f31f40cd6d0 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f994c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f4160f90 con 0x7f31f4153e60 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f994c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b5200 con 0x7f31f40b4880 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31f4153e60 0x7f31f415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31f4153e60 0x7f31f415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41168/0 (socket says 172.21.15.93:41168) 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.179+0000 7f31f2ffd640 1 -- 172.21.15.93:0/2460956137 learned_addr learned my addr 172.21.15.93:0/2460956137 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f37fe640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f2ffd640 1 -- 172.21.15.93:0/2460956137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 msgr2=0x7f31f40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f2ffd640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f2ffd640 1 -- 172.21.15.93:0/2460956137 >> v1:172.21.15.125:6789/0 conn(0x7f31f40cd6d0 legacy=0x7f31f4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f2ffd640 1 -- 172.21.15.93:0/2460956137 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f415e400 con 0x7f31f4153e60 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.180+0000 7f31f2ffd640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f415dec0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fbadb1f0a49e61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f1ffb640 1 -- 172.21.15.93:0/2460956137 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e402cb00 con 0x7f31f4153e60 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f1ffb640 1 -- 172.21.15.93:0/2460956137 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e402cc60 con 0x7f31f4153e60 2023-11-04T01:38:22.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f1ffb640 1 -- 172.21.15.93:0/2460956137 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40343f0 con 0x7f31f4153e60 2023-11-04T01:38:22.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 -- 172.21.15.93:0/2460956137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 msgr2=0x7f31f415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f415dec0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e402bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 -- 172.21.15.93:0/2460956137 shutdown_connections 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 --2- 172.21.15.93:0/2460956137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f415dec0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 -- 172.21.15.93:0/2460956137 >> 172.21.15.93:0/2460956137 conn(0x7f31f40cf880 msgr2=0x7f31f40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 -- 172.21.15.93:0/2460956137 shutdown_connections 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.181+0000 7f31f994c640 1 -- 172.21.15.93:0/2460956137 wait complete. 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.182+0000 7f31f994c640 1 Processor -- start 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 -- start start 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f41586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.188 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f40cd6d0 0x7f31f4157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f4154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4157660 con 0x7f31f4153e60 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f41551d0 con 0x7f31f40cd6d0 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f994c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4159360 con 0x7f31f40b4880 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f4154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f4154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41182/0 (socket says 172.21.15.93:41182) 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f37fe640 1 -- 172.21.15.93:0/1940707030 learned_addr learned my addr 172.21.15.93:0/1940707030 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.183+0000 7f31f2ffd640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f41586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f27fc640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f40cd6d0 0x7f31f4157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 -- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 msgr2=0x7f31f41586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f31f40b4880 0x7f31f41586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 -- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f40cd6d0 msgr2=0x7f31f4157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f40cd6d0 0x7f31f4157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 -- 172.21.15.93:0/1940707030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009b30 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f37fe640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31f4153e60 0x7f31f4154c90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00e960 tx=0x7f31ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec009690 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00c980 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00cd30 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f994c640 1 -- 172.21.15.93:0/1940707030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f4154240 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.184+0000 7f31f994c640 1 -- 172.21.15.93:0/1940707030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4159080 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.185+0000 7f31f994c640 1 -- 172.21.15.93:0/1940707030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4074290 con 0x7f31f4153e60 2023-11-04T01:38:22.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.185+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31ec013470 con 0x7f31f4153e60 2023-11-04T01:38:22.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.186+0000 7f31dbfff640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f31e006ae70 0x7f31e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.186+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f31ec089c60 con 0x7f31f4153e60 2023-11-04T01:38:22.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.186+0000 7f31f2ffd640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f31e006ae70 0x7f31e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.186+0000 7f31f2ffd640 1 --2- 172.21.15.93:0/1940707030 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f31e006ae70 0x7f31e006d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f31e4035000 tx=0x7f31e4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.190+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31ec0548c0 con 0x7f31f4153e60 2023-11-04T01:38:22.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.393+0000 7f31f994c640 1 -- 172.21.15.93:0/1940707030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f31f40d0b80 con 0x7f31f4153e60 2023-11-04T01:38:22.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.393+0000 7f31dbfff640 1 -- 172.21.15.93:0/1940707030 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(12) already has mon-managed snaps; can't attach pool to fs v29) v1 ==== 198+0+0 (secure 0 0 0) 0x7f31ec0170c0 con 0x7f31f4153e60 2023-11-04T01:38:22.395 INFO:teuthology.orchestra.run.smithi093.stderr:Error ENOTSUP: pool(12) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:38:22.400 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:22.400 DEBUG:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:38:22.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.438+0000 7fe403438f40 1 Processor -- start 2023-11-04T01:38:22.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.438+0000 7fe403438f40 1 -- start start 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba585f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba5851f9c0 0x55ba585dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba584cd3b0 con 0x55ba585dce40 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba58467650 con 0x55ba5851c730 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe403438f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba584672f0 con 0x55ba5851f9c0 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41188/0 (socket says 172.21.15.93:41188) 2023-11-04T01:38:22.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 -- 172.21.15.93:0/2585654563 learned_addr learned my addr 172.21.15.93:0/2585654563 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 -- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba5851f9c0 msgr2=0x55ba585dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba5851f9c0 0x55ba585dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 -- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 msgr2=0x55ba585f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba585f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 -- 172.21.15.93:0/2585654563 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8005d20 con 0x55ba585dce40 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe400fe3640 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800b650 tx=0x7fe3f800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ad8388367b556 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe3ff7e0640 1 -- 172.21.15.93:0/2585654563 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8009910 con 0x55ba585dce40 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe3ff7e0640 1 -- 172.21.15.93:0/2585654563 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f800b050 con 0x55ba585dce40 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.439+0000 7fe3ff7e0640 1 -- 172.21.15.93:0/2585654563 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8009cd0 con 0x55ba585dce40 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- 172.21.15.93:0/2585654563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 msgr2=0x55ba585d4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800b650 tx=0x7fe3f800bb10 comp rx=0 tx=0).stop 2023-11-04T01:38:22.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- 172.21.15.93:0/2585654563 shutdown_connections 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba585dce40 0x55ba585d4980 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba5851f9c0 0x55ba585dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 --2- 172.21.15.93:0/2585654563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba585f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- 172.21.15.93:0/2585654563 >> 172.21.15.93:0/2585654563 conn(0x55ba58549f40 msgr2=0x55ba585f6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- 172.21.15.93:0/2585654563 shutdown_connections 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- 172.21.15.93:0/2585654563 wait complete. 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 Processor -- start 2023-11-04T01:38:22.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.440+0000 7fe403438f40 1 -- start start 2023-11-04T01:38:22.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba5854c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 0x55ba585dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba584474f0 con 0x55ba5851f9c0 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba585dc5b0 con 0x55ba5851c730 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe403438f40 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba585dba30 con 0x55ba585dce40 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41192/0 (socket says 172.21.15.93:41192) 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe3f7fff640 1 -- 172.21.15.93:0/2444376603 learned_addr learned my addr 172.21.15.93:0/2444376603 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe400fe3640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 0x55ba585dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.441+0000 7fe4007e2640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba5854c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 -- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 msgr2=0x55ba585dacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 0x55ba585dacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 -- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 msgr2=0x55ba5854c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba5854c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 -- 172.21.15.93:0/2444376603 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f800b250 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe400fe3640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 0x55ba585dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3f7fff640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a440 tx=0x7fe3e804acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80529c0 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8052b20 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba58473780 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e805c400 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.442+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba58466930 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.443+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3e805c560 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.443+0000 7fe3fe7de640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 0x7fe3e006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.443+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7fe3e80c9fb0 con 0x55ba5851f9c0 2023-11-04T01:38:22.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.444+0000 7fe4007e2640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 0x7fe3e006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.444+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- pool_op(delete snap pool 12 tid 1 name snap4 v0) v4 -- 0x55ba584d7330 con 0x55ba5851f9c0 2023-11-04T01:38:22.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:22.444+0000 7fe4007e2640 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 0x7fe3e006bce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000f60 tx=0x7fe3f0001470 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.060+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v70) v1 ==== 43+0+0 (secure 0 0 0) 0x7fe3e806a080 con 0x55ba5851f9c0 2023-11-04T01:38:23.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fe3e0073f60 con 0x55ba5851f9c0 2023-11-04T01:38:23.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe3fe7de640 1 -- 172.21.15.93:0/2444376603 <== mon.0 v2:172.21.15.93:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 970+0+0 (secure 0 0 0) 0x7fe3e8098f20 con 0x55ba5851f9c0 2023-11-04T01:38:23.063 INFO:teuthology.orchestra.run.smithi093.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:38:23.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 msgr2=0x7fe3e006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 0x7fe3e006bce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000f60 tx=0x7fe3f0001470 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 msgr2=0x55ba585f2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a440 tx=0x7fe3e804acd0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 shutdown_connections 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe3e0069820 0x7fe3e006bce0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55ba585dce40 0x55ba585dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ba5851f9c0 0x55ba585f2820 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 --2- 172.21.15.93:0/2444376603 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba5851c730 0x55ba5854c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.061+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 >> 172.21.15.93:0/2444376603 conn(0x55ba58549f40 msgr2=0x55ba585f6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.062+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 shutdown_connections 2023-11-04T01:38:23.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.062+0000 7fe403438f40 1 -- 172.21.15.93:0/2444376603 wait complete. 2023-11-04T01:38:23.067 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:38:23.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 Processor -- start 2023-11-04T01:38:23.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 -- start start 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74b40d0710 0x7f74b40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f74b40cda50 0x7f74b40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40d0280 con 0x7f74b415e430 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40cf670 con 0x7f74b40d0710 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.211+0000 7f74bb090640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40cf950 con 0x7f74b40cda50 2023-11-04T01:38:23.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b8e2c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f74b415e430 0x7f74b40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50884/0 (socket says 172.21.15.93:50884) 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b8e2c640 1 -- 172.21.15.93:0/1605661098 learned_addr learned my addr 172.21.15.93:0/1605661098 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b3fff640 1 --2- 172.21.15.93:0/1605661098 >> v2:172.21.15.93:3300/0 conn(0x7f74b40d0710 0x7f74b40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b3fff640 1 -- 172.21.15.93:0/1605661098 >> v2:172.21.15.125:3300/0 conn(0x7f74b40cda50 msgr2=0x7f74b40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b3fff640 1 --2- 172.21.15.93:0/1605661098 >> v2:172.21.15.125:3300/0 conn(0x7f74b40cda50 0x7f74b40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b3fff640 1 -- 172.21.15.93:0/1605661098 >> v1:172.21.15.93:6789/0 conn(0x7f74b415e430 legacy=0x7f74b40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b3fff640 1 -- 172.21.15.93:0/1605661098 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40cfc30 con 0x7f74b40d0710 2023-11-04T01:38:23.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.212+0000 7f74b37fe640 1 -- 172.21.15.93:0/1605661098 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019530765 0 0) 0x7f74b40d0280 con 0x7f74b415e430 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74b3fff640 1 --2- 172.21.15.93:0/1605661098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b40d0710 0x7f74b40cd510 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f74b40b6250 tx=0x7f74a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d1563b77a72f02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74b37fe640 1 -- 172.21.15.93:0/1605661098 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8031830 con 0x7f74b40d0710 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74b37fe640 1 -- 172.21.15.93:0/1605661098 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8031990 con 0x7f74b40d0710 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74b37fe640 1 -- 172.21.15.93:0/1605661098 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8031d20 con 0x7f74b40d0710 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 -- 172.21.15.93:0/1605661098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b40d0710 msgr2=0x7f74b40cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 --2- 172.21.15.93:0/1605661098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b40d0710 0x7f74b40cd510 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f74b40b6250 tx=0x7f74a802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 -- 172.21.15.93:0/1605661098 shutdown_connections 2023-11-04T01:38:23.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 --2- 172.21.15.93:0/1605661098 >> v2:172.21.15.125:3300/0 conn(0x7f74b40cda50 0x7f74b40b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 --2- 172.21.15.93:0/1605661098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b40d0710 0x7f74b40cd510 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 -- 172.21.15.93:0/1605661098 >> 172.21.15.93:0/1605661098 conn(0x7f74b406ea20 msgr2=0x7f74b406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 -- 172.21.15.93:0/1605661098 shutdown_connections 2023-11-04T01:38:23.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.213+0000 7f74bb090640 1 -- 172.21.15.93:0/1605661098 wait complete. 2023-11-04T01:38:23.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.214+0000 7f74bb090640 1 Processor -- start 2023-11-04T01:38:23.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.214+0000 7f74bb090640 1 -- start start 2023-11-04T01:38:23.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74b40cda50 0x7f74b4159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74b40d0710 0x7f74b40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b415e430 0x7f74b41e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41f1100 con 0x7f74b415e430 2023-11-04T01:38:23.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41f0870 con 0x7f74b40d0710 2023-11-04T01:38:23.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74bb090640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40cb120 con 0x7f74b40cda50 2023-11-04T01:38:23.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74b962d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b415e430 0x7f74b41e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74b962d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b415e430 0x7f74b41e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41196/0 (socket says 172.21.15.93:41196) 2023-11-04T01:38:23.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.215+0000 7f74b962d640 1 -- 172.21.15.93:0/4200995544 learned_addr learned my addr 172.21.15.93:0/4200995544 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b3fff640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74b40d0710 0x7f74b40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b8e2c640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74b40cda50 0x7f74b4159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 -- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74b40cda50 msgr2=0x7f74b4159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74b40cda50 0x7f74b4159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 -- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74b40d0710 msgr2=0x7f74b40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74b40d0710 0x7f74b40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 -- 172.21.15.93:0/4200995544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009400 con 0x7f74b415e430 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b8e2c640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74b40cda50 0x7f74b4159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b962d640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74b415e430 0x7f74b41e4730 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b9a0 tx=0x7f74ac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00cba0 con 0x7f74b415e430 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00cd20 con 0x7f74b415e430 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74bb090640 1 -- 172.21.15.93:0/4200995544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b41598b0 con 0x7f74b415e430 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac014680 con 0x7f74b415e430 2023-11-04T01:38:23.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.216+0000 7f74bb090640 1 -- 172.21.15.93:0/4200995544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b40cae40 con 0x7f74b415e430 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.217+0000 7f74bb090640 1 -- 172.21.15.93:0/4200995544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b41f1240 con 0x7f74b415e430 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.217+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74ac01d3b0 con 0x7f74b415e430 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.218+0000 7f74b17fa640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74a006ae70 0x7f74a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.218+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f74ac089ac0 con 0x7f74b415e430 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.218+0000 7f74b8e2c640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74a006ae70 0x7f74a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.218+0000 7f74b8e2c640 1 --2- 172.21.15.93:0/4200995544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74a006ae70 0x7f74a006d330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000f60 tx=0x7f74a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.222+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74b41f1240 con 0x7f74b415e430 2023-11-04T01:38:23.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.392+0000 7f74bb090640 1 -- 172.21.15.93:0/4200995544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f74b41f1240 con 0x7f74b415e430 2023-11-04T01:38:23.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.392+0000 7f74b17fa640 1 -- 172.21.15.93:0/4200995544 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 296+0+0 (secure 0 0 0) 0x7f74b41f1240 con 0x7f74b415e430 2023-11-04T01:38:23.395 INFO:teuthology.orchestra.run.smithi093.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:38:23.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:23.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.500+0000 7f164f11d640 1 Processor -- start 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.500+0000 7f164f11d640 1 -- start start 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164f11d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1648159c00 0x7f16480cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164f11d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164815aff0 con 0x7f16480c48e0 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164f11d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164815a3e0 con 0x7f16480ae1d0 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164f11d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164815a6c0 con 0x7f1648159c00 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1648159c00 0x7f16480cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1648159c00 0x7f16480cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41212/0 (socket says 172.21.15.93:41212) 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 -- 172.21.15.93:0/2990062986 learned_addr learned my addr 172.21.15.93:0/2990062986 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f1647fff640 1 --1- 172.21.15.93:0/2990062986 >> v1:172.21.15.93:6789/0 conn(0x7f16480c48e0 0x7f16480adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50894/0 (socket says 172.21.15.93:50894) 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 -- 172.21.15.93:0/2990062986 >> v1:172.21.15.125:6789/0 conn(0x7f16480ae1d0 legacy=0x7f16480709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 -- 172.21.15.93:0/2990062986 >> v1:172.21.15.93:6789/0 conn(0x7f16480c48e0 legacy=0x7f16480adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.501+0000 7f164ceb9640 1 -- 172.21.15.93:0/2990062986 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164815a9a0 con 0x7f1648159c00 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164ceb9640 1 --2- 172.21.15.93:0/2990062986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f16480cc890 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f163c009870 tx=0x7f163c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c06713fc5f5f99 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f16477fe640 1 -- 172.21.15.93:0/2990062986 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c031870 con 0x7f1648159c00 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f16477fe640 1 -- 172.21.15.93:0/2990062986 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c0319d0 con 0x7f1648159c00 2023-11-04T01:38:23.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f16477fe640 1 -- 172.21.15.93:0/2990062986 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c031d60 con 0x7f1648159c00 2023-11-04T01:38:23.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 -- 172.21.15.93:0/2990062986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 msgr2=0x7f16480cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 --2- 172.21.15.93:0/2990062986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f16480cc890 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f163c009870 tx=0x7f163c02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:23.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 -- 172.21.15.93:0/2990062986 shutdown_connections 2023-11-04T01:38:23.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 --2- 172.21.15.93:0/2990062986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f16480cc890 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 -- 172.21.15.93:0/2990062986 >> 172.21.15.93:0/2990062986 conn(0x7f16480ce950 msgr2=0x7f16480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 -- 172.21.15.93:0/2990062986 shutdown_connections 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.502+0000 7f164f11d640 1 -- 172.21.15.93:0/2990062986 wait complete. 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 Processor -- start 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 -- start start 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16480ae1d0 0x7f164814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480c48e0 0x7f16480c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f164814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c73f0 con 0x7f1648159c00 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c6f60 con 0x7f16480c48e0 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.504+0000 7f164f11d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164814c3d0 con 0x7f16480ae1d0 2023-11-04T01:38:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f164814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f164814d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41228/0 (socket says 172.21.15.93:41228) 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 -- 172.21.15.93:0/1354494980 learned_addr learned my addr 172.21.15.93:0/1354494980 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f1647fff640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480c48e0 0x7f16480c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164ceb9640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16480ae1d0 0x7f164814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 -- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16480ae1d0 msgr2=0x7f164814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16480ae1d0 0x7f164814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 -- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480c48e0 msgr2=0x7f16480c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16480c48e0 0x7f16480c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 -- 172.21.15.93:0/1354494980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0094d0 con 0x7f1648159c00 2023-11-04T01:38:23.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164d6ba640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1648159c00 0x7f164814d780 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f164000c780 tx=0x7f164000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640003d80 con 0x7f1648159c00 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000ce90 con 0x7f1648159c00 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400052b0 con 0x7f1648159c00 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164f11d640 1 -- 172.21.15.93:0/1354494980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16480c6350 con 0x7f1648159c00 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.505+0000 7f164f11d640 1 -- 172.21.15.93:0/1354494980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16480c6910 con 0x7f1648159c00 2023-11-04T01:38:23.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.506+0000 7f164f11d640 1 -- 172.21.15.93:0/1354494980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480c3fa0 con 0x7f1648159c00 2023-11-04T01:38:23.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.507+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1640005410 con 0x7f1648159c00 2023-11-04T01:38:23.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.507+0000 7f16457fa640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f162c06ae70 0x7f162c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.507+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1640089080 con 0x7f1648159c00 2023-11-04T01:38:23.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.507+0000 7f164ceb9640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f162c06ae70 0x7f162c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.507+0000 7f164ceb9640 1 --2- 172.21.15.93:0/1354494980 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f162c06ae70 0x7f162c06d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f163c036000 tx=0x7f163c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.511+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1640053b90 con 0x7f1648159c00 2023-11-04T01:38:23.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.677+0000 7f164f11d640 1 -- 172.21.15.93:0/1354494980 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f1648074290 con 0x7f1648159c00 2023-11-04T01:38:23.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.677+0000 7f16457fa640 1 -- 172.21.15.93:0/1354494980 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 304+0+0 (secure 0 0 0) 0x7f16400170a0 con 0x7f1648159c00 2023-11-04T01:38:23.679 INFO:teuthology.orchestra.run.smithi093.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:38:23.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:23.684 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:23.684 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:23.728 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:23.773 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:23.773 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:23.773 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:23.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:23.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.927+0000 7f180896e640 1 Processor -- start 2023-11-04T01:38:23.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.927+0000 7f180896e640 1 -- start start 2023-11-04T01:38:23.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f180896e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18040cde60 0x7f180415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f180896e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f1804157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f180896e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180415e000 con 0x7f18040ce240 2023-11-04T01:38:23.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f180896e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180415e5c0 con 0x7f18040cde60 2023-11-04T01:38:23.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f180896e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e2e0 con 0x7f180415daa0 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f1802d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f18040ce240 0x7f180406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50908/0 (socket says 172.21.15.93:50908) 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.928+0000 7f1802d9d640 1 -- 172.21.15.93:0/3347174238 learned_addr learned my addr 172.21.15.93:0/3347174238 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1801d9b640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f1804157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180259c640 1 --2- 172.21.15.93:0/3347174238 >> v2:172.21.15.125:3300/0 conn(0x7f18040cde60 0x7f180415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899289061 0 0) 0x7f180415e000 con 0x7f18040ce240 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0003520 con 0x7f18040ce240 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993197977 0 0) 0x7f17f0003520 con 0x7f18040ce240 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 msgr2=0x7f1804157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f1804157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 >> v2:172.21.15.125:3300/0 conn(0x7f18040cde60 msgr2=0x7f180415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 --2- 172.21.15.93:0/3347174238 >> v2:172.21.15.125:3300/0 conn(0x7f18040cde60 0x7f180415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040d1120 con 0x7f18040ce240 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f17fc001670 con 0x7f18040ce240 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 >> v1:172.21.15.93:6789/0 conn(0x7f18040ce240 legacy=0x7f180406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0003970 0x7f17f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f17f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e5c0 con 0x7f17f0004d00 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e2e0 con 0x7f17f0003970 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f000b980 con 0x7f180415daa0 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f180259c640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0003970 0x7f17f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1801d9b640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f17f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 -- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 msgr2=0x7f17f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f180415daa0 0x7f17f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 -- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0003970 msgr2=0x7f17f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17f0003970 0x7f17f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.929+0000 7f1802d9d640 1 -- 172.21.15.93:0/3347174238 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0003520 con 0x7f17f0004d00 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.930+0000 7f1802d9d640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c2c0 tx=0x7f17f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ce06a88ef8efef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.930+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc005ad0 con 0x7f17f0004d00 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.930+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc005c30 con 0x7f17f0004d00 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.930+0000 7f180159a640 1 -- 172.21.15.93:0/3347174238 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc02c8b0 con 0x7f17f0004d00 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 -- 172.21.15.93:0/3347174238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f0004d00 msgr2=0x7f17f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 --2- 172.21.15.93:0/3347174238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c2c0 tx=0x7f17f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f1802d9d640 1 -- 172.21.15.93:0/3347174238 reap_dead start 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 -- 172.21.15.93:0/3347174238 shutdown_connections 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 -- 172.21.15.93:0/3347174238 >> 172.21.15.93:0/3347174238 conn(0x7f1804071f30 msgr2=0x7f18040cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 -- 172.21.15.93:0/3347174238 shutdown_connections 2023-11-04T01:38:23.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.931+0000 7f180896e640 1 -- 172.21.15.93:0/3347174238 wait complete. 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.932+0000 7f180896e640 1 Processor -- start 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.932+0000 7f180896e640 1 -- start start 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0004d00 0x7f18040b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18041f2e40 0x7f1804159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804159660 con 0x7f18041f29c0 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804157b40 con 0x7f18041f2e40 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f180896e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1804157e20 con 0x7f17f0004d00 2023-11-04T01:38:23.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41242/0 (socket says 172.21.15.93:41242) 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 -- 172.21.15.93:0/2748969915 learned_addr learned my addr 172.21.15.93:0/2748969915 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 -- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0004d00 msgr2=0x7f18040b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0004d00 0x7f18040b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 -- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18041f2e40 msgr2=0x7f1804159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18041f2e40 0x7f1804159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 -- 172.21.15.93:0/2748969915 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804158100 con 0x7f18041f29c0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.933+0000 7f1801d9b640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0119a0 tx=0x7f17ec011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.934+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00fa70 con 0x7f18041f29c0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.934+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00fbd0 con 0x7f18041f29c0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.934+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18041583e0 con 0x7f18041f29c0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.934+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec014440 con 0x7f18041f29c0 2023-11-04T01:38:23.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.934+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18040b8300 con 0x7f18041f29c0 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.935+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1804074290 con 0x7f18041f29c0 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.935+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17ec0145a0 con 0x7f18041f29c0 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.935+0000 7f17faffd640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 0x7f17e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.936+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f17ec08a2e0 con 0x7f18041f29c0 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.936+0000 7f180259c640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 0x7f17e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.936+0000 7f180259c640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 0x7f17e406d360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009f40 tx=0x7f17f4009750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:23.940+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17ec054e80 con 0x7f18041f29c0 2023-11-04T01:38:24.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.109+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18040b68b0 con 0x7f18041f29c0 2023-11-04T01:38:24.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.110+0000 7f17faffd640 1 -- 172.21.15.93:0/2748969915 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+22113 (secure 0 0 0) 0x7f17ec0584a0 con 0x7f18041f29c0 2023-11-04T01:38:24.111 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:24.112 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":70,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:23.055320+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 msgr2=0x7f17e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 0x7f17e406d360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009f40 tx=0x7f17f4009750 comp rx=0 tx=0).stop 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 msgr2=0x7f1804158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0119a0 tx=0x7f17ec011e60 comp rx=0 tx=0).stop 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 shutdown_connections 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f17e406aea0 0x7f17e406d360 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18041f2e40 0x7f1804159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18041f29c0 0x7f1804158be0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 --2- 172.21.15.93:0/2748969915 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f17f0004d00 0x7f18040b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 >> 172.21.15.93:0/2748969915 conn(0x7f1804071f30 msgr2=0x7f18040b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 shutdown_connections 2023-11-04T01:38:24.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.112+0000 7f180896e640 1 -- 172.21.15.93:0/2748969915 wait complete. 2023-11-04T01:38:24.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:10.157966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:10.624302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:24.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:24.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.228+0000 7fe2f72b4640 1 Processor -- start 2023-11-04T01:38:24.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.228+0000 7fe2f72b4640 1 -- start start 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f72b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2f015d1b0 0x7fe2f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f72b4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00c9bf0 con 0x7fe2f0070ff0 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f72b4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00cd890 con 0x7fe2f0066000 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f72b4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00cdb30 con 0x7fe2f015d1b0 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f5050640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe2f0070ff0 0x7fe2f00713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50912/0 (socket says 172.21.15.93:50912) 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f5050640 1 -- 172.21.15.93:0/1143105552 learned_addr learned my addr 172.21.15.93:0/1143105552 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f484f640 1 --2- 172.21.15.93:0/1143105552 >> v2:172.21.15.125:3300/0 conn(0x7fe2f015d1b0 0x7fe2f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964255861 0 0) 0x7fe2f00c9bf0 con 0x7fe2f0070ff0 2023-11-04T01:38:24.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc003520 con 0x7fe2f0070ff0 2023-11-04T01:38:24.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591313356 0 0) 0x7fe2dc003520 con 0x7fe2f0070ff0 2023-11-04T01:38:24.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 >> v2:172.21.15.125:3300/0 conn(0x7fe2f015d1b0 msgr2=0x7fe2f00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 --2- 172.21.15.93:0/1143105552 >> v2:172.21.15.125:3300/0 conn(0x7fe2f015d1b0 0x7fe2f00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 >> v1:172.21.15.125:6789/0 conn(0x7fe2f0066000 legacy=0x7fe2f006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00cde10 con 0x7fe2f0070ff0 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fe2ec001670 con 0x7fe2f0070ff0 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 >> v1:172.21.15.93:6789/0 conn(0x7fe2f0070ff0 legacy=0x7fe2f00713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2dc003970 0x7fe2dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2dc005180 0x7fe2dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00cdb30 con 0x7fe2dc0047c0 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00c020 con 0x7fe2dc003970 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00c1e0 con 0x7fe2dc005180 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f484f640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.229+0000 7fe2f5050640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2dc003970 0x7fe2dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f5851640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2dc005180 0x7fe2dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 -- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2dc005180 msgr2=0x7fe2dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2dc005180 0x7fe2dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 -- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2dc003970 msgr2=0x7fe2dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2dc003970 0x7fe2dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 -- 172.21.15.93:0/1143105552 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc003520 con 0x7fe2dc0047c0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f5851640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2dc005180 0x7fe2dc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f5050640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2dc003970 0x7fe2dc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f5851640 1 -- 172.21.15.93:0/1143105552 reap_dead start 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2f484f640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2dc004c40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009a90 tx=0x7fe2dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ec4c828178b39d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002c680 con 0x7fe2dc0047c0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e002c7e0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.230+0000 7fe2e7fff640 1 -- 172.21.15.93:0/1143105552 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002cb70 con 0x7fe2dc0047c0 2023-11-04T01:38:24.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 -- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 msgr2=0x7fe2dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2dc004c40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009a90 tx=0x7fe2dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 -- 172.21.15.93:0/1143105552 shutdown_connections 2023-11-04T01:38:24.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/1143105552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2dc004c40 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 -- 172.21.15.93:0/1143105552 >> 172.21.15.93:0/1143105552 conn(0x7fe2f00cbc90 msgr2=0x7fe2f00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 -- 172.21.15.93:0/1143105552 shutdown_connections 2023-11-04T01:38:24.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.231+0000 7fe2f72b4640 1 -- 172.21.15.93:0/1143105552 wait complete. 2023-11-04T01:38:24.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.232+0000 7fe2f72b4640 1 Processor -- start 2023-11-04T01:38:24.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.232+0000 7fe2f72b4640 1 -- start start 2023-11-04T01:38:24.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2f0148ad0 0x7fe2f00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2f0146060 0x7fe2f01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f015f700 con 0x7fe2dc0047c0 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f015ed30 con 0x7fe2f0146060 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f72b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f014be90 con 0x7fe2f0148ad0 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41258/0 (socket says 172.21.15.93:41258) 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 -- 172.21.15.93:0/3554247246 learned_addr learned my addr 172.21.15.93:0/3554247246 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f484f640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2f0148ad0 0x7fe2f00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 -- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2f0148ad0 msgr2=0x7fe2f00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2f0148ad0 0x7fe2f00c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 -- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2f0146060 msgr2=0x7fe2f01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5851640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2f0146060 0x7fe2f01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2f0146060 0x7fe2f01464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 -- 172.21.15.93:0/3554247246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f015e120 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.233+0000 7fe2f5050640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001c90 tx=0x7fe2ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.234+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec005260 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.234+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0053c0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.234+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f015e400 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.234+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0047e0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.234+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f0148f50 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.235+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0074290 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.235+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2ec004940 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.236+0000 7fe2e5ffb640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 0x7fe2d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.236+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe2ec0895f0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.236+0000 7fe2f484f640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 0x7fe2d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.236+0000 7fe2f484f640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 0x7fe2d406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0036000 tx=0x7fe2e0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.240+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2ec0541b0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.408+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2f00c2a40 con 0x7fe2dc0047c0 2023-11-04T01:38:24.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.409+0000 7fe2e5ffb640 1 -- 172.21.15.93:0/3554247246 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2ec0577d0 con 0x7fe2dc0047c0 2023-11-04T01:38:24.410 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 msgr2=0x7fe2d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 0x7fe2d406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0036000 tx=0x7fe2e0030000 comp rx=0 tx=0).stop 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 msgr2=0x7fe2f015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001c90 tx=0x7fe2ec00ed70 comp rx=0 tx=0).stop 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 shutdown_connections 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe2d406ae70 0x7fe2d406d330 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2f0146060 0x7fe2f01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2f0148ad0 0x7fe2f00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 --2- 172.21.15.93:0/3554247246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2dc0047c0 0x7fe2f015f1c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 >> 172.21.15.93:0/3554247246 conn(0x7fe2f00cbc90 msgr2=0x7fe2f0158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 shutdown_connections 2023-11-04T01:38:24.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.411+0000 7fe2f72b4640 1 -- 172.21.15.93:0/3554247246 wait complete. 2023-11-04T01:38:24.423 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:24.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 Processor -- start 2023-11-04T01:38:24.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 -- start start 2023-11-04T01:38:24.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0310153e60 0x7f031015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03100cd6d0 0x7f0310161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03100b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03100cde60 con 0x7f0310153e60 2023-11-04T01:38:24.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03100b5220 con 0x7f03100cd6d0 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f03157cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0310160f90 con 0x7f03100b4880 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f030effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0310153e60 0x7f031015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f030effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0310153e60 0x7f031015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41274/0 (socket says 172.21.15.93:41274) 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.524+0000 7f030effd640 1 -- 172.21.15.93:0/2641116737 learned_addr learned my addr 172.21.15.93:0/2641116737 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 -- 172.21.15.93:0/2641116737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 msgr2=0x7f03100b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 --2- 172.21.15.93:0/2641116737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03100b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 -- 172.21.15.93:0/2641116737 >> v2:172.21.15.125:3300/0 conn(0x7f03100cd6d0 msgr2=0x7f0310161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 --2- 172.21.15.93:0/2641116737 >> v2:172.21.15.125:3300/0 conn(0x7f03100cd6d0 0x7f0310161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 -- 172.21.15.93:0/2641116737 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031015e400 con 0x7f0310153e60 2023-11-04T01:38:24.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.525+0000 7f030effd640 1 --2- 172.21.15.93:0/2641116737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f031015dec0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f03100c9e80 tx=0x7f030002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd22c58bf73c59d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f030dffb640 1 -- 172.21.15.93:0/2641116737 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300031640 con 0x7f0310153e60 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f030dffb640 1 -- 172.21.15.93:0/2641116737 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000317a0 con 0x7f0310153e60 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f030dffb640 1 -- 172.21.15.93:0/2641116737 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300031b30 con 0x7f0310153e60 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 -- 172.21.15.93:0/2641116737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 msgr2=0x7f031015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 --2- 172.21.15.93:0/2641116737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f031015dec0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f03100c9e80 tx=0x7f030002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 -- 172.21.15.93:0/2641116737 shutdown_connections 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 --2- 172.21.15.93:0/2641116737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03100b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 --2- 172.21.15.93:0/2641116737 >> v2:172.21.15.125:3300/0 conn(0x7f03100cd6d0 0x7f0310161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 --2- 172.21.15.93:0/2641116737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f031015dec0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 -- 172.21.15.93:0/2641116737 >> 172.21.15.93:0/2641116737 conn(0x7f03100cf880 msgr2=0x7f03100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 -- 172.21.15.93:0/2641116737 shutdown_connections 2023-11-04T01:38:24.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.526+0000 7f03157cc640 1 -- 172.21.15.93:0/2641116737 wait complete. 2023-11-04T01:38:24.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.527+0000 7f03157cc640 1 Processor -- start 2023-11-04T01:38:24.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 -- start start 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03101f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03100cd6d0 0x7f03101575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03100c9810 con 0x7f0310153e60 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101565a0 con 0x7f03100cd6d0 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f03157cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03101567f0 con 0x7f03100b4880 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f030f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f030f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41276/0 (socket says 172.21.15.93:41276) 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f030f7fe640 1 -- 172.21.15.93:0/1463510122 learned_addr learned my addr 172.21.15.93:0/1463510122 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f030e7fc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03100cd6d0 0x7f03101575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.528+0000 7f030effd640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03101f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 -- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 msgr2=0x7f03101f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03101f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 -- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03100cd6d0 msgr2=0x7f03101575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03100cd6d0 0x7f03101575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 -- 172.21.15.93:0/1463510122 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000094d0 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f030f7fe640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f030800b970 tx=0x7f030800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030800caa0 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030800cc20 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310156ad0 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308014440 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.529+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0310157090 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.530+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310074290 con 0x7f0310153e60 2023-11-04T01:38:24.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.530+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03080145a0 con 0x7f0310153e60 2023-11-04T01:38:24.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.531+0000 7f02f77fe640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.531+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0308089950 con 0x7f0310153e60 2023-11-04T01:38:24.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.531+0000 7f030effd640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.531+0000 7f030effd640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 0x7f02fc06d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0300036000 tx=0x7f030003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.535+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03080545a0 con 0x7f0310153e60 2023-11-04T01:38:24.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.700+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f03100d0b80 con 0x7f0310153e60 2023-11-04T01:38:24.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.701+0000 7f02f77fe640 1 -- 172.21.15.93:0/1463510122 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0308019020 con 0x7f0310153e60 2023-11-04T01:38:24.702 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:24.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 msgr2=0x7f02fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 0x7f02fc06d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0300036000 tx=0x7f030003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:24.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 msgr2=0x7f03100c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f030800b970 tx=0x7f030800bd70 comp rx=0 tx=0).stop 2023-11-04T01:38:24.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 shutdown_connections 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0310153e60 0x7f03100c92d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03100cd6d0 0x7f03101575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 --2- 172.21.15.93:0/1463510122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03100b4880 0x7f03101f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 >> 172.21.15.93:0/1463510122 conn(0x7f03100cf880 msgr2=0x7f03100b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 shutdown_connections 2023-11-04T01:38:24.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.703+0000 7f03157cc640 1 -- 172.21.15.93:0/1463510122 wait complete. 2023-11-04T01:38:24.715 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.815+0000 7fbc61400640 1 Processor -- start 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.815+0000 7fbc61400640 1 -- start start 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbc5c0b8960 0x7fbc5c0d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c1608b0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c1616d0 con 0x7fbc5c0b8960 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc61400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c160ae0 con 0x7fbc5c15a830 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc527fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc527fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41286/0 (socket says 172.21.15.93:41286) 2023-11-04T01:38:24.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.816+0000 7fbc527fc640 1 -- 172.21.15.93:0/1753880702 learned_addr learned my addr 172.21.15.93:0/1753880702 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 -- 172.21.15.93:0/1753880702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 msgr2=0x7fbc5c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 --2- 172.21.15.93:0/1753880702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 -- 172.21.15.93:0/1753880702 >> v2:172.21.15.125:3300/0 conn(0x7fbc5c0b8960 msgr2=0x7fbc5c0d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 --2- 172.21.15.93:0/1753880702 >> v2:172.21.15.125:3300/0 conn(0x7fbc5c0b8960 0x7fbc5c0d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 -- 172.21.15.93:0/1753880702 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c160da0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.817+0000 7fbc527fc640 1 --2- 172.21.15.93:0/1753880702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b2180 tx=0x7fbc4402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5ca2310dc95954 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc5a7fc640 1 -- 172.21.15.93:0/1753880702 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44031890 con 0x7fbc5c0b8520 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc5a7fc640 1 -- 172.21.15.93:0/1753880702 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc440319f0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc5a7fc640 1 -- 172.21.15.93:0/1753880702 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44031d80 con 0x7fbc5c0b8520 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 -- 172.21.15.93:0/1753880702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 msgr2=0x7fbc5c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 --2- 172.21.15.93:0/1753880702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0b2180 tx=0x7fbc4402b930 comp rx=0 tx=0).stop 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 -- 172.21.15.93:0/1753880702 shutdown_connections 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 --2- 172.21.15.93:0/1753880702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c0d2b90 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 --2- 172.21.15.93:0/1753880702 >> v2:172.21.15.125:3300/0 conn(0x7fbc5c0b8960 0x7fbc5c0d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 --2- 172.21.15.93:0/1753880702 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 -- 172.21.15.93:0/1753880702 >> 172.21.15.93:0/1753880702 conn(0x7fbc5c071c70 msgr2=0x7fbc5c072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 -- 172.21.15.93:0/1753880702 shutdown_connections 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.818+0000 7fbc61400640 1 -- 172.21.15.93:0/1753880702 wait complete. 2023-11-04T01:38:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.819+0000 7fbc61400640 1 Processor -- start 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 -- start start 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc5c0b8960 0x7fbc5c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0b3bb0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0b3e90 con 0x7fbc5c0b8960 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc61400640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0b4170 con 0x7fbc5c15a830 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.820+0000 7fbc5affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41290/0 (socket says 172.21.15.93:41290) 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 -- 172.21.15.93:0/3467547254 learned_addr learned my addr 172.21.15.93:0/3467547254 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc527fc640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc5c0b8960 0x7fbc5c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5b7fe640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 -- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 msgr2=0x7fbc5c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 -- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc5c0b8960 msgr2=0x7fbc5c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc5c0b8960 0x7fbc5c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 -- 172.21.15.93:0/3467547254 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440094d0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc5affd640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00b4a0 tx=0x7fbc4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c010610 con 0x7fbc5c0b8520 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c010770 con 0x7fbc5c0b8520 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c010b20 con 0x7fbc5c0b8520 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c0b4450 con 0x7fbc5c0b8520 2023-11-04T01:38:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.821+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c159160 con 0x7fbc5c0b8520 2023-11-04T01:38:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.822+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c04ece0 con 0x7fbc5c0b8520 2023-11-04T01:38:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.823+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc4c010c80 con 0x7fbc5c0b8520 2023-11-04T01:38:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.823+0000 7fbc53fff640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 0x7fbc3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.823+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fbc4c089770 con 0x7fbc5c0b8520 2023-11-04T01:38:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.823+0000 7fbc527fc640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 0x7fbc3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.823+0000 7fbc527fc640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 0x7fbc3c06d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc44036000 tx=0x7fbc4403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.827+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc4c054330 con 0x7fbc5c0b8520 2023-11-04T01:38:24.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.991+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc5c15c050 con 0x7fbc5c0b8520 2023-11-04T01:38:24.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.991+0000 7fbc53fff640 1 -- 172.21.15.93:0/3467547254 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc4c057950 con 0x7fbc5c0b8520 2023-11-04T01:38:24.993 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:24.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 msgr2=0x7fbc3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 0x7fbc3c06d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc44036000 tx=0x7fbc4403c040 comp rx=0 tx=0).stop 2023-11-04T01:38:24.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 msgr2=0x7fbc5c158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00b4a0 tx=0x7fbc4c00b960 comp rx=0 tx=0).stop 2023-11-04T01:38:24.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 shutdown_connections 2023-11-04T01:38:24.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbc3c06ae70 0x7fbc3c06d330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbc5c15a830 0x7fbc5c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbc5c0b8960 0x7fbc5c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 --2- 172.21.15.93:0/3467547254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc5c0b8520 0x7fbc5c158c20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 >> 172.21.15.93:0/3467547254 conn(0x7fbc5c071c70 msgr2=0x7fbc5c15fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 shutdown_connections 2023-11-04T01:38:24.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:24.993+0000 7fbc61400640 1 -- 172.21.15.93:0/3467547254 wait complete. 2023-11-04T01:38:25.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:25.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.107+0000 7f208eefc640 1 Processor -- start 2023-11-04T01:38:25.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.107+0000 7f208eefc640 1 -- start start 2023-11-04T01:38:25.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208eefc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2088159c00 0x7f20880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208eefc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f20880c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208eefc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208815aff0 con 0x7f20880adac0 2023-11-04T01:38:25.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208eefc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880c52d0 con 0x7f2088159c00 2023-11-04T01:38:25.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208eefc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208815a3e0 con 0x7f20880c48e0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208d499640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f20880adac0 0x7f20880adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50922/0 (socket says 172.21.15.93:50922) 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.108+0000 7f208d499640 1 -- 172.21.15.93:0/2187454375 learned_addr learned my addr 172.21.15.93:0/2187454375 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897250261 0 0) 0x7f208815aff0 con 0x7f20880adac0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2070003520 con 0x7f20880adac0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f20880c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f208cc98640 1 --2- 172.21.15.93:0/2187454375 >> v2:172.21.15.125:3300/0 conn(0x7f2088159c00 0x7f20880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899224278 0 0) 0x7f2070003520 con 0x7f20880adac0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 msgr2=0x7f20880c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f20880c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 >> v2:172.21.15.125:3300/0 conn(0x7f2088159c00 msgr2=0x7f20880cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 --2- 172.21.15.93:0/2187454375 >> v2:172.21.15.125:3300/0 conn(0x7f2088159c00 0x7f20880cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208815a6c0 con 0x7f20880adac0 2023-11-04T01:38:25.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f20800019f0 con 0x7f20880adac0 2023-11-04T01:38:25.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 >> v1:172.21.15.93:6789/0 conn(0x7f20880adac0 legacy=0x7f20880adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f2070003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f20700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2070004d00 0x7f2070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c52d0 con 0x7f2070003ef0 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208815a3e0 con 0x7f2070004d00 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207000b980 con 0x7f20880c48e0 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f20700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f208cc98640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f2070003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f208d499640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2070004d00 0x7f2070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 -- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 msgr2=0x7f2070003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f2070003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 -- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2070004d00 msgr2=0x7f2070005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2070004d00 0x7f2070005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f207ffff640 1 -- 172.21.15.93:0/2187454375 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070003520 con 0x7f2070003ef0 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.109+0000 7f208cc98640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20880c48e0 0x7f2070003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.110+0000 7f207ffff640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f20700047c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2078009ac0 tx=0x7f20700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3082c7d5f210faeb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.110+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207802c6b0 con 0x7f2070003ef0 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.110+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207802c810 con 0x7f2070003ef0 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.110+0000 7f207f7fe640 1 -- 172.21.15.93:0/2187454375 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207802cba0 con 0x7f2070003ef0 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 -- 172.21.15.93:0/2187454375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 msgr2=0x7f20700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 --2- 172.21.15.93:0/2187454375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f20700047c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2078009ac0 tx=0x7f20700057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208d499640 1 -- 172.21.15.93:0/2187454375 reap_dead start 2023-11-04T01:38:25.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 -- 172.21.15.93:0/2187454375 shutdown_connections 2023-11-04T01:38:25.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 -- 172.21.15.93:0/2187454375 >> 172.21.15.93:0/2187454375 conn(0x7f20880ce950 msgr2=0x7f20880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 -- 172.21.15.93:0/2187454375 shutdown_connections 2023-11-04T01:38:25.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.111+0000 7f208eefc640 1 -- 172.21.15.93:0/2187454375 wait complete. 2023-11-04T01:38:25.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.112+0000 7f208eefc640 1 Processor -- start 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.112+0000 7f208eefc640 1 -- start start 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20880c37d0 0x7f20880c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f208814f6c0 0x7f208814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c4190 con 0x7f2070003ef0 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881503f0 con 0x7f20880c37d0 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20881506d0 con 0x7f208814f6c0 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41308/0 (socket says 172.21.15.93:41308) 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 -- 172.21.15.93:0/2786573478 learned_addr learned my addr 172.21.15.93:0/2786573478 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 -- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f208814f6c0 msgr2=0x7f208814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f208814f6c0 0x7f208814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 -- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20880c37d0 msgr2=0x7f20880c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20880c37d0 0x7f20880c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 -- 172.21.15.93:0/2786573478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20881509b0 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208cc98640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f20840116d0 tx=0x7f2084011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208400f940 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208400faa0 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088150c90 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208400fe30 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.113+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208814ba60 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.114+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20880b4890 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.115+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2084015460 con 0x7f2070003ef0 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.115+0000 7f207d7fa640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 0x7f207406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.115+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f208408a460 con 0x7f2070003ef0 2023-11-04T01:38:25.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.115+0000 7f207ffff640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 0x7f207406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.115+0000 7f207ffff640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 0x7f207406d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2078036000 tx=0x7f207802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.119+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2084055000 con 0x7f2070003ef0 2023-11-04T01:38:25.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.285+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20881512e0 con 0x7f2070003ef0 2023-11-04T01:38:25.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.285+0000 7f207d7fa640 1 -- 172.21.15.93:0/2786573478 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2084058620 con 0x7f2070003ef0 2023-11-04T01:38:25.287 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 msgr2=0x7f207406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 0x7f207406d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2078036000 tx=0x7f207802e000 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 msgr2=0x7f208814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f20840116d0 tx=0x7f2084011b90 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 shutdown_connections 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f207406ae70 0x7f207406d330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f208814f6c0 0x7f208814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20880c37d0 0x7f20880c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 --2- 172.21.15.93:0/2786573478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2070003ef0 0x7f208814b520 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 >> 172.21.15.93:0/2786573478 conn(0x7f20880ce950 msgr2=0x7f208806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 shutdown_connections 2023-11-04T01:38:25.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.287+0000 7f208eefc640 1 -- 172.21.15.93:0/2786573478 wait complete. 2023-11-04T01:38:25.299 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:25.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.400+0000 7efd359b6640 1 Processor -- start 2023-11-04T01:38:25.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.400+0000 7efd359b6640 1 -- start start 2023-11-04T01:38:25.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd359b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd300b1a40 0x7efd300ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd359b6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd30160990 con 0x7efd3006a830 2023-11-04T01:38:25.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd359b6640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300cc7c0 con 0x7efd301605b0 2023-11-04T01:38:25.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd359b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cd750 con 0x7efd300b1a40 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd2f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7efd3006a830 0x7efd300cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50926/0 (socket says 172.21.15.93:50926) 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd2f7fe640 1 -- 172.21.15.93:0/1058098575 learned_addr learned my addr 172.21.15.93:0/1058098575 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd2e7fc640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd300b1a40 0x7efd300ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465746848 0 0) 0x7efd30160990 con 0x7efd3006a830 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.401+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd18003520 con 0x7efd3006a830 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309974411 0 0) 0x7efd18003520 con 0x7efd3006a830 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd300b1a40 msgr2=0x7efd300ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd300b1a40 0x7efd300ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 >> v1:172.21.15.125:6789/0 conn(0x7efd301605b0 legacy=0x7efd3006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300cc4e0 con 0x7efd3006a830 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7efd28001670 con 0x7efd3006a830 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 >> v1:172.21.15.93:6789/0 conn(0x7efd3006a830 legacy=0x7efd300cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd180039a0 0x7efd18003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd18004300 0x7efd180047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd18005080 0x7efd1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cd750 con 0x7efd18005080 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1800bfa0 con 0x7efd18004300 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1800c160 con 0x7efd180039a0 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd18005080 0x7efd1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2e7fc640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd18004300 0x7efd180047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2effd640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd180039a0 0x7efd18003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 -- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd180039a0 msgr2=0x7efd18003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd180039a0 0x7efd18003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 -- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd18004300 msgr2=0x7efd180047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd18004300 0x7efd180047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.402+0000 7efd2f7fe640 1 -- 172.21.15.93:0/1058098575 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd18003520 con 0x7efd18005080 2023-11-04T01:38:25.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.403+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd18005080 0x7efd1800b980 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efd300726e0 tx=0x7efd180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3544225d4380aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.403+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28005ad0 con 0x7efd18005080 2023-11-04T01:38:25.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.403+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28005c50 con 0x7efd18005080 2023-11-04T01:38:25.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.403+0000 7efd2dffb640 1 -- 172.21.15.93:0/1058098575 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2802c850 con 0x7efd18005080 2023-11-04T01:38:25.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 -- 172.21.15.93:0/1058098575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd18005080 msgr2=0x7efd1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 --2- 172.21.15.93:0/1058098575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd18005080 0x7efd1800b980 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efd300726e0 tx=0x7efd180057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd2f7fe640 1 -- 172.21.15.93:0/1058098575 reap_dead start 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 -- 172.21.15.93:0/1058098575 shutdown_connections 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 -- 172.21.15.93:0/1058098575 >> 172.21.15.93:0/1058098575 conn(0x7efd30071820 msgr2=0x7efd30071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 -- 172.21.15.93:0/1058098575 shutdown_connections 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.404+0000 7efd359b6640 1 -- 172.21.15.93:0/1058098575 wait complete. 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.405+0000 7efd359b6640 1 Processor -- start 2023-11-04T01:38:25.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.405+0000 7efd359b6640 1 -- start start 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 0x7efd301f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 0x7efd301f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c7b40 con 0x7efd301f2db0 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c8950 con 0x7efd300c84d0 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300aba80 con 0x7efd18005080 2023-11-04T01:38:25.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41340/0 (socket says 172.21.15.93:41340) 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 -- 172.21.15.93:0/2455322429 learned_addr learned my addr 172.21.15.93:0/2455322429 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 0x7efd301f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2effd640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 0x7efd301f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 -- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 msgr2=0x7efd301f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 0x7efd301f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 -- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 msgr2=0x7efd301f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 0x7efd301f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 -- 172.21.15.93:0/2455322429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300c6ec0 con 0x7efd301f2db0 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2effd640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 0x7efd301f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2f7fe640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 0x7efd301f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd2e7fc640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efd24011940 tx=0x7efd24011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24004240 con 0x7efd301f2db0 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240043a0 con 0x7efd301f2db0 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300c71a0 con 0x7efd301f2db0 2023-11-04T01:38:25.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2400fb20 con 0x7efd301f2db0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.406+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300c7760 con 0x7efd301f2db0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.407+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300672a0 con 0x7efd301f2db0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.408+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd2400fc80 con 0x7efd301f2db0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.408+0000 7efd17fff640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 0x7efd1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.408+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7efd2408a240 con 0x7efd301f2db0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.408+0000 7efd2effd640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 0x7efd1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.409+0000 7efd2effd640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 0x7efd1c06d360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd20003fc0 tx=0x7efd20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.412+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd24054cc0 con 0x7efd301f2db0 2023-11-04T01:38:25.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.578+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7efd30074290 con 0x7efd301f2db0 2023-11-04T01:38:25.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.578+0000 7efd17fff640 1 -- 172.21.15.93:0/2455322429 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd240190a0 con 0x7efd301f2db0 2023-11-04T01:38:25.580 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:25.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 msgr2=0x7efd1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 0x7efd1c06d360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd20003fc0 tx=0x7efd20009040 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 msgr2=0x7efd300c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efd24011940 tx=0x7efd24011e00 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 shutdown_connections 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd1c06aea0 0x7efd1c06d360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd300c84d0 0x7efd301f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd301f2db0 0x7efd300c7f90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 --2- 172.21.15.93:0/2455322429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd18005080 0x7efd301f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 >> 172.21.15.93:0/2455322429 conn(0x7efd30071820 msgr2=0x7efd300c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 shutdown_connections 2023-11-04T01:38:25.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.580+0000 7efd359b6640 1 -- 172.21.15.93:0/2455322429 wait complete. 2023-11-04T01:38:25.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:25.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.693+0000 7f4ad42c2640 1 Processor -- start 2023-11-04T01:38:25.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.693+0000 7f4ad42c2640 1 -- start start 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad42c2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4acc0c4ff0 0x7f4acc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad42c2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc15aff0 con 0x7f4acc0adac0 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad42c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc15a3e0 con 0x7f4acc159c00 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad42c2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc15a6c0 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad285f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4acc0adac0 0x7f4acc0adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50928/0 (socket says 172.21.15.93:50928) 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad285f640 1 -- 172.21.15.93:0/2891344463 learned_addr learned my addr 172.21.15.93:0/2891344463 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad185d640 1 --2- 172.21.15.93:0/2891344463 >> v2:172.21.15.125:3300/0 conn(0x7f4acc0c4ff0 0x7f4acc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727272002 0 0) 0x7f4acc15aff0 con 0x7f4acc0adac0 2023-11-04T01:38:25.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.694+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab8003520 con 0x7f4acc0adac0 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783200855 0 0) 0x7f4acc15a3e0 con 0x7f4acc159c00 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc15aff0 con 0x7f4acc159c00 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad185d640 1 -- 172.21.15.93:0/2891344463 >> v1:172.21.15.125:6789/0 conn(0x7f4acc159c00 legacy=0x7f4acc0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad185d640 1 -- 172.21.15.93:0/2891344463 >> v1:172.21.15.93:6789/0 conn(0x7f4acc0adac0 legacy=0x7f4acc0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982796334 0 0) 0x7f4ab8003520 con 0x7f4acc0adac0 2023-11-04T01:38:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad185d640 1 -- 172.21.15.93:0/2891344463 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc15a9a0 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.695+0000 7f4ad185d640 1 --2- 172.21.15.93:0/2891344463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0cc890 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097a0 tx=0x7f4abc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2398ed7d8bf4afa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc02f050 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc031500 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad105c640 1 -- 172.21.15.93:0/2891344463 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4001670 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2891344463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 msgr2=0x7f4acc0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2891344463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0cc890 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0097a0 tx=0x7f4abc02b820 comp rx=0 tx=0).stop 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2891344463 shutdown_connections 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2891344463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0cc890 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2891344463 >> 172.21.15.93:0/2891344463 conn(0x7f4acc0ce950 msgr2=0x7f4acc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2891344463 shutdown_connections 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.696+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2891344463 wait complete. 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.697+0000 7f4ad42c2640 1 Processor -- start 2023-11-04T01:38:25.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.697+0000 7f4ad42c2640 1 -- start start 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc159c00 0x7f4acc149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0a8180 con 0x7f4acc0adac0 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0acfa0 con 0x7f4acc0c4ff0 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad42c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0ad280 con 0x7f4acc159c00 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41352/0 (socket says 172.21.15.93:41352) 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 -- 172.21.15.93:0/2117176447 learned_addr learned my addr 172.21.15.93:0/2117176447 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad185d640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad285f640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc159c00 0x7f4acc149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 -- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc159c00 msgr2=0x7f4acc149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc159c00 0x7f4acc149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 -- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 msgr2=0x7f4acc0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 -- 172.21.15.93:0/2117176447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009400 con 0x7f4acc0adac0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.698+0000 7f4ad205e640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c7a0 tx=0x7f4ac800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.699+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8003b70 con 0x7f4acc0adac0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.699+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8003cd0 con 0x7f4acc0adac0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.699+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800aa90 con 0x7f4acc0adac0 2023-11-04T01:38:25.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.699+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc0ad560 con 0x7f4acc0adac0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.699+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc0a7c40 con 0x7f4acc0adac0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.700+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc074290 con 0x7f4acc0adac0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.700+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ac800abf0 con 0x7f4acc0adac0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.700+0000 7f4ac2ffd640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 0x7f4ab006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.701+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f4ac80899e0 con 0x7f4acc0adac0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.701+0000 7f4ad185d640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 0x7f4ab006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.701+0000 7f4ad185d640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 0x7f4ab006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4abc035000 tx=0x7f4abc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.705+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ac8054580 con 0x7f4acc0adac0 2023-11-04T01:38:25.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.869+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f4acc0cee60 con 0x7f4acc0adac0 2023-11-04T01:38:25.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.869+0000 7f4ac2ffd640 1 -- 172.21.15.93:0/2117176447 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v70) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4ac8057ba0 con 0x7f4acc0adac0 2023-11-04T01:38:25.871 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 msgr2=0x7f4ab006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 0x7f4ab006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4abc035000 tx=0x7f4abc008030 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 msgr2=0x7f4acc06c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c7a0 tx=0x7f4ac800cc60 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 shutdown_connections 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4ab006ae70 0x7f4ab006d330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4acc159c00 0x7f4acc149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4acc0c4ff0 0x7f4acc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 --2- 172.21.15.93:0/2117176447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4acc0adac0 0x7f4acc06c980 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 >> 172.21.15.93:0/2117176447 conn(0x7f4acc0ce950 msgr2=0x7f4acc149e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 shutdown_connections 2023-11-04T01:38:25.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.871+0000 7f4ad42c2640 1 -- 172.21.15.93:0/2117176447 wait complete. 2023-11-04T01:38:25.883 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:25.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.981+0000 7f6247b05640 1 Processor -- start 2023-11-04T01:38:25.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.981+0000 7f6247b05640 1 -- start start 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f6247b05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62400b1a40 0x7f62400ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f6247b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f62400cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f6247b05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6240160990 con 0x7f62401605b0 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f6247b05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400cc7c0 con 0x7f62400b1a40 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f6247b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cd750 con 0x7f624006a830 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f62458a1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f62401605b0 0x7f624006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50934/0 (socket says 172.21.15.93:50934) 2023-11-04T01:38:25.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f62458a1640 1 -- 172.21.15.93:0/781796249 learned_addr learned my addr 172.21.15.93:0/781796249 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f62450a0640 1 --2- 172.21.15.93:0/781796249 >> v2:172.21.15.125:3300/0 conn(0x7f62400b1a40 0x7f62400ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f62460a2640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f62400cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.982+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450474855 0 0) 0x7f6240160990 con 0x7f62401605b0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f622c003520 con 0x7f62401605b0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188702600 0 0) 0x7f622c003520 con 0x7f62401605b0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 msgr2=0x7f62400cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f62400cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 >> v2:172.21.15.125:3300/0 conn(0x7f62400b1a40 msgr2=0x7f62400ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 --2- 172.21.15.93:0/781796249 >> v2:172.21.15.125:3300/0 conn(0x7f62400b1a40 0x7f62400ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400cc4e0 con 0x7f62401605b0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6238001670 con 0x7f62401605b0 2023-11-04T01:38:25.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 >> v1:172.21.15.93:6789/0 conn(0x7f62401605b0 legacy=0x7f624006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c003970 0x7f622c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f622c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c004d00 0x7f622c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cc7c0 con 0x7f622c004d00 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cd750 con 0x7f622c003970 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c00ba60 con 0x7f624006a830 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c004d00 0x7f622c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62458a1640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c003970 0x7f622c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62450a0640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f622c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 -- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 msgr2=0x7f622c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f622c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 -- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c003970 msgr2=0x7f622c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:25.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c003970 0x7f622c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62460a2640 1 -- 172.21.15.93:0/781796249 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c003520 con 0x7f622c004d00 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62450a0640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f624006a830 0x7f622c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.983+0000 7f62458a1640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f622c003970 0x7f622c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f62460a2640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c004d00 0x7f622c005180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f623c009f90 tx=0x7f622c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e13c56c4fc0048e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c02cbd0 con 0x7f622c004d00 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00f040 con 0x7f622c004d00 2023-11-04T01:38:25.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f624489f640 1 -- 172.21.15.93:0/781796249 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c034440 con 0x7f622c004d00 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f6247b05640 1 -- 172.21.15.93:0/781796249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c004d00 msgr2=0x7f622c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f6247b05640 1 --2- 172.21.15.93:0/781796249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c004d00 0x7f622c005180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f623c009f90 tx=0x7f622c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.984+0000 7f62460a2640 1 -- 172.21.15.93:0/781796249 reap_dead start 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.985+0000 7f6247b05640 1 -- 172.21.15.93:0/781796249 shutdown_connections 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.985+0000 7f6247b05640 1 -- 172.21.15.93:0/781796249 >> 172.21.15.93:0/781796249 conn(0x7f6240071820 msgr2=0x7f6240071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.985+0000 7f6247b05640 1 -- 172.21.15.93:0/781796249 shutdown_connections 2023-11-04T01:38:25.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.985+0000 7f6247b05640 1 -- 172.21.15.93:0/781796249 wait complete. 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 Processor -- start 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 -- start start 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c004d00 0x7f62400ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 0x7f62401f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400addc0 con 0x7f62401f1b50 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b3520 con 0x7f62401f6900 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.986+0000 7f6247b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400abe20 con 0x7f622c004d00 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41380/0 (socket says 172.21.15.93:41380) 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 -- 172.21.15.93:0/2277320948 learned_addr learned my addr 172.21.15.93:0/2277320948 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62450a0640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 0x7f62401f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62458a1640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c004d00 0x7f62400ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 -- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c004d00 msgr2=0x7f62400ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c004d00 0x7f62400ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 -- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 msgr2=0x7f62401f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 0x7f62401f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 -- 172.21.15.93:0/2277320948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400adfd0 con 0x7f62401f1b50 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62450a0640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 0x7f62401f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62460a2640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f623c037040 tx=0x7f623c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c003b90 con 0x7f62401f1b50 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c003d10 con 0x7f62401f1b50 2023-11-04T01:38:25.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400ae2b0 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c034b80 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.987+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62401f2510 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.988+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400672a0 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.988+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f623c034ce0 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.989+0000 7f62367fc640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 0x7f622406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.989+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f623c0ab3f0 con 0x7f62401f1b50 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.989+0000 7f62458a1640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 0x7f622406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:25.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.989+0000 7f62458a1640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 0x7f622406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6238001eb0 tx=0x7f6238009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:25.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:25.993+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f623c075fb0 con 0x7f62401f1b50 2023-11-04T01:38:26.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.172+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62400b32f0 con 0x7f62401f1b50 2023-11-04T01:38:26.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.173+0000 7f62367fc640 1 -- 172.21.15.93:0/2277320948 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62400b32f0 con 0x7f62401f1b50 2023-11-04T01:38:26.175 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 msgr2=0x7f622406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 0x7f622406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6238001eb0 tx=0x7f6238009040 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 msgr2=0x7f62401f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f623c037040 tx=0x7f623c009750 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 shutdown_connections 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f622406ae70 0x7f622406d330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62401f1b50 0x7f62401f1fd0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62401f6900 0x7f62401f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 --2- 172.21.15.93:0/2277320948 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f622c004d00 0x7f62400ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.174+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 >> 172.21.15.93:0/2277320948 conn(0x7f6240071820 msgr2=0x7f62400b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.175+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 shutdown_connections 2023-11-04T01:38:26.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.175+0000 7f6247b05640 1 -- 172.21.15.93:0/2277320948 wait complete. 2023-11-04T01:38:26.186 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:38:26.186 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:26.186 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:26.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:26.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[141519]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:26.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:26.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:38:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:26.253 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:38:26.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:26.253 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:26.268 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:26.268 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:26.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:26.286 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:38:26.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:26.286 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:26.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:26.345 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:26.346 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:26.346 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:26.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:26.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:38:26.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:26.362 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:26.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:26.417 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:26.418 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:26.418 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:26.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:26.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:38:26.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:26.437 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:26.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:26.494 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:26.495 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:26.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.593+0000 7f20f4c4f640 1 Processor -- start 2023-11-04T01:38:26.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.593+0000 7f20f4c4f640 1 -- start start 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20f4c4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20f0159c70 0x7f20f00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20f4c4f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20f006db20 0x7f20f00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20f4c4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f00b4110 con 0x7f20f00b0910 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20f4c4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00b49b0 con 0x7f20f0159c70 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20f4c4f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00b0da0 con 0x7f20f006db20 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20f0159c70 0x7f20f00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20f0159c70 0x7f20f00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41392/0 (socket says 172.21.15.93:41392) 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 -- 172.21.15.93:0/3100538999 learned_addr learned my addr 172.21.15.93:0/3100538999 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20edd9b640 1 --2- 172.21.15.93:0/3100538999 >> v2:172.21.15.125:3300/0 conn(0x7f20f006db20 0x7f20f00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 -- 172.21.15.93:0/3100538999 >> v2:172.21.15.125:3300/0 conn(0x7f20f006db20 msgr2=0x7f20f00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 --2- 172.21.15.93:0/3100538999 >> v2:172.21.15.125:3300/0 conn(0x7f20f006db20 0x7f20f00b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 -- 172.21.15.93:0/3100538999 >> v1:172.21.15.125:6789/0 conn(0x7f20f00b0910 legacy=0x7f20f015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.594+0000 7f20ee59c640 1 -- 172.21.15.93:0/3100538999 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00b43f0 con 0x7f20f0159c70 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20ee59c640 1 --2- 172.21.15.93:0/3100538999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f0159c70 0x7f20f00ce370 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cf800 tx=0x7f20e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f67e6147ec70c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20ed59a640 1 -- 172.21.15.93:0/3100538999 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e002ca80 con 0x7f20f0159c70 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20ed59a640 1 -- 172.21.15.93:0/3100538999 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e002cbe0 con 0x7f20f0159c70 2023-11-04T01:38:26.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20ed59a640 1 -- 172.21.15.93:0/3100538999 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00343f0 con 0x7f20f0159c70 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20f4c4f640 1 -- 172.21.15.93:0/3100538999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f0159c70 msgr2=0x7f20f00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.595+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/3100538999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f0159c70 0x7f20f00ce370 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cf800 tx=0x7f20e002bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 -- 172.21.15.93:0/3100538999 shutdown_connections 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/3100538999 >> v2:172.21.15.125:3300/0 conn(0x7f20f006db20 0x7f20f00b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/3100538999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f0159c70 0x7f20f00ce370 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 -- 172.21.15.93:0/3100538999 >> 172.21.15.93:0/3100538999 conn(0x7f20f00ce950 msgr2=0x7f20f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 -- 172.21.15.93:0/3100538999 shutdown_connections 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.596+0000 7f20f4c4f640 1 -- 172.21.15.93:0/3100538999 wait complete. 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.597+0000 7f20f4c4f640 1 Processor -- start 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.597+0000 7f20f4c4f640 1 -- start start 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f00b0910 0x7f20f01568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f0159c70 0x7f20f0156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b1570 con 0x7f20f006db20 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b1810 con 0x7f20f00b0910 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b1af0 con 0x7f20f0159c70 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41404/0 (socket says 172.21.15.93:41404) 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 -- 172.21.15.93:0/2208522765 learned_addr learned my addr 172.21.15.93:0/2208522765 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 -- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f0159c70 msgr2=0x7f20f0156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20edd9b640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f00b0910 0x7f20f01568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20eed9d640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f0159c70 0x7f20f0156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f0159c70 0x7f20f0156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 -- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f00b0910 msgr2=0x7f20f01568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f00b0910 0x7f20f01568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 -- 172.21.15.93:0/2208522765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009b30 con 0x7f20f006db20 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20ee59c640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0009510 con 0x7f20f006db20 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e003e450 con 0x7f20f006db20 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f00b1dd0 con 0x7f20f006db20 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e003e800 con 0x7f20f006db20 2023-11-04T01:38:26.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.598+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00b2390 con 0x7f20f006db20 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.599+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0074290 con 0x7f20f006db20 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.600+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20e002cd50 con 0x7f20f006db20 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.600+0000 7f20deffd640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 0x7f20d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.600+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f20e00ac740 con 0x7f20f006db20 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.600+0000 7f20edd9b640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 0x7f20d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.601+0000 7f20edd9b640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 0x7f20d006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.604+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20e0077250 con 0x7f20f006db20 2023-11-04T01:38:26.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.803+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20f006d3f0 con 0x7f20f006db20 2023-11-04T01:38:26.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.803+0000 7f20deffd640 1 -- 172.21.15.93:0/2208522765 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f20e007a870 con 0x7f20f006db20 2023-11-04T01:38:26.805 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:26.805 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:26.805 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 msgr2=0x7f20d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 0x7f20d006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 msgr2=0x7f20f0149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e0004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 shutdown_connections 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f20d006ae70 0x7f20d006d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20f0159c70 0x7f20f0156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20f00b0910 0x7f20f01568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 --2- 172.21.15.93:0/2208522765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20f006db20 0x7f20f0149d10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 >> 172.21.15.93:0/2208522765 conn(0x7f20f00ce950 msgr2=0x7f20f00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 shutdown_connections 2023-11-04T01:38:26.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.805+0000 7f20f4c4f640 1 -- 172.21.15.93:0/2208522765 wait complete. 2023-11-04T01:38:26.819 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:26.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.918+0000 7f1e2084b640 1 Processor -- start 2023-11-04T01:38:26.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.918+0000 7f1e2084b640 1 -- start start 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.918+0000 7f1e2084b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e1c0cda60 0x7f1e1c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e2084b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e1c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e2084b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0cc990 con 0x7f1e1c0cace0 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e2084b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0ccc70 con 0x7f1e1c0cda60 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e2084b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9ce0 con 0x7f1e1c0b0cd0 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1ad9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1e1c0cace0 0x7f1e1c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50948/0 (socket says 172.21.15.93:50948) 2023-11-04T01:38:26.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/557378586 learned_addr learned my addr 172.21.15.93:0/557378586 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234749966 0 0) 0x7f1e1c0cc990 con 0x7f1e1c0cace0 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e08003520 con 0x7f1e1c0cace0 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/557378586 >> v2:172.21.15.125:3300/0 conn(0x7f1e1c0cda60 0x7f1e1c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e1c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 129365213 0 0) 0x7f1e08003520 con 0x7f1e1c0cace0 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 msgr2=0x7f1e1c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e1c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 >> v2:172.21.15.125:3300/0 conn(0x7f1e1c0cda60 msgr2=0x7f1e1c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 --2- 172.21.15.93:0/557378586 >> v2:172.21.15.125:3300/0 conn(0x7f1e1c0cda60 0x7f1e1c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0c9fc0 con 0x7f1e1c0cace0 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1e140019f0 con 0x7f1e1c0cace0 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 >> v1:172.21.15.93:6789/0 conn(0x7f1e1c0cace0 legacy=0x7f1e1c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e08003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e08003ef0 0x7f1e080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08004d00 0x7f1e08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0ccc70 con 0x7f1e08003ef0 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9ce0 con 0x7f1e08004d00 2023-11-04T01:38:26.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0800b980 con 0x7f1e1c0b0cd0 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.919+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e08003ef0 0x7f1e080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e08003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e1ad9d640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08004d00 0x7f1e08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 -- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 msgr2=0x7f1e08003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c0b0cd0 0x7f1e08003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 -- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08004d00 msgr2=0x7f1e08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08004d00 0x7f1e08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 -- 172.21.15.93:0/557378586 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08003520 con 0x7f1e08003ef0 2023-11-04T01:38:26.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.920+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e08003ef0 0x7f1e080047c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009ac0 tx=0x7f1e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fff00e9fd522a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c02c6b0 con 0x7f1e08003ef0 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c02c810 con 0x7f1e08003ef0 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e1959a640 1 -- 172.21.15.93:0/557378586 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c02cba0 con 0x7f1e08003ef0 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 -- 172.21.15.93:0/557378586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e08003ef0 msgr2=0x7f1e080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 --2- 172.21.15.93:0/557378586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e08003ef0 0x7f1e080047c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009ac0 tx=0x7f1e080057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/557378586 reap_dead start 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 -- 172.21.15.93:0/557378586 shutdown_connections 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 -- 172.21.15.93:0/557378586 >> 172.21.15.93:0/557378586 conn(0x7f1e1c0ce950 msgr2=0x7f1e1c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 -- 172.21.15.93:0/557378586 shutdown_connections 2023-11-04T01:38:26.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.921+0000 7f1e2084b640 1 -- 172.21.15.93:0/557378586 wait complete. 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.922+0000 7f1e2084b640 1 Processor -- start 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 -- start start 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 0x7f1e1c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 0x7f1e1c14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c2bf0 con 0x7f1e1c14be90 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c15c500 con 0x7f1e08003ef0 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e2084b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c1fe0 con 0x7f1e1c14b4d0 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e1ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e1ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41436/0 (socket says 172.21.15.93:41436) 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.923+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/3179709302 learned_addr learned my addr 172.21.15.93:0/3179709302 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 msgr2=0x7f1e1c14b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 0x7f1e1c14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 0x7f1e1c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 0x7f1e1c14b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 msgr2=0x7f1e1c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 0x7f1e1c1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 -- 172.21.15.93:0/3179709302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0c22c0 con 0x7f1e1c14be90 2023-11-04T01:38:26.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e19d9b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 0x7f1e1c14b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 0x7f1e1c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e1ad9d640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1e140013d0 tx=0x7f1e14007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400ac20 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400ad80 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c0c25a0 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14013630 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.924+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c158e30 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.925+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c074290 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.925+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e14013790 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.926+0000 7f1e12ffd640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 0x7f1dfc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.926+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1e1408a520 con 0x7f1e1c14be90 2023-11-04T01:38:26.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.926+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 0x7f1dfc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:26.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.926+0000 7f1e1a59c640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 0x7f1dfc06d350 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009b30 tx=0x7f1e04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:26.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:26.930+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e140550c0 con 0x7f1e1c14be90 2023-11-04T01:38:27.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.102+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1c0b48d0 con 0x7f1e1c14be90 2023-11-04T01:38:27.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.104+0000 7f1e12ffd640 1 -- 172.21.15.93:0/3179709302 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22069 (secure 0 0 0) 0x7f1e140586e0 con 0x7f1e1c14be90 2023-11-04T01:38:27.105 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:27.105 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":71,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:27.032613+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:27.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 msgr2=0x7f1dfc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 0x7f1dfc06d350 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009b30 tx=0x7f1e04008040 comp rx=0 tx=0).stop 2023-11-04T01:38:27.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 msgr2=0x7f1e1c159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1e140013d0 tx=0x7f1e14007bd0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 shutdown_connections 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1dfc06ae90 0x7f1dfc06d350 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e1c14be90 0x7f1e1c159a10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e1c14b4d0 0x7f1e1c14b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 --2- 172.21.15.93:0/3179709302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e08003ef0 0x7f1e1c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 >> 172.21.15.93:0/3179709302 conn(0x7f1e1c0ce950 msgr2=0x7f1e1c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 shutdown_connections 2023-11-04T01:38:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.106+0000 7f1e2084b640 1 -- 172.21.15.93:0/3179709302 wait complete. 2023-11-04T01:38:27.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:10.157966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:10.624302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:27.119 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:27.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.220+0000 7f11cef05640 1 Processor -- start 2023-11-04T01:38:27.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.220+0000 7f11cef05640 1 -- start start 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cef05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11c80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cef05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c815aff0 con 0x7f11c80adac0 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cef05640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c815a3e0 con 0x7f11c8159c00 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cef05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c815a6c0 con 0x7f11c80c4ff0 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cd4a2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f11c80adac0 0x7f11c80adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50954/0 (socket says 172.21.15.93:50954) 2023-11-04T01:38:27.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11cd4a2640 1 -- 172.21.15.93:0/2749899225 learned_addr learned my addr 172.21.15.93:0/2749899225 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662371352 0 0) 0x7f11c815aff0 con 0x7f11c80adac0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b8003520 con 0x7f11c80adac0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c7fff640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11c80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837232057 0 0) 0x7f11b8003520 con 0x7f11c80adac0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 msgr2=0x7f11c80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11c80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 >> v1:172.21.15.125:6789/0 conn(0x7f11c8159c00 legacy=0x7f11c80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c815a9a0 con 0x7f11c80adac0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f11c00019f0 con 0x7f11c80adac0 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 >> v1:172.21.15.93:6789/0 conn(0x7f11c80adac0 legacy=0x7f11c80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11b80039a0 0x7f11b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.221+0000 7f11c77fe640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c815a6c0 con 0x7f11b8004d00 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b800bb40 con 0x7f11b80039a0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b800df10 con 0x7f11c80c4ff0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11ccca1640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11b80039a0 0x7f11b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11c7fff640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 -- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 msgr2=0x7f11b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c80c4ff0 0x7f11b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 -- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11b80039a0 msgr2=0x7f11b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11b80039a0 0x7f11b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.222+0000 7f11cd4a2640 1 -- 172.21.15.93:0/2749899225 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8003520 con 0x7f11b8004d00 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cd4a2640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11b8005180 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f11c000a820 tx=0x7f11b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3779d7a762cf05f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00072d0 con 0x7f11b8004d00 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c002f070 con 0x7f11b8004d00 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11c77fe640 1 -- 172.21.15.93:0/2749899225 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00076b0 con 0x7f11b8004d00 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 -- 172.21.15.93:0/2749899225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 msgr2=0x7f11b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 --2- 172.21.15.93:0/2749899225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11b8005180 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f11c000a820 tx=0x7f11b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cd4a2640 1 -- 172.21.15.93:0/2749899225 reap_dead start 2023-11-04T01:38:27.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 -- 172.21.15.93:0/2749899225 shutdown_connections 2023-11-04T01:38:27.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 -- 172.21.15.93:0/2749899225 >> 172.21.15.93:0/2749899225 conn(0x7f11c80ce950 msgr2=0x7f11c80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 -- 172.21.15.93:0/2749899225 shutdown_connections 2023-11-04T01:38:27.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.223+0000 7f11cef05640 1 -- 172.21.15.93:0/2749899225 wait complete. 2023-11-04T01:38:27.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 Processor -- start 2023-11-04T01:38:27.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 -- start start 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c81ef120 0x7f11c8158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c814d0f0 0x7f11c814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814dab0 con 0x7f11b8004d00 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814c340 con 0x7f11c814d0f0 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.225+0000 7f11cef05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814b730 con 0x7f11c81ef120 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41450/0 (socket says 172.21.15.93:41450) 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 -- 172.21.15.93:0/2955721841 learned_addr learned my addr 172.21.15.93:0/2955721841 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11cd4a2640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c814d0f0 0x7f11c814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11c7fff640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c81ef120 0x7f11c8158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 -- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c81ef120 msgr2=0x7f11c8158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c81ef120 0x7f11c8158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 -- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c814d0f0 msgr2=0x7f11c814d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c814d0f0 0x7f11c814d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 -- 172.21.15.93:0/2955721841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c814ba10 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11ccca1640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f620 tx=0x7f11bc00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0052e0 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc005440 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc003830 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c814bcf0 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.226+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c81593b0 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.227+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8074290 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.228+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11bc003990 con 0x7f11b8004d00 2023-11-04T01:38:27.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.228+0000 7f11c57fa640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 0x7f11ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.228+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f11bc089aa0 con 0x7f11b8004d00 2023-11-04T01:38:27.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.228+0000 7f11c7fff640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 0x7f11ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.228+0000 7f11c7fff640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 0x7f11ac06d360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11c806cf90 tx=0x7f11b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.232+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11bc0545d0 con 0x7f11b8004d00 2023-11-04T01:38:27.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.405+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11c814ced0 con 0x7f11b8004d00 2023-11-04T01:38:27.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.405+0000 7f11c57fa640 1 -- 172.21.15.93:0/2955721841 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11bc057bf0 con 0x7f11b8004d00 2023-11-04T01:38:27.406 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:27.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 msgr2=0x7f11ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 0x7f11ac06d360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11c806cf90 tx=0x7f11b4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 msgr2=0x7f11c814b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f620 tx=0x7f11bc00fae0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 shutdown_connections 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f11ac06aea0 0x7f11ac06d360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11c814d0f0 0x7f11c814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f11c81ef120 0x7f11c8158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 --2- 172.21.15.93:0/2955721841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11b8004d00 0x7f11c814b0a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 >> 172.21.15.93:0/2955721841 conn(0x7f11c80ce950 msgr2=0x7f11c80c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 shutdown_connections 2023-11-04T01:38:27.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.407+0000 7f11cef05640 1 -- 172.21.15.93:0/2955721841 wait complete. 2023-11-04T01:38:27.419 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:27.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.521+0000 7f7341890640 1 Processor -- start 2023-11-04T01:38:27.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.521+0000 7f7341890640 1 -- start start 2023-11-04T01:38:27.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.521+0000 7f7341890640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f733c153e60 0x7f733c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7341890640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f733c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7341890640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c0cde60 con 0x7f733c0b4880 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7341890640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c160f90 con 0x7f733c153e60 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7341890640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c15e400 con 0x7f733c0cd6d0 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f733c0b4880 0x7f733c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50956/0 (socket says 172.21.15.93:50956) 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733b7fe640 1 -- 172.21.15.93:0/3331877428 learned_addr learned my addr 172.21.15.93:0/3331877428 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733affd640 1 --2- 172.21.15.93:0/3331877428 >> v2:172.21.15.125:3300/0 conn(0x7f733c153e60 0x7f733c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733a7fc640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f733c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138877466 0 0) 0x7f733c0cde60 con 0x7f733c0b4880 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7324003520 con 0x7f733c0b4880 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093954417 0 0) 0x7f7324003520 con 0x7f733c0b4880 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 msgr2=0x7f733c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f733c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 >> v2:172.21.15.125:3300/0 conn(0x7f733c153e60 msgr2=0x7f733c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 --2- 172.21.15.93:0/3331877428 >> v2:172.21.15.125:3300/0 conn(0x7f733c153e60 0x7f733c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c161960 con 0x7f733c0b4880 2023-11-04T01:38:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f73340019f0 con 0x7f733c0b4880 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 >> v1:172.21.15.93:6789/0 conn(0x7f733c0b4880 legacy=0x7f733c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7324003970 0x7f7324003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73240047c0 0x7f7324004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f7324005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c160f90 con 0x7f73240047c0 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c15e400 con 0x7f7324003970 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732400b980 con 0x7f733c0cd6d0 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733a7fc640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73240047c0 0x7f7324004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733affd640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7324003970 0x7f7324003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.522+0000 7f733b7fe640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f7324005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 -- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 msgr2=0x7f7324005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f733c0cd6d0 0x7f7324005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 -- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7324003970 msgr2=0x7f7324003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7324003970 0x7f7324003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 -- 172.21.15.93:0/3331877428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324003520 con 0x7f73240047c0 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f733a7fc640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73240047c0 0x7f7324004c40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7330009ac0 tx=0x7f73240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d380733ddea664 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.523+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733002c6b0 con 0x7f73240047c0 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733002c810 con 0x7f73240047c0 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7339ffb640 1 -- 172.21.15.93:0/3331877428 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733002cba0 con 0x7f73240047c0 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 -- 172.21.15.93:0/3331877428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73240047c0 msgr2=0x7f7324004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 --2- 172.21.15.93:0/3331877428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73240047c0 0x7f7324004c40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7330009ac0 tx=0x7f73240057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f733b7fe640 1 -- 172.21.15.93:0/3331877428 reap_dead start 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 -- 172.21.15.93:0/3331877428 shutdown_connections 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 -- 172.21.15.93:0/3331877428 >> 172.21.15.93:0/3331877428 conn(0x7f733c0cf880 msgr2=0x7f733c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 -- 172.21.15.93:0/3331877428 shutdown_connections 2023-11-04T01:38:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.524+0000 7f7341890640 1 -- 172.21.15.93:0/3331877428 wait complete. 2023-11-04T01:38:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.525+0000 7f7341890640 1 Processor -- start 2023-11-04T01:38:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.525+0000 7f7341890640 1 -- start start 2023-11-04T01:38:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73240047c0 0x7f733c150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f733c1f29f0 0x7f733c1f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c6a90 con 0x7f733c0c7b30 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c6d70 con 0x7f733c1f29f0 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f7341890640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c7050 con 0x7f73240047c0 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f733a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f733a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41466/0 (socket says 172.21.15.93:41466) 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f733a7fc640 1 -- 172.21.15.93:0/683580363 learned_addr learned my addr 172.21.15.93:0/683580363 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f733affd640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73240047c0 0x7f733c150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.526+0000 7f733b7fe640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f733c1f29f0 0x7f733c1f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 -- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73240047c0 msgr2=0x7f733c150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73240047c0 0x7f733c150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 -- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f733c1f29f0 msgr2=0x7f733c1f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f733c1f29f0 0x7f733c1f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 -- 172.21.15.93:0/683580363 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0c7330 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f733a7fc640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f733002c250 tx=0x7f7330004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330003810 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330003970 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c0c7610 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330003ce0 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.527+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c0cb4b0 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.528+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c0c77a0 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.528+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7330047450 con 0x7f733c0c7b30 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.529+0000 7f7323fff640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 0x7f732806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.529+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f73300abb60 con 0x7f733c0c7b30 2023-11-04T01:38:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.529+0000 7f733affd640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 0x7f732806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.529+0000 7f733affd640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 0x7f732806d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f733c0d29a0 tx=0x7f732c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.533+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7330076890 con 0x7f733c0c7b30 2023-11-04T01:38:27.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.699+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f733c074290 con 0x7f733c0c7b30 2023-11-04T01:38:27.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.699+0000 7f7323fff640 1 -- 172.21.15.93:0/683580363 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f73300044e0 con 0x7f733c0c7b30 2023-11-04T01:38:27.700 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 msgr2=0x7f732806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 0x7f732806d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f733c0d29a0 tx=0x7f732c009190 comp rx=0 tx=0).stop 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 msgr2=0x7f733c0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f733002c250 tx=0x7f7330004730 comp rx=0 tx=0).stop 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 shutdown_connections 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f732806aea0 0x7f732806d360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f733c1f29f0 0x7f733c1f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f733c0c7b30 0x7f733c0c7fb0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 --2- 172.21.15.93:0/683580363 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73240047c0 0x7f733c150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 >> 172.21.15.93:0/683580363 conn(0x7f733c0cf880 msgr2=0x7f733c15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 shutdown_connections 2023-11-04T01:38:27.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.701+0000 7f7341890640 1 -- 172.21.15.93:0/683580363 wait complete. 2023-11-04T01:38:27.713 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:27.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.813+0000 7f5098733640 1 Processor -- start 2023-11-04T01:38:27.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.813+0000 7f5098733640 1 -- start start 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f5098733640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f509015af20 0x7f50900b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f5098733640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900cd3b0 0x7f50900cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f5098733640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900d01f0 con 0x7f50900b64c0 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f5098733640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50900cc380 con 0x7f509015af20 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f5098733640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900cdd80 con 0x7f50900cd3b0 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.814+0000 7f50964cf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f509015af20 0x7f50900b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f509015af20 0x7f50900b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41468/0 (socket says 172.21.15.93:41468) 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 -- 172.21.15.93:0/3256528265 learned_addr learned my addr 172.21.15.93:0/3256528265 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 -- 172.21.15.93:0/3256528265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900cd3b0 msgr2=0x7f50900cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 --2- 172.21.15.93:0/3256528265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900cd3b0 0x7f50900cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 -- 172.21.15.93:0/3256528265 >> v1:172.21.15.125:6789/0 conn(0x7f50900b64c0 legacy=0x7f50900cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 -- 172.21.15.93:0/3256528265 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900b6a40 con 0x7f509015af20 2023-11-04T01:38:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.815+0000 7f50964cf640 1 --2- 172.21.15.93:0/3256528265 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509015af20 0x7f50900b3cd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098a0 tx=0x7f508c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c3771f98774256 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f50954cd640 1 -- 172.21.15.93:0/3256528265 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c031640 con 0x7f509015af20 2023-11-04T01:38:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f50954cd640 1 -- 172.21.15.93:0/3256528265 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c0317a0 con 0x7f509015af20 2023-11-04T01:38:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f50954cd640 1 -- 172.21.15.93:0/3256528265 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c031b30 con 0x7f509015af20 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 -- 172.21.15.93:0/3256528265 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509015af20 msgr2=0x7f50900b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 --2- 172.21.15.93:0/3256528265 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509015af20 0x7f50900b3cd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f508c0098a0 tx=0x7f508c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 -- 172.21.15.93:0/3256528265 shutdown_connections 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 --2- 172.21.15.93:0/3256528265 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900cd3b0 0x7f50900cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 --2- 172.21.15.93:0/3256528265 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509015af20 0x7f50900b3cd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 -- 172.21.15.93:0/3256528265 >> 172.21.15.93:0/3256528265 conn(0x7f509006ea20 msgr2=0x7f509006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 -- 172.21.15.93:0/3256528265 shutdown_connections 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.816+0000 7f5098733640 1 -- 172.21.15.93:0/3256528265 wait complete. 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.817+0000 7f5098733640 1 Processor -- start 2023-11-04T01:38:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.817+0000 7f5098733640 1 -- start start 2023-11-04T01:38:27.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900b64c0 0x7f50900b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509015af20 0x7f50901f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c9e30 con 0x7f50900cd3b0 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c9220 con 0x7f509015af20 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5098733640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c9500 con 0x7f50900b64c0 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41480/0 (socket says 172.21.15.93:41480) 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 -- 172.21.15.93:0/1767105008 learned_addr learned my addr 172.21.15.93:0/1767105008 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f50964cf640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900b64c0 0x7f50900b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5096cd0640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509015af20 0x7f50901f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 -- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900b64c0 msgr2=0x7f50900b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900b64c0 0x7f50900b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 -- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509015af20 msgr2=0x7f50901f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509015af20 0x7f50901f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.818+0000 7f5095cce640 1 -- 172.21.15.93:0/1767105008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0094d0 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5095cce640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f508000b3e0 tx=0x7f508000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080011830 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800119b0 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900c97e0 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080011d60 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.819+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900b33f0 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.820+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50900c9fa0 con 0x7f50900cd3b0 2023-11-04T01:38:27.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.820+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f508001a400 con 0x7f50900cd3b0 2023-11-04T01:38:27.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.821+0000 7f5086ffd640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 0x7f507406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.821+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f5080089ce0 con 0x7f50900cd3b0 2023-11-04T01:38:27.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.821+0000 7f50964cf640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 0x7f507406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.821+0000 7f50964cf640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 0x7f507406d360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f508c036000 tx=0x7f508c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:27.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.825+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50900c9fa0 con 0x7f50900cd3b0 2023-11-04T01:38:27.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.991+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50900c9f70 con 0x7f50900cd3b0 2023-11-04T01:38:27.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.991+0000 7f5086ffd640 1 -- 172.21.15.93:0/1767105008 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50800150a0 con 0x7f50900cd3b0 2023-11-04T01:38:27.992 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:27.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 msgr2=0x7f507406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 0x7f507406d360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f508c036000 tx=0x7f508c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:27.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 msgr2=0x7f50901efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f508000b3e0 tx=0x7f508000b8a0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 shutdown_connections 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f507406aea0 0x7f507406d360 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f509015af20 0x7f50901f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50900cd3b0 0x7f50901efb80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 --2- 172.21.15.93:0/1767105008 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50900b64c0 0x7f50900b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 >> 172.21.15.93:0/1767105008 conn(0x7f509006ea20 msgr2=0x7f5090158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 shutdown_connections 2023-11-04T01:38:27.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:27.993+0000 7f5098733640 1 -- 172.21.15.93:0/1767105008 wait complete. 2023-11-04T01:38:28.005 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:28.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.108+0000 7f2f8d5a9640 1 Processor -- start 2023-11-04T01:38:28.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.108+0000 7f2f8d5a9640 1 -- start start 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.109+0000 7f2f8d5a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 0x7f2f880b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.109+0000 7f2f8d5a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 0x7f2f880cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.109+0000 7f2f8d5a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880d01f0 con 0x7f2f880cd3b0 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.109+0000 7f2f8d5a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880b6a40 con 0x7f2f880b64c0 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.109+0000 7f2f8d5a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880d04b0 con 0x7f2f8815af20 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f867fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 0x7f2f880cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f86ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 0x7f2f880b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f877fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2f880cd3b0 0x7f2f880b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:56312/0 (socket says 172.21.15.93:56312) 2023-11-04T01:38:28.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f877fe640 1 -- 172.21.15.93:0/2623178961 learned_addr learned my addr 172.21.15.93:0/2623178961 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f86ffd640 1 -- 172.21.15.93:0/2623178961 >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 msgr2=0x7f2f880cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f86ffd640 1 --2- 172.21.15.93:0/2623178961 >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 0x7f2f880cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f86ffd640 1 -- 172.21.15.93:0/2623178961 >> v1:172.21.15.125:6789/0 conn(0x7f2f880cd3b0 legacy=0x7f2f880b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f86ffd640 1 -- 172.21.15.93:0/2623178961 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880d0790 con 0x7f2f8815af20 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f85ffb640 1 -- 172.21.15.93:0/2623178961 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556565371 0 0) 0x7f2f880d01f0 con 0x7f2f880cd3b0 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.110+0000 7f2f867fc640 1 --2- 172.21.15.93:0/2623178961 >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 0x7f2f880cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f86ffd640 1 --2- 172.21.15.93:0/2623178961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 0x7f2f880b3cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009d90 tx=0x7f2f7802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c960dd1e4729a3b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f85ffb640 1 -- 172.21.15.93:0/2623178961 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7802cc50 con 0x7f2f8815af20 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f85ffb640 1 -- 172.21.15.93:0/2623178961 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7802cdb0 con 0x7f2f8815af20 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f85ffb640 1 -- 172.21.15.93:0/2623178961 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78034660 con 0x7f2f8815af20 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/2623178961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 msgr2=0x7f2f880b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/2623178961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 0x7f2f880b3cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009d90 tx=0x7f2f7802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/2623178961 shutdown_connections 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/2623178961 >> v2:172.21.15.125:3300/0 conn(0x7f2f880b64c0 0x7f2f880cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/2623178961 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f8815af20 0x7f2f880b3cd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/2623178961 >> 172.21.15.93:0/2623178961 conn(0x7f2f8806ea20 msgr2=0x7f2f8806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/2623178961 shutdown_connections 2023-11-04T01:38:28.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.111+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/2623178961 wait complete. 2023-11-04T01:38:28.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.113+0000 7f2f8d5a9640 1 Processor -- start 2023-11-04T01:38:28.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.113+0000 7f2f8d5a9640 1 -- start start 2023-11-04T01:38:28.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.113+0000 7f2f8d5a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f880b64c0 0x7f2f881edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.113+0000 7f2f8d5a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f880cd3b0 0x7f2f881f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.113+0000 7f2f8d5a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f8d5a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881f0ff0 con 0x7f2f8815af20 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f8d5a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881f12d0 con 0x7f2f880cd3b0 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f8d5a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8815c3f0 con 0x7f2f880b64c0 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41482/0 (socket says 172.21.15.93:41482) 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 -- 172.21.15.93:0/3632238115 learned_addr learned my addr 172.21.15.93:0/3632238115 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f867fc640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f880cd3b0 0x7f2f881f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f86ffd640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f880b64c0 0x7f2f881edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 -- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f880b64c0 msgr2=0x7f2f881edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f880b64c0 0x7f2f881edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 -- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f880cd3b0 msgr2=0x7f2f881f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f880cd3b0 0x7f2f881f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 -- 172.21.15.93:0/3632238115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009400 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f877fe640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c450 tx=0x7f2f8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800074e0 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80007660 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f78009a70 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80004a20 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.114+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f881f15b0 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.115+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8815c910 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.116+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f80004b80 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.116+0000 7f2f7f7fe640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 0x7f2f6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.116+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2f80088bf0 con 0x7f2f8815af20 2023-11-04T01:38:28.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.116+0000 7f2f86ffd640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 0x7f2f6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.117+0000 7f2f86ffd640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 0x7f2f6806d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2f78036000 tx=0x7f2f78030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.120+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f8815c910 con 0x7f2f8815af20 2023-11-04T01:38:28.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.286+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f8815c910 con 0x7f2f8815af20 2023-11-04T01:38:28.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.286+0000 7f2f7f7fe640 1 -- 172.21.15.93:0/3632238115 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f8815c910 con 0x7f2f8815af20 2023-11-04T01:38:28.288 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:38:28.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 msgr2=0x7f2f6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 0x7f2f6806d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2f78036000 tx=0x7f2f78030000 comp rx=0 tx=0).stop 2023-11-04T01:38:28.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 msgr2=0x7f2f8815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c450 tx=0x7f2f8000c910 comp rx=0 tx=0).stop 2023-11-04T01:38:28.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 shutdown_connections 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2f6806ae70 0x7f2f6806d330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f8815af20 0x7f2f8815cbf0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f880cd3b0 0x7f2f881f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 --2- 172.21.15.93:0/3632238115 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2f880b64c0 0x7f2f881edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 >> 172.21.15.93:0/3632238115 conn(0x7f2f8806ea20 msgr2=0x7f2f881586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 shutdown_connections 2023-11-04T01:38:28.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.288+0000 7f2f8d5a9640 1 -- 172.21.15.93:0/3632238115 wait complete. 2023-11-04T01:38:28.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:28.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.406+0000 7f8de24b4640 1 Processor -- start 2023-11-04T01:38:28.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.406+0000 7f8de24b4640 1 -- start start 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de24b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8ddc070e20 0x7f8ddc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de24b4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc0c3900 con 0x7f8ddc0ad730 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de24b4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc0c3be0 con 0x7f8ddc15ad30 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de24b4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0ae260 con 0x7f8ddc070e20 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de0a51640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8ddc0ad730 0x7f8ddc15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50962/0 (socket says 172.21.15.93:50962) 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8de0a51640 1 -- 172.21.15.93:0/951366272 learned_addr learned my addr 172.21.15.93:0/951366272 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852846016 0 0) 0x7f8ddc0c3900 con 0x7f8ddc0ad730 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc4003520 con 0x7f8ddc0ad730 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/951366272 >> v2:172.21.15.125:3300/0 conn(0x7f8ddc070e20 0x7f8ddc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321346387 0 0) 0x7f8dc4003520 con 0x7f8ddc0ad730 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 >> v2:172.21.15.125:3300/0 conn(0x7f8ddc070e20 msgr2=0x7f8ddc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 --2- 172.21.15.93:0/951366272 >> v2:172.21.15.125:3300/0 conn(0x7f8ddc070e20 0x7f8ddc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 >> v1:172.21.15.125:6789/0 conn(0x7f8ddc15ad30 legacy=0x7f8ddc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0c3ec0 con 0x7f8ddc0ad730 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8dd40019f0 con 0x7f8ddc0ad730 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 >> v1:172.21.15.93:6789/0 conn(0x7f8ddc0ad730 legacy=0x7f8ddc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dc40047c0 0x7f8dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dc40052a0 0x7f8dc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0ae260 con 0x7f8dc4003970 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc400c170 con 0x7f8dc40052a0 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.407+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc400c330 con 0x7f8dc40047c0 2023-11-04T01:38:28.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8de0a51640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dc40052a0 0x7f8dc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dc40047c0 0x7f8dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 -- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dc40047c0 msgr2=0x7f8dc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8dc40047c0 0x7f8dc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 -- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dc40052a0 msgr2=0x7f8dc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dc40052a0 0x7f8dc400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 -- 172.21.15.93:0/951366272 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4003520 con 0x7f8dc4003970 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8de0a51640 1 -- 172.21.15.93:0/951366272 reap_dead start 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.408+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc001720 tx=0x7f8dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dc5cd1e33406b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0052d0 con 0x7f8dc4003970 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc02e050 con 0x7f8dc4003970 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8ddaffd640 1 -- 172.21.15.93:0/951366272 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc003830 con 0x7f8dc4003970 2023-11-04T01:38:28.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 -- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 msgr2=0x7f8dc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc001720 tx=0x7f8dc40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 -- 172.21.15.93:0/951366272 shutdown_connections 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 --2- 172.21.15.93:0/951366272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 -- 172.21.15.93:0/951366272 >> 172.21.15.93:0/951366272 conn(0x7f8ddc0ce950 msgr2=0x7f8ddc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 -- 172.21.15.93:0/951366272 shutdown_connections 2023-11-04T01:38:28.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.409+0000 7f8de24b4640 1 -- 172.21.15.93:0/951366272 wait complete. 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.410+0000 7f8de24b4640 1 Processor -- start 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 -- start start 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 0x7f8ddc1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 0x7f8ddc14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc14e330 con 0x7f8dc4003970 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc153ef0 con 0x7f8ddc0c8550 2023-11-04T01:38:28.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de24b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc14d7b0 con 0x7f8ddc0b3c50 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8ddbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8ddbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41502/0 (socket says 172.21.15.93:41502) 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8ddbfff640 1 -- 172.21.15.93:0/2460947081 learned_addr learned my addr 172.21.15.93:0/2460947081 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8de0a51640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 0x7f8ddc14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.411+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 0x7f8ddc1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 -- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 msgr2=0x7f8ddc14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 0x7f8ddc14c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 -- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 msgr2=0x7f8ddc1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 0x7f8ddc1539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 -- 172.21.15.93:0/2460947081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc14da90 con 0x7f8dc4003970 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 0x7f8ddc1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8de0a51640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 0x7f8ddc14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:28.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8ddbfff640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc02bbc0 tx=0x7f8dcc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0076c0 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc007a30 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc006be0 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc14dd70 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.412+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc0b40d0 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.413+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc074290 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.413+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dcc006d40 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.414+0000 7f8dd8ff9640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 0x7f8dc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.414+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8dcc0ab7f0 con 0x7f8dc4003970 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.414+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 0x7f8dc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.414+0000 7f8ddb7fe640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 0x7f8dc806d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc1f5e40 tx=0x7f8dd0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.418+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8dcc0763b0 con 0x7f8dc4003970 2023-11-04T01:38:28.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.586+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f8ddc071970 con 0x7f8dc4003970 2023-11-04T01:38:28.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.586+0000 7f8dd8ff9640 1 -- 172.21.15.93:0/2460947081 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8dcc0799d0 con 0x7f8dc4003970 2023-11-04T01:38:28.587 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 msgr2=0x7f8dc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 0x7f8dc806d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc1f5e40 tx=0x7f8dd0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 msgr2=0x7f8ddc150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc02bbc0 tx=0x7f8dcc001120 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 shutdown_connections 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8dc806ae70 0x7f8dc806d330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ddc0b3c50 0x7f8ddc14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ddc0c8550 0x7f8ddc1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 --2- 172.21.15.93:0/2460947081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8dc4003970 0x7f8ddc150b90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 >> 172.21.15.93:0/2460947081 conn(0x7f8ddc0ce950 msgr2=0x7f8ddc15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 shutdown_connections 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.588+0000 7f8de24b4640 1 -- 172.21.15.93:0/2460947081 wait complete. 2023-11-04T01:38:28.600 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.701+0000 7f492e4a9640 1 Processor -- start 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.701+0000 7f492e4a9640 1 -- start start 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492e4a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492e4a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492815aff0 con 0x7f49280adac0 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492e4a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492815a3e0 con 0x7f4928159c00 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492e4a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492815a6c0 con 0x7f49280c4ff0 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492ca46640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f49280adac0 0x7f49280adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50970/0 (socket says 172.21.15.93:50970) 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f492ca46640 1 -- 172.21.15.93:0/1297135765 learned_addr learned my addr 172.21.15.93:0/1297135765 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f49277fe640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058802242 0 0) 0x7f492815aff0 con 0x7f49280adac0 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4910003520 con 0x7f49280adac0 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 736133290 0 0) 0x7f4910003520 con 0x7f49280adac0 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 msgr2=0x7f49280cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49280cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 >> v1:172.21.15.125:6789/0 conn(0x7f4928159c00 legacy=0x7f49280c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492815a9a0 con 0x7f49280adac0 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f49200019f0 con 0x7f49280adac0 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 >> v1:172.21.15.93:6789/0 conn(0x7f49280adac0 legacy=0x7f49280adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.702+0000 7f4926ffd640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f4926ffd640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4910004d00 0x7f4910005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492815a6c0 con 0x7f4910004d00 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491000ba60 con 0x7f49100039a0 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491000de30 con 0x7f49280c4ff0 2023-11-04T01:38:28.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4910004d00 0x7f4910005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f49277fe640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f4927fff640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 -- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 msgr2=0x7f49100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f49280c4ff0 0x7f49100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 -- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49100039a0 msgr2=0x7f4910003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49100039a0 0x7f4910003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.703+0000 7f492ca46640 1 -- 172.21.15.93:0/1297135765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910003520 con 0x7f4910004d00 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492ca46640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4910004d00 0x7f4910005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f492000a820 tx=0x7f49100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f133e7c148a897d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200072d0 con 0x7f4910004d00 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492002f070 con 0x7f4910004d00 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f4926ffd640 1 -- 172.21.15.93:0/1297135765 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200076b0 con 0x7f4910004d00 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 -- 172.21.15.93:0/1297135765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4910004d00 msgr2=0x7f4910005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 --2- 172.21.15.93:0/1297135765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4910004d00 0x7f4910005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f492000a820 tx=0x7f49100057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492ca46640 1 -- 172.21.15.93:0/1297135765 reap_dead start 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 -- 172.21.15.93:0/1297135765 shutdown_connections 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 -- 172.21.15.93:0/1297135765 >> 172.21.15.93:0/1297135765 conn(0x7f49280ce950 msgr2=0x7f49280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 -- 172.21.15.93:0/1297135765 shutdown_connections 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.704+0000 7f492e4a9640 1 -- 172.21.15.93:0/1297135765 wait complete. 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.705+0000 7f492e4a9640 1 Processor -- start 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 -- start start 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492814a6c0 0x7f492814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492814b770 0x7f49280c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280c5bc0 con 0x7f492814cf90 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492814d410 con 0x7f492814b770 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f492e4a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492814bbf0 con 0x7f492814a6c0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f49277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f49277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41518/0 (socket says 172.21.15.93:41518) 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.706+0000 7f49277fe640 1 -- 172.21.15.93:0/235995516 learned_addr learned my addr 172.21.15.93:0/235995516 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f4927fff640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492814a6c0 0x7f492814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f492ca46640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492814b770 0x7f49280c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 -- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492814a6c0 msgr2=0x7f492814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492814a6c0 0x7f492814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 -- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492814b770 msgr2=0x7f49280c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492814b770 0x7f49280c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 -- 172.21.15.93:0/235995516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49281ee840 con 0x7f492814cf90 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f49277fe640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f491c011910 tx=0x7f491c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c009590 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00fa90 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492814aaa0 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00fe00 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.707+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492814be10 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.708+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4928074290 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.709+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f491c014440 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.709+0000 7f4924ff9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 0x7f491406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.709+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f491c08a390 con 0x7f492814cf90 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.709+0000 7f4927fff640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 0x7f491406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.709+0000 7f4927fff640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 0x7f491406d360 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49280c77f0 tx=0x7f4918009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.713+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f491c054f50 con 0x7f492814cf90 2023-11-04T01:38:28.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.879+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f49280c45e0 con 0x7f492814cf90 2023-11-04T01:38:28.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.880+0000 7f4924ff9640 1 -- 172.21.15.93:0/235995516 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v71) v1 ==== 107+0+11 (secure 0 0 0) 0x7f491c058570 con 0x7f492814cf90 2023-11-04T01:38:28.881 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:28.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 msgr2=0x7f491406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 0x7f491406d360 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49280c77f0 tx=0x7f4918009040 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 msgr2=0x7f492814b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f491c011910 tx=0x7f491c011dd0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 shutdown_connections 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f491406aea0 0x7f491406d360 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f492814b770 0x7f49280c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f492814cf90 0x7f492814b230 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 --2- 172.21.15.93:0/235995516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f492814a6c0 0x7f492814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 >> 172.21.15.93:0/235995516 conn(0x7f49280ce950 msgr2=0x7f492806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 shutdown_connections 2023-11-04T01:38:28.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.882+0000 7f492e4a9640 1 -- 172.21.15.93:0/235995516 wait complete. 2023-11-04T01:38:28.895 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:28.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.993+0000 7f711f889640 1 Processor -- start 2023-11-04T01:38:28.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.993+0000 7f711f889640 1 -- start start 2023-11-04T01:38:28.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711f889640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f71180cda30 0x7f7118165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711f889640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180cc450 con 0x7f711815ae40 2023-11-04T01:38:28.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711f889640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711815f400 con 0x7f711815bfb0 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711f889640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711815b220 con 0x7f71180cda30 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711de26640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f71180cda30 0x7f7118165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711d625640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f711815ae40 0x7f71180cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50986/0 (socket says 172.21.15.93:50986) 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711d625640 1 -- 172.21.15.93:0/3786264352 learned_addr learned my addr 172.21.15.93:0/3786264352 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711de26640 1 -- 172.21.15.93:0/3786264352 >> v1:172.21.15.125:6789/0 conn(0x7f711815bfb0 legacy=0x7f71180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711de26640 1 -- 172.21.15.93:0/3786264352 >> v1:172.21.15.93:6789/0 conn(0x7f711815ae40 legacy=0x7f71180cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f711de26640 1 -- 172.21.15.93:0/3786264352 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711815f890 con 0x7f71180cda30 2023-11-04T01:38:28.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.994+0000 7f710ffff640 1 -- 172.21.15.93:0/3786264352 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020729699 0 0) 0x7f7114001110 con 0x7f711815ae40 2023-11-04T01:38:28.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f711de26640 1 --2- 172.21.15.93:0/3786264352 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71180cda30 0x7f7118165ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d90 tx=0x7f711002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e440bdcd1bf4ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f710ffff640 1 -- 172.21.15.93:0/3786264352 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002cc60 con 0x7f71180cda30 2023-11-04T01:38:28.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f710ffff640 1 -- 172.21.15.93:0/3786264352 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711002cdc0 con 0x7f71180cda30 2023-11-04T01:38:28.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f710ffff640 1 -- 172.21.15.93:0/3786264352 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110034660 con 0x7f71180cda30 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f711f889640 1 -- 172.21.15.93:0/3786264352 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71180cda30 msgr2=0x7f7118165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.995+0000 7f711f889640 1 --2- 172.21.15.93:0/3786264352 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71180cda30 0x7f7118165ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d90 tx=0x7f711002beb0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.996+0000 7f711f889640 1 -- 172.21.15.93:0/3786264352 shutdown_connections 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.996+0000 7f711f889640 1 --2- 172.21.15.93:0/3786264352 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71180cda30 0x7f7118165ce0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.996+0000 7f711f889640 1 -- 172.21.15.93:0/3786264352 >> 172.21.15.93:0/3786264352 conn(0x7f711806ea90 msgr2=0x7f711806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.996+0000 7f711f889640 1 -- 172.21.15.93:0/3786264352 shutdown_connections 2023-11-04T01:38:28.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.996+0000 7f711f889640 1 -- 172.21.15.93:0/3786264352 wait complete. 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 Processor -- start 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 -- start start 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 0x7f71180c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 0x7f71180c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180c46b0 con 0x7f711815bfb0 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180c5230 con 0x7f71180cda30 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.997+0000 7f711f889640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711814f510 con 0x7f711815ae40 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41538/0 (socket says 172.21.15.93:41538) 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 -- 172.21.15.93:0/637523810 learned_addr learned my addr 172.21.15.93:0/637523810 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711d625640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 0x7f71180c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711ce24640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 0x7f71180c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 -- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 msgr2=0x7f71180c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 0x7f71180c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 -- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 msgr2=0x7f71180c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 0x7f71180c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 -- 172.21.15.93:0/637523810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009a70 con 0x7f711815bfb0 2023-11-04T01:38:29.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711ce24640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 0x7f71180c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711d625640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 0x7f71180c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711de26640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7110009eb0 tx=0x7f7110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711003f420 con 0x7f711815bfb0 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711003f580 con 0x7f711815bfb0 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180c6c80 con 0x7f711815bfb0 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711003f910 con 0x7f711815bfb0 2023-11-04T01:38:29.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.998+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71180c4b70 con 0x7f711815bfb0 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:28.999+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71180ce2d0 con 0x7f711815bfb0 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.000+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f711003fa70 con 0x7f711815bfb0 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.000+0000 7f710dffb640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 0x7f70fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.000+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f71100ac550 con 0x7f711815bfb0 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.000+0000 7f711d625640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 0x7f70fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.001+0000 7f711d625640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 0x7f70fc06d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7114000f60 tx=0x7f7114009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.004+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7110077230 con 0x7f711815bfb0 2023-11-04T01:38:29.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.211+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71180c5370 con 0x7f711815bfb0 2023-11-04T01:38:29.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.212+0000 7f710dffb640 1 -- 172.21.15.93:0/637523810 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f71180c5370 con 0x7f711815bfb0 2023-11-04T01:38:29.213 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:29.213 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:29.214 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 msgr2=0x7f70fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 0x7f70fc06d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7114000f60 tx=0x7f7114009040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 msgr2=0x7f71180c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7110009eb0 tx=0x7f7110004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 shutdown_connections 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f70fc06ae70 0x7f70fc06d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f711815bfb0 0x7f71180c6600 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f711815ae40 0x7f71180c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 --2- 172.21.15.93:0/637523810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71180cda30 0x7f71180c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 >> 172.21.15.93:0/637523810 conn(0x7f711806ea90 msgr2=0x7f71180d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 shutdown_connections 2023-11-04T01:38:29.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.214+0000 7f711f889640 1 -- 172.21.15.93:0/637523810 wait complete. 2023-11-04T01:38:29.226 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:29.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.324+0000 7ff343c4f640 1 Processor -- start 2023-11-04T01:38:29.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 -- start start 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff33c0ce240 0x7ff33c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 0x7ff33c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c15e000 con 0x7ff33c0cde60 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c15e5c0 con 0x7ff33c0ce240 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.325+0000 7ff343c4f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c15e2e0 con 0x7ff33c157540 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3411ea640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff33c0ce240 0x7ff33c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3419eb640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff33c0cde60 0x7ff33c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50988/0 (socket says 172.21.15.93:50988) 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3419eb640 1 -- 172.21.15.93:0/3909636947 learned_addr learned my addr 172.21.15.93:0/3909636947 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3421ec640 1 --2- 172.21.15.93:0/3909636947 >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 0x7ff33c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3411ea640 1 -- 172.21.15.93:0/3909636947 >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 msgr2=0x7ff33c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3411ea640 1 --2- 172.21.15.93:0/3909636947 >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 0x7ff33c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3411ea640 1 -- 172.21.15.93:0/3909636947 >> v1:172.21.15.93:6789/0 conn(0x7ff33c0cde60 legacy=0x7ff33c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3411ea640 1 -- 172.21.15.93:0/3909636947 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0d1120 con 0x7ff33c0ce240 2023-11-04T01:38:29.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.326+0000 7ff3421ec640 1 --2- 172.21.15.93:0/3909636947 >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 0x7ff33c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff3411ea640 1 --2- 172.21.15.93:0/3909636947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c0ce240 0x7ff33c157000 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0cf2e0 tx=0x7ff32c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f900da956a41eb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff3409e9640 1 -- 172.21.15.93:0/3909636947 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c031830 con 0x7ff33c0ce240 2023-11-04T01:38:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff3409e9640 1 -- 172.21.15.93:0/3909636947 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c031990 con 0x7ff33c0ce240 2023-11-04T01:38:29.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff3409e9640 1 -- 172.21.15.93:0/3909636947 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c031d20 con 0x7ff33c0ce240 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 -- 172.21.15.93:0/3909636947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c0ce240 msgr2=0x7ff33c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 --2- 172.21.15.93:0/3909636947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c0ce240 0x7ff33c157000 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0cf2e0 tx=0x7ff32c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 -- 172.21.15.93:0/3909636947 shutdown_connections 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 --2- 172.21.15.93:0/3909636947 >> v2:172.21.15.125:3300/0 conn(0x7ff33c157540 0x7ff33c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 --2- 172.21.15.93:0/3909636947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c0ce240 0x7ff33c157000 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 -- 172.21.15.93:0/3909636947 >> 172.21.15.93:0/3909636947 conn(0x7ff33c071f30 msgr2=0x7ff33c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 -- 172.21.15.93:0/3909636947 shutdown_connections 2023-11-04T01:38:29.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.327+0000 7ff343c4f640 1 -- 172.21.15.93:0/3909636947 wait complete. 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.328+0000 7ff343c4f640 1 Processor -- start 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 -- start start 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33c0cde60 0x7ff33c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 0x7ff33c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1588e0 con 0x7ff33c157540 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1568a0 con 0x7ff33c0ce240 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff343c4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c157cd0 con 0x7ff33c0cde60 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff3421ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff3421ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41566/0 (socket says 172.21.15.93:41566) 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.329+0000 7ff3421ec640 1 -- 172.21.15.93:0/1173017622 learned_addr learned my addr 172.21.15.93:0/1173017622 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3411ea640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 0x7ff33c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3419eb640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33c0cde60 0x7ff33c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 -- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33c0cde60 msgr2=0x7ff33c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33c0cde60 0x7ff33c156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 -- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 msgr2=0x7ff33c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 0x7ff33c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 -- 172.21.15.93:0/1173017622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009400 con 0x7ff33c157540 2023-11-04T01:38:29.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3411ea640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 0x7ff33c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3421ec640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cd50 tx=0x7ff33400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400f680 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400f800 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400fbb0 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c157fb0 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.330+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c158570 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.331+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c158a50 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.331+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff33400b040 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.332+0000 7ff3327fc640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 0x7ff32006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.332+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ff33408a590 con 0x7ff33c157540 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.332+0000 7ff3419eb640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 0x7ff32006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.332+0000 7ff3419eb640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 0x7ff32006d360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff338005880 tx=0x7ff338009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.338 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.336+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3340550c0 con 0x7ff33c157540 2023-11-04T01:38:29.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.504+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff33c074290 con 0x7ff33c157540 2023-11-04T01:38:29.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.506+0000 7ff3327fc640 1 -- 172.21.15.93:0/1173017622 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22069 (secure 0 0 0) 0x7ff3340586e0 con 0x7ff33c157540 2023-11-04T01:38:29.507 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:29.507 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":71,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:27.032613+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 msgr2=0x7ff32006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 0x7ff32006d360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff338005880 tx=0x7ff338009040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 msgr2=0x7ff33c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cd50 tx=0x7ff33400a650 comp rx=0 tx=0).stop 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 shutdown_connections 2023-11-04T01:38:29.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff32006aea0 0x7ff32006d360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff33c157540 0x7ff33c0ccac0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff33c0ce240 0x7ff33c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 --2- 172.21.15.93:0/1173017622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33c0cde60 0x7ff33c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 >> 172.21.15.93:0/1173017622 conn(0x7ff33c071f30 msgr2=0x7ff33c0b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 shutdown_connections 2023-11-04T01:38:29.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.508+0000 7ff343c4f640 1 -- 172.21.15.93:0/1173017622 wait complete. 2023-11-04T01:38:29.520 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:29.520 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:29.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.618+0000 7f61796c2640 1 Processor -- start 2023-11-04T01:38:29.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.618+0000 7f61796c2640 1 -- start start 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61796c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f617406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61796c2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617406a120 con 0x7f61740cb5c0 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61796c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617406def0 con 0x7f617415d250 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61796c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61740cdc10 con 0x7f617415ce70 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61737fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f61740cb5c0 0x7f61740ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50996/0 (socket says 172.21.15.93:50996) 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f61737fe640 1 -- 172.21.15.93:0/3239072944 learned_addr learned my addr 172.21.15.93:0/3239072944 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083505261 0 0) 0x7f617406a120 con 0x7f61740cb5c0 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6172ffd640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f617406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c003520 con 0x7f61740cb5c0 2023-11-04T01:38:29.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315909582 0 0) 0x7f615c003520 con 0x7f61740cb5c0 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 msgr2=0x7f617406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.619+0000 7f6171ffb640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f617406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 >> v1:172.21.15.125:6789/0 conn(0x7f617415d250 legacy=0x7f61740c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740c9f40 con 0x7f61740cb5c0 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f616c001670 con 0x7f61740cb5c0 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 >> v1:172.21.15.93:6789/0 conn(0x7f61740cb5c0 legacy=0x7f61740ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f615c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615c003f20 0x7f615c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f615c004d00 0x7f615c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61740cdc10 con 0x7f615c004d00 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c00ba60 con 0x7f615c003f20 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c00bc20 con 0x7f617415ce70 2023-11-04T01:38:29.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f615c004d00 0x7f615c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f6172ffd640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f615c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61727fc640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615c003f20 0x7f615c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 -- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 msgr2=0x7f615c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f617415ce70 0x7f615c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 -- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615c003f20 msgr2=0x7f615c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615c003f20 0x7f615c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61737fe640 1 -- 172.21.15.93:0/3239072944 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c003520 con 0x7f615c004d00 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.620+0000 7f61727fc640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f615c003f20 0x7f615c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61737fe640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f615c004d00 0x7f615c005180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f616c00c240 tx=0x7f615c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8a2af647ed5234 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c005ad0 con 0x7f615c004d00 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c005c30 con 0x7f615c004d00 2023-11-04T01:38:29.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f6171ffb640 1 -- 172.21.15.93:0/3239072944 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c02caf0 con 0x7f615c004d00 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 -- 172.21.15.93:0/3239072944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f615c004d00 msgr2=0x7f615c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 --2- 172.21.15.93:0/3239072944 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f615c004d00 0x7f615c005180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f616c00c240 tx=0x7f615c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61737fe640 1 -- 172.21.15.93:0/3239072944 reap_dead start 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 -- 172.21.15.93:0/3239072944 shutdown_connections 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 -- 172.21.15.93:0/3239072944 >> 172.21.15.93:0/3239072944 conn(0x7f61740b0cd0 msgr2=0x7f61740b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 -- 172.21.15.93:0/3239072944 shutdown_connections 2023-11-04T01:38:29.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.621+0000 7f61796c2640 1 -- 172.21.15.93:0/3239072944 wait complete. 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 Processor -- start 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 -- start start 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61740c62b0 0x7f61740c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 0x7f61741e2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61740c9280 con 0x7f61741f23b0 2023-11-04T01:38:29.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61740c8990 con 0x7f61740c62b0 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f61796c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61740c6730 con 0x7f61740c8200 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.623+0000 7f6172ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41580/0 (socket says 172.21.15.93:41580) 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 -- 172.21.15.93:0/1187730662 learned_addr learned my addr 172.21.15.93:0/1187730662 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f61727fc640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61740c62b0 0x7f61740c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f61737fe640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 0x7f61741e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 -- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 msgr2=0x7f61741e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 0x7f61741e2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 -- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61740c62b0 msgr2=0x7f61740c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61740c62b0 0x7f61740c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 -- 172.21.15.93:0/1187730662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740c8c30 con 0x7f61741f23b0 2023-11-04T01:38:29.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f61737fe640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 0x7f61741e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f6172ffd640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6164011e30 tx=0x7f616400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400e040 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616400f040 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164009c00 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61740c8f10 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.624+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61740c8680 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.625+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6174074290 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.625+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6164015850 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.626+0000 7f615b7fe640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 0x7f616006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.626+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f616408a840 con 0x7f61741f23b0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.626+0000 7f61727fc640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 0x7f616006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.626+0000 7f61727fc640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 0x7f616006d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61741e40a0 tx=0x7f6168009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.630+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6164055370 con 0x7f61741f23b0 2023-11-04T01:38:29.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.829+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6174066170 con 0x7f61741f23b0 2023-11-04T01:38:29.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.830+0000 7f615b7fe640 1 -- 172.21.15.93:0/1187730662 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f6164058990 con 0x7f61741f23b0 2023-11-04T01:38:29.831 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:29.831 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:29.831 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:29.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.831+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 msgr2=0x7f616006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.831+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 0x7f616006d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61741e40a0 tx=0x7f6168009040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.831+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 msgr2=0x7f61741e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6164011e30 tx=0x7f616400f580 comp rx=0 tx=0).stop 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 shutdown_connections 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f616006aea0 0x7f616006d360 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61740c8200 0x7f61741e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61740c62b0 0x7f61740c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 --2- 172.21.15.93:0/1187730662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61741f23b0 0x7f61741e7380 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 >> 172.21.15.93:0/1187730662 conn(0x7f61740b0cd0 msgr2=0x7f61740adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 shutdown_connections 2023-11-04T01:38:29.834 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.832+0000 7f61796c2640 1 -- 172.21.15.93:0/1187730662 wait complete. 2023-11-04T01:38:29.844 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:29.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.942+0000 7f2dece2d640 1 Processor -- start 2023-11-04T01:38:29.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.942+0000 7f2dece2d640 1 -- start start 2023-11-04T01:38:29.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2dece2d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2de815ce70 0x7f2de806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2dece2d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 0x7f2de80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2dece2d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de806a120 con 0x7f2de815d250 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2dece2d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cdc10 con 0x7f2de815ce70 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2dece2d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de806def0 con 0x7f2de80cb5c0 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2de815ce70 0x7f2de806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de5d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2de815d250 0x7f2de80c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51000/0 (socket says 172.21.15.93:51000) 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de5d9b640 1 -- 172.21.15.93:0/37692711 learned_addr learned my addr 172.21.15.93:0/37692711 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de6d9d640 1 --2- 172.21.15.93:0/37692711 >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 0x7f2de80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de659c640 1 -- 172.21.15.93:0/37692711 >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 msgr2=0x7f2de80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de659c640 1 --2- 172.21.15.93:0/37692711 >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 0x7f2de80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de659c640 1 -- 172.21.15.93:0/37692711 >> v1:172.21.15.93:6789/0 conn(0x7f2de815d250 legacy=0x7f2de80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.945 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de559a640 1 -- 172.21.15.93:0/37692711 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441261810 0 0) 0x7f2de806a120 con 0x7f2de815d250 2023-11-04T01:38:29.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de659c640 1 -- 172.21.15.93:0/37692711 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80c9f40 con 0x7f2de815ce70 2023-11-04T01:38:29.946 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.943+0000 7f2de6d9d640 1 --2- 172.21.15.93:0/37692711 >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 0x7f2de80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.944+0000 7f2de659c640 1 --2- 172.21.15.93:0/37692711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815ce70 0x7f2de806d9b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2de809cee0 tx=0x7f2de002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2ed63a332bf513 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.944+0000 7f2de559a640 1 -- 172.21.15.93:0/37692711 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0031830 con 0x7f2de815ce70 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.944+0000 7f2de559a640 1 -- 172.21.15.93:0/37692711 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0031990 con 0x7f2de815ce70 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.944+0000 7f2de559a640 1 -- 172.21.15.93:0/37692711 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0031d20 con 0x7f2de815ce70 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 -- 172.21.15.93:0/37692711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815ce70 msgr2=0x7f2de806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 --2- 172.21.15.93:0/37692711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815ce70 0x7f2de806d9b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2de809cee0 tx=0x7f2de002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 -- 172.21.15.93:0/37692711 shutdown_connections 2023-11-04T01:38:29.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 --2- 172.21.15.93:0/37692711 >> v2:172.21.15.125:3300/0 conn(0x7f2de80cb5c0 0x7f2de80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 --2- 172.21.15.93:0/37692711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815ce70 0x7f2de806d9b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 -- 172.21.15.93:0/37692711 >> 172.21.15.93:0/37692711 conn(0x7f2de80b0cd0 msgr2=0x7f2de80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 -- 172.21.15.93:0/37692711 shutdown_connections 2023-11-04T01:38:29.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.945+0000 7f2dece2d640 1 -- 172.21.15.93:0/37692711 wait complete. 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.946+0000 7f2dece2d640 1 Processor -- start 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.946+0000 7f2dece2d640 1 -- start start 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2de80cb5c0 0x7f2de8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2de815ce70 0x7f2de815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b29a0 con 0x7f2de815d250 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de815a960 con 0x7f2de815ce70 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2dece2d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de815ac40 con 0x7f2de80cb5c0 2023-11-04T01:38:29.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41602/0 (socket says 172.21.15.93:41602) 2023-11-04T01:38:29.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 -- 172.21.15.93:0/3282103691 learned_addr learned my addr 172.21.15.93:0/3282103691 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de5d9b640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2de815ce70 0x7f2de815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de659c640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2de80cb5c0 0x7f2de8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 -- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2de80cb5c0 msgr2=0x7f2de8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2de80cb5c0 0x7f2de8158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 -- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2de815ce70 msgr2=0x7f2de815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2de815ce70 0x7f2de815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.947+0000 7f2de6d9d640 1 -- 172.21.15.93:0/3282103691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009400 con 0x7f2de815d250 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2de6d9d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007df0 tx=0x7f2dd800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8003990 con 0x7f2de815d250 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800f040 con 0x7f2de815d250 2023-11-04T01:38:29.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de815af20 con 0x7f2de815d250 2023-11-04T01:38:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8003d30 con 0x7f2de815d250 2023-11-04T01:38:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.948+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8159210 con 0x7f2de815d250 2023-11-04T01:38:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.949+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80b2ae0 con 0x7f2de815d250 2023-11-04T01:38:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.949+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dd8004030 con 0x7f2de815d250 2023-11-04T01:38:29.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.950+0000 7f2ddeffd640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 0x7f2dc806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.950+0000 7f2de659c640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 0x7f2dc806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.950+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2dd8089dc0 con 0x7f2de815d250 2023-11-04T01:38:29.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.950+0000 7f2de659c640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 0x7f2dc806d360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:29.954+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2de80b2ae0 con 0x7f2de815d250 2023-11-04T01:38:30.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.160+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2de80b2ae0 con 0x7f2de815d250 2023-11-04T01:38:30.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.160+0000 7f2ddeffd640 1 -- 172.21.15.93:0/3282103691 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f2de80b2ae0 con 0x7f2de815d250 2023-11-04T01:38:30.162 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:30.162 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:11.654445+0000","modified":"2023-11-04T01:38:13.648845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6835/2577358209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2577358209},{"type":"v1","addr":"172.21.15.93:6835","nonce":2577358209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:30.162 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 29 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 msgr2=0x7f2dc806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 0x7f2dc806d360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 msgr2=0x7f2de80abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007df0 tx=0x7f2dd800d4a0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 shutdown_connections 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dc806aea0 0x7f2dc806d360 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2de815d250 0x7f2de80abe10 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2de815ce70 0x7f2de815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 --2- 172.21.15.93:0/3282103691 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2de80cb5c0 0x7f2de8158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 >> 172.21.15.93:0/3282103691 conn(0x7f2de80b0cd0 msgr2=0x7f2de806d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 shutdown_connections 2023-11-04T01:38:30.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.162+0000 7f2dece2d640 1 -- 172.21.15.93:0/3282103691 wait complete. 2023-11-04T01:38:30.175 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:30.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.273+0000 7fe66847c640 1 Processor -- start 2023-11-04T01:38:30.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.273+0000 7fe66847c640 1 -- start start 2023-11-04T01:38:30.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe66847c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe66015ad80 0x7fe6600abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe66847c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe66006a1b0 0x7fe66006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe66847c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66006cf60 con 0x7fe6600c9a40 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe66847c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600ac390 con 0x7fe66015ad80 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe66847c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66015b160 con 0x7fe66006a1b0 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe66015ad80 0x7fe6600abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe66015ad80 0x7fe6600abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41608/0 (socket says 172.21.15.93:41608) 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 -- 172.21.15.93:0/3328178334 learned_addr learned my addr 172.21.15.93:0/3328178334 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe665a17640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe66006a1b0 0x7fe66006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 -- 172.21.15.93:0/3328178334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe66006a1b0 msgr2=0x7fe66006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe66006a1b0 0x7fe66006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 -- 172.21.15.93:0/3328178334 >> v1:172.21.15.125:6789/0 conn(0x7fe6600c9a40 legacy=0x7fe66006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.274+0000 7fe666218640 1 -- 172.21.15.93:0/3328178334 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66006b9b0 con 0x7fe66015ad80 2023-11-04T01:38:30.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.275+0000 7fe666218640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6600abe50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009870 tx=0x7fe65c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707f051a04558327 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.275+0000 7fe665216640 1 -- 172.21.15.93:0/3328178334 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c031640 con 0x7fe66015ad80 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.275+0000 7fe665216640 1 -- 172.21.15.93:0/3328178334 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c0317a0 con 0x7fe66015ad80 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.275+0000 7fe665216640 1 -- 172.21.15.93:0/3328178334 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c031b30 con 0x7fe66015ad80 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 -- 172.21.15.93:0/3328178334 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 msgr2=0x7fe6600abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6600abe50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009870 tx=0x7fe65c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 -- 172.21.15.93:0/3328178334 shutdown_connections 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe66006a1b0 0x7fe66006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 --2- 172.21.15.93:0/3328178334 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6600abe50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 -- 172.21.15.93:0/3328178334 >> 172.21.15.93:0/3328178334 conn(0x7fe6600b0cd0 msgr2=0x7fe6600b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 -- 172.21.15.93:0/3328178334 shutdown_connections 2023-11-04T01:38:30.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.276+0000 7fe66847c640 1 -- 172.21.15.93:0/3328178334 wait complete. 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.277+0000 7fe66847c640 1 Processor -- start 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.277+0000 7fe66847c640 1 -- start start 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66006a1b0 0x7fe6600c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6600c9a40 0x7fe66014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66014f000 con 0x7fe66015ad80 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66014f2e0 con 0x7fe66006a1b0 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c7eb0 con 0x7fe6600c9a40 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41616/0 (socket says 172.21.15.93:41616) 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 -- 172.21.15.93:0/47060207 learned_addr learned my addr 172.21.15.93:0/47060207 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 -- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6600c9a40 msgr2=0x7fe66014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6600c9a40 0x7fe66014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666218640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66006a1b0 0x7fe6600c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 -- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66006a1b0 msgr2=0x7fe6600c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66006a1b0 0x7fe6600c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 -- 172.21.15.93:0/47060207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0094d0 con 0x7fe66015ad80 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe666a19640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c780 tx=0x7fe65800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658004b60 con 0x7fe66015ad80 2023-11-04T01:38:30.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800ce90 con 0x7fe66015ad80 2023-11-04T01:38:30.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6600c8190 con 0x7fe66015ad80 2023-11-04T01:38:30.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800a850 con 0x7fe66015ad80 2023-11-04T01:38:30.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.278+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66014c6f0 con 0x7fe66015ad80 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.279+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6600c7d10 con 0x7fe66015ad80 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.280+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe65800a9b0 con 0x7fe66015ad80 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.280+0000 7fe656ffd640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 0x7fe64406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.280+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe658089cc0 con 0x7fe66015ad80 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.280+0000 7fe666218640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 0x7fe64406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.281+0000 7fe666218640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 0x7fe64406d360 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe65c036000 tx=0x7fe65c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.284+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6600c7d10 con 0x7fe66015ad80 2023-11-04T01:38:30.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.452+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6600c7d10 con 0x7fe66015ad80 2023-11-04T01:38:30.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.454+0000 7fe656ffd640 1 -- 172.21.15.93:0/47060207 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22069 (secure 0 0 0) 0x7fe6600c7d10 con 0x7fe66015ad80 2023-11-04T01:38:30.456 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:30.456 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":71,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:27.032613+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:10.157966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:10.624302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:30.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 msgr2=0x7fe64406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 0x7fe64406d360 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe65c036000 tx=0x7fe65c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:30.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 msgr2=0x7fe6601f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c780 tx=0x7fe65800cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 shutdown_connections 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe64406aea0 0x7fe64406d360 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe66015ad80 0x7fe6601f4230 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6600c9a40 0x7fe66014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 --2- 172.21.15.93:0/47060207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66006a1b0 0x7fe6600c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 >> 172.21.15.93:0/47060207 conn(0x7fe6600b0cd0 msgr2=0x7fe660155100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 shutdown_connections 2023-11-04T01:38:30.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.456+0000 7fe66847c640 1 -- 172.21.15.93:0/47060207 wait complete. 2023-11-04T01:38:30.468 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:30.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.567+0000 7ff374c75640 1 Processor -- start 2023-11-04T01:38:30.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.567+0000 7ff374c75640 1 -- start start 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff374c75640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff37015ad30 0x7ff3700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff374c75640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700c3900 con 0x7ff370070e20 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff374c75640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700c3be0 con 0x7ff3700ad730 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff374c75640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3700ae260 con 0x7ff37015ad30 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36ed9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff370070e20 0x7ff37015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51016/0 (socket says 172.21.15.93:51016) 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36ed9d640 1 -- 172.21.15.93:0/469694527 learned_addr learned my addr 172.21.15.93:0/469694527 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466001322 0 0) 0x7ff3700c3900 con 0x7ff370070e20 2023-11-04T01:38:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36e59c640 1 --2- 172.21.15.93:0/469694527 >> v2:172.21.15.125:3300/0 conn(0x7ff37015ad30 0x7ff3700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff35c003520 con 0x7ff370070e20 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553426504 0 0) 0x7ff35c003520 con 0x7ff370070e20 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 >> v2:172.21.15.125:3300/0 conn(0x7ff37015ad30 msgr2=0x7ff3700adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 --2- 172.21.15.93:0/469694527 >> v2:172.21.15.125:3300/0 conn(0x7ff37015ad30 0x7ff3700adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 >> v1:172.21.15.125:6789/0 conn(0x7ff3700ad730 legacy=0x7ff370070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700c3ec0 con 0x7ff370070e20 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff3680019f0 con 0x7ff370070e20 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 >> v1:172.21.15.93:6789/0 conn(0x7ff370070e20 legacy=0x7ff37015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff35c0052a0 0x7ff35c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700ae260 con 0x7ff35c003970 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c00c170 con 0x7ff35c0052a0 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.568+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c00c330 con 0x7ff35c0047c0 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff367fff640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36ed9d640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff35c0052a0 0x7ff35c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 -- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c0047c0 msgr2=0x7ff35c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 -- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff35c0052a0 msgr2=0x7ff35c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff35c0052a0 0x7ff35c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.574 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 -- 172.21.15.93:0/469694527 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c003520 con 0x7ff35c003970 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36ed9d640 1 -- 172.21.15.93:0/469694527 reap_dead start 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.569+0000 7ff36e59c640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff36000ba00 tx=0x7ff35c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fa2e36adf7f4ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360032620 con 0x7ff35c003970 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff360032780 con 0x7ff35c003970 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff36dd9b640 1 -- 172.21.15.93:0/469694527 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360032b10 con 0x7ff35c003970 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 -- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 msgr2=0x7ff35c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff36000ba00 tx=0x7ff35c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 -- 172.21.15.93:0/469694527 shutdown_connections 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 --2- 172.21.15.93:0/469694527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 -- 172.21.15.93:0/469694527 >> 172.21.15.93:0/469694527 conn(0x7ff3700ce950 msgr2=0x7ff3700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 -- 172.21.15.93:0/469694527 shutdown_connections 2023-11-04T01:38:30.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.570+0000 7ff374c75640 1 -- 172.21.15.93:0/469694527 wait complete. 2023-11-04T01:38:30.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 Processor -- start 2023-11-04T01:38:30.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 -- start start 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 0x7ff37014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff370151dc0 0x7ff3701537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700c87e0 con 0x7ff370153d10 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700c7b60 con 0x7ff370151dc0 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff374c75640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700c7e40 con 0x7ff35c003970 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff36ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff36ed9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41636/0 (socket says 172.21.15.93:41636) 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff36ed9d640 1 -- 172.21.15.93:0/3975047023 learned_addr learned my addr 172.21.15.93:0/3975047023 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff36e59c640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 0x7ff37014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.572+0000 7ff367fff640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff370151dc0 0x7ff3701537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 -- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 msgr2=0x7ff37014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 0x7ff37014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 -- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff370151dc0 msgr2=0x7ff3701537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff370151dc0 0x7ff3701537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 -- 172.21.15.93:0/3975047023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700c8120 con 0x7ff370153d10 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36e59c640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 0x7ff37014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff36ed9d640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff3700cb3a0 tx=0x7ff368007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368004e30 con 0x7ff370153d10 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800e890 con 0x7ff370153d10 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3700c8400 con 0x7ff370153d10 2023-11-04T01:38:30.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800ec40 con 0x7ff370153d10 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.573+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3701f4520 con 0x7ff370153d10 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.574+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3701f4770 con 0x7ff370153d10 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.574+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff368014430 con 0x7ff370153d10 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.575+0000 7ff366ffd640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 0x7ff35006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.575+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ff3680898a0 con 0x7ff370153d10 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.575+0000 7ff36e59c640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 0x7ff35006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.575+0000 7ff36e59c640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 0x7ff35006d360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff35c004740 tx=0x7ff36003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.579+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3680543d0 con 0x7ff370153d10 2023-11-04T01:38:30.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.780+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff3700c8920 con 0x7ff370153d10 2023-11-04T01:38:30.782 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:38:30.781+0000 7f76f40f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:30.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.783+0000 7ff366ffd640 1 -- 172.21.15.93:0/3975047023 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff3680579f0 con 0x7ff370153d10 2023-11-04T01:38:30.784 INFO:teuthology.orchestra.run.smithi093.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:30.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.786+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 msgr2=0x7ff35006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.786+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 0x7ff35006d360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff35c004740 tx=0x7ff36003d040 comp rx=0 tx=0).stop 2023-11-04T01:38:30.788 INFO:tasks.ceph.mds.c.smithi093.stderr: -567> 2023-11-04T01:38:18.037+0000 7fad7ea53640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.786+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 msgr2=0x7ff3701f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.786+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff3700cb3a0 tx=0x7ff368007b90 comp rx=0 tx=0).stop 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 shutdown_connections 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff35006aea0 0x7ff35006d360 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff370153d10 0x7ff3701f3e00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff370151dc0 0x7ff3701537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 --2- 172.21.15.93:0/3975047023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff35c003970 0x7ff37014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 >> 172.21.15.93:0/3975047023 conn(0x7ff3700ce950 msgr2=0x7ff37006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 shutdown_connections 2023-11-04T01:38:30.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.787+0000 7ff374c75640 1 -- 172.21.15.93:0/3975047023 wait complete. 2023-11-04T01:38:30.800 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:30.813 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:38:30.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.900+0000 7fc43f0b4640 1 Processor -- start 2023-11-04T01:38:30.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.900+0000 7fc43f0b4640 1 -- start start 2023-11-04T01:38:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43f0b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc43815ad30 0x7fc4380adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43f0b4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4380c3900 con 0x7fc438070e20 2023-11-04T01:38:30.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43f0b4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4380c3be0 con 0x7fc4380ad730 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43f0b4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4380ae260 con 0x7fc43815ad30 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43d651640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc438070e20 0x7fc43815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51028/0 (socket says 172.21.15.93:51028) 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.901+0000 7fc43d651640 1 -- 172.21.15.93:0/1149782135 learned_addr learned my addr 172.21.15.93:0/1149782135 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494380287 0 0) 0x7fc4380c3900 con 0x7fc438070e20 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc428003520 con 0x7fc438070e20 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc43ce50640 1 --2- 172.21.15.93:0/1149782135 >> v2:172.21.15.125:3300/0 conn(0x7fc43815ad30 0x7fc4380adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2915027317 0 0) 0x7fc428003520 con 0x7fc438070e20 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 >> v2:172.21.15.125:3300/0 conn(0x7fc43815ad30 msgr2=0x7fc4380adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 --2- 172.21.15.93:0/1149782135 >> v2:172.21.15.125:3300/0 conn(0x7fc43815ad30 0x7fc4380adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 >> v1:172.21.15.125:6789/0 conn(0x7fc4380ad730 legacy=0x7fc438070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380c3ec0 con 0x7fc438070e20 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fc4300019f0 con 0x7fc438070e20 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 >> v1:172.21.15.93:6789/0 conn(0x7fc438070e20 legacy=0x7fc43815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc428003970 0x7fc428003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4280047c0 0x7fc428004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 0x7fc42800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380ae260 con 0x7fc428005180 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800c120 con 0x7fc428003970 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800c2e0 con 0x7fc4280047c0 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc43d651640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 0x7fc42800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc43ce50640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc428003970 0x7fc428003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.902+0000 7fc437fff640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4280047c0 0x7fc428004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 -- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4280047c0 msgr2=0x7fc428004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4280047c0 0x7fc428004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 -- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc428003970 msgr2=0x7fc428003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc428003970 0x7fc428003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 -- 172.21.15.93:0/1149782135 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428003520 con 0x7fc428005180 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 -- 172.21.15.93:0/1149782135 reap_dead start 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc43d651640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 0x7fc42800b980 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc43000a820 tx=0x7fc4280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6fb560f61c7881 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300072d0 con 0x7fc428005180 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43002f070 con 0x7fc428005180 2023-11-04T01:38:30.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.903+0000 7fc4377fe640 1 -- 172.21.15.93:0/1149782135 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300076b0 con 0x7fc428005180 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 -- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 msgr2=0x7fc42800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 0x7fc42800b980 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc43000a820 tx=0x7fc4280057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 -- 172.21.15.93:0/1149782135 shutdown_connections 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/1149782135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc428005180 0x7fc42800b980 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 -- 172.21.15.93:0/1149782135 >> 172.21.15.93:0/1149782135 conn(0x7fc4380ce950 msgr2=0x7fc4380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 -- 172.21.15.93:0/1149782135 shutdown_connections 2023-11-04T01:38:30.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.904+0000 7fc43f0b4640 1 -- 172.21.15.93:0/1149782135 wait complete. 2023-11-04T01:38:30.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.905+0000 7fc43f0b4640 1 Processor -- start 2023-11-04T01:38:30.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.905+0000 7fc43f0b4640 1 -- start start 2023-11-04T01:38:30.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc428005180 0x7fc438150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc438150500 0x7fc43814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438150980 con 0x7fc43814bdd0 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4381f2e70 con 0x7fc438150500 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43f0b4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43814e990 con 0x7fc428005180 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41668/0 (socket says 172.21.15.93:41668) 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 -- 172.21.15.93:0/31600156 learned_addr learned my addr 172.21.15.93:0/31600156 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43ce50640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc428005180 0x7fc438150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc437fff640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc438150500 0x7fc43814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 -- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc428005180 msgr2=0x7fc438150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc428005180 0x7fc438150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 -- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc438150500 msgr2=0x7fc43814e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:30.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc438150500 0x7fc43814e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.906+0000 7fc43d651640 1 -- 172.21.15.93:0/31600156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43814ebf0 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc43d651640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f80 tx=0x7fc4380cb100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300019b0 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430001250 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4380cc9e0 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430004d60 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.907+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4380ccfa0 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.908+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc438074290 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.908+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc430031030 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.909+0000 7fc4357fa640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 0x7fc41c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.909+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fc4300ab6f0 con 0x7fc43814bdd0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.909+0000 7fc43ce50640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 0x7fc41c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:30.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.909+0000 7fc43ce50640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 0x7fc41c06d360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009b40 tx=0x7fc42c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:30.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:30.913+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4300761e0 con 0x7fc43814bdd0 2023-11-04T01:38:31.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.116+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc438074290 con 0x7fc43814bdd0 2023-11-04T01:38:31.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.784+0000 7fc4357fa640 1 -- 172.21.15.93:0/31600156 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc430079800 con 0x7fc43814bdd0 2023-11-04T01:38:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 msgr2=0x7fc41c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 0x7fc41c06d360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009b40 tx=0x7fc42c009190 comp rx=0 tx=0).stop 2023-11-04T01:38:31.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 msgr2=0x7fc43815c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f80 tx=0x7fc4380cb100 comp rx=0 tx=0).stop 2023-11-04T01:38:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 shutdown_connections 2023-11-04T01:38:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc41c06aea0 0x7fc41c06d360 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43814bdd0 0x7fc43815c5c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc438150500 0x7fc43814e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 --2- 172.21.15.93:0/31600156 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc428005180 0x7fc438150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 >> 172.21.15.93:0/31600156 conn(0x7fc4380ce950 msgr2=0x7fc43815b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 shutdown_connections 2023-11-04T01:38:31.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.786+0000 7fc43f0b4640 1 -- 172.21.15.93:0/31600156 wait complete. 2023-11-04T01:38:31.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:31.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 Processor -- start 2023-11-04T01:38:31.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 -- start start 2023-11-04T01:38:31.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7e000cd9f0 0x7f7e000cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000d27c0 0x7f7e0015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e000d1320 con 0x7f7e0015d4b0 2023-11-04T01:38:31.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0015e4d0 con 0x7f7e000cd9f0 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7e0676c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000ce310 con 0x7f7e000d27c0 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7dfffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7e000cd9f0 0x7f7e000cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.946+0000 7f7dff7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7e0015d4b0 0x7f7e000b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48582/0 (socket says 172.21.15.93:48582) 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dff7fe640 1 -- 172.21.15.93:0/4259543311 learned_addr learned my addr 172.21.15.93:0/4259543311 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7e04d09640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000d27c0 0x7f7e0015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dfffff640 1 -- 172.21.15.93:0/4259543311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000d27c0 msgr2=0x7f7e0015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dfffff640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000d27c0 0x7f7e0015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dfffff640 1 -- 172.21.15.93:0/4259543311 >> v1:172.21.15.93:6789/0 conn(0x7f7e0015d4b0 legacy=0x7f7e000b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dfffff640 1 -- 172.21.15.93:0/4259543311 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0015df10 con 0x7f7e000cd9f0 2023-11-04T01:38:31.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.947+0000 7f7dfeffd640 1 -- 172.21.15.93:0/4259543311 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293011185 0 0) 0x7f7e000d1320 con 0x7f7e0015d4b0 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7dfffff640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e000cd9f0 0x7f7e000cddd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097a0 tx=0x7f7df002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641e8ea093d30ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7dfeffd640 1 -- 172.21.15.93:0/4259543311 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0030610 con 0x7f7e000cd9f0 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7dfeffd640 1 -- 172.21.15.93:0/4259543311 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0030770 con 0x7f7e000cd9f0 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7dfeffd640 1 -- 172.21.15.93:0/4259543311 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0030b00 con 0x7f7e000cd9f0 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 -- 172.21.15.93:0/4259543311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e000cd9f0 msgr2=0x7f7e000cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e000cd9f0 0x7f7e000cddd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7df00097a0 tx=0x7f7df002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 -- 172.21.15.93:0/4259543311 shutdown_connections 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000d27c0 0x7f7e0015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 --2- 172.21.15.93:0/4259543311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e000cd9f0 0x7f7e000cddd0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 -- 172.21.15.93:0/4259543311 >> 172.21.15.93:0/4259543311 conn(0x7f7e00071c40 msgr2=0x7f7e00072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 -- 172.21.15.93:0/4259543311 shutdown_connections 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.948+0000 7f7e0676c640 1 -- 172.21.15.93:0/4259543311 wait complete. 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.949+0000 7f7e0676c640 1 Processor -- start 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 -- start start 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 0x7f7e000ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 0x7f7e00151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000cb840 con 0x7f7e0015d4b0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000cacb0 con 0x7f7e000d27c0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e0676c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00151690 con 0x7f7e000cd9f0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e04d09640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e04d09640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43048/0 (socket says 172.21.15.93:43048) 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.950+0000 7f7e04d09640 1 -- 172.21.15.93:0/1910041389 learned_addr learned my addr 172.21.15.93:0/1910041389 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dfffff640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 0x7f7e000ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dff7fe640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 0x7f7e00151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 -- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 msgr2=0x7f7e000ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 0x7f7e000ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 -- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 msgr2=0x7f7e00151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 0x7f7e00151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 -- 172.21.15.93:0/1910041389 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009400 con 0x7f7e0015d4b0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dfffff640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 0x7f7e000ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dff7fe640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 0x7f7e00151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e04d09640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7df800cc30 tx=0x7f7df800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800ae80 con 0x7f7e0015d4b0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800ce40 con 0x7f7e0015d4b0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e001f28e0 con 0x7f7e0015d4b0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8003b90 con 0x7f7e0015d4b0 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.951+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e001f2e50 con 0x7f7e0015d4b0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.952+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e000cb5a0 con 0x7f7e0015d4b0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.952+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7df800f3f0 con 0x7f7e0015d4b0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.953+0000 7f7dfcff9640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 0x7f7dec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.953+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f7df8089e30 con 0x7f7e0015d4b0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.953+0000 7f7dfffff640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 0x7f7dec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.953+0000 7f7dfffff640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 0x7f7dec06d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:31.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:31.957+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e000cb5a0 con 0x7f7e0015d4b0 2023-11-04T01:38:32.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:32.127+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e000cb980 con 0x7f7e0015d4b0 2023-11-04T01:38:33.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.098+0000 7f7dfcff9640 1 -- 172.21.15.93:0/1910041389 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7e000cb980 con 0x7f7e0015d4b0 2023-11-04T01:38:33.099 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.100+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 msgr2=0x7f7dec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.100+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 0x7f7dec06d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df0008030 comp rx=0 tx=0).stop 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.100+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 msgr2=0x7f7e001f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.100+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7df800cc30 tx=0x7f7df800a5c0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 shutdown_connections 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7dec06ae70 0x7f7dec06d330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e0015d4b0 0x7f7e001f23a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d27c0 0x7f7e00151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 --2- 172.21.15.93:0/1910041389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e000cd9f0 0x7f7e000ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 >> 172.21.15.93:0/1910041389 conn(0x7f7e00071c40 msgr2=0x7f7e0006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 shutdown_connections 2023-11-04T01:38:33.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.101+0000 7f7e0676c640 1 -- 172.21.15.93:0/1910041389 wait complete. 2023-11-04T01:38:33.121 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:33.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.227+0000 7f61c098a640 1 Processor -- start 2023-11-04T01:38:33.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 -- start start 2023-11-04T01:38:33.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f61bc0caf80 0x7f61bc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15de50 con 0x7f61bc0c4f90 2023-11-04T01:38:33.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0ca1c0 con 0x7f61bc0caf80 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.228+0000 7f61c098a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0ca4a0 con 0x7f61bc0c5370 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f61bc0caf80 0x7f61bc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61ba59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f61bc0c4f90 0x7f61bc15d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48588/0 (socket says 172.21.15.93:48588) 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61ba59c640 1 -- 172.21.15.93:0/1816798561 learned_addr learned my addr 172.21.15.93:0/1816798561 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61bad9d640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b3fff640 1 -- 172.21.15.93:0/1816798561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 msgr2=0x7f61bc1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b3fff640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b3fff640 1 -- 172.21.15.93:0/1816798561 >> v1:172.21.15.93:6789/0 conn(0x7f61bc0c4f90 legacy=0x7f61bc15d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b3fff640 1 -- 172.21.15.93:0/1816798561 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0ca780 con 0x7f61bc0caf80 2023-11-04T01:38:33.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.229+0000 7f61b9d9b640 1 -- 172.21.15.93:0/1816798561 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920607662 0 0) 0x7f61bc15de50 con 0x7f61bc0c4f90 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61b3fff640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc15d810 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f61a400a940 tx=0x7f61a402ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cda4db16ce0b31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61b9d9b640 1 -- 172.21.15.93:0/1816798561 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a402daa0 con 0x7f61bc0caf80 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61b9d9b640 1 -- 172.21.15.93:0/1816798561 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a402dc00 con 0x7f61bc0caf80 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61b9d9b640 1 -- 172.21.15.93:0/1816798561 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4035440 con 0x7f61bc0caf80 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 -- 172.21.15.93:0/1816798561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 msgr2=0x7f61bc15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc15d810 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f61a400a940 tx=0x7f61a402ccf0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 -- 172.21.15.93:0/1816798561 shutdown_connections 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 --2- 172.21.15.93:0/1816798561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc15d810 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 -- 172.21.15.93:0/1816798561 >> 172.21.15.93:0/1816798561 conn(0x7f61bc0b05d0 msgr2=0x7f61bc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 -- 172.21.15.93:0/1816798561 shutdown_connections 2023-11-04T01:38:33.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.230+0000 7f61c098a640 1 -- 172.21.15.93:0/1816798561 wait complete. 2023-11-04T01:38:33.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 Processor -- start 2023-11-04T01:38:33.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 -- start start 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61bc0c4f90 0x7f61bc0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc15b490 con 0x7f61bc0caf80 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc15b6a0 con 0x7f61bc0c4f90 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.232+0000 7f61c098a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc15b980 con 0x7f61bc0c5370 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43070/0 (socket says 172.21.15.93:43070) 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 -- 172.21.15.93:0/3203668744 learned_addr learned my addr 172.21.15.93:0/3203668744 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:33.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61b3fff640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61ba59c640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61bc0c4f90 0x7f61bc0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 -- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 msgr2=0x7f61bc151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 -- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61bc0c4f90 msgr2=0x7f61bc0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61bc0c4f90 0x7f61bc0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 -- 172.21.15.93:0/3203668744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a400a5a0 con 0x7f61bc0caf80 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61bad9d640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007ed0 tx=0x7f61b40106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4013880 con 0x7f61bc0caf80 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4013a00 con 0x7f61bc0caf80 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc15bc60 con 0x7f61bc0caf80 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4013db0 con 0x7f61bc0caf80 2023-11-04T01:38:33.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.233+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc0af540 con 0x7f61bc0caf80 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.234+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc0af730 con 0x7f61bc0caf80 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.235+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61b40123d0 con 0x7f61bc0caf80 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.235+0000 7f61b2ffd640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 0x7f619c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.235+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6798+0+0 (secure 0 0 0) 0x7f61b408cae0 con 0x7f61bc0caf80 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.235+0000 7f61ba59c640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 0x7f619c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.235+0000 7f61ba59c640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 0x7f619c06d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000f60 tx=0x7f61ac007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.239+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61b4057800 con 0x7f61bc0caf80 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:33.408+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61bc15c180 con 0x7f61bc0caf80 2023-11-04T01:38:34.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.114+0000 7f61b2ffd640 1 -- 172.21.15.93:0/3203668744 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f61bc15c180 con 0x7f61bc0caf80 2023-11-04T01:38:34.115 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:34.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.117+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 msgr2=0x7f619c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.117+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 0x7f619c06d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f61ac000f60 tx=0x7f61ac007d50 comp rx=0 tx=0).stop 2023-11-04T01:38:34.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.117+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 msgr2=0x7f61bc151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.117+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007ed0 tx=0x7f61b40106c0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 shutdown_connections 2023-11-04T01:38:34.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f619c06ae70 0x7f619c06d330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f61bc0caf80 0x7f61bc151ca0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f61bc0c5370 0x7f61bc151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 --2- 172.21.15.93:0/3203668744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61bc0c4f90 0x7f61bc0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 >> 172.21.15.93:0/3203668744 conn(0x7f61bc0b05d0 msgr2=0x7f61bc1564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 shutdown_connections 2023-11-04T01:38:34.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.118+0000 7f61c098a640 1 -- 172.21.15.93:0/3203668744 wait complete. 2023-11-04T01:38:34.134 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:34.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.236+0000 7fc37d7dc640 1 Processor -- start 2023-11-04T01:38:34.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.236+0000 7fc37d7dc640 1 -- start start 2023-11-04T01:38:34.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc37d7dc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc3780cd6d0 0x7fc378161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc37d7dc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780b4880 0x7fc3780b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc37d7dc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3780cde60 con 0x7fc378153e60 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc37d7dc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc378160f90 con 0x7fc3780cd6d0 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc37d7dc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc378161960 con 0x7fc3780b4880 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc3777fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780b4880 0x7fc3780b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc3767fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc3780cd6d0 0x7fc378161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc376ffd640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc378153e60 0x7fc37815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:51402/0 (socket says 172.21.15.93:51402) 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc376ffd640 1 -- 172.21.15.93:0/2108985240 learned_addr learned my addr 172.21.15.93:0/2108985240 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:34.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.237+0000 7fc3767fc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc3780cd6d0 0x7fc378161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:39346/0 (socket says 172.21.15.93:39346) 2023-11-04T01:38:34.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.238+0000 7fc3767fc640 1 -- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780b4880 msgr2=0x7fc3780b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.238+0000 7fc3767fc640 1 --2- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780b4880 0x7fc3780b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.238+0000 7fc3767fc640 1 -- 172.21.15.93:0/2108985240 >> v1:172.21.15.125:6789/0 conn(0x7fc378153e60 legacy=0x7fc37815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.238+0000 7fc3767fc640 1 -- 172.21.15.93:0/2108985240 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780b5220 con 0x7fc3780cd6d0 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc3767fc640 1 --2- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3780cd6d0 0x7fc378161420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feb667eff7edb2c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc375ffb640 1 -- 172.21.15.93:0/2108985240 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c031830 con 0x7fc3780cd6d0 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc375ffb640 1 -- 172.21.15.93:0/2108985240 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c031990 con 0x7fc3780cd6d0 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc375ffb640 1 -- 172.21.15.93:0/2108985240 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c031d20 con 0x7fc3780cd6d0 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 -- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3780cd6d0 msgr2=0x7fc378161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3780cd6d0 0x7fc378161420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 -- 172.21.15.93:0/2108985240 shutdown_connections 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780b4880 0x7fc3780b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/2108985240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3780cd6d0 0x7fc378161420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 -- 172.21.15.93:0/2108985240 >> 172.21.15.93:0/2108985240 conn(0x7fc3780cf880 msgr2=0x7fc3780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 -- 172.21.15.93:0/2108985240 shutdown_connections 2023-11-04T01:38:34.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.239+0000 7fc37d7dc640 1 -- 172.21.15.93:0/2108985240 wait complete. 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 Processor -- start 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 -- start start 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780cd6d0 0x7fc378159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc378153e60 0x7fc3780c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37815a530 con 0x7fc3780b4880 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc378155d20 con 0x7fc378153e60 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc37d7dc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc378156000 con 0x7fc3780cd6d0 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc376ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc376ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43072/0 (socket says 172.21.15.93:43072) 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.241+0000 7fc376ffd640 1 -- 172.21.15.93:0/3238305516 learned_addr learned my addr 172.21.15.93:0/3238305516 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:34.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc3777fe640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc378153e60 0x7fc3780c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc3767fc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780cd6d0 0x7fc378159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 -- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780cd6d0 msgr2=0x7fc378159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780cd6d0 0x7fc378159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 -- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc378153e60 msgr2=0x7fc3780c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc378153e60 0x7fc3780c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 -- 172.21.15.93:0/3238305516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009400 con 0x7fc3780b4880 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc376ffd640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc36800cbc0 tx=0x7fc36800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36800aca0 con 0x7fc3780b4880 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36800ae00 con 0x7fc3780b4880 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3781562e0 con 0x7fc3780b4880 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368012600 con 0x7fc3780b4880 2023-11-04T01:38:34.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.242+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3781568a0 con 0x7fc3780b4880 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.243+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc378160bc0 con 0x7fc3780b4880 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.244+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc368007070 con 0x7fc3780b4880 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.244+0000 7fc35f7fe640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 0x7fc36406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.244+0000 7fc3767fc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 0x7fc36406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.244+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fc3680896c0 con 0x7fc3780b4880 2023-11-04T01:38:34.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.245+0000 7fc3767fc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 0x7fc36406d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc36c036000 tx=0x7fc36c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.248+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3680545b0 con 0x7fc3780b4880 2023-11-04T01:38:34.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.421+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc378074290 con 0x7fc3780b4880 2023-11-04T01:38:34.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.424+0000 7fc35f7fe640 1 -- 172.21.15.93:0/3238305516 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc368057bd0 con 0x7fc3780b4880 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 msgr2=0x7fc36406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 0x7fc36406d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc36c036000 tx=0x7fc36c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 msgr2=0x7fc378155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc36800cbc0 tx=0x7fc36800a060 comp rx=0 tx=0).stop 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 shutdown_connections 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc36406ae70 0x7fc36406d330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc378153e60 0x7fc3780c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc3780cd6d0 0x7fc378159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 --2- 172.21.15.93:0/3238305516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780b4880 0x7fc378155680 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 >> 172.21.15.93:0/3238305516 conn(0x7fc3780cf880 msgr2=0x7fc37815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.426+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 shutdown_connections 2023-11-04T01:38:34.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.427+0000 7fc37d7dc640 1 -- 172.21.15.93:0/3238305516 wait complete. 2023-11-04T01:38:34.439 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:38:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.537+0000 7fe23e4a9640 1 Processor -- start 2023-11-04T01:38:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.537+0000 7fe23e4a9640 1 -- start start 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23e4a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe238070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23e4a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380cc990 con 0x7fe2380cde40 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23e4a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380ccc70 con 0x7fe2380cda60 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23e4a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c9ce0 con 0x7fe2380b0cd0 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23ca46640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe2380cde40 0x7fe23806c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48590/0 (socket says 172.21.15.93:48590) 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe23ca46640 1 -- 172.21.15.93:0/1022326405 learned_addr learned my addr 172.21.15.93:0/1022326405 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333185044 0 0) 0x7fe2380cc990 con 0x7fe2380cde40 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe220003520 con 0x7fe2380cde40 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe2377fe640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe238070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790506482 0 0) 0x7fe220003520 con 0x7fe2380cde40 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 msgr2=0x7fe238070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe238070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 >> v1:172.21.15.125:6789/0 conn(0x7fe2380cda60 legacy=0x7fe2380ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380c9fc0 con 0x7fe2380cde40 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fe2300019f0 con 0x7fe2380cde40 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 >> v1:172.21.15.93:6789/0 conn(0x7fe2380cde40 legacy=0x7fe23806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe2200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe220003fd0 0x7fe2200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220004d00 0x7fe220005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c9ce0 con 0x7fe220003fd0 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000cc50 con 0x7fe220004d00 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.538+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000ce10 con 0x7fe2380b0cd0 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe220003fd0 0x7fe2200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe237fff640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe2200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe23ca46640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220004d00 0x7fe220005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 -- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 msgr2=0x7fe2200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe2380b0cd0 0x7fe2200039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 -- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220004d00 msgr2=0x7fe220005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220004d00 0x7fe220005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 -- 172.21.15.93:0/1022326405 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220003520 con 0x7fe220003fd0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.539+0000 7fe2377fe640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe220003fd0 0x7fe2200047c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ba30 tx=0x7fe2200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e1caf3bc1fe1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228032640 con 0x7fe220003fd0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280327a0 con 0x7fe220003fd0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe236ffd640 1 -- 172.21.15.93:0/1022326405 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228032b30 con 0x7fe220003fd0 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 -- 172.21.15.93:0/1022326405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe220003fd0 msgr2=0x7fe2200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/1022326405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe220003fd0 0x7fe2200047c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ba30 tx=0x7fe2200057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23ca46640 1 -- 172.21.15.93:0/1022326405 reap_dead start 2023-11-04T01:38:34.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 -- 172.21.15.93:0/1022326405 shutdown_connections 2023-11-04T01:38:34.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 -- 172.21.15.93:0/1022326405 >> 172.21.15.93:0/1022326405 conn(0x7fe2380ce950 msgr2=0x7fe2380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 -- 172.21.15.93:0/1022326405 shutdown_connections 2023-11-04T01:38:34.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.540+0000 7fe23e4a9640 1 -- 172.21.15.93:0/1022326405 wait complete. 2023-11-04T01:38:34.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.541+0000 7fe23e4a9640 1 Processor -- start 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.541+0000 7fe23e4a9640 1 -- start start 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220003fd0 0x7fe2380c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe23815b8c0 0x7fe2380b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2381523b0 con 0x7fe2381519f0 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c6290 con 0x7fe220003fd0 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23e4a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380c6570 con 0x7fe23815b8c0 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23ca46640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23ca46640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43084/0 (socket says 172.21.15.93:43084) 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe23ca46640 1 -- 172.21.15.93:0/177085390 learned_addr learned my addr 172.21.15.93:0/177085390 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe2377fe640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe23815b8c0 0x7fe2380b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.542+0000 7fe237fff640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220003fd0 0x7fe2380c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 -- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe23815b8c0 msgr2=0x7fe2380b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe23815b8c0 0x7fe2380b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 -- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220003fd0 msgr2=0x7fe2380c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220003fd0 0x7fe2380c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 -- 172.21.15.93:0/177085390 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380c6850 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23ca46640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe238071bd0 tx=0x7fe230007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000abd0 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000ad70 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2380c6b30 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230013630 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.543+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2380c5ed0 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.544+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2380c6060 con 0x7fe2381519f0 2023-11-04T01:38:34.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.544+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe230013790 con 0x7fe2381519f0 2023-11-04T01:38:34.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.545+0000 7fe234ff9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 0x7fe22406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.545+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe230089e00 con 0x7fe2381519f0 2023-11-04T01:38:34.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.545+0000 7fe237fff640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 0x7fe22406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.545+0000 7fe237fff640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 0x7fe22406d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0017e0 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.549+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe230054cf0 con 0x7fe2381519f0 2023-11-04T01:38:34.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:34.779+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7fe2381eece0 con 0x7fe2381519f0 2023-11-04T01:38:35.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.115+0000 7fe234ff9640 1 -- 172.21.15.93:0/177085390 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v178) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe2381eece0 con 0x7fe2381519f0 2023-11-04T01:38:35.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 msgr2=0x7fe22406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 0x7fe22406d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0017e0 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 msgr2=0x7fe238151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe238071bd0 tx=0x7fe230007bd0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 shutdown_connections 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe22406ae70 0x7fe22406d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2381519f0 0x7fe238151e70 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe23815b8c0 0x7fe2380b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 --2- 172.21.15.93:0/177085390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220003fd0 0x7fe2380c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 >> 172.21.15.93:0/177085390 conn(0x7fe2380ce950 msgr2=0x7fe2380ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 shutdown_connections 2023-11-04T01:38:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.117+0000 7fe23e4a9640 1 -- 172.21.15.93:0/177085390 wait complete. 2023-11-04T01:38:35.131 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:38:35.131 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:38:35.131 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:38:35.131 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:35.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.232+0000 7f6d595d0640 1 Processor -- start 2023-11-04T01:38:35.233 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.232+0000 7f6d595d0640 1 -- start start 2023-11-04T01:38:35.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d595d0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d540ce240 0x7f6d54157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d595d0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5415e000 con 0x7f6d54157540 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d595d0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5415e2e0 con 0x7f6d540cde60 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d595d0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5415e5c0 con 0x7f6d540ce240 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d4a7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d540ce240 0x7f6d54157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d537fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6d54157540 0x7f6d540d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48598/0 (socket says 172.21.15.93:48598) 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d537fe640 1 -- 172.21.15.93:0/785228586 learned_addr learned my addr 172.21.15.93:0/785228586 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d4a7fc640 1 -- 172.21.15.93:0/785228586 >> v1:172.21.15.125:6789/0 conn(0x7f6d540cde60 legacy=0x7f6d5415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d4a7fc640 1 -- 172.21.15.93:0/785228586 >> v1:172.21.15.93:6789/0 conn(0x7f6d54157540 legacy=0x7f6d540d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d527fc640 1 -- 172.21.15.93:0/785228586 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306487472 0 0) 0x7f6d5415e000 con 0x7f6d54157540 2023-11-04T01:38:35.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.233+0000 7f6d4a7fc640 1 -- 172.21.15.93:0/785228586 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540d1120 con 0x7f6d540ce240 2023-11-04T01:38:35.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d4a7fc640 1 --2- 172.21.15.93:0/785228586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d540ce240 0x7f6d54157000 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097a0 tx=0x7f6d3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e4aa7605565a56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d527fc640 1 -- 172.21.15.93:0/785228586 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c030610 con 0x7f6d540ce240 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d527fc640 1 -- 172.21.15.93:0/785228586 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c030770 con 0x7f6d540ce240 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d527fc640 1 -- 172.21.15.93:0/785228586 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c030b00 con 0x7f6d540ce240 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d595d0640 1 -- 172.21.15.93:0/785228586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d540ce240 msgr2=0x7f6d54157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.234+0000 7f6d595d0640 1 --2- 172.21.15.93:0/785228586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d540ce240 0x7f6d54157000 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097a0 tx=0x7f6d3c02b960 comp rx=0 tx=0).stop 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.235+0000 7f6d595d0640 1 -- 172.21.15.93:0/785228586 shutdown_connections 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.235+0000 7f6d595d0640 1 --2- 172.21.15.93:0/785228586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d540ce240 0x7f6d54157000 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.235+0000 7f6d595d0640 1 -- 172.21.15.93:0/785228586 >> 172.21.15.93:0/785228586 conn(0x7f6d54071f30 msgr2=0x7f6d540cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.235+0000 7f6d595d0640 1 -- 172.21.15.93:0/785228586 shutdown_connections 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.235+0000 7f6d595d0640 1 -- 172.21.15.93:0/785228586 wait complete. 2023-11-04T01:38:35.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.236+0000 7f6d595d0640 1 Processor -- start 2023-11-04T01:38:35.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.236+0000 7f6d595d0640 1 -- start start 2023-11-04T01:38:35.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 0x7f6d54144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d540ce240 0x7f6d541f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540c9ef0 con 0x7f6d54157540 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d541f33e0 con 0x7f6d540ce240 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d54147220 con 0x7f6d540cde60 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43092/0 (socket says 172.21.15.93:43092) 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 -- 172.21.15.93:0/451121274 learned_addr learned my addr 172.21.15.93:0/451121274 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d4a7fc640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d540ce240 0x7f6d541f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d52ffd640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 0x7f6d54144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 -- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 msgr2=0x7f6d54144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 0x7f6d54144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 -- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d540ce240 msgr2=0x7f6d541f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d540ce240 0x7f6d541f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 -- 172.21.15.93:0/451121274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009400 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d52ffd640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 0x7f6d54144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d537fe640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c780 tx=0x7f6d4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00ce90 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00a640 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00a9d0 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d54147500 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.237+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d54147ac0 con 0x7f6d54157540 2023-11-04T01:38:35.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.238+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d540ca060 con 0x7f6d54157540 2023-11-04T01:38:35.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.239+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d4c00ab30 con 0x7f6d54157540 2023-11-04T01:38:35.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.239+0000 7f6d4bfff640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 0x7f6d3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.239+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f6d4c088c20 con 0x7f6d54157540 2023-11-04T01:38:35.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.239+0000 7f6d52ffd640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 0x7f6d3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.240+0000 7f6d52ffd640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 0x7f6d3406d360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007fd0 tx=0x7f6d44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.244+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d540ca060 con 0x7f6d54157540 2023-11-04T01:38:35.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.411+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d540ca030 con 0x7f6d54157540 2023-11-04T01:38:35.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.412+0000 7f6d4bfff640 1 -- 172.21.15.93:0/451121274 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18444 (secure 0 0 0) 0x7f6d4c018020 con 0x7f6d54157540 2023-11-04T01:38:35.413 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:35.414 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":74,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:34.106829+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6835/2577358209":"2023-11-05T01:38:30.781538+0000","172.21.15.93:6834/2577358209":"2023-11-05T01:38:30.781538+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:35.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 msgr2=0x7f6d3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 0x7f6d3406d360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007fd0 tx=0x7f6d44009040 comp rx=0 tx=0).stop 2023-11-04T01:38:35.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 msgr2=0x7f6d540d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c780 tx=0x7f6d4c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:35.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 shutdown_connections 2023-11-04T01:38:35.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d3406aea0 0x7f6d3406d360 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d54157540 0x7f6d540d2e00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d540ce240 0x7f6d541f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 --2- 172.21.15.93:0/451121274 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d540cde60 0x7f6d54144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 >> 172.21.15.93:0/451121274 conn(0x7f6d54071f30 msgr2=0x7f6d540c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 shutdown_connections 2023-11-04T01:38:35.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.414+0000 7f6d595d0640 1 -- 172.21.15.93:0/451121274 wait complete. 2023-11-04T01:38:35.426 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:35.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:35.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.527+0000 7f3107083640 1 Processor -- start 2023-11-04T01:38:35.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.527+0000 7f3107083640 1 -- start start 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3107083640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31000cd6d0 0x7f3100161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3107083640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000cde60 con 0x7f31000b4880 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3107083640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3100160f90 con 0x7f3100153e60 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3107083640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3100161960 con 0x7f31000cd6d0 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f30fffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31000cd6d0 0x7f3100161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3105620640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f31000b4880 0x7f31000d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48600/0 (socket says 172.21.15.93:48600) 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.528+0000 7f3105620640 1 -- 172.21.15.93:0/3619297551 learned_addr learned my addr 172.21.15.93:0/3619297551 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.529+0000 7f30fffff640 1 -- 172.21.15.93:0/3619297551 >> v1:172.21.15.125:6789/0 conn(0x7f3100153e60 legacy=0x7f310015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.529+0000 7f30fffff640 1 -- 172.21.15.93:0/3619297551 >> v1:172.21.15.93:6789/0 conn(0x7f31000b4880 legacy=0x7f31000d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.529+0000 7f30fffff640 1 -- 172.21.15.93:0/3619297551 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000ce090 con 0x7f31000cd6d0 2023-11-04T01:38:35.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.529+0000 7f30fffff640 1 --2- 172.21.15.93:0/3619297551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100161420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30f40097a0 tx=0x7f30f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7134b432b51aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f30ff7fe640 1 -- 172.21.15.93:0/3619297551 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4031830 con 0x7f31000cd6d0 2023-11-04T01:38:35.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f30ff7fe640 1 -- 172.21.15.93:0/3619297551 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4031990 con 0x7f31000cd6d0 2023-11-04T01:38:35.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f30ff7fe640 1 -- 172.21.15.93:0/3619297551 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4031d20 con 0x7f31000cd6d0 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 -- 172.21.15.93:0/3619297551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 msgr2=0x7f3100161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 --2- 172.21.15.93:0/3619297551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100161420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30f40097a0 tx=0x7f30f402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 -- 172.21.15.93:0/3619297551 shutdown_connections 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 --2- 172.21.15.93:0/3619297551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100161420 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 -- 172.21.15.93:0/3619297551 >> 172.21.15.93:0/3619297551 conn(0x7f31000cf880 msgr2=0x7f31000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 -- 172.21.15.93:0/3619297551 shutdown_connections 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.530+0000 7f3107083640 1 -- 172.21.15.93:0/3619297551 wait complete. 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.531+0000 7f3107083640 1 Processor -- start 2023-11-04T01:38:35.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.531+0000 7f3107083640 1 -- start start 2023-11-04T01:38:35.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31000b4880 0x7f3100150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 0x7f31000b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015ef10 con 0x7f31000cd6d0 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015fd70 con 0x7f31000b4880 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3107083640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310015f160 con 0x7f3100153e60 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f30fffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f30fffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43110/0 (socket says 172.21.15.93:43110) 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f30fffff640 1 -- 172.21.15.93:0/239853913 learned_addr learned my addr 172.21.15.93:0/239853913 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3104e1f640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31000b4880 0x7f3100150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f3105620640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 0x7f31000b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f30fffff640 1 -- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 msgr2=0x7f31000b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.532+0000 7f30fffff640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 0x7f31000b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fffff640 1 -- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31000b4880 msgr2=0x7f3100150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fffff640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31000b4880 0x7f3100150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fffff640 1 -- 172.21.15.93:0/239853913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009400 con 0x7f31000cd6d0 2023-11-04T01:38:35.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f3105620640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 0x7f31000b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fffff640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098c0 tx=0x7f30f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f403ba70 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f403bbf0 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310015f440 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40453f0 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.533+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310015fa00 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.534+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310015fee0 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.534+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30f404e450 con 0x7f31000cd6d0 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.535+0000 7f30fd7fa640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 0x7f30ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.535+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f30f40abb10 con 0x7f31000cd6d0 2023-11-04T01:38:35.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.535+0000 7f3104e1f640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 0x7f30ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.535+0000 7f3104e1f640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 0x7f30ec06d360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f310015bdb0 tx=0x7f30f0009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.539+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30f4076a70 con 0x7f31000cd6d0 2023-11-04T01:38:35.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.703+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3100156060 con 0x7f31000cd6d0 2023-11-04T01:38:35.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.703+0000 7f30fd7fa640 1 -- 172.21.15.93:0/239853913 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30f4035020 con 0x7f31000cd6d0 2023-11-04T01:38:35.705 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:35.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 msgr2=0x7f30ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 0x7f30ec06d360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f310015bdb0 tx=0x7f30f0009060 comp rx=0 tx=0).stop 2023-11-04T01:38:35.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 msgr2=0x7f3100154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098c0 tx=0x7f30f40046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 shutdown_connections 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f30ec06aea0 0x7f30ec06d360 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3100153e60 0x7f31000b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31000cd6d0 0x7f3100154570 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 --2- 172.21.15.93:0/239853913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31000b4880 0x7f3100150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 >> 172.21.15.93:0/239853913 conn(0x7f31000cf880 msgr2=0x7f31000b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 shutdown_connections 2023-11-04T01:38:35.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.705+0000 7f3107083640 1 -- 172.21.15.93:0/239853913 wait complete. 2023-11-04T01:38:35.717 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 Processor -- start 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 -- start start 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fad6c153e60 0x7fad6c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 0x7fad6c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0cde60 con 0x7fad6c0cd6d0 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c160f90 con 0x7fad6c153e60 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad71524640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0b5200 con 0x7fad6c0b4880 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad6affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fad6c153e60 0x7fad6c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.819+0000 7fad627fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fad6c0cd6d0 0x7fad6c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48602/0 (socket says 172.21.15.93:48602) 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad627fc640 1 -- 172.21.15.93:0/1682138436 learned_addr learned my addr 172.21.15.93:0/1682138436 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6affd640 1 -- 172.21.15.93:0/1682138436 >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 msgr2=0x7fad6c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6b7fe640 1 --2- 172.21.15.93:0/1682138436 >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 0x7fad6c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6affd640 1 --2- 172.21.15.93:0/1682138436 >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 0x7fad6c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6affd640 1 -- 172.21.15.93:0/1682138436 >> v1:172.21.15.93:6789/0 conn(0x7fad6c0cd6d0 legacy=0x7fad6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6a7fc640 1 -- 172.21.15.93:0/1682138436 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458034747 0 0) 0x7fad6c0cde60 con 0x7fad6c0cd6d0 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6affd640 1 -- 172.21.15.93:0/1682138436 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c15e400 con 0x7fad6c153e60 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.820+0000 7fad6b7fe640 1 --2- 172.21.15.93:0/1682138436 >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 0x7fad6c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad6affd640 1 --2- 172.21.15.93:0/1682138436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c15dec0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0b8f40 tx=0x7fad5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f09eee44e1ebf83 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad6a7fc640 1 -- 172.21.15.93:0/1682138436 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c031830 con 0x7fad6c153e60 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad6a7fc640 1 -- 172.21.15.93:0/1682138436 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c031990 con 0x7fad6c153e60 2023-11-04T01:38:35.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad6a7fc640 1 -- 172.21.15.93:0/1682138436 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c031d20 con 0x7fad6c153e60 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 -- 172.21.15.93:0/1682138436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 msgr2=0x7fad6c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 --2- 172.21.15.93:0/1682138436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c15dec0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0b8f40 tx=0x7fad5c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 -- 172.21.15.93:0/1682138436 shutdown_connections 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 --2- 172.21.15.93:0/1682138436 >> v2:172.21.15.125:3300/0 conn(0x7fad6c0b4880 0x7fad6c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 --2- 172.21.15.93:0/1682138436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c15dec0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 -- 172.21.15.93:0/1682138436 >> 172.21.15.93:0/1682138436 conn(0x7fad6c0cf880 msgr2=0x7fad6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 -- 172.21.15.93:0/1682138436 shutdown_connections 2023-11-04T01:38:35.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.821+0000 7fad71524640 1 -- 172.21.15.93:0/1682138436 wait complete. 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.822+0000 7fad71524640 1 Processor -- start 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 -- start start 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6c0b4880 0x7fad6c1f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 0x7fad6c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c154240 con 0x7fad6c153e60 2023-11-04T01:38:35.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c154ae0 con 0x7fad6c0b4880 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad71524640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0cbb80 con 0x7fad6c0cd6d0 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad6b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad6b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43130/0 (socket says 172.21.15.93:43130) 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.823+0000 7fad6b7fe640 1 -- 172.21.15.93:0/3004799148 learned_addr learned my addr 172.21.15.93:0/3004799148 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6affd640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6c0b4880 0x7fad6c1f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad627fc640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 0x7fad6c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 -- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 msgr2=0x7fad6c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 0x7fad6c0cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 -- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6c0b4880 msgr2=0x7fad6c1f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6c0b4880 0x7fad6c1f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 -- 172.21.15.93:0/3004799148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009400 con 0x7fad6c153e60 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad627fc640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 0x7fad6c0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:35.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad6b7fe640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fad6400cf20 tx=0x7fad6400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400d840 con 0x7fad6c153e60 2023-11-04T01:38:35.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6400d9a0 con 0x7fad6c153e60 2023-11-04T01:38:35.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c157100 con 0x7fad6c153e60 2023-11-04T01:38:35.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400dd50 con 0x7fad6c153e60 2023-11-04T01:38:35.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.824+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c154770 con 0x7fad6c153e60 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.825+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c074290 con 0x7fad6c153e60 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.825+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad6401e3b0 con 0x7fad6c153e60 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.826+0000 7fad63fff640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 0x7fad4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.826+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fad6408a350 con 0x7fad6c153e60 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.826+0000 7fad6affd640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 0x7fad4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.826+0000 7fad6affd640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 0x7fad4c06d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad5c036000 tx=0x7fad5c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.830+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad64055190 con 0x7fad6c153e60 2023-11-04T01:38:35.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.994+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fad6c154c20 con 0x7fad6c153e60 2023-11-04T01:38:35.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.994+0000 7fad63fff640 1 -- 172.21.15.93:0/3004799148 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad640587b0 con 0x7fad6c153e60 2023-11-04T01:38:35.996 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:35.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 msgr2=0x7fad4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 0x7fad4c06d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad5c036000 tx=0x7fad5c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 msgr2=0x7fad6c1f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fad6400cf20 tx=0x7fad6400a7d0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 shutdown_connections 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4c06ae70 0x7fad4c06d330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c153e60 0x7fad6c1f52c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6c0cd6d0 0x7fad6c0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 --2- 172.21.15.93:0/3004799148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6c0b4880 0x7fad6c1f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 >> 172.21.15.93:0/3004799148 conn(0x7fad6c0cf880 msgr2=0x7fad6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 shutdown_connections 2023-11-04T01:38:35.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:35.996+0000 7fad71524640 1 -- 172.21.15.93:0/3004799148 wait complete. 2023-11-04T01:38:36.008 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.108+0000 7f52fd100640 1 Processor -- start 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.108+0000 7f52fd100640 1 -- start start 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52fd100640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52f8153850 0x7f52f815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52fd100640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52f80c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52fd100640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80c3860 con 0x7f52f80cc520 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52fd100640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f80c9250 con 0x7f52f8153850 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52fd100640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8153c30 con 0x7f52f80cc9d0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52f659c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f52f80cc520 0x7f52f8070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48608/0 (socket says 172.21.15.93:48608) 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.109+0000 7f52f659c640 1 -- 172.21.15.93:0/885452495 learned_addr learned my addr 172.21.15.93:0/885452495 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275551987 0 0) 0x7f52f80c3860 con 0x7f52f80cc520 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f6d9d640 1 --2- 172.21.15.93:0/885452495 >> v2:172.21.15.125:3300/0 conn(0x7f52f8153850 0x7f52f815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e0003520 con 0x7f52f80cc520 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52f80c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49490455 0 0) 0x7f52e0003520 con 0x7f52f80cc520 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 msgr2=0x7f52f80c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52f80c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 >> v2:172.21.15.125:3300/0 conn(0x7f52f8153850 msgr2=0x7f52f815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 --2- 172.21.15.93:0/885452495 >> v2:172.21.15.125:3300/0 conn(0x7f52f8153850 0x7f52f815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f815a700 con 0x7f52f80cc520 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f52ec0019f0 con 0x7f52f80cc520 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 >> v1:172.21.15.93:6789/0 conn(0x7f52f80cc520 legacy=0x7f52f8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e0003970 0x7f52e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80c9250 con 0x7f52e0004d00 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8153c30 con 0x7f52e0003970 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e000ca90 con 0x7f52f80cc9d0 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f659c640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f6d9d640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e0003970 0x7f52e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 -- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 msgr2=0x7f52e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80cc9d0 0x7f52e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 -- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e0003970 msgr2=0x7f52e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52e0003970 0x7f52e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.110+0000 7f52f759e640 1 -- 172.21.15.93:0/885452495 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0003520 con 0x7f52e0004d00 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.111+0000 7f52f759e640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52e0005180 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009a90 tx=0x7f52e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1652c372cdf0b0cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.111+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e802c680 con 0x7f52e0004d00 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.111+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e802c7e0 con 0x7f52e0004d00 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.111+0000 7f52f5d9b640 1 -- 172.21.15.93:0/885452495 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e802cb90 con 0x7f52e0004d00 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 -- 172.21.15.93:0/885452495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 msgr2=0x7f52e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 --2- 172.21.15.93:0/885452495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52e0005180 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009a90 tx=0x7f52e00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52f759e640 1 -- 172.21.15.93:0/885452495 reap_dead start 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 -- 172.21.15.93:0/885452495 shutdown_connections 2023-11-04T01:38:36.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 -- 172.21.15.93:0/885452495 >> 172.21.15.93:0/885452495 conn(0x7f52f80ce950 msgr2=0x7f52f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 -- 172.21.15.93:0/885452495 shutdown_connections 2023-11-04T01:38:36.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.112+0000 7f52fd100640 1 -- 172.21.15.93:0/885452495 wait complete. 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.113+0000 7f52fd100640 1 Processor -- start 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.113+0000 7f52fd100640 1 -- start start 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80b3a80 0x7f52f81f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80ccdb0 0x7f52f80cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80cd780 con 0x7f52e0004d00 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8158a10 con 0x7f52f80b3a80 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52fd100640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8150320 con 0x7f52f80ccdb0 2023-11-04T01:38:36.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43152/0 (socket says 172.21.15.93:43152) 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 -- 172.21.15.93:0/1492261689 learned_addr learned my addr 172.21.15.93:0/1492261689 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 -- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80ccdb0 msgr2=0x7f52f80cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80ccdb0 0x7f52f80cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 -- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80b3a80 msgr2=0x7f52f81f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80b3a80 0x7f52f81f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 -- 172.21.15.93:0/1492261689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f81f2a60 con 0x7f52e0004d00 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.114+0000 7f52f6d9d640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f52f0011960 tx=0x7f52f0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.115+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0009590 con 0x7f52e0004d00 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.115+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f000fa10 con 0x7f52e0004d00 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.115+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8158c60 con 0x7f52e0004d00 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.115+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000fdc0 con 0x7f52e0004d00 2023-11-04T01:38:36.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.115+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f814ffb0 con 0x7f52e0004d00 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.116+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8074290 con 0x7f52e0004d00 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.116+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52f0014440 con 0x7f52e0004d00 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.116+0000 7f52df7fe640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 0x7f52e406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.116+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f52f008a110 con 0x7f52e0004d00 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.116+0000 7f52f659c640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 0x7f52e406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.117+0000 7f52f659c640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 0x7f52e406d2c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b3e60 tx=0x7f52ec000f40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.122+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52f0054ec0 con 0x7f52e0004d00 2023-11-04T01:38:36.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.286+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f52f80b3e90 con 0x7f52e0004d00 2023-11-04T01:38:36.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.287+0000 7f52df7fe640 1 -- 172.21.15.93:0/1492261689 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52f00584e0 con 0x7f52e0004d00 2023-11-04T01:38:36.288 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:36.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 msgr2=0x7f52e406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 0x7f52e406d2c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b3e60 tx=0x7f52ec000f40 comp rx=0 tx=0).stop 2023-11-04T01:38:36.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 msgr2=0x7f52f814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f52f0011960 tx=0x7f52f0011e20 comp rx=0 tx=0).stop 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 shutdown_connections 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f52e406ae00 0x7f52e406d2c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f52f80ccdb0 0x7f52f80cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52f80b3a80 0x7f52f81f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 --2- 172.21.15.93:0/1492261689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f52e0004d00 0x7f52f814e570 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 >> 172.21.15.93:0/1492261689 conn(0x7f52f80ce950 msgr2=0x7f52f814f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 shutdown_connections 2023-11-04T01:38:36.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.289+0000 7f52fd100640 1 -- 172.21.15.93:0/1492261689 wait complete. 2023-11-04T01:38:36.301 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.402+0000 7fed7ca4f640 1 Processor -- start 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.402+0000 7fed7ca4f640 1 -- start start 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7ca4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed7815e430 0x7fed780cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7ca4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed780cf160 0x7fed780cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7ca4f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed780d0280 con 0x7fed780d0710 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7ca4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed780cf670 con 0x7fed780cf160 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7ca4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed780cf950 con 0x7fed7815e430 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed75d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fed780cf160 0x7fed780cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed76d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fed780d0710 0x7fed780b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48610/0 (socket says 172.21.15.93:48610) 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed76d9d640 1 -- 172.21.15.93:0/2044695022 learned_addr learned my addr 172.21.15.93:0/2044695022 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.403+0000 7fed7659c640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed7815e430 0x7fed780cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed75d9b640 1 -- 172.21.15.93:0/2044695022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed7815e430 msgr2=0x7fed780cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed75d9b640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed7815e430 0x7fed780cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed75d9b640 1 -- 172.21.15.93:0/2044695022 >> v1:172.21.15.93:6789/0 conn(0x7fed780d0710 legacy=0x7fed780b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed75d9b640 1 -- 172.21.15.93:0/2044695022 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed780cfc30 con 0x7fed780cf160 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed7559a640 1 -- 172.21.15.93:0/2044695022 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996263409 0 0) 0x7fed780d0280 con 0x7fed780d0710 2023-11-04T01:38:36.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.404+0000 7fed75d9b640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed780cf160 0x7fed780cd510 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0097a0 tx=0x7fed6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeec7e901535bea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7559a640 1 -- 172.21.15.93:0/2044695022 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c031830 con 0x7fed780cf160 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7559a640 1 -- 172.21.15.93:0/2044695022 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c031990 con 0x7fed780cf160 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7559a640 1 -- 172.21.15.93:0/2044695022 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c031d20 con 0x7fed780cf160 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 -- 172.21.15.93:0/2044695022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed780cf160 msgr2=0x7fed780cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed780cf160 0x7fed780cd510 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0097a0 tx=0x7fed6c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 -- 172.21.15.93:0/2044695022 shutdown_connections 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed780cf160 0x7fed780cd510 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/2044695022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed7815e430 0x7fed780cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 -- 172.21.15.93:0/2044695022 >> 172.21.15.93:0/2044695022 conn(0x7fed7806ea20 msgr2=0x7fed7806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 -- 172.21.15.93:0/2044695022 shutdown_connections 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.405+0000 7fed7ca4f640 1 -- 172.21.15.93:0/2044695022 wait complete. 2023-11-04T01:38:36.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.406+0000 7fed7ca4f640 1 Processor -- start 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 -- start start 2023-11-04T01:38:36.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed780cf160 0x7fed780c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 0x7fed780af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.413 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed780c81c0 con 0x7fed7815e430 2023-11-04T01:38:36.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed780c84a0 con 0x7fed780d0710 2023-11-04T01:38:36.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed7ca4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed780c8780 con 0x7fed780cf160 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed76d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed76d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43168/0 (socket says 172.21.15.93:43168) 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.407+0000 7fed76d9d640 1 -- 172.21.15.93:0/714762735 learned_addr learned my addr 172.21.15.93:0/714762735 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed7659c640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed780cf160 0x7fed780c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed75d9b640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 0x7fed780af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 -- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed780cf160 msgr2=0x7fed780c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed780cf160 0x7fed780c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 -- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 msgr2=0x7fed780af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 0x7fed780af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 -- 172.21.15.93:0/714762735 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009400 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed75d9b640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 0x7fed780af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed76d9d640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c450 tx=0x7fed7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700074e0 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70007660 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70004a20 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed780c8a60 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.408+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7806d150 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.409+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed780ce730 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.409+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed70004b80 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.410+0000 7fed66ffd640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 0x7fed5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.410+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fed70088940 con 0x7fed7815e430 2023-11-04T01:38:36.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.410+0000 7fed7659c640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 0x7fed5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.410+0000 7fed7659c640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 0x7fed5806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed680074a0 tx=0x7fed6800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.414+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed700538d0 con 0x7fed7815e430 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.578+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fed780c8f80 con 0x7fed7815e430 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.578+0000 7fed66ffd640 1 -- 172.21.15.93:0/714762735 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v74) v1 ==== 107+0+11 (secure 0 0 0) 0x7fed70018020 con 0x7fed7815e430 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:36.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 msgr2=0x7fed5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 0x7fed5806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed680074a0 tx=0x7fed6800b040 comp rx=0 tx=0).stop 2023-11-04T01:38:36.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 msgr2=0x7fed78154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c450 tx=0x7fed7000c910 comp rx=0 tx=0).stop 2023-11-04T01:38:36.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 shutdown_connections 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fed5806ae70 0x7fed5806d330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7815e430 0x7fed78154170 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed780d0710 0x7fed780af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 --2- 172.21.15.93:0/714762735 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fed780cf160 0x7fed780c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 >> 172.21.15.93:0/714762735 conn(0x7fed7806ea20 msgr2=0x7fed7815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 shutdown_connections 2023-11-04T01:38:36.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.580+0000 7fed7ca4f640 1 -- 172.21.15.93:0/714762735 wait complete. 2023-11-04T01:38:36.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:38:36.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.689+0000 7f9fa39d0640 1 Processor -- start 2023-11-04T01:38:36.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.689+0000 7f9fa39d0640 1 -- start start 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa39d0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9f9c15cf40 0x7f9f9c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa39d0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f9c161510 0x7f9f9c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa39d0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c06f2a0 con 0x7f9f9c06a660 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa39d0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c06aaf0 con 0x7f9f9c15cf40 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa39d0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0ccbd0 con 0x7f9f9c161510 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa176c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9f9c15cf40 0x7f9f9c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa1f6d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9f9c06a660 0x7f9f9c06d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48612/0 (socket says 172.21.15.93:48612) 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.690+0000 7f9fa1f6d640 1 -- 172.21.15.93:0/3143242253 learned_addr learned my addr 172.21.15.93:0/3143242253 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa0f6b640 1 --2- 172.21.15.93:0/3143242253 >> v2:172.21.15.125:3300/0 conn(0x7f9f9c161510 0x7f9f9c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa176c640 1 -- 172.21.15.93:0/3143242253 >> v2:172.21.15.125:3300/0 conn(0x7f9f9c161510 msgr2=0x7f9f9c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa176c640 1 --2- 172.21.15.93:0/3143242253 >> v2:172.21.15.125:3300/0 conn(0x7f9f9c161510 0x7f9f9c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa176c640 1 -- 172.21.15.93:0/3143242253 >> v1:172.21.15.93:6789/0 conn(0x7f9f9c06a660 legacy=0x7f9f9c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa176c640 1 -- 172.21.15.93:0/3143242253 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0cceb0 con 0x7f9f9c15cf40 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9f9bfff640 1 -- 172.21.15.93:0/3143242253 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818706223 0 0) 0x7f9f9c06f2a0 con 0x7f9f9c06a660 2023-11-04T01:38:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.691+0000 7f9fa176c640 1 --2- 172.21.15.93:0/3143242253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c15cf40 0x7f9f9c06ecc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c160a60 tx=0x7f9f8c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c289f8e7d643c174 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9f9bfff640 1 -- 172.21.15.93:0/3143242253 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c02ccb0 con 0x7f9f9c15cf40 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9f9bfff640 1 -- 172.21.15.93:0/3143242253 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c02ce10 con 0x7f9f9c15cf40 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9f9bfff640 1 -- 172.21.15.93:0/3143242253 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c034660 con 0x7f9f9c15cf40 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 -- 172.21.15.93:0/3143242253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c15cf40 msgr2=0x7f9f9c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/3143242253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c15cf40 0x7f9f9c06ecc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c160a60 tx=0x7f9f8c02bf00 comp rx=0 tx=0).stop 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 -- 172.21.15.93:0/3143242253 shutdown_connections 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/3143242253 >> v2:172.21.15.125:3300/0 conn(0x7f9f9c161510 0x7f9f9c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/3143242253 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c15cf40 0x7f9f9c06ecc0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 -- 172.21.15.93:0/3143242253 >> 172.21.15.93:0/3143242253 conn(0x7f9f9c098a60 msgr2=0x7f9f9c098e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 -- 172.21.15.93:0/3143242253 shutdown_connections 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.692+0000 7f9fa39d0640 1 -- 172.21.15.93:0/3143242253 wait complete. 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.693+0000 7f9fa39d0640 1 Processor -- start 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.693+0000 7f9fa39d0640 1 -- start start 2023-11-04T01:38:36.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 0x7f9f9c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f9c15cf40 0x7f9f9c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0b27e0 con 0x7f9f9c161510 2023-11-04T01:38:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0b2ac0 con 0x7f9f9c06a660 2023-11-04T01:38:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa39d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0b2da0 con 0x7f9f9c15cf40 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43178/0 (socket says 172.21.15.93:43178) 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 -- 172.21.15.93:0/55555173 learned_addr learned my addr 172.21.15.93:0/55555173 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 -- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f9c15cf40 msgr2=0x7f9f9c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa176c640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 0x7f9f9c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa0f6b640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f9c15cf40 0x7f9f9c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f9c15cf40 0x7f9f9c0c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 -- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 msgr2=0x7f9f9c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 0x7f9f9c159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa1f6d640 1 -- 172.21.15.93:0/55555173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c009a70 con 0x7f9f9c161510 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.694+0000 7f9fa176c640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 0x7f9f9c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9fa1f6d640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c450 tx=0x7f9f9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940074e0 con 0x7f9f9c161510 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94007660 con 0x7f9f9c161510 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94004a20 con 0x7f9f9c161510 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c0b3080 con 0x7f9f9c161510 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.695+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c159890 con 0x7f9f9c161510 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.696+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0b35a0 con 0x7f9f9c161510 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.696+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f94004b80 con 0x7f9f9c161510 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.697+0000 7f9f99ffb640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.697+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f9f940889d0 con 0x7f9f9c161510 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.697+0000 7f9fa176c640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.697+0000 7f9fa176c640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 0x7f9f8806d330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c036000 tx=0x7f9f8c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.701+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f9c0b35a0 con 0x7f9f9c161510 2023-11-04T01:38:36.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:36.931+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f9f9c0b35a0 con 0x7f9f9c161510 2023-11-04T01:38:37.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.124+0000 7f9f99ffb640 1 -- 172.21.15.93:0/55555173 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v180) v1 ==== 151+0+0 (secure 0 0 0) 0x7f9f9c0b35a0 con 0x7f9f9c161510 2023-11-04T01:38:37.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 msgr2=0x7f9f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 0x7f9f8806d330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c036000 tx=0x7f9f8c030000 comp rx=0 tx=0).stop 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 msgr2=0x7f9f9c0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c450 tx=0x7f9f9400c910 comp rx=0 tx=0).stop 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 shutdown_connections 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f8806ae70 0x7f9f8806d330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f9c161510 0x7f9f9c0c8fd0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f9c15cf40 0x7f9f9c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 --2- 172.21.15.93:0/55555173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f9c06a660 0x7f9f9c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 >> 172.21.15.93:0/55555173 conn(0x7f9f9c098a60 msgr2=0x7f9f9c06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.126+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 shutdown_connections 2023-11-04T01:38:37.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.127+0000 7f9fa39d0640 1 -- 172.21.15.93:0/55555173 wait complete. 2023-11-04T01:38:37.139 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:37.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.241+0000 7f0c59f3c640 1 Processor -- start 2023-11-04T01:38:37.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.241+0000 7f0c59f3c640 1 -- start start 2023-11-04T01:38:37.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c59f3c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c54159c00 0x7f0c540cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c59f3c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540c48e0 0x7f0c540c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c59f3c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5415aff0 con 0x7f0c540adac0 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c59f3c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540c52d0 con 0x7f0c54159c00 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c59f3c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415a3e0 con 0x7f0c540c48e0 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c54159c00 0x7f0c540cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0c54159c00 0x7f0c540cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43188/0 (socket says 172.21.15.93:43188) 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 -- 172.21.15.93:0/1480641970 learned_addr learned my addr 172.21.15.93:0/1480641970 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c52ffd640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540c48e0 0x7f0c540c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 -- 172.21.15.93:0/1480641970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540c48e0 msgr2=0x7f0c540c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540c48e0 0x7f0c540c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 -- 172.21.15.93:0/1480641970 >> v1:172.21.15.125:6789/0 conn(0x7f0c540adac0 legacy=0x7f0c540adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.242+0000 7f0c537fe640 1 -- 172.21.15.93:0/1480641970 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5415a6c0 con 0x7f0c54159c00 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c537fe640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c54159c00 0x7f0c540cc890 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009870 tx=0x7f0c4402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9763ad11c60d9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c527fc640 1 -- 172.21.15.93:0/1480641970 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44030840 con 0x7f0c54159c00 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c527fc640 1 -- 172.21.15.93:0/1480641970 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440309a0 con 0x7f0c54159c00 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c527fc640 1 -- 172.21.15.93:0/1480641970 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44030d30 con 0x7f0c54159c00 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1480641970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c54159c00 msgr2=0x7f0c540cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c54159c00 0x7f0c540cc890 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009870 tx=0x7f0c4402b980 comp rx=0 tx=0).stop 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1480641970 shutdown_connections 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c540c48e0 0x7f0c540c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.243+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1480641970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c54159c00 0x7f0c540cc890 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.244+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1480641970 >> 172.21.15.93:0/1480641970 conn(0x7f0c540ce950 msgr2=0x7f0c540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.244+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1480641970 shutdown_connections 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.244+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1480641970 wait complete. 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.245+0000 7f0c59f3c640 1 Processor -- start 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.245+0000 7f0c59f3c640 1 -- start start 2023-11-04T01:38:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540adac0 0x7f0c54148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54159c00 0x7f0c541f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54151d50 con 0x7f0c540c48e0 2023-11-04T01:38:37.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5414e420 con 0x7f0c540adac0 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54151f80 con 0x7f0c54159c00 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43202/0 (socket says 172.21.15.93:43202) 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 -- 172.21.15.93:0/1125370426 learned_addr learned my addr 172.21.15.93:0/1125370426 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 -- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54159c00 msgr2=0x7f0c541f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54159c00 0x7f0c541f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 -- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540adac0 msgr2=0x7f0c54148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540adac0 0x7f0c54148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 -- 172.21.15.93:0/1125370426 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440094d0 con 0x7f0c540c48e0 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c52ffd640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e9b0 tx=0x7f0c4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009670 con 0x7f0c540c48e0 2023-11-04T01:38:37.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800c9a0 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c54152260 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800cd50 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.246+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5414b810 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.247+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5414ba90 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.248+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c48013470 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.248+0000 7f0c3bfff640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 0x7f0c4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.248+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0c48089a00 con 0x7f0c540c48e0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.248+0000 7f0c537fe640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 0x7f0c4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.249+0000 7f0c537fe640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 0x7f0c4006d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0c44036000 tx=0x7f0c4403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.252+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c480548d0 con 0x7f0c540c48e0 2023-11-04T01:38:37.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.418+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0c54074290 con 0x7f0c540c48e0 2023-11-04T01:38:37.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.421+0000 7f0c3bfff640 1 -- 172.21.15.93:0/1125370426 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c480170c0 con 0x7f0c540c48e0 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 msgr2=0x7f0c4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 0x7f0c4006d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0c44036000 tx=0x7f0c4403b040 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 msgr2=0x7f0c5414d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e9b0 tx=0x7f0c4800ee70 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 shutdown_connections 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0c4006ae70 0x7f0c4006d330 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0c54159c00 0x7f0c541f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0c540c48e0 0x7f0c5414d9d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 --2- 172.21.15.93:0/1125370426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c540adac0 0x7f0c54148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 >> 172.21.15.93:0/1125370426 conn(0x7f0c540ce950 msgr2=0x7f0c540cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 shutdown_connections 2023-11-04T01:38:37.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.423+0000 7f0c59f3c640 1 -- 172.21.15.93:0/1125370426 wait complete. 2023-11-04T01:38:37.435 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:37.436 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:37.490 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:37.545 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:37.545 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:37.546 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:37.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:37.561 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:37.561 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:37.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:37.577 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:37.577 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:37.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:37.616 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:37.616 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:37.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:37.636 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:37.636 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.755+0000 7f849f84b640 1 Processor -- start 2023-11-04T01:38:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 -- start start 2023-11-04T01:38:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f84980cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980cc450 con 0x7f84980cd860 2023-11-04T01:38:37.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849815f400 con 0x7f849815ae40 2023-11-04T01:38:37.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.756+0000 7f849f84b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849815b220 con 0x7f84980cbc00 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849d5e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849cde6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f84980cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849d5e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:39480/0 (socket says 172.21.15.93:39480) 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849d5e7640 1 -- 172.21.15.93:0/2914881445 learned_addr learned my addr 172.21.15.93:0/2914881445 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849cde6640 1 -- 172.21.15.93:0/2914881445 >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 msgr2=0x7f849815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849cde6640 1 --2- 172.21.15.93:0/2914881445 >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849cde6640 1 -- 172.21.15.93:0/2914881445 >> v1:172.21.15.125:6789/0 conn(0x7f84980cd860 legacy=0x7f84980b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849cde6640 1 -- 172.21.15.93:0/2914881445 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849815f890 con 0x7f84980cbc00 2023-11-04T01:38:37.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.757+0000 7f849d5e7640 1 --2- 172.21.15.93:0/2914881445 >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:37.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.758+0000 7f849cde6640 1 --2- 172.21.15.93:0/2914881445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f84980cd320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84880097a0 tx=0x7f848802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c98cf85b6a181 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.758+0000 7f848ffff640 1 -- 172.21.15.93:0/2914881445 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488031830 con 0x7f84980cbc00 2023-11-04T01:38:37.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.758+0000 7f848ffff640 1 -- 172.21.15.93:0/2914881445 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488031990 con 0x7f84980cbc00 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.758+0000 7f848ffff640 1 -- 172.21.15.93:0/2914881445 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488031d20 con 0x7f84980cbc00 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 -- 172.21.15.93:0/2914881445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 msgr2=0x7f84980cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 --2- 172.21.15.93:0/2914881445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f84980cd320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84880097a0 tx=0x7f848802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 -- 172.21.15.93:0/2914881445 shutdown_connections 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 --2- 172.21.15.93:0/2914881445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f84980cd320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 --2- 172.21.15.93:0/2914881445 >> v2:172.21.15.125:3300/0 conn(0x7f849815ae40 0x7f849815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 -- 172.21.15.93:0/2914881445 >> 172.21.15.93:0/2914881445 conn(0x7f849806ea90 msgr2=0x7f849806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 -- 172.21.15.93:0/2914881445 shutdown_connections 2023-11-04T01:38:37.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.759+0000 7f849f84b640 1 -- 172.21.15.93:0/2914881445 wait complete. 2023-11-04T01:38:37.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.760+0000 7f849f84b640 1 Processor -- start 2023-11-04T01:38:37.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.760+0000 7f849f84b640 1 -- start start 2023-11-04T01:38:37.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f8498150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 0x7f84980c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498150bc0 con 0x7f849815ae40 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980c3d10 con 0x7f84980cd860 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849f84b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84980c8d60 con 0x7f84980cbc00 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43212/0 (socket says 172.21.15.93:43212) 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 -- 172.21.15.93:0/2930684791 learned_addr learned my addr 172.21.15.93:0/2930684791 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849d5e7640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f8498150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849cde6640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 0x7f84980c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 -- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 msgr2=0x7f8498150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f8498150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 -- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 msgr2=0x7f84980c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 0x7f84980c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849dde8640 1 -- 172.21.15.93:0/2930684791 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009b30 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849d5e7640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f8498150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.761+0000 7f849cde6640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 0x7f84980c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f849dde8640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f849000c400 tx=0x7f849000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900052d0 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490005430 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488009400 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490003810 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.762+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84980c4e30 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.763+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84980ce2d0 con 0x7f849815ae40 2023-11-04T01:38:37.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.763+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8490003970 con 0x7f849815ae40 2023-11-04T01:38:37.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.764+0000 7f848dffb640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.764+0000 7f849d5e7640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.764+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f8490088bc0 con 0x7f849815ae40 2023-11-04T01:38:37.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.764+0000 7f849d5e7640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 0x7f847c06d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8494009fd0 tx=0x7f849400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.768+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8490053a90 con 0x7f849815ae40 2023-11-04T01:38:37.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.966+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84980cc450 con 0x7f849815ae40 2023-11-04T01:38:37.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.967+0000 7f848dffb640 1 -- 172.21.15.93:0/2930684791 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f84980cc450 con 0x7f849815ae40 2023-11-04T01:38:37.969 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:37.969 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3149566378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3149566378},{"type":"v1","addr":"172.21.15.93:6837","nonce":3149566378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/615169164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":615169164},{"type":"v1","addr":"172.21.15.125:6834","nonce":615169164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2972010567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2972010567},{"type":"v1","addr":"172.21.15.125:6835","nonce":2972010567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6807,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2026851196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2026851196},{"type":"v1","addr":"172.21.15.93:6835","nonce":2026851196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[]} 2023-11-04T01:38:37.969 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 31 2023-11-04T01:38:37.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 msgr2=0x7f847c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 0x7f847c06d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8494009fd0 tx=0x7f849400b040 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 msgr2=0x7f84980c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f849000c400 tx=0x7f849000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 shutdown_connections 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f849815ae40 0x7f84980c6ab0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84980cd860 0x7f84980c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 --2- 172.21.15.93:0/2930684791 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f84980cbc00 0x7f8498150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 >> 172.21.15.93:0/2930684791 conn(0x7f849806ea90 msgr2=0x7f849815dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 shutdown_connections 2023-11-04T01:38:37.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:37.969+0000 7f849f84b640 1 -- 172.21.15.93:0/2930684791 wait complete. 2023-11-04T01:38:37.981 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:37.981 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:37.982 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:37.982 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:37.982 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:37.982 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:37.982 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:37.982 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:37.983 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:37.983 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:37.983 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:37.983 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:37.983 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:37.984 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:37.984 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:37.984 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:37.994 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:37.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:37.995 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:37.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:37.996 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:37.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:37.997 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:37.997 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:38.037 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:38.038 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:38.039 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:38.039 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:38.040 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:38.041 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:38.041 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:38.041 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:38.042 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:38.113 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:38:38.114 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:38:38.131 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:38:38.132 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:38:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.150+0000 7f782f683640 1 Processor -- start 2023-11-04T01:38:38.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 -- start start 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78280cd6d0 0x7f7828161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78280b4880 0x7f78280b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78280cde60 con 0x7f7828153e60 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828160f90 con 0x7f78280b4880 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.151+0000 7f782f683640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828161960 con 0x7f78280cd6d0 2023-11-04T01:38:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78280b4880 0x7f78280b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78280b4880 0x7f78280b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43238/0 (socket says 172.21.15.93:43238) 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 -- 172.21.15.93:0/3742638854 learned_addr learned my addr 172.21.15.93:0/3742638854 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782cc1e640 1 --2- 172.21.15.93:0/3742638854 >> v2:172.21.15.125:3300/0 conn(0x7f78280cd6d0 0x7f7828161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 -- 172.21.15.93:0/3742638854 >> v2:172.21.15.125:3300/0 conn(0x7f78280cd6d0 msgr2=0x7f7828161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 --2- 172.21.15.93:0/3742638854 >> v2:172.21.15.125:3300/0 conn(0x7f78280cd6d0 0x7f7828161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 -- 172.21.15.93:0/3742638854 >> v1:172.21.15.125:6789/0 conn(0x7f7828153e60 legacy=0x7f782815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.152+0000 7f782dc20640 1 -- 172.21.15.93:0/3742638854 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280b5220 con 0x7f78280b4880 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782dc20640 1 --2- 172.21.15.93:0/3742638854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78280b4ce0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f78280c9e80 tx=0x7f782002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e588b633cec4c2f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f781ffff640 1 -- 172.21.15.93:0/3742638854 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782002cb20 con 0x7f78280b4880 2023-11-04T01:38:38.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f781ffff640 1 -- 172.21.15.93:0/3742638854 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782002cc80 con 0x7f78280b4880 2023-11-04T01:38:38.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f781ffff640 1 -- 172.21.15.93:0/3742638854 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78200343f0 con 0x7f78280b4880 2023-11-04T01:38:38.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 -- 172.21.15.93:0/3742638854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 msgr2=0x7f78280b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 --2- 172.21.15.93:0/3742638854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78280b4ce0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f78280c9e80 tx=0x7f782002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:38.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 -- 172.21.15.93:0/3742638854 shutdown_connections 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 --2- 172.21.15.93:0/3742638854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78280b4ce0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 --2- 172.21.15.93:0/3742638854 >> v2:172.21.15.125:3300/0 conn(0x7f78280cd6d0 0x7f7828161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 -- 172.21.15.93:0/3742638854 >> 172.21.15.93:0/3742638854 conn(0x7f78280cf880 msgr2=0x7f78280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.153+0000 7f782f683640 1 -- 172.21.15.93:0/3742638854 shutdown_connections 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.154+0000 7f782f683640 1 -- 172.21.15.93:0/3742638854 wait complete. 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 Processor -- start 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 -- start start 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78280cd6d0 0x7f78280c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7828153e60 0x7f78281f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78281f6f10 con 0x7f78280b4880 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78281f29a0 con 0x7f78280cd6d0 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782f683640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281f38f0 con 0x7f7828153e60 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782d41f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782d41f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43244/0 (socket says 172.21.15.93:43244) 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.155+0000 7f782d41f640 1 -- 172.21.15.93:0/100147408 learned_addr learned my addr 172.21.15.93:0/100147408 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782cc1e640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78280cd6d0 0x7f78280c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782dc20640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7828153e60 0x7f78281f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 -- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7828153e60 msgr2=0x7f78281f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7828153e60 0x7f78281f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 -- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78280cd6d0 msgr2=0x7f78280c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78280cd6d0 0x7f78280c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 -- 172.21.15.93:0/100147408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009b30 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782d41f640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f781800c400 tx=0x7f781800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180052d0 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818005430 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78281f6950 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818003830 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.156+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78281f2e90 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.157+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78281f6d40 con 0x7f78280b4880 2023-11-04T01:38:38.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.157+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7818003990 con 0x7f78280b4880 2023-11-04T01:38:38.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.158+0000 7f781dffb640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 0x7f780c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.158+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f7818088d60 con 0x7f78280b4880 2023-11-04T01:38:38.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.158+0000 7f782cc1e640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 0x7f780c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.158+0000 7f782cc1e640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 0x7f780c06d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78280b7b80 tx=0x7f7824009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.162+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7818053c40 con 0x7f78280b4880 2023-11-04T01:38:38.342 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:38.341+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7828074290 con 0x7f78280b4880 2023-11-04T01:38:39.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.137+0000 7f781dffb640 1 -- 172.21.15.93:0/100147408 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7818017080 con 0x7f78280b4880 2023-11-04T01:38:39.139 INFO:teuthology.orchestra.run.smithi093.stderr: removed all blocklist entries 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.140+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 msgr2=0x7f780c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.140+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 0x7f780c06d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78280b7b80 tx=0x7f7824009190 comp rx=0 tx=0).stop 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.140+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 msgr2=0x7f78281f33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.140+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f781800c400 tx=0x7f781800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 shutdown_connections 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f780c06ae70 0x7f780c06d330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7828153e60 0x7f78281f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78280cd6d0 0x7f78280c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 --2- 172.21.15.93:0/100147408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78280b4880 0x7f78281f33b0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 >> 172.21.15.93:0/100147408 conn(0x7f78280cf880 msgr2=0x7f78280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 shutdown_connections 2023-11-04T01:38:39.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.141+0000 7f782f683640 1 -- 172.21.15.93:0/100147408 wait complete. 2023-11-04T01:38:39.155 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:39.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 Processor -- start 2023-11-04T01:38:39.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 -- start start 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 0x7f0ce815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ce80ce240 0x7f0ce80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce815e000 con 0x7f0ce815daa0 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce815e5c0 con 0x7f0ce80ce240 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.261+0000 7f0ceeeb4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce815e2e0 con 0x7f0ce80cde60 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ce80ce240 0x7f0ce80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ce80ce240 0x7f0ce80d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43260/0 (socket says 172.21.15.93:43260) 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 -- 172.21.15.93:0/501832995 learned_addr learned my addr 172.21.15.93:0/501832995 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0cecc50640 1 --2- 172.21.15.93:0/501832995 >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 0x7f0ce815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 -- 172.21.15.93:0/501832995 >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 msgr2=0x7f0ce815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 --2- 172.21.15.93:0/501832995 >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 0x7f0ce815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 -- 172.21.15.93:0/501832995 >> v1:172.21.15.125:6789/0 conn(0x7f0ce815daa0 legacy=0x7f0ce8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0ced451640 1 -- 172.21.15.93:0/501832995 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80d1120 con 0x7f0ce80ce240 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.262+0000 7f0cecc50640 1 --2- 172.21.15.93:0/501832995 >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 0x7f0ce815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ced451640 1 --2- 172.21.15.93:0/501832995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80d1920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80b5550 tx=0x7f0cd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64167e04f0feab5b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ce77fe640 1 -- 172.21.15.93:0/501832995 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031870 con 0x7f0ce80ce240 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ce77fe640 1 -- 172.21.15.93:0/501832995 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80319d0 con 0x7f0ce80ce240 2023-11-04T01:38:39.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ce77fe640 1 -- 172.21.15.93:0/501832995 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031d60 con 0x7f0ce80ce240 2023-11-04T01:38:39.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/501832995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 msgr2=0x7f0ce80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/501832995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80d1920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80b5550 tx=0x7f0cd802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:39.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/501832995 shutdown_connections 2023-11-04T01:38:39.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/501832995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80d1920 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/501832995 >> v2:172.21.15.125:3300/0 conn(0x7f0ce80cde60 0x7f0ce815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/501832995 >> 172.21.15.93:0/501832995 conn(0x7f0ce8071f30 msgr2=0x7f0ce80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/501832995 shutdown_connections 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.263+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/501832995 wait complete. 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.264+0000 7f0ceeeb4640 1 Processor -- start 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.264+0000 7f0ceeeb4640 1 -- start start 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80cde60 0x7f0ce80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 0x7f0ce8152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81554b0 con 0x7f0ce80ce240 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8154b10 con 0x7f0ce80cde60 2023-11-04T01:38:39.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ceeeb4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8154df0 con 0x7f0ce815daa0 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ce7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.265+0000 7f0ce7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43262/0 (socket says 172.21.15.93:43262) 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 -- 172.21.15.93:0/3348897461 learned_addr learned my addr 172.21.15.93:0/3348897461 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0cecc50640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80cde60 0x7f0ce80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ced451640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 0x7f0ce8152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 -- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 msgr2=0x7f0ce8152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 0x7f0ce8152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 -- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80cde60 msgr2=0x7f0ce80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80cde60 0x7f0ce80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 -- 172.21.15.93:0/3348897461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094d0 con 0x7f0ce80ce240 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ced451640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 0x7f0ce8152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce7fff640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b3c0 tx=0x7f0cd000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011830 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011990 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce81550d0 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d80 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.266+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8154730 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.267+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce8074290 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.268+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cd001b460 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.268+0000 7f0ce57fa640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.268+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f0cd0089390 con 0x7f0ce80ce240 2023-11-04T01:38:39.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.268+0000 7f0cecc50640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.269+0000 7f0cecc50640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 0x7f0cc806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00075b0 tx=0x7f0ce0007540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.272+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cd00542c0 con 0x7f0ce80ce240 2023-11-04T01:38:39.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.501+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0ce8156740 con 0x7f0ce80ce240 2023-11-04T01:38:39.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.501+0000 7f0ce57fa640 1 -- 172.21.15.93:0/3348897461 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0cd00578e0 con 0x7f0ce80ce240 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "auth_dump": [ 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.a", 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA==", 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.b", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q==", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.504 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.c", 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA==", 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.505 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.d", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A==", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.0", 2023-11-04T01:38:39.506 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng==", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.1", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg==", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.507 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.2", 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ==", 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.508 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.3", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw==", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.4", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw==", 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.509 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.5", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig==", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.510 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.6", 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q==", 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.511 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.7", 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg==", 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.512 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.0", 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA==", 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow r", 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.513 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.1", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA==", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.2", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA==", 2023-11-04T01:38:39.514 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.3", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA==", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:38:39.515 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.admin", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC8n0VlXE3tMRAAENuvCH1TV9mwClMjb99rXg==", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:38:39.516 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.x", 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA==", 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:39.517 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.y", 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA==", 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-11-04T01:38:39.518 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:39.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 msgr2=0x7f0cc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 0x7f0cc806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00075b0 tx=0x7f0ce0007540 comp rx=0 tx=0).stop 2023-11-04T01:38:39.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 msgr2=0x7f0ce80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b3c0 tx=0x7f0cd000b880 comp rx=0 tx=0).stop 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 shutdown_connections 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0cc806ae70 0x7f0cc806d330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ce815daa0 0x7f0ce8152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce80ce240 0x7f0ce80cc600 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 --2- 172.21.15.93:0/3348897461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80cde60 0x7f0ce80cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 >> 172.21.15.93:0/3348897461 conn(0x7f0ce8071f30 msgr2=0x7f0ce80b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 shutdown_connections 2023-11-04T01:38:39.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.503+0000 7f0ceeeb4640 1 -- 172.21.15.93:0/3348897461 wait complete. 2023-11-04T01:38:39.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:39.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.622+0000 7fef25c9b640 1 Processor -- start 2023-11-04T01:38:39.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 -- start start 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fef200cde60 0x7fef2015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef200ce240 0x7fef200d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2015e000 con 0x7fef2015daa0 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2015e5c0 con 0x7fef200cde60 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef25c9b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2015e2e0 con 0x7fef200ce240 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef1f7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fef200cde60 0x7fef2015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef1effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fef2015daa0 0x7fef20157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48640/0 (socket says 172.21.15.93:48640) 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.623+0000 7fef1effd640 1 -- 172.21.15.93:0/1813149076 learned_addr learned my addr 172.21.15.93:0/1813149076 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1ffff640 1 --2- 172.21.15.93:0/1813149076 >> v2:172.21.15.125:3300/0 conn(0x7fef200ce240 0x7fef200d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1f7fe640 1 -- 172.21.15.93:0/1813149076 >> v2:172.21.15.125:3300/0 conn(0x7fef200ce240 msgr2=0x7fef200d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1f7fe640 1 --2- 172.21.15.93:0/1813149076 >> v2:172.21.15.125:3300/0 conn(0x7fef200ce240 0x7fef200d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1f7fe640 1 -- 172.21.15.93:0/1813149076 >> v1:172.21.15.93:6789/0 conn(0x7fef2015daa0 legacy=0x7fef20157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1f7fe640 1 -- 172.21.15.93:0/1813149076 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200d1120 con 0x7fef200cde60 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1e7fc640 1 -- 172.21.15.93:0/1813149076 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444094110 0 0) 0x7fef2015e000 con 0x7fef2015daa0 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.624+0000 7fef1f7fe640 1 --2- 172.21.15.93:0/1813149076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef200cde60 0x7fef2015d560 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fef200cf2e0 tx=0x7fef1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e2f1ec55688a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef1e7fc640 1 -- 172.21.15.93:0/1813149076 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10031830 con 0x7fef200cde60 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef1e7fc640 1 -- 172.21.15.93:0/1813149076 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10031990 con 0x7fef200cde60 2023-11-04T01:38:39.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef1e7fc640 1 -- 172.21.15.93:0/1813149076 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10031d20 con 0x7fef200cde60 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 -- 172.21.15.93:0/1813149076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef200cde60 msgr2=0x7fef2015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 --2- 172.21.15.93:0/1813149076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef200cde60 0x7fef2015d560 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fef200cf2e0 tx=0x7fef1002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 -- 172.21.15.93:0/1813149076 shutdown_connections 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 --2- 172.21.15.93:0/1813149076 >> v2:172.21.15.125:3300/0 conn(0x7fef200ce240 0x7fef200d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 --2- 172.21.15.93:0/1813149076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef200cde60 0x7fef2015d560 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 -- 172.21.15.93:0/1813149076 >> 172.21.15.93:0/1813149076 conn(0x7fef20071f30 msgr2=0x7fef200cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 -- 172.21.15.93:0/1813149076 shutdown_connections 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.625+0000 7fef25c9b640 1 -- 172.21.15.93:0/1813149076 wait complete. 2023-11-04T01:38:39.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.626+0000 7fef25c9b640 1 Processor -- start 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 -- start start 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef200cde60 0x7fef20156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 0x7fef2015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2015cbd0 con 0x7fef2015daa0 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef201f44d0 con 0x7fef200cde60 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef25c9b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef201f47b0 con 0x7fef200ce240 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43284/0 (socket says 172.21.15.93:43284) 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef1ffff640 1 -- 172.21.15.93:0/386831120 learned_addr learned my addr 172.21.15.93:0/386831120 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef1f7fe640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef200cde60 0x7fef20156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.627+0000 7fef1effd640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 0x7fef2015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 -- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 msgr2=0x7fef2015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 0x7fef2015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 -- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef200cde60 msgr2=0x7fef20156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef200cde60 0x7fef20156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 -- 172.21.15.93:0/386831120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009400 con 0x7fef2015daa0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1effd640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 0x7fef2015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef1ffff640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fef18007e30 tx=0x7fef1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18014620 con 0x7fef2015daa0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800ee90 con 0x7fef2015daa0 2023-11-04T01:38:39.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef201f4a90 con 0x7fef2015daa0 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180149c0 con 0x7fef2015daa0 2023-11-04T01:38:39.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.628+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef201f0200 con 0x7fef2015daa0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.629+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef201f4fb0 con 0x7fef2015daa0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.629+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef18014b20 con 0x7fef2015daa0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.630+0000 7fef07fff640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 0x7fef0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.630+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fef1808a180 con 0x7fef2015daa0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.630+0000 7fef1f7fe640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 0x7fef0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.630+0000 7fef1f7fe640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 0x7fef0c06d360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fef10036000 tx=0x7fef1003e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.634+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef201f4fb0 con 0x7fef2015daa0 2023-11-04T01:38:39.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.802+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef201f4fb0 con 0x7fef2015daa0 2023-11-04T01:38:39.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.803+0000 7fef07fff640 1 -- 172.21.15.93:0/386831120 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18315 (secure 0 0 0) 0x7fef201f4fb0 con 0x7fef2015daa0 2023-11-04T01:38:39.804 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:39.805 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":78,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:39.136016+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:39.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 msgr2=0x7fef0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 0x7fef0c06d360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fef10036000 tx=0x7fef1003e040 comp rx=0 tx=0).stop 2023-11-04T01:38:39.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 msgr2=0x7fef201f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fef18007e30 tx=0x7fef1800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 shutdown_connections 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fef0c06aea0 0x7fef0c06d360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef2015daa0 0x7fef201f04a0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fef200ce240 0x7fef2015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 --2- 172.21.15.93:0/386831120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef200cde60 0x7fef20156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 >> 172.21.15.93:0/386831120 conn(0x7fef20071f30 msgr2=0x7fef200d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 shutdown_connections 2023-11-04T01:38:39.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.805+0000 7fef25c9b640 1 -- 172.21.15.93:0/386831120 wait complete. 2023-11-04T01:38:39.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:39.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:39.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.919+0000 7f3330483640 1 Processor -- start 2023-11-04T01:38:39.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.919+0000 7f3330483640 1 -- start start 2023-11-04T01:38:39.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f3330483640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3328066000 0x7f33280cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f3330483640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280c9bf0 con 0x7f3328070ff0 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f3330483640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280cd890 con 0x7f332815d1b0 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f3330483640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280cdb30 con 0x7f3328066000 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332ea20640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3328066000 0x7f33280cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332e21f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3328070ff0 0x7f33280713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48656/0 (socket says 172.21.15.93:48656) 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332e21f640 1 -- 172.21.15.93:0/1877131203 learned_addr learned my addr 172.21.15.93:0/1877131203 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332ea20640 1 -- 172.21.15.93:0/1877131203 >> v1:172.21.15.125:6789/0 conn(0x7f332815d1b0 legacy=0x7f332806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332ea20640 1 -- 172.21.15.93:0/1877131203 >> v1:172.21.15.93:6789/0 conn(0x7f3328070ff0 legacy=0x7f33280713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.920+0000 7f332ea20640 1 -- 172.21.15.93:0/1877131203 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280cde10 con 0x7f3328066000 2023-11-04T01:38:39.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.921+0000 7f332ea20640 1 --2- 172.21.15.93:0/1877131203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3328066000 0x7f33280cb4e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3320009d90 tx=0x7f332002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b017a3017f41a4c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.921+0000 7f332d21d640 1 -- 172.21.15.93:0/1877131203 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332002cc60 con 0x7f3328066000 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.921+0000 7f332d21d640 1 -- 172.21.15.93:0/1877131203 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332002cdc0 con 0x7f3328066000 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.921+0000 7f332d21d640 1 -- 172.21.15.93:0/1877131203 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320034660 con 0x7f3328066000 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 -- 172.21.15.93:0/1877131203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3328066000 msgr2=0x7f33280cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 --2- 172.21.15.93:0/1877131203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3328066000 0x7f33280cb4e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3320009d90 tx=0x7f332002beb0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 -- 172.21.15.93:0/1877131203 shutdown_connections 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 --2- 172.21.15.93:0/1877131203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3328066000 0x7f33280cb4e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 -- 172.21.15.93:0/1877131203 >> 172.21.15.93:0/1877131203 conn(0x7f33280cbc90 msgr2=0x7f33280cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 -- 172.21.15.93:0/1877131203 shutdown_connections 2023-11-04T01:38:39.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.922+0000 7f3330483640 1 -- 172.21.15.93:0/1877131203 wait complete. 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.923+0000 7f3330483640 1 Processor -- start 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.923+0000 7f3330483640 1 -- start start 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 0x7f33281560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3328070ff0 0x7f3328157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33280b40f0 con 0x7f332815d1b0 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33280b43d0 con 0x7f3328066000 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33280b46b0 con 0x7f3328070ff0 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43296/0 (socket says 172.21.15.93:43296) 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 -- 172.21.15.93:0/1861204348 learned_addr learned my addr 172.21.15.93:0/1861204348 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332e21f640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 0x7f33281560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 -- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3328070ff0 msgr2=0x7f3328157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332da1e640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3328070ff0 0x7f3328157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3328070ff0 0x7f3328157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 -- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 msgr2=0x7f33281560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 0x7f33281560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 -- 172.21.15.93:0/1861204348 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320009a70 con 0x7f332815d1b0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332e21f640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 0x7f33281560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f332ea20640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3320009d90 tx=0x7f3320004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320040450 con 0x7f332815d1b0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33200405d0 con 0x7f332815d1b0 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33280b4990 con 0x7f332815d1b0 2023-11-04T01:38:39.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320040980 con 0x7f332815d1b0 2023-11-04T01:38:39.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.924+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33281565e0 con 0x7f332815d1b0 2023-11-04T01:38:39.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.925+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328074290 con 0x7f332815d1b0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.926+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3320040ae0 con 0x7f332815d1b0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.926+0000 7f331effd640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 0x7f330c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.926+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f33200ac380 con 0x7f332815d1b0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.926+0000 7f332e21f640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 0x7f330c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.927+0000 7f332e21f640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 0x7f330c06d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3324007fd0 tx=0x7f3324009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:39.930+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33200772e0 con 0x7f332815d1b0 2023-11-04T01:38:40.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.094+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33280b4230 con 0x7f332815d1b0 2023-11-04T01:38:40.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.094+0000 7f331effd640 1 -- 172.21.15.93:0/1861204348 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33280b4230 con 0x7f332815d1b0 2023-11-04T01:38:40.096 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 msgr2=0x7f330c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 0x7f330c06d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3324007fd0 tx=0x7f3324009040 comp rx=0 tx=0).stop 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 msgr2=0x7f3328157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3320009d90 tx=0x7f3320004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 shutdown_connections 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f330c06ae70 0x7f330c06d330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f332815d1b0 0x7f3328157760 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3328070ff0 0x7f3328157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 --2- 172.21.15.93:0/1861204348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3328066000 0x7f33281560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.096+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 >> 172.21.15.93:0/1861204348 conn(0x7f33280cbc90 msgr2=0x7f3328072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.097+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 shutdown_connections 2023-11-04T01:38:40.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.097+0000 7f3330483640 1 -- 172.21.15.93:0/1861204348 wait complete. 2023-11-04T01:38:40.109 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:40.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.211+0000 7fce79cc9640 1 Processor -- start 2023-11-04T01:38:40.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.211+0000 7fce79cc9640 1 -- start start 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce79cc9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce740c4ff0 0x7fce740cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce79cc9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7415aff0 con 0x7fce740adac0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce79cc9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7415a3e0 con 0x7fce74159c00 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce79cc9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7415a6c0 con 0x7fce740c4ff0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce73fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fce740adac0 0x7fce740adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48668/0 (socket says 172.21.15.93:48668) 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce73fff640 1 -- 172.21.15.93:0/2135153850 learned_addr learned my addr 172.21.15.93:0/2135153850 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165378044 0 0) 0x7fce7415aff0 con 0x7fce740adac0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce5c003520 con 0x7fce740adac0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce72ffd640 1 --2- 172.21.15.93:0/2135153850 >> v2:172.21.15.125:3300/0 conn(0x7fce740c4ff0 0x7fce740cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946798462 0 0) 0x7fce5c003520 con 0x7fce740adac0 2023-11-04T01:38:40.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 >> v2:172.21.15.125:3300/0 conn(0x7fce740c4ff0 msgr2=0x7fce740cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.212+0000 7fce727fc640 1 --2- 172.21.15.93:0/2135153850 >> v2:172.21.15.125:3300/0 conn(0x7fce740c4ff0 0x7fce740cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 >> v1:172.21.15.125:6789/0 conn(0x7fce74159c00 legacy=0x7fce740c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7415a9a0 con 0x7fce740adac0 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fce6c0019f0 con 0x7fce740adac0 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 >> v1:172.21.15.93:6789/0 conn(0x7fce740adac0 legacy=0x7fce740adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 0x7fce5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c0047c0 0x7fce5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce5c005180 0x7fce5c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7415a6c0 con 0x7fce5c003970 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00e230 con 0x7fce5c005180 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c00e3f0 con 0x7fce5c0047c0 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 0x7fce5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce73fff640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce5c005180 0x7fce5c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce72ffd640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c0047c0 0x7fce5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 -- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c0047c0 msgr2=0x7fce5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c0047c0 0x7fce5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 -- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce5c005180 msgr2=0x7fce5c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce5c005180 0x7fce5c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce737fe640 1 -- 172.21.15.93:0/2135153850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c003520 con 0x7fce5c003970 2023-11-04T01:38:40.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.213+0000 7fce73fff640 1 -- 172.21.15.93:0/2135153850 reap_dead start 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce737fe640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 0x7fce5c003d90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fce64001750 tx=0x7fce5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e39dd1198fe43e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640052d0 con 0x7fce5c003970 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6402e050 con 0x7fce5c003970 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce727fc640 1 -- 172.21.15.93:0/2135153850 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64003830 con 0x7fce5c003970 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 -- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 msgr2=0x7fce5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 0x7fce5c003d90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fce64001750 tx=0x7fce5c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 -- 172.21.15.93:0/2135153850 shutdown_connections 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2135153850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce5c003970 0x7fce5c003d90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 -- 172.21.15.93:0/2135153850 >> 172.21.15.93:0/2135153850 conn(0x7fce740ce950 msgr2=0x7fce740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 -- 172.21.15.93:0/2135153850 shutdown_connections 2023-11-04T01:38:40.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.214+0000 7fce79cc9640 1 -- 172.21.15.93:0/2135153850 wait complete. 2023-11-04T01:38:40.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 Processor -- start 2023-11-04T01:38:40.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 -- start start 2023-11-04T01:38:40.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c003970 0x7fce7414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 0x7fce740c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7414f1b0 con 0x7fce741edc50 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c4190 con 0x7fce740c37d0 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.216+0000 7fce79cc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7414b130 con 0x7fce5c003970 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43322/0 (socket says 172.21.15.93:43322) 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 -- 172.21.15.93:0/2644805885 learned_addr learned my addr 172.21.15.93:0/2644805885 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce73fff640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 0x7fce740c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce737fe640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c003970 0x7fce7414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 -- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c003970 msgr2=0x7fce7414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c003970 0x7fce7414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 -- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 msgr2=0x7fce740c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 0x7fce740c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 -- 172.21.15.93:0/2644805885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7414b410 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce73fff640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 0x7fce740c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce72ffd640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fce68011960 tx=0x7fce68011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68004240 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce680043a0 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7414b6f0 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800fa20 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.217+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7414bcb0 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.218+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce74074290 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.219+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce6800fb80 con 0x7fce741edc50 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.219+0000 7fce5bfff640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 0x7fce6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.219+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fce68089c60 con 0x7fce741edc50 2023-11-04T01:38:40.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.219+0000 7fce737fe640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 0x7fce6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.219+0000 7fce737fe640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 0x7fce6006d360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fce64033000 tx=0x7fce64009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.223+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce68054b90 con 0x7fce741edc50 2023-11-04T01:38:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.388+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fce740c8c60 con 0x7fce741edc50 2023-11-04T01:38:40.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.388+0000 7fce5bfff640 1 -- 172.21.15.93:0/2644805885 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v78) v1 ==== 103+0+11 (secure 0 0 0) 0x7fce680230a0 con 0x7fce741edc50 2023-11-04T01:38:40.390 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:40.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 msgr2=0x7fce6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 0x7fce6006d360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fce64033000 tx=0x7fce64009030 comp rx=0 tx=0).stop 2023-11-04T01:38:40.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 msgr2=0x7fce740c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fce68011960 tx=0x7fce68011d60 comp rx=0 tx=0).stop 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 shutdown_connections 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fce6006aea0 0x7fce6006d360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740c37d0 0x7fce740c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce741edc50 0x7fce740c6430 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 --2- 172.21.15.93:0/2644805885 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fce5c003970 0x7fce7414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 >> 172.21.15.93:0/2644805885 conn(0x7fce740ce950 msgr2=0x7fce7406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 shutdown_connections 2023-11-04T01:38:40.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.390+0000 7fce79cc9640 1 -- 172.21.15.93:0/2644805885 wait complete. 2023-11-04T01:38:40.402 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.503+0000 7fa2adefc640 1 Processor -- start 2023-11-04T01:38:40.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.503+0000 7fa2adefc640 1 -- start start 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2adefc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa2a8160600 0x7fa2a80cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2adefc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2adefc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a806e1a0 con 0x7fa2a81609e0 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2adefc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a80cd330 con 0x7fa2a8160600 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2adefc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a806db50 con 0x7fa2a80ccde0 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2a6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa2a81609e0 0x7fa2a80cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48682/0 (socket says 172.21.15.93:48682) 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2a6ffd640 1 -- 172.21.15.93:0/4121815065 learned_addr learned my addr 172.21.15.93:0/4121815065 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/4121815065 >> v2:172.21.15.125:3300/0 conn(0x7fa2a8160600 0x7fa2a80cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2a7fff640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.504+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229358644 0 0) 0x7fa2a806e1a0 con 0x7fa2a81609e0 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa290003520 con 0x7fa2a81609e0 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147361117 0 0) 0x7fa290003520 con 0x7fa2a81609e0 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a77fe640 1 -- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 msgr2=0x7fa2a806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a77fe640 1 -- 172.21.15.93:0/4121815065 >> v1:172.21.15.93:6789/0 conn(0x7fa2a81609e0 legacy=0x7fa2a80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.505+0000 7fa2a77fe640 1 -- 172.21.15.93:0/4121815065 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a806de30 con 0x7fa2a8160600 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80cd610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a700d165b4e7fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29802f050 con 0x7fa2a8160600 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298031500 con 0x7fa2a8160600 2023-11-04T01:38:40.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2a67fc640 1 -- 172.21.15.93:0/4121815065 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c001670 con 0x7fa2a8160600 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 -- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 msgr2=0x7fa2a80cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80cd610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802b820 comp rx=0 tx=0).stop 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 -- 172.21.15.93:0/4121815065 shutdown_connections 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 --2- 172.21.15.93:0/4121815065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80cd610 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 -- 172.21.15.93:0/4121815065 >> 172.21.15.93:0/4121815065 conn(0x7fa2a806a120 msgr2=0x7fa2a806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 -- 172.21.15.93:0/4121815065 shutdown_connections 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.506+0000 7fa2adefc640 1 -- 172.21.15.93:0/4121815065 wait complete. 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.507+0000 7fa2adefc640 1 Processor -- start 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 -- start start 2023-11-04T01:38:40.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a80b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a81f06d0 con 0x7fa2a81609e0 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80b43f0 con 0x7fa2a8160600 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2adefc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a81f3be0 con 0x7fa2a80ccde0 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2a7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2a7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43324/0 (socket says 172.21.15.93:43324) 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2a7fff640 1 -- 172.21.15.93:0/419286604 learned_addr learned my addr 172.21.15.93:0/419286604 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.508+0000 7fa2a6ffd640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a80b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 -- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 msgr2=0x7fa2a80b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a80b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 -- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 msgr2=0x7fa2a80b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 -- 172.21.15.93:0/419286604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009400 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2a7fff640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000efc0 tx=0x7fa2a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0014480 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000f040 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80b37e0 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0014820 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.509+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a80b3da0 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.510+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a8066610 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.511+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2a0014980 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.511+0000 7fa28ffff640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 0x7fa29406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.511+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fa2a008a250 con 0x7fa2a81609e0 2023-11-04T01:38:40.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.511+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 0x7fa29406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.511+0000 7fa2a77fe640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 0x7fa29406d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa298035000 tx=0x7fa298008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.515+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2a0055230 con 0x7fa2a81609e0 2023-11-04T01:38:40.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.682+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fa2a80b4580 con 0x7fa2a81609e0 2023-11-04T01:38:40.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.682+0000 7fa28ffff640 1 -- 172.21.15.93:0/419286604 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v78) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa2a0058850 con 0x7fa2a81609e0 2023-11-04T01:38:40.684 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 msgr2=0x7fa29406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 0x7fa29406d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa298035000 tx=0x7fa298008030 comp rx=0 tx=0).stop 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 msgr2=0x7fa2a81f36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000efc0 tx=0x7fa2a000c490 comp rx=0 tx=0).stop 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 shutdown_connections 2023-11-04T01:38:40.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa29406ae70 0x7fa29406d330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a81609e0 0x7fa2a81f36a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a8160600 0x7fa2a80b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 --2- 172.21.15.93:0/419286604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a80ccde0 0x7fa2a80b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.684+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 >> 172.21.15.93:0/419286604 conn(0x7fa2a806a120 msgr2=0x7fa2a80c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.685+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 shutdown_connections 2023-11-04T01:38:40.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.685+0000 7fa2adefc640 1 -- 172.21.15.93:0/419286604 wait complete. 2023-11-04T01:38:40.697 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:40.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 Processor -- start 2023-11-04T01:38:40.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 -- start start 2023-11-04T01:38:40.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07d40cd6d0 0x7f07d4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40cde60 con 0x7f07d4153e60 2023-11-04T01:38:40.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d4160f90 con 0x7f07d40b4880 2023-11-04T01:38:40.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d9ed4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d4161960 con 0x7f07d40cd6d0 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.798+0000 7f07d2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07d40cd6d0 0x7f07d4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f07d4153e60 0x7f07d415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48684/0 (socket says 172.21.15.93:48684) 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d37fe640 1 -- 172.21.15.93:0/365423729 learned_addr learned my addr 172.21.15.93:0/365423729 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d2ffd640 1 -- 172.21.15.93:0/365423729 >> v1:172.21.15.125:6789/0 conn(0x7f07d40b4880 legacy=0x7f07d40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d2ffd640 1 -- 172.21.15.93:0/365423729 >> v1:172.21.15.93:6789/0 conn(0x7f07d4153e60 legacy=0x7f07d415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d27fc640 1 -- 172.21.15.93:0/365423729 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694433916 0 0) 0x7f07d40cde60 con 0x7f07d4153e60 2023-11-04T01:38:40.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.799+0000 7f07d2ffd640 1 -- 172.21.15.93:0/365423729 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40ce090 con 0x7f07d40cd6d0 2023-11-04T01:38:40.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d2ffd640 1 --2- 172.21.15.93:0/365423729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4161420 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097a0 tx=0x7f07c802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c36de07fb7b0760 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d27fc640 1 -- 172.21.15.93:0/365423729 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8030610 con 0x7f07d40cd6d0 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d27fc640 1 -- 172.21.15.93:0/365423729 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8030770 con 0x7f07d40cd6d0 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d27fc640 1 -- 172.21.15.93:0/365423729 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8030b00 con 0x7f07d40cd6d0 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 -- 172.21.15.93:0/365423729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 msgr2=0x7f07d4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/365423729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4161420 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097a0 tx=0x7f07c802b960 comp rx=0 tx=0).stop 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 -- 172.21.15.93:0/365423729 shutdown_connections 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/365423729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4161420 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 -- 172.21.15.93:0/365423729 >> 172.21.15.93:0/365423729 conn(0x7f07d40cf880 msgr2=0x7f07d40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 -- 172.21.15.93:0/365423729 shutdown_connections 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.800+0000 7f07d9ed4640 1 -- 172.21.15.93:0/365423729 wait complete. 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.801+0000 7f07d9ed4640 1 Processor -- start 2023-11-04T01:38:40.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 -- start start 2023-11-04T01:38:40.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 0x7f07d4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07d4153e60 0x7f07d41547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4157150 con 0x7f07d40cd6d0 2023-11-04T01:38:40.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4154ce0 con 0x7f07d40b4880 2023-11-04T01:38:40.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d9ed4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40c6d80 con 0x7f07d4153e60 2023-11-04T01:38:40.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d2ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43348/0 (socket says 172.21.15.93:43348) 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.802+0000 7f07d2ffd640 1 -- 172.21.15.93:0/2698336429 learned_addr learned my addr 172.21.15.93:0/2698336429 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d37fe640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 0x7f07d4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d3fff640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07d4153e60 0x7f07d41547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 -- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07d4153e60 msgr2=0x7f07d41547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07d4153e60 0x7f07d41547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 -- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 msgr2=0x7f07d4157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 0x7f07d4157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 -- 172.21.15.93:0/2698336429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009400 con 0x7f07d40cd6d0 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d37fe640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 0x7f07d4157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d2ffd640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07c802bf70 tx=0x7f07c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c803e040 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8039cb0 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d4157340 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8043680 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.803+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d40c72b0 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.804+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d4074290 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.804+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07c80423e0 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.805+0000 7f07bbfff640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 0x7f07c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.805+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f07c80abd70 con 0x7f07d40cd6d0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.805+0000 7f07d37fe640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 0x7f07c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.805+0000 7f07d37fe640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 0x7f07c006d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f07c4007fd0 tx=0x7f07c4007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.809+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07c8076c10 con 0x7f07d40cd6d0 2023-11-04T01:38:40.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.974+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f07d40d0b80 con 0x7f07d40cd6d0 2023-11-04T01:38:40.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.975+0000 7f07bbfff640 1 -- 172.21.15.93:0/2698336429 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7f07c807a230 con 0x7f07d40cd6d0 2023-11-04T01:38:40.976 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 msgr2=0x7f07c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 0x7f07c006d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f07c4007fd0 tx=0x7f07c4007de0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 msgr2=0x7f07d4156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f07c802bf70 tx=0x7f07c8004730 comp rx=0 tx=0).stop 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 shutdown_connections 2023-11-04T01:38:40.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07c006ae70 0x7f07c006d330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07d4153e60 0x7f07d41547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07d40cd6d0 0x7f07d4156c10 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 --2- 172.21.15.93:0/2698336429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07d40b4880 0x7f07d4157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.976+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 >> 172.21.15.93:0/2698336429 conn(0x7f07d40cf880 msgr2=0x7f07d40d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.977+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 shutdown_connections 2023-11-04T01:38:40.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:40.977+0000 7f07d9ed4640 1 -- 172.21.15.93:0/2698336429 wait complete. 2023-11-04T01:38:40.989 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.087+0000 7f4dcae1a640 1 Processor -- start 2023-11-04T01:38:41.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.087+0000 7f4dcae1a640 1 -- start start 2023-11-04T01:38:41.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dcae1a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dc415ad80 0x7f4dc406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dcae1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 0x7f4dc40c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dcae1a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40ca070 con 0x7f4dc40c9c40 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dcae1a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc406cd00 con 0x7f4dc415ad80 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dcae1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406cfa0 con 0x7f4dc40b42c0 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 0x7f4dc40c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dc8bb6640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dc415ad80 0x7f4dc406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dc93b7640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4dc40c9c40 0x7f4dc4070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:51500/0 (socket says 172.21.15.93:51500) 2023-11-04T01:38:41.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.088+0000 7f4dc93b7640 1 -- 172.21.15.93:0/2122444076 learned_addr learned my addr 172.21.15.93:0/2122444076 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc3fff640 1 -- 172.21.15.93:0/2122444076 >> v2:172.21.15.125:3300/0 conn(0x7f4dc415ad80 msgr2=0x7f4dc406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/2122444076 >> v2:172.21.15.125:3300/0 conn(0x7f4dc415ad80 0x7f4dc406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc37fe640 1 -- 172.21.15.93:0/2122444076 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481731238 0 0) 0x7f4dc40ca070 con 0x7f4dc40c9c40 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc3fff640 1 -- 172.21.15.93:0/2122444076 >> v1:172.21.15.125:6789/0 conn(0x7f4dc40c9c40 legacy=0x7f4dc4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc3fff640 1 -- 172.21.15.93:0/2122444076 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc406d280 con 0x7f4dc40b42c0 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.089+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/2122444076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 0x7f4dc40c9700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4db00097a0 tx=0x7f4db002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d142424d68abf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dc37fe640 1 -- 172.21.15.93:0/2122444076 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0030610 con 0x7f4dc40b42c0 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dc37fe640 1 -- 172.21.15.93:0/2122444076 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0030770 con 0x7f4dc40b42c0 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dc37fe640 1 -- 172.21.15.93:0/2122444076 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0030b00 con 0x7f4dc40b42c0 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 -- 172.21.15.93:0/2122444076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 msgr2=0x7f4dc40c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/2122444076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 0x7f4dc40c9700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4db00097a0 tx=0x7f4db002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:41.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 -- 172.21.15.93:0/2122444076 shutdown_connections 2023-11-04T01:38:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/2122444076 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc40b42c0 0x7f4dc40c9700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/2122444076 >> v2:172.21.15.125:3300/0 conn(0x7f4dc415ad80 0x7f4dc406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 -- 172.21.15.93:0/2122444076 >> 172.21.15.93:0/2122444076 conn(0x7f4dc40ce950 msgr2=0x7f4dc40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 -- 172.21.15.93:0/2122444076 shutdown_connections 2023-11-04T01:38:41.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.090+0000 7f4dcae1a640 1 -- 172.21.15.93:0/2122444076 wait complete. 2023-11-04T01:38:41.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.091+0000 7f4dcae1a640 1 Processor -- start 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.091+0000 7f4dcae1a640 1 -- start start 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 0x7f4dc40c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc415ad80 0x7f4dc40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4156000 con 0x7f4dc40b42c0 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f0840 con 0x7f4dc40c9c40 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dcae1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f0b20 con 0x7f4dc415ad80 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dc8bb6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dc8bb6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43354/0 (socket says 172.21.15.93:43354) 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dc8bb6640 1 -- 172.21.15.93:0/154413788 learned_addr learned my addr 172.21.15.93:0/154413788 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 0x7f4dc40c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.092+0000 7f4dc93b7640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc415ad80 0x7f4dc40c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 -- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc415ad80 msgr2=0x7f4dc40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc415ad80 0x7f4dc40c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 -- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 msgr2=0x7f4dc40c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 0x7f4dc40c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 -- 172.21.15.93:0/154413788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009400 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 0x7f4dc40c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc8bb6640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9b0 tx=0x7f4db800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8009670 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800c9a0 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc41f0e00 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800cd50 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.093+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40c7640 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.094+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4074290 con 0x7f4dc40b42c0 2023-11-04T01:38:41.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.095+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4db8013470 con 0x7f4dc40b42c0 2023-11-04T01:38:41.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.095+0000 7f4dc17fa640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 0x7f4da806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.095+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f4db8089930 con 0x7f4dc40b42c0 2023-11-04T01:38:41.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.095+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 0x7f4da806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.095+0000 7f4dc3fff640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 0x7f4da806d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4db0036000 tx=0x7f4db003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.099+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4db8054910 con 0x7f4dc40b42c0 2023-11-04T01:38:41.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.267+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4dc40b4880 con 0x7f4dc40b42c0 2023-11-04T01:38:41.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.268+0000 7f4dc17fa640 1 -- 172.21.15.93:0/154413788 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+287 (secure 0 0 0) 0x7f4db8021130 con 0x7f4dc40b42c0 2023-11-04T01:38:41.269 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 7, 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 12, 2023-11-04T01:38:41.270 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "test_data_pool" 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 13, 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:41.271 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.269+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 msgr2=0x7f4da806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.269+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 0x7f4da806d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4db0036000 tx=0x7f4db003b040 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.269+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 msgr2=0x7f4dc4157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.269+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e9b0 tx=0x7f4db800ee70 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 shutdown_connections 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4da806ae70 0x7f4da806d330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4dc415ad80 0x7f4dc40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc40c9c40 0x7f4dc40c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 --2- 172.21.15.93:0/154413788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4dc40b42c0 0x7f4dc4157420 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 >> 172.21.15.93:0/154413788 conn(0x7f4dc40ce950 msgr2=0x7f4dc40b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 shutdown_connections 2023-11-04T01:38:41.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.270+0000 7f4dcae1a640 1 -- 172.21.15.93:0/154413788 wait complete. 2023-11-04T01:38:41.282 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:41.282 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.384+0000 7f9a95901640 1 Processor -- start 2023-11-04T01:38:41.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.384+0000 7f9a95901640 1 -- start start 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a95901640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9a900cd610 0x7f9a900b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a95901640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a90160fc0 con 0x7f9a90160370 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a95901640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a900ce8c0 con 0x7f9a900cda50 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a95901640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a90160c70 con 0x7f9a900cd610 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a8effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9a90160370 0x7f9a90161450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48694/0 (socket says 172.21.15.93:48694) 2023-11-04T01:38:41.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.385+0000 7f9a8effd640 1 -- 172.21.15.93:0/1754425738 learned_addr learned my addr 172.21.15.93:0/1754425738 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518769567 0 0) 0x7f9a90160fc0 con 0x7f9a90160370 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a78003520 con 0x7f9a90160370 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1754425738 >> v2:172.21.15.125:3300/0 conn(0x7f9a900cd610 0x7f9a900b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18080939 0 0) 0x7f9a78003520 con 0x7f9a90160370 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 >> v2:172.21.15.125:3300/0 conn(0x7f9a900cd610 msgr2=0x7f9a900b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 --2- 172.21.15.93:0/1754425738 >> v2:172.21.15.125:3300/0 conn(0x7f9a900cd610 0x7f9a900b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 >> v1:172.21.15.125:6789/0 conn(0x7f9a900cda50 legacy=0x7f9a9006f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900af0e0 con 0x7f9a90160370 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f9a800019f0 con 0x7f9a90160370 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 >> v1:172.21.15.93:6789/0 conn(0x7f9a90160370 legacy=0x7f9a90161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a78003970 0x7f9a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a78005180 0x7f9a7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90160c70 con 0x7f9a780047c0 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7800c020 con 0x7f9a78003970 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7800c1e0 con 0x7f9a78005180 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8effd640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a78003970 0x7f9a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8f7fe640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a78005180 0x7f9a7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 -- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a78005180 msgr2=0x7f9a7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a78005180 0x7f9a7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 -- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a78003970 msgr2=0x7f9a78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a78003970 0x7f9a78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8e7fc640 1 -- 172.21.15.93:0/1754425738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78003520 con 0x7f9a780047c0 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.386+0000 7f9a8f7fe640 1 -- 172.21.15.93:0/1754425738 reap_dead start 2023-11-04T01:38:41.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.387+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a78004c40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009ac0 tx=0x7f9a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d267e6660065e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.387+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8402c6b0 con 0x7f9a780047c0 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.387+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8402c810 con 0x7f9a780047c0 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.387+0000 7f9a8dffb640 1 -- 172.21.15.93:0/1754425738 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8402cba0 con 0x7f9a780047c0 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 -- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 msgr2=0x7f9a78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a78004c40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009ac0 tx=0x7f9a780057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 -- 172.21.15.93:0/1754425738 shutdown_connections 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 --2- 172.21.15.93:0/1754425738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a78004c40 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 -- 172.21.15.93:0/1754425738 >> 172.21.15.93:0/1754425738 conn(0x7f9a9006d890 msgr2=0x7f9a9006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 -- 172.21.15.93:0/1754425738 shutdown_connections 2023-11-04T01:38:41.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.388+0000 7f9a95901640 1 -- 172.21.15.93:0/1754425738 wait complete. 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.389+0000 7f9a95901640 1 Processor -- start 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.389+0000 7f9a95901640 1 -- start start 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 0x7f9a900ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 0x7f9a900acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900cada0 con 0x7f9a780047c0 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900adae0 con 0x7f9a900c99b0 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900c8bf0 con 0x7f9a900ca920 2023-11-04T01:38:41.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43370/0 (socket says 172.21.15.93:43370) 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 -- 172.21.15.93:0/1636238624 learned_addr learned my addr 172.21.15.93:0/1636238624 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 0x7f9a900ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8f7fe640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 0x7f9a900acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 -- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 msgr2=0x7f9a900acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 0x7f9a900acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 -- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 msgr2=0x7f9a900ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 0x7f9a900ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 -- 172.21.15.93:0/1636238624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900c8ed0 con 0x7f9a780047c0 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 0x7f9a900ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8f7fe640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 0x7f9a900acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a8effd640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9a80007970 tx=0x7f9a8000a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80001880 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800133f0 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a900c91b0 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800137a0 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.390+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a900c74f0 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.391+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a90067c50 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.392+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a80013900 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.392+0000 7f9a77fff640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 0x7f9a7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.392+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f9a8008a580 con 0x7f9a780047c0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.392+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 0x7f9a7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.393+0000 7f9a8e7fc640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 0x7f9a7c06d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a84036000 tx=0x7f9a84030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.396+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a80055420 con 0x7f9a780047c0 2023-11-04T01:38:41.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:41.563+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9a900cf070 con 0x7f9a780047c0 2023-11-04T01:38:42.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.143+0000 7f9a77fff640 1 -- 172.21.15.93:0/1636238624 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9a80058a40 con 0x7f9a780047c0 2023-11-04T01:38:42.145 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:42.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.146+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 msgr2=0x7f9a7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.147+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 0x7f9a7c06d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a84036000 tx=0x7f9a84030000 comp rx=0 tx=0).stop 2023-11-04T01:38:42.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.147+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 msgr2=0x7f9a900c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.147+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9a80007970 tx=0x7f9a8000a6e0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 shutdown_connections 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a7c06aea0 0x7f9a7c06d360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a900ca920 0x7f9a900acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a900c99b0 0x7f9a900ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 --2- 172.21.15.93:0/1636238624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a780047c0 0x7f9a900c6fb0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.148+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 >> 172.21.15.93:0/1636238624 conn(0x7f9a9006d890 msgr2=0x7f9a900cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.150+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 shutdown_connections 2023-11-04T01:38:42.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.151+0000 7f9a95901640 1 -- 172.21.15.93:0/1636238624 wait complete. 2023-11-04T01:38:42.166 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:42.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.272+0000 7f88ef890640 1 Processor -- start 2023-11-04T01:38:42.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.273+0000 7f88ef890640 1 -- start start 2023-11-04T01:38:42.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.273+0000 7f88ef890640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e8153e60 0x7f88e815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.273+0000 7f88ef890640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88e80b4880 0x7f88e80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.273+0000 7f88ef890640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80cde60 con 0x7f88e80cd6d0 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ef890640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80b5230 con 0x7f88e80b4880 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ef890640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8160f90 con 0x7f88e8153e60 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88e80b4880 0x7f88e80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88e80b4880 0x7f88e80b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38692/0 (socket says 172.21.15.93:38692) 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 -- 172.21.15.93:0/4109820375 learned_addr learned my addr 172.21.15.93:0/4109820375 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ed62c640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e8153e60 0x7f88e815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 -- 172.21.15.93:0/4109820375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e8153e60 msgr2=0x7f88e815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e8153e60 0x7f88e815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 -- 172.21.15.93:0/4109820375 >> v1:172.21.15.125:6789/0 conn(0x7f88e80cd6d0 legacy=0x7f88e8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88dffff640 1 -- 172.21.15.93:0/4109820375 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278971235 0 0) 0x7f88e80cde60 con 0x7f88e80cd6d0 2023-11-04T01:38:42.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.274+0000 7f88ede2d640 1 -- 172.21.15.93:0/4109820375 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e815e400 con 0x7f88e80b4880 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ede2d640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e80b4cf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009e50 tx=0x7f88e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bea22624181a10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88dffff640 1 -- 172.21.15.93:0/4109820375 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e002cb00 con 0x7f88e80b4880 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88dffff640 1 -- 172.21.15.93:0/4109820375 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e002cc60 con 0x7f88e80b4880 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88dffff640 1 -- 172.21.15.93:0/4109820375 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00343f0 con 0x7f88e80b4880 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 -- 172.21.15.93:0/4109820375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 msgr2=0x7f88e80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e80b4cf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009e50 tx=0x7f88e002bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:42.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 -- 172.21.15.93:0/4109820375 shutdown_connections 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e80b4cf0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 --2- 172.21.15.93:0/4109820375 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e8153e60 0x7f88e815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.275+0000 7f88ef890640 1 -- 172.21.15.93:0/4109820375 >> 172.21.15.93:0/4109820375 conn(0x7f88e80cf880 msgr2=0x7f88e80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.276+0000 7f88ef890640 1 -- 172.21.15.93:0/4109820375 shutdown_connections 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.276+0000 7f88ef890640 1 -- 172.21.15.93:0/4109820375 wait complete. 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 Processor -- start 2023-11-04T01:38:42.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 -- start start 2023-11-04T01:38:42.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e80cd6d0 0x7f88e80c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 0x7f88e80c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81591f0 con 0x7f88e80b4880 2023-11-04T01:38:42.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8153620 con 0x7f88e8153e60 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ef890640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8158620 con 0x7f88e80cd6d0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ed62c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ed62c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38702/0 (socket says 172.21.15.93:38702) 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.277+0000 7f88ed62c640 1 -- 172.21.15.93:0/3129929029 learned_addr learned my addr 172.21.15.93:0/3129929029 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ece2b640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e80cd6d0 0x7f88e80c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ede2d640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 0x7f88e80c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 -- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e80cd6d0 msgr2=0x7f88e80c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e80cd6d0 0x7f88e80c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 -- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 msgr2=0x7f88e80c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 0x7f88e80c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 -- 172.21.15.93:0/3129929029 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009b30 con 0x7f88e80b4880 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ede2d640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 0x7f88e80c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:42.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ed62c640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e870 tx=0x7f88e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40094f0 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e400c940 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e81588c0 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e400ccf0 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.278+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e8158e80 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.279+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e8074290 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.280+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88e4013470 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.280+0000 7f88ddffb640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.280+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6610+0+0 (secure 0 0 0) 0x7f88e4089a50 con 0x7f88e80b4880 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.280+0000 7f88ece2b640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.281+0000 7f88ece2b640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f88e80c6480 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.285+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88e4054770 con 0x7f88e80b4880 2023-11-04T01:38:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:42.454+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f88e80d1d00 con 0x7f88e80b4880 2023-11-04T01:38:43.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.146+0000 7f88ddffb640 1 -- 172.21.15.93:0/3129929029 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f88e40170d0 con 0x7f88e80b4880 2023-11-04T01:38:43.148 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:38:43.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.149+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 msgr2=0x7f88cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.149+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f88e80c6480 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 msgr2=0x7f88e81530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e870 tx=0x7f88e400ed30 comp rx=0 tx=0).stop 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 shutdown_connections 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e8153e60 0x7f88e80c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e80cd6d0 0x7f88e80c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 --2- 172.21.15.93:0/3129929029 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e80b4880 0x7f88e81530e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 >> 172.21.15.93:0/3129929029 conn(0x7f88e80cf880 msgr2=0x7f88e8161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 shutdown_connections 2023-11-04T01:38:43.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.150+0000 7f88ef890640 1 -- 172.21.15.93:0/3129929029 wait complete. 2023-11-04T01:38:43.176 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:43.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.281+0000 7f2df121f640 1 Processor -- start 2023-11-04T01:38:43.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2df121f640 1 -- start start 2023-11-04T01:38:43.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2df121f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2dec070e20 0x7f2dec0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2df121f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0c3900 con 0x7f2dec0ad730 2023-11-04T01:38:43.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2df121f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0c3be0 con 0x7f2dec15ad30 2023-11-04T01:38:43.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2df121f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0ae260 con 0x7f2dec070e20 2023-11-04T01:38:43.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2deb59e640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2dec0ad730 0x7f2dec15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49830/0 (socket says 172.21.15.93:49830) 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.282+0000 7f2deb59e640 1 -- 172.21.15.93:0/2964559892 learned_addr learned my addr 172.21.15.93:0/2964559892 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049312912 0 0) 0x7f2dec0c3900 con 0x7f2dec0ad730 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8003520 con 0x7f2dec0ad730 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2de3fff640 1 --2- 172.21.15.93:0/2964559892 >> v2:172.21.15.125:3300/0 conn(0x7f2dec070e20 0x7f2dec0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806961015 0 0) 0x7f2dd8003520 con 0x7f2dec0ad730 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 >> v2:172.21.15.125:3300/0 conn(0x7f2dec070e20 msgr2=0x7f2dec0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 --2- 172.21.15.93:0/2964559892 >> v2:172.21.15.125:3300/0 conn(0x7f2dec070e20 0x7f2dec0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 >> v1:172.21.15.125:6789/0 conn(0x7f2dec15ad30 legacy=0x7f2dec070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0c3ec0 con 0x7f2dec0ad730 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f2de40019f0 con 0x7f2dec0ad730 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2de3fff640 1 --2- 172.21.15.93:0/2964559892 >> v2:172.21.15.125:3300/0 conn(0x7f2dec070e20 0x7f2dec0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 >> v1:172.21.15.93:6789/0 conn(0x7f2dec0ad730 legacy=0x7f2dec15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0ae260 con 0x7f2dd80052a0 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800c170 con 0x7f2dd8003970 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800c330 con 0x7f2dd80047c0 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2dead9d640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2de3fff640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 -- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dd80047c0 msgr2=0x7f2dd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dd80047c0 0x7f2dd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 -- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd8003970 msgr2=0x7f2dd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dd8003970 0x7f2dd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.283+0000 7f2deb59e640 1 -- 172.21.15.93:0/2964559892 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8003520 con 0x7f2dd80052a0 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.284+0000 7f2deb59e640 1 -- 172.21.15.93:0/2964559892 reap_dead start 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.284+0000 7f2deb59e640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dd800b980 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2de400a7f0 tx=0x7f2dd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d40b9f493de7f7b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.284+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40072d0 con 0x7f2dd80052a0 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.284+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de402f070 con 0x7f2dd80052a0 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.284+0000 7f2dea59c640 1 -- 172.21.15.93:0/2964559892 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4007670 con 0x7f2dd80052a0 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 -- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 msgr2=0x7f2dd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dd800b980 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2de400a7f0 tx=0x7f2dd80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 -- 172.21.15.93:0/2964559892 shutdown_connections 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 --2- 172.21.15.93:0/2964559892 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dd800b980 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 -- 172.21.15.93:0/2964559892 >> 172.21.15.93:0/2964559892 conn(0x7f2dec0ce950 msgr2=0x7f2dec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 -- 172.21.15.93:0/2964559892 shutdown_connections 2023-11-04T01:38:43.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.285+0000 7f2df121f640 1 -- 172.21.15.93:0/2964559892 wait complete. 2023-11-04T01:38:43.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.286+0000 7f2df121f640 1 Processor -- start 2023-11-04T01:38:43.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.286+0000 7f2df121f640 1 -- start start 2023-11-04T01:38:43.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 0x7f2dec1efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dec0c5a20 0x7f2dec0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec15b1b0 con 0x7f2dd80052a0 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1f01f0 con 0x7f2dec0c5a20 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2df121f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1f3ef0 con 0x7f2dec15caa0 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38716/0 (socket says 172.21.15.93:38716) 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 -- 172.21.15.93:0/154394750 learned_addr learned my addr 172.21.15.93:0/154394750 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2de3fff640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 0x7f2dec1efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2deb59e640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dec0c5a20 0x7f2dec0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 -- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 msgr2=0x7f2dec1efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 0x7f2dec1efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 -- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dec0c5a20 msgr2=0x7f2dec0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dec0c5a20 0x7f2dec0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 -- 172.21.15.93:0/154394750 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec1f41d0 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2de3fff640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 0x7f2dec1efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.287+0000 7f2dead9d640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00f5f0 tx=0x7f2ddc00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.288+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0052e0 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.288+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc005440 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.288+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec1f44b0 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.288+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc003810 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.288+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec15cf00 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.289+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec074290 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.289+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ddc003970 con 0x7f2dd80052a0 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.289+0000 7f2de37fe640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 0x7f2dcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.290+0000 7f2de3fff640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 0x7f2dcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.290+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6992+0+0 (secure 0 0 0) 0x7f2ddc089900 con 0x7f2dd80052a0 2023-11-04T01:38:43.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.290+0000 7f2de3fff640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 0x7f2dcc06d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0c8c80 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.294+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ddc054540 con 0x7f2dd80052a0 2023-11-04T01:38:43.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:43.495+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2dec15b2f0 con 0x7f2dd80052a0 2023-11-04T01:38:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 14 and data pool 15 2023-11-04T01:38:44.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.167+0000 7f2de37fe640 1 -- 172.21.15.93:0/154394750 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2dec15b2f0 con 0x7f2dd80052a0 2023-11-04T01:38:44.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.175+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 msgr2=0x7f2dcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.175+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 0x7f2dcc06d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0c8c80 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.175+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 msgr2=0x7f2dec1f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.175+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00f5f0 tx=0x7f2ddc00fab0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 shutdown_connections 2023-11-04T01:38:44.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2dcc06ae70 0x7f2dcc06d330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2dec0c5a20 0x7f2dec0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2dec15caa0 0x7f2dec1efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 --2- 172.21.15.93:0/154394750 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2dd80052a0 0x7f2dec1f3910 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.179+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 >> 172.21.15.93:0/154394750 conn(0x7f2dec0ce950 msgr2=0x7f2dec159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.181+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 shutdown_connections 2023-11-04T01:38:44.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.183+0000 7f2df121f640 1 -- 172.21.15.93:0/154394750 wait complete. 2023-11-04T01:38:44.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:44.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.301+0000 7f5ca6a56640 1 Processor -- start 2023-11-04T01:38:44.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 -- start start 2023-11-04T01:38:44.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5ca015cdf0 0x7f5ca00b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ca00b8b10 0x7f5ca00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca00b62c0 con 0x7f5ca00d0db0 2023-11-04T01:38:44.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca00b65a0 con 0x7f5ca015cdf0 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.302+0000 7f5ca6a56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca00b6880 con 0x7f5ca00b8b10 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5ca4ff3640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5ca00d0db0 0x7f5ca01609f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49840/0 (socket says 172.21.15.93:49840) 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5ca4ff3640 1 -- 172.21.15.93:0/3080560237 learned_addr learned my addr 172.21.15.93:0/3080560237 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5ca015cdf0 0x7f5ca00b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9effd640 1 -- 172.21.15.93:0/3080560237 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213751980 0 0) 0x7f5ca00b62c0 con 0x7f5ca00d0db0 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9f7fe640 1 --2- 172.21.15.93:0/3080560237 >> v2:172.21.15.125:3300/0 conn(0x7f5ca00b8b10 0x7f5ca00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9effd640 1 -- 172.21.15.93:0/3080560237 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c88003520 con 0x7f5ca00d0db0 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9ffff640 1 -- 172.21.15.93:0/3080560237 >> v2:172.21.15.125:3300/0 conn(0x7f5ca00b8b10 msgr2=0x7f5ca00b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/3080560237 >> v2:172.21.15.125:3300/0 conn(0x7f5ca00b8b10 0x7f5ca00b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9ffff640 1 -- 172.21.15.93:0/3080560237 >> v1:172.21.15.93:6789/0 conn(0x7f5ca00d0db0 legacy=0x7f5ca01609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.303+0000 7f5c9ffff640 1 -- 172.21.15.93:0/3080560237 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00b6b60 con 0x7f5ca015cdf0 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/3080560237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca015cdf0 0x7f5ca00b85d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d3a70 tx=0x7f5c9002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b61a1da4035711 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5c9effd640 1 -- 172.21.15.93:0/3080560237 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90030610 con 0x7f5ca015cdf0 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5c9effd640 1 -- 172.21.15.93:0/3080560237 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90030770 con 0x7f5ca015cdf0 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5c9effd640 1 -- 172.21.15.93:0/3080560237 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90030b00 con 0x7f5ca015cdf0 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 -- 172.21.15.93:0/3080560237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca015cdf0 msgr2=0x7f5ca00b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/3080560237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca015cdf0 0x7f5ca00b85d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d3a70 tx=0x7f5c9002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 -- 172.21.15.93:0/3080560237 shutdown_connections 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/3080560237 >> v2:172.21.15.125:3300/0 conn(0x7f5ca00b8b10 0x7f5ca00b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/3080560237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca015cdf0 0x7f5ca00b85d0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 -- 172.21.15.93:0/3080560237 >> 172.21.15.93:0/3080560237 conn(0x7f5ca0071c70 msgr2=0x7f5ca0072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 -- 172.21.15.93:0/3080560237 shutdown_connections 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.304+0000 7f5ca6a56640 1 -- 172.21.15.93:0/3080560237 wait complete. 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.305+0000 7f5ca6a56640 1 Processor -- start 2023-11-04T01:38:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 -- start start 2023-11-04T01:38:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 0x7f5ca01f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ca015cdf0 0x7f5ca00d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00ca990 con 0x7f5ca00d0db0 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00ca690 con 0x7f5ca00b8b10 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5ca6a56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca01f6140 con 0x7f5ca015cdf0 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5c9f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5c9f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38744/0 (socket says 172.21.15.93:38744) 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.306+0000 7f5c9f7fe640 1 -- 172.21.15.93:0/2475569660 learned_addr learned my addr 172.21.15.93:0/2475569660 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 0x7f5ca01f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5ca4ff3640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ca015cdf0 0x7f5ca00d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 -- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ca015cdf0 msgr2=0x7f5ca00d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ca015cdf0 0x7f5ca00d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 -- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 msgr2=0x7f5ca01f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 0x7f5ca01f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 -- 172.21.15.93:0/2475569660 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90009400 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 0x7f5ca01f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9f7fe640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d830 tx=0x7f5c9400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400b6c0 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400b820 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400bbb0 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca01f6420 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.307+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca01f6700 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.308+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0067c50 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.309+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c9401e460 con 0x7f5ca00d0db0 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.309+0000 7f5c9cff9640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 0x7f5c8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.309+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 0x7f5c8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.309+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f5c9408a310 con 0x7f5ca00d0db0 2023-11-04T01:38:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.309+0000 7f5c9ffff640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 0x7f5c8c06d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5c90036000 tx=0x7f5c9003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.313+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c94054e60 con 0x7f5ca00d0db0 2023-11-04T01:38:44.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.481+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ca00cab40 con 0x7f5ca00d0db0 2023-11-04T01:38:44.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.483+0000 7f5c9cff9640 1 -- 172.21.15.93:0/2475569660 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+21978 (secure 0 0 0) 0x7f5ca00cab40 con 0x7f5ca00d0db0 2023-11-04T01:38:44.485 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:44.485 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":81,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:43.496136+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 msgr2=0x7f5c8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 0x7f5c8c06d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5c90036000 tx=0x7f5c9003b040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 msgr2=0x7f5ca00cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d830 tx=0x7f5c9400dcf0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 shutdown_connections 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5c8c06ae70 0x7f5c8c06d330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5ca015cdf0 0x7f5ca00d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5ca00d0db0 0x7f5ca00cae20 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 --2- 172.21.15.93:0/2475569660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ca00b8b10 0x7f5ca01f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 >> 172.21.15.93:0/2475569660 conn(0x7f5ca0071c70 msgr2=0x7f5ca015dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 shutdown_connections 2023-11-04T01:38:44.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.485+0000 7f5ca6a56640 1 -- 172.21.15.93:0/2475569660 wait complete. 2023-11-04T01:38:44.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.595+0000 7fa451178640 1 Processor -- start 2023-11-04T01:38:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.595+0000 7fa451178640 1 -- start start 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa451178640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa44c15bfb0 0x7fa44c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa451178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa451178640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0cc450 con 0x7fa44c15ae40 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa451178640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c15f400 con 0x7fa44c15bfb0 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa451178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c15b220 con 0x7fa44c0cd860 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa44c15bfb0 0x7fa44c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa44c15bfb0 0x7fa44c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38752/0 (socket says 172.21.15.93:38752) 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 -- 172.21.15.93:0/484263986 learned_addr learned my addr 172.21.15.93:0/484263986 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa44b59e640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 -- 172.21.15.93:0/484263986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 msgr2=0x7fa44c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 -- 172.21.15.93:0/484263986 >> v1:172.21.15.125:6789/0 conn(0x7fa44c15ae40 legacy=0x7fa44c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.596+0000 7fa443fff640 1 -- 172.21.15.93:0/484263986 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c15f890 con 0x7fa44c15bfb0 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa443fff640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0cd320 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa434009870 tx=0x7fa43402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9077b02303000f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa44a59c640 1 -- 172.21.15.93:0/484263986 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434030840 con 0x7fa44c15bfb0 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa44a59c640 1 -- 172.21.15.93:0/484263986 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340309a0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa44a59c640 1 -- 172.21.15.93:0/484263986 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434030d30 con 0x7fa44c15bfb0 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa451178640 1 -- 172.21.15.93:0/484263986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 msgr2=0x7fa44c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa451178640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0cd320 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa434009870 tx=0x7fa43402b980 comp rx=0 tx=0).stop 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.597+0000 7fa451178640 1 -- 172.21.15.93:0/484263986 shutdown_connections 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.598+0000 7fa451178640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.598+0000 7fa451178640 1 --2- 172.21.15.93:0/484263986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0cd320 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.598+0000 7fa451178640 1 -- 172.21.15.93:0/484263986 >> 172.21.15.93:0/484263986 conn(0x7fa44c06ea90 msgr2=0x7fa44c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.598+0000 7fa451178640 1 -- 172.21.15.93:0/484263986 shutdown_connections 2023-11-04T01:38:44.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.598+0000 7fa451178640 1 -- 172.21.15.93:0/484263986 wait complete. 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.599+0000 7fa451178640 1 Processor -- start 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.599+0000 7fa451178640 1 -- start start 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 0x7fa44c1e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0c9cb0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c06c610 con 0x7fa44c15ae40 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c06bce0 con 0x7fa44c0cd860 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38760/0 (socket says 172.21.15.93:38760) 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 -- 172.21.15.93:0/3463736164 learned_addr learned my addr 172.21.15.93:0/3463736164 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44ad9d640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa443fff640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 0x7fa44c1e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 -- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 msgr2=0x7fa44c0c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 -- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 msgr2=0x7fa44c1e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 0x7fa44c1e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 -- 172.21.15.93:0/3463736164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340094d0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa443fff640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 0x7fa44c1e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa44b59e640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa444007e40 tx=0x7fa44400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444014620 con 0x7fa44c15bfb0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44400ee90 con 0x7fa44c15bfb0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c06bfc0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440149e0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.600+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c06caa0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.601+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c0ce2d0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.602+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa444014b40 con 0x7fa44c15bfb0 2023-11-04T01:38:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.602+0000 7fa4437fe640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 0x7fa42c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.602+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa44408a540 con 0x7fa44c15bfb0 2023-11-04T01:38:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.602+0000 7fa44ad9d640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 0x7fa42c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.603+0000 7fa44ad9d640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 0x7fa42c06d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa43c000f60 tx=0x7fa43c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.606+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa444055080 con 0x7fa44c15bfb0 2023-11-04T01:38:44.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.774+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44c0b3720 con 0x7fa44c15bfb0 2023-11-04T01:38:44.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.776+0000 7fa4437fe640 1 -- 172.21.15.93:0/3463736164 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+21978 (secure 0 0 0) 0x7fa4440586a0 con 0x7fa44c15bfb0 2023-11-04T01:38:44.778 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:44.778 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":81,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:43.496136+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 msgr2=0x7fa42c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 0x7fa42c06d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa43c000f60 tx=0x7fa43c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 msgr2=0x7fa44c0ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa444007e40 tx=0x7fa44400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 shutdown_connections 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa42c06ae70 0x7fa42c06d330 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa44c15bfb0 0x7fa44c0ca030 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa44c15ae40 0x7fa44c1e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 --2- 172.21.15.93:0/3463736164 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa44c0cd860 0x7fa44c0c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.777+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 >> 172.21.15.93:0/3463736164 conn(0x7fa44c06ea90 msgr2=0x7fa44c0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.778+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 shutdown_connections 2023-11-04T01:38:44.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.778+0000 7fa451178640 1 -- 172.21.15.93:0/3463736164 wait complete. 2023-11-04T01:38:44.791 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:38:44.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.891+0000 7f6dead4c640 1 Processor -- start 2023-11-04T01:38:44.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.891+0000 7f6dead4c640 1 -- start start 2023-11-04T01:38:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6dead4c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6de415d1b0 0x7f6de40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6dead4c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40c9bf0 con 0x7f6de4070ff0 2023-11-04T01:38:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6dead4c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40cd890 con 0x7f6de4066000 2023-11-04T01:38:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6dead4c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de40cdb30 con 0x7f6de415d1b0 2023-11-04T01:38:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6de415d1b0 0x7f6de40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de8ae8640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6de4070ff0 0x7f6de40713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49846/0 (socket says 172.21.15.93:49846) 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de8ae8640 1 -- 172.21.15.93:0/2472792470 learned_addr learned my addr 172.21.15.93:0/2472792470 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de3fff640 1 -- 172.21.15.93:0/2472792470 >> v1:172.21.15.125:6789/0 conn(0x7f6de4066000 legacy=0x7f6de406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de3fff640 1 -- 172.21.15.93:0/2472792470 >> v1:172.21.15.93:6789/0 conn(0x7f6de4070ff0 legacy=0x7f6de40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de3fff640 1 -- 172.21.15.93:0/2472792470 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40cde10 con 0x7f6de415d1b0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.892+0000 7f6de37fe640 1 -- 172.21.15.93:0/2472792470 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516800924 0 0) 0x7f6de40c9bf0 con 0x7f6de4070ff0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6de3fff640 1 --2- 172.21.15.93:0/2472792470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de415d1b0 0x7f6de40cb4e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00097a0 tx=0x7f6dd002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c4540c29c57cdb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6de37fe640 1 -- 172.21.15.93:0/2472792470 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030610 con 0x7f6de415d1b0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6de37fe640 1 -- 172.21.15.93:0/2472792470 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0030770 con 0x7f6de415d1b0 2023-11-04T01:38:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6de37fe640 1 -- 172.21.15.93:0/2472792470 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030b00 con 0x7f6de415d1b0 2023-11-04T01:38:44.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 -- 172.21.15.93:0/2472792470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de415d1b0 msgr2=0x7f6de40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 --2- 172.21.15.93:0/2472792470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de415d1b0 0x7f6de40cb4e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00097a0 tx=0x7f6dd002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 -- 172.21.15.93:0/2472792470 shutdown_connections 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 --2- 172.21.15.93:0/2472792470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de415d1b0 0x7f6de40cb4e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 -- 172.21.15.93:0/2472792470 >> 172.21.15.93:0/2472792470 conn(0x7f6de40cbc90 msgr2=0x7f6de40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 -- 172.21.15.93:0/2472792470 shutdown_connections 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.893+0000 7f6dead4c640 1 -- 172.21.15.93:0/2472792470 wait complete. 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 Processor -- start 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 -- start start 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de4066000 0x7f6de415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de415d1b0 0x7f6de41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b1e30 con 0x7f6de4070ff0 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de415d8e0 con 0x7f6de415d1b0 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6dead4c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41f2da0 con 0x7f6de4066000 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.895+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38774/0 (socket says 172.21.15.93:38774) 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 -- 172.21.15.93:0/3086637370 learned_addr learned my addr 172.21.15.93:0/3086637370 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de8ae8640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de4066000 0x7f6de415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de92e9640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de415d1b0 0x7f6de41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 -- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de4066000 msgr2=0x7f6de415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de4066000 0x7f6de415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 -- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de415d1b0 msgr2=0x7f6de41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de415d1b0 0x7f6de41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 -- 172.21.15.93:0/3086637370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009400 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de3fff640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0039c90 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd003f040 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0004030 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de41f3080 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.896+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de40b2040 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.897+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de40b2230 con 0x7f6de4070ff0 2023-11-04T01:38:44.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.897+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dd0004190 con 0x7f6de4070ff0 2023-11-04T01:38:44.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.898+0000 7f6de17fa640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 0x7f6dc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.898+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f6dd00ab8e0 con 0x7f6de4070ff0 2023-11-04T01:38:44.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.898+0000 7f6de8ae8640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 0x7f6dc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.898+0000 7f6de8ae8640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 0x7f6dc806d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000f60 tx=0x7f6dd8007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:44.902+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dd00764b0 con 0x7f6de4070ff0 2023-11-04T01:38:45.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.105+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6de4074290 con 0x7f6de4070ff0 2023-11-04T01:38:45.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.170+0000 7f6de17fa640 1 -- 172.21.15.93:0/3086637370 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6dd0079ad0 con 0x7f6de4070ff0 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 msgr2=0x7f6dc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 0x7f6dc806d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000f60 tx=0x7f6dd8007b90 comp rx=0 tx=0).stop 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 msgr2=0x7f6de41f2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd00046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 shutdown_connections 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6dc806ae70 0x7f6dc806d330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6de415d1b0 0x7f6de41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6de4070ff0 0x7f6de41f2570 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 --2- 172.21.15.93:0/3086637370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6de4066000 0x7f6de415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 >> 172.21.15.93:0/3086637370 conn(0x7f6de40cbc90 msgr2=0x7f6de4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 shutdown_connections 2023-11-04T01:38:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.172+0000 7f6dead4c640 1 -- 172.21.15.93:0/3086637370 wait complete. 2023-11-04T01:38:45.185 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:38:45.186 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:38:45.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.285+0000 7f2f01b05640 1 Processor -- start 2023-11-04T01:38:45.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.285+0000 7f2f01b05640 1 -- start start 2023-11-04T01:38:45.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2f01b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2f01b05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2efc06c1d0 0x7f2efc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2f01b05640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc06ca40 con 0x7f2efc160430 2023-11-04T01:38:45.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2f01b05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0cb580 con 0x7f2efc06c1d0 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2f01b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc06cd20 con 0x7f2efc0b2d30 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2efbfff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2efc06c1d0 0x7f2efc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2efb7fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2efc160430 0x7f2efc0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:44716/0 (socket says 172.21.15.93:44716) 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:50456/0 (socket says 172.21.15.93:50456) 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.286+0000 7f2efb7fe640 1 -- 172.21.15.93:0/4090114503 learned_addr learned my addr 172.21.15.93:0/4090114503 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.287+0000 7f2efbfff640 1 -- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 msgr2=0x7f2efc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.287+0000 7f2efbfff640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.287+0000 7f2efbfff640 1 -- 172.21.15.93:0/4090114503 >> v1:172.21.15.125:6789/0 conn(0x7f2efc160430 legacy=0x7f2efc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.287+0000 7f2efbfff640 1 -- 172.21.15.93:0/4090114503 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc06d000 con 0x7f2efc06c1d0 2023-11-04T01:38:45.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.287+0000 7f2efaffd640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2efbfff640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc06c1d0 0x7f2efc0cbcb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009d90 tx=0x7f2ef402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31e24e2d399e99a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2efa7fc640 1 -- 172.21.15.93:0/4090114503 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef402cc50 con 0x7f2efc06c1d0 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2efa7fc640 1 -- 172.21.15.93:0/4090114503 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef402cdb0 con 0x7f2efc06c1d0 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2efa7fc640 1 -- 172.21.15.93:0/4090114503 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4034660 con 0x7f2efc06c1d0 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 -- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc06c1d0 msgr2=0x7f2efc0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc06c1d0 0x7f2efc0cbcb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009d90 tx=0x7f2ef402bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 -- 172.21.15.93:0/4090114503 shutdown_connections 2023-11-04T01:38:45.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc06c1d0 0x7f2efc0cbcb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 --2- 172.21.15.93:0/4090114503 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc0b2d30 0x7f2efc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 -- 172.21.15.93:0/4090114503 >> 172.21.15.93:0/4090114503 conn(0x7f2efc06ea20 msgr2=0x7f2efc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 -- 172.21.15.93:0/4090114503 shutdown_connections 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.288+0000 7f2f01b05640 1 -- 172.21.15.93:0/4090114503 wait complete. 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 Processor -- start 2023-11-04T01:38:45.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 -- start start 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc06c1d0 0x7f2efc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc160430 0x7f2efc1f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1f6a00 con 0x7f2efc0b2d30 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0b5310 con 0x7f2efc160430 2023-11-04T01:38:45.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.290+0000 7f2f01b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c7680 con 0x7f2efc06c1d0 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38780/0 (socket says 172.21.15.93:38780) 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 -- 172.21.15.93:0/1260738763 learned_addr learned my addr 172.21.15.93:0/1260738763 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc06c1d0 0x7f2efc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efbfff640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc160430 0x7f2efc1f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 -- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc06c1d0 msgr2=0x7f2efc0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc06c1d0 0x7f2efc0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 -- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc160430 msgr2=0x7f2efc1f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc160430 0x7f2efc1f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 -- 172.21.15.93:0/1260738763 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009400 con 0x7f2efc0b2d30 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2efaffd640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ebe0 tx=0x7f2ef000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0009760 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000cc30 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef4009a70 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000eee0 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.291+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc0b5ac0 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.292+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc074290 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.293+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ef0013470 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.293+0000 7f2ee3fff640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 0x7f2ee806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.293+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f2ef0089e20 con 0x7f2efc0b2d30 2023-11-04T01:38:45.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.293+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 0x7f2ee806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.293+0000 7f2efb7fe640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 0x7f2ee806d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005880 tx=0x7f2eec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.297+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ef0054a10 con 0x7f2efc0b2d30 2023-11-04T01:38:45.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:45.501+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2efc0b6b20 con 0x7f2efc0b2d30 2023-11-04T01:38:46.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.175+0000 7f2ee3fff640 1 -- 172.21.15.93:0/1260738763 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ef00170c0 con 0x7f2efc0b2d30 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 msgr2=0x7f2ee806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 0x7f2ee806d330 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005880 tx=0x7f2eec009040 comp rx=0 tx=0).stop 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 msgr2=0x7f2efc0c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ebe0 tx=0x7f2ef000c520 comp rx=0 tx=0).stop 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 shutdown_connections 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ee806ae70 0x7f2ee806d330 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2efc160430 0x7f2efc1f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2efc0b2d30 0x7f2efc0c7140 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 --2- 172.21.15.93:0/1260738763 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2efc06c1d0 0x7f2efc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 >> 172.21.15.93:0/1260738763 conn(0x7f2efc06ea20 msgr2=0x7f2efc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 shutdown_connections 2023-11-04T01:38:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.177+0000 7f2f01b05640 1 -- 172.21.15.93:0/1260738763 wait complete. 2023-11-04T01:38:46.191 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:38:46.191 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.288+0000 7fa82fce0640 1 Processor -- start 2023-11-04T01:38:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.288+0000 7fa82fce0640 1 -- start start 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82fce0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa828159c70 0x7fa8280ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82fce0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 0x7fa8280b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82fce0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280b4110 con 0x7fa8280b0910 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82fce0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280b49b0 con 0x7fa828159c70 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82fce0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280b0da0 con 0x7fa82806db20 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82da7c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa828159c70 0x7fa8280ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82d27b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 0x7fa8280b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82e27d640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa8280b0910 0x7fa82815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:44726/0 (socket says 172.21.15.93:44726) 2023-11-04T01:38:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.289+0000 7fa82e27d640 1 -- 172.21.15.93:0/4280262867 learned_addr learned my addr 172.21.15.93:0/4280262867 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.290+0000 7fa82da7c640 1 -- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 msgr2=0x7fa8280b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.290+0000 7fa82da7c640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 0x7fa8280b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.290+0000 7fa82da7c640 1 -- 172.21.15.93:0/4280262867 >> v1:172.21.15.125:6789/0 conn(0x7fa8280b0910 legacy=0x7fa82815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.290+0000 7fa82da7c640 1 -- 172.21.15.93:0/4280262867 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280b43f0 con 0x7fa828159c70 2023-11-04T01:38:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.290+0000 7fa82d27b640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 0x7fa8280b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82da7c640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828159c70 0x7fa8280ce370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa824009d90 tx=0x7fa82402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a30be6ee38c3261 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82ca7a640 1 -- 172.21.15.93:0/4280262867 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402cc50 con 0x7fa828159c70 2023-11-04T01:38:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82ca7a640 1 -- 172.21.15.93:0/4280262867 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82402cdb0 con 0x7fa828159c70 2023-11-04T01:38:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82ca7a640 1 -- 172.21.15.93:0/4280262867 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824034660 con 0x7fa828159c70 2023-11-04T01:38:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 -- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828159c70 msgr2=0x7fa8280ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828159c70 0x7fa8280ce370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa824009d90 tx=0x7fa82402bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 -- 172.21.15.93:0/4280262867 shutdown_connections 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa82806db20 0x7fa8280b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 --2- 172.21.15.93:0/4280262867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa828159c70 0x7fa8280ce370 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 -- 172.21.15.93:0/4280262867 >> 172.21.15.93:0/4280262867 conn(0x7fa8280ce950 msgr2=0x7fa8280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 -- 172.21.15.93:0/4280262867 shutdown_connections 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.291+0000 7fa82fce0640 1 -- 172.21.15.93:0/4280262867 wait complete. 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 Processor -- start 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 -- start start 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa82806db20 0x7fa82815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280b0910 0x7fa82814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814edf0 con 0x7fa828159c70 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814f0d0 con 0x7fa82806db20 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82fce0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814f3b0 con 0x7fa8280b0910 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82e27d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82e27d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38788/0 (socket says 172.21.15.93:38788) 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82e27d640 1 -- 172.21.15.93:0/1308432800 learned_addr learned my addr 172.21.15.93:0/1308432800 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.293+0000 7fa82da7c640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa82806db20 0x7fa82815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82d27b640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280b0910 0x7fa82814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 -- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280b0910 msgr2=0x7fa82814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280b0910 0x7fa82814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 -- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa82806db20 msgr2=0x7fa82815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa82806db20 0x7fa82815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 -- 172.21.15.93:0/1308432800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009400 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82e27d640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c420 tx=0x7fa82000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820005ce0 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820005e40 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824009a70 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200072d0 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.294+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82815a3d0 con 0x7fa828159c70 2023-11-04T01:38:46.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.295+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa828074290 con 0x7fa828159c70 2023-11-04T01:38:46.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.296+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa820007430 con 0x7fa828159c70 2023-11-04T01:38:46.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.296+0000 7fa81e7fc640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 0x7fa80c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.296+0000 7fa82da7c640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 0x7fa80c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.296+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa820088f10 con 0x7fa828159c70 2023-11-04T01:38:46.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.296+0000 7fa82da7c640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 0x7fa80c06d360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa824036000 tx=0x7fa824030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.300+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa820053b90 con 0x7fa828159c70 2023-11-04T01:38:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.501+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa82806d3f0 con 0x7fa828159c70 2023-11-04T01:38:46.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.502+0000 7fa81e7fc640 1 -- 172.21.15.93:0/1308432800 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fa820017020 con 0x7fa828159c70 2023-11-04T01:38:46.504 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:46.504 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:45.502966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:46.504 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 36 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 msgr2=0x7fa80c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 0x7fa80c06d360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa824036000 tx=0x7fa824030000 comp rx=0 tx=0).stop 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 msgr2=0x7fa82815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c420 tx=0x7fa82000c8e0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 shutdown_connections 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa80c06aea0 0x7fa80c06d360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa828159c70 0x7fa82815a8f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa8280b0910 0x7fa82814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 --2- 172.21.15.93:0/1308432800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa82806db20 0x7fa82815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.503+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 >> 172.21.15.93:0/1308432800 conn(0x7fa8280ce950 msgr2=0x7fa8280cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.504+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 shutdown_connections 2023-11-04T01:38:46.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.504+0000 7fa82fce0640 1 -- 172.21.15.93:0/1308432800 wait complete. 2023-11-04T01:38:46.517 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:46.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.614+0000 7f74d800e640 1 Processor -- start 2023-11-04T01:38:46.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.614+0000 7f74d800e640 1 -- start start 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d800e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f74d006a1b0 0x7f74d006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d800e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74d00c9a40 0x7f74d00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d800e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d006cf60 con 0x7f74d015ad80 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d800e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00ca430 con 0x7f74d00c9a40 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d800e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d015b160 con 0x7f74d006a1b0 2023-11-04T01:38:46.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d65ab640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74d00c9a40 0x7f74d00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d5daa640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f74d015ad80 0x7f74d00abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49850/0 (socket says 172.21.15.93:49850) 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d5daa640 1 -- 172.21.15.93:0/2209180247 learned_addr learned my addr 172.21.15.93:0/2209180247 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d55a9640 1 --2- 172.21.15.93:0/2209180247 >> v2:172.21.15.125:3300/0 conn(0x7f74d006a1b0 0x7f74d006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d65ab640 1 -- 172.21.15.93:0/2209180247 >> v2:172.21.15.125:3300/0 conn(0x7f74d006a1b0 msgr2=0x7f74d006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d65ab640 1 --2- 172.21.15.93:0/2209180247 >> v2:172.21.15.125:3300/0 conn(0x7f74d006a1b0 0x7f74d006b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d65ab640 1 -- 172.21.15.93:0/2209180247 >> v1:172.21.15.93:6789/0 conn(0x7f74d015ad80 legacy=0x7f74d00abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d4da8640 1 -- 172.21.15.93:0/2209180247 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742783582 0 0) 0x7f74d006cf60 con 0x7f74d015ad80 2023-11-04T01:38:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.615+0000 7f74d65ab640 1 -- 172.21.15.93:0/2209180247 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d006b9b0 con 0x7f74d00c9a40 2023-11-04T01:38:46.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d65ab640 1 --2- 172.21.15.93:0/2209180247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c9ef0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f74d00b1b70 tx=0x7f74c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f26104f7bc36f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d4da8640 1 -- 172.21.15.93:0/2209180247 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c802cc80 con 0x7f74d00c9a40 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d4da8640 1 -- 172.21.15.93:0/2209180247 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c802cde0 con 0x7f74d00c9a40 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d4da8640 1 -- 172.21.15.93:0/2209180247 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8034660 con 0x7f74d00c9a40 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 -- 172.21.15.93:0/2209180247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 msgr2=0x7f74d00c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 --2- 172.21.15.93:0/2209180247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c9ef0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f74d00b1b70 tx=0x7f74c802bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 -- 172.21.15.93:0/2209180247 shutdown_connections 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 --2- 172.21.15.93:0/2209180247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c9ef0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 --2- 172.21.15.93:0/2209180247 >> v2:172.21.15.125:3300/0 conn(0x7f74d006a1b0 0x7f74d006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 -- 172.21.15.93:0/2209180247 >> 172.21.15.93:0/2209180247 conn(0x7f74d00b0cd0 msgr2=0x7f74d00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.616+0000 7f74d800e640 1 -- 172.21.15.93:0/2209180247 shutdown_connections 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.617+0000 7f74d800e640 1 -- 172.21.15.93:0/2209180247 wait complete. 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 Processor -- start 2023-11-04T01:38:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 -- start start 2023-11-04T01:38:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74d006a1b0 0x7f74d00c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74d015ad80 0x7f74d0153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00c6670 con 0x7f74d00c9a40 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00ce880 con 0x7f74d006a1b0 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d800e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00ce2c0 con 0x7f74d015ad80 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d55a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d55a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38796/0 (socket says 172.21.15.93:38796) 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.618+0000 7f74d55a9640 1 -- 172.21.15.93:0/3839069737 learned_addr learned my addr 172.21.15.93:0/3839069737 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 -- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74d015ad80 msgr2=0x7f74d0153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74d015ad80 0x7f74d0153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 -- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74d006a1b0 msgr2=0x7f74d00c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d5daa640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74d006a1b0 0x7f74d00c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74d006a1b0 0x7f74d00c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 -- 172.21.15.93:0/3839069737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009a70 con 0x7f74d00c9a40 2023-11-04T01:38:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d55a9640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00c7f0 tx=0x7f74cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004220 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc004380 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc007840 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d00ce5a0 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.619+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d00c3090 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.620+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d00c3280 con 0x7f74d00c9a40 2023-11-04T01:38:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.620+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74cc007bb0 con 0x7f74d00c9a40 2023-11-04T01:38:46.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.621+0000 7f74c67fc640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 0x7f74b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.621+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f74cc089b30 con 0x7f74d00c9a40 2023-11-04T01:38:46.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.621+0000 7f74d5daa640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 0x7f74b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.621+0000 7f74d5daa640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 0x7f74b406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f74c0000f60 tx=0x7f74c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.625+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74cc054670 con 0x7f74d00c9a40 2023-11-04T01:38:46.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.793+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74d0074290 con 0x7f74d00c9a40 2023-11-04T01:38:46.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.795+0000 7f74c67fc640 1 -- 172.21.15.93:0/3839069737 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+21965 (secure 0 0 0) 0x7f74cc007e60 con 0x7f74d00c9a40 2023-11-04T01:38:46.797 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:46.797 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:45.166816+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 msgr2=0x7f74b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 0x7f74b406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f74c0000f60 tx=0x7f74c0009040 comp rx=0 tx=0).stop 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 msgr2=0x7f74d00c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00c7f0 tx=0x7f74cc00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 shutdown_connections 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74b406ae70 0x7f74b406d330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74d015ad80 0x7f74d0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74d00c9a40 0x7f74d00c7f80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 --2- 172.21.15.93:0/3839069737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74d006a1b0 0x7f74d00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 >> 172.21.15.93:0/3839069737 conn(0x7f74d00b0cd0 msgr2=0x7f74d00aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 shutdown_connections 2023-11-04T01:38:46.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.797+0000 7f74d800e640 1 -- 172.21.15.93:0/3839069737 wait complete. 2023-11-04T01:38:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:38:46.810 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.907+0000 7f81e3e32640 1 Processor -- start 2023-11-04T01:38:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.907+0000 7f81e3e32640 1 -- start start 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e3e32640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f81dc0c9fd0 0x7f81dc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e3e32640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0ca7a0 con 0x7f81dc15aa60 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e3e32640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc06ab30 con 0x7f81dc06db70 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e3e32640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc06ae10 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e13cd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f81dc0c9fd0 0x7f81dc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e1bce640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f81dc15aa60 0x7f81dc0c98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49852/0 (socket says 172.21.15.93:49852) 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.908+0000 7f81e1bce640 1 -- 172.21.15.93:0/3555366835 learned_addr learned my addr 172.21.15.93:0/3555366835 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e13cd640 1 -- 172.21.15.93:0/3555366835 >> v1:172.21.15.125:6789/0 conn(0x7f81dc06db70 legacy=0x7f81dc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e13cd640 1 -- 172.21.15.93:0/3555366835 >> v1:172.21.15.93:6789/0 conn(0x7f81dc15aa60 legacy=0x7f81dc0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e13cd640 1 -- 172.21.15.93:0/3555366835 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc06b0f0 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e0bcc640 1 -- 172.21.15.93:0/3555366835 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600872615 0 0) 0x7f81dc0ca7a0 con 0x7f81dc15aa60 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e13cd640 1 --2- 172.21.15.93:0/3555366835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc06e220 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097a0 tx=0x7f81cc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608ca5e2618c449b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e0bcc640 1 -- 172.21.15.93:0/3555366835 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc030610 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.909+0000 7f81e0bcc640 1 -- 172.21.15.93:0/3555366835 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc030770 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e0bcc640 1 -- 172.21.15.93:0/3555366835 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc030b00 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 -- 172.21.15.93:0/3555366835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc0c9fd0 msgr2=0x7f81dc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3555366835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc06e220 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097a0 tx=0x7f81cc02b960 comp rx=0 tx=0).stop 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 -- 172.21.15.93:0/3555366835 shutdown_connections 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3555366835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc06e220 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 -- 172.21.15.93:0/3555366835 >> 172.21.15.93:0/3555366835 conn(0x7f81dc06cef0 msgr2=0x7f81dc06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 -- 172.21.15.93:0/3555366835 shutdown_connections 2023-11-04T01:38:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.910+0000 7f81e3e32640 1 -- 172.21.15.93:0/3555366835 wait complete. 2023-11-04T01:38:46.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.911+0000 7f81e3e32640 1 Processor -- start 2023-11-04T01:38:46.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.911+0000 7f81e3e32640 1 -- start start 2023-11-04T01:38:46.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81dc15aa60 0x7f81dc0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0aea00 con 0x7f81dc06db70 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc145710 con 0x7f81dc0c9fd0 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e3e32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc1459f0 con 0x7f81dc15aa60 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38824/0 (socket says 172.21.15.93:38824) 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 -- 172.21.15.93:0/3304394780 learned_addr learned my addr 172.21.15.93:0/3304394780 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e13cd640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 -- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81dc15aa60 msgr2=0x7f81dc0c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81dc15aa60 0x7f81dc0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 -- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81dc0c9fd0 msgr2=0x7f81dc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.912+0000 7f81e1bce640 1 -- 172.21.15.93:0/3304394780 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc009400 con 0x7f81dc06db70 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81e1bce640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c7c0 tx=0x7f81d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800a640 con 0x7f81dc06db70 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800a7c0 con 0x7f81dc06db70 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc145cd0 con 0x7f81dc06db70 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800ab70 con 0x7f81dc06db70 2023-11-04T01:38:46.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.913+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc156bb0 con 0x7f81dc06db70 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.914+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc074290 con 0x7f81dc06db70 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.914+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81d800acd0 con 0x7f81dc06db70 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.914+0000 7f81d27fc640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 0x7f81c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.915+0000 7f81e13cd640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 0x7f81c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.915+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f81d80890d0 con 0x7f81dc06db70 2023-11-04T01:38:46.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.915+0000 7f81e13cd640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 0x7f81c006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f81cc036000 tx=0x7f81cc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:46.919+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81d8053ca0 con 0x7f81dc06db70 2023-11-04T01:38:47.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.085+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81dc06b6b0 con 0x7f81c006ae70 2023-11-04T01:38:47.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.098+0000 7f81d27fc640 1 -- 172.21.15.93:0/3304394780 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532203 (secure 0 0 0) 0x7f81cc030410 con 0x7f81c006ae70 2023-11-04T01:38:47.105 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:47.109 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:38:47.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 msgr2=0x7f81c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 0x7f81c006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f81cc036000 tx=0x7f81cc03b040 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 msgr2=0x7f81dc0ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c7c0 tx=0x7f81d800cc80 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 shutdown_connections 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81c006ae70 0x7f81c006d330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81dc15aa60 0x7f81dc0c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81dc0c9fd0 0x7f81dc0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 --2- 172.21.15.93:0/3304394780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81dc06db70 0x7f81dc0ae4c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 >> 172.21.15.93:0/3304394780 conn(0x7f81dc06cef0 msgr2=0x7f81dc0713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 shutdown_connections 2023-11-04T01:38:47.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.102+0000 7f81e3e32640 1 -- 172.21.15.93:0/3304394780 wait complete. 2023-11-04T01:38:47.117 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-11-04T01:38:45.362545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229156,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754745564,"statfs":{"total":773094113280,"available":772859457536,"internally_reserved":0,"allocated":9039872,"data_stored":4965156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000929"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192328+0000","last_change":"2023-11-04T01:38:44.184278+0000","last_active":"2023-11-04T01:38:44.192328+0000","last_peered":"2023-11-04T01:38:44.192328+0000","last_clean":"2023-11-04T01:38:44.192328+0000","last_became_active":"2023-11-04T01:38:44.183373+0000","last_became_peered":"2023-11-04T01:38:44.183373+0000","last_unstale":"2023-11-04T01:38:44.192328+0000","last_undegraded":"2023-11-04T01:38:44.192328+0000","last_fullsized":"2023-11-04T01:38:44.192328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:11.000661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186735+0000","last_change":"2023-11-04T01:38:44.181495+0000","last_active":"2023-11-04T01:38:44.186735+0000","last_peered":"2023-11-04T01:38:44.186735+0000","last_clean":"2023-11-04T01:38:44.186735+0000","last_became_active":"2023-11-04T01:38:44.180705+0000","last_became_peered":"2023-11-04T01:38:44.180705+0000","last_unstale":"2023-11-04T01:38:44.186735+0000","last_undegraded":"2023-11-04T01:38:44.186735+0000","last_fullsized":"2023-11-04T01:38:44.186735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:41.091836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192190+0000","last_change":"2023-11-04T01:38:44.183012+0000","last_active":"2023-11-04T01:38:44.192190+0000","last_peered":"2023-11-04T01:38:44.192190+0000","last_clean":"2023-11-04T01:38:44.192190+0000","last_became_active":"2023-11-04T01:38:44.182705+0000","last_became_peered":"2023-11-04T01:38:44.182705+0000","last_unstale":"2023-11-04T01:38:44.192190+0000","last_undegraded":"2023-11-04T01:38:44.192190+0000","last_fullsized":"2023-11-04T01:38:44.192190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:43.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189398+0000","last_change":"2023-11-04T01:38:44.184507+0000","last_active":"2023-11-04T01:38:44.189398+0000","last_peered":"2023-11-04T01:38:44.189398+0000","last_clean":"2023-11-04T01:38:44.189398+0000","last_became_active":"2023-11-04T01:38:44.184212+0000","last_became_peered":"2023-11-04T01:38:44.184212+0000","last_unstale":"2023-11-04T01:38:44.189398+0000","last_undegraded":"2023-11-04T01:38:44.189398+0000","last_fullsized":"2023-11-04T01:38:44.189398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:28.740971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189682+0000","last_change":"2023-11-04T01:38:44.180922+0000","last_active":"2023-11-04T01:38:44.189682+0000","last_peered":"2023-11-04T01:38:44.189682+0000","last_clean":"2023-11-04T01:38:44.189682+0000","last_became_active":"2023-11-04T01:38:44.180657+0000","last_became_peered":"2023-11-04T01:38:44.180657+0000","last_unstale":"2023-11-04T01:38:44.189682+0000","last_undegraded":"2023-11-04T01:38:44.189682+0000","last_fullsized":"2023-11-04T01:38:44.189682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:11.359483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192071+0000","last_change":"2023-11-04T01:38:44.187350+0000","last_active":"2023-11-04T01:38:44.192071+0000","last_peered":"2023-11-04T01:38:44.192071+0000","last_clean":"2023-11-04T01:38:44.192071+0000","last_became_active":"2023-11-04T01:38:44.187071+0000","last_became_peered":"2023-11-04T01:38:44.187071+0000","last_unstale":"2023-11-04T01:38:44.192071+0000","last_undegraded":"2023-11-04T01:38:44.192071+0000","last_fullsized":"2023-11-04T01:38:44.192071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:31.652186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192054+0000","last_change":"2023-11-04T01:38:44.187495+0000","last_active":"2023-11-04T01:38:44.192054+0000","last_peered":"2023-11-04T01:38:44.192054+0000","last_clean":"2023-11-04T01:38:44.192054+0000","last_became_active":"2023-11-04T01:38:44.187208+0000","last_became_peered":"2023-11-04T01:38:44.187208+0000","last_unstale":"2023-11-04T01:38:44.192054+0000","last_undegraded":"2023-11-04T01:38:44.192054+0000","last_fullsized":"2023-11-04T01:38:44.192054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:57.689599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187203+0000","last_change":"2023-11-04T01:38:44.182567+0000","last_active":"2023-11-04T01:38:44.187203+0000","last_peered":"2023-11-04T01:38:44.187203+0000","last_clean":"2023-11-04T01:38:44.187203+0000","last_became_active":"2023-11-04T01:38:44.182312+0000","last_became_peered":"2023-11-04T01:38:44.182312+0000","last_unstale":"2023-11-04T01:38:44.187203+0000","last_undegraded":"2023-11-04T01:38:44.187203+0000","last_fullsized":"2023-11-04T01:38:44.187203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:28.740971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188714+0000","last_change":"2023-11-04T01:38:44.178763+0000","last_active":"2023-11-04T01:38:44.188714+0000","last_peered":"2023-11-04T01:38:44.188714+0000","last_clean":"2023-11-04T01:38:44.188714+0000","last_became_active":"2023-11-04T01:38:44.178474+0000","last_became_peered":"2023-11-04T01:38:44.178474+0000","last_unstale":"2023-11-04T01:38:44.188714+0000","last_undegraded":"2023-11-04T01:38:44.188714+0000","last_fullsized":"2023-11-04T01:38:44.188714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:11.359483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189414+0000","last_change":"2023-11-04T01:38:44.182626+0000","last_active":"2023-11-04T01:38:44.189414+0000","last_peered":"2023-11-04T01:38:44.189414+0000","last_clean":"2023-11-04T01:38:44.189414+0000","last_became_active":"2023-11-04T01:38:44.181286+0000","last_became_peered":"2023-11-04T01:38:44.181286+0000","last_unstale":"2023-11-04T01:38:44.189414+0000","last_undegraded":"2023-11-04T01:38:44.189414+0000","last_fullsized":"2023-11-04T01:38:44.189414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:32.097650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186708+0000","last_change":"2023-11-04T01:38:44.179447+0000","last_active":"2023-11-04T01:38:44.186708+0000","last_peered":"2023-11-04T01:38:44.186708+0000","last_clean":"2023-11-04T01:38:44.186708+0000","last_became_active":"2023-11-04T01:38:44.179199+0000","last_became_peered":"2023-11-04T01:38:44.179199+0000","last_unstale":"2023-11-04T01:38:44.186708+0000","last_undegraded":"2023-11-04T01:38:44.186708+0000","last_fullsized":"2023-11-04T01:38:44.186708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:46.314385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.175655+0000","last_change":"2023-11-04T01:38:44.168544+0000","last_active":"2023-11-04T01:38:44.175655+0000","last_peered":"2023-11-04T01:38:44.175655+0000","last_clean":"2023-11-04T01:38:44.175655+0000","last_became_active":"2023-11-04T01:38:44.168302+0000","last_became_peered":"2023-11-04T01:38:44.168302+0000","last_unstale":"2023-11-04T01:38:44.175655+0000","last_undegraded":"2023-11-04T01:38:44.175655+0000","last_fullsized":"2023-11-04T01:38:44.175655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:39.738471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182273+0000","last_change":"2023-11-04T01:38:44.179516+0000","last_active":"2023-11-04T01:38:44.182273+0000","last_peered":"2023-11-04T01:38:44.182273+0000","last_clean":"2023-11-04T01:38:44.182273+0000","last_became_active":"2023-11-04T01:38:44.179245+0000","last_became_peered":"2023-11-04T01:38:44.179245+0000","last_unstale":"2023-11-04T01:38:44.182273+0000","last_undegraded":"2023-11-04T01:38:44.182273+0000","last_fullsized":"2023-11-04T01:38:44.182273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:58.457869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194773+0000","last_change":"2023-11-04T01:38:44.190224+0000","last_active":"2023-11-04T01:38:44.194773+0000","last_peered":"2023-11-04T01:38:44.194773+0000","last_clean":"2023-11-04T01:38:44.194773+0000","last_became_active":"2023-11-04T01:38:44.189957+0000","last_became_peered":"2023-11-04T01:38:44.189957+0000","last_unstale":"2023-11-04T01:38:44.194773+0000","last_undegraded":"2023-11-04T01:38:44.194773+0000","last_fullsized":"2023-11-04T01:38:44.194773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:44:13.795744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182323+0000","last_change":"2023-11-04T01:38:44.180629+0000","last_active":"2023-11-04T01:38:44.182323+0000","last_peered":"2023-11-04T01:38:44.182323+0000","last_clean":"2023-11-04T01:38:44.182323+0000","last_became_active":"2023-11-04T01:38:44.180332+0000","last_became_peered":"2023-11-04T01:38:44.180332+0000","last_unstale":"2023-11-04T01:38:44.182323+0000","last_undegraded":"2023-11-04T01:38:44.182323+0000","last_fullsized":"2023-11-04T01:38:44.182323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:36.888737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.191844+0000","last_change":"2023-11-04T01:38:44.186716+0000","last_active":"2023-11-04T01:38:44.191844+0000","last_peered":"2023-11-04T01:38:44.191844+0000","last_clean":"2023-11-04T01:38:44.191844+0000","last_became_active":"2023-11-04T01:38:44.186377+0000","last_became_peered":"2023-11-04T01:38:44.186377+0000","last_unstale":"2023-11-04T01:38:44.191844+0000","last_undegraded":"2023-11-04T01:38:44.191844+0000","last_fullsized":"2023-11-04T01:38:44.191844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:16.196865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187918+0000","last_change":"2023-11-04T01:38:44.186795+0000","last_active":"2023-11-04T01:38:44.187918+0000","last_peered":"2023-11-04T01:38:44.187918+0000","last_clean":"2023-11-04T01:38:44.187918+0000","last_became_active":"2023-11-04T01:38:44.184943+0000","last_became_peered":"2023-11-04T01:38:44.184943+0000","last_unstale":"2023-11-04T01:38:44.187918+0000","last_undegraded":"2023-11-04T01:38:44.187918+0000","last_fullsized":"2023-11-04T01:38:44.187918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:49.217495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184330+0000","last_change":"2023-11-04T01:38:44.182773+0000","last_active":"2023-11-04T01:38:44.184330+0000","last_peered":"2023-11-04T01:38:44.184330+0000","last_clean":"2023-11-04T01:38:44.184330+0000","last_became_active":"2023-11-04T01:38:44.182517+0000","last_became_peered":"2023-11-04T01:38:44.182517+0000","last_unstale":"2023-11-04T01:38:44.184330+0000","last_undegraded":"2023-11-04T01:38:44.184330+0000","last_fullsized":"2023-11-04T01:38:44.184330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:12.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183921+0000","last_change":"2023-11-04T01:38:44.178614+0000","last_active":"2023-11-04T01:38:44.183921+0000","last_peered":"2023-11-04T01:38:44.183921+0000","last_clean":"2023-11-04T01:38:44.183921+0000","last_became_active":"2023-11-04T01:38:44.178314+0000","last_became_peered":"2023-11-04T01:38:44.178314+0000","last_unstale":"2023-11-04T01:38:44.183921+0000","last_undegraded":"2023-11-04T01:38:44.183921+0000","last_fullsized":"2023-11-04T01:38:44.183921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:24.377625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188707+0000","last_change":"2023-11-04T01:38:44.178963+0000","last_active":"2023-11-04T01:38:44.188707+0000","last_peered":"2023-11-04T01:38:44.188707+0000","last_clean":"2023-11-04T01:38:44.188707+0000","last_became_active":"2023-11-04T01:38:44.178682+0000","last_became_peered":"2023-11-04T01:38:44.178682+0000","last_unstale":"2023-11-04T01:38:44.188707+0000","last_undegraded":"2023-11-04T01:38:44.188707+0000","last_fullsized":"2023-11-04T01:38:44.188707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:04.527571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184773+0000","last_change":"2023-11-04T01:38:44.181958+0000","last_active":"2023-11-04T01:38:44.184773+0000","last_peered":"2023-11-04T01:38:44.184773+0000","last_clean":"2023-11-04T01:38:44.184773+0000","last_became_active":"2023-11-04T01:38:44.181709+0000","last_became_peered":"2023-11-04T01:38:44.181709+0000","last_unstale":"2023-11-04T01:38:44.184773+0000","last_undegraded":"2023-11-04T01:38:44.184773+0000","last_fullsized":"2023-11-04T01:38:44.184773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:54.007155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186199+0000","last_change":"2023-11-04T01:38:44.178830+0000","last_active":"2023-11-04T01:38:44.186199+0000","last_peered":"2023-11-04T01:38:44.186199+0000","last_clean":"2023-11-04T01:38:44.186199+0000","last_became_active":"2023-11-04T01:38:44.178579+0000","last_became_peered":"2023-11-04T01:38:44.178579+0000","last_unstale":"2023-11-04T01:38:44.186199+0000","last_undegraded":"2023-11-04T01:38:44.186199+0000","last_fullsized":"2023-11-04T01:38:44.186199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:28.863609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187480+0000","last_change":"2023-11-04T01:38:44.181392+0000","last_active":"2023-11-04T01:38:44.187480+0000","last_peered":"2023-11-04T01:38:44.187480+0000","last_clean":"2023-11-04T01:38:44.187480+0000","last_became_active":"2023-11-04T01:38:44.180425+0000","last_became_peered":"2023-11-04T01:38:44.180425+0000","last_unstale":"2023-11-04T01:38:44.187480+0000","last_undegraded":"2023-11-04T01:38:44.187480+0000","last_fullsized":"2023-11-04T01:38:44.187480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:56.720079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189171+0000","last_change":"2023-11-04T01:38:44.185402+0000","last_active":"2023-11-04T01:38:44.189171+0000","last_peered":"2023-11-04T01:38:44.189171+0000","last_clean":"2023-11-04T01:38:44.189171+0000","last_became_active":"2023-11-04T01:38:44.185129+0000","last_became_peered":"2023-11-04T01:38:44.185129+0000","last_unstale":"2023-11-04T01:38:44.189171+0000","last_undegraded":"2023-11-04T01:38:44.189171+0000","last_fullsized":"2023-11-04T01:38:44.189171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:24.718401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194766+0000","last_change":"2023-11-04T01:38:44.191096+0000","last_active":"2023-11-04T01:38:44.194766+0000","last_peered":"2023-11-04T01:38:44.194766+0000","last_clean":"2023-11-04T01:38:44.194766+0000","last_became_active":"2023-11-04T01:38:44.190495+0000","last_became_peered":"2023-11-04T01:38:44.190495+0000","last_unstale":"2023-11-04T01:38:44.194766+0000","last_undegraded":"2023-11-04T01:38:44.194766+0000","last_fullsized":"2023-11-04T01:38:44.194766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:36.178146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187938+0000","last_change":"2023-11-04T01:38:44.187065+0000","last_active":"2023-11-04T01:38:44.187938+0000","last_peered":"2023-11-04T01:38:44.187938+0000","last_clean":"2023-11-04T01:38:44.187938+0000","last_became_active":"2023-11-04T01:38:44.186807+0000","last_became_peered":"2023-11-04T01:38:44.186807+0000","last_unstale":"2023-11-04T01:38:44.187938+0000","last_undegraded":"2023-11-04T01:38:44.187938+0000","last_fullsized":"2023-11-04T01:38:44.187938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:58.457869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189033+0000","last_change":"2023-11-04T01:38:44.184809+0000","last_active":"2023-11-04T01:38:44.189033+0000","last_peered":"2023-11-04T01:38:44.189033+0000","last_clean":"2023-11-04T01:38:44.189033+0000","last_became_active":"2023-11-04T01:38:44.184535+0000","last_became_peered":"2023-11-04T01:38:44.184535+0000","last_unstale":"2023-11-04T01:38:44.189033+0000","last_undegraded":"2023-11-04T01:38:44.189033+0000","last_fullsized":"2023-11-04T01:38:44.189033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:32.157525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194699+0000","last_change":"2023-11-04T01:38:44.190338+0000","last_active":"2023-11-04T01:38:44.194699+0000","last_peered":"2023-11-04T01:38:44.194699+0000","last_clean":"2023-11-04T01:38:44.194699+0000","last_became_active":"2023-11-04T01:38:44.189800+0000","last_became_peered":"2023-11-04T01:38:44.189800+0000","last_unstale":"2023-11-04T01:38:44.194699+0000","last_undegraded":"2023-11-04T01:38:44.194699+0000","last_fullsized":"2023-11-04T01:38:44.194699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189046+0000","last_change":"2023-11-04T01:38:44.187676+0000","last_active":"2023-11-04T01:38:44.189046+0000","last_peered":"2023-11-04T01:38:44.189046+0000","last_clean":"2023-11-04T01:38:44.189046+0000","last_became_active":"2023-11-04T01:38:44.187405+0000","last_became_peered":"2023-11-04T01:38:44.187405+0000","last_unstale":"2023-11-04T01:38:44.189046+0000","last_undegraded":"2023-11-04T01:38:44.189046+0000","last_fullsized":"2023-11-04T01:38:44.189046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:35.470620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183601+0000","last_change":"2023-11-04T01:38:44.178290+0000","last_active":"2023-11-04T01:38:44.183601+0000","last_peered":"2023-11-04T01:38:44.183601+0000","last_clean":"2023-11-04T01:38:44.183601+0000","last_became_active":"2023-11-04T01:38:44.177902+0000","last_became_peered":"2023-11-04T01:38:44.177902+0000","last_unstale":"2023-11-04T01:38:44.183601+0000","last_undegraded":"2023-11-04T01:38:44.183601+0000","last_fullsized":"2023-11-04T01:38:44.183601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:12.912824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194757+0000","last_change":"2023-11-04T01:38:44.191451+0000","last_active":"2023-11-04T01:38:44.194757+0000","last_peered":"2023-11-04T01:38:44.194757+0000","last_clean":"2023-11-04T01:38:44.194757+0000","last_became_active":"2023-11-04T01:38:44.191130+0000","last_became_peered":"2023-11-04T01:38:44.191130+0000","last_unstale":"2023-11-04T01:38:44.194757+0000","last_undegraded":"2023-11-04T01:38:44.194757+0000","last_fullsized":"2023-11-04T01:38:44.194757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:35.470620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178781+0000","last_change":"2023-11-04T01:38:44.173929+0000","last_active":"2023-11-04T01:38:44.178781+0000","last_peered":"2023-11-04T01:38:44.178781+0000","last_clean":"2023-11-04T01:38:44.178781+0000","last_became_active":"2023-11-04T01:38:44.173698+0000","last_became_peered":"2023-11-04T01:38:44.173698+0000","last_unstale":"2023-11-04T01:38:44.178781+0000","last_undegraded":"2023-11-04T01:38:44.178781+0000","last_fullsized":"2023-11-04T01:38:44.178781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:37.924463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192088+0000","last_change":"2023-11-04T01:38:44.188018+0000","last_active":"2023-11-04T01:38:44.192088+0000","last_peered":"2023-11-04T01:38:44.192088+0000","last_clean":"2023-11-04T01:38:44.192088+0000","last_became_active":"2023-11-04T01:38:44.187731+0000","last_became_peered":"2023-11-04T01:38:44.187731+0000","last_unstale":"2023-11-04T01:38:44.192088+0000","last_undegraded":"2023-11-04T01:38:44.192088+0000","last_fullsized":"2023-11-04T01:38:44.192088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:08.443797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"81'6","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.197047+0000","last_change":"2023-11-04T01:38:43.165254+0000","last_active":"2023-11-04T01:38:44.197047+0000","last_peered":"2023-11-04T01:38:44.197047+0000","last_clean":"2023-11-04T01:38:44.197047+0000","last_became_active":"2023-11-04T01:38:43.164965+0000","last_became_peered":"2023-11-04T01:38:43.164965+0000","last_unstale":"2023-11-04T01:38:44.197047+0000","last_undegraded":"2023-11-04T01:38:44.197047+0000","last_fullsized":"2023-11-04T01:38:44.197047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163931+0000","last_change":"2023-11-04T01:38:22.072453+0000","last_active":"2023-11-04T01:38:43.163931+0000","last_peered":"2023-11-04T01:38:43.163931+0000","last_clean":"2023-11-04T01:38:43.163931+0000","last_became_active":"2023-11-04T01:38:22.071910+0000","last_became_peered":"2023-11-04T01:38:22.071910+0000","last_unstale":"2023-11-04T01:38:43.163931+0000","last_undegraded":"2023-11-04T01:38:43.163931+0000","last_fullsized":"2023-11-04T01:38:43.163931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164988+0000","last_change":"2023-11-04T01:38:23.405090+0000","last_active":"2023-11-04T01:38:43.164988+0000","last_peered":"2023-11-04T01:38:43.164988+0000","last_clean":"2023-11-04T01:38:43.164988+0000","last_became_active":"2023-11-04T01:38:21.069416+0000","last_became_peered":"2023-11-04T01:38:21.069416+0000","last_unstale":"2023-11-04T01:38:43.164988+0000","last_undegraded":"2023-11-04T01:38:43.164988+0000","last_fullsized":"2023-11-04T01:38:43.164988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:08.663648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078635399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150168+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:38:43.150168+0000","last_peered":"2023-11-04T01:38:43.150168+0000","last_clean":"2023-11-04T01:38:43.150168+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:38:43.150168+0000","last_undegraded":"2023-11-04T01:38:43.150168+0000","last_fullsized":"2023-11-04T01:38:43.150168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194720+0000","last_change":"2023-11-04T01:38:44.190637+0000","last_active":"2023-11-04T01:38:44.194720+0000","last_peered":"2023-11-04T01:38:44.194720+0000","last_clean":"2023-11-04T01:38:44.194720+0000","last_became_active":"2023-11-04T01:38:44.189868+0000","last_became_peered":"2023-11-04T01:38:44.189868+0000","last_unstale":"2023-11-04T01:38:44.194720+0000","last_undegraded":"2023-11-04T01:38:44.194720+0000","last_fullsized":"2023-11-04T01:38:44.194720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:04.527571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"81'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189247+0000","last_change":"2023-11-04T01:38:43.167599+0000","last_active":"2023-11-04T01:38:44.189247+0000","last_peered":"2023-11-04T01:38:44.189247+0000","last_clean":"2023-11-04T01:38:44.189247+0000","last_became_active":"2023-11-04T01:38:43.167348+0000","last_became_peered":"2023-11-04T01:38:43.167348+0000","last_unstale":"2023-11-04T01:38:44.189247+0000","last_undegraded":"2023-11-04T01:38:44.189247+0000","last_fullsized":"2023-11-04T01:38:44.189247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:47.431830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162583+0000","last_change":"2023-11-04T01:38:22.076676+0000","last_active":"2023-11-04T01:38:43.162583+0000","last_peered":"2023-11-04T01:38:43.162583+0000","last_clean":"2023-11-04T01:38:43.162583+0000","last_became_active":"2023-11-04T01:38:22.076358+0000","last_became_peered":"2023-11-04T01:38:22.076358+0000","last_unstale":"2023-11-04T01:38:43.162583+0000","last_undegraded":"2023-11-04T01:38:43.162583+0000","last_fullsized":"2023-11-04T01:38:43.162583+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:54.096380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165866+0000","last_change":"2023-11-04T01:38:23.405733+0000","last_active":"2023-11-04T01:38:43.165866+0000","last_peered":"2023-11-04T01:38:43.165866+0000","last_clean":"2023-11-04T01:38:43.165866+0000","last_became_active":"2023-11-04T01:38:21.072619+0000","last_became_peered":"2023-11-04T01:38:21.072619+0000","last_unstale":"2023-11-04T01:38:43.165866+0000","last_undegraded":"2023-11-04T01:38:43.165866+0000","last_fullsized":"2023-11-04T01:38:43.165866+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:43.756589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010857900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163810+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:38:43.163810+0000","last_peered":"2023-11-04T01:38:43.163810+0000","last_clean":"2023-11-04T01:38:43.163810+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:38:43.163810+0000","last_undegraded":"2023-11-04T01:38:43.163810+0000","last_fullsized":"2023-11-04T01:38:43.163810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189018+0000","last_change":"2023-11-04T01:38:44.182624+0000","last_active":"2023-11-04T01:38:44.189018+0000","last_peered":"2023-11-04T01:38:44.189018+0000","last_clean":"2023-11-04T01:38:44.189018+0000","last_became_active":"2023-11-04T01:38:44.181771+0000","last_became_peered":"2023-11-04T01:38:44.181771+0000","last_unstale":"2023-11-04T01:38:44.189018+0000","last_undegraded":"2023-11-04T01:38:44.189018+0000","last_fullsized":"2023-11-04T01:38:44.189018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173356+0000","last_change":"2023-11-04T01:38:43.175290+0000","last_active":"2023-11-04T01:38:44.173356+0000","last_peered":"2023-11-04T01:38:44.173356+0000","last_clean":"2023-11-04T01:38:44.173356+0000","last_became_active":"2023-11-04T01:38:43.175094+0000","last_became_peered":"2023-11-04T01:38:43.175094+0000","last_unstale":"2023-11-04T01:38:44.173356+0000","last_undegraded":"2023-11-04T01:38:44.173356+0000","last_fullsized":"2023-11-04T01:38:44.173356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:17.607307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155880+0000","last_change":"2023-11-04T01:38:22.069819+0000","last_active":"2023-11-04T01:38:43.155880+0000","last_peered":"2023-11-04T01:38:43.155880+0000","last_clean":"2023-11-04T01:38:43.155880+0000","last_became_active":"2023-11-04T01:38:22.068982+0000","last_became_peered":"2023-11-04T01:38:22.068982+0000","last_unstale":"2023-11-04T01:38:43.155880+0000","last_undegraded":"2023-11-04T01:38:43.155880+0000","last_fullsized":"2023-11-04T01:38:43.155880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:16.517766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163631+0000","last_change":"2023-11-04T01:38:23.334735+0000","last_active":"2023-11-04T01:38:43.163631+0000","last_peered":"2023-11-04T01:38:43.163631+0000","last_clean":"2023-11-04T01:38:43.163631+0000","last_became_active":"2023-11-04T01:38:21.067774+0000","last_became_peered":"2023-11-04T01:38:21.067774+0000","last_unstale":"2023-11-04T01:38:43.163631+0000","last_undegraded":"2023-11-04T01:38:43.163631+0000","last_fullsized":"2023-11-04T01:38:43.163631+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:03.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050306999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166147+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:38:43.166147+0000","last_peered":"2023-11-04T01:38:43.166147+0000","last_clean":"2023-11-04T01:38:43.166147+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:38:43.166147+0000","last_undegraded":"2023-11-04T01:38:43.166147+0000","last_fullsized":"2023-11-04T01:38:43.166147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186716+0000","last_change":"2023-11-04T01:38:44.181271+0000","last_active":"2023-11-04T01:38:44.186716+0000","last_peered":"2023-11-04T01:38:44.186716+0000","last_clean":"2023-11-04T01:38:44.186716+0000","last_became_active":"2023-11-04T01:38:44.180349+0000","last_became_peered":"2023-11-04T01:38:44.180349+0000","last_unstale":"2023-11-04T01:38:44.186716+0000","last_undegraded":"2023-11-04T01:38:44.186716+0000","last_fullsized":"2023-11-04T01:38:44.186716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:40.534383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.163751+0000","last_change":"2023-11-04T01:38:43.166756+0000","last_active":"2023-11-04T01:38:44.163751+0000","last_peered":"2023-11-04T01:38:44.163751+0000","last_clean":"2023-11-04T01:38:44.163751+0000","last_became_active":"2023-11-04T01:38:43.165164+0000","last_became_peered":"2023-11-04T01:38:43.165164+0000","last_unstale":"2023-11-04T01:38:44.163751+0000","last_undegraded":"2023-11-04T01:38:44.163751+0000","last_fullsized":"2023-11-04T01:38:44.163751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:05.207241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.157601+0000","last_change":"2023-11-04T01:38:22.069762+0000","last_active":"2023-11-04T01:38:43.157601+0000","last_peered":"2023-11-04T01:38:43.157601+0000","last_clean":"2023-11-04T01:38:43.157601+0000","last_became_active":"2023-11-04T01:38:22.069461+0000","last_became_peered":"2023-11-04T01:38:22.069461+0000","last_unstale":"2023-11-04T01:38:43.157601+0000","last_undegraded":"2023-11-04T01:38:43.157601+0000","last_fullsized":"2023-11-04T01:38:43.157601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:03.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166167+0000","last_change":"2023-11-04T01:38:23.405132+0000","last_active":"2023-11-04T01:38:43.166167+0000","last_peered":"2023-11-04T01:38:43.166167+0000","last_clean":"2023-11-04T01:38:43.166167+0000","last_became_active":"2023-11-04T01:38:21.070339+0000","last_became_peered":"2023-11-04T01:38:21.070339+0000","last_unstale":"2023-11-04T01:38:43.166167+0000","last_undegraded":"2023-11-04T01:38:43.166167+0000","last_fullsized":"2023-11-04T01:38:43.166167+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000921534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149875+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:38:43.149875+0000","last_peered":"2023-11-04T01:38:43.149875+0000","last_clean":"2023-11-04T01:38:43.149875+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:38:43.149875+0000","last_undegraded":"2023-11-04T01:38:43.149875+0000","last_fullsized":"2023-11-04T01:38:43.149875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183324+0000","last_change":"2023-11-04T01:38:44.177263+0000","last_active":"2023-11-04T01:38:44.183324+0000","last_peered":"2023-11-04T01:38:44.183324+0000","last_clean":"2023-11-04T01:38:44.183324+0000","last_became_active":"2023-11-04T01:38:44.177002+0000","last_became_peered":"2023-11-04T01:38:44.177002+0000","last_unstale":"2023-11-04T01:38:44.183324+0000","last_undegraded":"2023-11-04T01:38:44.183324+0000","last_fullsized":"2023-11-04T01:38:44.183324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:22.226361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.195330+0000","last_change":"2023-11-04T01:38:43.166563+0000","last_active":"2023-11-04T01:38:44.195330+0000","last_peered":"2023-11-04T01:38:44.195330+0000","last_clean":"2023-11-04T01:38:44.195330+0000","last_became_active":"2023-11-04T01:38:43.166307+0000","last_became_peered":"2023-11-04T01:38:43.166307+0000","last_unstale":"2023-11-04T01:38:44.195330+0000","last_undegraded":"2023-11-04T01:38:44.195330+0000","last_fullsized":"2023-11-04T01:38:44.195330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.153560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161543+0000","last_change":"2023-11-04T01:38:22.069939+0000","last_active":"2023-11-04T01:38:43.161543+0000","last_peered":"2023-11-04T01:38:43.161543+0000","last_clean":"2023-11-04T01:38:43.161543+0000","last_became_active":"2023-11-04T01:38:22.069690+0000","last_became_peered":"2023-11-04T01:38:22.069690+0000","last_unstale":"2023-11-04T01:38:43.161543+0000","last_undegraded":"2023-11-04T01:38:43.161543+0000","last_fullsized":"2023-11-04T01:38:43.161543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162860+0000","last_change":"2023-11-04T01:38:23.327651+0000","last_active":"2023-11-04T01:38:43.162860+0000","last_peered":"2023-11-04T01:38:43.162860+0000","last_clean":"2023-11-04T01:38:43.162860+0000","last_became_active":"2023-11-04T01:38:21.067028+0000","last_became_peered":"2023-11-04T01:38:21.067028+0000","last_unstale":"2023-11-04T01:38:43.162860+0000","last_undegraded":"2023-11-04T01:38:43.162860+0000","last_fullsized":"2023-11-04T01:38:43.162860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:13.072797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054701200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164523+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:38:43.164523+0000","last_peered":"2023-11-04T01:38:43.164523+0000","last_clean":"2023-11-04T01:38:43.164523+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:38:43.164523+0000","last_undegraded":"2023-11-04T01:38:43.164523+0000","last_fullsized":"2023-11-04T01:38:43.164523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188864+0000","last_change":"2023-11-04T01:38:44.181312+0000","last_active":"2023-11-04T01:38:44.188864+0000","last_peered":"2023-11-04T01:38:44.188864+0000","last_clean":"2023-11-04T01:38:44.188864+0000","last_became_active":"2023-11-04T01:38:44.181034+0000","last_became_peered":"2023-11-04T01:38:44.181034+0000","last_unstale":"2023-11-04T01:38:44.188864+0000","last_undegraded":"2023-11-04T01:38:44.188864+0000","last_fullsized":"2023-11-04T01:38:44.188864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:48.498859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.165020+0000","last_change":"2023-11-04T01:38:43.164494+0000","last_active":"2023-11-04T01:38:44.165020+0000","last_peered":"2023-11-04T01:38:44.165020+0000","last_clean":"2023-11-04T01:38:44.165020+0000","last_became_active":"2023-11-04T01:38:43.164188+0000","last_became_peered":"2023-11-04T01:38:43.164188+0000","last_unstale":"2023-11-04T01:38:44.165020+0000","last_undegraded":"2023-11-04T01:38:44.165020+0000","last_fullsized":"2023-11-04T01:38:44.165020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:15.192547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.153820+0000","last_change":"2023-11-04T01:38:22.066355+0000","last_active":"2023-11-04T01:38:43.153820+0000","last_peered":"2023-11-04T01:38:43.153820+0000","last_clean":"2023-11-04T01:38:43.153820+0000","last_became_active":"2023-11-04T01:38:22.065849+0000","last_became_peered":"2023-11-04T01:38:22.065849+0000","last_unstale":"2023-11-04T01:38:43.153820+0000","last_undegraded":"2023-11-04T01:38:43.153820+0000","last_fullsized":"2023-11-04T01:38:43.153820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149716+0000","last_change":"2023-11-04T01:38:23.358293+0000","last_active":"2023-11-04T01:38:43.149716+0000","last_peered":"2023-11-04T01:38:43.149716+0000","last_clean":"2023-11-04T01:38:43.149716+0000","last_became_active":"2023-11-04T01:38:21.070333+0000","last_became_peered":"2023-11-04T01:38:21.070333+0000","last_unstale":"2023-11-04T01:38:43.149716+0000","last_undegraded":"2023-11-04T01:38:43.149716+0000","last_fullsized":"2023-11-04T01:38:43.149716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:43.144500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059104700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154364+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:38:43.154364+0000","last_peered":"2023-11-04T01:38:43.154364+0000","last_clean":"2023-11-04T01:38:43.154364+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:38:43.154364+0000","last_undegraded":"2023-11-04T01:38:43.154364+0000","last_fullsized":"2023-11-04T01:38:43.154364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178663+0000","last_change":"2023-11-04T01:38:44.175080+0000","last_active":"2023-11-04T01:38:44.178663+0000","last_peered":"2023-11-04T01:38:44.178663+0000","last_clean":"2023-11-04T01:38:44.178663+0000","last_became_active":"2023-11-04T01:38:44.174837+0000","last_became_peered":"2023-11-04T01:38:44.174837+0000","last_unstale":"2023-11-04T01:38:44.178663+0000","last_undegraded":"2023-11-04T01:38:44.178663+0000","last_fullsized":"2023-11-04T01:38:44.178663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:11:06.861938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168148+0000","last_change":"2023-11-04T01:38:43.165054+0000","last_active":"2023-11-04T01:38:44.168148+0000","last_peered":"2023-11-04T01:38:44.168148+0000","last_clean":"2023-11-04T01:38:44.168148+0000","last_became_active":"2023-11-04T01:38:43.164813+0000","last_became_peered":"2023-11-04T01:38:43.164813+0000","last_unstale":"2023-11-04T01:38:44.168148+0000","last_undegraded":"2023-11-04T01:38:44.168148+0000","last_fullsized":"2023-11-04T01:38:44.168148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:57.139324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149527+0000","last_change":"2023-11-04T01:38:22.074795+0000","last_active":"2023-11-04T01:38:43.149527+0000","last_peered":"2023-11-04T01:38:43.149527+0000","last_clean":"2023-11-04T01:38:43.149527+0000","last_became_active":"2023-11-04T01:38:22.074381+0000","last_became_peered":"2023-11-04T01:38:22.074381+0000","last_unstale":"2023-11-04T01:38:43.149527+0000","last_undegraded":"2023-11-04T01:38:43.149527+0000","last_fullsized":"2023-11-04T01:38:43.149527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:56:25.208149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154284+0000","last_change":"2023-11-04T01:38:23.061673+0000","last_active":"2023-11-04T01:38:43.154284+0000","last_peered":"2023-11-04T01:38:43.154284+0000","last_clean":"2023-11-04T01:38:43.154284+0000","last_became_active":"2023-11-04T01:38:21.062435+0000","last_became_peered":"2023-11-04T01:38:21.062435+0000","last_unstale":"2023-11-04T01:38:43.154284+0000","last_undegraded":"2023-11-04T01:38:43.154284+0000","last_fullsized":"2023-11-04T01:38:43.154284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:52.059754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048859499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154295+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:38:43.154295+0000","last_peered":"2023-11-04T01:38:43.154295+0000","last_clean":"2023-11-04T01:38:43.154295+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:38:43.154295+0000","last_undegraded":"2023-11-04T01:38:43.154295+0000","last_fullsized":"2023-11-04T01:38:43.154295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192353+0000","last_change":"2023-11-04T01:38:44.184870+0000","last_active":"2023-11-04T01:38:44.192353+0000","last_peered":"2023-11-04T01:38:44.192353+0000","last_clean":"2023-11-04T01:38:44.192353+0000","last_became_active":"2023-11-04T01:38:44.184600+0000","last_became_peered":"2023-11-04T01:38:44.184600+0000","last_unstale":"2023-11-04T01:38:44.192353+0000","last_undegraded":"2023-11-04T01:38:44.192353+0000","last_fullsized":"2023-11-04T01:38:44.192353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:56.720079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.190809+0000","last_change":"2023-11-04T01:38:43.168743+0000","last_active":"2023-11-04T01:38:44.190809+0000","last_peered":"2023-11-04T01:38:44.190809+0000","last_clean":"2023-11-04T01:38:44.190809+0000","last_became_active":"2023-11-04T01:38:43.168465+0000","last_became_peered":"2023-11-04T01:38:43.168465+0000","last_unstale":"2023-11-04T01:38:44.190809+0000","last_undegraded":"2023-11-04T01:38:44.190809+0000","last_fullsized":"2023-11-04T01:38:44.190809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:13.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150275+0000","last_change":"2023-11-04T01:38:22.075108+0000","last_active":"2023-11-04T01:38:43.150275+0000","last_peered":"2023-11-04T01:38:43.150275+0000","last_clean":"2023-11-04T01:38:43.150275+0000","last_became_active":"2023-11-04T01:38:22.074780+0000","last_became_peered":"2023-11-04T01:38:22.074780+0000","last_unstale":"2023-11-04T01:38:43.150275+0000","last_undegraded":"2023-11-04T01:38:43.150275+0000","last_fullsized":"2023-11-04T01:38:43.150275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:13.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162738+0000","last_change":"2023-11-04T01:38:23.334648+0000","last_active":"2023-11-04T01:38:43.162738+0000","last_peered":"2023-11-04T01:38:43.162738+0000","last_clean":"2023-11-04T01:38:43.162738+0000","last_became_active":"2023-11-04T01:38:21.066335+0000","last_became_peered":"2023-11-04T01:38:21.066335+0000","last_unstale":"2023-11-04T01:38:43.162738+0000","last_undegraded":"2023-11-04T01:38:43.162738+0000","last_fullsized":"2023-11-04T01:38:43.162738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:43.106209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047853300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155751+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:38:43.155751+0000","last_peered":"2023-11-04T01:38:43.155751+0000","last_clean":"2023-11-04T01:38:43.155751+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:38:43.155751+0000","last_undegraded":"2023-11-04T01:38:43.155751+0000","last_fullsized":"2023-11-04T01:38:43.155751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188941+0000","last_change":"2023-11-04T01:38:44.181148+0000","last_active":"2023-11-04T01:38:44.188941+0000","last_peered":"2023-11-04T01:38:44.188941+0000","last_clean":"2023-11-04T01:38:44.188941+0000","last_became_active":"2023-11-04T01:38:44.180848+0000","last_became_peered":"2023-11-04T01:38:44.180848+0000","last_unstale":"2023-11-04T01:38:44.188941+0000","last_undegraded":"2023-11-04T01:38:44.188941+0000","last_fullsized":"2023-11-04T01:38:44.188941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192816+0000","last_change":"2023-11-04T01:38:43.168074+0000","last_active":"2023-11-04T01:38:44.192816+0000","last_peered":"2023-11-04T01:38:44.192816+0000","last_clean":"2023-11-04T01:38:44.192816+0000","last_became_active":"2023-11-04T01:38:43.167846+0000","last_became_peered":"2023-11-04T01:38:43.167846+0000","last_unstale":"2023-11-04T01:38:44.192816+0000","last_undegraded":"2023-11-04T01:38:44.192816+0000","last_fullsized":"2023-11-04T01:38:44.192816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:11.280545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166076+0000","last_change":"2023-11-04T01:38:22.072789+0000","last_active":"2023-11-04T01:38:43.166076+0000","last_peered":"2023-11-04T01:38:43.166076+0000","last_clean":"2023-11-04T01:38:43.166076+0000","last_became_active":"2023-11-04T01:38:22.072509+0000","last_became_peered":"2023-11-04T01:38:22.072509+0000","last_unstale":"2023-11-04T01:38:43.166076+0000","last_undegraded":"2023-11-04T01:38:43.166076+0000","last_fullsized":"2023-11-04T01:38:43.166076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156112+0000","last_change":"2023-11-04T01:38:23.061961+0000","last_active":"2023-11-04T01:38:43.156112+0000","last_peered":"2023-11-04T01:38:43.156112+0000","last_clean":"2023-11-04T01:38:43.156112+0000","last_became_active":"2023-11-04T01:38:21.063415+0000","last_became_peered":"2023-11-04T01:38:21.063415+0000","last_unstale":"2023-11-04T01:38:43.156112+0000","last_undegraded":"2023-11-04T01:38:43.156112+0000","last_fullsized":"2023-11-04T01:38:43.156112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.820188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000396594,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161008+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:38:43.161008+0000","last_peered":"2023-11-04T01:38:43.161008+0000","last_clean":"2023-11-04T01:38:43.161008+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:38:43.161008+0000","last_undegraded":"2023-11-04T01:38:43.161008+0000","last_fullsized":"2023-11-04T01:38:43.161008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178862+0000","last_change":"2023-11-04T01:38:44.176528+0000","last_active":"2023-11-04T01:38:44.178862+0000","last_peered":"2023-11-04T01:38:44.178862+0000","last_clean":"2023-11-04T01:38:44.178862+0000","last_became_active":"2023-11-04T01:38:44.176282+0000","last_became_peered":"2023-11-04T01:38:44.176282+0000","last_unstale":"2023-11-04T01:38:44.178862+0000","last_undegraded":"2023-11-04T01:38:44.178862+0000","last_fullsized":"2023-11-04T01:38:44.178862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:39.850295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186402+0000","last_change":"2023-11-04T01:38:43.172258+0000","last_active":"2023-11-04T01:38:44.186402+0000","last_peered":"2023-11-04T01:38:44.186402+0000","last_clean":"2023-11-04T01:38:44.186402+0000","last_became_active":"2023-11-04T01:38:43.171981+0000","last_became_peered":"2023-11-04T01:38:43.171981+0000","last_unstale":"2023-11-04T01:38:44.186402+0000","last_undegraded":"2023-11-04T01:38:44.186402+0000","last_fullsized":"2023-11-04T01:38:44.186402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:40.091655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156049+0000","last_change":"2023-11-04T01:38:22.068816+0000","last_active":"2023-11-04T01:38:43.156049+0000","last_peered":"2023-11-04T01:38:43.156049+0000","last_clean":"2023-11-04T01:38:43.156049+0000","last_became_active":"2023-11-04T01:38:22.068537+0000","last_became_peered":"2023-11-04T01:38:22.068537+0000","last_unstale":"2023-11-04T01:38:43.156049+0000","last_undegraded":"2023-11-04T01:38:43.156049+0000","last_fullsized":"2023-11-04T01:38:43.156049+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:44.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165778+0000","last_change":"2023-11-04T01:38:23.405504+0000","last_active":"2023-11-04T01:38:43.165778+0000","last_peered":"2023-11-04T01:38:43.165778+0000","last_clean":"2023-11-04T01:38:43.165778+0000","last_became_active":"2023-11-04T01:38:21.073116+0000","last_became_peered":"2023-11-04T01:38:21.073116+0000","last_unstale":"2023-11-04T01:38:43.165778+0000","last_undegraded":"2023-11-04T01:38:43.165778+0000","last_fullsized":"2023-11-04T01:38:43.165778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:14.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098846799999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163340+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:38:43.163340+0000","last_peered":"2023-11-04T01:38:43.163340+0000","last_clean":"2023-11-04T01:38:43.163340+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:38:43.163340+0000","last_undegraded":"2023-11-04T01:38:43.163340+0000","last_fullsized":"2023-11-04T01:38:43.163340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194806+0000","last_change":"2023-11-04T01:38:44.191459+0000","last_active":"2023-11-04T01:38:44.194806+0000","last_peered":"2023-11-04T01:38:44.194806+0000","last_clean":"2023-11-04T01:38:44.194806+0000","last_became_active":"2023-11-04T01:38:44.191139+0000","last_became_peered":"2023-11-04T01:38:44.191139+0000","last_unstale":"2023-11-04T01:38:44.194806+0000","last_undegraded":"2023-11-04T01:38:44.194806+0000","last_fullsized":"2023-11-04T01:38:44.194806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:41.091836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192495+0000","last_change":"2023-11-04T01:38:43.166740+0000","last_active":"2023-11-04T01:38:44.192495+0000","last_peered":"2023-11-04T01:38:44.192495+0000","last_clean":"2023-11-04T01:38:44.192495+0000","last_became_active":"2023-11-04T01:38:43.166487+0000","last_became_peered":"2023-11-04T01:38:43.166487+0000","last_unstale":"2023-11-04T01:38:44.192495+0000","last_undegraded":"2023-11-04T01:38:44.192495+0000","last_fullsized":"2023-11-04T01:38:44.192495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:27.859291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160531+0000","last_change":"2023-11-04T01:38:22.069605+0000","last_active":"2023-11-04T01:38:43.160531+0000","last_peered":"2023-11-04T01:38:43.160531+0000","last_clean":"2023-11-04T01:38:43.160531+0000","last_became_active":"2023-11-04T01:38:22.069171+0000","last_became_peered":"2023-11-04T01:38:22.069171+0000","last_unstale":"2023-11-04T01:38:43.160531+0000","last_undegraded":"2023-11-04T01:38:43.160531+0000","last_fullsized":"2023-11-04T01:38:43.160531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:07.216732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159533+0000","last_change":"2023-11-04T01:38:23.063133+0000","last_active":"2023-11-04T01:38:43.159533+0000","last_peered":"2023-11-04T01:38:43.159533+0000","last_clean":"2023-11-04T01:38:43.159533+0000","last_became_active":"2023-11-04T01:38:21.070011+0000","last_became_peered":"2023-11-04T01:38:21.070011+0000","last_unstale":"2023-11-04T01:38:43.159533+0000","last_undegraded":"2023-11-04T01:38:43.159533+0000","last_fullsized":"2023-11-04T01:38:43.159533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:08.992301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161913+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:38:43.161913+0000","last_peered":"2023-11-04T01:38:43.161913+0000","last_clean":"2023-11-04T01:38:43.161913+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:38:43.161913+0000","last_undegraded":"2023-11-04T01:38:43.161913+0000","last_fullsized":"2023-11-04T01:38:43.161913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189415+0000","last_change":"2023-11-04T01:38:44.185144+0000","last_active":"2023-11-04T01:38:44.189415+0000","last_peered":"2023-11-04T01:38:44.189415+0000","last_clean":"2023-11-04T01:38:44.189415+0000","last_became_active":"2023-11-04T01:38:44.184883+0000","last_became_peered":"2023-11-04T01:38:44.184883+0000","last_unstale":"2023-11-04T01:38:44.189415+0000","last_undegraded":"2023-11-04T01:38:44.189415+0000","last_fullsized":"2023-11-04T01:38:44.189415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:40.457824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"81'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194510+0000","last_change":"2023-11-04T01:38:43.172890+0000","last_active":"2023-11-04T01:38:44.194510+0000","last_peered":"2023-11-04T01:38:44.194510+0000","last_clean":"2023-11-04T01:38:44.194510+0000","last_became_active":"2023-11-04T01:38:43.172634+0000","last_became_peered":"2023-11-04T01:38:43.172634+0000","last_unstale":"2023-11-04T01:38:44.194510+0000","last_undegraded":"2023-11-04T01:38:44.194510+0000","last_fullsized":"2023-11-04T01:38:44.194510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:08.355119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165053+0000","last_change":"2023-11-04T01:38:22.077275+0000","last_active":"2023-11-04T01:38:43.165053+0000","last_peered":"2023-11-04T01:38:43.165053+0000","last_clean":"2023-11-04T01:38:43.165053+0000","last_became_active":"2023-11-04T01:38:22.076997+0000","last_became_peered":"2023-11-04T01:38:22.076997+0000","last_unstale":"2023-11-04T01:38:43.165053+0000","last_undegraded":"2023-11-04T01:38:43.165053+0000","last_fullsized":"2023-11-04T01:38:43.165053+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:14.205713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160828+0000","last_change":"2023-11-04T01:38:23.062882+0000","last_active":"2023-11-04T01:38:43.160828+0000","last_peered":"2023-11-04T01:38:43.160828+0000","last_clean":"2023-11-04T01:38:43.160828+0000","last_became_active":"2023-11-04T01:38:21.069964+0000","last_became_peered":"2023-11-04T01:38:21.069964+0000","last_unstale":"2023-11-04T01:38:43.160828+0000","last_undegraded":"2023-11-04T01:38:43.160828+0000","last_fullsized":"2023-11-04T01:38:43.160828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:16.633121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083743200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156142+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:38:43.156142+0000","last_peered":"2023-11-04T01:38:43.156142+0000","last_clean":"2023-11-04T01:38:43.156142+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:38:43.156142+0000","last_undegraded":"2023-11-04T01:38:43.156142+0000","last_fullsized":"2023-11-04T01:38:43.156142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188890+0000","last_change":"2023-11-04T01:38:44.181167+0000","last_active":"2023-11-04T01:38:44.188890+0000","last_peered":"2023-11-04T01:38:44.188890+0000","last_clean":"2023-11-04T01:38:44.188890+0000","last_became_active":"2023-11-04T01:38:44.180860+0000","last_became_peered":"2023-11-04T01:38:44.180860+0000","last_unstale":"2023-11-04T01:38:44.188890+0000","last_undegraded":"2023-11-04T01:38:44.188890+0000","last_fullsized":"2023-11-04T01:38:44.188890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:32.097650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.162583+0000","last_change":"2023-11-04T01:38:43.166035+0000","last_active":"2023-11-04T01:38:44.162583+0000","last_peered":"2023-11-04T01:38:44.162583+0000","last_clean":"2023-11-04T01:38:44.162583+0000","last_became_active":"2023-11-04T01:38:43.165780+0000","last_became_peered":"2023-11-04T01:38:43.165780+0000","last_unstale":"2023-11-04T01:38:44.162583+0000","last_undegraded":"2023-11-04T01:38:44.162583+0000","last_fullsized":"2023-11-04T01:38:44.162583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:27.983013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155777+0000","last_change":"2023-11-04T01:38:22.062314+0000","last_active":"2023-11-04T01:38:43.155777+0000","last_peered":"2023-11-04T01:38:43.155777+0000","last_clean":"2023-11-04T01:38:43.155777+0000","last_became_active":"2023-11-04T01:38:22.062007+0000","last_became_peered":"2023-11-04T01:38:22.062007+0000","last_unstale":"2023-11-04T01:38:43.155777+0000","last_undegraded":"2023-11-04T01:38:43.155777+0000","last_fullsized":"2023-11-04T01:38:43.155777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:09.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155675+0000","last_change":"2023-11-04T01:38:23.060981+0000","last_active":"2023-11-04T01:38:43.155675+0000","last_peered":"2023-11-04T01:38:43.155675+0000","last_clean":"2023-11-04T01:38:43.155675+0000","last_became_active":"2023-11-04T01:38:21.065930+0000","last_became_peered":"2023-11-04T01:38:21.065930+0000","last_unstale":"2023-11-04T01:38:43.155675+0000","last_undegraded":"2023-11-04T01:38:43.155675+0000","last_fullsized":"2023-11-04T01:38:43.155675+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158363+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:38:43.158363+0000","last_peered":"2023-11-04T01:38:43.158363+0000","last_clean":"2023-11-04T01:38:43.158363+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:38:43.158363+0000","last_undegraded":"2023-11-04T01:38:43.158363+0000","last_fullsized":"2023-11-04T01:38:43.158363+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182284+0000","last_change":"2023-11-04T01:38:44.180724+0000","last_active":"2023-11-04T01:38:44.182284+0000","last_peered":"2023-11-04T01:38:44.182284+0000","last_clean":"2023-11-04T01:38:44.182284+0000","last_became_active":"2023-11-04T01:38:44.180473+0000","last_became_peered":"2023-11-04T01:38:44.180473+0000","last_unstale":"2023-11-04T01:38:44.182284+0000","last_undegraded":"2023-11-04T01:38:44.182284+0000","last_fullsized":"2023-11-04T01:38:44.182284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:49.217495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173509+0000","last_change":"2023-11-04T01:38:43.167042+0000","last_active":"2023-11-04T01:38:44.173509+0000","last_peered":"2023-11-04T01:38:44.173509+0000","last_clean":"2023-11-04T01:38:44.173509+0000","last_became_active":"2023-11-04T01:38:43.166809+0000","last_became_peered":"2023-11-04T01:38:43.166809+0000","last_unstale":"2023-11-04T01:38:44.173509+0000","last_undegraded":"2023-11-04T01:38:44.173509+0000","last_fullsized":"2023-11-04T01:38:44.173509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:30.647869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149525+0000","last_change":"2023-11-04T01:38:22.075621+0000","last_active":"2023-11-04T01:38:43.149525+0000","last_peered":"2023-11-04T01:38:43.149525+0000","last_clean":"2023-11-04T01:38:43.149525+0000","last_became_active":"2023-11-04T01:38:22.075337+0000","last_became_peered":"2023-11-04T01:38:22.075337+0000","last_unstale":"2023-11-04T01:38:43.149525+0000","last_undegraded":"2023-11-04T01:38:43.149525+0000","last_fullsized":"2023-11-04T01:38:43.149525+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:00.382893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155803+0000","last_change":"2023-11-04T01:38:23.061099+0000","last_active":"2023-11-04T01:38:43.155803+0000","last_peered":"2023-11-04T01:38:43.155803+0000","last_clean":"2023-11-04T01:38:43.155803+0000","last_became_active":"2023-11-04T01:38:21.063958+0000","last_became_peered":"2023-11-04T01:38:21.063958+0000","last_unstale":"2023-11-04T01:38:43.155803+0000","last_undegraded":"2023-11-04T01:38:43.155803+0000","last_fullsized":"2023-11-04T01:38:43.155803+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:13.105036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164004+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:38:43.164004+0000","last_peered":"2023-11-04T01:38:43.164004+0000","last_clean":"2023-11-04T01:38:43.164004+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:38:43.164004+0000","last_undegraded":"2023-11-04T01:38:43.164004+0000","last_fullsized":"2023-11-04T01:38:43.164004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.196821+0000","last_change":"2023-11-04T01:38:44.192413+0000","last_active":"2023-11-04T01:38:44.196821+0000","last_peered":"2023-11-04T01:38:44.196821+0000","last_clean":"2023-11-04T01:38:44.196821+0000","last_became_active":"2023-11-04T01:38:44.192156+0000","last_became_peered":"2023-11-04T01:38:44.192156+0000","last_unstale":"2023-11-04T01:38:44.196821+0000","last_undegraded":"2023-11-04T01:38:44.196821+0000","last_fullsized":"2023-11-04T01:38:44.196821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:13.663524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.193101+0000","last_change":"2023-11-04T01:38:43.169954+0000","last_active":"2023-11-04T01:38:44.193101+0000","last_peered":"2023-11-04T01:38:44.193101+0000","last_clean":"2023-11-04T01:38:44.193101+0000","last_became_active":"2023-11-04T01:38:43.169132+0000","last_became_peered":"2023-11-04T01:38:43.169132+0000","last_unstale":"2023-11-04T01:38:44.193101+0000","last_undegraded":"2023-11-04T01:38:44.193101+0000","last_fullsized":"2023-11-04T01:38:44.193101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:43.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163757+0000","last_change":"2023-11-04T01:38:22.070752+0000","last_active":"2023-11-04T01:38:43.163757+0000","last_peered":"2023-11-04T01:38:43.163757+0000","last_clean":"2023-11-04T01:38:43.163757+0000","last_became_active":"2023-11-04T01:38:22.070461+0000","last_became_peered":"2023-11-04T01:38:22.070461+0000","last_unstale":"2023-11-04T01:38:43.163757+0000","last_undegraded":"2023-11-04T01:38:43.163757+0000","last_fullsized":"2023-11-04T01:38:43.163757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:27.426475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150122+0000","last_change":"2023-11-04T01:38:23.358397+0000","last_active":"2023-11-04T01:38:43.150122+0000","last_peered":"2023-11-04T01:38:43.150122+0000","last_clean":"2023-11-04T01:38:43.150122+0000","last_became_active":"2023-11-04T01:38:21.066012+0000","last_became_peered":"2023-11-04T01:38:21.066012+0000","last_unstale":"2023-11-04T01:38:43.150122+0000","last_undegraded":"2023-11-04T01:38:43.150122+0000","last_fullsized":"2023-11-04T01:38:43.150122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.942370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051071600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154933+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:38:43.154933+0000","last_peered":"2023-11-04T01:38:43.154933+0000","last_clean":"2023-11-04T01:38:43.154933+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:38:43.154933+0000","last_undegraded":"2023-11-04T01:38:43.154933+0000","last_fullsized":"2023-11-04T01:38:43.154933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186218+0000","last_change":"2023-11-04T01:38:44.181978+0000","last_active":"2023-11-04T01:38:44.186218+0000","last_peered":"2023-11-04T01:38:44.186218+0000","last_clean":"2023-11-04T01:38:44.186218+0000","last_became_active":"2023-11-04T01:38:44.181721+0000","last_became_peered":"2023-11-04T01:38:44.181721+0000","last_unstale":"2023-11-04T01:38:44.186218+0000","last_undegraded":"2023-11-04T01:38:44.186218+0000","last_fullsized":"2023-11-04T01:38:44.186218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194275+0000","last_change":"2023-11-04T01:38:43.165213+0000","last_active":"2023-11-04T01:38:44.194275+0000","last_peered":"2023-11-04T01:38:44.194275+0000","last_clean":"2023-11-04T01:38:44.194275+0000","last_became_active":"2023-11-04T01:38:43.164915+0000","last_became_peered":"2023-11-04T01:38:43.164915+0000","last_unstale":"2023-11-04T01:38:44.194275+0000","last_undegraded":"2023-11-04T01:38:44.194275+0000","last_fullsized":"2023-11-04T01:38:44.194275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:33.153011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162332+0000","last_change":"2023-11-04T01:38:22.067648+0000","last_active":"2023-11-04T01:38:43.162332+0000","last_peered":"2023-11-04T01:38:43.162332+0000","last_clean":"2023-11-04T01:38:43.162332+0000","last_became_active":"2023-11-04T01:38:22.067338+0000","last_became_peered":"2023-11-04T01:38:22.067338+0000","last_unstale":"2023-11-04T01:38:43.162332+0000","last_undegraded":"2023-11-04T01:38:43.162332+0000","last_fullsized":"2023-11-04T01:38:43.162332+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:04.184731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154002+0000","last_change":"2023-11-04T01:38:23.061682+0000","last_active":"2023-11-04T01:38:43.154002+0000","last_peered":"2023-11-04T01:38:43.154002+0000","last_clean":"2023-11-04T01:38:43.154002+0000","last_became_active":"2023-11-04T01:38:21.067953+0000","last_became_peered":"2023-11-04T01:38:21.067953+0000","last_unstale":"2023-11-04T01:38:43.154002+0000","last_undegraded":"2023-11-04T01:38:43.154002+0000","last_fullsized":"2023-11-04T01:38:43.154002+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:06.211868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042784099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164740+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:38:43.164740+0000","last_peered":"2023-11-04T01:38:43.164740+0000","last_clean":"2023-11-04T01:38:43.164740+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:38:43.164740+0000","last_undegraded":"2023-11-04T01:38:43.164740+0000","last_fullsized":"2023-11-04T01:38:43.164740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194739+0000","last_change":"2023-11-04T01:38:44.190973+0000","last_active":"2023-11-04T01:38:44.194739+0000","last_peered":"2023-11-04T01:38:44.194739+0000","last_clean":"2023-11-04T01:38:44.194739+0000","last_became_active":"2023-11-04T01:38:44.190093+0000","last_became_peered":"2023-11-04T01:38:44.190093+0000","last_unstale":"2023-11-04T01:38:44.194739+0000","last_undegraded":"2023-11-04T01:38:44.194739+0000","last_fullsized":"2023-11-04T01:38:44.194739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:48.498859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.174471+0000","last_change":"2023-11-04T01:38:43.163222+0000","last_active":"2023-11-04T01:38:44.174471+0000","last_peered":"2023-11-04T01:38:44.174471+0000","last_clean":"2023-11-04T01:38:44.174471+0000","last_became_active":"2023-11-04T01:38:43.162940+0000","last_became_peered":"2023-11-04T01:38:43.162940+0000","last_unstale":"2023-11-04T01:38:44.174471+0000","last_undegraded":"2023-11-04T01:38:44.174471+0000","last_fullsized":"2023-11-04T01:38:44.174471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:12.659206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161793+0000","last_change":"2023-11-04T01:38:22.069448+0000","last_active":"2023-11-04T01:38:43.161793+0000","last_peered":"2023-11-04T01:38:43.161793+0000","last_clean":"2023-11-04T01:38:43.161793+0000","last_became_active":"2023-11-04T01:38:22.069195+0000","last_became_peered":"2023-11-04T01:38:22.069195+0000","last_unstale":"2023-11-04T01:38:43.161793+0000","last_undegraded":"2023-11-04T01:38:43.161793+0000","last_fullsized":"2023-11-04T01:38:43.161793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:21.047863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149786+0000","last_change":"2023-11-04T01:38:23.358753+0000","last_active":"2023-11-04T01:38:43.149786+0000","last_peered":"2023-11-04T01:38:43.149786+0000","last_clean":"2023-11-04T01:38:43.149786+0000","last_became_active":"2023-11-04T01:38:21.070981+0000","last_became_peered":"2023-11-04T01:38:21.070981+0000","last_unstale":"2023-11-04T01:38:43.149786+0000","last_undegraded":"2023-11-04T01:38:43.149786+0000","last_fullsized":"2023-11-04T01:38:43.149786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:55.408316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043018,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166262+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:38:43.166262+0000","last_peered":"2023-11-04T01:38:43.166262+0000","last_clean":"2023-11-04T01:38:43.166262+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:38:43.166262+0000","last_undegraded":"2023-11-04T01:38:43.166262+0000","last_fullsized":"2023-11-04T01:38:43.166262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192361+0000","last_change":"2023-11-04T01:38:44.183123+0000","last_active":"2023-11-04T01:38:44.192361+0000","last_peered":"2023-11-04T01:38:44.192361+0000","last_clean":"2023-11-04T01:38:44.192361+0000","last_became_active":"2023-11-04T01:38:44.182859+0000","last_became_peered":"2023-11-04T01:38:44.182859+0000","last_unstale":"2023-11-04T01:38:44.192361+0000","last_undegraded":"2023-11-04T01:38:44.192361+0000","last_fullsized":"2023-11-04T01:38:44.192361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:15.165104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168863+0000","last_change":"2023-11-04T01:38:43.167000+0000","last_active":"2023-11-04T01:38:44.168863+0000","last_peered":"2023-11-04T01:38:44.168863+0000","last_clean":"2023-11-04T01:38:44.168863+0000","last_became_active":"2023-11-04T01:38:43.166758+0000","last_became_peered":"2023-11-04T01:38:43.166758+0000","last_unstale":"2023-11-04T01:38:44.168863+0000","last_undegraded":"2023-11-04T01:38:44.168863+0000","last_fullsized":"2023-11-04T01:38:44.168863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:19.401660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156043+0000","last_change":"2023-11-04T01:38:22.070238+0000","last_active":"2023-11-04T01:38:43.156043+0000","last_peered":"2023-11-04T01:38:43.156043+0000","last_clean":"2023-11-04T01:38:43.156043+0000","last_became_active":"2023-11-04T01:38:22.069898+0000","last_became_peered":"2023-11-04T01:38:22.069898+0000","last_unstale":"2023-11-04T01:38:43.156043+0000","last_undegraded":"2023-11-04T01:38:43.156043+0000","last_fullsized":"2023-11-04T01:38:43.156043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:57.057392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149695+0000","last_change":"2023-11-04T01:38:23.358872+0000","last_active":"2023-11-04T01:38:43.149695+0000","last_peered":"2023-11-04T01:38:43.149695+0000","last_clean":"2023-11-04T01:38:43.149695+0000","last_became_active":"2023-11-04T01:38:21.069193+0000","last_became_peered":"2023-11-04T01:38:21.069193+0000","last_unstale":"2023-11-04T01:38:43.149695+0000","last_undegraded":"2023-11-04T01:38:43.149695+0000","last_fullsized":"2023-11-04T01:38:43.149695+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:57.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055334700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165295+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:38:43.165295+0000","last_peered":"2023-11-04T01:38:43.165295+0000","last_clean":"2023-11-04T01:38:43.165295+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:38:43.165295+0000","last_undegraded":"2023-11-04T01:38:43.165295+0000","last_fullsized":"2023-11-04T01:38:43.165295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178743+0000","last_change":"2023-11-04T01:38:44.173767+0000","last_active":"2023-11-04T01:38:44.178743+0000","last_peered":"2023-11-04T01:38:44.178743+0000","last_clean":"2023-11-04T01:38:44.178743+0000","last_became_active":"2023-11-04T01:38:44.173331+0000","last_became_peered":"2023-11-04T01:38:44.173331+0000","last_unstale":"2023-11-04T01:38:44.178743+0000","last_undegraded":"2023-11-04T01:38:44.178743+0000","last_fullsized":"2023-11-04T01:38:44.178743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:26.285215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169009+0000","last_change":"2023-11-04T01:38:43.172456+0000","last_active":"2023-11-04T01:38:44.169009+0000","last_peered":"2023-11-04T01:38:44.169009+0000","last_clean":"2023-11-04T01:38:44.169009+0000","last_became_active":"2023-11-04T01:38:43.172193+0000","last_became_peered":"2023-11-04T01:38:43.172193+0000","last_unstale":"2023-11-04T01:38:44.169009+0000","last_undegraded":"2023-11-04T01:38:44.169009+0000","last_fullsized":"2023-11-04T01:38:44.169009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:08.306948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155929+0000","last_change":"2023-11-04T01:38:22.064805+0000","last_active":"2023-11-04T01:38:43.155929+0000","last_peered":"2023-11-04T01:38:43.155929+0000","last_clean":"2023-11-04T01:38:43.155929+0000","last_became_active":"2023-11-04T01:38:22.064524+0000","last_became_peered":"2023-11-04T01:38:22.064524+0000","last_unstale":"2023-11-04T01:38:43.155929+0000","last_undegraded":"2023-11-04T01:38:43.155929+0000","last_fullsized":"2023-11-04T01:38:43.155929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:15.823978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165139+0000","last_change":"2023-11-04T01:38:23.404752+0000","last_active":"2023-11-04T01:38:43.165139+0000","last_peered":"2023-11-04T01:38:43.165139+0000","last_clean":"2023-11-04T01:38:43.165139+0000","last_became_active":"2023-11-04T01:38:21.069815+0000","last_became_peered":"2023-11-04T01:38:21.069815+0000","last_unstale":"2023-11-04T01:38:43.165139+0000","last_undegraded":"2023-11-04T01:38:43.165139+0000","last_fullsized":"2023-11-04T01:38:43.165139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:15.512902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076771900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161044+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:38:43.161044+0000","last_peered":"2023-11-04T01:38:43.161044+0000","last_clean":"2023-11-04T01:38:43.161044+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:38:43.161044+0000","last_undegraded":"2023-11-04T01:38:43.161044+0000","last_fullsized":"2023-11-04T01:38:43.161044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187182+0000","last_change":"2023-11-04T01:38:44.183124+0000","last_active":"2023-11-04T01:38:44.187182+0000","last_peered":"2023-11-04T01:38:44.187182+0000","last_clean":"2023-11-04T01:38:44.187182+0000","last_became_active":"2023-11-04T01:38:44.181017+0000","last_became_peered":"2023-11-04T01:38:44.181017+0000","last_unstale":"2023-11-04T01:38:44.187182+0000","last_undegraded":"2023-11-04T01:38:44.187182+0000","last_fullsized":"2023-11-04T01:38:44.187182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:36.888737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189304+0000","last_change":"2023-11-04T01:38:43.164538+0000","last_active":"2023-11-04T01:38:44.189304+0000","last_peered":"2023-11-04T01:38:44.189304+0000","last_clean":"2023-11-04T01:38:44.189304+0000","last_became_active":"2023-11-04T01:38:43.164249+0000","last_became_peered":"2023-11-04T01:38:43.164249+0000","last_unstale":"2023-11-04T01:38:44.189304+0000","last_undegraded":"2023-11-04T01:38:44.189304+0000","last_fullsized":"2023-11-04T01:38:44.189304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:35.173829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165218+0000","last_change":"2023-11-04T01:38:22.071153+0000","last_active":"2023-11-04T01:38:43.165218+0000","last_peered":"2023-11-04T01:38:43.165218+0000","last_clean":"2023-11-04T01:38:43.165218+0000","last_became_active":"2023-11-04T01:38:22.070642+0000","last_became_peered":"2023-11-04T01:38:22.070642+0000","last_unstale":"2023-11-04T01:38:43.165218+0000","last_undegraded":"2023-11-04T01:38:43.165218+0000","last_fullsized":"2023-11-04T01:38:43.165218+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:14.109900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166090+0000","last_change":"2023-11-04T01:38:23.405429+0000","last_active":"2023-11-04T01:38:43.166090+0000","last_peered":"2023-11-04T01:38:43.166090+0000","last_clean":"2023-11-04T01:38:43.166090+0000","last_became_active":"2023-11-04T01:38:21.073092+0000","last_became_peered":"2023-11-04T01:38:21.073092+0000","last_unstale":"2023-11-04T01:38:43.166090+0000","last_undegraded":"2023-11-04T01:38:43.166090+0000","last_fullsized":"2023-11-04T01:38:43.166090+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:05.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088544700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162276+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:38:43.162276+0000","last_peered":"2023-11-04T01:38:43.162276+0000","last_clean":"2023-11-04T01:38:43.162276+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:38:43.162276+0000","last_undegraded":"2023-11-04T01:38:43.162276+0000","last_fullsized":"2023-11-04T01:38:43.162276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189504+0000","last_change":"2023-11-04T01:38:44.184560+0000","last_active":"2023-11-04T01:38:44.189504+0000","last_peered":"2023-11-04T01:38:44.189504+0000","last_clean":"2023-11-04T01:38:44.189504+0000","last_became_active":"2023-11-04T01:38:44.181175+0000","last_became_peered":"2023-11-04T01:38:44.181175+0000","last_unstale":"2023-11-04T01:38:44.189504+0000","last_undegraded":"2023-11-04T01:38:44.189504+0000","last_fullsized":"2023-11-04T01:38:44.189504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:26.661431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168139+0000","last_change":"2023-11-04T01:38:43.168749+0000","last_active":"2023-11-04T01:38:44.168139+0000","last_peered":"2023-11-04T01:38:44.168139+0000","last_clean":"2023-11-04T01:38:44.168139+0000","last_became_active":"2023-11-04T01:38:43.168465+0000","last_became_peered":"2023-11-04T01:38:43.168465+0000","last_unstale":"2023-11-04T01:38:44.168139+0000","last_undegraded":"2023-11-04T01:38:44.168139+0000","last_fullsized":"2023-11-04T01:38:44.168139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:19.203453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154102+0000","last_change":"2023-11-04T01:38:22.066267+0000","last_active":"2023-11-04T01:38:43.154102+0000","last_peered":"2023-11-04T01:38:43.154102+0000","last_clean":"2023-11-04T01:38:43.154102+0000","last_became_active":"2023-11-04T01:38:22.065904+0000","last_became_peered":"2023-11-04T01:38:22.065904+0000","last_unstale":"2023-11-04T01:38:43.154102+0000","last_undegraded":"2023-11-04T01:38:43.154102+0000","last_fullsized":"2023-11-04T01:38:43.154102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155716+0000","last_change":"2023-11-04T01:38:23.062165+0000","last_active":"2023-11-04T01:38:43.155716+0000","last_peered":"2023-11-04T01:38:43.155716+0000","last_clean":"2023-11-04T01:38:43.155716+0000","last_became_active":"2023-11-04T01:38:21.065551+0000","last_became_peered":"2023-11-04T01:38:21.065551+0000","last_unstale":"2023-11-04T01:38:43.155716+0000","last_undegraded":"2023-11-04T01:38:43.155716+0000","last_fullsized":"2023-11-04T01:38:43.155716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:16.744946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068861599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.153615+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:38:43.153615+0000","last_peered":"2023-11-04T01:38:43.153615+0000","last_clean":"2023-11-04T01:38:43.153615+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:38:43.153615+0000","last_undegraded":"2023-11-04T01:38:43.153615+0000","last_fullsized":"2023-11-04T01:38:43.153615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183451+0000","last_change":"2023-11-04T01:38:44.177484+0000","last_active":"2023-11-04T01:38:44.183451+0000","last_peered":"2023-11-04T01:38:44.183451+0000","last_clean":"2023-11-04T01:38:44.183451+0000","last_became_active":"2023-11-04T01:38:44.177206+0000","last_became_peered":"2023-11-04T01:38:44.177206+0000","last_unstale":"2023-11-04T01:38:44.183451+0000","last_undegraded":"2023-11-04T01:38:44.183451+0000","last_fullsized":"2023-11-04T01:38:44.183451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:51.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.175703+0000","last_change":"2023-11-04T01:38:43.171278+0000","last_active":"2023-11-04T01:38:44.175703+0000","last_peered":"2023-11-04T01:38:44.175703+0000","last_clean":"2023-11-04T01:38:44.175703+0000","last_became_active":"2023-11-04T01:38:43.171034+0000","last_became_peered":"2023-11-04T01:38:43.171034+0000","last_unstale":"2023-11-04T01:38:44.175703+0000","last_undegraded":"2023-11-04T01:38:44.175703+0000","last_fullsized":"2023-11-04T01:38:44.175703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:39.530065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165288+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:38:43.165288+0000","last_peered":"2023-11-04T01:38:43.165288+0000","last_clean":"2023-11-04T01:38:43.165288+0000","last_became_active":"2023-11-04T01:38:22.074718+0000","last_became_peered":"2023-11-04T01:38:22.074718+0000","last_unstale":"2023-11-04T01:38:43.165288+0000","last_undegraded":"2023-11-04T01:38:43.165288+0000","last_fullsized":"2023-11-04T01:38:43.165288+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:12.056843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154208+0000","last_change":"2023-11-04T01:38:23.062210+0000","last_active":"2023-11-04T01:38:43.154208+0000","last_peered":"2023-11-04T01:38:43.154208+0000","last_clean":"2023-11-04T01:38:43.154208+0000","last_became_active":"2023-11-04T01:38:21.062480+0000","last_became_peered":"2023-11-04T01:38:21.062480+0000","last_unstale":"2023-11-04T01:38:43.154208+0000","last_undegraded":"2023-11-04T01:38:43.154208+0000","last_fullsized":"2023-11-04T01:38:43.154208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:20.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040890099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159108+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:38:43.159108+0000","last_peered":"2023-11-04T01:38:43.159108+0000","last_clean":"2023-11-04T01:38:43.159108+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:38:43.159108+0000","last_undegraded":"2023-11-04T01:38:43.159108+0000","last_fullsized":"2023-11-04T01:38:43.159108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194440+0000","last_change":"2023-11-04T01:38:44.191381+0000","last_active":"2023-11-04T01:38:44.194440+0000","last_peered":"2023-11-04T01:38:44.194440+0000","last_clean":"2023-11-04T01:38:44.194440+0000","last_became_active":"2023-11-04T01:38:44.191110+0000","last_became_peered":"2023-11-04T01:38:44.191110+0000","last_unstale":"2023-11-04T01:38:44.194440+0000","last_undegraded":"2023-11-04T01:38:44.194440+0000","last_fullsized":"2023-11-04T01:38:44.194440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:26.661431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172510+0000","last_change":"2023-11-04T01:38:43.169589+0000","last_active":"2023-11-04T01:38:44.172510+0000","last_peered":"2023-11-04T01:38:44.172510+0000","last_clean":"2023-11-04T01:38:44.172510+0000","last_became_active":"2023-11-04T01:38:43.169337+0000","last_became_peered":"2023-11-04T01:38:43.169337+0000","last_unstale":"2023-11-04T01:38:44.172510+0000","last_undegraded":"2023-11-04T01:38:44.172510+0000","last_fullsized":"2023-11-04T01:38:44.172510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:15.192547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164264+0000","last_change":"2023-11-04T01:38:22.070477+0000","last_active":"2023-11-04T01:38:43.164264+0000","last_peered":"2023-11-04T01:38:43.164264+0000","last_clean":"2023-11-04T01:38:43.164264+0000","last_became_active":"2023-11-04T01:38:22.070203+0000","last_became_peered":"2023-11-04T01:38:22.070203+0000","last_unstale":"2023-11-04T01:38:43.164264+0000","last_undegraded":"2023-11-04T01:38:43.164264+0000","last_fullsized":"2023-11-04T01:38:43.164264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:07.694892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155545+0000","last_change":"2023-11-04T01:38:23.060125+0000","last_active":"2023-11-04T01:38:43.155545+0000","last_peered":"2023-11-04T01:38:43.155545+0000","last_clean":"2023-11-04T01:38:43.155545+0000","last_became_active":"2023-11-04T01:38:21.068722+0000","last_became_peered":"2023-11-04T01:38:21.068722+0000","last_unstale":"2023-11-04T01:38:43.155545+0000","last_undegraded":"2023-11-04T01:38:43.155545+0000","last_fullsized":"2023-11-04T01:38:43.155545+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:13.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058911300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149807+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:38:43.149807+0000","last_peered":"2023-11-04T01:38:43.149807+0000","last_clean":"2023-11-04T01:38:43.149807+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:38:43.149807+0000","last_undegraded":"2023-11-04T01:38:43.149807+0000","last_fullsized":"2023-11-04T01:38:43.149807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183304+0000","last_change":"2023-11-04T01:38:44.176859+0000","last_active":"2023-11-04T01:38:44.183304+0000","last_peered":"2023-11-04T01:38:44.183304+0000","last_clean":"2023-11-04T01:38:44.183304+0000","last_became_active":"2023-11-04T01:38:44.176608+0000","last_became_peered":"2023-11-04T01:38:44.176608+0000","last_unstale":"2023-11-04T01:38:44.183304+0000","last_undegraded":"2023-11-04T01:38:44.183304+0000","last_fullsized":"2023-11-04T01:38:44.183304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:51.967085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169732+0000","last_change":"2023-11-04T01:38:43.173139+0000","last_active":"2023-11-04T01:38:44.169732+0000","last_peered":"2023-11-04T01:38:44.169732+0000","last_clean":"2023-11-04T01:38:44.169732+0000","last_became_active":"2023-11-04T01:38:43.171732+0000","last_became_peered":"2023-11-04T01:38:43.171732+0000","last_unstale":"2023-11-04T01:38:44.169732+0000","last_undegraded":"2023-11-04T01:38:44.169732+0000","last_fullsized":"2023-11-04T01:38:44.169732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:55:14.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162408+0000","last_change":"2023-11-04T01:38:22.075956+0000","last_active":"2023-11-04T01:38:43.162408+0000","last_peered":"2023-11-04T01:38:43.162408+0000","last_clean":"2023-11-04T01:38:43.162408+0000","last_became_active":"2023-11-04T01:38:22.075635+0000","last_became_peered":"2023-11-04T01:38:22.075635+0000","last_unstale":"2023-11-04T01:38:43.162408+0000","last_undegraded":"2023-11-04T01:38:43.162408+0000","last_fullsized":"2023-11-04T01:38:43.162408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164343+0000","last_change":"2023-11-04T01:38:23.404427+0000","last_active":"2023-11-04T01:38:43.164343+0000","last_peered":"2023-11-04T01:38:43.164343+0000","last_clean":"2023-11-04T01:38:43.164343+0000","last_became_active":"2023-11-04T01:38:21.069870+0000","last_became_peered":"2023-11-04T01:38:21.069870+0000","last_unstale":"2023-11-04T01:38:43.164343+0000","last_undegraded":"2023-11-04T01:38:43.164343+0000","last_fullsized":"2023-11-04T01:38:43.164343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:47.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086834100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162979+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:38:43.162979+0000","last_peered":"2023-11-04T01:38:43.162979+0000","last_clean":"2023-11-04T01:38:43.162979+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:38:43.162979+0000","last_undegraded":"2023-11-04T01:38:43.162979+0000","last_fullsized":"2023-11-04T01:38:43.162979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189015+0000","last_change":"2023-11-04T01:38:44.185049+0000","last_active":"2023-11-04T01:38:44.189015+0000","last_peered":"2023-11-04T01:38:44.189015+0000","last_clean":"2023-11-04T01:38:44.189015+0000","last_became_active":"2023-11-04T01:38:44.184626+0000","last_became_peered":"2023-11-04T01:38:44.184626+0000","last_unstale":"2023-11-04T01:38:44.189015+0000","last_undegraded":"2023-11-04T01:38:44.189015+0000","last_fullsized":"2023-11-04T01:38:44.189015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:44.457483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168277+0000","last_change":"2023-11-04T01:38:43.167555+0000","last_active":"2023-11-04T01:38:44.168277+0000","last_peered":"2023-11-04T01:38:44.168277+0000","last_clean":"2023-11-04T01:38:44.168277+0000","last_became_active":"2023-11-04T01:38:43.167308+0000","last_became_peered":"2023-11-04T01:38:43.167308+0000","last_unstale":"2023-11-04T01:38:44.168277+0000","last_undegraded":"2023-11-04T01:38:44.168277+0000","last_fullsized":"2023-11-04T01:38:44.168277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:17.607307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166002+0000","last_change":"2023-11-04T01:38:22.071179+0000","last_active":"2023-11-04T01:38:43.166002+0000","last_peered":"2023-11-04T01:38:43.166002+0000","last_clean":"2023-11-04T01:38:43.166002+0000","last_became_active":"2023-11-04T01:38:22.070904+0000","last_became_peered":"2023-11-04T01:38:22.070904+0000","last_unstale":"2023-11-04T01:38:43.166002+0000","last_undegraded":"2023-11-04T01:38:43.166002+0000","last_fullsized":"2023-11-04T01:38:43.166002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:17.749810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161151+0000","last_change":"2023-11-04T01:38:23.062973+0000","last_active":"2023-11-04T01:38:43.161151+0000","last_peered":"2023-11-04T01:38:43.161151+0000","last_clean":"2023-11-04T01:38:43.161151+0000","last_became_active":"2023-11-04T01:38:21.060285+0000","last_became_peered":"2023-11-04T01:38:21.060285+0000","last_unstale":"2023-11-04T01:38:43.161151+0000","last_undegraded":"2023-11-04T01:38:43.161151+0000","last_fullsized":"2023-11-04T01:38:43.161151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:03.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097246599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161098+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:38:43.161098+0000","last_peered":"2023-11-04T01:38:43.161098+0000","last_clean":"2023-11-04T01:38:43.161098+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:38:43.161098+0000","last_undegraded":"2023-11-04T01:38:43.161098+0000","last_fullsized":"2023-11-04T01:38:43.161098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194600+0000","last_change":"2023-11-04T01:38:44.192583+0000","last_active":"2023-11-04T01:38:44.194600+0000","last_peered":"2023-11-04T01:38:44.194600+0000","last_clean":"2023-11-04T01:38:44.194600+0000","last_became_active":"2023-11-04T01:38:44.192268+0000","last_became_peered":"2023-11-04T01:38:44.192268+0000","last_unstale":"2023-11-04T01:38:44.194600+0000","last_undegraded":"2023-11-04T01:38:44.194600+0000","last_fullsized":"2023-11-04T01:38:44.194600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.193907+0000","last_change":"2023-11-04T01:38:43.163115+0000","last_active":"2023-11-04T01:38:44.193907+0000","last_peered":"2023-11-04T01:38:44.193907+0000","last_clean":"2023-11-04T01:38:44.193907+0000","last_became_active":"2023-11-04T01:38:43.162785+0000","last_became_peered":"2023-11-04T01:38:43.162785+0000","last_unstale":"2023-11-04T01:38:44.193907+0000","last_undegraded":"2023-11-04T01:38:44.193907+0000","last_fullsized":"2023-11-04T01:38:44.193907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158133+0000","last_change":"2023-11-04T01:38:22.070640+0000","last_active":"2023-11-04T01:38:43.158133+0000","last_peered":"2023-11-04T01:38:43.158133+0000","last_clean":"2023-11-04T01:38:43.158133+0000","last_became_active":"2023-11-04T01:38:22.070342+0000","last_became_peered":"2023-11-04T01:38:22.070342+0000","last_unstale":"2023-11-04T01:38:43.158133+0000","last_undegraded":"2023-11-04T01:38:43.158133+0000","last_fullsized":"2023-11-04T01:38:43.158133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165935+0000","last_change":"2023-11-04T01:38:23.405745+0000","last_active":"2023-11-04T01:38:43.165935+0000","last_peered":"2023-11-04T01:38:43.165935+0000","last_clean":"2023-11-04T01:38:43.165935+0000","last_became_active":"2023-11-04T01:38:21.071619+0000","last_became_peered":"2023-11-04T01:38:21.071619+0000","last_unstale":"2023-11-04T01:38:43.165935+0000","last_undegraded":"2023-11-04T01:38:43.165935+0000","last_fullsized":"2023-11-04T01:38:43.165935+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:56.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096848099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159617+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:38:43.159617+0000","last_peered":"2023-11-04T01:38:43.159617+0000","last_clean":"2023-11-04T01:38:43.159617+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:38:43.159617+0000","last_undegraded":"2023-11-04T01:38:43.159617+0000","last_fullsized":"2023-11-04T01:38:43.159617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194787+0000","last_change":"2023-11-04T01:38:44.191113+0000","last_active":"2023-11-04T01:38:44.194787+0000","last_peered":"2023-11-04T01:38:44.194787+0000","last_clean":"2023-11-04T01:38:44.194787+0000","last_became_active":"2023-11-04T01:38:44.189776+0000","last_became_peered":"2023-11-04T01:38:44.189776+0000","last_unstale":"2023-11-04T01:38:44.194787+0000","last_undegraded":"2023-11-04T01:38:44.194787+0000","last_fullsized":"2023-11-04T01:38:44.194787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.190328+0000","last_change":"2023-11-04T01:38:43.170433+0000","last_active":"2023-11-04T01:38:44.190328+0000","last_peered":"2023-11-04T01:38:44.190328+0000","last_clean":"2023-11-04T01:38:44.190328+0000","last_became_active":"2023-11-04T01:38:43.170133+0000","last_became_peered":"2023-11-04T01:38:43.170133+0000","last_unstale":"2023-11-04T01:38:44.190328+0000","last_undegraded":"2023-11-04T01:38:44.190328+0000","last_fullsized":"2023-11-04T01:38:44.190328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:35.173829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155910+0000","last_change":"2023-11-04T01:38:22.075348+0000","last_active":"2023-11-04T01:38:43.155910+0000","last_peered":"2023-11-04T01:38:43.155910+0000","last_clean":"2023-11-04T01:38:43.155910+0000","last_became_active":"2023-11-04T01:38:22.075069+0000","last_became_peered":"2023-11-04T01:38:22.075069+0000","last_unstale":"2023-11-04T01:38:43.155910+0000","last_undegraded":"2023-11-04T01:38:43.155910+0000","last_fullsized":"2023-11-04T01:38:43.155910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:06.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.157679+0000","last_change":"2023-11-04T01:38:23.062630+0000","last_active":"2023-11-04T01:38:43.157679+0000","last_peered":"2023-11-04T01:38:43.157679+0000","last_clean":"2023-11-04T01:38:43.157679+0000","last_became_active":"2023-11-04T01:38:21.066987+0000","last_became_peered":"2023-11-04T01:38:21.066987+0000","last_unstale":"2023-11-04T01:38:43.157679+0000","last_undegraded":"2023-11-04T01:38:43.157679+0000","last_fullsized":"2023-11-04T01:38:43.157679+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:48.254134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064188099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166256+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:38:43.166256+0000","last_peered":"2023-11-04T01:38:43.166256+0000","last_clean":"2023-11-04T01:38:43.166256+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:38:43.166256+0000","last_undegraded":"2023-11-04T01:38:43.166256+0000","last_fullsized":"2023-11-04T01:38:43.166256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194684+0000","last_change":"2023-11-04T01:38:44.190512+0000","last_active":"2023-11-04T01:38:44.194684+0000","last_peered":"2023-11-04T01:38:44.194684+0000","last_clean":"2023-11-04T01:38:44.194684+0000","last_became_active":"2023-11-04T01:38:44.189834+0000","last_became_peered":"2023-11-04T01:38:44.189834+0000","last_unstale":"2023-11-04T01:38:44.194684+0000","last_undegraded":"2023-11-04T01:38:44.194684+0000","last_fullsized":"2023-11-04T01:38:44.194684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:39.738471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169007+0000","last_change":"2023-11-04T01:38:43.171498+0000","last_active":"2023-11-04T01:38:44.169007+0000","last_peered":"2023-11-04T01:38:44.169007+0000","last_clean":"2023-11-04T01:38:44.169007+0000","last_became_active":"2023-11-04T01:38:43.168889+0000","last_became_peered":"2023-11-04T01:38:43.168889+0000","last_unstale":"2023-11-04T01:38:44.169007+0000","last_undegraded":"2023-11-04T01:38:44.169007+0000","last_fullsized":"2023-11-04T01:38:44.169007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:36.124325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161272+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:38:43.161272+0000","last_peered":"2023-11-04T01:38:43.161272+0000","last_clean":"2023-11-04T01:38:43.161272+0000","last_became_active":"2023-11-04T01:38:22.074743+0000","last_became_peered":"2023-11-04T01:38:22.074743+0000","last_unstale":"2023-11-04T01:38:43.161272+0000","last_undegraded":"2023-11-04T01:38:43.161272+0000","last_fullsized":"2023-11-04T01:38:43.161272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:33:48.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160173+0000","last_change":"2023-11-04T01:38:23.066643+0000","last_active":"2023-11-04T01:38:43.160173+0000","last_peered":"2023-11-04T01:38:43.160173+0000","last_clean":"2023-11-04T01:38:43.160173+0000","last_became_active":"2023-11-04T01:38:21.070223+0000","last_became_peered":"2023-11-04T01:38:21.070223+0000","last_unstale":"2023-11-04T01:38:43.160173+0000","last_undegraded":"2023-11-04T01:38:43.160173+0000","last_fullsized":"2023-11-04T01:38:43.160173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:52.001252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000522103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155642+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:38:43.155642+0000","last_peered":"2023-11-04T01:38:43.155642+0000","last_clean":"2023-11-04T01:38:43.155642+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:38:43.155642+0000","last_undegraded":"2023-11-04T01:38:43.155642+0000","last_fullsized":"2023-11-04T01:38:43.155642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183624+0000","last_change":"2023-11-04T01:38:44.178038+0000","last_active":"2023-11-04T01:38:44.183624+0000","last_peered":"2023-11-04T01:38:44.183624+0000","last_clean":"2023-11-04T01:38:44.183624+0000","last_became_active":"2023-11-04T01:38:44.177754+0000","last_became_peered":"2023-11-04T01:38:44.177754+0000","last_unstale":"2023-11-04T01:38:44.183624+0000","last_undegraded":"2023-11-04T01:38:44.183624+0000","last_fullsized":"2023-11-04T01:38:44.183624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:54.441008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172936+0000","last_change":"2023-11-04T01:38:43.169006+0000","last_active":"2023-11-04T01:38:44.172936+0000","last_peered":"2023-11-04T01:38:44.172936+0000","last_clean":"2023-11-04T01:38:44.172936+0000","last_became_active":"2023-11-04T01:38:43.168693+0000","last_became_peered":"2023-11-04T01:38:43.168693+0000","last_unstale":"2023-11-04T01:38:44.172936+0000","last_undegraded":"2023-11-04T01:38:44.172936+0000","last_fullsized":"2023-11-04T01:38:44.172936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:03.523253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160249+0000","last_change":"2023-11-04T01:38:22.075923+0000","last_active":"2023-11-04T01:38:43.160249+0000","last_peered":"2023-11-04T01:38:43.160249+0000","last_clean":"2023-11-04T01:38:43.160249+0000","last_became_active":"2023-11-04T01:38:22.075005+0000","last_became_peered":"2023-11-04T01:38:22.075005+0000","last_unstale":"2023-11-04T01:38:43.160249+0000","last_undegraded":"2023-11-04T01:38:43.160249+0000","last_fullsized":"2023-11-04T01:38:43.160249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:53.841576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163505+0000","last_change":"2023-11-04T01:38:23.327369+0000","last_active":"2023-11-04T01:38:43.163505+0000","last_peered":"2023-11-04T01:38:43.163505+0000","last_clean":"2023-11-04T01:38:43.163505+0000","last_became_active":"2023-11-04T01:38:21.071839+0000","last_became_peered":"2023-11-04T01:38:21.071839+0000","last_unstale":"2023-11-04T01:38:43.163505+0000","last_undegraded":"2023-11-04T01:38:43.163505+0000","last_fullsized":"2023-11-04T01:38:43.163505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:41.422222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044534300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160260+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:38:43.160260+0000","last_peered":"2023-11-04T01:38:43.160260+0000","last_clean":"2023-11-04T01:38:43.160260+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:38:43.160260+0000","last_undegraded":"2023-11-04T01:38:43.160260+0000","last_fullsized":"2023-11-04T01:38:43.160260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173773+0000","last_change":"2023-11-04T01:38:44.172217+0000","last_active":"2023-11-04T01:38:44.173773+0000","last_peered":"2023-11-04T01:38:44.173773+0000","last_clean":"2023-11-04T01:38:44.173773+0000","last_became_active":"2023-11-04T01:38:44.171955+0000","last_became_peered":"2023-11-04T01:38:44.171955+0000","last_unstale":"2023-11-04T01:38:44.173773+0000","last_undegraded":"2023-11-04T01:38:44.173773+0000","last_fullsized":"2023-11-04T01:38:44.173773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:38.606969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172129+0000","last_change":"2023-11-04T01:38:43.168304+0000","last_active":"2023-11-04T01:38:44.172129+0000","last_peered":"2023-11-04T01:38:44.172129+0000","last_clean":"2023-11-04T01:38:44.172129+0000","last_became_active":"2023-11-04T01:38:43.168021+0000","last_became_peered":"2023-11-04T01:38:43.168021+0000","last_unstale":"2023-11-04T01:38:44.172129+0000","last_undegraded":"2023-11-04T01:38:44.172129+0000","last_fullsized":"2023-11-04T01:38:44.172129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:47.494541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163828+0000","last_change":"2023-11-04T01:38:22.072700+0000","last_active":"2023-11-04T01:38:43.163828+0000","last_peered":"2023-11-04T01:38:43.163828+0000","last_clean":"2023-11-04T01:38:43.163828+0000","last_became_active":"2023-11-04T01:38:22.072280+0000","last_became_peered":"2023-11-04T01:38:22.072280+0000","last_unstale":"2023-11-04T01:38:43.163828+0000","last_undegraded":"2023-11-04T01:38:43.163828+0000","last_fullsized":"2023-11-04T01:38:43.163828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163938+0000","last_change":"2023-11-04T01:38:23.327480+0000","last_active":"2023-11-04T01:38:43.163938+0000","last_peered":"2023-11-04T01:38:43.163938+0000","last_clean":"2023-11-04T01:38:43.163938+0000","last_became_active":"2023-11-04T01:38:21.071005+0000","last_became_peered":"2023-11-04T01:38:21.071005+0000","last_unstale":"2023-11-04T01:38:43.163938+0000","last_undegraded":"2023-11-04T01:38:43.163938+0000","last_fullsized":"2023-11-04T01:38:43.163938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:25.393510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081827400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163571+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:38:43.163571+0000","last_peered":"2023-11-04T01:38:43.163571+0000","last_clean":"2023-11-04T01:38:43.163571+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:38:43.163571+0000","last_undegraded":"2023-11-04T01:38:43.163571+0000","last_fullsized":"2023-11-04T01:38:43.163571+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184150+0000","last_change":"2023-11-04T01:38:44.178811+0000","last_active":"2023-11-04T01:38:44.184150+0000","last_peered":"2023-11-04T01:38:44.184150+0000","last_clean":"2023-11-04T01:38:44.184150+0000","last_became_active":"2023-11-04T01:38:44.178569+0000","last_became_peered":"2023-11-04T01:38:44.178569+0000","last_unstale":"2023-11-04T01:38:44.184150+0000","last_undegraded":"2023-11-04T01:38:44.184150+0000","last_fullsized":"2023-11-04T01:38:44.184150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:40.736345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192699+0000","last_change":"2023-11-04T01:38:43.173478+0000","last_active":"2023-11-04T01:38:44.192699+0000","last_peered":"2023-11-04T01:38:44.192699+0000","last_clean":"2023-11-04T01:38:44.192699+0000","last_became_active":"2023-11-04T01:38:43.173212+0000","last_became_peered":"2023-11-04T01:38:43.173212+0000","last_unstale":"2023-11-04T01:38:44.192699+0000","last_undegraded":"2023-11-04T01:38:44.192699+0000","last_fullsized":"2023-11-04T01:38:44.192699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:13.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158975+0000","last_change":"2023-11-04T01:38:22.070891+0000","last_active":"2023-11-04T01:38:43.158975+0000","last_peered":"2023-11-04T01:38:43.158975+0000","last_clean":"2023-11-04T01:38:43.158975+0000","last_became_active":"2023-11-04T01:38:22.070338+0000","last_became_peered":"2023-11-04T01:38:22.070338+0000","last_unstale":"2023-11-04T01:38:43.158975+0000","last_undegraded":"2023-11-04T01:38:43.158975+0000","last_fullsized":"2023-11-04T01:38:43.158975+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:21.863324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159017+0000","last_change":"2023-11-04T01:38:23.066474+0000","last_active":"2023-11-04T01:38:43.159017+0000","last_peered":"2023-11-04T01:38:43.159017+0000","last_clean":"2023-11-04T01:38:43.159017+0000","last_became_active":"2023-11-04T01:38:21.069750+0000","last_became_peered":"2023-11-04T01:38:21.069750+0000","last_unstale":"2023-11-04T01:38:43.159017+0000","last_undegraded":"2023-11-04T01:38:43.159017+0000","last_fullsized":"2023-11-04T01:38:43.159017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:07.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045060599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163050+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:38:43.163050+0000","last_peered":"2023-11-04T01:38:43.163050+0000","last_clean":"2023-11-04T01:38:43.163050+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:38:43.163050+0000","last_undegraded":"2023-11-04T01:38:43.163050+0000","last_fullsized":"2023-11-04T01:38:43.163050+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.185231+0000","last_change":"2023-11-04T01:38:44.179424+0000","last_active":"2023-11-04T01:38:44.185231+0000","last_peered":"2023-11-04T01:38:44.185231+0000","last_clean":"2023-11-04T01:38:44.185231+0000","last_became_active":"2023-11-04T01:38:44.179146+0000","last_became_peered":"2023-11-04T01:38:44.179146+0000","last_unstale":"2023-11-04T01:38:44.185231+0000","last_undegraded":"2023-11-04T01:38:44.185231+0000","last_fullsized":"2023-11-04T01:38:44.185231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:53:40.362544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186463+0000","last_change":"2023-11-04T01:38:43.173576+0000","last_active":"2023-11-04T01:38:44.186463+0000","last_peered":"2023-11-04T01:38:44.186463+0000","last_clean":"2023-11-04T01:38:44.186463+0000","last_became_active":"2023-11-04T01:38:43.173281+0000","last_became_peered":"2023-11-04T01:38:43.173281+0000","last_unstale":"2023-11-04T01:38:44.186463+0000","last_undegraded":"2023-11-04T01:38:44.186463+0000","last_fullsized":"2023-11-04T01:38:44.186463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:48.213177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149664+0000","last_change":"2023-11-04T01:38:22.076759+0000","last_active":"2023-11-04T01:38:43.149664+0000","last_peered":"2023-11-04T01:38:43.149664+0000","last_clean":"2023-11-04T01:38:43.149664+0000","last_became_active":"2023-11-04T01:38:22.075797+0000","last_became_peered":"2023-11-04T01:38:22.075797+0000","last_unstale":"2023-11-04T01:38:43.149664+0000","last_undegraded":"2023-11-04T01:38:43.149664+0000","last_fullsized":"2023-11-04T01:38:43.149664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:57.170559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160932+0000","last_change":"2023-11-04T01:38:23.061342+0000","last_active":"2023-11-04T01:38:43.160932+0000","last_peered":"2023-11-04T01:38:43.160932+0000","last_clean":"2023-11-04T01:38:43.160932+0000","last_became_active":"2023-11-04T01:38:21.070645+0000","last_became_peered":"2023-11-04T01:38:21.070645+0000","last_unstale":"2023-11-04T01:38:43.160932+0000","last_undegraded":"2023-11-04T01:38:43.160932+0000","last_fullsized":"2023-11-04T01:38:43.160932+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053603500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.170183+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:38:43.170183+0000","last_peered":"2023-11-04T01:38:43.170183+0000","last_clean":"2023-11-04T01:38:43.170183+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:38:43.170183+0000","last_undegraded":"2023-11-04T01:38:43.170183+0000","last_fullsized":"2023-11-04T01:38:43.170183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":222,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162595+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:38:43.162595+0000","last_peered":"2023-11-04T01:38:43.162595+0000","last_clean":"2023-11-04T01:38:43.162595+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:38:43.162595+0000","last_undegraded":"2023-11-04T01:38:43.162595+0000","last_fullsized":"2023-11-04T01:38:43.162595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":1572864,"data_stored":1061563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70599999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69699999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":0.755},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.29299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":0.872,"15min":0.872},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":470176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626}]},{"osd":1,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.504}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63900000000000001,"5min":0.752,"15min":0.752},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.499}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.78800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":0.752},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70999999999999996,"5min":0.75,"15min":0.75},"last":0.433}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29699999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.318}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.505}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":1.133,"15min":1.133},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.65400000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.77100000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34999999999999998,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.502,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.375},"min":{"1min":0.29899999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72599999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.72199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.876,"15min":0.876},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.438},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.628},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.54600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":479353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.312},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.24199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40200000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1069284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.311,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42199999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.316}]},{"osd":2,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.46999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.502,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":1.048,"15min":1.048},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73199999999999998,"5min":1.056,"15min":1.056},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72199999999999998,"5min":0.874,"15min":0.874},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.67500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:47.126 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.253+0000 7f88e5fa9640 1 Processor -- start 2023-11-04T01:38:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 -- start start 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88e015bfb0 0x7f88e00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e00cd860 0x7f88e00ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00cc450 con 0x7f88e015ae40 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e015f400 con 0x7f88e015bfb0 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88e5fa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e015b220 con 0x7f88e00cd860 2023-11-04T01:38:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88deffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88e015bfb0 0x7f88e00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88df7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f88e015ae40 0x7f88e00cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49856/0 (socket says 172.21.15.93:49856) 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.254+0000 7f88df7fe640 1 -- 172.21.15.93:0/2767147579 learned_addr learned my addr 172.21.15.93:0/2767147579 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88dffff640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e00cd860 0x7f88e00ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88deffd640 1 -- 172.21.15.93:0/2767147579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e00cd860 msgr2=0x7f88e00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88deffd640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e00cd860 0x7f88e00ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88deffd640 1 -- 172.21.15.93:0/2767147579 >> v1:172.21.15.93:6789/0 conn(0x7f88e015ae40 legacy=0x7f88e00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88deffd640 1 -- 172.21.15.93:0/2767147579 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e015f890 con 0x7f88e015bfb0 2023-11-04T01:38:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88de7fc640 1 -- 172.21.15.93:0/2767147579 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162485629 0 0) 0x7f88d0001110 con 0x7f88e015ae40 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.255+0000 7f88deffd640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e00cd320 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd34226d7eb35f21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88de7fc640 1 -- 172.21.15.93:0/2767147579 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4031830 con 0x7f88e015bfb0 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88de7fc640 1 -- 172.21.15.93:0/2767147579 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4031990 con 0x7f88e015bfb0 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88de7fc640 1 -- 172.21.15.93:0/2767147579 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4031d20 con 0x7f88e015bfb0 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 -- 172.21.15.93:0/2767147579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 msgr2=0x7f88e00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e00cd320 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 -- 172.21.15.93:0/2767147579 shutdown_connections 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e00cd860 0x7f88e00ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/2767147579 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e00cd320 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 -- 172.21.15.93:0/2767147579 >> 172.21.15.93:0/2767147579 conn(0x7f88e006ea90 msgr2=0x7f88e006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 -- 172.21.15.93:0/2767147579 shutdown_connections 2023-11-04T01:38:47.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.256+0000 7f88e5fa9640 1 -- 172.21.15.93:0/2767147579 wait complete. 2023-11-04T01:38:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.257+0000 7f88e5fa9640 1 Processor -- start 2023-11-04T01:38:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 -- start start 2023-11-04T01:38:47.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e00cd860 0x7f88e014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 0x7f88e0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e014f3a0 con 0x7f88e015bfb0 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c5700 con 0x7f88e00cd860 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88e5fa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c5950 con 0x7f88e015ae40 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88dffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88dffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38852/0 (socket says 172.21.15.93:38852) 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88dffff640 1 -- 172.21.15.93:0/4228566828 learned_addr learned my addr 172.21.15.93:0/4228566828 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88df7fe640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e00cd860 0x7f88e014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.258+0000 7f88deffd640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 0x7f88e0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 -- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 msgr2=0x7f88e0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 0x7f88e0152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 -- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e00cd860 msgr2=0x7f88e014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e00cd860 0x7f88e014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 -- 172.21.15.93:0/4228566828 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009400 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88deffd640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 0x7f88e0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88dffff640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007e40 tx=0x7f88d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8014620 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800ee90 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00c5c30 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80149e0 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.259+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00c61f0 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.260+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00ce2d0 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.260+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88d8014b40 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.261+0000 7f88c7fff640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.261+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f88d808a3c0 con 0x7f88e015bfb0 2023-11-04T01:38:47.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.261+0000 7f88df7fe640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.261+0000 7f88df7fe640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f60 tx=0x7f88d0007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.265+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88d8054f90 con 0x7f88e015bfb0 2023-11-04T01:38:47.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.428+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88e00c5ac0 con 0x7f88cc06ae70 2023-11-04T01:38:47.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.440+0000 7f88c7fff640 1 -- 172.21.15.93:0/4228566828 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532203 (secure 0 0 0) 0x7f88e00c5ac0 con 0x7f88cc06ae70 2023-11-04T01:38:47.448 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:47.452 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:38:47.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 msgr2=0x7f88cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f60 tx=0x7f88d0007b90 comp rx=0 tx=0).stop 2023-11-04T01:38:47.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 msgr2=0x7f88e015cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007e40 tx=0x7f88d800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 shutdown_connections 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88e015bfb0 0x7f88e015cea0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f88e015ae40 0x7f88e0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 --2- 172.21.15.93:0/4228566828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88e00cd860 0x7f88e014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.444+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 >> 172.21.15.93:0/4228566828 conn(0x7f88e006ea90 msgr2=0x7f88e00b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.445+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 shutdown_connections 2023-11-04T01:38:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.445+0000 7f88e5fa9640 1 -- 172.21.15.93:0/4228566828 wait complete. 2023-11-04T01:38:47.458 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-11-04T01:38:47.362897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229156,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754745564,"statfs":{"total":773094113280,"available":772859457536,"internally_reserved":0,"allocated":9039872,"data_stored":4965156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.217861"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192328+0000","last_change":"2023-11-04T01:38:44.184278+0000","last_active":"2023-11-04T01:38:44.192328+0000","last_peered":"2023-11-04T01:38:44.192328+0000","last_clean":"2023-11-04T01:38:44.192328+0000","last_became_active":"2023-11-04T01:38:44.183373+0000","last_became_peered":"2023-11-04T01:38:44.183373+0000","last_unstale":"2023-11-04T01:38:44.192328+0000","last_undegraded":"2023-11-04T01:38:44.192328+0000","last_fullsized":"2023-11-04T01:38:44.192328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:11.000661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186735+0000","last_change":"2023-11-04T01:38:44.181495+0000","last_active":"2023-11-04T01:38:44.186735+0000","last_peered":"2023-11-04T01:38:44.186735+0000","last_clean":"2023-11-04T01:38:44.186735+0000","last_became_active":"2023-11-04T01:38:44.180705+0000","last_became_peered":"2023-11-04T01:38:44.180705+0000","last_unstale":"2023-11-04T01:38:44.186735+0000","last_undegraded":"2023-11-04T01:38:44.186735+0000","last_fullsized":"2023-11-04T01:38:44.186735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:41.091836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192190+0000","last_change":"2023-11-04T01:38:44.183012+0000","last_active":"2023-11-04T01:38:44.192190+0000","last_peered":"2023-11-04T01:38:44.192190+0000","last_clean":"2023-11-04T01:38:44.192190+0000","last_became_active":"2023-11-04T01:38:44.182705+0000","last_became_peered":"2023-11-04T01:38:44.182705+0000","last_unstale":"2023-11-04T01:38:44.192190+0000","last_undegraded":"2023-11-04T01:38:44.192190+0000","last_fullsized":"2023-11-04T01:38:44.192190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:43.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189398+0000","last_change":"2023-11-04T01:38:44.184507+0000","last_active":"2023-11-04T01:38:44.189398+0000","last_peered":"2023-11-04T01:38:44.189398+0000","last_clean":"2023-11-04T01:38:44.189398+0000","last_became_active":"2023-11-04T01:38:44.184212+0000","last_became_peered":"2023-11-04T01:38:44.184212+0000","last_unstale":"2023-11-04T01:38:44.189398+0000","last_undegraded":"2023-11-04T01:38:44.189398+0000","last_fullsized":"2023-11-04T01:38:44.189398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:28.740971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189682+0000","last_change":"2023-11-04T01:38:44.180922+0000","last_active":"2023-11-04T01:38:44.189682+0000","last_peered":"2023-11-04T01:38:44.189682+0000","last_clean":"2023-11-04T01:38:44.189682+0000","last_became_active":"2023-11-04T01:38:44.180657+0000","last_became_peered":"2023-11-04T01:38:44.180657+0000","last_unstale":"2023-11-04T01:38:44.189682+0000","last_undegraded":"2023-11-04T01:38:44.189682+0000","last_fullsized":"2023-11-04T01:38:44.189682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:11.359483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192071+0000","last_change":"2023-11-04T01:38:44.187350+0000","last_active":"2023-11-04T01:38:44.192071+0000","last_peered":"2023-11-04T01:38:44.192071+0000","last_clean":"2023-11-04T01:38:44.192071+0000","last_became_active":"2023-11-04T01:38:44.187071+0000","last_became_peered":"2023-11-04T01:38:44.187071+0000","last_unstale":"2023-11-04T01:38:44.192071+0000","last_undegraded":"2023-11-04T01:38:44.192071+0000","last_fullsized":"2023-11-04T01:38:44.192071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:31.652186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192054+0000","last_change":"2023-11-04T01:38:44.187495+0000","last_active":"2023-11-04T01:38:44.192054+0000","last_peered":"2023-11-04T01:38:44.192054+0000","last_clean":"2023-11-04T01:38:44.192054+0000","last_became_active":"2023-11-04T01:38:44.187208+0000","last_became_peered":"2023-11-04T01:38:44.187208+0000","last_unstale":"2023-11-04T01:38:44.192054+0000","last_undegraded":"2023-11-04T01:38:44.192054+0000","last_fullsized":"2023-11-04T01:38:44.192054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:57.689599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187203+0000","last_change":"2023-11-04T01:38:44.182567+0000","last_active":"2023-11-04T01:38:44.187203+0000","last_peered":"2023-11-04T01:38:44.187203+0000","last_clean":"2023-11-04T01:38:44.187203+0000","last_became_active":"2023-11-04T01:38:44.182312+0000","last_became_peered":"2023-11-04T01:38:44.182312+0000","last_unstale":"2023-11-04T01:38:44.187203+0000","last_undegraded":"2023-11-04T01:38:44.187203+0000","last_fullsized":"2023-11-04T01:38:44.187203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:28.740971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188714+0000","last_change":"2023-11-04T01:38:44.178763+0000","last_active":"2023-11-04T01:38:44.188714+0000","last_peered":"2023-11-04T01:38:44.188714+0000","last_clean":"2023-11-04T01:38:44.188714+0000","last_became_active":"2023-11-04T01:38:44.178474+0000","last_became_peered":"2023-11-04T01:38:44.178474+0000","last_unstale":"2023-11-04T01:38:44.188714+0000","last_undegraded":"2023-11-04T01:38:44.188714+0000","last_fullsized":"2023-11-04T01:38:44.188714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:11.359483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189414+0000","last_change":"2023-11-04T01:38:44.182626+0000","last_active":"2023-11-04T01:38:44.189414+0000","last_peered":"2023-11-04T01:38:44.189414+0000","last_clean":"2023-11-04T01:38:44.189414+0000","last_became_active":"2023-11-04T01:38:44.181286+0000","last_became_peered":"2023-11-04T01:38:44.181286+0000","last_unstale":"2023-11-04T01:38:44.189414+0000","last_undegraded":"2023-11-04T01:38:44.189414+0000","last_fullsized":"2023-11-04T01:38:44.189414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:32.097650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186708+0000","last_change":"2023-11-04T01:38:44.179447+0000","last_active":"2023-11-04T01:38:44.186708+0000","last_peered":"2023-11-04T01:38:44.186708+0000","last_clean":"2023-11-04T01:38:44.186708+0000","last_became_active":"2023-11-04T01:38:44.179199+0000","last_became_peered":"2023-11-04T01:38:44.179199+0000","last_unstale":"2023-11-04T01:38:44.186708+0000","last_undegraded":"2023-11-04T01:38:44.186708+0000","last_fullsized":"2023-11-04T01:38:44.186708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:46.314385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.175655+0000","last_change":"2023-11-04T01:38:44.168544+0000","last_active":"2023-11-04T01:38:44.175655+0000","last_peered":"2023-11-04T01:38:44.175655+0000","last_clean":"2023-11-04T01:38:44.175655+0000","last_became_active":"2023-11-04T01:38:44.168302+0000","last_became_peered":"2023-11-04T01:38:44.168302+0000","last_unstale":"2023-11-04T01:38:44.175655+0000","last_undegraded":"2023-11-04T01:38:44.175655+0000","last_fullsized":"2023-11-04T01:38:44.175655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:39.738471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182273+0000","last_change":"2023-11-04T01:38:44.179516+0000","last_active":"2023-11-04T01:38:44.182273+0000","last_peered":"2023-11-04T01:38:44.182273+0000","last_clean":"2023-11-04T01:38:44.182273+0000","last_became_active":"2023-11-04T01:38:44.179245+0000","last_became_peered":"2023-11-04T01:38:44.179245+0000","last_unstale":"2023-11-04T01:38:44.182273+0000","last_undegraded":"2023-11-04T01:38:44.182273+0000","last_fullsized":"2023-11-04T01:38:44.182273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:58.457869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194773+0000","last_change":"2023-11-04T01:38:44.190224+0000","last_active":"2023-11-04T01:38:44.194773+0000","last_peered":"2023-11-04T01:38:44.194773+0000","last_clean":"2023-11-04T01:38:44.194773+0000","last_became_active":"2023-11-04T01:38:44.189957+0000","last_became_peered":"2023-11-04T01:38:44.189957+0000","last_unstale":"2023-11-04T01:38:44.194773+0000","last_undegraded":"2023-11-04T01:38:44.194773+0000","last_fullsized":"2023-11-04T01:38:44.194773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:44:13.795744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182323+0000","last_change":"2023-11-04T01:38:44.180629+0000","last_active":"2023-11-04T01:38:44.182323+0000","last_peered":"2023-11-04T01:38:44.182323+0000","last_clean":"2023-11-04T01:38:44.182323+0000","last_became_active":"2023-11-04T01:38:44.180332+0000","last_became_peered":"2023-11-04T01:38:44.180332+0000","last_unstale":"2023-11-04T01:38:44.182323+0000","last_undegraded":"2023-11-04T01:38:44.182323+0000","last_fullsized":"2023-11-04T01:38:44.182323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:36.888737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.191844+0000","last_change":"2023-11-04T01:38:44.186716+0000","last_active":"2023-11-04T01:38:44.191844+0000","last_peered":"2023-11-04T01:38:44.191844+0000","last_clean":"2023-11-04T01:38:44.191844+0000","last_became_active":"2023-11-04T01:38:44.186377+0000","last_became_peered":"2023-11-04T01:38:44.186377+0000","last_unstale":"2023-11-04T01:38:44.191844+0000","last_undegraded":"2023-11-04T01:38:44.191844+0000","last_fullsized":"2023-11-04T01:38:44.191844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:16.196865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187918+0000","last_change":"2023-11-04T01:38:44.186795+0000","last_active":"2023-11-04T01:38:44.187918+0000","last_peered":"2023-11-04T01:38:44.187918+0000","last_clean":"2023-11-04T01:38:44.187918+0000","last_became_active":"2023-11-04T01:38:44.184943+0000","last_became_peered":"2023-11-04T01:38:44.184943+0000","last_unstale":"2023-11-04T01:38:44.187918+0000","last_undegraded":"2023-11-04T01:38:44.187918+0000","last_fullsized":"2023-11-04T01:38:44.187918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:49.217495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184330+0000","last_change":"2023-11-04T01:38:44.182773+0000","last_active":"2023-11-04T01:38:44.184330+0000","last_peered":"2023-11-04T01:38:44.184330+0000","last_clean":"2023-11-04T01:38:44.184330+0000","last_became_active":"2023-11-04T01:38:44.182517+0000","last_became_peered":"2023-11-04T01:38:44.182517+0000","last_unstale":"2023-11-04T01:38:44.184330+0000","last_undegraded":"2023-11-04T01:38:44.184330+0000","last_fullsized":"2023-11-04T01:38:44.184330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:12.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183921+0000","last_change":"2023-11-04T01:38:44.178614+0000","last_active":"2023-11-04T01:38:44.183921+0000","last_peered":"2023-11-04T01:38:44.183921+0000","last_clean":"2023-11-04T01:38:44.183921+0000","last_became_active":"2023-11-04T01:38:44.178314+0000","last_became_peered":"2023-11-04T01:38:44.178314+0000","last_unstale":"2023-11-04T01:38:44.183921+0000","last_undegraded":"2023-11-04T01:38:44.183921+0000","last_fullsized":"2023-11-04T01:38:44.183921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:24.377625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188707+0000","last_change":"2023-11-04T01:38:44.178963+0000","last_active":"2023-11-04T01:38:44.188707+0000","last_peered":"2023-11-04T01:38:44.188707+0000","last_clean":"2023-11-04T01:38:44.188707+0000","last_became_active":"2023-11-04T01:38:44.178682+0000","last_became_peered":"2023-11-04T01:38:44.178682+0000","last_unstale":"2023-11-04T01:38:44.188707+0000","last_undegraded":"2023-11-04T01:38:44.188707+0000","last_fullsized":"2023-11-04T01:38:44.188707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:04.527571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184773+0000","last_change":"2023-11-04T01:38:44.181958+0000","last_active":"2023-11-04T01:38:44.184773+0000","last_peered":"2023-11-04T01:38:44.184773+0000","last_clean":"2023-11-04T01:38:44.184773+0000","last_became_active":"2023-11-04T01:38:44.181709+0000","last_became_peered":"2023-11-04T01:38:44.181709+0000","last_unstale":"2023-11-04T01:38:44.184773+0000","last_undegraded":"2023-11-04T01:38:44.184773+0000","last_fullsized":"2023-11-04T01:38:44.184773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:54.007155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186199+0000","last_change":"2023-11-04T01:38:44.178830+0000","last_active":"2023-11-04T01:38:44.186199+0000","last_peered":"2023-11-04T01:38:44.186199+0000","last_clean":"2023-11-04T01:38:44.186199+0000","last_became_active":"2023-11-04T01:38:44.178579+0000","last_became_peered":"2023-11-04T01:38:44.178579+0000","last_unstale":"2023-11-04T01:38:44.186199+0000","last_undegraded":"2023-11-04T01:38:44.186199+0000","last_fullsized":"2023-11-04T01:38:44.186199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:28.863609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187480+0000","last_change":"2023-11-04T01:38:44.181392+0000","last_active":"2023-11-04T01:38:44.187480+0000","last_peered":"2023-11-04T01:38:44.187480+0000","last_clean":"2023-11-04T01:38:44.187480+0000","last_became_active":"2023-11-04T01:38:44.180425+0000","last_became_peered":"2023-11-04T01:38:44.180425+0000","last_unstale":"2023-11-04T01:38:44.187480+0000","last_undegraded":"2023-11-04T01:38:44.187480+0000","last_fullsized":"2023-11-04T01:38:44.187480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:56.720079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189171+0000","last_change":"2023-11-04T01:38:44.185402+0000","last_active":"2023-11-04T01:38:44.189171+0000","last_peered":"2023-11-04T01:38:44.189171+0000","last_clean":"2023-11-04T01:38:44.189171+0000","last_became_active":"2023-11-04T01:38:44.185129+0000","last_became_peered":"2023-11-04T01:38:44.185129+0000","last_unstale":"2023-11-04T01:38:44.189171+0000","last_undegraded":"2023-11-04T01:38:44.189171+0000","last_fullsized":"2023-11-04T01:38:44.189171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:24.718401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194766+0000","last_change":"2023-11-04T01:38:44.191096+0000","last_active":"2023-11-04T01:38:44.194766+0000","last_peered":"2023-11-04T01:38:44.194766+0000","last_clean":"2023-11-04T01:38:44.194766+0000","last_became_active":"2023-11-04T01:38:44.190495+0000","last_became_peered":"2023-11-04T01:38:44.190495+0000","last_unstale":"2023-11-04T01:38:44.194766+0000","last_undegraded":"2023-11-04T01:38:44.194766+0000","last_fullsized":"2023-11-04T01:38:44.194766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:36.178146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187938+0000","last_change":"2023-11-04T01:38:44.187065+0000","last_active":"2023-11-04T01:38:44.187938+0000","last_peered":"2023-11-04T01:38:44.187938+0000","last_clean":"2023-11-04T01:38:44.187938+0000","last_became_active":"2023-11-04T01:38:44.186807+0000","last_became_peered":"2023-11-04T01:38:44.186807+0000","last_unstale":"2023-11-04T01:38:44.187938+0000","last_undegraded":"2023-11-04T01:38:44.187938+0000","last_fullsized":"2023-11-04T01:38:44.187938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:58.457869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189033+0000","last_change":"2023-11-04T01:38:44.184809+0000","last_active":"2023-11-04T01:38:44.189033+0000","last_peered":"2023-11-04T01:38:44.189033+0000","last_clean":"2023-11-04T01:38:44.189033+0000","last_became_active":"2023-11-04T01:38:44.184535+0000","last_became_peered":"2023-11-04T01:38:44.184535+0000","last_unstale":"2023-11-04T01:38:44.189033+0000","last_undegraded":"2023-11-04T01:38:44.189033+0000","last_fullsized":"2023-11-04T01:38:44.189033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:26:32.157525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194699+0000","last_change":"2023-11-04T01:38:44.190338+0000","last_active":"2023-11-04T01:38:44.194699+0000","last_peered":"2023-11-04T01:38:44.194699+0000","last_clean":"2023-11-04T01:38:44.194699+0000","last_became_active":"2023-11-04T01:38:44.189800+0000","last_became_peered":"2023-11-04T01:38:44.189800+0000","last_unstale":"2023-11-04T01:38:44.194699+0000","last_undegraded":"2023-11-04T01:38:44.194699+0000","last_fullsized":"2023-11-04T01:38:44.194699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189046+0000","last_change":"2023-11-04T01:38:44.187676+0000","last_active":"2023-11-04T01:38:44.189046+0000","last_peered":"2023-11-04T01:38:44.189046+0000","last_clean":"2023-11-04T01:38:44.189046+0000","last_became_active":"2023-11-04T01:38:44.187405+0000","last_became_peered":"2023-11-04T01:38:44.187405+0000","last_unstale":"2023-11-04T01:38:44.189046+0000","last_undegraded":"2023-11-04T01:38:44.189046+0000","last_fullsized":"2023-11-04T01:38:44.189046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:35.470620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183601+0000","last_change":"2023-11-04T01:38:44.178290+0000","last_active":"2023-11-04T01:38:44.183601+0000","last_peered":"2023-11-04T01:38:44.183601+0000","last_clean":"2023-11-04T01:38:44.183601+0000","last_became_active":"2023-11-04T01:38:44.177902+0000","last_became_peered":"2023-11-04T01:38:44.177902+0000","last_unstale":"2023-11-04T01:38:44.183601+0000","last_undegraded":"2023-11-04T01:38:44.183601+0000","last_fullsized":"2023-11-04T01:38:44.183601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:12.912824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194757+0000","last_change":"2023-11-04T01:38:44.191451+0000","last_active":"2023-11-04T01:38:44.194757+0000","last_peered":"2023-11-04T01:38:44.194757+0000","last_clean":"2023-11-04T01:38:44.194757+0000","last_became_active":"2023-11-04T01:38:44.191130+0000","last_became_peered":"2023-11-04T01:38:44.191130+0000","last_unstale":"2023-11-04T01:38:44.194757+0000","last_undegraded":"2023-11-04T01:38:44.194757+0000","last_fullsized":"2023-11-04T01:38:44.194757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:35.470620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178781+0000","last_change":"2023-11-04T01:38:44.173929+0000","last_active":"2023-11-04T01:38:44.178781+0000","last_peered":"2023-11-04T01:38:44.178781+0000","last_clean":"2023-11-04T01:38:44.178781+0000","last_became_active":"2023-11-04T01:38:44.173698+0000","last_became_peered":"2023-11-04T01:38:44.173698+0000","last_unstale":"2023-11-04T01:38:44.178781+0000","last_undegraded":"2023-11-04T01:38:44.178781+0000","last_fullsized":"2023-11-04T01:38:44.178781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:37.924463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192088+0000","last_change":"2023-11-04T01:38:44.188018+0000","last_active":"2023-11-04T01:38:44.192088+0000","last_peered":"2023-11-04T01:38:44.192088+0000","last_clean":"2023-11-04T01:38:44.192088+0000","last_became_active":"2023-11-04T01:38:44.187731+0000","last_became_peered":"2023-11-04T01:38:44.187731+0000","last_unstale":"2023-11-04T01:38:44.192088+0000","last_undegraded":"2023-11-04T01:38:44.192088+0000","last_fullsized":"2023-11-04T01:38:44.192088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:08.443797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"81'6","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.197047+0000","last_change":"2023-11-04T01:38:43.165254+0000","last_active":"2023-11-04T01:38:44.197047+0000","last_peered":"2023-11-04T01:38:44.197047+0000","last_clean":"2023-11-04T01:38:44.197047+0000","last_became_active":"2023-11-04T01:38:43.164965+0000","last_became_peered":"2023-11-04T01:38:43.164965+0000","last_unstale":"2023-11-04T01:38:44.197047+0000","last_undegraded":"2023-11-04T01:38:44.197047+0000","last_fullsized":"2023-11-04T01:38:44.197047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163931+0000","last_change":"2023-11-04T01:38:22.072453+0000","last_active":"2023-11-04T01:38:43.163931+0000","last_peered":"2023-11-04T01:38:43.163931+0000","last_clean":"2023-11-04T01:38:43.163931+0000","last_became_active":"2023-11-04T01:38:22.071910+0000","last_became_peered":"2023-11-04T01:38:22.071910+0000","last_unstale":"2023-11-04T01:38:43.163931+0000","last_undegraded":"2023-11-04T01:38:43.163931+0000","last_fullsized":"2023-11-04T01:38:43.163931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164988+0000","last_change":"2023-11-04T01:38:23.405090+0000","last_active":"2023-11-04T01:38:43.164988+0000","last_peered":"2023-11-04T01:38:43.164988+0000","last_clean":"2023-11-04T01:38:43.164988+0000","last_became_active":"2023-11-04T01:38:21.069416+0000","last_became_peered":"2023-11-04T01:38:21.069416+0000","last_unstale":"2023-11-04T01:38:43.164988+0000","last_undegraded":"2023-11-04T01:38:43.164988+0000","last_fullsized":"2023-11-04T01:38:43.164988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:08.663648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078635399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150168+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:38:43.150168+0000","last_peered":"2023-11-04T01:38:43.150168+0000","last_clean":"2023-11-04T01:38:43.150168+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:38:43.150168+0000","last_undegraded":"2023-11-04T01:38:43.150168+0000","last_fullsized":"2023-11-04T01:38:43.150168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194720+0000","last_change":"2023-11-04T01:38:44.190637+0000","last_active":"2023-11-04T01:38:44.194720+0000","last_peered":"2023-11-04T01:38:44.194720+0000","last_clean":"2023-11-04T01:38:44.194720+0000","last_became_active":"2023-11-04T01:38:44.189868+0000","last_became_peered":"2023-11-04T01:38:44.189868+0000","last_unstale":"2023-11-04T01:38:44.194720+0000","last_undegraded":"2023-11-04T01:38:44.194720+0000","last_fullsized":"2023-11-04T01:38:44.194720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:04.527571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"81'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189247+0000","last_change":"2023-11-04T01:38:43.167599+0000","last_active":"2023-11-04T01:38:44.189247+0000","last_peered":"2023-11-04T01:38:44.189247+0000","last_clean":"2023-11-04T01:38:44.189247+0000","last_became_active":"2023-11-04T01:38:43.167348+0000","last_became_peered":"2023-11-04T01:38:43.167348+0000","last_unstale":"2023-11-04T01:38:44.189247+0000","last_undegraded":"2023-11-04T01:38:44.189247+0000","last_fullsized":"2023-11-04T01:38:44.189247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:47.431830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162583+0000","last_change":"2023-11-04T01:38:22.076676+0000","last_active":"2023-11-04T01:38:43.162583+0000","last_peered":"2023-11-04T01:38:43.162583+0000","last_clean":"2023-11-04T01:38:43.162583+0000","last_became_active":"2023-11-04T01:38:22.076358+0000","last_became_peered":"2023-11-04T01:38:22.076358+0000","last_unstale":"2023-11-04T01:38:43.162583+0000","last_undegraded":"2023-11-04T01:38:43.162583+0000","last_fullsized":"2023-11-04T01:38:43.162583+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:54.096380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165866+0000","last_change":"2023-11-04T01:38:23.405733+0000","last_active":"2023-11-04T01:38:43.165866+0000","last_peered":"2023-11-04T01:38:43.165866+0000","last_clean":"2023-11-04T01:38:43.165866+0000","last_became_active":"2023-11-04T01:38:21.072619+0000","last_became_peered":"2023-11-04T01:38:21.072619+0000","last_unstale":"2023-11-04T01:38:43.165866+0000","last_undegraded":"2023-11-04T01:38:43.165866+0000","last_fullsized":"2023-11-04T01:38:43.165866+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:43.756589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010857900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163810+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:38:43.163810+0000","last_peered":"2023-11-04T01:38:43.163810+0000","last_clean":"2023-11-04T01:38:43.163810+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:38:43.163810+0000","last_undegraded":"2023-11-04T01:38:43.163810+0000","last_fullsized":"2023-11-04T01:38:43.163810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189018+0000","last_change":"2023-11-04T01:38:44.182624+0000","last_active":"2023-11-04T01:38:44.189018+0000","last_peered":"2023-11-04T01:38:44.189018+0000","last_clean":"2023-11-04T01:38:44.189018+0000","last_became_active":"2023-11-04T01:38:44.181771+0000","last_became_peered":"2023-11-04T01:38:44.181771+0000","last_unstale":"2023-11-04T01:38:44.189018+0000","last_undegraded":"2023-11-04T01:38:44.189018+0000","last_fullsized":"2023-11-04T01:38:44.189018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173356+0000","last_change":"2023-11-04T01:38:43.175290+0000","last_active":"2023-11-04T01:38:44.173356+0000","last_peered":"2023-11-04T01:38:44.173356+0000","last_clean":"2023-11-04T01:38:44.173356+0000","last_became_active":"2023-11-04T01:38:43.175094+0000","last_became_peered":"2023-11-04T01:38:43.175094+0000","last_unstale":"2023-11-04T01:38:44.173356+0000","last_undegraded":"2023-11-04T01:38:44.173356+0000","last_fullsized":"2023-11-04T01:38:44.173356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:17.607307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155880+0000","last_change":"2023-11-04T01:38:22.069819+0000","last_active":"2023-11-04T01:38:43.155880+0000","last_peered":"2023-11-04T01:38:43.155880+0000","last_clean":"2023-11-04T01:38:43.155880+0000","last_became_active":"2023-11-04T01:38:22.068982+0000","last_became_peered":"2023-11-04T01:38:22.068982+0000","last_unstale":"2023-11-04T01:38:43.155880+0000","last_undegraded":"2023-11-04T01:38:43.155880+0000","last_fullsized":"2023-11-04T01:38:43.155880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:16.517766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163631+0000","last_change":"2023-11-04T01:38:23.334735+0000","last_active":"2023-11-04T01:38:43.163631+0000","last_peered":"2023-11-04T01:38:43.163631+0000","last_clean":"2023-11-04T01:38:43.163631+0000","last_became_active":"2023-11-04T01:38:21.067774+0000","last_became_peered":"2023-11-04T01:38:21.067774+0000","last_unstale":"2023-11-04T01:38:43.163631+0000","last_undegraded":"2023-11-04T01:38:43.163631+0000","last_fullsized":"2023-11-04T01:38:43.163631+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:03.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050306999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166147+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:38:43.166147+0000","last_peered":"2023-11-04T01:38:43.166147+0000","last_clean":"2023-11-04T01:38:43.166147+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:38:43.166147+0000","last_undegraded":"2023-11-04T01:38:43.166147+0000","last_fullsized":"2023-11-04T01:38:43.166147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186716+0000","last_change":"2023-11-04T01:38:44.181271+0000","last_active":"2023-11-04T01:38:44.186716+0000","last_peered":"2023-11-04T01:38:44.186716+0000","last_clean":"2023-11-04T01:38:44.186716+0000","last_became_active":"2023-11-04T01:38:44.180349+0000","last_became_peered":"2023-11-04T01:38:44.180349+0000","last_unstale":"2023-11-04T01:38:44.186716+0000","last_undegraded":"2023-11-04T01:38:44.186716+0000","last_fullsized":"2023-11-04T01:38:44.186716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:40.534383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.163751+0000","last_change":"2023-11-04T01:38:43.166756+0000","last_active":"2023-11-04T01:38:44.163751+0000","last_peered":"2023-11-04T01:38:44.163751+0000","last_clean":"2023-11-04T01:38:44.163751+0000","last_became_active":"2023-11-04T01:38:43.165164+0000","last_became_peered":"2023-11-04T01:38:43.165164+0000","last_unstale":"2023-11-04T01:38:44.163751+0000","last_undegraded":"2023-11-04T01:38:44.163751+0000","last_fullsized":"2023-11-04T01:38:44.163751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:05.207241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.157601+0000","last_change":"2023-11-04T01:38:22.069762+0000","last_active":"2023-11-04T01:38:43.157601+0000","last_peered":"2023-11-04T01:38:43.157601+0000","last_clean":"2023-11-04T01:38:43.157601+0000","last_became_active":"2023-11-04T01:38:22.069461+0000","last_became_peered":"2023-11-04T01:38:22.069461+0000","last_unstale":"2023-11-04T01:38:43.157601+0000","last_undegraded":"2023-11-04T01:38:43.157601+0000","last_fullsized":"2023-11-04T01:38:43.157601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:03.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166167+0000","last_change":"2023-11-04T01:38:23.405132+0000","last_active":"2023-11-04T01:38:43.166167+0000","last_peered":"2023-11-04T01:38:43.166167+0000","last_clean":"2023-11-04T01:38:43.166167+0000","last_became_active":"2023-11-04T01:38:21.070339+0000","last_became_peered":"2023-11-04T01:38:21.070339+0000","last_unstale":"2023-11-04T01:38:43.166167+0000","last_undegraded":"2023-11-04T01:38:43.166167+0000","last_fullsized":"2023-11-04T01:38:43.166167+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000921534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149875+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:38:43.149875+0000","last_peered":"2023-11-04T01:38:43.149875+0000","last_clean":"2023-11-04T01:38:43.149875+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:38:43.149875+0000","last_undegraded":"2023-11-04T01:38:43.149875+0000","last_fullsized":"2023-11-04T01:38:43.149875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183324+0000","last_change":"2023-11-04T01:38:44.177263+0000","last_active":"2023-11-04T01:38:44.183324+0000","last_peered":"2023-11-04T01:38:44.183324+0000","last_clean":"2023-11-04T01:38:44.183324+0000","last_became_active":"2023-11-04T01:38:44.177002+0000","last_became_peered":"2023-11-04T01:38:44.177002+0000","last_unstale":"2023-11-04T01:38:44.183324+0000","last_undegraded":"2023-11-04T01:38:44.183324+0000","last_fullsized":"2023-11-04T01:38:44.183324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:22.226361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.195330+0000","last_change":"2023-11-04T01:38:43.166563+0000","last_active":"2023-11-04T01:38:44.195330+0000","last_peered":"2023-11-04T01:38:44.195330+0000","last_clean":"2023-11-04T01:38:44.195330+0000","last_became_active":"2023-11-04T01:38:43.166307+0000","last_became_peered":"2023-11-04T01:38:43.166307+0000","last_unstale":"2023-11-04T01:38:44.195330+0000","last_undegraded":"2023-11-04T01:38:44.195330+0000","last_fullsized":"2023-11-04T01:38:44.195330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:58:18.153560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161543+0000","last_change":"2023-11-04T01:38:22.069939+0000","last_active":"2023-11-04T01:38:43.161543+0000","last_peered":"2023-11-04T01:38:43.161543+0000","last_clean":"2023-11-04T01:38:43.161543+0000","last_became_active":"2023-11-04T01:38:22.069690+0000","last_became_peered":"2023-11-04T01:38:22.069690+0000","last_unstale":"2023-11-04T01:38:43.161543+0000","last_undegraded":"2023-11-04T01:38:43.161543+0000","last_fullsized":"2023-11-04T01:38:43.161543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162860+0000","last_change":"2023-11-04T01:38:23.327651+0000","last_active":"2023-11-04T01:38:43.162860+0000","last_peered":"2023-11-04T01:38:43.162860+0000","last_clean":"2023-11-04T01:38:43.162860+0000","last_became_active":"2023-11-04T01:38:21.067028+0000","last_became_peered":"2023-11-04T01:38:21.067028+0000","last_unstale":"2023-11-04T01:38:43.162860+0000","last_undegraded":"2023-11-04T01:38:43.162860+0000","last_fullsized":"2023-11-04T01:38:43.162860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:13.072797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054701200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164523+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:38:43.164523+0000","last_peered":"2023-11-04T01:38:43.164523+0000","last_clean":"2023-11-04T01:38:43.164523+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:38:43.164523+0000","last_undegraded":"2023-11-04T01:38:43.164523+0000","last_fullsized":"2023-11-04T01:38:43.164523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188864+0000","last_change":"2023-11-04T01:38:44.181312+0000","last_active":"2023-11-04T01:38:44.188864+0000","last_peered":"2023-11-04T01:38:44.188864+0000","last_clean":"2023-11-04T01:38:44.188864+0000","last_became_active":"2023-11-04T01:38:44.181034+0000","last_became_peered":"2023-11-04T01:38:44.181034+0000","last_unstale":"2023-11-04T01:38:44.188864+0000","last_undegraded":"2023-11-04T01:38:44.188864+0000","last_fullsized":"2023-11-04T01:38:44.188864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:48.498859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.165020+0000","last_change":"2023-11-04T01:38:43.164494+0000","last_active":"2023-11-04T01:38:44.165020+0000","last_peered":"2023-11-04T01:38:44.165020+0000","last_clean":"2023-11-04T01:38:44.165020+0000","last_became_active":"2023-11-04T01:38:43.164188+0000","last_became_peered":"2023-11-04T01:38:43.164188+0000","last_unstale":"2023-11-04T01:38:44.165020+0000","last_undegraded":"2023-11-04T01:38:44.165020+0000","last_fullsized":"2023-11-04T01:38:44.165020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:15.192547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.153820+0000","last_change":"2023-11-04T01:38:22.066355+0000","last_active":"2023-11-04T01:38:43.153820+0000","last_peered":"2023-11-04T01:38:43.153820+0000","last_clean":"2023-11-04T01:38:43.153820+0000","last_became_active":"2023-11-04T01:38:22.065849+0000","last_became_peered":"2023-11-04T01:38:22.065849+0000","last_unstale":"2023-11-04T01:38:43.153820+0000","last_undegraded":"2023-11-04T01:38:43.153820+0000","last_fullsized":"2023-11-04T01:38:43.153820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149716+0000","last_change":"2023-11-04T01:38:23.358293+0000","last_active":"2023-11-04T01:38:43.149716+0000","last_peered":"2023-11-04T01:38:43.149716+0000","last_clean":"2023-11-04T01:38:43.149716+0000","last_became_active":"2023-11-04T01:38:21.070333+0000","last_became_peered":"2023-11-04T01:38:21.070333+0000","last_unstale":"2023-11-04T01:38:43.149716+0000","last_undegraded":"2023-11-04T01:38:43.149716+0000","last_fullsized":"2023-11-04T01:38:43.149716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:43.144500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059104700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154364+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:38:43.154364+0000","last_peered":"2023-11-04T01:38:43.154364+0000","last_clean":"2023-11-04T01:38:43.154364+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:38:43.154364+0000","last_undegraded":"2023-11-04T01:38:43.154364+0000","last_fullsized":"2023-11-04T01:38:43.154364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178663+0000","last_change":"2023-11-04T01:38:44.175080+0000","last_active":"2023-11-04T01:38:44.178663+0000","last_peered":"2023-11-04T01:38:44.178663+0000","last_clean":"2023-11-04T01:38:44.178663+0000","last_became_active":"2023-11-04T01:38:44.174837+0000","last_became_peered":"2023-11-04T01:38:44.174837+0000","last_unstale":"2023-11-04T01:38:44.178663+0000","last_undegraded":"2023-11-04T01:38:44.178663+0000","last_fullsized":"2023-11-04T01:38:44.178663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:11:06.861938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168148+0000","last_change":"2023-11-04T01:38:43.165054+0000","last_active":"2023-11-04T01:38:44.168148+0000","last_peered":"2023-11-04T01:38:44.168148+0000","last_clean":"2023-11-04T01:38:44.168148+0000","last_became_active":"2023-11-04T01:38:43.164813+0000","last_became_peered":"2023-11-04T01:38:43.164813+0000","last_unstale":"2023-11-04T01:38:44.168148+0000","last_undegraded":"2023-11-04T01:38:44.168148+0000","last_fullsized":"2023-11-04T01:38:44.168148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:57.139324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149527+0000","last_change":"2023-11-04T01:38:22.074795+0000","last_active":"2023-11-04T01:38:43.149527+0000","last_peered":"2023-11-04T01:38:43.149527+0000","last_clean":"2023-11-04T01:38:43.149527+0000","last_became_active":"2023-11-04T01:38:22.074381+0000","last_became_peered":"2023-11-04T01:38:22.074381+0000","last_unstale":"2023-11-04T01:38:43.149527+0000","last_undegraded":"2023-11-04T01:38:43.149527+0000","last_fullsized":"2023-11-04T01:38:43.149527+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:56:25.208149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154284+0000","last_change":"2023-11-04T01:38:23.061673+0000","last_active":"2023-11-04T01:38:43.154284+0000","last_peered":"2023-11-04T01:38:43.154284+0000","last_clean":"2023-11-04T01:38:43.154284+0000","last_became_active":"2023-11-04T01:38:21.062435+0000","last_became_peered":"2023-11-04T01:38:21.062435+0000","last_unstale":"2023-11-04T01:38:43.154284+0000","last_undegraded":"2023-11-04T01:38:43.154284+0000","last_fullsized":"2023-11-04T01:38:43.154284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:52.059754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048859499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154295+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:38:43.154295+0000","last_peered":"2023-11-04T01:38:43.154295+0000","last_clean":"2023-11-04T01:38:43.154295+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:38:43.154295+0000","last_undegraded":"2023-11-04T01:38:43.154295+0000","last_fullsized":"2023-11-04T01:38:43.154295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192353+0000","last_change":"2023-11-04T01:38:44.184870+0000","last_active":"2023-11-04T01:38:44.192353+0000","last_peered":"2023-11-04T01:38:44.192353+0000","last_clean":"2023-11-04T01:38:44.192353+0000","last_became_active":"2023-11-04T01:38:44.184600+0000","last_became_peered":"2023-11-04T01:38:44.184600+0000","last_unstale":"2023-11-04T01:38:44.192353+0000","last_undegraded":"2023-11-04T01:38:44.192353+0000","last_fullsized":"2023-11-04T01:38:44.192353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:56.720079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.190809+0000","last_change":"2023-11-04T01:38:43.168743+0000","last_active":"2023-11-04T01:38:44.190809+0000","last_peered":"2023-11-04T01:38:44.190809+0000","last_clean":"2023-11-04T01:38:44.190809+0000","last_became_active":"2023-11-04T01:38:43.168465+0000","last_became_peered":"2023-11-04T01:38:43.168465+0000","last_unstale":"2023-11-04T01:38:44.190809+0000","last_undegraded":"2023-11-04T01:38:44.190809+0000","last_fullsized":"2023-11-04T01:38:44.190809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:13.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150275+0000","last_change":"2023-11-04T01:38:22.075108+0000","last_active":"2023-11-04T01:38:43.150275+0000","last_peered":"2023-11-04T01:38:43.150275+0000","last_clean":"2023-11-04T01:38:43.150275+0000","last_became_active":"2023-11-04T01:38:22.074780+0000","last_became_peered":"2023-11-04T01:38:22.074780+0000","last_unstale":"2023-11-04T01:38:43.150275+0000","last_undegraded":"2023-11-04T01:38:43.150275+0000","last_fullsized":"2023-11-04T01:38:43.150275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:13.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162738+0000","last_change":"2023-11-04T01:38:23.334648+0000","last_active":"2023-11-04T01:38:43.162738+0000","last_peered":"2023-11-04T01:38:43.162738+0000","last_clean":"2023-11-04T01:38:43.162738+0000","last_became_active":"2023-11-04T01:38:21.066335+0000","last_became_peered":"2023-11-04T01:38:21.066335+0000","last_unstale":"2023-11-04T01:38:43.162738+0000","last_undegraded":"2023-11-04T01:38:43.162738+0000","last_fullsized":"2023-11-04T01:38:43.162738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:43.106209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047853300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155751+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:38:43.155751+0000","last_peered":"2023-11-04T01:38:43.155751+0000","last_clean":"2023-11-04T01:38:43.155751+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:38:43.155751+0000","last_undegraded":"2023-11-04T01:38:43.155751+0000","last_fullsized":"2023-11-04T01:38:43.155751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188941+0000","last_change":"2023-11-04T01:38:44.181148+0000","last_active":"2023-11-04T01:38:44.188941+0000","last_peered":"2023-11-04T01:38:44.188941+0000","last_clean":"2023-11-04T01:38:44.188941+0000","last_became_active":"2023-11-04T01:38:44.180848+0000","last_became_peered":"2023-11-04T01:38:44.180848+0000","last_unstale":"2023-11-04T01:38:44.188941+0000","last_undegraded":"2023-11-04T01:38:44.188941+0000","last_fullsized":"2023-11-04T01:38:44.188941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192816+0000","last_change":"2023-11-04T01:38:43.168074+0000","last_active":"2023-11-04T01:38:44.192816+0000","last_peered":"2023-11-04T01:38:44.192816+0000","last_clean":"2023-11-04T01:38:44.192816+0000","last_became_active":"2023-11-04T01:38:43.167846+0000","last_became_peered":"2023-11-04T01:38:43.167846+0000","last_unstale":"2023-11-04T01:38:44.192816+0000","last_undegraded":"2023-11-04T01:38:44.192816+0000","last_fullsized":"2023-11-04T01:38:44.192816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:11.280545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166076+0000","last_change":"2023-11-04T01:38:22.072789+0000","last_active":"2023-11-04T01:38:43.166076+0000","last_peered":"2023-11-04T01:38:43.166076+0000","last_clean":"2023-11-04T01:38:43.166076+0000","last_became_active":"2023-11-04T01:38:22.072509+0000","last_became_peered":"2023-11-04T01:38:22.072509+0000","last_unstale":"2023-11-04T01:38:43.166076+0000","last_undegraded":"2023-11-04T01:38:43.166076+0000","last_fullsized":"2023-11-04T01:38:43.166076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156112+0000","last_change":"2023-11-04T01:38:23.061961+0000","last_active":"2023-11-04T01:38:43.156112+0000","last_peered":"2023-11-04T01:38:43.156112+0000","last_clean":"2023-11-04T01:38:43.156112+0000","last_became_active":"2023-11-04T01:38:21.063415+0000","last_became_peered":"2023-11-04T01:38:21.063415+0000","last_unstale":"2023-11-04T01:38:43.156112+0000","last_undegraded":"2023-11-04T01:38:43.156112+0000","last_fullsized":"2023-11-04T01:38:43.156112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.820188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000396594,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161008+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:38:43.161008+0000","last_peered":"2023-11-04T01:38:43.161008+0000","last_clean":"2023-11-04T01:38:43.161008+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:38:43.161008+0000","last_undegraded":"2023-11-04T01:38:43.161008+0000","last_fullsized":"2023-11-04T01:38:43.161008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178862+0000","last_change":"2023-11-04T01:38:44.176528+0000","last_active":"2023-11-04T01:38:44.178862+0000","last_peered":"2023-11-04T01:38:44.178862+0000","last_clean":"2023-11-04T01:38:44.178862+0000","last_became_active":"2023-11-04T01:38:44.176282+0000","last_became_peered":"2023-11-04T01:38:44.176282+0000","last_unstale":"2023-11-04T01:38:44.178862+0000","last_undegraded":"2023-11-04T01:38:44.178862+0000","last_fullsized":"2023-11-04T01:38:44.178862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:39.850295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186402+0000","last_change":"2023-11-04T01:38:43.172258+0000","last_active":"2023-11-04T01:38:44.186402+0000","last_peered":"2023-11-04T01:38:44.186402+0000","last_clean":"2023-11-04T01:38:44.186402+0000","last_became_active":"2023-11-04T01:38:43.171981+0000","last_became_peered":"2023-11-04T01:38:43.171981+0000","last_unstale":"2023-11-04T01:38:44.186402+0000","last_undegraded":"2023-11-04T01:38:44.186402+0000","last_fullsized":"2023-11-04T01:38:44.186402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:40.091655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156049+0000","last_change":"2023-11-04T01:38:22.068816+0000","last_active":"2023-11-04T01:38:43.156049+0000","last_peered":"2023-11-04T01:38:43.156049+0000","last_clean":"2023-11-04T01:38:43.156049+0000","last_became_active":"2023-11-04T01:38:22.068537+0000","last_became_peered":"2023-11-04T01:38:22.068537+0000","last_unstale":"2023-11-04T01:38:43.156049+0000","last_undegraded":"2023-11-04T01:38:43.156049+0000","last_fullsized":"2023-11-04T01:38:43.156049+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:44.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165778+0000","last_change":"2023-11-04T01:38:23.405504+0000","last_active":"2023-11-04T01:38:43.165778+0000","last_peered":"2023-11-04T01:38:43.165778+0000","last_clean":"2023-11-04T01:38:43.165778+0000","last_became_active":"2023-11-04T01:38:21.073116+0000","last_became_peered":"2023-11-04T01:38:21.073116+0000","last_unstale":"2023-11-04T01:38:43.165778+0000","last_undegraded":"2023-11-04T01:38:43.165778+0000","last_fullsized":"2023-11-04T01:38:43.165778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:14.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098846799999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163340+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:38:43.163340+0000","last_peered":"2023-11-04T01:38:43.163340+0000","last_clean":"2023-11-04T01:38:43.163340+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:38:43.163340+0000","last_undegraded":"2023-11-04T01:38:43.163340+0000","last_fullsized":"2023-11-04T01:38:43.163340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194806+0000","last_change":"2023-11-04T01:38:44.191459+0000","last_active":"2023-11-04T01:38:44.194806+0000","last_peered":"2023-11-04T01:38:44.194806+0000","last_clean":"2023-11-04T01:38:44.194806+0000","last_became_active":"2023-11-04T01:38:44.191139+0000","last_became_peered":"2023-11-04T01:38:44.191139+0000","last_unstale":"2023-11-04T01:38:44.194806+0000","last_undegraded":"2023-11-04T01:38:44.194806+0000","last_fullsized":"2023-11-04T01:38:44.194806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:41.091836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192495+0000","last_change":"2023-11-04T01:38:43.166740+0000","last_active":"2023-11-04T01:38:44.192495+0000","last_peered":"2023-11-04T01:38:44.192495+0000","last_clean":"2023-11-04T01:38:44.192495+0000","last_became_active":"2023-11-04T01:38:43.166487+0000","last_became_peered":"2023-11-04T01:38:43.166487+0000","last_unstale":"2023-11-04T01:38:44.192495+0000","last_undegraded":"2023-11-04T01:38:44.192495+0000","last_fullsized":"2023-11-04T01:38:44.192495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:27.859291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160531+0000","last_change":"2023-11-04T01:38:22.069605+0000","last_active":"2023-11-04T01:38:43.160531+0000","last_peered":"2023-11-04T01:38:43.160531+0000","last_clean":"2023-11-04T01:38:43.160531+0000","last_became_active":"2023-11-04T01:38:22.069171+0000","last_became_peered":"2023-11-04T01:38:22.069171+0000","last_unstale":"2023-11-04T01:38:43.160531+0000","last_undegraded":"2023-11-04T01:38:43.160531+0000","last_fullsized":"2023-11-04T01:38:43.160531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:07.216732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159533+0000","last_change":"2023-11-04T01:38:23.063133+0000","last_active":"2023-11-04T01:38:43.159533+0000","last_peered":"2023-11-04T01:38:43.159533+0000","last_clean":"2023-11-04T01:38:43.159533+0000","last_became_active":"2023-11-04T01:38:21.070011+0000","last_became_peered":"2023-11-04T01:38:21.070011+0000","last_unstale":"2023-11-04T01:38:43.159533+0000","last_undegraded":"2023-11-04T01:38:43.159533+0000","last_fullsized":"2023-11-04T01:38:43.159533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:08.992301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161913+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:38:43.161913+0000","last_peered":"2023-11-04T01:38:43.161913+0000","last_clean":"2023-11-04T01:38:43.161913+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:38:43.161913+0000","last_undegraded":"2023-11-04T01:38:43.161913+0000","last_fullsized":"2023-11-04T01:38:43.161913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189415+0000","last_change":"2023-11-04T01:38:44.185144+0000","last_active":"2023-11-04T01:38:44.189415+0000","last_peered":"2023-11-04T01:38:44.189415+0000","last_clean":"2023-11-04T01:38:44.189415+0000","last_became_active":"2023-11-04T01:38:44.184883+0000","last_became_peered":"2023-11-04T01:38:44.184883+0000","last_unstale":"2023-11-04T01:38:44.189415+0000","last_undegraded":"2023-11-04T01:38:44.189415+0000","last_fullsized":"2023-11-04T01:38:44.189415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:40.457824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"81'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194510+0000","last_change":"2023-11-04T01:38:43.172890+0000","last_active":"2023-11-04T01:38:44.194510+0000","last_peered":"2023-11-04T01:38:44.194510+0000","last_clean":"2023-11-04T01:38:44.194510+0000","last_became_active":"2023-11-04T01:38:43.172634+0000","last_became_peered":"2023-11-04T01:38:43.172634+0000","last_unstale":"2023-11-04T01:38:44.194510+0000","last_undegraded":"2023-11-04T01:38:44.194510+0000","last_fullsized":"2023-11-04T01:38:44.194510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:08.355119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165053+0000","last_change":"2023-11-04T01:38:22.077275+0000","last_active":"2023-11-04T01:38:43.165053+0000","last_peered":"2023-11-04T01:38:43.165053+0000","last_clean":"2023-11-04T01:38:43.165053+0000","last_became_active":"2023-11-04T01:38:22.076997+0000","last_became_peered":"2023-11-04T01:38:22.076997+0000","last_unstale":"2023-11-04T01:38:43.165053+0000","last_undegraded":"2023-11-04T01:38:43.165053+0000","last_fullsized":"2023-11-04T01:38:43.165053+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:14.205713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160828+0000","last_change":"2023-11-04T01:38:23.062882+0000","last_active":"2023-11-04T01:38:43.160828+0000","last_peered":"2023-11-04T01:38:43.160828+0000","last_clean":"2023-11-04T01:38:43.160828+0000","last_became_active":"2023-11-04T01:38:21.069964+0000","last_became_peered":"2023-11-04T01:38:21.069964+0000","last_unstale":"2023-11-04T01:38:43.160828+0000","last_undegraded":"2023-11-04T01:38:43.160828+0000","last_fullsized":"2023-11-04T01:38:43.160828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:16.633121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083743200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156142+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:38:43.156142+0000","last_peered":"2023-11-04T01:38:43.156142+0000","last_clean":"2023-11-04T01:38:43.156142+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:38:43.156142+0000","last_undegraded":"2023-11-04T01:38:43.156142+0000","last_fullsized":"2023-11-04T01:38:43.156142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.188890+0000","last_change":"2023-11-04T01:38:44.181167+0000","last_active":"2023-11-04T01:38:44.188890+0000","last_peered":"2023-11-04T01:38:44.188890+0000","last_clean":"2023-11-04T01:38:44.188890+0000","last_became_active":"2023-11-04T01:38:44.180860+0000","last_became_peered":"2023-11-04T01:38:44.180860+0000","last_unstale":"2023-11-04T01:38:44.188890+0000","last_undegraded":"2023-11-04T01:38:44.188890+0000","last_fullsized":"2023-11-04T01:38:44.188890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:32.097650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.162583+0000","last_change":"2023-11-04T01:38:43.166035+0000","last_active":"2023-11-04T01:38:44.162583+0000","last_peered":"2023-11-04T01:38:44.162583+0000","last_clean":"2023-11-04T01:38:44.162583+0000","last_became_active":"2023-11-04T01:38:43.165780+0000","last_became_peered":"2023-11-04T01:38:43.165780+0000","last_unstale":"2023-11-04T01:38:44.162583+0000","last_undegraded":"2023-11-04T01:38:44.162583+0000","last_fullsized":"2023-11-04T01:38:44.162583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:27.983013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155777+0000","last_change":"2023-11-04T01:38:22.062314+0000","last_active":"2023-11-04T01:38:43.155777+0000","last_peered":"2023-11-04T01:38:43.155777+0000","last_clean":"2023-11-04T01:38:43.155777+0000","last_became_active":"2023-11-04T01:38:22.062007+0000","last_became_peered":"2023-11-04T01:38:22.062007+0000","last_unstale":"2023-11-04T01:38:43.155777+0000","last_undegraded":"2023-11-04T01:38:43.155777+0000","last_fullsized":"2023-11-04T01:38:43.155777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:09.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155675+0000","last_change":"2023-11-04T01:38:23.060981+0000","last_active":"2023-11-04T01:38:43.155675+0000","last_peered":"2023-11-04T01:38:43.155675+0000","last_clean":"2023-11-04T01:38:43.155675+0000","last_became_active":"2023-11-04T01:38:21.065930+0000","last_became_peered":"2023-11-04T01:38:21.065930+0000","last_unstale":"2023-11-04T01:38:43.155675+0000","last_undegraded":"2023-11-04T01:38:43.155675+0000","last_fullsized":"2023-11-04T01:38:43.155675+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158363+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:38:43.158363+0000","last_peered":"2023-11-04T01:38:43.158363+0000","last_clean":"2023-11-04T01:38:43.158363+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:38:43.158363+0000","last_undegraded":"2023-11-04T01:38:43.158363+0000","last_fullsized":"2023-11-04T01:38:43.158363+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.182284+0000","last_change":"2023-11-04T01:38:44.180724+0000","last_active":"2023-11-04T01:38:44.182284+0000","last_peered":"2023-11-04T01:38:44.182284+0000","last_clean":"2023-11-04T01:38:44.182284+0000","last_became_active":"2023-11-04T01:38:44.180473+0000","last_became_peered":"2023-11-04T01:38:44.180473+0000","last_unstale":"2023-11-04T01:38:44.182284+0000","last_undegraded":"2023-11-04T01:38:44.182284+0000","last_fullsized":"2023-11-04T01:38:44.182284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:49.217495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173509+0000","last_change":"2023-11-04T01:38:43.167042+0000","last_active":"2023-11-04T01:38:44.173509+0000","last_peered":"2023-11-04T01:38:44.173509+0000","last_clean":"2023-11-04T01:38:44.173509+0000","last_became_active":"2023-11-04T01:38:43.166809+0000","last_became_peered":"2023-11-04T01:38:43.166809+0000","last_unstale":"2023-11-04T01:38:44.173509+0000","last_undegraded":"2023-11-04T01:38:44.173509+0000","last_fullsized":"2023-11-04T01:38:44.173509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:30.647869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149525+0000","last_change":"2023-11-04T01:38:22.075621+0000","last_active":"2023-11-04T01:38:43.149525+0000","last_peered":"2023-11-04T01:38:43.149525+0000","last_clean":"2023-11-04T01:38:43.149525+0000","last_became_active":"2023-11-04T01:38:22.075337+0000","last_became_peered":"2023-11-04T01:38:22.075337+0000","last_unstale":"2023-11-04T01:38:43.149525+0000","last_undegraded":"2023-11-04T01:38:43.149525+0000","last_fullsized":"2023-11-04T01:38:43.149525+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:00.382893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155803+0000","last_change":"2023-11-04T01:38:23.061099+0000","last_active":"2023-11-04T01:38:43.155803+0000","last_peered":"2023-11-04T01:38:43.155803+0000","last_clean":"2023-11-04T01:38:43.155803+0000","last_became_active":"2023-11-04T01:38:21.063958+0000","last_became_peered":"2023-11-04T01:38:21.063958+0000","last_unstale":"2023-11-04T01:38:43.155803+0000","last_undegraded":"2023-11-04T01:38:43.155803+0000","last_fullsized":"2023-11-04T01:38:43.155803+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:13.105036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164004+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:38:43.164004+0000","last_peered":"2023-11-04T01:38:43.164004+0000","last_clean":"2023-11-04T01:38:43.164004+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:38:43.164004+0000","last_undegraded":"2023-11-04T01:38:43.164004+0000","last_fullsized":"2023-11-04T01:38:43.164004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.196821+0000","last_change":"2023-11-04T01:38:44.192413+0000","last_active":"2023-11-04T01:38:44.196821+0000","last_peered":"2023-11-04T01:38:44.196821+0000","last_clean":"2023-11-04T01:38:44.196821+0000","last_became_active":"2023-11-04T01:38:44.192156+0000","last_became_peered":"2023-11-04T01:38:44.192156+0000","last_unstale":"2023-11-04T01:38:44.196821+0000","last_undegraded":"2023-11-04T01:38:44.196821+0000","last_fullsized":"2023-11-04T01:38:44.196821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:13.663524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.193101+0000","last_change":"2023-11-04T01:38:43.169954+0000","last_active":"2023-11-04T01:38:44.193101+0000","last_peered":"2023-11-04T01:38:44.193101+0000","last_clean":"2023-11-04T01:38:44.193101+0000","last_became_active":"2023-11-04T01:38:43.169132+0000","last_became_peered":"2023-11-04T01:38:43.169132+0000","last_unstale":"2023-11-04T01:38:44.193101+0000","last_undegraded":"2023-11-04T01:38:44.193101+0000","last_fullsized":"2023-11-04T01:38:44.193101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:43.427888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163757+0000","last_change":"2023-11-04T01:38:22.070752+0000","last_active":"2023-11-04T01:38:43.163757+0000","last_peered":"2023-11-04T01:38:43.163757+0000","last_clean":"2023-11-04T01:38:43.163757+0000","last_became_active":"2023-11-04T01:38:22.070461+0000","last_became_peered":"2023-11-04T01:38:22.070461+0000","last_unstale":"2023-11-04T01:38:43.163757+0000","last_undegraded":"2023-11-04T01:38:43.163757+0000","last_fullsized":"2023-11-04T01:38:43.163757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:27.426475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.150122+0000","last_change":"2023-11-04T01:38:23.358397+0000","last_active":"2023-11-04T01:38:43.150122+0000","last_peered":"2023-11-04T01:38:43.150122+0000","last_clean":"2023-11-04T01:38:43.150122+0000","last_became_active":"2023-11-04T01:38:21.066012+0000","last_became_peered":"2023-11-04T01:38:21.066012+0000","last_unstale":"2023-11-04T01:38:43.150122+0000","last_undegraded":"2023-11-04T01:38:43.150122+0000","last_fullsized":"2023-11-04T01:38:43.150122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.942370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051071600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154933+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:38:43.154933+0000","last_peered":"2023-11-04T01:38:43.154933+0000","last_clean":"2023-11-04T01:38:43.154933+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:38:43.154933+0000","last_undegraded":"2023-11-04T01:38:43.154933+0000","last_fullsized":"2023-11-04T01:38:43.154933+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186218+0000","last_change":"2023-11-04T01:38:44.181978+0000","last_active":"2023-11-04T01:38:44.186218+0000","last_peered":"2023-11-04T01:38:44.186218+0000","last_clean":"2023-11-04T01:38:44.186218+0000","last_became_active":"2023-11-04T01:38:44.181721+0000","last_became_peered":"2023-11-04T01:38:44.181721+0000","last_unstale":"2023-11-04T01:38:44.186218+0000","last_undegraded":"2023-11-04T01:38:44.186218+0000","last_fullsized":"2023-11-04T01:38:44.186218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:50.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194275+0000","last_change":"2023-11-04T01:38:43.165213+0000","last_active":"2023-11-04T01:38:44.194275+0000","last_peered":"2023-11-04T01:38:44.194275+0000","last_clean":"2023-11-04T01:38:44.194275+0000","last_became_active":"2023-11-04T01:38:43.164915+0000","last_became_peered":"2023-11-04T01:38:43.164915+0000","last_unstale":"2023-11-04T01:38:44.194275+0000","last_undegraded":"2023-11-04T01:38:44.194275+0000","last_fullsized":"2023-11-04T01:38:44.194275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:33.153011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162332+0000","last_change":"2023-11-04T01:38:22.067648+0000","last_active":"2023-11-04T01:38:43.162332+0000","last_peered":"2023-11-04T01:38:43.162332+0000","last_clean":"2023-11-04T01:38:43.162332+0000","last_became_active":"2023-11-04T01:38:22.067338+0000","last_became_peered":"2023-11-04T01:38:22.067338+0000","last_unstale":"2023-11-04T01:38:43.162332+0000","last_undegraded":"2023-11-04T01:38:43.162332+0000","last_fullsized":"2023-11-04T01:38:43.162332+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:04.184731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154002+0000","last_change":"2023-11-04T01:38:23.061682+0000","last_active":"2023-11-04T01:38:43.154002+0000","last_peered":"2023-11-04T01:38:43.154002+0000","last_clean":"2023-11-04T01:38:43.154002+0000","last_became_active":"2023-11-04T01:38:21.067953+0000","last_became_peered":"2023-11-04T01:38:21.067953+0000","last_unstale":"2023-11-04T01:38:43.154002+0000","last_undegraded":"2023-11-04T01:38:43.154002+0000","last_fullsized":"2023-11-04T01:38:43.154002+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:06.211868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042784099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164740+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:38:43.164740+0000","last_peered":"2023-11-04T01:38:43.164740+0000","last_clean":"2023-11-04T01:38:43.164740+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:38:43.164740+0000","last_undegraded":"2023-11-04T01:38:43.164740+0000","last_fullsized":"2023-11-04T01:38:43.164740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194739+0000","last_change":"2023-11-04T01:38:44.190973+0000","last_active":"2023-11-04T01:38:44.194739+0000","last_peered":"2023-11-04T01:38:44.194739+0000","last_clean":"2023-11-04T01:38:44.194739+0000","last_became_active":"2023-11-04T01:38:44.190093+0000","last_became_peered":"2023-11-04T01:38:44.190093+0000","last_unstale":"2023-11-04T01:38:44.194739+0000","last_undegraded":"2023-11-04T01:38:44.194739+0000","last_fullsized":"2023-11-04T01:38:44.194739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:48.498859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.174471+0000","last_change":"2023-11-04T01:38:43.163222+0000","last_active":"2023-11-04T01:38:44.174471+0000","last_peered":"2023-11-04T01:38:44.174471+0000","last_clean":"2023-11-04T01:38:44.174471+0000","last_became_active":"2023-11-04T01:38:43.162940+0000","last_became_peered":"2023-11-04T01:38:43.162940+0000","last_unstale":"2023-11-04T01:38:44.174471+0000","last_undegraded":"2023-11-04T01:38:44.174471+0000","last_fullsized":"2023-11-04T01:38:44.174471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:12.659206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161793+0000","last_change":"2023-11-04T01:38:22.069448+0000","last_active":"2023-11-04T01:38:43.161793+0000","last_peered":"2023-11-04T01:38:43.161793+0000","last_clean":"2023-11-04T01:38:43.161793+0000","last_became_active":"2023-11-04T01:38:22.069195+0000","last_became_peered":"2023-11-04T01:38:22.069195+0000","last_unstale":"2023-11-04T01:38:43.161793+0000","last_undegraded":"2023-11-04T01:38:43.161793+0000","last_fullsized":"2023-11-04T01:38:43.161793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:21.047863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149786+0000","last_change":"2023-11-04T01:38:23.358753+0000","last_active":"2023-11-04T01:38:43.149786+0000","last_peered":"2023-11-04T01:38:43.149786+0000","last_clean":"2023-11-04T01:38:43.149786+0000","last_became_active":"2023-11-04T01:38:21.070981+0000","last_became_peered":"2023-11-04T01:38:21.070981+0000","last_unstale":"2023-11-04T01:38:43.149786+0000","last_undegraded":"2023-11-04T01:38:43.149786+0000","last_fullsized":"2023-11-04T01:38:43.149786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:55.408316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043018,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166262+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:38:43.166262+0000","last_peered":"2023-11-04T01:38:43.166262+0000","last_clean":"2023-11-04T01:38:43.166262+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:38:43.166262+0000","last_undegraded":"2023-11-04T01:38:43.166262+0000","last_fullsized":"2023-11-04T01:38:43.166262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192361+0000","last_change":"2023-11-04T01:38:44.183123+0000","last_active":"2023-11-04T01:38:44.192361+0000","last_peered":"2023-11-04T01:38:44.192361+0000","last_clean":"2023-11-04T01:38:44.192361+0000","last_became_active":"2023-11-04T01:38:44.182859+0000","last_became_peered":"2023-11-04T01:38:44.182859+0000","last_unstale":"2023-11-04T01:38:44.192361+0000","last_undegraded":"2023-11-04T01:38:44.192361+0000","last_fullsized":"2023-11-04T01:38:44.192361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:15.165104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168863+0000","last_change":"2023-11-04T01:38:43.167000+0000","last_active":"2023-11-04T01:38:44.168863+0000","last_peered":"2023-11-04T01:38:44.168863+0000","last_clean":"2023-11-04T01:38:44.168863+0000","last_became_active":"2023-11-04T01:38:43.166758+0000","last_became_peered":"2023-11-04T01:38:43.166758+0000","last_unstale":"2023-11-04T01:38:44.168863+0000","last_undegraded":"2023-11-04T01:38:44.168863+0000","last_fullsized":"2023-11-04T01:38:44.168863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:19.401660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.156043+0000","last_change":"2023-11-04T01:38:22.070238+0000","last_active":"2023-11-04T01:38:43.156043+0000","last_peered":"2023-11-04T01:38:43.156043+0000","last_clean":"2023-11-04T01:38:43.156043+0000","last_became_active":"2023-11-04T01:38:22.069898+0000","last_became_peered":"2023-11-04T01:38:22.069898+0000","last_unstale":"2023-11-04T01:38:43.156043+0000","last_undegraded":"2023-11-04T01:38:43.156043+0000","last_fullsized":"2023-11-04T01:38:43.156043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:57.057392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149695+0000","last_change":"2023-11-04T01:38:23.358872+0000","last_active":"2023-11-04T01:38:43.149695+0000","last_peered":"2023-11-04T01:38:43.149695+0000","last_clean":"2023-11-04T01:38:43.149695+0000","last_became_active":"2023-11-04T01:38:21.069193+0000","last_became_peered":"2023-11-04T01:38:21.069193+0000","last_unstale":"2023-11-04T01:38:43.149695+0000","last_undegraded":"2023-11-04T01:38:43.149695+0000","last_fullsized":"2023-11-04T01:38:43.149695+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:57.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055334700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165295+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:38:43.165295+0000","last_peered":"2023-11-04T01:38:43.165295+0000","last_clean":"2023-11-04T01:38:43.165295+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:38:43.165295+0000","last_undegraded":"2023-11-04T01:38:43.165295+0000","last_fullsized":"2023-11-04T01:38:43.165295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.178743+0000","last_change":"2023-11-04T01:38:44.173767+0000","last_active":"2023-11-04T01:38:44.178743+0000","last_peered":"2023-11-04T01:38:44.178743+0000","last_clean":"2023-11-04T01:38:44.178743+0000","last_became_active":"2023-11-04T01:38:44.173331+0000","last_became_peered":"2023-11-04T01:38:44.173331+0000","last_unstale":"2023-11-04T01:38:44.178743+0000","last_undegraded":"2023-11-04T01:38:44.178743+0000","last_fullsized":"2023-11-04T01:38:44.178743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:26.285215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169009+0000","last_change":"2023-11-04T01:38:43.172456+0000","last_active":"2023-11-04T01:38:44.169009+0000","last_peered":"2023-11-04T01:38:44.169009+0000","last_clean":"2023-11-04T01:38:44.169009+0000","last_became_active":"2023-11-04T01:38:43.172193+0000","last_became_peered":"2023-11-04T01:38:43.172193+0000","last_unstale":"2023-11-04T01:38:44.169009+0000","last_undegraded":"2023-11-04T01:38:44.169009+0000","last_fullsized":"2023-11-04T01:38:44.169009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:08.306948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155929+0000","last_change":"2023-11-04T01:38:22.064805+0000","last_active":"2023-11-04T01:38:43.155929+0000","last_peered":"2023-11-04T01:38:43.155929+0000","last_clean":"2023-11-04T01:38:43.155929+0000","last_became_active":"2023-11-04T01:38:22.064524+0000","last_became_peered":"2023-11-04T01:38:22.064524+0000","last_unstale":"2023-11-04T01:38:43.155929+0000","last_undegraded":"2023-11-04T01:38:43.155929+0000","last_fullsized":"2023-11-04T01:38:43.155929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:15.823978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165139+0000","last_change":"2023-11-04T01:38:23.404752+0000","last_active":"2023-11-04T01:38:43.165139+0000","last_peered":"2023-11-04T01:38:43.165139+0000","last_clean":"2023-11-04T01:38:43.165139+0000","last_became_active":"2023-11-04T01:38:21.069815+0000","last_became_peered":"2023-11-04T01:38:21.069815+0000","last_unstale":"2023-11-04T01:38:43.165139+0000","last_undegraded":"2023-11-04T01:38:43.165139+0000","last_fullsized":"2023-11-04T01:38:43.165139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:15.512902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076771900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161044+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:38:43.161044+0000","last_peered":"2023-11-04T01:38:43.161044+0000","last_clean":"2023-11-04T01:38:43.161044+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:38:43.161044+0000","last_undegraded":"2023-11-04T01:38:43.161044+0000","last_fullsized":"2023-11-04T01:38:43.161044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.187182+0000","last_change":"2023-11-04T01:38:44.183124+0000","last_active":"2023-11-04T01:38:44.187182+0000","last_peered":"2023-11-04T01:38:44.187182+0000","last_clean":"2023-11-04T01:38:44.187182+0000","last_became_active":"2023-11-04T01:38:44.181017+0000","last_became_peered":"2023-11-04T01:38:44.181017+0000","last_unstale":"2023-11-04T01:38:44.187182+0000","last_undegraded":"2023-11-04T01:38:44.187182+0000","last_fullsized":"2023-11-04T01:38:44.187182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:36.888737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189304+0000","last_change":"2023-11-04T01:38:43.164538+0000","last_active":"2023-11-04T01:38:44.189304+0000","last_peered":"2023-11-04T01:38:44.189304+0000","last_clean":"2023-11-04T01:38:44.189304+0000","last_became_active":"2023-11-04T01:38:43.164249+0000","last_became_peered":"2023-11-04T01:38:43.164249+0000","last_unstale":"2023-11-04T01:38:44.189304+0000","last_undegraded":"2023-11-04T01:38:44.189304+0000","last_fullsized":"2023-11-04T01:38:44.189304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:35.173829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165218+0000","last_change":"2023-11-04T01:38:22.071153+0000","last_active":"2023-11-04T01:38:43.165218+0000","last_peered":"2023-11-04T01:38:43.165218+0000","last_clean":"2023-11-04T01:38:43.165218+0000","last_became_active":"2023-11-04T01:38:22.070642+0000","last_became_peered":"2023-11-04T01:38:22.070642+0000","last_unstale":"2023-11-04T01:38:43.165218+0000","last_undegraded":"2023-11-04T01:38:43.165218+0000","last_fullsized":"2023-11-04T01:38:43.165218+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:14.109900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166090+0000","last_change":"2023-11-04T01:38:23.405429+0000","last_active":"2023-11-04T01:38:43.166090+0000","last_peered":"2023-11-04T01:38:43.166090+0000","last_clean":"2023-11-04T01:38:43.166090+0000","last_became_active":"2023-11-04T01:38:21.073092+0000","last_became_peered":"2023-11-04T01:38:21.073092+0000","last_unstale":"2023-11-04T01:38:43.166090+0000","last_undegraded":"2023-11-04T01:38:43.166090+0000","last_fullsized":"2023-11-04T01:38:43.166090+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:05.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088544700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162276+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:38:43.162276+0000","last_peered":"2023-11-04T01:38:43.162276+0000","last_clean":"2023-11-04T01:38:43.162276+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:38:43.162276+0000","last_undegraded":"2023-11-04T01:38:43.162276+0000","last_fullsized":"2023-11-04T01:38:43.162276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189504+0000","last_change":"2023-11-04T01:38:44.184560+0000","last_active":"2023-11-04T01:38:44.189504+0000","last_peered":"2023-11-04T01:38:44.189504+0000","last_clean":"2023-11-04T01:38:44.189504+0000","last_became_active":"2023-11-04T01:38:44.181175+0000","last_became_peered":"2023-11-04T01:38:44.181175+0000","last_unstale":"2023-11-04T01:38:44.189504+0000","last_undegraded":"2023-11-04T01:38:44.189504+0000","last_fullsized":"2023-11-04T01:38:44.189504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:26.661431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168139+0000","last_change":"2023-11-04T01:38:43.168749+0000","last_active":"2023-11-04T01:38:44.168139+0000","last_peered":"2023-11-04T01:38:44.168139+0000","last_clean":"2023-11-04T01:38:44.168139+0000","last_became_active":"2023-11-04T01:38:43.168465+0000","last_became_peered":"2023-11-04T01:38:43.168465+0000","last_unstale":"2023-11-04T01:38:44.168139+0000","last_undegraded":"2023-11-04T01:38:44.168139+0000","last_fullsized":"2023-11-04T01:38:44.168139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:19.203453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154102+0000","last_change":"2023-11-04T01:38:22.066267+0000","last_active":"2023-11-04T01:38:43.154102+0000","last_peered":"2023-11-04T01:38:43.154102+0000","last_clean":"2023-11-04T01:38:43.154102+0000","last_became_active":"2023-11-04T01:38:22.065904+0000","last_became_peered":"2023-11-04T01:38:22.065904+0000","last_unstale":"2023-11-04T01:38:43.154102+0000","last_undegraded":"2023-11-04T01:38:43.154102+0000","last_fullsized":"2023-11-04T01:38:43.154102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155716+0000","last_change":"2023-11-04T01:38:23.062165+0000","last_active":"2023-11-04T01:38:43.155716+0000","last_peered":"2023-11-04T01:38:43.155716+0000","last_clean":"2023-11-04T01:38:43.155716+0000","last_became_active":"2023-11-04T01:38:21.065551+0000","last_became_peered":"2023-11-04T01:38:21.065551+0000","last_unstale":"2023-11-04T01:38:43.155716+0000","last_undegraded":"2023-11-04T01:38:43.155716+0000","last_fullsized":"2023-11-04T01:38:43.155716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:16.744946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068861599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.153615+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:38:43.153615+0000","last_peered":"2023-11-04T01:38:43.153615+0000","last_clean":"2023-11-04T01:38:43.153615+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:38:43.153615+0000","last_undegraded":"2023-11-04T01:38:43.153615+0000","last_fullsized":"2023-11-04T01:38:43.153615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183451+0000","last_change":"2023-11-04T01:38:44.177484+0000","last_active":"2023-11-04T01:38:44.183451+0000","last_peered":"2023-11-04T01:38:44.183451+0000","last_clean":"2023-11-04T01:38:44.183451+0000","last_became_active":"2023-11-04T01:38:44.177206+0000","last_became_peered":"2023-11-04T01:38:44.177206+0000","last_unstale":"2023-11-04T01:38:44.183451+0000","last_undegraded":"2023-11-04T01:38:44.183451+0000","last_fullsized":"2023-11-04T01:38:44.183451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:51.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.175703+0000","last_change":"2023-11-04T01:38:43.171278+0000","last_active":"2023-11-04T01:38:44.175703+0000","last_peered":"2023-11-04T01:38:44.175703+0000","last_clean":"2023-11-04T01:38:44.175703+0000","last_became_active":"2023-11-04T01:38:43.171034+0000","last_became_peered":"2023-11-04T01:38:43.171034+0000","last_unstale":"2023-11-04T01:38:44.175703+0000","last_undegraded":"2023-11-04T01:38:44.175703+0000","last_fullsized":"2023-11-04T01:38:44.175703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:39.530065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165288+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:38:43.165288+0000","last_peered":"2023-11-04T01:38:43.165288+0000","last_clean":"2023-11-04T01:38:43.165288+0000","last_became_active":"2023-11-04T01:38:22.074718+0000","last_became_peered":"2023-11-04T01:38:22.074718+0000","last_unstale":"2023-11-04T01:38:43.165288+0000","last_undegraded":"2023-11-04T01:38:43.165288+0000","last_fullsized":"2023-11-04T01:38:43.165288+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:12.056843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.154208+0000","last_change":"2023-11-04T01:38:23.062210+0000","last_active":"2023-11-04T01:38:43.154208+0000","last_peered":"2023-11-04T01:38:43.154208+0000","last_clean":"2023-11-04T01:38:43.154208+0000","last_became_active":"2023-11-04T01:38:21.062480+0000","last_became_peered":"2023-11-04T01:38:21.062480+0000","last_unstale":"2023-11-04T01:38:43.154208+0000","last_undegraded":"2023-11-04T01:38:43.154208+0000","last_fullsized":"2023-11-04T01:38:43.154208+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:20.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040890099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159108+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:38:43.159108+0000","last_peered":"2023-11-04T01:38:43.159108+0000","last_clean":"2023-11-04T01:38:43.159108+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:38:43.159108+0000","last_undegraded":"2023-11-04T01:38:43.159108+0000","last_fullsized":"2023-11-04T01:38:43.159108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194440+0000","last_change":"2023-11-04T01:38:44.191381+0000","last_active":"2023-11-04T01:38:44.194440+0000","last_peered":"2023-11-04T01:38:44.194440+0000","last_clean":"2023-11-04T01:38:44.194440+0000","last_became_active":"2023-11-04T01:38:44.191110+0000","last_became_peered":"2023-11-04T01:38:44.191110+0000","last_unstale":"2023-11-04T01:38:44.194440+0000","last_undegraded":"2023-11-04T01:38:44.194440+0000","last_fullsized":"2023-11-04T01:38:44.194440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:26.661431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172510+0000","last_change":"2023-11-04T01:38:43.169589+0000","last_active":"2023-11-04T01:38:44.172510+0000","last_peered":"2023-11-04T01:38:44.172510+0000","last_clean":"2023-11-04T01:38:44.172510+0000","last_became_active":"2023-11-04T01:38:43.169337+0000","last_became_peered":"2023-11-04T01:38:43.169337+0000","last_unstale":"2023-11-04T01:38:44.172510+0000","last_undegraded":"2023-11-04T01:38:44.172510+0000","last_fullsized":"2023-11-04T01:38:44.172510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:15.192547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164264+0000","last_change":"2023-11-04T01:38:22.070477+0000","last_active":"2023-11-04T01:38:43.164264+0000","last_peered":"2023-11-04T01:38:43.164264+0000","last_clean":"2023-11-04T01:38:43.164264+0000","last_became_active":"2023-11-04T01:38:22.070203+0000","last_became_peered":"2023-11-04T01:38:22.070203+0000","last_unstale":"2023-11-04T01:38:43.164264+0000","last_undegraded":"2023-11-04T01:38:43.164264+0000","last_fullsized":"2023-11-04T01:38:43.164264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:07.694892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155545+0000","last_change":"2023-11-04T01:38:23.060125+0000","last_active":"2023-11-04T01:38:43.155545+0000","last_peered":"2023-11-04T01:38:43.155545+0000","last_clean":"2023-11-04T01:38:43.155545+0000","last_became_active":"2023-11-04T01:38:21.068722+0000","last_became_peered":"2023-11-04T01:38:21.068722+0000","last_unstale":"2023-11-04T01:38:43.155545+0000","last_undegraded":"2023-11-04T01:38:43.155545+0000","last_fullsized":"2023-11-04T01:38:43.155545+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:13.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058911300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149807+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:38:43.149807+0000","last_peered":"2023-11-04T01:38:43.149807+0000","last_clean":"2023-11-04T01:38:43.149807+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:38:43.149807+0000","last_undegraded":"2023-11-04T01:38:43.149807+0000","last_fullsized":"2023-11-04T01:38:43.149807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183304+0000","last_change":"2023-11-04T01:38:44.176859+0000","last_active":"2023-11-04T01:38:44.183304+0000","last_peered":"2023-11-04T01:38:44.183304+0000","last_clean":"2023-11-04T01:38:44.183304+0000","last_became_active":"2023-11-04T01:38:44.176608+0000","last_became_peered":"2023-11-04T01:38:44.176608+0000","last_unstale":"2023-11-04T01:38:44.183304+0000","last_undegraded":"2023-11-04T01:38:44.183304+0000","last_fullsized":"2023-11-04T01:38:44.183304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:51.967085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169732+0000","last_change":"2023-11-04T01:38:43.173139+0000","last_active":"2023-11-04T01:38:44.169732+0000","last_peered":"2023-11-04T01:38:44.169732+0000","last_clean":"2023-11-04T01:38:44.169732+0000","last_became_active":"2023-11-04T01:38:43.171732+0000","last_became_peered":"2023-11-04T01:38:43.171732+0000","last_unstale":"2023-11-04T01:38:44.169732+0000","last_undegraded":"2023-11-04T01:38:44.169732+0000","last_fullsized":"2023-11-04T01:38:44.169732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:55:14.689717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162408+0000","last_change":"2023-11-04T01:38:22.075956+0000","last_active":"2023-11-04T01:38:43.162408+0000","last_peered":"2023-11-04T01:38:43.162408+0000","last_clean":"2023-11-04T01:38:43.162408+0000","last_became_active":"2023-11-04T01:38:22.075635+0000","last_became_peered":"2023-11-04T01:38:22.075635+0000","last_unstale":"2023-11-04T01:38:43.162408+0000","last_undegraded":"2023-11-04T01:38:43.162408+0000","last_fullsized":"2023-11-04T01:38:43.162408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.164343+0000","last_change":"2023-11-04T01:38:23.404427+0000","last_active":"2023-11-04T01:38:43.164343+0000","last_peered":"2023-11-04T01:38:43.164343+0000","last_clean":"2023-11-04T01:38:43.164343+0000","last_became_active":"2023-11-04T01:38:21.069870+0000","last_became_peered":"2023-11-04T01:38:21.069870+0000","last_unstale":"2023-11-04T01:38:43.164343+0000","last_undegraded":"2023-11-04T01:38:43.164343+0000","last_fullsized":"2023-11-04T01:38:43.164343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:47.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086834100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162979+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:38:43.162979+0000","last_peered":"2023-11-04T01:38:43.162979+0000","last_clean":"2023-11-04T01:38:43.162979+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:38:43.162979+0000","last_undegraded":"2023-11-04T01:38:43.162979+0000","last_fullsized":"2023-11-04T01:38:43.162979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.189015+0000","last_change":"2023-11-04T01:38:44.185049+0000","last_active":"2023-11-04T01:38:44.189015+0000","last_peered":"2023-11-04T01:38:44.189015+0000","last_clean":"2023-11-04T01:38:44.189015+0000","last_became_active":"2023-11-04T01:38:44.184626+0000","last_became_peered":"2023-11-04T01:38:44.184626+0000","last_unstale":"2023-11-04T01:38:44.189015+0000","last_undegraded":"2023-11-04T01:38:44.189015+0000","last_fullsized":"2023-11-04T01:38:44.189015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:44.457483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.168277+0000","last_change":"2023-11-04T01:38:43.167555+0000","last_active":"2023-11-04T01:38:44.168277+0000","last_peered":"2023-11-04T01:38:44.168277+0000","last_clean":"2023-11-04T01:38:44.168277+0000","last_became_active":"2023-11-04T01:38:43.167308+0000","last_became_peered":"2023-11-04T01:38:43.167308+0000","last_unstale":"2023-11-04T01:38:44.168277+0000","last_undegraded":"2023-11-04T01:38:44.168277+0000","last_fullsized":"2023-11-04T01:38:44.168277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:17.607307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166002+0000","last_change":"2023-11-04T01:38:22.071179+0000","last_active":"2023-11-04T01:38:43.166002+0000","last_peered":"2023-11-04T01:38:43.166002+0000","last_clean":"2023-11-04T01:38:43.166002+0000","last_became_active":"2023-11-04T01:38:22.070904+0000","last_became_peered":"2023-11-04T01:38:22.070904+0000","last_unstale":"2023-11-04T01:38:43.166002+0000","last_undegraded":"2023-11-04T01:38:43.166002+0000","last_fullsized":"2023-11-04T01:38:43.166002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:17.749810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161151+0000","last_change":"2023-11-04T01:38:23.062973+0000","last_active":"2023-11-04T01:38:43.161151+0000","last_peered":"2023-11-04T01:38:43.161151+0000","last_clean":"2023-11-04T01:38:43.161151+0000","last_became_active":"2023-11-04T01:38:21.060285+0000","last_became_peered":"2023-11-04T01:38:21.060285+0000","last_unstale":"2023-11-04T01:38:43.161151+0000","last_undegraded":"2023-11-04T01:38:43.161151+0000","last_fullsized":"2023-11-04T01:38:43.161151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:03.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097246599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161098+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:38:43.161098+0000","last_peered":"2023-11-04T01:38:43.161098+0000","last_clean":"2023-11-04T01:38:43.161098+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:38:43.161098+0000","last_undegraded":"2023-11-04T01:38:43.161098+0000","last_fullsized":"2023-11-04T01:38:43.161098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194600+0000","last_change":"2023-11-04T01:38:44.192583+0000","last_active":"2023-11-04T01:38:44.194600+0000","last_peered":"2023-11-04T01:38:44.194600+0000","last_clean":"2023-11-04T01:38:44.194600+0000","last_became_active":"2023-11-04T01:38:44.192268+0000","last_became_peered":"2023-11-04T01:38:44.192268+0000","last_unstale":"2023-11-04T01:38:44.194600+0000","last_undegraded":"2023-11-04T01:38:44.194600+0000","last_fullsized":"2023-11-04T01:38:44.194600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.193907+0000","last_change":"2023-11-04T01:38:43.163115+0000","last_active":"2023-11-04T01:38:44.193907+0000","last_peered":"2023-11-04T01:38:44.193907+0000","last_clean":"2023-11-04T01:38:44.193907+0000","last_became_active":"2023-11-04T01:38:43.162785+0000","last_became_peered":"2023-11-04T01:38:43.162785+0000","last_unstale":"2023-11-04T01:38:44.193907+0000","last_undegraded":"2023-11-04T01:38:44.193907+0000","last_fullsized":"2023-11-04T01:38:44.193907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158133+0000","last_change":"2023-11-04T01:38:22.070640+0000","last_active":"2023-11-04T01:38:43.158133+0000","last_peered":"2023-11-04T01:38:43.158133+0000","last_clean":"2023-11-04T01:38:43.158133+0000","last_became_active":"2023-11-04T01:38:22.070342+0000","last_became_peered":"2023-11-04T01:38:22.070342+0000","last_unstale":"2023-11-04T01:38:43.158133+0000","last_undegraded":"2023-11-04T01:38:43.158133+0000","last_fullsized":"2023-11-04T01:38:43.158133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.165935+0000","last_change":"2023-11-04T01:38:23.405745+0000","last_active":"2023-11-04T01:38:43.165935+0000","last_peered":"2023-11-04T01:38:43.165935+0000","last_clean":"2023-11-04T01:38:43.165935+0000","last_became_active":"2023-11-04T01:38:21.071619+0000","last_became_peered":"2023-11-04T01:38:21.071619+0000","last_unstale":"2023-11-04T01:38:43.165935+0000","last_undegraded":"2023-11-04T01:38:43.165935+0000","last_fullsized":"2023-11-04T01:38:43.165935+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:56.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096848099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159617+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:38:43.159617+0000","last_peered":"2023-11-04T01:38:43.159617+0000","last_clean":"2023-11-04T01:38:43.159617+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:38:43.159617+0000","last_undegraded":"2023-11-04T01:38:43.159617+0000","last_fullsized":"2023-11-04T01:38:43.159617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194787+0000","last_change":"2023-11-04T01:38:44.191113+0000","last_active":"2023-11-04T01:38:44.194787+0000","last_peered":"2023-11-04T01:38:44.194787+0000","last_clean":"2023-11-04T01:38:44.194787+0000","last_became_active":"2023-11-04T01:38:44.189776+0000","last_became_peered":"2023-11-04T01:38:44.189776+0000","last_unstale":"2023-11-04T01:38:44.194787+0000","last_undegraded":"2023-11-04T01:38:44.194787+0000","last_fullsized":"2023-11-04T01:38:44.194787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:49.526960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.190328+0000","last_change":"2023-11-04T01:38:43.170433+0000","last_active":"2023-11-04T01:38:44.190328+0000","last_peered":"2023-11-04T01:38:44.190328+0000","last_clean":"2023-11-04T01:38:44.190328+0000","last_became_active":"2023-11-04T01:38:43.170133+0000","last_became_peered":"2023-11-04T01:38:43.170133+0000","last_unstale":"2023-11-04T01:38:44.190328+0000","last_undegraded":"2023-11-04T01:38:44.190328+0000","last_fullsized":"2023-11-04T01:38:44.190328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:35.173829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155910+0000","last_change":"2023-11-04T01:38:22.075348+0000","last_active":"2023-11-04T01:38:43.155910+0000","last_peered":"2023-11-04T01:38:43.155910+0000","last_clean":"2023-11-04T01:38:43.155910+0000","last_became_active":"2023-11-04T01:38:22.075069+0000","last_became_peered":"2023-11-04T01:38:22.075069+0000","last_unstale":"2023-11-04T01:38:43.155910+0000","last_undegraded":"2023-11-04T01:38:43.155910+0000","last_fullsized":"2023-11-04T01:38:43.155910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:06.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.157679+0000","last_change":"2023-11-04T01:38:23.062630+0000","last_active":"2023-11-04T01:38:43.157679+0000","last_peered":"2023-11-04T01:38:43.157679+0000","last_clean":"2023-11-04T01:38:43.157679+0000","last_became_active":"2023-11-04T01:38:21.066987+0000","last_became_peered":"2023-11-04T01:38:21.066987+0000","last_unstale":"2023-11-04T01:38:43.157679+0000","last_undegraded":"2023-11-04T01:38:43.157679+0000","last_fullsized":"2023-11-04T01:38:43.157679+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:48.254134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064188099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.166256+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:38:43.166256+0000","last_peered":"2023-11-04T01:38:43.166256+0000","last_clean":"2023-11-04T01:38:43.166256+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:38:43.166256+0000","last_undegraded":"2023-11-04T01:38:43.166256+0000","last_fullsized":"2023-11-04T01:38:43.166256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.194684+0000","last_change":"2023-11-04T01:38:44.190512+0000","last_active":"2023-11-04T01:38:44.194684+0000","last_peered":"2023-11-04T01:38:44.194684+0000","last_clean":"2023-11-04T01:38:44.194684+0000","last_became_active":"2023-11-04T01:38:44.189834+0000","last_became_peered":"2023-11-04T01:38:44.189834+0000","last_unstale":"2023-11-04T01:38:44.194684+0000","last_undegraded":"2023-11-04T01:38:44.194684+0000","last_fullsized":"2023-11-04T01:38:44.194684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:39.738471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.169007+0000","last_change":"2023-11-04T01:38:43.171498+0000","last_active":"2023-11-04T01:38:44.169007+0000","last_peered":"2023-11-04T01:38:44.169007+0000","last_clean":"2023-11-04T01:38:44.169007+0000","last_became_active":"2023-11-04T01:38:43.168889+0000","last_became_peered":"2023-11-04T01:38:43.168889+0000","last_unstale":"2023-11-04T01:38:44.169007+0000","last_undegraded":"2023-11-04T01:38:44.169007+0000","last_fullsized":"2023-11-04T01:38:44.169007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:36.124325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.161272+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:38:43.161272+0000","last_peered":"2023-11-04T01:38:43.161272+0000","last_clean":"2023-11-04T01:38:43.161272+0000","last_became_active":"2023-11-04T01:38:22.074743+0000","last_became_peered":"2023-11-04T01:38:22.074743+0000","last_unstale":"2023-11-04T01:38:43.161272+0000","last_undegraded":"2023-11-04T01:38:43.161272+0000","last_fullsized":"2023-11-04T01:38:43.161272+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:33:48.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160173+0000","last_change":"2023-11-04T01:38:23.066643+0000","last_active":"2023-11-04T01:38:43.160173+0000","last_peered":"2023-11-04T01:38:43.160173+0000","last_clean":"2023-11-04T01:38:43.160173+0000","last_became_active":"2023-11-04T01:38:21.070223+0000","last_became_peered":"2023-11-04T01:38:21.070223+0000","last_unstale":"2023-11-04T01:38:43.160173+0000","last_undegraded":"2023-11-04T01:38:43.160173+0000","last_fullsized":"2023-11-04T01:38:43.160173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:52.001252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000522103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.155642+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:38:43.155642+0000","last_peered":"2023-11-04T01:38:43.155642+0000","last_clean":"2023-11-04T01:38:43.155642+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:38:43.155642+0000","last_undegraded":"2023-11-04T01:38:43.155642+0000","last_fullsized":"2023-11-04T01:38:43.155642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.183624+0000","last_change":"2023-11-04T01:38:44.178038+0000","last_active":"2023-11-04T01:38:44.183624+0000","last_peered":"2023-11-04T01:38:44.183624+0000","last_clean":"2023-11-04T01:38:44.183624+0000","last_became_active":"2023-11-04T01:38:44.177754+0000","last_became_peered":"2023-11-04T01:38:44.177754+0000","last_unstale":"2023-11-04T01:38:44.183624+0000","last_undegraded":"2023-11-04T01:38:44.183624+0000","last_fullsized":"2023-11-04T01:38:44.183624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:22:54.441008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172936+0000","last_change":"2023-11-04T01:38:43.169006+0000","last_active":"2023-11-04T01:38:44.172936+0000","last_peered":"2023-11-04T01:38:44.172936+0000","last_clean":"2023-11-04T01:38:44.172936+0000","last_became_active":"2023-11-04T01:38:43.168693+0000","last_became_peered":"2023-11-04T01:38:43.168693+0000","last_unstale":"2023-11-04T01:38:44.172936+0000","last_undegraded":"2023-11-04T01:38:44.172936+0000","last_fullsized":"2023-11-04T01:38:44.172936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:03.523253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160249+0000","last_change":"2023-11-04T01:38:22.075923+0000","last_active":"2023-11-04T01:38:43.160249+0000","last_peered":"2023-11-04T01:38:43.160249+0000","last_clean":"2023-11-04T01:38:43.160249+0000","last_became_active":"2023-11-04T01:38:22.075005+0000","last_became_peered":"2023-11-04T01:38:22.075005+0000","last_unstale":"2023-11-04T01:38:43.160249+0000","last_undegraded":"2023-11-04T01:38:43.160249+0000","last_fullsized":"2023-11-04T01:38:43.160249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:53.841576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163505+0000","last_change":"2023-11-04T01:38:23.327369+0000","last_active":"2023-11-04T01:38:43.163505+0000","last_peered":"2023-11-04T01:38:43.163505+0000","last_clean":"2023-11-04T01:38:43.163505+0000","last_became_active":"2023-11-04T01:38:21.071839+0000","last_became_peered":"2023-11-04T01:38:21.071839+0000","last_unstale":"2023-11-04T01:38:43.163505+0000","last_undegraded":"2023-11-04T01:38:43.163505+0000","last_fullsized":"2023-11-04T01:38:43.163505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:41.422222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044534300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160260+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:38:43.160260+0000","last_peered":"2023-11-04T01:38:43.160260+0000","last_clean":"2023-11-04T01:38:43.160260+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:38:43.160260+0000","last_undegraded":"2023-11-04T01:38:43.160260+0000","last_fullsized":"2023-11-04T01:38:43.160260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.173773+0000","last_change":"2023-11-04T01:38:44.172217+0000","last_active":"2023-11-04T01:38:44.173773+0000","last_peered":"2023-11-04T01:38:44.173773+0000","last_clean":"2023-11-04T01:38:44.173773+0000","last_became_active":"2023-11-04T01:38:44.171955+0000","last_became_peered":"2023-11-04T01:38:44.171955+0000","last_unstale":"2023-11-04T01:38:44.173773+0000","last_undegraded":"2023-11-04T01:38:44.173773+0000","last_fullsized":"2023-11-04T01:38:44.173773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:38.606969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.172129+0000","last_change":"2023-11-04T01:38:43.168304+0000","last_active":"2023-11-04T01:38:44.172129+0000","last_peered":"2023-11-04T01:38:44.172129+0000","last_clean":"2023-11-04T01:38:44.172129+0000","last_became_active":"2023-11-04T01:38:43.168021+0000","last_became_peered":"2023-11-04T01:38:43.168021+0000","last_unstale":"2023-11-04T01:38:44.172129+0000","last_undegraded":"2023-11-04T01:38:44.172129+0000","last_fullsized":"2023-11-04T01:38:44.172129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:47.494541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163828+0000","last_change":"2023-11-04T01:38:22.072700+0000","last_active":"2023-11-04T01:38:43.163828+0000","last_peered":"2023-11-04T01:38:43.163828+0000","last_clean":"2023-11-04T01:38:43.163828+0000","last_became_active":"2023-11-04T01:38:22.072280+0000","last_became_peered":"2023-11-04T01:38:22.072280+0000","last_unstale":"2023-11-04T01:38:43.163828+0000","last_undegraded":"2023-11-04T01:38:43.163828+0000","last_fullsized":"2023-11-04T01:38:43.163828+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163938+0000","last_change":"2023-11-04T01:38:23.327480+0000","last_active":"2023-11-04T01:38:43.163938+0000","last_peered":"2023-11-04T01:38:43.163938+0000","last_clean":"2023-11-04T01:38:43.163938+0000","last_became_active":"2023-11-04T01:38:21.071005+0000","last_became_peered":"2023-11-04T01:38:21.071005+0000","last_unstale":"2023-11-04T01:38:43.163938+0000","last_undegraded":"2023-11-04T01:38:43.163938+0000","last_fullsized":"2023-11-04T01:38:43.163938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:25.393510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081827400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163571+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:38:43.163571+0000","last_peered":"2023-11-04T01:38:43.163571+0000","last_clean":"2023-11-04T01:38:43.163571+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:38:43.163571+0000","last_undegraded":"2023-11-04T01:38:43.163571+0000","last_fullsized":"2023-11-04T01:38:43.163571+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.184150+0000","last_change":"2023-11-04T01:38:44.178811+0000","last_active":"2023-11-04T01:38:44.184150+0000","last_peered":"2023-11-04T01:38:44.184150+0000","last_clean":"2023-11-04T01:38:44.184150+0000","last_became_active":"2023-11-04T01:38:44.178569+0000","last_became_peered":"2023-11-04T01:38:44.178569+0000","last_unstale":"2023-11-04T01:38:44.184150+0000","last_undegraded":"2023-11-04T01:38:44.184150+0000","last_fullsized":"2023-11-04T01:38:44.184150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:40.736345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.192699+0000","last_change":"2023-11-04T01:38:43.173478+0000","last_active":"2023-11-04T01:38:44.192699+0000","last_peered":"2023-11-04T01:38:44.192699+0000","last_clean":"2023-11-04T01:38:44.192699+0000","last_became_active":"2023-11-04T01:38:43.173212+0000","last_became_peered":"2023-11-04T01:38:43.173212+0000","last_unstale":"2023-11-04T01:38:44.192699+0000","last_undegraded":"2023-11-04T01:38:44.192699+0000","last_fullsized":"2023-11-04T01:38:44.192699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:13.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.158975+0000","last_change":"2023-11-04T01:38:22.070891+0000","last_active":"2023-11-04T01:38:43.158975+0000","last_peered":"2023-11-04T01:38:43.158975+0000","last_clean":"2023-11-04T01:38:43.158975+0000","last_became_active":"2023-11-04T01:38:22.070338+0000","last_became_peered":"2023-11-04T01:38:22.070338+0000","last_unstale":"2023-11-04T01:38:43.158975+0000","last_undegraded":"2023-11-04T01:38:43.158975+0000","last_fullsized":"2023-11-04T01:38:43.158975+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:21.863324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.159017+0000","last_change":"2023-11-04T01:38:23.066474+0000","last_active":"2023-11-04T01:38:43.159017+0000","last_peered":"2023-11-04T01:38:43.159017+0000","last_clean":"2023-11-04T01:38:43.159017+0000","last_became_active":"2023-11-04T01:38:21.069750+0000","last_became_peered":"2023-11-04T01:38:21.069750+0000","last_unstale":"2023-11-04T01:38:43.159017+0000","last_undegraded":"2023-11-04T01:38:43.159017+0000","last_fullsized":"2023-11-04T01:38:43.159017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:07.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045060599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.163050+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:38:43.163050+0000","last_peered":"2023-11-04T01:38:43.163050+0000","last_clean":"2023-11-04T01:38:43.163050+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:38:43.163050+0000","last_undegraded":"2023-11-04T01:38:43.163050+0000","last_fullsized":"2023-11-04T01:38:43.163050+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.185231+0000","last_change":"2023-11-04T01:38:44.179424+0000","last_active":"2023-11-04T01:38:44.185231+0000","last_peered":"2023-11-04T01:38:44.185231+0000","last_clean":"2023-11-04T01:38:44.185231+0000","last_became_active":"2023-11-04T01:38:44.179146+0000","last_became_peered":"2023-11-04T01:38:44.179146+0000","last_unstale":"2023-11-04T01:38:44.185231+0000","last_undegraded":"2023-11-04T01:38:44.185231+0000","last_fullsized":"2023-11-04T01:38:44.185231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:43.144191+0000","last_clean_scrub_stamp":"2023-11-04T01:38:43.144191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:53:40.362544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:38:44.186463+0000","last_change":"2023-11-04T01:38:43.173576+0000","last_active":"2023-11-04T01:38:44.186463+0000","last_peered":"2023-11-04T01:38:44.186463+0000","last_clean":"2023-11-04T01:38:44.186463+0000","last_became_active":"2023-11-04T01:38:43.173281+0000","last_became_peered":"2023-11-04T01:38:43.173281+0000","last_unstale":"2023-11-04T01:38:44.186463+0000","last_undegraded":"2023-11-04T01:38:44.186463+0000","last_fullsized":"2023-11-04T01:38:44.186463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:42.139873+0000","last_clean_scrub_stamp":"2023-11-04T01:38:42.139873+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:48.213177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.149664+0000","last_change":"2023-11-04T01:38:22.076759+0000","last_active":"2023-11-04T01:38:43.149664+0000","last_peered":"2023-11-04T01:38:43.149664+0000","last_clean":"2023-11-04T01:38:43.149664+0000","last_became_active":"2023-11-04T01:38:22.075797+0000","last_became_peered":"2023-11-04T01:38:22.075797+0000","last_unstale":"2023-11-04T01:38:43.149664+0000","last_undegraded":"2023-11-04T01:38:43.149664+0000","last_fullsized":"2023-11-04T01:38:43.149664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:57.170559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.160932+0000","last_change":"2023-11-04T01:38:23.061342+0000","last_active":"2023-11-04T01:38:43.160932+0000","last_peered":"2023-11-04T01:38:43.160932+0000","last_clean":"2023-11-04T01:38:43.160932+0000","last_became_active":"2023-11-04T01:38:21.070645+0000","last_became_peered":"2023-11-04T01:38:21.070645+0000","last_unstale":"2023-11-04T01:38:43.160932+0000","last_undegraded":"2023-11-04T01:38:43.160932+0000","last_fullsized":"2023-11-04T01:38:43.160932+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053603500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.170183+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:38:43.170183+0000","last_peered":"2023-11-04T01:38:43.170183+0000","last_clean":"2023-11-04T01:38:43.170183+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:38:43.170183+0000","last_undegraded":"2023-11-04T01:38:43.170183+0000","last_fullsized":"2023-11-04T01:38:43.170183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":222,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:38:43.162595+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:38:43.162595+0000","last_peered":"2023-11-04T01:38:43.162595+0000","last_clean":"2023-11-04T01:38:43.162595+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:38:43.162595+0000","last_undegraded":"2023-11-04T01:38:43.162595+0000","last_fullsized":"2023-11-04T01:38:43.162595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":1572864,"data_stored":1061563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70599999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69699999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69399999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":0.755},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.29299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.754}]},{"osd":5,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74099999999999999,"5min":0.872,"15min":0.872},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":470176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626}]},{"osd":1,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.504}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63900000000000001,"5min":0.752,"15min":0.752},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.499}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.78800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":0.752},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70999999999999996,"5min":0.75,"15min":0.75},"last":0.433}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29699999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.318}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.505}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":1.133,"15min":1.133},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.65400000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.77100000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34999999999999998,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.502,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.375},"min":{"1min":0.29899999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72599999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.72199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.876,"15min":0.876},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40100000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.54700000000000004,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.39400000000000002,"15min":0.40600000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.51300000000000001,"5min":1.427,"15min":1.427},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40200000000000002,"15min":0.41099999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46999999999999997,"5min":1.375,"15min":1.375},"last":0.438},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34399999999999997,"15min":0.35099999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.437,"5min":1.266,"15min":1.266},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.167,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.497}]},{"osd":4,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.628},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83099999999999996,"5min":1.498,"15min":1.498},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74099999999999999,"5min":1.276,"15min":1.276},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.236,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.54600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":479353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.314,"15min":0.309},"min":{"1min":0.246,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.312},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.315,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.23300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.24199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.372,"15min":0.371},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48699999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40200000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1069284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.311,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42199999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.316}]},{"osd":2,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.46999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.502,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":1.048,"15min":1.048},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73199999999999998,"5min":1.056,"15min":1.056},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72199999999999998,"5min":0.874,"15min":0.874},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.67500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:47.466 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:38:47.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:38:47.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.601+0000 7fd3f4f68640 1 Processor -- start 2023-11-04T01:38:47.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.601+0000 7fd3f4f68640 1 -- start start 2023-11-04T01:38:47.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3f4f68640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3f015ad30 0x7fd3f00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3f4f68640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3f015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3f4f68640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f00c3900 con 0x7fd3f00ad730 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3f4f68640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f00ae260 con 0x7fd3f015ad30 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3f4f68640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c3be0 con 0x7fd3f0070e20 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3e7fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd3f00ad730 0x7fd3f0070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49860/0 (socket says 172.21.15.93:49860) 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3e7fff640 1 -- 172.21.15.93:0/3276050547 learned_addr learned my addr 172.21.15.93:0/3276050547 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3ee59c640 1 --2- 172.21.15.93:0/3276050547 >> v2:172.21.15.125:3300/0 conn(0x7fd3f015ad30 0x7fd3f00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615208734 0 0) 0x7fd3f00c3900 con 0x7fd3f00ad730 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc003520 con 0x7fd3f00ad730 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3eed9d640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3f015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255993288 0 0) 0x7fd3dc003520 con 0x7fd3f00ad730 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 msgr2=0x7fd3f015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3f015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 >> v2:172.21.15.125:3300/0 conn(0x7fd3f015ad30 msgr2=0x7fd3f00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 --2- 172.21.15.93:0/3276050547 >> v2:172.21.15.125:3300/0 conn(0x7fd3f015ad30 0x7fd3f00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00c3ec0 con 0x7fd3f00ad730 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.602+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fd3d8001670 con 0x7fd3f00ad730 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 >> v1:172.21.15.93:6789/0 conn(0x7fd3f00ad730 legacy=0x7fd3f0070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00ae260 con 0x7fd3dc0047c0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c3be0 con 0x7fd3dc003970 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00ba80 con 0x7fd3f0070e20 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3ee59c640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3eed9d640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 -- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 msgr2=0x7fd3dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 -- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc003970 msgr2=0x7fd3dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3dc003970 0x7fd3dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3e7fff640 1 -- 172.21.15.93:0/3276050547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc003520 con 0x7fd3dc0047c0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.603+0000 7fd3eed9d640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f0070e20 0x7fd3dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c210 tx=0x7fd3dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad74a212d2a9519b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8005ad0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8005c30 con 0x7fd3dc0047c0 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3edd9b640 1 -- 172.21.15.93:0/3276050547 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d802c8a0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 -- 172.21.15.93:0/3276050547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 msgr2=0x7fd3dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/3276050547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3dc004c40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c210 tx=0x7fd3dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3eed9d640 1 -- 172.21.15.93:0/3276050547 reap_dead start 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 -- 172.21.15.93:0/3276050547 shutdown_connections 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 -- 172.21.15.93:0/3276050547 >> 172.21.15.93:0/3276050547 conn(0x7fd3f00ce950 msgr2=0x7fd3f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 -- 172.21.15.93:0/3276050547 shutdown_connections 2023-11-04T01:38:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.604+0000 7fd3f4f68640 1 -- 172.21.15.93:0/3276050547 wait complete. 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 Processor -- start 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 -- start start 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 0x7fd3f0151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f015c7e0 0x7fd3f015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f015d1a0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01f0730 con 0x7fd3f01514a0 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3f4f68640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0151f60 con 0x7fd3f015c7e0 2023-11-04T01:38:47.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.606+0000 7fd3ee59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38870/0 (socket says 172.21.15.93:38870) 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 -- 172.21.15.93:0/1249704929 learned_addr learned my addr 172.21.15.93:0/1249704929 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 0x7fd3f0151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3eed9d640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f015c7e0 0x7fd3f015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 -- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f015c7e0 msgr2=0x7fd3f015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f015c7e0 0x7fd3f015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 -- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 msgr2=0x7fd3f0151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 0x7fd3f0151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 -- 172.21.15.93:0/1249704929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0152240 con 0x7fd3dc0047c0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 0x7fd3f0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3ee59c640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0011a70 tx=0x7fd3e0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0009680 con 0x7fd3dc0047c0 2023-11-04T01:38:47.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000fb50 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f014f120 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000fee0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.607+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f0147920 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.608+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f00ae080 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.609+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3e001d400 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.609+0000 7fd3e6ffd640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 0x7fd3d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.609+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd3e008a4a0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.609+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 0x7fd3d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.609+0000 7fd3e7fff640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 0x7fd3d006d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d8007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.613+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3e0054fe0 con 0x7fd3dc0047c0 2023-11-04T01:38:47.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.841+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd3f0074290 con 0x7fd3dc0047c0 2023-11-04T01:38:47.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.843+0000 7fd3e6ffd640 1 -- 172.21.15.93:0/1249704929 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd3e0058600 con 0x7fd3dc0047c0 2023-11-04T01:38:47.845 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:38:47.845 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:38:47.845 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow" 2023-11-04T01:38:47.846 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow r" 2023-11-04T01:38:47.846 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:47.846 INFO:teuthology.orchestra.run.smithi093.stderr:updated caps for client.0 2023-11-04T01:38:47.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 msgr2=0x7fd3d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 0x7fd3d006d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8034000 tx=0x7fd3d8007000 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 msgr2=0x7fd3f01473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0011a70 tx=0x7fd3e0011f30 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 shutdown_connections 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd3d006ae70 0x7fd3d006d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd3f015c7e0 0x7fd3f015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3f01514a0 0x7fd3f0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 --2- 172.21.15.93:0/1249704929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3dc0047c0 0x7fd3f01473e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 >> 172.21.15.93:0/1249704929 conn(0x7fd3f00ce950 msgr2=0x7fd3f015d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 shutdown_connections 2023-11-04T01:38:47.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.845+0000 7fd3f4f68640 1 -- 172.21.15.93:0/1249704929 wait complete. 2023-11-04T01:38:47.858 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:47.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.956+0000 7f9a8595e640 1 Processor -- start 2023-11-04T01:38:47.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.956+0000 7f9a8595e640 1 -- start start 2023-11-04T01:38:47.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.956+0000 7f9a8595e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a80167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.962 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.956+0000 7f9a8595e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8015e000 con 0x7f9a800ce240 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a8595e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8015e2e0 con 0x7f9a800cde60 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a8595e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8015e5c0 con 0x7f9a80157710 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a77fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9a800ce240 0x7f9a80157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49872/0 (socket says 172.21.15.93:49872) 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a77fff640 1 -- 172.21.15.93:0/72734918 learned_addr learned my addr 172.21.15.93:0/72734918 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314508989 0 0) 0x7f9a8015e000 con 0x7f9a800ce240 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a6c003520 con 0x7f9a800ce240 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7f7fe640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a80167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118899423 0 0) 0x7f9a6c003520 con 0x7f9a800ce240 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 msgr2=0x7f9a80167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a80167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 >> v1:172.21.15.125:6789/0 conn(0x7f9a800cde60 legacy=0x7f9a8015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800d1120 con 0x7f9a800ce240 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f9a68001670 con 0x7f9a800ce240 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 >> v1:172.21.15.93:6789/0 conn(0x7f9a800ce240 legacy=0x7f9a80157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a6c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a6c003f20 0x7f9a6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a6c004d00 0x7f9a6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8015e5c0 con 0x7f9a6c003f20 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c00ba60 con 0x7f9a6c004d00 2023-11-04T01:38:47.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c00bc20 con 0x7f9a80157710 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a77fff640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a6c003f20 0x7f9a6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7effd640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a6c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.957+0000 7f9a7f7fe640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a6c004d00 0x7f9a6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 -- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 msgr2=0x7f9a6c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a80157710 0x7f9a6c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 -- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a6c004d00 msgr2=0x7f9a6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a6c004d00 0x7f9a6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 -- 172.21.15.93:0/72734918 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c003520 con 0x7f9a6c003f20 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.958+0000 7f9a77fff640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a6c003f20 0x7f9a6c0047c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c240 tx=0x7f9a6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e427ca72502d425 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68005ad0 con 0x7f9a6c003f20 2023-11-04T01:38:47.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a68005c30 con 0x7f9a6c003f20 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a7e7fc640 1 -- 172.21.15.93:0/72734918 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6802caf0 con 0x7f9a6c003f20 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 -- 172.21.15.93:0/72734918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a6c003f20 msgr2=0x7f9a6c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 --2- 172.21.15.93:0/72734918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a6c003f20 0x7f9a6c0047c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c240 tx=0x7f9a6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a7f7fe640 1 -- 172.21.15.93:0/72734918 reap_dead start 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 -- 172.21.15.93:0/72734918 shutdown_connections 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 -- 172.21.15.93:0/72734918 >> 172.21.15.93:0/72734918 conn(0x7f9a80071f30 msgr2=0x7f9a800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 -- 172.21.15.93:0/72734918 shutdown_connections 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.959+0000 7f9a8595e640 1 -- 172.21.15.93:0/72734918 wait complete. 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.960+0000 7f9a8595e640 1 Processor -- start 2023-11-04T01:38:47.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.960+0000 7f9a8595e640 1 -- start start 2023-11-04T01:38:47.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a6c003f20 0x7f9a800cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a8015b7d0 0x7f9a80155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800ccd90 con 0x7f9a801ef700 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8015bc50 con 0x7f9a8015b7d0 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a8595e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801f62c0 con 0x7f9a6c003f20 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38888/0 (socket says 172.21.15.93:38888) 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 -- 172.21.15.93:0/1275961997 learned_addr learned my addr 172.21.15.93:0/1275961997 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a77fff640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a8015b7d0 0x7f9a80155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7effd640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a6c003f20 0x7f9a800cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 -- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a6c003f20 msgr2=0x7f9a800cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a6c003f20 0x7f9a800cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 -- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a8015b7d0 msgr2=0x7f9a80155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a8015b7d0 0x7f9a80155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.961+0000 7f9a7f7fe640 1 -- 172.21.15.93:0/1275961997 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a801f65a0 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a7f7fe640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9a800cf5c0 tx=0x7f9a7800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800e040 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800f040 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78015430 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a801f6880 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.962+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a800cc290 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.963+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80074290 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.963+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a78015590 con 0x7f9a801ef700 2023-11-04T01:38:47.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.964+0000 7f9a7cff9640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 0x7f9a6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.964+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f9a7808a1f0 con 0x7f9a801ef700 2023-11-04T01:38:47.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.964+0000 7f9a7effd640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 0x7f9a6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.964+0000 7f9a7effd640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 0x7f9a6006d360 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9a700035f0 tx=0x7f9a70009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:47.968+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a78054dc0 con 0x7f9a801ef700 2023-11-04T01:38:48.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.170+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a80157be0 con 0x7f9a801ef700 2023-11-04T01:38:48.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.171+0000 7f9a7cff9640 1 -- 172.21.15.93:0/1275961997 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f9a780583e0 con 0x7f9a801ef700 2023-11-04T01:38:48.173 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:48.173 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:45.502966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:48.174 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 36 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 msgr2=0x7f9a6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 0x7f9a6006d360 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9a700035f0 tx=0x7f9a70009040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 msgr2=0x7f9a801efbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9a800cf5c0 tx=0x7f9a7800f580 comp rx=0 tx=0).stop 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 shutdown_connections 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9a6006aea0 0x7f9a6006d360 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a801ef700 0x7f9a801efbb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a8015b7d0 0x7f9a80155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 --2- 172.21.15.93:0/1275961997 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9a6c003f20 0x7f9a800cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 >> 172.21.15.93:0/1275961997 conn(0x7f9a80071f30 msgr2=0x7f9a800cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 shutdown_connections 2023-11-04T01:38:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.173+0000 7f9a8595e640 1 -- 172.21.15.93:0/1275961997 wait complete. 2023-11-04T01:38:48.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:43.496462+0000', 'modified': '2023-11-04T01:38:45.502966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6924}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6924': {'gid': 6924, 'name': 'd', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6835/2732445196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 2732445196}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 2732445196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:48.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:48.589 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:38:48.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.688+0000 7f460d056640 1 Processor -- start 2023-11-04T01:38:48.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.688+0000 7f460d056640 1 -- start start 2023-11-04T01:38:48.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460d056640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f460815d1b0 0x7f46080cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460d056640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4608066000 0x7f460806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460d056640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080c9bf0 con 0x7f4608070ff0 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460d056640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080cd890 con 0x7f4608066000 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460d056640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080cdb30 con 0x7f460815d1b0 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4608066000 0x7f460806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4608066000 0x7f460806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38896/0 (socket says 172.21.15.93:38896) 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 -- 172.21.15.93:0/445840615 learned_addr learned my addr 172.21.15.93:0/445840615 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460659c640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f460815d1b0 0x7f46080cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 -- 172.21.15.93:0/445840615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f460815d1b0 msgr2=0x7f46080cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f460815d1b0 0x7f46080cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 -- 172.21.15.93:0/445840615 >> v1:172.21.15.125:6789/0 conn(0x7f4608070ff0 legacy=0x7f46080713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.689+0000 7f460759e640 1 -- 172.21.15.93:0/445840615 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080cde10 con 0x7f4608066000 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.690+0000 7f460759e640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608066000 0x7f460806a500 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ed1c5bfa110fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.690+0000 7f4605d9b640 1 -- 172.21.15.93:0/445840615 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460002cb00 con 0x7f4608066000 2023-11-04T01:38:48.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.690+0000 7f4605d9b640 1 -- 172.21.15.93:0/445840615 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460002cc60 con 0x7f4608066000 2023-11-04T01:38:48.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.690+0000 7f4605d9b640 1 -- 172.21.15.93:0/445840615 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000343f0 con 0x7f4608066000 2023-11-04T01:38:48.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 -- 172.21.15.93:0/445840615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608066000 msgr2=0x7f460806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608066000 0x7f460806a500 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460002bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:48.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 -- 172.21.15.93:0/445840615 shutdown_connections 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608066000 0x7f460806a500 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 --2- 172.21.15.93:0/445840615 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f460815d1b0 0x7f46080cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 -- 172.21.15.93:0/445840615 >> 172.21.15.93:0/445840615 conn(0x7f46080cbc90 msgr2=0x7f46080cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 -- 172.21.15.93:0/445840615 shutdown_connections 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.691+0000 7f460d056640 1 -- 172.21.15.93:0/445840615 wait complete. 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.692+0000 7f460d056640 1 Processor -- start 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.692+0000 7f460d056640 1 -- start start 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4608066000 0x7f460814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4608070ff0 0x7f46080b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460815ffc0 con 0x7f460815d1b0 2023-11-04T01:38:48.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46081513e0 con 0x7f4608066000 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460d056640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b24f0 con 0x7f4608070ff0 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38902/0 (socket says 172.21.15.93:38902) 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 -- 172.21.15.93:0/3745767397 learned_addr learned my addr 172.21.15.93:0/3745767397 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4608066000 0x7f460814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460659c640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4608070ff0 0x7f46080b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 -- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4608070ff0 msgr2=0x7f46080b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4608070ff0 0x7f46080b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 -- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4608066000 msgr2=0x7f460814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4608066000 0x7f460814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 -- 172.21.15.93:0/3745767397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600009b30 con 0x7f460815d1b0 2023-11-04T01:38:48.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.693+0000 7f460759e640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4600009f70 tx=0x7f4600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.694+0000 7f45ef7fe640 1 -- 172.21.15.93:0/3745767397 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600009510 con 0x7f460815d1b0 2023-11-04T01:38:48.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.694+0000 7f45ef7fe640 1 -- 172.21.15.93:0/3745767397 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460003e450 con 0x7f460815d1b0 2023-11-04T01:38:48.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.694+0000 7f45ef7fe640 1 -- 172.21.15.93:0/3745767397 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460003e800 con 0x7f460815d1b0 2023-11-04T01:38:48.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.694+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46081503c0 con 0x7f460815d1b0 2023-11-04T01:38:48.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.694+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4608150980 con 0x7f460815d1b0 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.695+0000 7f45ef7fe640 1 -- 172.21.15.93:0/3745767397 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f460003e960 con 0x7f460815d1b0 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.695+0000 7f45ef7fe640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 0x7f45f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.695+0000 7f45ef7fe640 1 -- 172.21.15.93:0/3745767397 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f46000ac390 con 0x7f460815d1b0 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.696+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 0x7f45f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.696+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 0x7f45f406d360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f45f8000f60 tx=0x7f45f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.696+0000 7f460fbea740 1 Processor -- start 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 -- start start 2023-11-04T01:38:48.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72452850 0x556c72425750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72425c90 0x556c72455b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c72336740 con 0x556c72452c30 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c723988d0 con 0x556c72425c90 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c72395fc0 con 0x556c72452850 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.697+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38912/0 (socket says 172.21.15.93:38912) 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 -- 172.21.15.93:0/2579278771 learned_addr learned my addr 172.21.15.93:0/2579278771 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f4606d9d640 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72452850 0x556c72425750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460759e640 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72425c90 0x556c72455b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 -- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72452850 msgr2=0x556c72425750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72452850 0x556c72425750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 -- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72425c90 msgr2=0x556c72455b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72425c90 0x556c72455b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 -- 172.21.15.93:0/2579278771 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c72354ca0 con 0x556c72452c30 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f460659c640 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4608150240 tx=0x7f45fc00bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830f47feb4445d0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f45ecff9640 1 -- 172.21.15.93:0/2579278771 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004020 con 0x556c72452c30 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f45ecff9640 1 -- 172.21.15.93:0/2579278771 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc004180 con 0x556c72452c30 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.698+0000 7f45ecff9640 1 -- 172.21.15.93:0/2579278771 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00f7c0 con 0x556c72452c30 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- 172.21.15.93:0/2579278771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 msgr2=0x556c724555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4608150240 tx=0x7f45fc00bd00 comp rx=0 tx=0).stop 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- 172.21.15.93:0/2579278771 shutdown_connections 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72425c90 0x556c72455b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c724555e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 --2- 172.21.15.93:0/2579278771 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72452850 0x556c72425750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- 172.21.15.93:0/2579278771 >> 172.21.15.93:0/2579278771 conn(0x556c72427a60 msgr2=0x556c724705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- 172.21.15.93:0/2579278771 shutdown_connections 2023-11-04T01:38:48.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- 172.21.15.93:0/2579278771 wait complete. 2023-11-04T01:38:48.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 -- start start 2023-11-04T01:38:48.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.699+0000 7f460fbea740 1 Processor -- start 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7245c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72456c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c723918b0 con 0x556c72452c30 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7234bc80 con 0x556c72452850 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c7234b920 con 0x556c72450290 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460fbea740 10 client.0 _ll_register_callbacks cb 0x556c720a3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:48.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38914/0 (socket says 172.21.15.93:38914) 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460659c640 1 -- 172.21.15.93:0/555408833 learned_addr learned my addr 172.21.15.93:0/555408833 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f4606d9d640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7245c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.700+0000 7f460759e640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72456c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 -- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 msgr2=0x556c72456c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72456c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 -- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 msgr2=0x556c7245c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7245c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 -- 172.21.15.93:0/555408833 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc00e040 con 0x556c72452c30 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460659c640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f45fc016000 tx=0x7f45fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744befee79c4df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:38:48.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00fd80 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f45fc003610 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c7233dbf0 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45fc00fee0 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 10 client.7080 fetch_fsmap learned FSMap version 36 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556c7238ff30 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c7233dbf0 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f45fc0037d0 con 0x556c72452c30 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 10 client.7080 fetch_fsmap finished waiting for FSMap version 36 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 10 client.7080 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 20 client.7080 populate_metadata read hostname 'smithi093' 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c72480340 0x556c72480720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 4 client.7080 mds_command: new command op to 6924 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.701+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 --> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c7238a890 con 0x556c72480340 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.702+0000 7f4606d9d640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c72480340 0x556c72480720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.702+0000 7f45e5ffb640 10 client.7080 ms_handle_connect on v2:172.21.15.125:6833/2732445196 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.702+0000 7f4606d9d640 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c72480340 0x556c72480720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e9448fa7849057 server_cookie=f73aed9f1ea4dcb1 in_seq=0 out_seq=0 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f45e5ffb640 1 -- 172.21.15.93:0/555408833 <== mds.0 v2:172.21.15.125:6833/2732445196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c7238a890 con 0x556c72480340 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f45e5ffb640 10 client.7080 handle_command_reply: tid=0 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 client.7080 shutdown 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 msgr2=0x556c7245c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f45fc016000 tx=0x7f45fc004730 comp rx=0 tx=0).stop 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 shutdown_connections 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c72480340 0x556c72480720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72456c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c7245c7a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f45e5ffb640 0 client.7080 ms_handle_reset on v2:172.21.15.125:6833/2732445196 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 --2- 172.21.15.93:0/555408833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7245c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 >> 172.21.15.93:0/555408833 conn(0x556c72425c90 msgr2=0x556c724296d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 shutdown_connections 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 1 -- 172.21.15.93:0/555408833 wait complete. 2023-11-04T01:38:48.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.703+0000 7f460fbea740 20 client.7080 trim_cache size 0 max 16384 2023-11-04T01:38:48.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.718+0000 7f460fbea740 1 Processor -- start 2023-11-04T01:38:48.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.718+0000 7f460fbea740 1 -- start start 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72424d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7242c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c72311280 con 0x556c72452c30 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7245e1f0 con 0x556c72452850 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c723909b0 con 0x556c72450290 2023-11-04T01:38:48.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38922/0 (socket says 172.21.15.93:38922) 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 -- 172.21.15.93:0/3645829729 learned_addr learned my addr 172.21.15.93:0/3645829729 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72424d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460659c640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7242c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 -- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 msgr2=0x556c72424d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72424d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 -- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 msgr2=0x556c7242c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7242c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 -- 172.21.15.93:0/3645829729 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c7232dd10 con 0x556c72452c30 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72424d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f460759e640 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f46000aa3e0 tx=0x7f4600041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155f0f0d522e99fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f45ed7fa640 1 -- 172.21.15.93:0/3645829729 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460007b320 con 0x556c72452c30 2023-11-04T01:38:48.724 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.719+0000 7f45ed7fa640 1 -- 172.21.15.93:0/3645829729 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460007ac20 con 0x556c72452c30 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f45ed7fa640 1 -- 172.21.15.93:0/3645829729 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460007ed70 con 0x556c72452c30 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 -- 172.21.15.93:0/3645829729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 msgr2=0x556c72470b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f46000aa3e0 tx=0x7f4600041040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 -- 172.21.15.93:0/3645829729 shutdown_connections 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452c30 0x556c72470b80 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452850 0x556c7242c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 --2- 172.21.15.93:0/3645829729 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c72424d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 -- 172.21.15.93:0/3645829729 >> 172.21.15.93:0/3645829729 conn(0x556c72425c90 msgr2=0x556c724587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 -- 172.21.15.93:0/3645829729 shutdown_connections 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.720+0000 7f460fbea740 1 -- 172.21.15.93:0/3645829729 wait complete. 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 -- start start 2023-11-04T01:38:48.725 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 Processor -- start 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c724c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 0x556c72470b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c724740c0 con 0x556c72452850 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c724c1550 con 0x556c72452c30 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c724c16f0 con 0x556c72450290 2023-11-04T01:38:48.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460fbea740 10 client.0 _ll_register_callbacks cb 0x7f45fc00b2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38926/0 (socket says 172.21.15.93:38926) 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.721+0000 7f460659c640 1 -- 172.21.15.93:0/3683355031 learned_addr learned my addr 172.21.15.93:0/3683355031 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460759e640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 0x556c72470b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c724c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 -- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 msgr2=0x556c724c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c724c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 -- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 msgr2=0x556c72470b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 0x556c72470b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 -- 172.21.15.93:0/3683355031 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4608150980 con 0x556c72452850 2023-11-04T01:38:48.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460759e640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 0x556c72470b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c724c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460659c640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f45fc016000 tx=0x7f45fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3773804e2248c51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00b6f0 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f45fc000e40 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45fc004180 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45fc00f9d0 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 10 client.7086 fetch_fsmap learned FSMap version 36 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556c72353500 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc004180 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f45fc014460 con 0x556c72452850 2023-11-04T01:38:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 10 client.7086 fetch_fsmap finished waiting for FSMap version 36 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 10 client.7086 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 20 client.7086 populate_metadata read hostname 'smithi093' 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c724de520 0x556c724de900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 4 client.7086 mds_command: new command op to 6924 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.722+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 --> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c7238a5b0 con 0x556c724de520 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c724de520 0x556c724de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f45e5ffb640 10 client.7086 ms_handle_connect on v2:172.21.15.125:6833/2732445196 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f4606d9d640 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c724de520 0x556c724de900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70a22f320d09f63b server_cookie=f4046cbfccf17bf0 in_seq=0 out_seq=0 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f45e5ffb640 1 -- 172.21.15.93:0/3683355031 <== mds.0 v2:172.21.15.125:6833/2732445196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556c7238a5b0 con 0x556c724de520 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f45e5ffb640 10 client.7086 handle_command_reply: tid=0 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 client.7086 shutdown 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 msgr2=0x556c72473b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f45fc016000 tx=0x7f45fc015000 comp rx=0 tx=0).stop 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 shutdown_connections 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:6833/2732445196,v1:172.21.15.125:6835/2732445196] conn(0x556c724de520 0x556c724de900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556c72452c30 0x556c72470b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556c72452850 0x556c72473b80 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 --2- 172.21.15.93:0/3683355031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556c72450290 0x556c724c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f45e5ffb640 0 client.7086 ms_handle_reset on v2:172.21.15.125:6833/2732445196 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 >> 172.21.15.93:0/3683355031 conn(0x556c72425c90 msgr2=0x556c724587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 shutdown_connections 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.723+0000 7f460fbea740 1 -- 172.21.15.93:0/3683355031 wait complete. 2023-11-04T01:38:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460fbea740 20 client.7086 trim_cache size 0 max 16384 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 6924, 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 4.5568243849999996, 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 36, 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 82, 2023-11-04T01:38:48.734 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 82, 2023-11-04T01:38:48.735 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 10.592486813000001 2023-11-04T01:38:48.735 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:48.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 msgr2=0x7f45f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 0x7f45f406d360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f45f8000f60 tx=0x7f45f8009040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 msgr2=0x7f4608150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4600009f70 tx=0x7f4600004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 shutdown_connections 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45f406aea0 0x7f45f406d360 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f460815d1b0 0x7f4608150ea0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4608070ff0 0x7f46080b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 --2- 172.21.15.93:0/3745767397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4608066000 0x7f460814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 >> 172.21.15.93:0/3745767397 conn(0x7f46080cbc90 msgr2=0x7f46080714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 shutdown_connections 2023-11-04T01:38:48.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.724+0000 7f460d056640 1 -- 172.21.15.93:0/3745767397 wait complete. 2023-11-04T01:38:48.737 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:48.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.834+0000 7f7a1359e640 1 Processor -- start 2023-11-04T01:38:48.836 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.834+0000 7f7a1359e640 1 -- start start 2023-11-04T01:38:48.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1359e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a1415d080 0x7f7a140cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1359e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 0x7f7a140b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1359e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1406d340 con 0x7f7a1415e100 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1359e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140b2de0 con 0x7f7a1415d080 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1359e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140cf5a0 con 0x7f7a140b2410 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a1415d080 0x7f7a140cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a11d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7a1415e100 0x7f7a140cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:49878/0 (socket says 172.21.15.93:49878) 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a11d9b640 1 -- 172.21.15.93:0/3263878386 learned_addr learned my addr 172.21.15.93:0/3263878386 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a12d9d640 1 --2- 172.21.15.93:0/3263878386 >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 0x7f7a140b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1259c640 1 -- 172.21.15.93:0/3263878386 >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 msgr2=0x7f7a140b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1259c640 1 --2- 172.21.15.93:0/3263878386 >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 0x7f7a140b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1259c640 1 -- 172.21.15.93:0/3263878386 >> v1:172.21.15.93:6789/0 conn(0x7f7a1415e100 legacy=0x7f7a140cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1259c640 1 -- 172.21.15.93:0/3263878386 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1406cd80 con 0x7f7a1415d080 2023-11-04T01:38:48.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a1159a640 1 -- 172.21.15.93:0/3263878386 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913051974 0 0) 0x7f7a1406d340 con 0x7f7a1415e100 2023-11-04T01:38:48.839 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.835+0000 7f7a12d9d640 1 --2- 172.21.15.93:0/3263878386 >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 0x7f7a140b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1259c640 1 --2- 172.21.15.93:0/3263878386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140cdf30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7a140c79f0 tx=0x7f7a0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afada264a2636f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1159a640 1 -- 172.21.15.93:0/3263878386 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04031830 con 0x7f7a1415d080 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1159a640 1 -- 172.21.15.93:0/3263878386 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04031990 con 0x7f7a1415d080 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1159a640 1 -- 172.21.15.93:0/3263878386 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04031d20 con 0x7f7a1415d080 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 -- 172.21.15.93:0/3263878386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 msgr2=0x7f7a140cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 --2- 172.21.15.93:0/3263878386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140cdf30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7a140c79f0 tx=0x7f7a0402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 -- 172.21.15.93:0/3263878386 shutdown_connections 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 --2- 172.21.15.93:0/3263878386 >> v2:172.21.15.125:3300/0 conn(0x7f7a140b2410 0x7f7a140b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 --2- 172.21.15.93:0/3263878386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140cdf30 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 -- 172.21.15.93:0/3263878386 >> 172.21.15.93:0/3263878386 conn(0x7f7a140cd410 msgr2=0x7f7a140cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 -- 172.21.15.93:0/3263878386 shutdown_connections 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.836+0000 7f7a1359e640 1 -- 172.21.15.93:0/3263878386 wait complete. 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 Processor -- start 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 -- start start 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a140b2410 0x7f7a140ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 0x7f7a14160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140b5550 con 0x7f7a1415d080 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140b5830 con 0x7f7a1415e100 2023-11-04T01:38:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.838+0000 7f7a1359e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140b5b10 con 0x7f7a140b2410 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38950/0 (socket says 172.21.15.93:38950) 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 -- 172.21.15.93:0/2560056202 learned_addr learned my addr 172.21.15.93:0/2560056202 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a12d9d640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 0x7f7a14160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a1259c640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a140b2410 0x7f7a140ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 -- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a140b2410 msgr2=0x7f7a140ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a140b2410 0x7f7a140ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 -- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 msgr2=0x7f7a14160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 0x7f7a14160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 -- 172.21.15.93:0/2560056202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009400 con 0x7f7a1415d080 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a12d9d640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 0x7f7a14160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a11d9b640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c430 tx=0x7f7a0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080074e0 con 0x7f7a1415d080 2023-11-04T01:38:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a08007660 con 0x7f7a1415d080 2023-11-04T01:38:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a140b5df0 con 0x7f7a1415d080 2023-11-04T01:38:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08004a20 con 0x7f7a1415d080 2023-11-04T01:38:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.839+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a14158100 con 0x7f7a1415d080 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.840+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1406e5b0 con 0x7f7a1415d080 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.841+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a08004b80 con 0x7f7a1415d080 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.841+0000 7f7a02ffd640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 0x7f79f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.841+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7a080899b0 con 0x7f7a1415d080 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.841+0000 7f7a1259c640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 0x7f79f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.842+0000 7f7a1259c640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 0x7f79f406d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7a04036000 tx=0x7f7a04008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:48.845+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a080544f0 con 0x7f7a1415d080 2023-11-04T01:38:49.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.046+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a140b6310 con 0x7f7a1415d080 2023-11-04T01:38:49.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.046+0000 7f7a02ffd640 1 -- 172.21.15.93:0/2560056202 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a140b6310 con 0x7f7a1415d080 2023-11-04T01:38:49.048 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 msgr2=0x7f79f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 0x7f79f406d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7a04036000 tx=0x7f7a04008030 comp rx=0 tx=0).stop 2023-11-04T01:38:49.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 msgr2=0x7f7a140b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c430 tx=0x7f7a0800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 shutdown_connections 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f79f406ae70 0x7f79f406d330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1415e100 0x7f7a14160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a1415d080 0x7f7a140b4a90 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 --2- 172.21.15.93:0/2560056202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a140b2410 0x7f7a140ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 >> 172.21.15.93:0/2560056202 conn(0x7f7a140cd410 msgr2=0x7f7a140cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 shutdown_connections 2023-11-04T01:38:49.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:49.048+0000 7f7a1359e640 1 -- 172.21.15.93:0/2560056202 wait complete. 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:49.061 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:49.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.062 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:49.077 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41671sec preferred_lft 41671sec 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.078 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:38:49.079 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:49.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.080 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:49.142 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:38:49.140+0000 7febc879a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:49.143 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:38:49.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.144 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:38:49.199 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:38:49.200 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:49.200 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:38:49.200 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:38:49.200 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:49.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.200 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:38:49.200 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:38:49.200 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:38:49.201 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:38:49.201 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:38:49.201 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:38:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.295 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:38:49.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:49.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:49.310 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:49.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.310 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:38:49.378 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:49.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:49.378 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:49.433 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:49.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:49.433 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:49.487 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:49.542 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:49.542 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:49.542 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:49.543 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:49.544 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:49.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.545 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:49.599 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:49.600 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:49.642 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:49.657 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:49.657 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:49.657 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:49.657 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:49.658 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:49.659 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:49.660 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:49.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:49.661 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:49.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:38:49.730+0000 7f962200b480 -1 init, newargv = 0x55987fad0190 newargc=15 2023-11-04T01:38:49.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[144920]: starting ceph client 2023-11-04T01:38:49.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[144920]: starting fuse 2023-11-04T01:38:50.814 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:50.832 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:38:50.832 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:50.833 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:50.834 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:50.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:50.835 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:38:50.889 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:38:50.889 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:50.890 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:38:50.891 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:38:50.892 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:38:50.892 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:50.892 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:38:50.892 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:50.892 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:38:51.015 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.144920.asok 2023-11-04T01:38:51.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:51.026 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.144920.asok 2023-11-04T01:38:51.026 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:51.026 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.144920.asok status 2023-11-04T01:38:51.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:51.195 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:38:51.195 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:38:51.195 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "144920", 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7101, 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:38:51.196 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 7101 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3109194029 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:38:51.197 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3109194029 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.7101 192.168.0.1:0/3109194029", 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/3109194029", 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 36, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 82, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:38:51.198 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:38:51.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:51.209 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:51.209 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:51.210 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:51.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:51.268 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:38:51.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:51.275 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:51.275 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:51.275 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:51.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:51.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:51.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:38:51.451 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:38:51.452 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:38:51.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:51.452 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:38:51.474 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:38:51.551 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:51.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:51.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.616+0000 7f7c5a54c640 1 Processor -- start 2023-11-04T01:38:51.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.616+0000 7f7c5a54c640 1 -- start start 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c5a54c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c5406a830 0x7f7c540b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c5a54c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540cdc30 con 0x7f7c540cb650 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c5a54c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540cd620 con 0x7f7c540cb270 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c5a54c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5406fe00 con 0x7f7c5406a830 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c58ae9640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7c540cb650 0x7f7c54160e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40394/0 (socket says 172.21.15.93:40394) 2023-11-04T01:38:51.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c58ae9640 1 -- 172.21.15.93:0/3994825462 learned_addr learned my addr 172.21.15.93:0/3994825462 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.617+0000 7f7c537fe640 1 --2- 172.21.15.93:0/3994825462 >> v2:172.21.15.125:3300/0 conn(0x7f7c5406a830 0x7f7c540b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283448096 0 0) 0x7f7c540cdc30 con 0x7f7c540cb650 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c3c003520 con 0x7f7c540cb650 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624432062 0 0) 0x7f7c540cd620 con 0x7f7c540cb270 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c540cdc30 con 0x7f7c540cb270 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2523777927 0 0) 0x7f7c3c003520 con 0x7f7c540cb650 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 >> v2:172.21.15.125:3300/0 conn(0x7f7c5406a830 msgr2=0x7f7c540b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 --2- 172.21.15.93:0/3994825462 >> v2:172.21.15.125:3300/0 conn(0x7f7c5406a830 0x7f7c540b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 >> v1:172.21.15.125:6789/0 conn(0x7f7c540cb270 legacy=0x7f7c5406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540700e0 con 0x7f7c540cb650 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f7c4c0019f0 con 0x7f7c540cb650 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 >> v1:172.21.15.93:6789/0 conn(0x7f7c540cb650 legacy=0x7f7c54160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 0x7f7c3c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3c0047c0 0x7f7c3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c005180 0x7f7c3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5406fe00 con 0x7f7c3c003b00 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c00c000 con 0x7f7c3c0047c0 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c00c1c0 con 0x7f7c3c005180 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 0x7f7c3c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c537fe640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3c0047c0 0x7f7c3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c58ae9640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c005180 0x7f7c3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 -- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c005180 msgr2=0x7f7c3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c005180 0x7f7c3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 -- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3c0047c0 msgr2=0x7f7c3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3c0047c0 0x7f7c3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c53fff640 1 -- 172.21.15.93:0/3994825462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c003520 con 0x7f7c3c003b00 2023-11-04T01:38:51.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.618+0000 7f7c58ae9640 1 -- 172.21.15.93:0/3994825462 reap_dead start 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.619+0000 7f7c53fff640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 0x7f7c3c003f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7c440018d0 tx=0x7f7c3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c0bb365588783 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.619+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440052d0 con 0x7f7c3c003b00 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.619+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44005430 con 0x7f7c3c003b00 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.619+0000 7f7c52ffd640 1 -- 172.21.15.93:0/3994825462 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44003810 con 0x7f7c3c003b00 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 -- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 msgr2=0x7f7c3c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 0x7f7c3c003f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7c440018d0 tx=0x7f7c3c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 -- 172.21.15.93:0/3994825462 shutdown_connections 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/3994825462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c3c003b00 0x7f7c3c003f00 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 -- 172.21.15.93:0/3994825462 >> 172.21.15.93:0/3994825462 conn(0x7f7c5406d820 msgr2=0x7f7c5406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 -- 172.21.15.93:0/3994825462 shutdown_connections 2023-11-04T01:38:51.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.620+0000 7f7c5a54c640 1 -- 172.21.15.93:0/3994825462 wait complete. 2023-11-04T01:38:51.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.621+0000 7f7c5a54c640 1 Processor -- start 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.621+0000 7f7c5a54c640 1 -- start start 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 0x7f7c540c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c540c9190 0x7f7c5415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540ab980 con 0x7f7c540c9610 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540abc60 con 0x7f7c540c9190 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540abf40 con 0x7f7c3c003b00 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56716/0 (socket says 172.21.15.93:56716) 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 -- 172.21.15.93:0/510558476 learned_addr learned my addr 172.21.15.93:0/510558476 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c53fff640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 0x7f7c540c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c537fe640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c540c9190 0x7f7c5415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 -- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 msgr2=0x7f7c540c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 0x7f7c540c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 -- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c540c9190 msgr2=0x7f7c5415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c540c9190 0x7f7c5415be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 -- 172.21.15.93:0/510558476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540ac220 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c53fff640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 0x7f7c540c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c58ae9640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004740 tx=0x7f7c4c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00ee20 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c013420 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.622+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540ac500 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.623+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0137d0 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.623+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540c88c0 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.623+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5404e490 con 0x7f7c540c9610 2023-11-04T01:38:51.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.624+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c4c013930 con 0x7f7c540c9610 2023-11-04T01:38:51.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.624+0000 7f7c50ff9640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.624+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7c4c089f30 con 0x7f7c540c9610 2023-11-04T01:38:51.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.624+0000 7f7c53fff640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.625+0000 7f7c53fff640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 0x7f7c4006d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c44031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.628+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c4c054b00 con 0x7f7c540c9610 2023-11-04T01:38:51.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:51.828+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c540b59d0 con 0x7f7c540c9610 2023-11-04T01:38:52.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.192+0000 7f7c50ff9640 1 -- 172.21.15.93:0/510558476 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c4c058120 con 0x7f7c540c9610 2023-11-04T01:38:52.195 INFO:teuthology.orchestra.run.smithi093.stderr:disabled new snapshots 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 msgr2=0x7f7c4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 0x7f7c4006d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c44031000 comp rx=0 tx=0).stop 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 msgr2=0x7f7c5415c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004740 tx=0x7f7c4c00e530 comp rx=0 tx=0).stop 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 shutdown_connections 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7c4006ae70 0x7f7c4006d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540c9610 0x7f7c5415c3b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c540c9190 0x7f7c5415be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 --2- 172.21.15.93:0/510558476 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7c3c003b00 0x7f7c540c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.194+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 >> 172.21.15.93:0/510558476 conn(0x7f7c5406d820 msgr2=0x7f7c540c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.195+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 shutdown_connections 2023-11-04T01:38:52.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.195+0000 7f7c5a54c640 1 -- 172.21.15.93:0/510558476 wait complete. 2023-11-04T01:38:52.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:52.207 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:38:52.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:52.267 INFO:teuthology.orchestra.run.smithi093.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-11-04T01:38:52.267 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:38:52.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.408+0000 7f8d197d0640 1 Processor -- start 2023-11-04T01:38:52.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.408+0000 7f8d197d0640 1 -- start start 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d197d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8d140ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d197d0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140c5890 con 0x7f8d14159be0 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d197d0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140cd8e0 con 0x7f8d140adc70 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d197d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140ae100 con 0x7f8d1415e420 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d12ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d14159be0 0x7f8d140c4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40404/0 (socket says 172.21.15.93:40404) 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d12ffd640 1 -- 172.21.15.93:0/2728913023 learned_addr learned my addr 172.21.15.93:0/2728913023 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d127fc640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8d140ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744049189 0 0) 0x7f8d140c5890 con 0x7f8d14159be0 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.409+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cfc003520 con 0x7f8d14159be0 2023-11-04T01:38:52.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823607235 0 0) 0x7f8cfc003520 con 0x7f8d14159be0 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 msgr2=0x7f8d140ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8d140ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 >> v1:172.21.15.125:6789/0 conn(0x7f8d140adc70 legacy=0x7f8d140c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140cdbc0 con 0x7f8d14159be0 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8d040019f0 con 0x7f8d14159be0 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 >> v1:172.21.15.93:6789/0 conn(0x7f8d14159be0 legacy=0x7f8d140c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cfc0039a0 0x7f8cfc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0047c0 0x7f8cfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8cfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140ae100 con 0x7f8cfc0039a0 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc00bab0 con 0x7f8cfc0047c0 2023-11-04T01:38:52.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc00bc70 con 0x7f8d1415e420 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cfc0039a0 0x7f8cfc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d127fc640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0047c0 0x7f8cfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d137fe640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8cfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 -- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 msgr2=0x7f8cfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d1415e420 0x7f8cfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 -- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0047c0 msgr2=0x7f8cfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0047c0 0x7f8cfc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.410+0000 7f8d12ffd640 1 -- 172.21.15.93:0/2728913023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc003520 con 0x7f8cfc0039a0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cfc0039a0 0x7f8cfc003dc0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400a830 tx=0x7f8cfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f10a65260176fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040072d0 con 0x7f8cfc0039a0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0402f070 con 0x7f8cfc0039a0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d11ffb640 1 -- 172.21.15.93:0/2728913023 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040076b0 con 0x7f8cfc0039a0 2023-11-04T01:38:52.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 -- 172.21.15.93:0/2728913023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cfc0039a0 msgr2=0x7f8cfc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 --2- 172.21.15.93:0/2728913023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8cfc0039a0 0x7f8cfc003dc0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400a830 tx=0x7f8cfc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d137fe640 1 -- 172.21.15.93:0/2728913023 reap_dead start 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 -- 172.21.15.93:0/2728913023 shutdown_connections 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 -- 172.21.15.93:0/2728913023 >> 172.21.15.93:0/2728913023 conn(0x7f8d140b05d0 msgr2=0x7f8d140b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 -- 172.21.15.93:0/2728913023 shutdown_connections 2023-11-04T01:38:52.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.411+0000 7f8d197d0640 1 -- 172.21.15.93:0/2728913023 wait complete. 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 Processor -- start 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 -- start start 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 0x7f8d141515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d140c7ca0 0x7f8d140c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c8640 con 0x7f8d14157580 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140b19a0 con 0x7f8cfc0039a0 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.413+0000 7f8d197d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d141582b0 con 0x7f8d140c7ca0 2023-11-04T01:38:52.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56740/0 (socket says 172.21.15.93:56740) 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 -- 172.21.15.93:0/1448431721 learned_addr learned my addr 172.21.15.93:0/1448431721 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 0x7f8d141515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d127fc640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d140c7ca0 0x7f8d140c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 -- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d140c7ca0 msgr2=0x7f8d140c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d140c7ca0 0x7f8d140c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 -- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 msgr2=0x7f8d141515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 0x7f8d141515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 -- 172.21.15.93:0/1448431721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14158590 con 0x7f8d14157580 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 0x7f8d141515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:52.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d137fe640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071b00 tx=0x7f8d0c00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0053a0 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0035f0 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14158870 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0039a0 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.414+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d14157f40 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.415+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140b1b50 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.416+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d0c003b00 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.416+0000 7f8cfb7fe640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.416+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8d0c0897a0 con 0x7f8d14157580 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.416+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.416+0000 7f8d12ffd640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d04034000 tx=0x7f8d04007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.420+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d140b1b50 con 0x7f8d14157580 2023-11-04T01:38:52.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:52.621+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8d140b1b10 con 0x7f8d14157580 2023-11-04T01:38:53.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.193+0000 7f8cfb7fe640 1 -- 172.21.15.93:0/1448431721 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v38) v1 ==== 167+0+0 (secure 0 0 0) 0x7f8d0c054390 con 0x7f8d14157580 2023-11-04T01:38:53.196 INFO:teuthology.orchestra.run.smithi093.stderr:enabled new snapshots 2023-11-04T01:38:53.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 msgr2=0x7f8d0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d04034000 tx=0x7f8d04007000 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 msgr2=0x7f8d14157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8d14071b00 tx=0x7f8d0c00f920 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 shutdown_connections 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d0006ae70 0x7f8d0006d330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d14157580 0x7f8d14157a00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d140c7ca0 0x7f8d140c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 --2- 172.21.15.93:0/1448431721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cfc0039a0 0x7f8d141515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 >> 172.21.15.93:0/1448431721 conn(0x7f8d140b05d0 msgr2=0x7f8d140c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 shutdown_connections 2023-11-04T01:38:53.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.196+0000 7f8d197d0640 1 -- 172.21.15.93:0/1448431721 wait complete. 2023-11-04T01:38:53.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:53.211 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:38:53.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:53.235 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:38:53.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:53.298 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:38:53.356 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:53.357 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:53.445 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:53.487 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:53.488 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:53.488 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:53.503 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:53.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.640+0000 7fa77d389640 1 Processor -- start 2023-11-04T01:38:53.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.640+0000 7fa77d389640 1 -- start start 2023-11-04T01:38:53.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa77d389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa778157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa77d389640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa778157540 0x7fa7780d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa77d389640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77815e000 con 0x7fa7780cde60 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa77d389640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77815e5c0 con 0x7fa778157540 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa77d389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815e2e0 con 0x7fa7780ce240 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa776ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa7780cde60 0x7fa77815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40412/0 (socket says 172.21.15.93:40412) 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.641+0000 7fa776ffd640 1 -- 172.21.15.93:0/2300940518 learned_addr learned my addr 172.21.15.93:0/2300940518 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa7777fe640 1 --2- 172.21.15.93:0/2300940518 >> v2:172.21.15.125:3300/0 conn(0x7fa778157540 0x7fa7780d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa7767fc640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa778157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774206560 0 0) 0x7fa77815e000 con 0x7fa7780cde60 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760003520 con 0x7fa7780cde60 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207736353 0 0) 0x7fa760003520 con 0x7fa7780cde60 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 msgr2=0x7fa778157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa778157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 >> v2:172.21.15.125:3300/0 conn(0x7fa778157540 msgr2=0x7fa7780d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 --2- 172.21.15.93:0/2300940518 >> v2:172.21.15.125:3300/0 conn(0x7fa778157540 0x7fa7780d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780d1120 con 0x7fa7780cde60 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa7680019f0 con 0x7fa7780cde60 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 >> v1:172.21.15.93:6789/0 conn(0x7fa7780cde60 legacy=0x7fa77815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa760003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa7600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa760004d00 0x7fa760005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815e5c0 con 0x7fa760003970 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815e2e0 con 0x7fa760004d00 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76000b980 con 0x7fa7780ce240 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa760003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa7767fc640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa7600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa7777fe640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa760004d00 0x7fa760005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 -- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 msgr2=0x7fa7600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780ce240 0x7fa7600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 -- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa760004d00 msgr2=0x7fa760005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa760004d00 0x7fa760005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa776ffd640 1 -- 172.21.15.93:0/2300940518 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760003520 con 0x7fa760003970 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.642+0000 7fa7777fe640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa760004d00 0x7fa760005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.643+0000 7fa776ffd640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa760003d90 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa76800a900 tx=0x7fa7600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c9d98c7eaf9a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.643+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768034630 con 0x7fa760003970 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.643+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76802f070 con 0x7fa760003970 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.643+0000 7fa775ffb640 1 -- 172.21.15.93:0/2300940518 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680349d0 con 0x7fa760003970 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 -- 172.21.15.93:0/2300940518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 msgr2=0x7fa760003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 --2- 172.21.15.93:0/2300940518 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa760003d90 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa76800a900 tx=0x7fa7600057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa7777fe640 1 -- 172.21.15.93:0/2300940518 reap_dead start 2023-11-04T01:38:53.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 -- 172.21.15.93:0/2300940518 shutdown_connections 2023-11-04T01:38:53.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 -- 172.21.15.93:0/2300940518 >> 172.21.15.93:0/2300940518 conn(0x7fa778071f30 msgr2=0x7fa7780cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 -- 172.21.15.93:0/2300940518 shutdown_connections 2023-11-04T01:38:53.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.644+0000 7fa77d389640 1 -- 172.21.15.93:0/2300940518 wait complete. 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.645+0000 7fa77d389640 1 Processor -- start 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.645+0000 7fa77d389640 1 -- start start 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780c82e0 0x7fa7781f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa77814c7c0 0x7fa77814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77814d1b0 con 0x7fa760003970 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780c88a0 con 0x7fa77814c7c0 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa77d389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780c8b80 con 0x7fa7780c82e0 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56766/0 (socket says 172.21.15.93:56766) 2023-11-04T01:38:53.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 -- 172.21.15.93:0/1930466327 learned_addr learned my addr 172.21.15.93:0/1930466327 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa7777fe640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa77814c7c0 0x7fa77814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa7767fc640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780c82e0 0x7fa7781f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 -- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780c82e0 msgr2=0x7fa7781f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780c82e0 0x7fa7781f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 -- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa77814c7c0 msgr2=0x7fa77814cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa77814c7c0 0x7fa77814cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.646+0000 7fa776ffd640 1 -- 172.21.15.93:0/1930466327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780c8e60 con 0x7fa760003970 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa776ffd640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa76800aa20 tx=0x7fa768001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768040480 con 0x7fa760003970 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7680405e0 con 0x7fa760003970 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7780c9140 con 0x7fa760003970 2023-11-04T01:38:53.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768040990 con 0x7fa760003970 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.647+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77815cbd0 con 0x7fa760003970 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.648+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778074290 con 0x7fa760003970 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.648+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa768031030 con 0x7fa760003970 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.648+0000 7fa75f7fe640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 0x7fa76406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.648+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa7680ab610 con 0x7fa760003970 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.648+0000 7fa7767fc640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 0x7fa76406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.649+0000 7fa7767fc640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 0x7fa76406d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa7780c9970 tx=0x7fa76c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.652+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa768076200 con 0x7fa760003970 2023-11-04T01:38:53.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.819+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7780d0bc0 con 0x7fa760003970 2023-11-04T01:38:53.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.820+0000 7fa75f7fe640 1 -- 172.21.15.93:0/1930466327 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+21965 (secure 0 0 0) 0x7fa768079820 con 0x7fa760003970 2023-11-04T01:38:53.823 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:53.823 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:45.166816+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:53.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 msgr2=0x7fa76406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 0x7fa76406d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa7780c9970 tx=0x7fa76c009190 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 msgr2=0x7fa77815c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa76800aa20 tx=0x7fa768001360 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 shutdown_connections 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa76406aea0 0x7fa76406d360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa77814c7c0 0x7fa77814cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa7780c82e0 0x7fa7781f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 --2- 172.21.15.93:0/1930466327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760003970 0x7fa77815c690 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 >> 172.21.15.93:0/1930466327 conn(0x7fa778071f30 msgr2=0x7fa7780b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 shutdown_connections 2023-11-04T01:38:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.822+0000 7fa77d389640 1 -- 172.21.15.93:0/1930466327 wait complete. 2023-11-04T01:38:53.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:41.581505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:42.472925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:53.836 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:53.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.935+0000 7f6f66305640 1 Processor -- start 2023-11-04T01:38:53.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.935+0000 7f6f66305640 1 -- start start 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f60153e60 0x7f6f6015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600cd6d0 0x7f6f60161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f600b4880 0x7f6f600b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f600cde60 con 0x7f6f60153e60 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f60160f90 con 0x7f6f600b4880 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f66305640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600b51e0 con 0x7f6f600cd6d0 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f5ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f60153e60 0x7f6f6015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f5ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f60153e60 0x7f6f6015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56782/0 (socket says 172.21.15.93:56782) 2023-11-04T01:38:53.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f5ffff640 1 -- 172.21.15.93:0/896303522 learned_addr learned my addr 172.21.15.93:0/896303522 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f648a2640 1 --2- 172.21.15.93:0/896303522 >> v2:172.21.15.125:3300/0 conn(0x7f6f600b4880 0x7f6f600b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.936+0000 7f6f5f7fe640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600cd6d0 0x7f6f60161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 -- 172.21.15.93:0/896303522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600cd6d0 msgr2=0x7f6f60161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600cd6d0 0x7f6f60161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 -- 172.21.15.93:0/896303522 >> v2:172.21.15.125:3300/0 conn(0x7f6f600b4880 msgr2=0x7f6f600b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/896303522 >> v2:172.21.15.125:3300/0 conn(0x7f6f600b4880 0x7f6f600b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 -- 172.21.15.93:0/896303522 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6015e400 con 0x7f6f60153e60 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f60153e60 0x7f6f6015dec0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f6f600c9e50 tx=0x7f6f5002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f40514b3231e681 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.937+0000 7f6f5effd640 1 -- 172.21.15.93:0/896303522 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50031860 con 0x7f6f60153e60 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f5effd640 1 -- 172.21.15.93:0/896303522 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f500319c0 con 0x7f6f60153e60 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f5effd640 1 -- 172.21.15.93:0/896303522 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50031d50 con 0x7f6f60153e60 2023-11-04T01:38:53.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 -- 172.21.15.93:0/896303522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f60153e60 msgr2=0x7f6f6015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f60153e60 0x7f6f6015dec0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f6f600c9e50 tx=0x7f6f5002b900 comp rx=0 tx=0).stop 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 -- 172.21.15.93:0/896303522 shutdown_connections 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 --2- 172.21.15.93:0/896303522 >> v2:172.21.15.125:3300/0 conn(0x7f6f600b4880 0x7f6f600b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600cd6d0 0x7f6f60161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 --2- 172.21.15.93:0/896303522 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f60153e60 0x7f6f6015dec0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 -- 172.21.15.93:0/896303522 >> 172.21.15.93:0/896303522 conn(0x7f6f600cf880 msgr2=0x7f6f600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 -- 172.21.15.93:0/896303522 shutdown_connections 2023-11-04T01:38:53.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.938+0000 7f6f66305640 1 -- 172.21.15.93:0/896303522 wait complete. 2023-11-04T01:38:53.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.939+0000 7f6f66305640 1 Processor -- start 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.939+0000 7f6f66305640 1 -- start start 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 0x7f6f600c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 0x7f6f60155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600c8f30 con 0x7f6f600cd6d0 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600ca7d0 con 0x7f6f60153e60 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f66305640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600caab0 con 0x7f6f600b4880 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56792/0 (socket says 172.21.15.93:56792) 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 -- 172.21.15.93:0/4277188544 learned_addr learned my addr 172.21.15.93:0/4277188544 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f648a2640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 0x7f6f60155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 0x7f6f600c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 -- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 msgr2=0x7f6f600c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 0x7f6f600c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 -- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 msgr2=0x7f6f60155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.940+0000 7f6f5f7fe640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 0x7f6f60155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5f7fe640 1 -- 172.21.15.93:0/4277188544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500094d0 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f648a2640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 0x7f6f60155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 0x7f6f600c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5f7fe640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e9b0 tx=0x7f6f5400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54009670 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5400c9a0 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f600cad90 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400cd50 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.941+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f600cb350 con 0x7f6f600cd6d0 2023-11-04T01:38:53.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.942+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60074290 con 0x7f6f600cd6d0 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.942+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f54013470 con 0x7f6f600cd6d0 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.943+0000 7f6f5cff9640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 0x7f6f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.943+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f6f54089e30 con 0x7f6f600cd6d0 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.943+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 0x7f6f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.943+0000 7f6f5ffff640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 0x7f6f4c06d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6f50036000 tx=0x7f6f5003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:53.947+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f54054970 con 0x7f6f600cd6d0 2023-11-04T01:38:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.116+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f600d0b80 con 0x7f6f600cd6d0 2023-11-04T01:38:54.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.116+0000 7f6f5cff9640 1 -- 172.21.15.93:0/4277188544 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f540170a0 con 0x7f6f600cd6d0 2023-11-04T01:38:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 msgr2=0x7f6f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 0x7f6f4c06d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6f50036000 tx=0x7f6f5003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 msgr2=0x7f6f600c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e9b0 tx=0x7f6f5400ee70 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 shutdown_connections 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f4c06ae70 0x7f6f4c06d330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f60153e60 0x7f6f60155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f600cd6d0 0x7f6f600c9ed0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 --2- 172.21.15.93:0/4277188544 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f600b4880 0x7f6f600c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 >> 172.21.15.93:0/4277188544 conn(0x7f6f600cf880 msgr2=0x7f6f600d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 shutdown_connections 2023-11-04T01:38:54.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.118+0000 7f6f66305640 1 -- 172.21.15.93:0/4277188544 wait complete. 2023-11-04T01:38:54.131 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.232+0000 7fbbe9d9e640 1 Processor -- start 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.232+0000 7fbbe9d9e640 1 -- start start 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe9d9e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbe40c4ff0 0x7fbbe40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe9d9e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 0x7fbbe40adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe9d9e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe415aff0 con 0x7fbbe4159c00 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe9d9e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40ae460 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe9d9e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe415a3e0 con 0x7fbbe40adac0 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbe40c4ff0 0x7fbbe40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbbe4159c00 0x7fbbe40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40416/0 (socket says 172.21.15.93:40416) 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe37fe640 1 -- 172.21.15.93:0/877511364 learned_addr learned my addr 172.21.15.93:0/877511364 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe3fff640 1 --2- 172.21.15.93:0/877511364 >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 0x7fbbe40adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe2ffd640 1 -- 172.21.15.93:0/877511364 >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 msgr2=0x7fbbe40adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe2ffd640 1 --2- 172.21.15.93:0/877511364 >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 0x7fbbe40adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe2ffd640 1 -- 172.21.15.93:0/877511364 >> v1:172.21.15.93:6789/0 conn(0x7fbbe4159c00 legacy=0x7fbbe40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe27fc640 1 -- 172.21.15.93:0/877511364 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632479626 0 0) 0x7fbbe415aff0 con 0x7fbbe4159c00 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe2ffd640 1 -- 172.21.15.93:0/877511364 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe415a6c0 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.233+0000 7fbbe3fff640 1 --2- 172.21.15.93:0/877511364 >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 0x7fbbe40adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:54.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.234+0000 7fbbe2ffd640 1 --2- 172.21.15.93:0/877511364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe40c4ff0 0x7fbbe40cc890 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c59a0 tx=0x7fbbd802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc339336cb44184 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.234+0000 7fbbe27fc640 1 -- 172.21.15.93:0/877511364 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8031830 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.234+0000 7fbbe27fc640 1 -- 172.21.15.93:0/877511364 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8031990 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.234+0000 7fbbe27fc640 1 -- 172.21.15.93:0/877511364 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8031d20 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/877511364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe40c4ff0 msgr2=0x7fbbe40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/877511364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe40c4ff0 0x7fbbe40cc890 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c59a0 tx=0x7fbbd802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/877511364 shutdown_connections 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/877511364 >> v2:172.21.15.125:3300/0 conn(0x7fbbe40adac0 0x7fbbe40adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/877511364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe40c4ff0 0x7fbbe40cc890 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/877511364 >> 172.21.15.93:0/877511364 conn(0x7fbbe40ce950 msgr2=0x7fbbe40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/877511364 shutdown_connections 2023-11-04T01:38:54.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.235+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/877511364 wait complete. 2023-11-04T01:38:54.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.236+0000 7fbbe9d9e640 1 Processor -- start 2023-11-04T01:38:54.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.236+0000 7fbbe9d9e640 1 -- start start 2023-11-04T01:38:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 0x7fbbe414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe40c4ff0 0x7fbbe4150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe415caa0 con 0x7fbbe4159c00 2023-11-04T01:38:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c6dd0 con 0x7fbbe40adac0 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe9d9e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe414ecd0 con 0x7fbbe40c4ff0 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56800/0 (socket says 172.21.15.93:56800) 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 -- 172.21.15.93:0/363821872 learned_addr learned my addr 172.21.15.93:0/363821872 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe37fe640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 0x7fbbe414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 -- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe40c4ff0 msgr2=0x7fbbe4150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe2ffd640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe40c4ff0 0x7fbbe4150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe40c4ff0 0x7fbbe4150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 -- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 msgr2=0x7fbbe414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 0x7fbbe414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe3fff640 1 -- 172.21.15.93:0/363821872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009400 con 0x7fbbe4159c00 2023-11-04T01:38:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.237+0000 7fbbe37fe640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 0x7fbbe414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbe3fff640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00cef0 tx=0x7fbbdc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00d840 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00d9c0 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe415be20 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00dd70 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.238+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe415c3e0 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.239+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe415cbe0 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.239+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbdc01e3b0 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.240+0000 7fbbcbfff640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 0x7fbbd006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.240+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fbbdc08a6b0 con 0x7fbbe4159c00 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.240+0000 7fbbe37fe640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 0x7fbbd006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.240+0000 7fbbe37fe640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 0x7fbbd006d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000f60 tx=0x7fbbd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.244+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbbdc055220 con 0x7fbbe4159c00 2023-11-04T01:38:54.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.410+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fbbe4074290 con 0x7fbbe4159c00 2023-11-04T01:38:54.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.410+0000 7fbbcbfff640 1 -- 172.21.15.93:0/363821872 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbdc01a0a0 con 0x7fbbe4159c00 2023-11-04T01:38:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:54.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 msgr2=0x7fbbd006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 0x7fbbd006d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000f60 tx=0x7fbbd4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 msgr2=0x7fbbe4150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00cef0 tx=0x7fbbdc00a710 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 shutdown_connections 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbd006aea0 0x7fbbd006d360 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbe4159c00 0x7fbbe4150570 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbe40c4ff0 0x7fbbe4150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 --2- 172.21.15.93:0/363821872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe40adac0 0x7fbbe414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 >> 172.21.15.93:0/363821872 conn(0x7fbbe40ce950 msgr2=0x7fbbe406dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 shutdown_connections 2023-11-04T01:38:54.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.412+0000 7fbbe9d9e640 1 -- 172.21.15.93:0/363821872 wait complete. 2023-11-04T01:38:54.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.525+0000 7f4ffcc87640 1 Processor -- start 2023-11-04T01:38:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.525+0000 7f4ffcc87640 1 -- start start 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ffcc87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4ff80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ffcc87640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ff80c48e0 0x7f4ff80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ffcc87640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff815aff0 con 0x7f4ff80adac0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ffcc87640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80c52a0 con 0x7f4ff80c48e0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ffcc87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff815a3e0 con 0x7f4ff8159c00 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4ff80adac0 0x7f4ff80adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40428/0 (socket says 172.21.15.93:40428) 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff6d9d640 1 -- 172.21.15.93:0/3565776210 learned_addr learned my addr 172.21.15.93:0/3565776210 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018210706 0 0) 0x7f4ff815aff0 con 0x7f4ff80adac0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe0003520 con 0x7f4ff80adac0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff5d9b640 1 --2- 172.21.15.93:0/3565776210 >> v2:172.21.15.125:3300/0 conn(0x7f4ff80c48e0 0x7f4ff80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4ff80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.526+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263475284 0 0) 0x7f4fe0003520 con 0x7f4ff80adac0 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 msgr2=0x7f4ff80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4ff80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 >> v2:172.21.15.125:3300/0 conn(0x7f4ff80c48e0 msgr2=0x7f4ff80c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 --2- 172.21.15.93:0/3565776210 >> v2:172.21.15.125:3300/0 conn(0x7f4ff80c48e0 0x7f4ff80c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff815a6c0 con 0x7f4ff80adac0 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4ff0001670 con 0x7f4ff80adac0 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 >> v1:172.21.15.93:6789/0 conn(0x7f4ff80adac0 legacy=0x7f4ff80adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4fe00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fe0004d00 0x7f4fe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c52a0 con 0x7f4fe0004d00 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff815a3e0 con 0x7f4fe0003970 2023-11-04T01:38:54.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000b980 con 0x7f4ff8159c00 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fe0004d00 0x7f4fe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff5d9b640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4fe00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 -- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 msgr2=0x7f4fe00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4ff8159c00 0x7f4fe00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 -- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe0003970 msgr2=0x7f4fe0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.527+0000 7f4ff6d9d640 1 -- 172.21.15.93:0/3565776210 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0003520 con 0x7f4fe0004d00 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ff6d9d640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fe0004d00 0x7f4fe0005180 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c290 tx=0x7f4fe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf2f13fa5b15113 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0005ad0 con 0x7f4fe0004d00 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0005c30 con 0x7f4fe0004d00 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ff559a640 1 -- 172.21.15.93:0/3565776210 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff002c8d0 con 0x7f4fe0004d00 2023-11-04T01:38:54.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3565776210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fe0004d00 msgr2=0x7f4fe0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3565776210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fe0004d00 0x7f4fe0005180 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c290 tx=0x7f4fe00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ff6d9d640 1 -- 172.21.15.93:0/3565776210 reap_dead start 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3565776210 shutdown_connections 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3565776210 >> 172.21.15.93:0/3565776210 conn(0x7f4ff80ce950 msgr2=0x7f4ff80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3565776210 shutdown_connections 2023-11-04T01:38:54.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.528+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3565776210 wait complete. 2023-11-04T01:38:54.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 Processor -- start 2023-11-04T01:38:54.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 -- start start 2023-11-04T01:38:54.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 0x7f4ff81f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ff80c6a70 0x7f4ff80c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c7460 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f3880 con 0x7f4ff80c6a70 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.530+0000 7f4ffcc87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f46a0 con 0x7f4fe0004d00 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56826/0 (socket says 172.21.15.93:56826) 2023-11-04T01:38:54.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 -- 172.21.15.93:0/3647188799 learned_addr learned my addr 172.21.15.93:0/3647188799 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 0x7f4ff81f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff6d9d640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ff80c6a70 0x7f4ff80c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 -- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 msgr2=0x7f4ff81f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 0x7f4ff81f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 -- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ff80c6a70 msgr2=0x7f4ff80c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ff80c6a70 0x7f4ff80c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 -- 172.21.15.93:0/3647188799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff81f3660 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 0x7f4ff81f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ff5d9b640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4fec011aa0 tx=0x7f4fec011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec009680 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec00fb20 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff81f3a90 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00feb0 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.531+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff81f4050 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.532+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff81f47e0 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.533+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4fec014440 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.533+0000 7f4fe6ffd640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 0x7f4fd806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.533+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f4fec08a390 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.533+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 0x7f4fd806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.534+0000 7f4ff659c640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 0x7f4fd806d360 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007520 tx=0x7f4fe800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.537+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ff81f47e0 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.704+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f4ff81f47e0 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.704+0000 7f4fe6ffd640 1 -- 172.21.15.93:0/3647188799 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ff81f47e0 con 0x7f4ff81f0ff0 2023-11-04T01:38:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 msgr2=0x7f4fd806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 0x7f4fd806d360 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007520 tx=0x7f4fe800b040 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 msgr2=0x7f4ff8151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4fec011aa0 tx=0x7f4fec011f60 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 shutdown_connections 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4fd806aea0 0x7f4fd806d360 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ff80c6a70 0x7f4ff80c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ff81f0ff0 0x7f4ff8151040 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 --2- 172.21.15.93:0/3647188799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4fe0004d00 0x7f4ff81f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 >> 172.21.15.93:0/3647188799 conn(0x7f4ff80ce950 msgr2=0x7f4ff80c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 shutdown_connections 2023-11-04T01:38:54.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.706+0000 7f4ffcc87640 1 -- 172.21.15.93:0/3647188799 wait complete. 2023-11-04T01:38:54.719 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:54.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.818+0000 7f38b182d640 1 Processor -- start 2023-11-04T01:38:54.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.818+0000 7f38b182d640 1 -- start start 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38b182d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38ac0cf180 0x7f38ac06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38b182d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 0x7f38ac0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38b182d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0cdf00 con 0x7f38ac15cfd0 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38b182d640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac15d3b0 con 0x7f38ac0cf180 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38b182d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0cea20 con 0x7f38ac0cd570 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38aaffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f38ac15cfd0 0x7f38ac161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40442/0 (socket says 172.21.15.93:40442) 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38aaffd640 1 -- 172.21.15.93:0/85823062 learned_addr learned my addr 172.21.15.93:0/85823062 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:54.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38aa7fc640 1 --2- 172.21.15.93:0/85823062 >> v2:172.21.15.125:3300/0 conn(0x7f38ac0cf180 0x7f38ac06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.819+0000 7f38ab7fe640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 0x7f38ac0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38a9ffb640 1 -- 172.21.15.93:0/85823062 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357300378 0 0) 0x7f38ac0cdf00 con 0x7f38ac15cfd0 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38a9ffb640 1 -- 172.21.15.93:0/85823062 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3894003520 con 0x7f38ac15cfd0 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38aa7fc640 1 -- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 msgr2=0x7f38ac0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38aa7fc640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 0x7f38ac0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38aa7fc640 1 -- 172.21.15.93:0/85823062 >> v1:172.21.15.93:6789/0 conn(0x7f38ac15cfd0 legacy=0x7f38ac161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38aa7fc640 1 -- 172.21.15.93:0/85823062 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0cf610 con 0x7f38ac0cf180 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.820+0000 7f38ab7fe640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 0x7f38ac0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38aa7fc640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cf180 0x7f38ac06c0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097a0 tx=0x7f38a002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab9402a456411ea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38a9ffb640 1 -- 172.21.15.93:0/85823062 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a002e070 con 0x7f38ac0cf180 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38a9ffb640 1 -- 172.21.15.93:0/85823062 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a00315a0 con 0x7f38ac0cf180 2023-11-04T01:38:54.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38a9ffb640 1 -- 172.21.15.93:0/85823062 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0031910 con 0x7f38ac0cf180 2023-11-04T01:38:54.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 -- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cf180 msgr2=0x7f38ac06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cf180 0x7f38ac06c0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097a0 tx=0x7f38a002b840 comp rx=0 tx=0).stop 2023-11-04T01:38:54.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 -- 172.21.15.93:0/85823062 shutdown_connections 2023-11-04T01:38:54.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac0cd570 0x7f38ac0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 --2- 172.21.15.93:0/85823062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cf180 0x7f38ac06c0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 -- 172.21.15.93:0/85823062 >> 172.21.15.93:0/85823062 conn(0x7f38ac06ea20 msgr2=0x7f38ac06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 -- 172.21.15.93:0/85823062 shutdown_connections 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.821+0000 7f38b182d640 1 -- 172.21.15.93:0/85823062 wait complete. 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.822+0000 7f38b182d640 1 Processor -- start 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 -- start start 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cd570 0x7f38ac15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 0x7f38ac0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0b41a0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0c8890 con 0x7f38ac0cd570 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38b182d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0caad0 con 0x7f38ac15cfd0 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.823+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56838/0 (socket says 172.21.15.93:56838) 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 -- 172.21.15.93:0/1891165120 learned_addr learned my addr 172.21.15.93:0/1891165120 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38aaffd640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cd570 0x7f38ac15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38aa7fc640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 0x7f38ac0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 -- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 msgr2=0x7f38ac0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 0x7f38ac0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 -- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cd570 msgr2=0x7f38ac15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cd570 0x7f38ac15ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 -- 172.21.15.93:0/1891165120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009400 con 0x7f38ac0c83e0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38aa7fc640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 0x7f38ac0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38ab7fe640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e8b0 tx=0x7f38a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4009660 con 0x7f38ac0c83e0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4004020 con 0x7f38ac0c83e0 2023-11-04T01:38:54.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0009400 con 0x7f38ac0c83e0 2023-11-04T01:38:54.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a40043b0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.824+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac0b3ae0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.825+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac0b42e0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.825+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38a400c940 con 0x7f38ac0c83e0 2023-11-04T01:38:54.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.826+0000 7f3893fff640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 0x7f389806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.826+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f38a4089920 con 0x7f38ac0c83e0 2023-11-04T01:38:54.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.826+0000 7f38aaffd640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 0x7f389806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.826+0000 7f38aaffd640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 0x7f389806d360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f389c001580 tx=0x7f389c000f40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.830+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38ac0b42e0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.994+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f38ac0b42e0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.995+0000 7f3893fff640 1 -- 172.21.15.93:0/1891165120 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f38ac0b42e0 con 0x7f38ac0c83e0 2023-11-04T01:38:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:54.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 msgr2=0x7f389806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 0x7f389806d360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f389c001580 tx=0x7f389c000f40 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 msgr2=0x7f38ac0c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e8b0 tx=0x7f38a400ed70 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 shutdown_connections 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f389806aea0 0x7f389806d360 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38ac0c83e0 0x7f38ac0c9ca0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f38ac15cfd0 0x7f38ac0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 --2- 172.21.15.93:0/1891165120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38ac0cd570 0x7f38ac15ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 >> 172.21.15.93:0/1891165120 conn(0x7f38ac06ea20 msgr2=0x7f38ac0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 shutdown_connections 2023-11-04T01:38:55.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:54.997+0000 7f38b182d640 1 -- 172.21.15.93:0/1891165120 wait complete. 2023-11-04T01:38:55.010 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:55.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.109+0000 7fa01b96c640 1 Processor -- start 2023-11-04T01:38:55.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.109+0000 7fa01b96c640 1 -- start start 2023-11-04T01:38:55.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa01b96c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa014159c00 0x7fa0140cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa01b96c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140ae1d0 0x7fa0140c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa01b96c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01415aff0 con 0x7fa0140c48e0 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa01b96c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140c52d0 con 0x7fa014159c00 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa01b96c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01415a3e0 con 0x7fa0140ae1d0 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa014159c00 0x7fa0140cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa014159c00 0x7fa0140cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56840/0 (socket says 172.21.15.93:56840) 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 -- 172.21.15.93:0/3866132943 learned_addr learned my addr 172.21.15.93:0/3866132943 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019f09640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140ae1d0 0x7fa0140c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 -- 172.21.15.93:0/3866132943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140ae1d0 msgr2=0x7fa0140c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140ae1d0 0x7fa0140c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 -- 172.21.15.93:0/3866132943 >> v1:172.21.15.125:6789/0 conn(0x7fa0140c48e0 legacy=0x7fa0140adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.110+0000 7fa019708640 1 -- 172.21.15.93:0/3866132943 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01415a6c0 con 0x7fa014159c00 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.111+0000 7fa019708640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa014159c00 0x7fa0140cc890 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa010009e50 tx=0x7fa01002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c897b0f99bb7da server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.111+0000 7fa00bfff640 1 -- 172.21.15.93:0/3866132943 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01002ec80 con 0x7fa014159c00 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.111+0000 7fa00bfff640 1 -- 172.21.15.93:0/3866132943 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01002ede0 con 0x7fa014159c00 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.111+0000 7fa00bfff640 1 -- 172.21.15.93:0/3866132943 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010036610 con 0x7fa014159c00 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 -- 172.21.15.93:0/3866132943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa014159c00 msgr2=0x7fa0140cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa014159c00 0x7fa0140cc890 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa010009e50 tx=0x7fa01002e0e0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 -- 172.21.15.93:0/3866132943 shutdown_connections 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140ae1d0 0x7fa0140c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 --2- 172.21.15.93:0/3866132943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa014159c00 0x7fa0140cc890 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 -- 172.21.15.93:0/3866132943 >> 172.21.15.93:0/3866132943 conn(0x7fa0140ce950 msgr2=0x7fa0140ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 -- 172.21.15.93:0/3866132943 shutdown_connections 2023-11-04T01:38:55.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.112+0000 7fa01b96c640 1 -- 172.21.15.93:0/3866132943 wait complete. 2023-11-04T01:38:55.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.113+0000 7fa01b96c640 1 Processor -- start 2023-11-04T01:38:55.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.113+0000 7fa01b96c640 1 -- start start 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 0x7fa0140c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014159c00 0x7fa014152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0140c5a20 con 0x7fa0140ae1d0 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa014142f20 con 0x7fa014159c00 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0140c5c70 con 0x7fa0140c48e0 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56842/0 (socket says 172.21.15.93:56842) 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 -- 172.21.15.93:0/1048602979 learned_addr learned my addr 172.21.15.93:0/1048602979 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019f09640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014159c00 0x7fa014152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa018f07640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 0x7fa0140c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 -- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 msgr2=0x7fa0140c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 0x7fa0140c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 -- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014159c00 msgr2=0x7fa014152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014159c00 0x7fa014152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 -- 172.21.15.93:0/1048602979 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010009b30 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa018f07640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 0x7fa0140c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa019708640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa010009f70 tx=0x7fa010004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01002ec80 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa010009510 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0140c5f50 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.114+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01003e630 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.115+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0140c6510 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.116+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa014074290 con 0x7fa0140ae1d0 2023-11-04T01:38:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.116+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa01003e790 con 0x7fa0140ae1d0 2023-11-04T01:38:55.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.116+0000 7fa009ffb640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 0x7f9ff806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.116+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa0100ac0b0 con 0x7fa0140ae1d0 2023-11-04T01:38:55.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.116+0000 7fa018f07640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 0x7f9ff806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.117+0000 7fa018f07640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 0x7f9ff806d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa0141f2340 tx=0x7fa004009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.121+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa010076c80 con 0x7fa0140ae1d0 2023-11-04T01:38:55.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.288+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa01406c7b0 con 0x7fa0140ae1d0 2023-11-04T01:38:55.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.289+0000 7fa009ffb640 1 -- 172.21.15.93:0/1048602979 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa01007a2a0 con 0x7fa0140ae1d0 2023-11-04T01:38:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:55.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.290+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 msgr2=0x7f9ff806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.290+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 0x7f9ff806d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa0141f2340 tx=0x7fa004009040 comp rx=0 tx=0).stop 2023-11-04T01:38:55.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 msgr2=0x7fa0141f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa010009f70 tx=0x7fa010004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:55.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 shutdown_connections 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ff806ae70 0x7f9ff806d330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014159c00 0x7fa014152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa0140c48e0 0x7fa0140c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 --2- 172.21.15.93:0/1048602979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0140ae1d0 0x7fa0141f1e00 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 >> 172.21.15.93:0/1048602979 conn(0x7fa0140ce950 msgr2=0x7fa01406d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 shutdown_connections 2023-11-04T01:38:55.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.291+0000 7fa01b96c640 1 -- 172.21.15.93:0/1048602979 wait complete. 2023-11-04T01:38:55.303 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:55.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.403+0000 7f638cb90640 1 Processor -- start 2023-11-04T01:38:55.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.403+0000 7f638cb90640 1 -- start start 2023-11-04T01:38:55.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638cb90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6388153e60 0x7f638815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638cb90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f63880b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638cb90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880cde60 con 0x7f63880cd6d0 2023-11-04T01:38:55.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638cb90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6388160f90 con 0x7f6388153e60 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638cb90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880b5200 con 0x7f63880b4880 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f6385d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f63880cd6d0 0x7f6388161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40450/0 (socket says 172.21.15.93:40450) 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f6385d9b640 1 -- 172.21.15.93:0/2943503689 learned_addr learned my addr 172.21.15.93:0/2943503689 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638659c640 1 --2- 172.21.15.93:0/2943503689 >> v2:172.21.15.125:3300/0 conn(0x7f6388153e60 0x7f638815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864079160 0 0) 0x7f63880cde60 con 0x7f63880cd6d0 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f6386d9d640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f63880b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.404+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6370003520 con 0x7f63880cd6d0 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688659485 0 0) 0x7f6370003520 con 0x7f63880cd6d0 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 msgr2=0x7f63880b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f63880b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 >> v2:172.21.15.125:3300/0 conn(0x7f6388153e60 msgr2=0x7f638815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 --2- 172.21.15.93:0/2943503689 >> v2:172.21.15.125:3300/0 conn(0x7f6388153e60 0x7f638815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638815e400 con 0x7f63880cd6d0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f637c001670 con 0x7f63880cd6d0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 >> v1:172.21.15.93:6789/0 conn(0x7f63880cd6d0 legacy=0x7f6388161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6370003970 0x7f6370003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63700047c0 0x7f6370004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f6370005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388160f90 con 0x7f63700047c0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880b5200 con 0x7f6370003970 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637000b980 con 0x7f63880b4880 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63700047c0 0x7f6370004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f638659c640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6370003970 0x7f6370003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6386d9d640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f6370005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.410 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 -- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 msgr2=0x7f6370005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63880b4880 0x7f6370005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 -- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6370003970 msgr2=0x7f6370003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6370003970 0x7f6370003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.405+0000 7f6385d9b640 1 -- 172.21.15.93:0/2943503689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6370003520 con 0x7f63700047c0 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63700047c0 0x7f6370004c40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c210 tx=0x7f63700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2580a55fafa2a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c005ad0 con 0x7f63700047c0 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005c50 con 0x7f63700047c0 2023-11-04T01:38:55.411 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f638559a640 1 -- 172.21.15.93:0/2943503689 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c02c890 con 0x7f63700047c0 2023-11-04T01:38:55.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f638cb90640 1 -- 172.21.15.93:0/2943503689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63700047c0 msgr2=0x7f6370004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.406+0000 7f638cb90640 1 --2- 172.21.15.93:0/2943503689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63700047c0 0x7f6370004c40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c210 tx=0x7f63700057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.407+0000 7f6386d9d640 1 -- 172.21.15.93:0/2943503689 reap_dead start 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.407+0000 7f638cb90640 1 -- 172.21.15.93:0/2943503689 shutdown_connections 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.407+0000 7f638cb90640 1 -- 172.21.15.93:0/2943503689 >> 172.21.15.93:0/2943503689 conn(0x7f63880cf880 msgr2=0x7f63880cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.407+0000 7f638cb90640 1 -- 172.21.15.93:0/2943503689 shutdown_connections 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.407+0000 7f638cb90640 1 -- 172.21.15.93:0/2943503689 wait complete. 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.408+0000 7f638cb90640 1 Processor -- start 2023-11-04T01:38:55.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.408+0000 7f638cb90640 1 -- start start 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 0x7f6388152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63881f5f90 0x7f63881f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881f6ef0 con 0x7f63880c8ad0 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c9490 con 0x7f63700047c0 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63881f2960 con 0x7f63881f5f90 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56874/0 (socket says 172.21.15.93:56874) 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 -- 172.21.15.93:0/2618703255 learned_addr learned my addr 172.21.15.93:0/2618703255 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638659c640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 0x7f6388152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6386d9d640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63881f5f90 0x7f63881f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 -- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63881f5f90 msgr2=0x7f63881f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63881f5f90 0x7f63881f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 -- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 msgr2=0x7f6388152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 0x7f6388152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 -- 172.21.15.93:0/2618703255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388153160 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638659c640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 0x7f6388152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6385d9b640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c210 tx=0x7f63881610d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c03c040 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c02dd30 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63881f6950 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c02dea0 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.409+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63881f2bb0 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.410+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6388074290 con 0x7f63880c8ad0 2023-11-04T01:38:55.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.411+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f637c032070 con 0x7f63880c8ad0 2023-11-04T01:38:55.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.411+0000 7f6376ffd640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 0x7f636806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.411+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f637c0aad30 con 0x7f63880c8ad0 2023-11-04T01:38:55.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.411+0000 7f638659c640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 0x7f636806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.412+0000 7f638659c640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 0x7f636806d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f63880b47f0 tx=0x7f637800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.416+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f637c075900 con 0x7f63880c8ad0 2023-11-04T01:38:55.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.580+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63880b8620 con 0x7f63880c8ad0 2023-11-04T01:38:55.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.580+0000 7f6376ffd640 1 -- 172.21.15.93:0/2618703255 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f637c078f20 con 0x7f63880c8ad0 2023-11-04T01:38:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 msgr2=0x7f636806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 0x7f636806d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f63880b47f0 tx=0x7f637800b040 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 msgr2=0x7f63880c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c210 tx=0x7f63881610d0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 shutdown_connections 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f636806ae70 0x7f636806d330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63881f5f90 0x7f63881f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63880c8ad0 0x7f63880c8f50 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 --2- 172.21.15.93:0/2618703255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63700047c0 0x7f6388152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 >> 172.21.15.93:0/2618703255 conn(0x7f63880cf880 msgr2=0x7f63880b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 shutdown_connections 2023-11-04T01:38:55.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.582+0000 7f638cb90640 1 -- 172.21.15.93:0/2618703255 wait complete. 2023-11-04T01:38:55.595 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:55.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.693+0000 7fb47eb33640 1 Processor -- start 2023-11-04T01:38:55.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.693+0000 7fb47eb33640 1 -- start start 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47eb33640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb4780adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47eb33640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4780ad730 0x7fb47815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47eb33640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780c3900 con 0x7fb47815ad30 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47eb33640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780ae260 con 0x7fb4780ad730 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47eb33640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c3be0 con 0x7fb478070e20 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4780ad730 0x7fb47815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4780ad730 0x7fb47815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56888/0 (socket says 172.21.15.93:56888) 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 -- 172.21.15.93:0/1871197486 learned_addr learned my addr 172.21.15.93:0/1871197486 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 -- 172.21.15.93:0/1871197486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 msgr2=0x7fb4780adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 --2- 172.21.15.93:0/1871197486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb4780adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 -- 172.21.15.93:0/1871197486 >> v1:172.21.15.125:6789/0 conn(0x7fb47815ad30 legacy=0x7fb478070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.694+0000 7fb47d0d0640 1 -- 172.21.15.93:0/1871197486 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780c3ec0 con 0x7fb4780ad730 2023-11-04T01:38:55.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb47d0d0640 1 --2- 172.21.15.93:0/1871197486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb47815e740 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb470009e50 tx=0x7fb47002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cee36f762fd3b6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb46f7fe640 1 -- 172.21.15.93:0/1871197486 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47002c9e0 con 0x7fb4780ad730 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb46f7fe640 1 -- 172.21.15.93:0/1871197486 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47002cb40 con 0x7fb4780ad730 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb46f7fe640 1 -- 172.21.15.93:0/1871197486 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700343f0 con 0x7fb4780ad730 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb47eb33640 1 -- 172.21.15.93:0/1871197486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 msgr2=0x7fb47815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb47eb33640 1 --2- 172.21.15.93:0/1871197486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb47815e740 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb470009e50 tx=0x7fb47002be40 comp rx=0 tx=0).stop 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.695+0000 7fb47eb33640 1 -- 172.21.15.93:0/1871197486 shutdown_connections 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.696+0000 7fb47eb33640 1 --2- 172.21.15.93:0/1871197486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb47815e740 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.696+0000 7fb47eb33640 1 --2- 172.21.15.93:0/1871197486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb4780adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.696+0000 7fb47eb33640 1 -- 172.21.15.93:0/1871197486 >> 172.21.15.93:0/1871197486 conn(0x7fb4780ce950 msgr2=0x7fb4780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.696+0000 7fb47eb33640 1 -- 172.21.15.93:0/1871197486 shutdown_connections 2023-11-04T01:38:55.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.696+0000 7fb47eb33640 1 -- 172.21.15.93:0/1871197486 wait complete. 2023-11-04T01:38:55.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.697+0000 7fb47eb33640 1 Processor -- start 2023-11-04T01:38:55.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.697+0000 7fb47eb33640 1 -- start start 2023-11-04T01:38:55.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.697+0000 7fb47eb33640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb478156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.697+0000 7fb47eb33640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47815ad30 0x7fb4780c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c8870 con 0x7fb4780ad730 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c5ac0 con 0x7fb47815ad30 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c5da0 con 0x7fb478070e20 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56902/0 (socket says 172.21.15.93:56902) 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 -- 172.21.15.93:0/2073366137 learned_addr learned my addr 172.21.15.93:0/2073366137 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47d0d0640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47815ad30 0x7fb4780c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 -- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 msgr2=0x7fb478156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb478156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 -- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47815ad30 msgr2=0x7fb4780c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47815ad30 0x7fb4780c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 -- 172.21.15.93:0/2073366137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470009b30 con 0x7fb4780ad730 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46ffff640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb46800b4a0 tx=0x7fb46800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468010610 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468010770 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4780c6080 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468010b20 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.698+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4780c6640 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.699+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4780c6860 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.700+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb468010c80 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.700+0000 7fb46d7fa640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.700+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb4680897e0 con 0x7fb4780ad730 2023-11-04T01:38:55.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.700+0000 7fb47c8cf640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.701+0000 7fb47c8cf640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.704+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb468054320 con 0x7fb4780ad730 2023-11-04T01:38:55.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.880+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb478074290 con 0x7fb4780ad730 2023-11-04T01:38:55.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.881+0000 7fb46d7fa640 1 -- 172.21.15.93:0/2073366137 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb468057940 con 0x7fb4780ad730 2023-11-04T01:38:55.883 INFO:teuthology.orchestra.run.smithi093.stderr:listed 0 entries 2023-11-04T01:38:55.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 msgr2=0x7fb46406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006bc0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 msgr2=0x7fb4781f0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb46800b4a0 tx=0x7fb46800b960 comp rx=0 tx=0).stop 2023-11-04T01:38:55.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 shutdown_connections 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb47815ad30 0x7fb4780c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4780ad730 0x7fb4781f0950 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 --2- 172.21.15.93:0/2073366137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb478070e20 0x7fb478156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 >> 172.21.15.93:0/2073366137 conn(0x7fb4780ce950 msgr2=0x7fb4780ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 shutdown_connections 2023-11-04T01:38:55.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55.883+0000 7fb47eb33640 1 -- 172.21.15.93:0/2073366137 wait complete. 2023-11-04T01:38:55.895 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:38:55.895 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:55.896 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:55.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:55.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[144920]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:55.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:55.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:38:55.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.961 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:55.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:55.976 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:55.976 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:55.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:55.995 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:38:55.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.995 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:56.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:56.052 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:56.053 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:38:56.053 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:56.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:56.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:38:56.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:56.069 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:56.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:56.123 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:56.123 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:38:56.123 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:56.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:56.144 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:38:56.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:56.144 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:56.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:56.201 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:56.202 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:56.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.299+0000 7f88615d0640 1 Processor -- start 2023-11-04T01:38:56.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.299+0000 7f88615d0640 1 -- start start 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f88615d0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f885c06cdf0 0x7f885c161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f88615d0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c161ab0 con 0x7f885c0b2d10 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f88615d0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c06bd50 con 0x7f885c15cf90 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f88615d0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c06c030 con 0x7f885c06cdf0 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f885a7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f885c0b2d10 0x7f885c0cb5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40452/0 (socket says 172.21.15.93:40452) 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f885a7fc640 1 -- 172.21.15.93:0/74870235 learned_addr learned my addr 172.21.15.93:0/74870235 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f885b7fe640 1 --2- 172.21.15.93:0/74870235 >> v2:172.21.15.125:3300/0 conn(0x7f885c06cdf0 0x7f885c161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793435477 0 0) 0x7f8850001110 con 0x7f885c0b2d10 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8844003520 con 0x7f885c0b2d10 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201398221 0 0) 0x7f8844003520 con 0x7f885c0b2d10 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 >> v2:172.21.15.125:3300/0 conn(0x7f885c06cdf0 msgr2=0x7f885c161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 --2- 172.21.15.93:0/74870235 >> v2:172.21.15.125:3300/0 conn(0x7f885c06cdf0 0x7f885c161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 >> v1:172.21.15.125:6789/0 conn(0x7f885c15cf90 legacy=0x7f885c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c06c310 con 0x7f885c0b2d10 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8850001800 con 0x7f885c0b2d10 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 >> v1:172.21.15.93:6789/0 conn(0x7f885c0b2d10 legacy=0x7f885c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 0x7f8844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844005180 0x7f884400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c06c030 con 0x7f8844003970 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884400c020 con 0x7f88440047c0 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.300+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884400c1e0 con 0x7f8844005180 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 0x7f8844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885a7fc640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885b7fe640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844005180 0x7f884400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 -- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844005180 msgr2=0x7f884400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844005180 0x7f884400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 -- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88440047c0 msgr2=0x7f8844004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 -- 172.21.15.93:0/74870235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844003520 con 0x7f8844003970 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885b7fe640 1 -- 172.21.15.93:0/74870235 reap_dead start 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.301+0000 7f885affd640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 0x7f8844003d90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f884c001770 tx=0x7f88440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6436f915195b6e1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0052d0 con 0x7f8844003970 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c02e050 con 0x7f8844003970 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f8859ffb640 1 -- 172.21.15.93:0/74870235 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c003640 con 0x7f8844003970 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 -- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 msgr2=0x7f8844003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 0x7f8844003d90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f884c001770 tx=0x7f88440057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 -- 172.21.15.93:0/74870235 shutdown_connections 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 --2- 172.21.15.93:0/74870235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8844003970 0x7f8844003d90 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 -- 172.21.15.93:0/74870235 >> 172.21.15.93:0/74870235 conn(0x7f885c0cd600 msgr2=0x7f885c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 -- 172.21.15.93:0/74870235 shutdown_connections 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.302+0000 7f88615d0640 1 -- 172.21.15.93:0/74870235 wait complete. 2023-11-04T01:38:56.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.303+0000 7f88615d0640 1 Processor -- start 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 -- start start 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844003970 0x7f885c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 0x7f885c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b6670 con 0x7f885c0b6210 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b3b70 con 0x7f885c0b4360 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f88615d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1e7020 con 0x7f8844003970 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56922/0 (socket says 172.21.15.93:56922) 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f885a7fc640 1 -- 172.21.15.93:0/466269530 learned_addr learned my addr 172.21.15.93:0/466269530 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f885b7fe640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 0x7f885c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.304+0000 7f885affd640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844003970 0x7f885c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 -- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844003970 msgr2=0x7f885c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844003970 0x7f885c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 -- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 msgr2=0x7f885c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 0x7f885c0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 -- 172.21.15.93:0/466269530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c1e6d40 con 0x7f885c0b6210 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885b7fe640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 0x7f885c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f885a7fc640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8850004fb0 tx=0x7f88500074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850001180 con 0x7f885c0b6210 2023-11-04T01:38:56.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850007740 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000fc00 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0b3e10 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.305+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c1e6960 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.306+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c0b39d0 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.306+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f885000fd60 con 0x7f885c0b6210 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.307+0000 7f88437fe640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 0x7f884806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.307+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8850089b10 con 0x7f885c0b6210 2023-11-04T01:38:56.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.307+0000 7f885affd640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 0x7f884806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.307+0000 7f885affd640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 0x7f884806d360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f884c033000 tx=0x7f884c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.311+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f885c0b39d0 con 0x7f885c0b6210 2023-11-04T01:38:56.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.511+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f885c161ab0 con 0x7f885c0b6210 2023-11-04T01:38:56.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.512+0000 7f88437fe640 1 -- 172.21.15.93:0/466269530 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f885c161ab0 con 0x7f885c0b6210 2023-11-04T01:38:56.514 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:52.623770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:56.514 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 38 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 msgr2=0x7f884806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 0x7f884806d360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f884c033000 tx=0x7f884c009030 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 msgr2=0x7f885c1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8850004fb0 tx=0x7f88500074f0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 shutdown_connections 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f884806aea0 0x7f884806d360 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f885c0b4360 0x7f885c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f885c0b6210 0x7f885c1574a0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.513+0000 7f88615d0640 1 --2- 172.21.15.93:0/466269530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8844003970 0x7f885c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.514+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 >> 172.21.15.93:0/466269530 conn(0x7f885c0cd600 msgr2=0x7f885c0b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.514+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 shutdown_connections 2023-11-04T01:38:56.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.514+0000 7f88615d0640 1 -- 172.21.15.93:0/466269530 wait complete. 2023-11-04T01:38:56.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:56.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.623+0000 7fab96ba9640 1 Processor -- start 2023-11-04T01:38:56.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 -- start start 2023-11-04T01:38:56.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9015e000 con 0x7fab9015daa0 2023-11-04T01:38:56.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9015e5c0 con 0x7fab900cde60 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.624+0000 7fab96ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015e2e0 con 0x7fab900ce240 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab94945640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab94945640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:39620/0 (socket says 172.21.15.93:39620) 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab87fff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fab9015daa0 0x7fab90157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:45078/0 (socket says 172.21.15.93:45078) 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab94945640 1 -- 172.21.15.93:0/1963270506 learned_addr learned my addr 172.21.15.93:0/1963270506 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 --2- 172.21.15.93:0/1963270506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:60120/0 (socket says 172.21.15.93:60120) 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 -- 172.21.15.93:0/1963270506 >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 msgr2=0x7fab9015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 --2- 172.21.15.93:0/1963270506 >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 -- 172.21.15.93:0/1963270506 >> v1:172.21.15.125:6789/0 conn(0x7fab9015daa0 legacy=0x7fab90157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab95146640 1 -- 172.21.15.93:0/1963270506 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900d1120 con 0x7fab900ce240 2023-11-04T01:38:56.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.625+0000 7fab94945640 1 --2- 172.21.15.93:0/1963270506 >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab95146640 1 --2- 172.21.15.93:0/1963270506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab88009d90 tx=0x7fab8802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcbd782c83465127 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab877fe640 1 -- 172.21.15.93:0/1963270506 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8802cc50 con 0x7fab900ce240 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab877fe640 1 -- 172.21.15.93:0/1963270506 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8802cdb0 con 0x7fab900ce240 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab877fe640 1 -- 172.21.15.93:0/1963270506 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88034660 con 0x7fab900ce240 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 -- 172.21.15.93:0/1963270506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 msgr2=0x7fab900d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 --2- 172.21.15.93:0/1963270506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab88009d90 tx=0x7fab8802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 -- 172.21.15.93:0/1963270506 shutdown_connections 2023-11-04T01:38:56.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 --2- 172.21.15.93:0/1963270506 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab900d1920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 --2- 172.21.15.93:0/1963270506 >> v2:172.21.15.125:3300/0 conn(0x7fab900cde60 0x7fab9015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 -- 172.21.15.93:0/1963270506 >> 172.21.15.93:0/1963270506 conn(0x7fab90071f30 msgr2=0x7fab900cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.626+0000 7fab96ba9640 1 -- 172.21.15.93:0/1963270506 shutdown_connections 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.627+0000 7fab96ba9640 1 -- 172.21.15.93:0/1963270506 wait complete. 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.628+0000 7fab96ba9640 1 Processor -- start 2023-11-04T01:38:56.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.628+0000 7fab96ba9640 1 -- start start 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.628+0000 7fab96ba9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab9014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab9015daa0 0x7fab9014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015a190 con 0x7fab900cde60 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015a470 con 0x7fab9015daa0 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015a750 con 0x7fab900ce240 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56928/0 (socket says 172.21.15.93:56928) 2023-11-04T01:38:56.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 -- 172.21.15.93:0/4145668596 learned_addr learned my addr 172.21.15.93:0/4145668596 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab95146640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab9015daa0 0x7fab9014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab87fff640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab9014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 -- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 msgr2=0x7fab9014ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab9014ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 -- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab9015daa0 msgr2=0x7fab9014c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab9015daa0 0x7fab9014c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 -- 172.21.15.93:0/4145668596 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0094d0 con 0x7fab900cde60 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab94945640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00e9d0 tx=0x7fab8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00ca60 con 0x7fab900cde60 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c00cbc0 con 0x7fab900cde60 2023-11-04T01:38:56.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab88009a70 con 0x7fab900cde60 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c013470 con 0x7fab900cde60 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.629+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9015ad10 con 0x7fab900cde60 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.630+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90074290 con 0x7fab900cde60 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.631+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab8c0135d0 con 0x7fab900cde60 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.631+0000 7fab857fa640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 0x7fab7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.631+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fab8c089d80 con 0x7fab900cde60 2023-11-04T01:38:56.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.631+0000 7fab87fff640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 0x7fab7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.632+0000 7fab87fff640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 0x7fab7c06d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fab900d3f20 tx=0x7fab80000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.636+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab8c054a00 con 0x7fab900cde60 2023-11-04T01:38:56.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.802+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab901568b0 con 0x7fab900cde60 2023-11-04T01:38:56.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.803+0000 7fab857fa640 1 -- 172.21.15.93:0/4145668596 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+21965 (secure 0 0 0) 0x7fab8c017090 con 0x7fab900cde60 2023-11-04T01:38:56.806 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:45.166816+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.805+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 msgr2=0x7fab7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.805+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 0x7fab7c06d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fab900d3f20 tx=0x7fab80000ed0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.805+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 msgr2=0x7fab900c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.805+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00e9d0 tx=0x7fab8c00ee90 comp rx=0 tx=0).stop 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 shutdown_connections 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab7c06ae70 0x7fab7c06d330 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab9015daa0 0x7fab9014c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab900ce240 0x7fab9014ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 --2- 172.21.15.93:0/4145668596 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab900cde60 0x7fab900c89f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 >> 172.21.15.93:0/4145668596 conn(0x7fab90071f30 msgr2=0x7fab900c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 shutdown_connections 2023-11-04T01:38:56.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.806+0000 7fab96ba9640 1 -- 172.21.15.93:0/4145668596 wait complete. 2023-11-04T01:38:56.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:41.581505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:42.472925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:56.819 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:56.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.919+0000 7f6ed2a6f640 1 Processor -- start 2023-11-04T01:38:56.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.919+0000 7f6ed2a6f640 1 -- start start 2023-11-04T01:38:56.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed2a6f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 0x7f6ecc0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed2a6f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ecc070e20 0x7f6ecc0c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed2a6f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc146950 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed2a6f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc1464a0 con 0x7f6ecc070e20 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed2a6f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c4170 con 0x7f6ecc1460c0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ecbfff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6ecc0c37d0 0x7f6ecc070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:45090/0 (socket says 172.21.15.93:45090) 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ecbfff640 1 -- 172.21.15.93:0/4115381181 learned_addr learned my addr 172.21.15.93:0/4115381181 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4115381181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 0x7f6ecc0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed100c640 1 --2- 172.21.15.93:0/4115381181 >> v2:172.21.15.125:3300/0 conn(0x7f6ecc070e20 0x7f6ecc0c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ecb7fe640 1 -- 172.21.15.93:0/4115381181 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845907715 0 0) 0x7f6ecc146950 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ecb7fe640 1 -- 172.21.15.93:0/4115381181 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc003520 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed080b640 1 -- 172.21.15.93:0/4115381181 >> v2:172.21.15.125:3300/0 conn(0x7f6ecc070e20 msgr2=0x7f6ecc0c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4115381181 >> v2:172.21.15.125:3300/0 conn(0x7f6ecc070e20 0x7f6ecc0c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed080b640 1 -- 172.21.15.93:0/4115381181 >> v1:172.21.15.125:6789/0 conn(0x7f6ecc0c37d0 legacy=0x7f6ecc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.920+0000 7f6ed080b640 1 -- 172.21.15.93:0/4115381181 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0cc5c0 con 0x7f6ecc1460c0 2023-11-04T01:38:56.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.921+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4115381181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 0x7f6ecc0b1860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00097a0 tx=0x7f6ec002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4b2005bf1ac2d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.921+0000 7f6ecb7fe640 1 -- 172.21.15.93:0/4115381181 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0031830 con 0x7f6ecc1460c0 2023-11-04T01:38:56.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.921+0000 7f6ecb7fe640 1 -- 172.21.15.93:0/4115381181 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0031990 con 0x7f6ecc1460c0 2023-11-04T01:38:56.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.921+0000 7f6ecb7fe640 1 -- 172.21.15.93:0/4115381181 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0031d20 con 0x7f6ecc1460c0 2023-11-04T01:38:56.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4115381181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 msgr2=0x7f6ecc0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4115381181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 0x7f6ecc0b1860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00097a0 tx=0x7f6ec002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4115381181 shutdown_connections 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4115381181 >> v2:172.21.15.125:3300/0 conn(0x7f6ecc070e20 0x7f6ecc0c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4115381181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc1460c0 0x7f6ecc0b1860 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4115381181 >> 172.21.15.93:0/4115381181 conn(0x7f6ecc0ce950 msgr2=0x7f6ecc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4115381181 shutdown_connections 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.922+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4115381181 wait complete. 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.923+0000 7f6ed2a6f640 1 Processor -- start 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.923+0000 7f6ed2a6f640 1 -- start start 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 0x7f6ecc0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 0x7f6ecc1e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc1f69f0 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c5ac0 con 0x7f6ecc1460c0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed2a6f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c5da0 con 0x7f6ecc070e20 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56932/0 (socket says 172.21.15.93:56932) 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 -- 172.21.15.93:0/4060465356 learned_addr learned my addr 172.21.15.93:0/4060465356 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed100c640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 0x7f6ecc1e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 0x7f6ecc0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 -- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 msgr2=0x7f6ecc0c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 0x7f6ecc0c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 -- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 msgr2=0x7f6ecc1e6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 0x7f6ecc1e6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ecbfff640 1 -- 172.21.15.93:0/4060465356 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0009400 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed100c640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 0x7f6ecc1e6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.924+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 0x7f6ecc0c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ecbfff640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c500 tx=0x7f6eb800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8005ce0 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8005e40 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8007330 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0c6080 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.925+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc143990 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.926+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc074290 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.926+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6eb8007550 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.927+0000 7f6ec97fa640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 0x7f6eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.927+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f6eb8089190 con 0x7f6ecc0c37d0 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.927+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 0x7f6eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:56.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.927+0000 7f6ed080b640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 0x7f6eb006d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0036000 tx=0x7f6ec003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:56.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:56.931+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6eb8053e20 con 0x7f6ecc0c37d0 2023-11-04T01:38:57.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.097+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ecc15ce50 con 0x7f6ecc0c37d0 2023-11-04T01:38:57.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.097+0000 7f6ec97fa640 1 -- 172.21.15.93:0/4060465356 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6eb8057440 con 0x7f6ecc0c37d0 2023-11-04T01:38:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:38:57.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 msgr2=0x7f6eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 0x7f6eb006d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0036000 tx=0x7f6ec003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 msgr2=0x7f6ecc143450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c500 tx=0x7f6eb800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 shutdown_connections 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6eb006ae70 0x7f6eb006d330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ecc1460c0 0x7f6ecc1e6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ecc0c37d0 0x7f6ecc143450 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 --2- 172.21.15.93:0/4060465356 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ecc070e20 0x7f6ecc0c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 >> 172.21.15.93:0/4060465356 conn(0x7f6ecc0ce950 msgr2=0x7f6ecc145490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 shutdown_connections 2023-11-04T01:38:57.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.099+0000 7f6ed2a6f640 1 -- 172.21.15.93:0/4060465356 wait complete. 2023-11-04T01:38:57.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:57.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.212+0000 7f651ce9b640 1 Processor -- start 2023-11-04T01:38:57.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.212+0000 7f651ce9b640 1 -- start start 2023-11-04T01:38:57.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.212+0000 7f651ce9b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f65180c4ff0 0x7f65180cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.212+0000 7f651ce9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65180adac0 0x7f65180adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.212+0000 7f651ce9b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651815aff0 con 0x7f6518159c00 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f651ce9b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65180ae460 con 0x7f65180adac0 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f651ce9b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651815a3e0 con 0x7f65180c4ff0 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65180adac0 0x7f65180adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65180adac0 0x7f65180adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56938/0 (socket says 172.21.15.93:56938) 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 -- 172.21.15.93:0/3682933399 learned_addr learned my addr 172.21.15.93:0/3682933399 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f650ffff640 1 --2- 172.21.15.93:0/3682933399 >> v2:172.21.15.125:3300/0 conn(0x7f65180c4ff0 0x7f65180cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 -- 172.21.15.93:0/3682933399 >> v2:172.21.15.125:3300/0 conn(0x7f65180c4ff0 msgr2=0x7f65180cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 --2- 172.21.15.93:0/3682933399 >> v2:172.21.15.125:3300/0 conn(0x7f65180c4ff0 0x7f65180cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 -- 172.21.15.93:0/3682933399 >> v1:172.21.15.125:6789/0 conn(0x7f6518159c00 legacy=0x7f65180c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.213+0000 7f6516d9d640 1 -- 172.21.15.93:0/3682933399 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651815a6c0 con 0x7f65180adac0 2023-11-04T01:38:57.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.214+0000 7f6516d9d640 1 --2- 172.21.15.93:0/3682933399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180adac0 0x7f65180adf20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f65180cde50 tx=0x7f651002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ea43ea567b1704 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f6515d9b640 1 -- 172.21.15.93:0/3682933399 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651002cb20 con 0x7f65180adac0 2023-11-04T01:38:57.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f6515d9b640 1 -- 172.21.15.93:0/3682933399 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651002cc80 con 0x7f65180adac0 2023-11-04T01:38:57.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f6515d9b640 1 -- 172.21.15.93:0/3682933399 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100343f0 con 0x7f65180adac0 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 -- 172.21.15.93:0/3682933399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180adac0 msgr2=0x7f65180adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 --2- 172.21.15.93:0/3682933399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180adac0 0x7f65180adf20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f65180cde50 tx=0x7f651002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 -- 172.21.15.93:0/3682933399 shutdown_connections 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 --2- 172.21.15.93:0/3682933399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180adac0 0x7f65180adf20 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 --2- 172.21.15.93:0/3682933399 >> v2:172.21.15.125:3300/0 conn(0x7f65180c4ff0 0x7f65180cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 -- 172.21.15.93:0/3682933399 >> 172.21.15.93:0/3682933399 conn(0x7f65180ce950 msgr2=0x7f65180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 -- 172.21.15.93:0/3682933399 shutdown_connections 2023-11-04T01:38:57.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.217+0000 7f651ce9b640 1 -- 172.21.15.93:0/3682933399 wait complete. 2023-11-04T01:38:57.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 Processor -- start 2023-11-04T01:38:57.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 -- start start 2023-11-04T01:38:57.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f65180adac0 0x7f65180c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 0x7f651815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.219+0000 7f651ce9b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651814dea0 con 0x7f65180c4ff0 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f651ce9b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651814e0f0 con 0x7f6518159c00 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f651ce9b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651814e3d0 con 0x7f65180adac0 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56950/0 (socket says 172.21.15.93:56950) 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 -- 172.21.15.93:0/660196384 learned_addr learned my addr 172.21.15.93:0/660196384 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f6516d9d640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 0x7f651815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f651659c640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f65180adac0 0x7f65180c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 -- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f65180adac0 msgr2=0x7f65180c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f65180adac0 0x7f65180c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 -- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 msgr2=0x7f651815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 0x7f651815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 -- 172.21.15.93:0/660196384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510009b30 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f6516d9d640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 0x7f651815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650ffff640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f650000d7d0 tx=0x7f650000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500004030 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500004190 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000b6c0 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651814e6b0 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.220+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651814ec70 con 0x7f65180c4ff0 2023-11-04T01:38:57.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.221+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651814ee00 con 0x7f65180c4ff0 2023-11-04T01:38:57.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.222+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f650000b820 con 0x7f65180c4ff0 2023-11-04T01:38:57.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.222+0000 7f650effd640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 0x7f64f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.222+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f6500089cd0 con 0x7f65180c4ff0 2023-11-04T01:38:57.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.222+0000 7f651659c640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 0x7f64f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.222+0000 7f651659c640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 0x7f64f806d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f651815d250 tx=0x7f6508009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.226+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65000548a0 con 0x7f65180c4ff0 2023-11-04T01:38:57.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.393+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f65180adf20 con 0x7f65180c4ff0 2023-11-04T01:38:57.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.393+0000 7f650effd640 1 -- 172.21.15.93:0/660196384 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6500057ec0 con 0x7f65180c4ff0 2023-11-04T01:38:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 msgr2=0x7f64f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 0x7f64f806d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f651815d250 tx=0x7f6508009040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 msgr2=0x7f651815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f650000d7d0 tx=0x7f650000dc90 comp rx=0 tx=0).stop 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 shutdown_connections 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f64f806ae70 0x7f64f806d330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6518159c00 0x7f651815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65180c4ff0 0x7f651815c600 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 --2- 172.21.15.93:0/660196384 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f65180adac0 0x7f65180c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 >> 172.21.15.93:0/660196384 conn(0x7f65180ce950 msgr2=0x7f65180c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 shutdown_connections 2023-11-04T01:38:57.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.395+0000 7f651ce9b640 1 -- 172.21.15.93:0/660196384 wait complete. 2023-11-04T01:38:57.408 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:38:57.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.508+0000 7f8fffc64640 1 Processor -- start 2023-11-04T01:38:57.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.508+0000 7f8fffc64640 1 -- start start 2023-11-04T01:38:57.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8fffc64640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8ff80cccc0 0x7f8ff806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8fffc64640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff806ca40 con 0x7f8ff80b2d30 2023-11-04T01:38:57.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8fffc64640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff806cd20 con 0x7f8ff8160430 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8fffc64640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff80cb580 con 0x7f8ff80cccc0 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8ffd1ff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8ff80b2d30 0x7f8ff806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40466/0 (socket says 172.21.15.93:40466) 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.509+0000 7f8ffd1ff640 1 -- 172.21.15.93:0/1664181341 learned_addr learned my addr 172.21.15.93:0/1664181341 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffe201640 1 --2- 172.21.15.93:0/1664181341 >> v2:172.21.15.93:3300/0 conn(0x7f8ff80cccc0 0x7f8ff806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffc9fe640 1 -- 172.21.15.93:0/1664181341 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71848218 0 0) 0x7f8ff806ca40 con 0x7f8ff80b2d30 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffc9fe640 1 -- 172.21.15.93:0/1664181341 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe4003520 con 0x7f8ff80b2d30 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffe201640 1 -- 172.21.15.93:0/1664181341 >> v1:172.21.15.125:6789/0 conn(0x7f8ff8160430 legacy=0x7f8ff80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffe201640 1 -- 172.21.15.93:0/1664181341 >> v1:172.21.15.93:6789/0 conn(0x7f8ff80b2d30 legacy=0x7f8ff806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.510+0000 7f8ffe201640 1 -- 172.21.15.93:0/1664181341 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff806d000 con 0x7f8ff80cccc0 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8ffe201640 1 --2- 172.21.15.93:0/1664181341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff80cccc0 0x7f8ff806c3a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00097a0 tx=0x7f8ff002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da5cd6b0a0cdaa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8ffc9fe640 1 -- 172.21.15.93:0/1664181341 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0030610 con 0x7f8ff80cccc0 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8ffc9fe640 1 -- 172.21.15.93:0/1664181341 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0030770 con 0x7f8ff80cccc0 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8ffc9fe640 1 -- 172.21.15.93:0/1664181341 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0030b00 con 0x7f8ff80cccc0 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8fffc64640 1 -- 172.21.15.93:0/1664181341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff80cccc0 msgr2=0x7f8ff806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1664181341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff80cccc0 0x7f8ff806c3a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00097a0 tx=0x7f8ff002b960 comp rx=0 tx=0).stop 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8fffc64640 1 -- 172.21.15.93:0/1664181341 shutdown_connections 2023-11-04T01:38:57.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1664181341 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff80cccc0 0x7f8ff806c3a0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.511+0000 7f8fffc64640 1 -- 172.21.15.93:0/1664181341 >> 172.21.15.93:0/1664181341 conn(0x7f8ff806ea20 msgr2=0x7f8ff806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.512+0000 7f8fffc64640 1 -- 172.21.15.93:0/1664181341 shutdown_connections 2023-11-04T01:38:57.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.512+0000 7f8fffc64640 1 -- 172.21.15.93:0/1664181341 wait complete. 2023-11-04T01:38:57.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 Processor -- start 2023-11-04T01:38:57.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 -- start start 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff80b2d30 0x7f8ff815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 0x7f8ff80b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff814b250 con 0x7f8ff8160430 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80b0330 con 0x7f8ff80cccc0 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8fffc64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80b0610 con 0x7f8ff80b2d30 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.513+0000 7f8ffe201640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56964/0 (socket says 172.21.15.93:56964) 2023-11-04T01:38:57.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 -- 172.21.15.93:0/1720594488 learned_addr learned my addr 172.21.15.93:0/1720594488 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffd1ff640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 0x7f8ff80b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffda00640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff80b2d30 0x7f8ff815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 -- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff80b2d30 msgr2=0x7f8ff815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff80b2d30 0x7f8ff815f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 -- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 msgr2=0x7f8ff80b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 0x7f8ff80b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 -- 172.21.15.93:0/1720594488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0009400 con 0x7f8ff8160430 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffd1ff640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 0x7f8ff80b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8ffe201640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00098c0 tx=0x7f8ff0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff003e040 con 0x7f8ff8160430 2023-11-04T01:38:57.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0039c10 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80b08f0 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0030e10 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.514+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80b10f0 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.515+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff8074290 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.516+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ff004d3b0 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.516+0000 7f8fea7fc640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 0x7f8fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.516+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8ff00ac0b0 con 0x7f8ff8160430 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.516+0000 7f8ffda00640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 0x7f8fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.517+0000 7f8ffda00640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 0x7f8fdc06d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40012e0 tx=0x7f8ff4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.520+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ff0076bf0 con 0x7f8ff8160430 2023-11-04T01:38:57.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.685+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f8ff80b6b20 con 0x7f8ff8160430 2023-11-04T01:38:57.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.686+0000 7f8fea7fc640 1 -- 172.21.15.93:0/1720594488 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ff007a210 con 0x7f8ff8160430 2023-11-04T01:38:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.687+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 msgr2=0x7f8fdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.687+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 0x7f8fdc06d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40012e0 tx=0x7f8ff4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.687+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 msgr2=0x7f8ff80b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.687+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00098c0 tx=0x7f8ff0004730 comp rx=0 tx=0).stop 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.687+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 shutdown_connections 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8fdc06ae70 0x7f8fdc06d330 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ff8160430 0x7f8ff80b2220 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff80cccc0 0x7f8ff80b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 --2- 172.21.15.93:0/1720594488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ff80b2d30 0x7f8ff815f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 >> 172.21.15.93:0/1720594488 conn(0x7f8ff806ea20 msgr2=0x7f8ff80cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 shutdown_connections 2023-11-04T01:38:57.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.688+0000 7f8fffc64640 1 -- 172.21.15.93:0/1720594488 wait complete. 2023-11-04T01:38:57.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:38:57.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.800+0000 7f9b8cd83640 1 Processor -- start 2023-11-04T01:38:57.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.800+0000 7f9b8cd83640 1 -- start start 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8cd83640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8cd83640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815aff0 con 0x7f9b880c4ff0 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8cd83640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815a3e0 con 0x7f9b88159c00 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8cd83640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8815a6c0 con 0x7f9b880ae1d0 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b85d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9b880c4ff0 0x7f9b880adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40476/0 (socket says 172.21.15.93:40476) 2023-11-04T01:38:57.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b85d9b640 1 -- 172.21.15.93:0/351161052 learned_addr learned my addr 172.21.15.93:0/351161052 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232225865 0 0) 0x7f9b8815aff0 con 0x7f9b880c4ff0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.801+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70003520 con 0x7f9b880c4ff0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092174058 0 0) 0x7f9b70003520 con 0x7f9b880c4ff0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 msgr2=0x7f9b880cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b880cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 >> v1:172.21.15.125:6789/0 conn(0x7f9b88159c00 legacy=0x7f9b880c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8815a9a0 con 0x7f9b880c4ff0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f9b7c001670 con 0x7f9b880c4ff0 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b880cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:57.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 >> v1:172.21.15.93:6789/0 conn(0x7f9b880c4ff0 legacy=0x7f9b880adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b70003f90 0x7f9b700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8815a6c0 con 0x7f9b70004d00 2023-11-04T01:38:57.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7000bae0 con 0x7f9b70003f90 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7000bca0 con 0x7f9b880ae1d0 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b85d9b640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b70003f90 0x7f9b700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b8659c640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 -- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 msgr2=0x7f9b700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880ae1d0 0x7f9b700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 -- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b70003f90 msgr2=0x7f9b700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b70003f90 0x7f9b700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.802+0000 7f9b86d9d640 1 -- 172.21.15.93:0/351161052 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70003520 con 0x7f9b70004d00 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b70005180 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098a0 tx=0x7f9b700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce56bf10090559d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004230 con 0x7f9b70004d00 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80004390 con 0x7f9b70004d00 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b8559a640 1 -- 172.21.15.93:0/351161052 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80003830 con 0x7f9b70004d00 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b8cd83640 1 -- 172.21.15.93:0/351161052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 msgr2=0x7f9b70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/351161052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b70005180 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9b800098a0 tx=0x7f9b700057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.803+0000 7f9b86d9d640 1 -- 172.21.15.93:0/351161052 reap_dead start 2023-11-04T01:38:57.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.804+0000 7f9b8cd83640 1 -- 172.21.15.93:0/351161052 shutdown_connections 2023-11-04T01:38:57.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.804+0000 7f9b8cd83640 1 -- 172.21.15.93:0/351161052 >> 172.21.15.93:0/351161052 conn(0x7f9b880ce950 msgr2=0x7f9b880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.804+0000 7f9b8cd83640 1 -- 172.21.15.93:0/351161052 shutdown_connections 2023-11-04T01:38:57.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.804+0000 7f9b8cd83640 1 -- 172.21.15.93:0/351161052 wait complete. 2023-11-04T01:38:57.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.805+0000 7f9b8cd83640 1 Processor -- start 2023-11-04T01:38:57.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.805+0000 7f9b8cd83640 1 -- start start 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880c8440 0x7f9b8814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 0x7f9b880b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8814ff00 con 0x7f9b70004d00 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8814cd90 con 0x7f9b8814fa80 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ae010 con 0x7f9b880c8440 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56982/0 (socket says 172.21.15.93:56982) 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 -- 172.21.15.93:0/3922864170 learned_addr learned my addr 172.21.15.93:0/3922864170 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 0x7f9b880b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b85d9b640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880c8440 0x7f9b8814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 -- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880c8440 msgr2=0x7f9b8814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880c8440 0x7f9b8814f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 -- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 msgr2=0x7f9b880b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 0x7f9b880b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 -- 172.21.15.93:0/3922864170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8815b240 con 0x7f9b70004d00 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b86d9d640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 0x7f9b880b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8659c640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800fb90 tx=0x7f9b7800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800fe90 con 0x7f9b70004d00 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800dc30 con 0x7f9b70004d00 2023-11-04T01:38:57.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880b45e0 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78003970 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.806+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88152bc0 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.807+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88074290 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.808+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b78003ad0 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.808+0000 7f9b76ffd640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 0x7f9b6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.808+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f9b78089de0 con 0x7f9b70004d00 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.808+0000 7f9b85d9b640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 0x7f9b6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:57.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.808+0000 7f9b85d9b640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 0x7f9b6806d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000c00 tx=0x7f9b7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:57.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.812+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b780549b0 con 0x7f9b70004d00 2023-11-04T01:38:57.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.975+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f9b880c7ce0 con 0x7f9b70004d00 2023-11-04T01:38:57.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.976+0000 7f9b76ffd640 1 -- 172.21.15.93:0/3922864170 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9b78057fd0 con 0x7f9b70004d00 2023-11-04T01:38:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:57.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 msgr2=0x7f9b6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 0x7f9b6806d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000c00 tx=0x7f9b7c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 msgr2=0x7f9b880c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800fb90 tx=0x7f9b7800d520 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 shutdown_connections 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b6806ae70 0x7f9b6806d330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b8814fa80 0x7f9b880b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b880c8440 0x7f9b8814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 --2- 172.21.15.93:0/3922864170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b70004d00 0x7f9b880c7f00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 >> 172.21.15.93:0/3922864170 conn(0x7f9b880ce950 msgr2=0x7f9b8806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 shutdown_connections 2023-11-04T01:38:57.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:57.978+0000 7f9b8cd83640 1 -- 172.21.15.93:0/3922864170 wait complete. 2023-11-04T01:38:57.991 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:58.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.090+0000 7fcdfcdb6640 1 Processor -- start 2023-11-04T01:38:58.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 -- start start 2023-11-04T01:38:58.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf8159c00 0x7fcdf80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcdf80c48e0 0x7fcdf80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdf80adac0 0x7fcdf80adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf80c52a0 con 0x7fcdf80c48e0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf815aff0 con 0x7fcdf80adac0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdfcdb6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80ae430 con 0x7fcdf8159c00 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.091+0000 7fcdeffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcdf80c48e0 0x7fcdf80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcdf80c48e0 0x7fcdf80c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56986/0 (socket says 172.21.15.93:56986) 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 -- 172.21.15.93:0/2388146409 learned_addr learned my addr 172.21.15.93:0/2388146409 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdf6d9d640 1 --2- 172.21.15.93:0/2388146409 >> v2:172.21.15.125:3300/0 conn(0x7fcdf80adac0 0x7fcdf80adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 -- 172.21.15.93:0/2388146409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf8159c00 msgr2=0x7fcdf80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2388146409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf8159c00 0x7fcdf80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 -- 172.21.15.93:0/2388146409 >> v2:172.21.15.125:3300/0 conn(0x7fcdf80adac0 msgr2=0x7fcdf80adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2388146409 >> v2:172.21.15.125:3300/0 conn(0x7fcdf80adac0 0x7fcdf80adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 -- 172.21.15.93:0/2388146409 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf815a3e0 con 0x7fcdf80c48e0 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.092+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2388146409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80c48e0 0x7fcdf80c4d60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815d5c0 tx=0x7fcde002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc42f355ede2cb48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdf5d9b640 1 -- 172.21.15.93:0/2388146409 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0031870 con 0x7fcdf80c48e0 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdf5d9b640 1 -- 172.21.15.93:0/2388146409 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde00319d0 con 0x7fcdf80c48e0 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdf5d9b640 1 -- 172.21.15.93:0/2388146409 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0031d60 con 0x7fcdf80c48e0 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2388146409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80c48e0 msgr2=0x7fcdf80c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2388146409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80c48e0 0x7fcdf80c4d60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815d5c0 tx=0x7fcde002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2388146409 shutdown_connections 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2388146409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80c48e0 0x7fcdf80c4d60 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2388146409 >> v2:172.21.15.125:3300/0 conn(0x7fcdf80adac0 0x7fcdf80adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2388146409 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf8159c00 0x7fcdf80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2388146409 >> 172.21.15.93:0/2388146409 conn(0x7fcdf80ce950 msgr2=0x7fcdf80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2388146409 shutdown_connections 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.093+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2388146409 wait complete. 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.094+0000 7fcdfcdb6640 1 Processor -- start 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.094+0000 7fcdfcdb6640 1 -- start start 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf80c48e0 0x7fcdf80709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf8159c00 0x7fcdf8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8152750 con 0x7fcdf80adac0 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf81e5b10 con 0x7fcdf8159c00 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdfcdb6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf81e4f00 con 0x7fcdf80c48e0 2023-11-04T01:38:58.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdf659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdf659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56994/0 (socket says 172.21.15.93:56994) 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdf659c640 1 -- 172.21.15.93:0/2813517023 learned_addr learned my addr 172.21.15.93:0/2813517023 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdf6d9d640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf8159c00 0x7fcdf8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.095+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf80c48e0 0x7fcdf80709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 -- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf80c48e0 msgr2=0x7fcdf80709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf80c48e0 0x7fcdf80709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 -- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf8159c00 msgr2=0x7fcdf8070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf8159c00 0x7fcdf8070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 -- 172.21.15.93:0/2813517023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00094d0 con 0x7fcdf80adac0 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdf659c640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcde800d990 tx=0x7fcde800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800edf0 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8016440 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf81e51e0 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80167f0 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.096+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf81e57a0 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.097+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf80b4890 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.097+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcde801f3b0 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.098+0000 7fcdeeffd640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 0x7fcdd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.098+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fcde808bb10 con 0x7fcdf80adac0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.098+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 0x7fcdd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.098+0000 7fcdeffff640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 0x7fcdd806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcde0036000 tx=0x7fcde003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.102+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcde8056790 con 0x7fcdf80adac0 2023-11-04T01:38:58.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.273+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdf8074290 con 0x7fcdf80adac0 2023-11-04T01:38:58.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.274+0000 7fcdeeffd640 1 -- 172.21.15.93:0/2813517023 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcde801b020 con 0x7fcdf80adac0 2023-11-04T01:38:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:38:58.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.275+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 msgr2=0x7fcdd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.275+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 0x7fcdd806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcde0036000 tx=0x7fcde003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 msgr2=0x7fcdf813e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcde800d990 tx=0x7fcde800de50 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 shutdown_connections 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcdd806ae70 0x7fcdd806d330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf8159c00 0x7fcdf8070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcdf80c48e0 0x7fcdf80709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 --2- 172.21.15.93:0/2813517023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdf80adac0 0x7fcdf813e490 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 >> 172.21.15.93:0/2813517023 conn(0x7fcdf80ce950 msgr2=0x7fcdf806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 shutdown_connections 2023-11-04T01:38:58.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.276+0000 7fcdfcdb6640 1 -- 172.21.15.93:0/2813517023 wait complete. 2023-11-04T01:38:58.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.391+0000 7f38767c5640 1 Processor -- start 2023-11-04T01:38:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.391+0000 7f38767c5640 1 -- start start 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f38767c5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 0x7f38700b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f38767c5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 0x7f38700cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f38767c5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38700b2fc0 con 0x7f38700b2b60 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f38767c5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38700cb580 con 0x7f387006c3a0 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f38767c5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387006ca40 con 0x7f3870160430 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f3874d62640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 0x7f38700cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386f7fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f38700b2b60 0x7f387006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:45124/0 (socket says 172.21.15.93:45124) 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.392+0000 7f386ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 0x7f38700b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386f7fe640 1 -- 172.21.15.93:0/2149411999 learned_addr learned my addr 172.21.15.93:0/2149411999 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386ffff640 1 -- 172.21.15.93:0/2149411999 >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 msgr2=0x7f38700cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386ffff640 1 --2- 172.21.15.93:0/2149411999 >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 0x7f38700cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386ffff640 1 -- 172.21.15.93:0/2149411999 >> v1:172.21.15.125:6789/0 conn(0x7f38700b2b60 legacy=0x7f387006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f386ffff640 1 -- 172.21.15.93:0/2149411999 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387006c810 con 0x7f3870160430 2023-11-04T01:38:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.393+0000 7f3874d62640 1 --2- 172.21.15.93:0/2149411999 >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 0x7f38700cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f386ffff640 1 --2- 172.21.15.93:0/2149411999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 0x7f38700b2620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38600097a0 tx=0x7f386002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a98355b5377062 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f386effd640 1 -- 172.21.15.93:0/2149411999 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860031830 con 0x7f3870160430 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f386effd640 1 -- 172.21.15.93:0/2149411999 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3860031990 con 0x7f3870160430 2023-11-04T01:38:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f386effd640 1 -- 172.21.15.93:0/2149411999 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860031d20 con 0x7f3870160430 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 -- 172.21.15.93:0/2149411999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 msgr2=0x7f38700b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 --2- 172.21.15.93:0/2149411999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 0x7f38700b2620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38600097a0 tx=0x7f386002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 -- 172.21.15.93:0/2149411999 shutdown_connections 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 --2- 172.21.15.93:0/2149411999 >> v2:172.21.15.125:3300/0 conn(0x7f387006c3a0 0x7f38700cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 --2- 172.21.15.93:0/2149411999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3870160430 0x7f38700b2620 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.394+0000 7f38767c5640 1 -- 172.21.15.93:0/2149411999 >> 172.21.15.93:0/2149411999 conn(0x7f387006ea20 msgr2=0x7f387006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.395+0000 7f38767c5640 1 -- 172.21.15.93:0/2149411999 shutdown_connections 2023-11-04T01:38:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.395+0000 7f38767c5640 1 -- 172.21.15.93:0/2149411999 wait complete. 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 Processor -- start 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 -- start start 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f387006c3a0 0x7f3870151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3870160430 0x7f38700cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700b48c0 con 0x7f38700b2b60 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700b44a0 con 0x7f3870160430 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.396+0000 7f38767c5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38700b3860 con 0x7f387006c3a0 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57002/0 (socket says 172.21.15.93:57002) 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 -- 172.21.15.93:0/3651120796 learned_addr learned my addr 172.21.15.93:0/3651120796 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386ffff640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f387006c3a0 0x7f3870151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f3874d62640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3870160430 0x7f38700cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 -- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f387006c3a0 msgr2=0x7f3870151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f387006c3a0 0x7f3870151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 -- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3870160430 msgr2=0x7f38700cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3870160430 0x7f38700cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 -- 172.21.15.93:0/3651120796 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009a70 con 0x7f38700b2b60 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386f7fe640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f386400c4a0 tx=0x7f386400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864005ce0 con 0x7f38700b2b60 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864005e40 con 0x7f38700b2b60 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3860009400 con 0x7f38700b2b60 2023-11-04T01:38:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640072d0 con 0x7f38700b2b60 2023-11-04T01:38:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.397+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38700b3bb0 con 0x7f38700b2b60 2023-11-04T01:38:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.398+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3870074290 con 0x7f38700b2b60 2023-11-04T01:38:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.399+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3864007430 con 0x7f38700b2b60 2023-11-04T01:38:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.399+0000 7f386cff9640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 0x7f385c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.399+0000 7f386ffff640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 0x7f385c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.399+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f3864088f90 con 0x7f38700b2b60 2023-11-04T01:38:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.400+0000 7f386ffff640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 0x7f385c06d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3860036000 tx=0x7f386003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.405 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.403+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38640bbca0 con 0x7f38700b2b60 2023-11-04T01:38:58.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.579+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38700b6b20 con 0x7f38700b2b60 2023-11-04T01:38:58.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.579+0000 7f386cff9640 1 -- 172.21.15.93:0/3651120796 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38640170a0 con 0x7f38700b2b60 2023-11-04T01:38:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 msgr2=0x7f385c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 0x7f385c06d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3860036000 tx=0x7f386003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 msgr2=0x7f3870154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f386400c4a0 tx=0x7f386400c8a0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 shutdown_connections 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f385c06ae70 0x7f385c06d330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3870160430 0x7f38700cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38700b2b60 0x7f3870154d20 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 --2- 172.21.15.93:0/3651120796 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f387006c3a0 0x7f3870151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.581+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 >> 172.21.15.93:0/3651120796 conn(0x7f387006ea20 msgr2=0x7f38700cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.582+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 shutdown_connections 2023-11-04T01:38:58.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.582+0000 7f38767c5640 1 -- 172.21.15.93:0/3651120796 wait complete. 2023-11-04T01:38:58.594 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:58.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.691+0000 7fbba82e0640 1 Processor -- start 2023-11-04T01:38:58.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.691+0000 7fbba82e0640 1 -- start start 2023-11-04T01:38:58.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba82e0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbba0159c70 0x7fbba00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba82e0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00b4110 con 0x7fbba00b0ae0 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba82e0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00b43f0 con 0x7fbba006db20 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba82e0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00b49b0 con 0x7fbba0159c70 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba607c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbba0159c70 0x7fbba00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba687d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbba00b0ae0 0x7fbba015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40482/0 (socket says 172.21.15.93:40482) 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba687d640 1 -- 172.21.15.93:0/57139614 learned_addr learned my addr 172.21.15.93:0/57139614 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba607c640 1 -- 172.21.15.93:0/57139614 >> v1:172.21.15.125:6789/0 conn(0x7fbba006db20 legacy=0x7fbba00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba607c640 1 -- 172.21.15.93:0/57139614 >> v1:172.21.15.93:6789/0 conn(0x7fbba00b0ae0 legacy=0x7fbba015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba607c640 1 -- 172.21.15.93:0/57139614 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00b46d0 con 0x7fbba0159c70 2023-11-04T01:38:58.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.692+0000 7fbba507a640 1 -- 172.21.15.93:0/57139614 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329859092 0 0) 0x7fbba00b4110 con 0x7fbba00b0ae0 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.693+0000 7fbba607c640 1 --2- 172.21.15.93:0/57139614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba0159c70 0x7fbba00ce370 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097a0 tx=0x7fbb9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b38601d777ba112 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.693+0000 7fbba507a640 1 -- 172.21.15.93:0/57139614 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c031830 con 0x7fbba0159c70 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.693+0000 7fbba507a640 1 -- 172.21.15.93:0/57139614 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c031990 con 0x7fbba0159c70 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.693+0000 7fbba507a640 1 -- 172.21.15.93:0/57139614 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c031d20 con 0x7fbba0159c70 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 -- 172.21.15.93:0/57139614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba0159c70 msgr2=0x7fbba00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 --2- 172.21.15.93:0/57139614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba0159c70 0x7fbba00ce370 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097a0 tx=0x7fbb9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 -- 172.21.15.93:0/57139614 shutdown_connections 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 --2- 172.21.15.93:0/57139614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba0159c70 0x7fbba00ce370 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 -- 172.21.15.93:0/57139614 >> 172.21.15.93:0/57139614 conn(0x7fbba00ce950 msgr2=0x7fbba00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 -- 172.21.15.93:0/57139614 shutdown_connections 2023-11-04T01:38:58.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.694+0000 7fbba82e0640 1 -- 172.21.15.93:0/57139614 wait complete. 2023-11-04T01:38:58.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.695+0000 7fbba82e0640 1 Processor -- start 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.695+0000 7fbba82e0640 1 -- start start 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba00b0ae0 0x7fbba014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 0x7fbba014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba014f670 con 0x7fbba006db20 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00c7c40 con 0x7fbba0159c70 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba82e0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00c7f20 con 0x7fbba00b0ae0 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57006/0 (socket says 172.21.15.93:57006) 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 -- 172.21.15.93:0/3486870590 learned_addr learned my addr 172.21.15.93:0/3486870590 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba687d640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 0x7fbba014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 -- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba00b0ae0 msgr2=0x7fbba014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba00b0ae0 0x7fbba014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 -- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 msgr2=0x7fbba014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 0x7fbba014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 -- 172.21.15.93:0/3486870590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009400 con 0x7fbba006db20 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba687d640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 0x7fbba014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbba607c640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c034040 tx=0x7fbb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.696+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c004030 con 0x7fbba006db20 2023-11-04T01:38:58.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.697+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0041b0 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.697+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba01543f0 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.697+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c03b8f0 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.697+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba01549b0 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.697+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba006df90 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.698+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb9c03ba50 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.698+0000 7fbb96ffd640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 0x7fbb8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.698+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fbb9c0ae9b0 con 0x7fbba006db20 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.699+0000 7fbba587b640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 0x7fbb8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.699+0000 7fbba587b640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 0x7fbb8406d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbba01f2e00 tx=0x7fbb900079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.703+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbba006df90 con 0x7fbba006db20 2023-11-04T01:38:58.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.901+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbba006df90 con 0x7fbba006db20 2023-11-04T01:38:58.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.901+0000 7fbb96ffd640 1 -- 172.21.15.93:0/3486870590 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fbba006df90 con 0x7fbba006db20 2023-11-04T01:38:58.904 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:52.623770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:58.904 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 38 2023-11-04T01:38:58.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 msgr2=0x7fbb8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 0x7fbb8406d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbba01f2e00 tx=0x7fbb900079d0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 msgr2=0x7fbba00c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c034040 tx=0x7fbb9c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 shutdown_connections 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbb8406ae70 0x7fbb8406d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbba0159c70 0x7fbba014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbba00b0ae0 0x7fbba014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 --2- 172.21.15.93:0/3486870590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbba006db20 0x7fbba00c83b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 >> 172.21.15.93:0/3486870590 conn(0x7fbba00ce950 msgr2=0x7fbba015a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 shutdown_connections 2023-11-04T01:38:58.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:58.903+0000 7fbba82e0640 1 -- 172.21.15.93:0/3486870590 wait complete. 2023-11-04T01:38:58.916 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:59.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.013+0000 7ff6fe383640 1 Processor -- start 2023-11-04T01:38:59.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.013+0000 7ff6fe383640 1 -- start start 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6f8159c70 0x7ff6f80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6f80b0910 0x7ff6f815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80b49b0 con 0x7ff6f8159c70 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80b0da0 con 0x7ff6f80b0910 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fe383640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80b4110 con 0x7ff6f806db20 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6f8159c70 0x7ff6f80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6f8159c70 0x7ff6f80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57016/0 (socket says 172.21.15.93:57016) 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 -- 172.21.15.93:0/1197161307 learned_addr learned my addr 172.21.15.93:0/1197161307 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f77fe640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6fc920640 1 --2- 172.21.15.93:0/1197161307 >> v2:172.21.15.125:3300/0 conn(0x7ff6f80b0910 0x7ff6f815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 -- 172.21.15.93:0/1197161307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 msgr2=0x7ff6f80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 -- 172.21.15.93:0/1197161307 >> v2:172.21.15.125:3300/0 conn(0x7ff6f80b0910 msgr2=0x7ff6f815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/1197161307 >> v2:172.21.15.125:3300/0 conn(0x7ff6f80b0910 0x7ff6f815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.014+0000 7ff6f7fff640 1 -- 172.21.15.93:0/1197161307 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80b43f0 con 0x7ff6f8159c70 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f80ce370 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80ca130 tx=0x7ff6ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94453ed24b2d4aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6f6ffd640 1 -- 172.21.15.93:0/1197161307 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec031870 con 0x7ff6f8159c70 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6f6ffd640 1 -- 172.21.15.93:0/1197161307 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec0319d0 con 0x7ff6f8159c70 2023-11-04T01:38:59.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6f6ffd640 1 -- 172.21.15.93:0/1197161307 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec031d60 con 0x7ff6f8159c70 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6fe383640 1 -- 172.21.15.93:0/1197161307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 msgr2=0x7ff6f80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.015+0000 7ff6fe383640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f80ce370 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80ca130 tx=0x7ff6ec02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 -- 172.21.15.93:0/1197161307 shutdown_connections 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 --2- 172.21.15.93:0/1197161307 >> v2:172.21.15.125:3300/0 conn(0x7ff6f80b0910 0x7ff6f815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 --2- 172.21.15.93:0/1197161307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f80ce370 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 -- 172.21.15.93:0/1197161307 >> 172.21.15.93:0/1197161307 conn(0x7ff6f80ce950 msgr2=0x7ff6f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 -- 172.21.15.93:0/1197161307 shutdown_connections 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.016+0000 7ff6fe383640 1 -- 172.21.15.93:0/1197161307 wait complete. 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.017+0000 7ff6fe383640 1 Processor -- start 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.017+0000 7ff6fe383640 1 -- start start 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f81512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f80b0910 0x7ff6f8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815bc40 con 0x7ff6f8159c70 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815ea80 con 0x7ff6f80b0910 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815b960 con 0x7ff6f806db20 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57022/0 (socket says 172.21.15.93:57022) 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 -- 172.21.15.93:0/2828526902 learned_addr learned my addr 172.21.15.93:0/2828526902 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f81512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6f77fe640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f80b0910 0x7ff6f8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 -- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 msgr2=0x7ff6f81512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f81512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 -- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f80b0910 msgr2=0x7ff6f8151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f80b0910 0x7ff6f8151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 -- 172.21.15.93:0/2828526902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0094d0 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fc920640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007e40 tx=0x7ff6f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0014620 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000ee90 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00149e0 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f815ed20 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.018+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f8152290 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.019+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f815e8e0 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.020+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6f0014b40 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.020+0000 7ff6f4ff9640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 0x7ff6e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.020+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ff6f008a500 con 0x7ff6f8159c70 2023-11-04T01:38:59.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.020+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 0x7ff6e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.020+0000 7ff6f7fff640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 0x7ff6e406d360 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec036000 tx=0x7ff6ec03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.024+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6f815e8e0 con 0x7ff6f8159c70 2023-11-04T01:38:59.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.196+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f815f240 con 0x7ff6f8159c70 2023-11-04T01:38:59.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.197+0000 7ff6f4ff9640 1 -- 172.21.15.93:0/2828526902 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22075 (secure 0 0 0) 0x7ff6f815f240 con 0x7ff6f8159c70 2023-11-04T01:38:59.200 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":83,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:58.214486+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":83,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:59.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 msgr2=0x7ff6e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 0x7ff6e406d360 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec036000 tx=0x7ff6ec03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 msgr2=0x7ff6f8151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007e40 tx=0x7ff6f000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 shutdown_connections 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff6e406aea0 0x7ff6e406d360 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6f8159c70 0x7ff6f8151d50 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6f80b0910 0x7ff6f8151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 --2- 172.21.15.93:0/2828526902 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff6f806db20 0x7ff6f81512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 >> 172.21.15.93:0/2828526902 conn(0x7ff6f80ce950 msgr2=0x7ff6f80ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 shutdown_connections 2023-11-04T01:38:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.199+0000 7ff6fe383640 1 -- 172.21.15.93:0/2828526902 wait complete. 2023-11-04T01:38:59.213 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:59.213 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:59.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.310+0000 7f82d3dc0640 1 Processor -- start 2023-11-04T01:38:59.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.310+0000 7f82d3dc0640 1 -- start start 2023-11-04T01:38:59.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d3dc0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f82cc15ce70 0x7f82cc06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d3dc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc15d250 0x7f82cc0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d3dc0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc06a120 con 0x7f82cc0c9d70 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d3dc0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0cdc10 con 0x7f82cc15ce70 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d3dc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc06def0 con 0x7f82cc15d250 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d1b5c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f82cc15ce70 0x7f82cc06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d235d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f82cc0c9d70 0x7f82cc0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40496/0 (socket says 172.21.15.93:40496) 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d235d640 1 -- 172.21.15.93:0/1732313474 learned_addr learned my addr 172.21.15.93:0/1732313474 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d1b5c640 1 -- 172.21.15.93:0/1732313474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc15d250 msgr2=0x7f82cc0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d1b5c640 1 --2- 172.21.15.93:0/1732313474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc15d250 0x7f82cc0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d1b5c640 1 -- 172.21.15.93:0/1732313474 >> v1:172.21.15.93:6789/0 conn(0x7f82cc0c9d70 legacy=0x7f82cc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d0b5a640 1 -- 172.21.15.93:0/1732313474 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493693804 0 0) 0x7f82cc06a120 con 0x7f82cc0c9d70 2023-11-04T01:38:59.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.311+0000 7f82d1b5c640 1 -- 172.21.15.93:0/1732313474 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc06a370 con 0x7f82cc15ce70 2023-11-04T01:38:59.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d1b5c640 1 --2- 172.21.15.93:0/1732313474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc06d9b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f82c80097a0 tx=0x7f82c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dabc9709bf3586 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d0b5a640 1 -- 172.21.15.93:0/1732313474 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8031830 con 0x7f82cc15ce70 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d0b5a640 1 -- 172.21.15.93:0/1732313474 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8031990 con 0x7f82cc15ce70 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d0b5a640 1 -- 172.21.15.93:0/1732313474 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8031d20 con 0x7f82cc15ce70 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 -- 172.21.15.93:0/1732313474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 msgr2=0x7f82cc06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/1732313474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc06d9b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f82c80097a0 tx=0x7f82c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 -- 172.21.15.93:0/1732313474 shutdown_connections 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/1732313474 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc15d250 0x7f82cc0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/1732313474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc06d9b0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.312+0000 7f82d3dc0640 1 -- 172.21.15.93:0/1732313474 >> 172.21.15.93:0/1732313474 conn(0x7f82cc0b0cd0 msgr2=0x7f82cc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.313+0000 7f82d3dc0640 1 -- 172.21.15.93:0/1732313474 shutdown_connections 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.313+0000 7f82d3dc0640 1 -- 172.21.15.93:0/1732313474 wait complete. 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 Processor -- start 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 -- start start 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82cc15d250 0x7f82cc0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc1e23d0 0x7f82cc1e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c7ec0 con 0x7f82cc15ce70 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c7b70 con 0x7f82cc15d250 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d3dc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c5cb0 con 0x7f82cc1e23d0 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.314+0000 7f82d1b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57036/0 (socket says 172.21.15.93:57036) 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 -- 172.21.15.93:0/312430903 learned_addr learned my addr 172.21.15.93:0/312430903 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d235d640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc1e23d0 0x7f82cc1e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d135b640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82cc15d250 0x7f82cc0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 -- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc1e23d0 msgr2=0x7f82cc1e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc1e23d0 0x7f82cc1e2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 -- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82cc15d250 msgr2=0x7f82cc0c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82cc15d250 0x7f82cc0c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 -- 172.21.15.93:0/312430903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009400 con 0x7f82cc15ce70 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d1b5c640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f82c802bee0 tx=0x7f82c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c803ba70 con 0x7f82cc15ce70 2023-11-04T01:38:59.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c803bbd0 con 0x7f82cc15ce70 2023-11-04T01:38:59.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc0c6b00 con 0x7f82cc15ce70 2023-11-04T01:38:59.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80453f0 con 0x7f82cc15ce70 2023-11-04T01:38:59.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.315+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0c70c0 con 0x7f82cc15ce70 2023-11-04T01:38:59.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.316+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc0c8000 con 0x7f82cc15ce70 2023-11-04T01:38:59.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.317+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82c8045550 con 0x7f82cc15ce70 2023-11-04T01:38:59.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.317+0000 7f82c27fc640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 0x7f82b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.317+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f82c80abe40 con 0x7f82cc15ce70 2023-11-04T01:38:59.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.317+0000 7f82d135b640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 0x7f82b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.317+0000 7f82d135b640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 0x7f82b006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82cc15c4f0 tx=0x7f82bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.321+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82cc0c8000 con 0x7f82cc15ce70 2023-11-04T01:38:59.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.521+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82cc0c8000 con 0x7f82cc15ce70 2023-11-04T01:38:59.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.522+0000 7f82c27fc640 1 -- 172.21.15.93:0/312430903 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f82cc0c8000 con 0x7f82cc15ce70 2023-11-04T01:38:59.525 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:59.525 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:52.623770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:59.525 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 38 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 msgr2=0x7f82b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 0x7f82b006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82cc15c4f0 tx=0x7f82bc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 msgr2=0x7f82cc0c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f82c802bee0 tx=0x7f82c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 shutdown_connections 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f82b006ae70 0x7f82b006d330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82cc1e23d0 0x7f82cc1e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82cc15d250 0x7f82cc0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 --2- 172.21.15.93:0/312430903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82cc15ce70 0x7f82cc0c5770 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 >> 172.21.15.93:0/312430903 conn(0x7f82cc0b0cd0 msgr2=0x7f82cc0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 shutdown_connections 2023-11-04T01:38:59.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.524+0000 7f82d3dc0640 1 -- 172.21.15.93:0/312430903 wait complete. 2023-11-04T01:38:59.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:59.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.634+0000 7f898004b640 1 Processor -- start 2023-11-04T01:38:59.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.634+0000 7f898004b640 1 -- start start 2023-11-04T01:38:59.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f898004b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8978160b10 0x7f8978160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f898004b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89780cf160 0x7f89780cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f898004b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897806bf00 con 0x7f897815ce60 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f898004b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780cbde0 con 0x7f89780cf160 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f898004b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780cfb30 con 0x7f8978160b10 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89780cf160 0x7f89780cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89780cf160 0x7f89780cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57040/0 (socket says 172.21.15.93:57040) 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897dde7640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f897815ce60 0x7f897806b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40512/0 (socket says 172.21.15.93:40512) 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 -- 172.21.15.93:0/1412738574 learned_addr learned my addr 172.21.15.93:0/1412738574 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897d5e6640 1 --2- 172.21.15.93:0/1412738574 >> v2:172.21.15.125:3300/0 conn(0x7f8978160b10 0x7f8978160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 -- 172.21.15.93:0/1412738574 >> v2:172.21.15.125:3300/0 conn(0x7f8978160b10 msgr2=0x7f8978160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 --2- 172.21.15.93:0/1412738574 >> v2:172.21.15.125:3300/0 conn(0x7f8978160b10 0x7f8978160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 -- 172.21.15.93:0/1412738574 >> v1:172.21.15.93:6789/0 conn(0x7f897815ce60 legacy=0x7f897806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897cde5640 1 -- 172.21.15.93:0/1412738574 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52384355 0 0) 0x7f897806bf00 con 0x7f897815ce60 2023-11-04T01:38:59.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.635+0000 7f897e5e8640 1 -- 172.21.15.93:0/1412738574 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89781615d0 con 0x7f89780cf160 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.636+0000 7f897e5e8640 1 --2- 172.21.15.93:0/1412738574 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f89780cf5f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8978072590 tx=0x7f897002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b6b975d1bbc6b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.636+0000 7f897cde5640 1 -- 172.21.15.93:0/1412738574 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897002cb20 con 0x7f89780cf160 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.636+0000 7f897cde5640 1 -- 172.21.15.93:0/1412738574 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897002cc80 con 0x7f89780cf160 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.636+0000 7f897cde5640 1 -- 172.21.15.93:0/1412738574 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700343f0 con 0x7f89780cf160 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 -- 172.21.15.93:0/1412738574 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 msgr2=0x7f89780cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 --2- 172.21.15.93:0/1412738574 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f89780cf5f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8978072590 tx=0x7f897002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 -- 172.21.15.93:0/1412738574 shutdown_connections 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 --2- 172.21.15.93:0/1412738574 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f89780cf5f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 --2- 172.21.15.93:0/1412738574 >> v2:172.21.15.125:3300/0 conn(0x7f8978160b10 0x7f8978160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 -- 172.21.15.93:0/1412738574 >> 172.21.15.93:0/1412738574 conn(0x7f897806ea90 msgr2=0x7f897806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 -- 172.21.15.93:0/1412738574 shutdown_connections 2023-11-04T01:38:59.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.637+0000 7f898004b640 1 -- 172.21.15.93:0/1412738574 wait complete. 2023-11-04T01:38:59.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.638+0000 7f898004b640 1 Processor -- start 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.638+0000 7f898004b640 1 -- start start 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897815ce60 0x7f897814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8978160b10 0x7f897814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8978150930 con 0x7f89780cf160 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897814aab0 con 0x7f897815ce60 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897814b630 con 0x7f8978160b10 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57054/0 (socket says 172.21.15.93:57054) 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 -- 172.21.15.93:0/2352320381 learned_addr learned my addr 172.21.15.93:0/2352320381 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 -- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8978160b10 msgr2=0x7f897814bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8978160b10 0x7f897814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 -- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897815ce60 msgr2=0x7f897814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897815ce60 0x7f897814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 -- 172.21.15.93:0/2352320381 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009b30 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f897dde7640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f897400c460 tx=0x7f897400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740074e0 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974007660 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897814ad00 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.639+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974004a20 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.640+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897814b2c0 con 0x7f89780cf160 2023-11-04T01:38:59.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.640+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978074290 con 0x7f89780cf160 2023-11-04T01:38:59.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.641+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8974004b80 con 0x7f89780cf160 2023-11-04T01:38:59.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.641+0000 7f896e7fc640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 0x7f895c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.641+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f89740890a0 con 0x7f89780cf160 2023-11-04T01:38:59.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.641+0000 7f897d5e6640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 0x7f895c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.642+0000 7f897d5e6640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 0x7f895c06d330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.645+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8974053b20 con 0x7f89780cf160 2023-11-04T01:38:59.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.844+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897806b3e0 con 0x7f89780cf160 2023-11-04T01:38:59.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.845+0000 7f896e7fc640 1 -- 172.21.15.93:0/2352320381 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f8974018020 con 0x7f89780cf160 2023-11-04T01:38:59.847 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:38:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:38:43.496462+0000","modified":"2023-11-04T01:38:52.623770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6924},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6924":{"gid":6924,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6835/2732445196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":2732445196},{"type":"v1","addr":"172.21.15.125:6835","nonce":2732445196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:38:59.848 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 38 2023-11-04T01:38:59.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 msgr2=0x7f895c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 0x7f895c06d330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968008040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 msgr2=0x7f8978150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f897400c460 tx=0x7f897400c920 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 shutdown_connections 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f895c06ae70 0x7f895c06d330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8978160b10 0x7f897814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897815ce60 0x7f897814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 --2- 172.21.15.93:0/2352320381 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89780cf160 0x7f8978150b50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 >> 172.21.15.93:0/2352320381 conn(0x7f897806ea90 msgr2=0x7f89780b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 shutdown_connections 2023-11-04T01:38:59.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.847+0000 7f898004b640 1 -- 172.21.15.93:0/2352320381 wait complete. 2023-11-04T01:38:59.860 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:59.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.956+0000 7faa50a32640 1 Processor -- start 2023-11-04T01:38:59.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.956+0000 7faa50a32640 1 -- start start 2023-11-04T01:38:59.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.957+0000 7faa50a32640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faa4c0cde60 0x7faa4c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.957+0000 7faa50a32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0ce240 0x7faa4c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.957+0000 7faa50a32640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c15e000 con 0x7faa4c15daa0 2023-11-04T01:38:59.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.957+0000 7faa50a32640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c15e5c0 con 0x7faa4c0cde60 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.957+0000 7faa50a32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15e2e0 con 0x7faa4c0ce240 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faa4c0cde60 0x7faa4c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa49d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7faa4c15daa0 0x7faa4c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40514/0 (socket says 172.21.15.93:40514) 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa49d9b640 1 -- 172.21.15.93:0/2683998330 learned_addr learned my addr 172.21.15.93:0/2683998330 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4a59c640 1 -- 172.21.15.93:0/2683998330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0ce240 msgr2=0x7faa4c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4ad9d640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0ce240 0x7faa4c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4959a640 1 -- 172.21.15.93:0/2683998330 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762732032 0 0) 0x7faa4c15e000 con 0x7faa4c15daa0 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4a59c640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0ce240 0x7faa4c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4a59c640 1 -- 172.21.15.93:0/2683998330 >> v1:172.21.15.93:6789/0 conn(0x7faa4c15daa0 legacy=0x7faa4c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.958+0000 7faa4a59c640 1 -- 172.21.15.93:0/2683998330 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0d1120 con 0x7faa4c0cde60 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa4a59c640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c0cde60 0x7faa4c15d560 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5262b1ea51c7d71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa4959a640 1 -- 172.21.15.93:0/2683998330 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44031830 con 0x7faa4c0cde60 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa4959a640 1 -- 172.21.15.93:0/2683998330 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44031990 con 0x7faa4c0cde60 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa4959a640 1 -- 172.21.15.93:0/2683998330 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44031d20 con 0x7faa4c0cde60 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 -- 172.21.15.93:0/2683998330 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c0cde60 msgr2=0x7faa4c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c0cde60 0x7faa4c15d560 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 -- 172.21.15.93:0/2683998330 shutdown_connections 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0ce240 0x7faa4c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 --2- 172.21.15.93:0/2683998330 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c0cde60 0x7faa4c15d560 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 -- 172.21.15.93:0/2683998330 >> 172.21.15.93:0/2683998330 conn(0x7faa4c071f30 msgr2=0x7faa4c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 -- 172.21.15.93:0/2683998330 shutdown_connections 2023-11-04T01:38:59.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.959+0000 7faa50a32640 1 -- 172.21.15.93:0/2683998330 wait complete. 2023-11-04T01:38:59.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 Processor -- start 2023-11-04T01:38:59.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 -- start start 2023-11-04T01:38:59.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0cde60 0x7faa4c1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c0ce240 0x7faa4c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0cc8d0 con 0x7faa4c15daa0 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0cc5f0 con 0x7faa4c0ce240 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.961+0000 7faa50a32640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c156f00 con 0x7faa4c0cde60 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57064/0 (socket says 172.21.15.93:57064) 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 -- 172.21.15.93:0/713193507 learned_addr learned my addr 172.21.15.93:0/713193507 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4a59c640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0cde60 0x7faa4c1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa49d9b640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c0ce240 0x7faa4c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 -- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0cde60 msgr2=0x7faa4c1f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0cde60 0x7faa4c1f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 -- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c0ce240 msgr2=0x7faa4c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c0ce240 0x7faa4c159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 -- 172.21.15.93:0/713193507 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009400 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa4ad9d640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c7c0 tx=0x7faa3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004220 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c004380 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c1571e0 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c007840 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.962+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c1f2790 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.963+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c157700 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.964+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa3c0079a0 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.964+0000 7faa3affd640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 0x7faa2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.964+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7faa3c089860 con 0x7faa4c15daa0 2023-11-04T01:38:59.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.964+0000 7faa4a59c640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 0x7faa2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.964+0000 7faa4a59c640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 0x7faa2c06d360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa44036000 tx=0x7faa44008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:38:59.968+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa4c157700 con 0x7faa4c15daa0 2023-11-04T01:39:00.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.134+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4c157700 con 0x7faa4c15daa0 2023-11-04T01:39:00.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.135+0000 7faa3affd640 1 -- 172.21.15.93:0/713193507 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22075 (secure 0 0 0) 0x7faa4c157700 con 0x7faa4c15daa0 2023-11-04T01:39:00.138 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":83,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:38:58.214486+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:41.581505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:42.472925+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":83,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:00.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 msgr2=0x7faa2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 0x7faa2c06d360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa44036000 tx=0x7faa44008030 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 msgr2=0x7faa4c159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c7c0 tx=0x7faa3c00cc80 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 shutdown_connections 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7faa2c06aea0 0x7faa2c06d360 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa4c15daa0 0x7faa4c159c40 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa4c0ce240 0x7faa4c159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 --2- 172.21.15.93:0/713193507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7faa4c0cde60 0x7faa4c1f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 >> 172.21.15.93:0/713193507 conn(0x7faa4c071f30 msgr2=0x7faa4c0c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 shutdown_connections 2023-11-04T01:39:00.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.137+0000 7faa50a32640 1 -- 172.21.15.93:0/713193507 wait complete. 2023-11-04T01:39:00.151 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:39:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.251+0000 7f7380d39640 1 Processor -- start 2023-11-04T01:39:00.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.251+0000 7f7380d39640 1 -- start start 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f7380d39640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f737c15ad30 0x7f737c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f7380d39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c070e20 0x7f737c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f7380d39640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0c3900 con 0x7f737c0ad730 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f7380d39640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0ae260 con 0x7f737c15ad30 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f7380d39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c3be0 con 0x7f737c070e20 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f737c15ad30 0x7f737c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f737c15ad30 0x7f737c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57078/0 (socket says 172.21.15.93:57078) 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 -- 172.21.15.93:0/2092260512 learned_addr learned my addr 172.21.15.93:0/2092260512 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:00.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737ad9d640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c070e20 0x7f737c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 -- 172.21.15.93:0/2092260512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c070e20 msgr2=0x7f737c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c070e20 0x7f737c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 -- 172.21.15.93:0/2092260512 >> v1:172.21.15.125:6789/0 conn(0x7f737c0ad730 legacy=0x7f737c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.252+0000 7f737a59c640 1 -- 172.21.15.93:0/2092260512 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0c3ec0 con 0x7f737c15ad30 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f737a59c640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c15ad30 0x7f737c0adc80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f736c009870 tx=0x7f736c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184fd54fe13bf3b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7379d9b640 1 -- 172.21.15.93:0/2092260512 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c031640 con 0x7f737c15ad30 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7379d9b640 1 -- 172.21.15.93:0/2092260512 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0317a0 con 0x7f737c15ad30 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7379d9b640 1 -- 172.21.15.93:0/2092260512 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c031b30 con 0x7f737c15ad30 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 -- 172.21.15.93:0/2092260512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c15ad30 msgr2=0x7f737c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c15ad30 0x7f737c0adc80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f736c009870 tx=0x7f736c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 -- 172.21.15.93:0/2092260512 shutdown_connections 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c070e20 0x7f737c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 --2- 172.21.15.93:0/2092260512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c15ad30 0x7f737c0adc80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 -- 172.21.15.93:0/2092260512 >> 172.21.15.93:0/2092260512 conn(0x7f737c0ce950 msgr2=0x7f737c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.253+0000 7f7380d39640 1 -- 172.21.15.93:0/2092260512 shutdown_connections 2023-11-04T01:39:00.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.254+0000 7f7380d39640 1 -- 172.21.15.93:0/2092260512 wait complete. 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 Processor -- start 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 -- start start 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f737c070e20 0x7f737c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c15ad30 0x7f737c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c151b90 con 0x7f737c0ad730 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c77e0 con 0x7f737c070e20 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.255+0000 7f7380d39640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c6bf0 con 0x7f737c15ad30 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57088/0 (socket says 172.21.15.93:57088) 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 -- 172.21.15.93:0/3810698020 learned_addr learned my addr 172.21.15.93:0/3810698020 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f737ad9d640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c15ad30 0x7f737c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f737a59c640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f737c070e20 0x7f737c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 -- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c15ad30 msgr2=0x7f737c1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c15ad30 0x7f737c1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 -- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f737c070e20 msgr2=0x7f737c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f737c070e20 0x7f737c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 -- 172.21.15.93:0/3810698020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0094d0 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7373fff640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f736400c450 tx=0x7f736400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73640052d0 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364005430 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0c6eb0 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364012870 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.256+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0c7470 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.257+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c074290 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.258+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73640129d0 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.258+0000 7f7372ffd640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 0x7f735c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.258+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f73640895d0 con 0x7f737c0ad730 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.258+0000 7f737a59c640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 0x7f735c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.258+0000 7f737a59c640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 0x7f735c06d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f736c036000 tx=0x7f736c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.262+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73640540f0 con 0x7f737c0ad730 2023-11-04T01:39:00.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.462+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f737c0c7600 con 0x7f737c0ad730 2023-11-04T01:39:00.464 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:39:00.462+0000 7f76f40f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:39:00.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.464+0000 7f7372ffd640 1 -- 172.21.15.93:0/3810698020 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7364057710 con 0x7f737c0ad730 2023-11-04T01:39:00.466 INFO:teuthology.orchestra.run.smithi093.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 msgr2=0x7f735c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 0x7f735c06d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f736c036000 tx=0x7f736c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 msgr2=0x7f737c151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f736400c450 tx=0x7f736400c910 comp rx=0 tx=0).stop 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 shutdown_connections 2023-11-04T01:39:00.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f735c06ae70 0x7f735c06d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f737c15ad30 0x7f737c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f737c0ad730 0x7f737c151e70 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 --2- 172.21.15.93:0/3810698020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f737c070e20 0x7f737c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 >> 172.21.15.93:0/3810698020 conn(0x7f737c0ce950 msgr2=0x7f737c0af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 shutdown_connections 2023-11-04T01:39:00.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.467+0000 7f7380d39640 1 -- 172.21.15.93:0/3810698020 wait complete. 2023-11-04T01:39:00.470 INFO:tasks.ceph.mds.d.smithi125.stderr: -2628> 2023-11-04T01:38:49.140+0000 7febc879a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:00.480 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:39:00.500 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:39:00.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.579+0000 7f2e5aa64640 1 Processor -- start 2023-11-04T01:39:00.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.579+0000 7f2e5aa64640 1 -- start start 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e5aa64640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e540cc520 0x7f2e54070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e5aa64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e540714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e5aa64640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540c3860 con 0x7f2e54153850 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e5aa64640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540c9250 con 0x7f2e540cc520 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e5aa64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54153c30 con 0x7f2e540cc9d0 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e58800640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2e54153850 0x7f2e5415a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40528/0 (socket says 172.21.15.93:40528) 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e58800640 1 -- 172.21.15.93:0/3921125334 learned_addr learned my addr 172.21.15.93:0/3921125334 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e4bfff640 1 --2- 172.21.15.93:0/3921125334 >> v2:172.21.15.125:3300/0 conn(0x7f2e540cc520 0x7f2e54070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.580+0000 7f2e59001640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e540714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4b7fe640 1 -- 172.21.15.93:0/3921125334 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073829890 0 0) 0x7f2e540c3860 con 0x7f2e54153850 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4b7fe640 1 -- 172.21.15.93:0/3921125334 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c003520 con 0x7f2e54153850 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4bfff640 1 -- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 msgr2=0x7f2e540714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4bfff640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e540714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4bfff640 1 -- 172.21.15.93:0/3921125334 >> v1:172.21.15.93:6789/0 conn(0x7f2e54153850 legacy=0x7f2e5415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.581+0000 7f2e4bfff640 1 -- 172.21.15.93:0/3921125334 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540ce590 con 0x7f2e540cc520 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e4bfff640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e54070fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097a0 tx=0x7f2e4402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7c6da8b0153aa97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e4b7fe640 1 -- 172.21.15.93:0/3921125334 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44031830 con 0x7f2e540cc520 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e4b7fe640 1 -- 172.21.15.93:0/3921125334 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44031990 con 0x7f2e540cc520 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e4b7fe640 1 -- 172.21.15.93:0/3921125334 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44031d20 con 0x7f2e540cc520 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 -- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 msgr2=0x7f2e54070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e54070fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097a0 tx=0x7f2e4402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 -- 172.21.15.93:0/3921125334 shutdown_connections 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e540714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/3921125334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e54070fa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 -- 172.21.15.93:0/3921125334 >> 172.21.15.93:0/3921125334 conn(0x7f2e540ce950 msgr2=0x7f2e540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 -- 172.21.15.93:0/3921125334 shutdown_connections 2023-11-04T01:39:00.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.582+0000 7f2e5aa64640 1 -- 172.21.15.93:0/3921125334 wait complete. 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 Processor -- start 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 -- start start 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e5414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e54152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540ab8d0 con 0x7f2e54153850 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540abbb0 con 0x7f2e540cc520 2023-11-04T01:39:00.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.584+0000 7f2e5aa64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540abe90 con 0x7f2e540cc9d0 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57094/0 (socket says 172.21.15.93:57094) 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 -- 172.21.15.93:0/2881399055 learned_addr learned my addr 172.21.15.93:0/2881399055 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e58800640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e5414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e4bfff640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e54152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 -- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 msgr2=0x7f2e54152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e54152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 -- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 msgr2=0x7f2e5414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e5414dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 -- 172.21.15.93:0/2881399055 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009400 con 0x7f2e54153850 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e59001640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00efc0 tx=0x7f2e4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c009ca0 con 0x7f2e54153850 2023-11-04T01:39:00.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00f040 con 0x7f2e54153850 2023-11-04T01:39:00.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540ac170 con 0x7f2e54153850 2023-11-04T01:39:00.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0146c0 con 0x7f2e54153850 2023-11-04T01:39:00.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.585+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e540ac730 con 0x7f2e54153850 2023-11-04T01:39:00.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.586+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54074290 con 0x7f2e54153850 2023-11-04T01:39:00.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.586+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e4c014820 con 0x7f2e54153850 2023-11-04T01:39:00.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.587+0000 7f2e497fa640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 0x7f2e4006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:00.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.587+0000 7f2e58800640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 0x7f2e4006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:00.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.587+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f2e4c08aa60 con 0x7f2e54153850 2023-11-04T01:39:00.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.587+0000 7f2e58800640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 0x7f2e4006d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005880 tx=0x7f2e50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.591+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e4c0555e0 con 0x7f2e54153850 2023-11-04T01:39:00.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:00.792+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e54156c00 con 0x7f2e54153850 2023-11-04T01:39:01.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.465+0000 7f2e497fa640 1 -- 172.21.15.93:0/2881399055 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e4c058c00 con 0x7f2e54153850 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.467+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 msgr2=0x7f2e4006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.467+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 0x7f2e4006d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005880 tx=0x7f2e50009040 comp rx=0 tx=0).stop 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.467+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 msgr2=0x7f2e54165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.467+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00efc0 tx=0x7f2e4c00c490 comp rx=0 tx=0).stop 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 shutdown_connections 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2e4006aea0 0x7f2e4006d360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2e54153850 0x7f2e54165120 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2e540cc9d0 0x7f2e54152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 --2- 172.21.15.93:0/2881399055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e540cc520 0x7f2e5414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 >> 172.21.15.93:0/2881399055 conn(0x7f2e540ce950 msgr2=0x7f2e54071100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 shutdown_connections 2023-11-04T01:39:01.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.468+0000 7f2e5aa64640 1 -- 172.21.15.93:0/2881399055 wait complete. 2023-11-04T01:39:01.481 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:39:01.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.586+0000 7fa8492a2640 1 Processor -- start 2023-11-04T01:39:01.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.586+0000 7fa8492a2640 1 -- start start 2023-11-04T01:39:01.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8492a2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa84415d4b0 0x7fa84415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8492a2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa8440d17b0 0x7fa8440d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8492a2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440d1320 con 0x7fa8440cd9f0 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8492a2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84415e4d0 con 0x7fa8440d17b0 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8492a2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84415df10 con 0x7fa84415d4b0 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa8440d17b0 0x7fa8440d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa8440d17b0 0x7fa8440d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43170/0 (socket says 172.21.15.93:43170) 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa842ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa8440cd9f0 0x7fa8440cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59454/0 (socket says 172.21.15.93:59454) 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 -- 172.21.15.93:0/3550160791 learned_addr learned my addr 172.21.15.93:0/3550160791 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8427fc640 1 --2- 172.21.15.93:0/3550160791 >> v2:172.21.15.125:3300/0 conn(0x7fa84415d4b0 0x7fa84415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 -- 172.21.15.93:0/3550160791 >> v2:172.21.15.125:3300/0 conn(0x7fa84415d4b0 msgr2=0x7fa84415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 --2- 172.21.15.93:0/3550160791 >> v2:172.21.15.125:3300/0 conn(0x7fa84415d4b0 0x7fa84415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 -- 172.21.15.93:0/3550160791 >> v1:172.21.15.93:6789/0 conn(0x7fa8440cd9f0 legacy=0x7fa8440cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.587+0000 7fa8437fe640 1 -- 172.21.15.93:0/3550160791 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84415e1f0 con 0x7fa8440d17b0 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.588+0000 7fa8437fe640 1 --2- 172.21.15.93:0/3550160791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440d1c60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009870 tx=0x7fa83c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51be0d41e1b9f586 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.588+0000 7fa841ffb640 1 -- 172.21.15.93:0/3550160791 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02f840 con 0x7fa8440d17b0 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.588+0000 7fa841ffb640 1 -- 172.21.15.93:0/3550160791 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c02f9a0 con 0x7fa8440d17b0 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.588+0000 7fa841ffb640 1 -- 172.21.15.93:0/3550160791 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02fd30 con 0x7fa8440d17b0 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 -- 172.21.15.93:0/3550160791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 msgr2=0x7fa8440d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 --2- 172.21.15.93:0/3550160791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440d1c60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009870 tx=0x7fa83c02ba20 comp rx=0 tx=0).stop 2023-11-04T01:39:01.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 -- 172.21.15.93:0/3550160791 shutdown_connections 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 --2- 172.21.15.93:0/3550160791 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440d1c60 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 --2- 172.21.15.93:0/3550160791 >> v2:172.21.15.125:3300/0 conn(0x7fa84415d4b0 0x7fa84415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 -- 172.21.15.93:0/3550160791 >> 172.21.15.93:0/3550160791 conn(0x7fa844071c40 msgr2=0x7fa844072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 -- 172.21.15.93:0/3550160791 shutdown_connections 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.589+0000 7fa8492a2640 1 -- 172.21.15.93:0/3550160791 wait complete. 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.590+0000 7fa8492a2640 1 Processor -- start 2023-11-04T01:39:01.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.590+0000 7fa8492a2640 1 -- start start 2023-11-04T01:39:01.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 0x7fa8440c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa84415d4b0 0x7fa844156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440cb400 con 0x7fa8440d17b0 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440c8e20 con 0x7fa8440cd9f0 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440ca7f0 con 0x7fa84415d4b0 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43180/0 (socket says 172.21.15.93:43180) 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 -- 172.21.15.93:0/34511089 learned_addr learned my addr 172.21.15.93:0/34511089 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa842ffd640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 0x7fa8440c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 -- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa84415d4b0 msgr2=0x7fa844156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa84415d4b0 0x7fa844156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 -- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 msgr2=0x7fa8440c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 0x7fa8440c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 -- 172.21.15.93:0/34511089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0094d0 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa842ffd640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 0x7fa8440c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8427fc640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c820 tx=0x7fa83800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838004020 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838004180 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8440caad0 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838007830 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.591+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8440cb090 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.592+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84415cf80 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.593+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa838007990 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.593+0000 7fa82b7fe640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.593+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7206+0+0 (secure 0 0 0) 0x7fa8380898e0 con 0x7fa8440d17b0 2023-11-04T01:39:01.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.593+0000 7fa842ffd640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.594+0000 7fa842ffd640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 0x7fa83006d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa834007fd0 tx=0x7fa834009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.597+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8380543b0 con 0x7fa8440d17b0 2023-11-04T01:39:01.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:01.766+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa84404e490 con 0x7fa8440d17b0 2023-11-04T01:39:02.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.469+0000 7fa82b7fe640 1 -- 172.21.15.93:0/34511089 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa8380579d0 con 0x7fa8440d17b0 2023-11-04T01:39:02.471 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:39:02.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 msgr2=0x7fa83006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 0x7fa83006d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa834007fd0 tx=0x7fa834009040 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 msgr2=0x7fa8440c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c820 tx=0x7fa83800cce0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 shutdown_connections 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa84415d4b0 0x7fa844156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8440d17b0 0x7fa8440c9da0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 --2- 172.21.15.93:0/34511089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8440cd9f0 0x7fa8440c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 >> 172.21.15.93:0/34511089 conn(0x7fa844071c40 msgr2=0x7fa8440ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 shutdown_connections 2023-11-04T01:39:02.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.471+0000 7fa8492a2640 1 -- 172.21.15.93:0/34511089 wait complete. 2023-11-04T01:39:02.491 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:39:02.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.597+0000 7fba040f2640 1 Processor -- start 2023-11-04T01:39:02.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.597+0000 7fba040f2640 1 -- start start 2023-11-04T01:39:02.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.597+0000 7fba040f2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb9fc0cd360 0x7fb9fc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba040f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc06f4a0 0x7fb9fc0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba040f2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc06ed30 con 0x7fb9fc0cd740 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba040f2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b5250 con 0x7fb9fc0cd360 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba040f2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc06f260 con 0x7fb9fc06f4a0 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb9fc0cd360 0x7fb9fc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb9fc0cd360 0x7fb9fc0b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43186/0 (socket says 172.21.15.93:43186) 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 -- 172.21.15.93:0/2831080068 learned_addr learned my addr 172.21.15.93:0/2831080068 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 -- 172.21.15.93:0/2831080068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc06f4a0 msgr2=0x7fb9fc0b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba0168d640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc06f4a0 0x7fb9fc0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc06f4a0 0x7fb9fc0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 -- 172.21.15.93:0/2831080068 >> v1:172.21.15.125:6789/0 conn(0x7fb9fc0cd740 legacy=0x7fb9fc06ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.598+0000 7fba01e8e640 1 -- 172.21.15.93:0/2831080068 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc06a8a0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba01e8e640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc0b2470 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208c8317cfb38ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba00e8c640 1 -- 172.21.15.93:0/2831080068 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8030840 con 0x7fb9fc0cd360 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba00e8c640 1 -- 172.21.15.93:0/2831080068 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f80309a0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba00e8c640 1 -- 172.21.15.93:0/2831080068 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8030d30 con 0x7fb9fc0cd360 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 -- 172.21.15.93:0/2831080068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 msgr2=0x7fb9fc0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc0b2470 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f802b980 comp rx=0 tx=0).stop 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 -- 172.21.15.93:0/2831080068 shutdown_connections 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc06f4a0 0x7fb9fc0b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 --2- 172.21.15.93:0/2831080068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc0b2470 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.599+0000 7fba040f2640 1 -- 172.21.15.93:0/2831080068 >> 172.21.15.93:0/2831080068 conn(0x7fb9fc0b0ce0 msgr2=0x7fb9fc0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.600+0000 7fba040f2640 1 -- 172.21.15.93:0/2831080068 shutdown_connections 2023-11-04T01:39:02.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.600+0000 7fba040f2640 1 -- 172.21.15.93:0/2831080068 wait complete. 2023-11-04T01:39:02.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 Processor -- start 2023-11-04T01:39:02.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 -- start start 2023-11-04T01:39:02.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9fc06f4a0 0x7fb9fc0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc0cd740 0x7fb9fc0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1e3a60 con 0x7fb9fc0cd360 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0c3bc0 con 0x7fb9fc06f4a0 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba040f2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1e3410 con 0x7fb9fc0cd740 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba0168d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.601+0000 7fba0168d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43204/0 (socket says 172.21.15.93:43204) 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 -- 172.21.15.93:0/2710714629 learned_addr learned my addr 172.21.15.93:0/2710714629 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba01e8e640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9fc06f4a0 0x7fb9fc0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0268f640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc0cd740 0x7fb9fc0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 -- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc0cd740 msgr2=0x7fb9fc0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc0cd740 0x7fb9fc0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 -- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9fc06f4a0 msgr2=0x7fb9fc0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9fc06f4a0 0x7fb9fc0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 -- 172.21.15.93:0/2710714629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80094d0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba0168d640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c7f0 tx=0x7fb9ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec004230 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec004390 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc1e36f0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec007860 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.602+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0c5770 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.603+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc04e490 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.603+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9ec0079c0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.604+0000 7fb9f27fc640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 0x7fb9e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.604+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6768+0+0 (secure 0 0 0) 0x7fb9ec089860 con 0x7fb9fc0cd360 2023-11-04T01:39:02.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.604+0000 7fba01e8e640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 0x7fb9e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.604+0000 7fba01e8e640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 0x7fb9e006d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.608+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9ec0544f0 con 0x7fb9fc0cd360 2023-11-04T01:39:02.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:02.776+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9fc0b1910 con 0x7fb9fc0cd360 2023-11-04T01:39:03.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.470+0000 7fb9f27fc640 1 -- 172.21.15.93:0/2710714629 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9ec01e0d0 con 0x7fb9fc0cd360 2023-11-04T01:39:03.473 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' removed 2023-11-04T01:39:03.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 msgr2=0x7fb9e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 0x7fb9e006d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803b040 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 msgr2=0x7fb9fc1e3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c7f0 tx=0x7fb9ec00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 shutdown_connections 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb9e006ae70 0x7fb9e006d330 secure :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803b040 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb9fc0cd740 0x7fb9fc0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9fc0cd360 0x7fb9fc1e3ef0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 --2- 172.21.15.93:0/2710714629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9fc06f4a0 0x7fb9fc0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.473+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 >> 172.21.15.93:0/2710714629 conn(0x7fb9fc0b0ce0 msgr2=0x7fb9fc0c62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.474+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 shutdown_connections 2023-11-04T01:39:03.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.474+0000 7fba040f2640 1 -- 172.21.15.93:0/2710714629 wait complete. 2023-11-04T01:39:03.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:39:03.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.597+0000 7f8324039640 1 Processor -- start 2023-11-04T01:39:03.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.597+0000 7f8324039640 1 -- start start 2023-11-04T01:39:03.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8324039640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f831c0c4ff0 0x7f831c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8324039640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8324039640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c15aff0 con 0x7f831c159c00 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8324039640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0ae460 con 0x7f831c0c4ff0 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8324039640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c15a3e0 con 0x7f831c0adac0 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f831c0c4ff0 0x7f831c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8321dd5640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f831c159c00 0x7f831c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59464/0 (socket says 172.21.15.93:59464) 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f831c0c4ff0 0x7f831c0cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43216/0 (socket says 172.21.15.93:43216) 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8321dd5640 1 -- 172.21.15.93:0/3693141709 learned_addr learned my addr 172.21.15.93:0/3693141709 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83225d6640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 -- 172.21.15.93:0/3693141709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 msgr2=0x7f831c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 -- 172.21.15.93:0/3693141709 >> v1:172.21.15.93:6789/0 conn(0x7f831c159c00 legacy=0x7f831c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83215d4640 1 -- 172.21.15.93:0/3693141709 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c15a6c0 con 0x7f831c0c4ff0 2023-11-04T01:39:03.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f8320dd3640 1 -- 172.21.15.93:0/3693141709 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290849969 0 0) 0x7f831c15aff0 con 0x7f831c159c00 2023-11-04T01:39:03.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.598+0000 7f83225d6640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f83215d4640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c0cc890 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f830c0097a0 tx=0x7f830c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29069a5c3ce65ff9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f8320dd3640 1 -- 172.21.15.93:0/3693141709 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c02d040 con 0x7f831c0c4ff0 2023-11-04T01:39:03.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f8320dd3640 1 -- 172.21.15.93:0/3693141709 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c031810 con 0x7f831c0c4ff0 2023-11-04T01:39:03.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f8320dd3640 1 -- 172.21.15.93:0/3693141709 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c031ba0 con 0x7f831c0c4ff0 2023-11-04T01:39:03.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f8324039640 1 -- 172.21.15.93:0/3693141709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 msgr2=0x7f831c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.599+0000 7f8324039640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c0cc890 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f830c0097a0 tx=0x7f830c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 -- 172.21.15.93:0/3693141709 shutdown_connections 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 --2- 172.21.15.93:0/3693141709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c0cc890 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 -- 172.21.15.93:0/3693141709 >> 172.21.15.93:0/3693141709 conn(0x7f831c0ce950 msgr2=0x7f831c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 -- 172.21.15.93:0/3693141709 shutdown_connections 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.600+0000 7f8324039640 1 -- 172.21.15.93:0/3693141709 wait complete. 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 Processor -- start 2023-11-04T01:39:03.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 -- start start 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c159c00 0x7f831c0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.601+0000 7f8324039640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ad250 con 0x7f831c0c4ff0 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f8324039640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1e3c90 con 0x7f831c159c00 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f8324039640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1e3f70 con 0x7f831c0adac0 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43222/0 (socket says 172.21.15.93:43222) 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 -- 172.21.15.93:0/1924184151 learned_addr learned my addr 172.21.15.93:0/1924184151 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f8321dd5640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83225d6640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c159c00 0x7f831c0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 -- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 msgr2=0x7f831c0acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 -- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c159c00 msgr2=0x7f831c0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c159c00 0x7f831c0c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 -- 172.21.15.93:0/1924184151 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009400 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83215d4640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f830c0098c0 tx=0x7f830c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c03ad60 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c044400 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c1e4250 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0447b0 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.602+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1e4f90 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.603+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c074290 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.604+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f830c04d440 con 0x7f831c0c4ff0 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.604+0000 7f83127fc640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 0x7f830006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.604+0000 7f8321dd5640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 0x7f830006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.604+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f830c0abd60 con 0x7f831c0c4ff0 2023-11-04T01:39:03.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.605+0000 7f8321dd5640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 0x7f830006d360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8318000f60 tx=0x7f8318007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.608+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f830c076b80 con 0x7f831c0c4ff0 2023-11-04T01:39:03.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.773+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f831c0cd6a0 con 0x7f831c0c4ff0 2023-11-04T01:39:03.778 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.776+0000 7f83127fc640 1 -- 172.21.15.93:0/1924184151 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f830c07a1a0 con 0x7f831c0c4ff0 2023-11-04T01:39:03.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 msgr2=0x7f830006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 0x7f830006d360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8318000f60 tx=0x7f8318007c00 comp rx=0 tx=0).stop 2023-11-04T01:39:03.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 msgr2=0x7f831c1e4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.780 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f830c0098c0 tx=0x7f830c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 shutdown_connections 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f830006aea0 0x7f830006d360 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831c159c00 0x7f831c0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f831c0c4ff0 0x7f831c1e4a50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 --2- 172.21.15.93:0/1924184151 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f831c0adac0 0x7f831c0acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 >> 172.21.15.93:0/1924184151 conn(0x7f831c0ce950 msgr2=0x7f831c0c4730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 shutdown_connections 2023-11-04T01:39:03.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.778+0000 7f8324039640 1 -- 172.21.15.93:0/1924184151 wait complete. 2023-11-04T01:39:03.791 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:39:03.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.887+0000 7fc115f0f640 1 Processor -- start 2023-11-04T01:39:03.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.887+0000 7fc115f0f640 1 -- start start 2023-11-04T01:39:03.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc115f0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc1100ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc115f0f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1100b0cd0 0x7fc110070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc115f0f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100cc990 con 0x7fc1100cace0 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc115f0f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100ccc70 con 0x7fc1100b0cd0 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc115f0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c9ce0 con 0x7fc1100cda60 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1100b0cd0 0x7fc110070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc1100b0cd0 0x7fc110070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43224/0 (socket says 172.21.15.93:43224) 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 -- 172.21.15.93:0/721889938 learned_addr learned my addr 172.21.15.93:0/721889938 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc1100ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 -- 172.21.15.93:0/721889938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 msgr2=0x7fc1100ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc1100ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 -- 172.21.15.93:0/721889938 >> v1:172.21.15.125:6789/0 conn(0x7fc1100cace0 legacy=0x7fc11006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10effd640 1 -- 172.21.15.93:0/721889938 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100c9fc0 con 0x7fc1100b0cd0 2023-11-04T01:39:03.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.888+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc1100ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.889+0000 7fc10effd640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100b0cd0 0x7fc110070630 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475fbd2d1f7c05d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.889+0000 7fc10e7fc640 1 -- 172.21.15.93:0/721889938 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104031640 con 0x7fc1100b0cd0 2023-11-04T01:39:03.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.889+0000 7fc10e7fc640 1 -- 172.21.15.93:0/721889938 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1040317a0 con 0x7fc1100b0cd0 2023-11-04T01:39:03.893 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.889+0000 7fc10e7fc640 1 -- 172.21.15.93:0/721889938 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104031b30 con 0x7fc1100b0cd0 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 -- 172.21.15.93:0/721889938 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100b0cd0 msgr2=0x7fc110070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100b0cd0 0x7fc110070630 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 -- 172.21.15.93:0/721889938 shutdown_connections 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100b0cd0 0x7fc110070630 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 --2- 172.21.15.93:0/721889938 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc1100ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 -- 172.21.15.93:0/721889938 >> 172.21.15.93:0/721889938 conn(0x7fc1100ce950 msgr2=0x7fc1100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 -- 172.21.15.93:0/721889938 shutdown_connections 2023-11-04T01:39:03.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.890+0000 7fc115f0f640 1 -- 172.21.15.93:0/721889938 wait complete. 2023-11-04T01:39:03.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.891+0000 7fc115f0f640 1 Processor -- start 2023-11-04T01:39:03.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.891+0000 7fc115f0f640 1 -- start start 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 0x7fc1100b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc110150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b3290 con 0x7fc1100cace0 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110151190 con 0x7fc1100b0cd0 2023-11-04T01:39:03.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc115f0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b2610 con 0x7fc1100cda60 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43240/0 (socket says 172.21.15.93:43240) 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 -- 172.21.15.93:0/3989515081 learned_addr learned my addr 172.21.15.93:0/3989515081 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 0x7fc1100b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 -- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 msgr2=0x7fc110150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10ffff640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc110150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc110150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 -- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 msgr2=0x7fc1100b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 0x7fc1100b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10effd640 1 -- 172.21.15.93:0/3989515081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040094d0 con 0x7fc1100cace0 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 0x7fc1100b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.892+0000 7fc10ffff640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc110150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc10effd640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc104000c00 tx=0x7fc1040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10403ac60 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10403ade0 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100b28f0 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104044630 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.893+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1100b2eb0 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.894+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1100b33d0 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.894+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc10402f050 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.894+0000 7fc0f7fff640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 0x7fc0fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.895+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fc1040aba20 con 0x7fc1100cace0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.895+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 0x7fc0fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.895+0000 7fc10f7fe640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 0x7fc0fc06d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc100006fd0 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:03.899+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1100b33d0 con 0x7fc1100cace0 2023-11-04T01:39:04.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.130+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7fc1100b33d0 con 0x7fc1100cace0 2023-11-04T01:39:04.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.472+0000 7fc0f7fff640 1 -- 172.21.15.93:0/3989515081 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v206) v1 ==== 148+0+0 (secure 0 0 0) 0x7fc1100b33d0 con 0x7fc1100cace0 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 msgr2=0x7fc0fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 0x7fc0fc06d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc100006fd0 tx=0x7fc100008040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 msgr2=0x7fc11014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc104000c00 tx=0x7fc1040046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 shutdown_connections 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc0fc06ae70 0x7fc0fc06d330 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc1100cda60 0x7fc110150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1100cace0 0x7fc11014dbb0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 --2- 172.21.15.93:0/3989515081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1100b0cd0 0x7fc1100b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 >> 172.21.15.93:0/3989515081 conn(0x7fc1100ce950 msgr2=0x7fc1100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 shutdown_connections 2023-11-04T01:39:04.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.476+0000 7fc115f0f640 1 -- 172.21.15.93:0/3989515081 wait complete. 2023-11-04T01:39:04.489 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:39:04.489 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:39:04.490 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:39:04.490 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:04.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.587+0000 7f67e1ab4640 1 Processor -- start 2023-11-04T01:39:04.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.587+0000 7f67e1ab4640 1 -- start start 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67e1ab4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc06a830 0x7f67dc0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67e1ab4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67dc0b18b0 0x7f67dc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67e1ab4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc15e6e0 con 0x7f67dc0cce10 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67e1ab4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc15dd10 con 0x7f67dc0b18b0 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67e1ab4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc15d720 con 0x7f67dc06a830 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67dbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67dc0b18b0 0x7f67dc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67db7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f67dc0cce10 0x7f67dc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59476/0 (socket says 172.21.15.93:59476) 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.588+0000 7f67db7fe640 1 -- 172.21.15.93:0/536995345 learned_addr learned my addr 172.21.15.93:0/536995345 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67dbfff640 1 -- 172.21.15.93:0/536995345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc06a830 msgr2=0x7f67dc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67dbfff640 1 --2- 172.21.15.93:0/536995345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc06a830 0x7f67dc0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67dbfff640 1 -- 172.21.15.93:0/536995345 >> v1:172.21.15.93:6789/0 conn(0x7f67dc0cce10 legacy=0x7f67dc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67daffd640 1 -- 172.21.15.93:0/536995345 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475586204 0 0) 0x7f67cc001110 con 0x7f67dc0cce10 2023-11-04T01:39:04.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67dbfff640 1 -- 172.21.15.93:0/536995345 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc06fe00 con 0x7f67dc0b18b0 2023-11-04T01:39:04.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67dbfff640 1 --2- 172.21.15.93:0/536995345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc0b18b0 0x7f67dc15e1a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009d90 tx=0x7f67d402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47c63d4f30e349b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.589+0000 7f67daffd640 1 -- 172.21.15.93:0/536995345 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d402cb30 con 0x7f67dc0b18b0 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67daffd640 1 -- 172.21.15.93:0/536995345 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d402cc90 con 0x7f67dc0b18b0 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67daffd640 1 -- 172.21.15.93:0/536995345 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4034440 con 0x7f67dc0b18b0 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 -- 172.21.15.93:0/536995345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc0b18b0 msgr2=0x7f67dc15e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/536995345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc0b18b0 0x7f67dc15e1a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009d90 tx=0x7f67d402bd80 comp rx=0 tx=0).stop 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 -- 172.21.15.93:0/536995345 shutdown_connections 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/536995345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc0b18b0 0x7f67dc15e1a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/536995345 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc06a830 0x7f67dc0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 -- 172.21.15.93:0/536995345 >> 172.21.15.93:0/536995345 conn(0x7f67dc06d8b0 msgr2=0x7f67dc06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 -- 172.21.15.93:0/536995345 shutdown_connections 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.590+0000 7f67e1ab4640 1 -- 172.21.15.93:0/536995345 wait complete. 2023-11-04T01:39:04.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.591+0000 7f67e1ab4640 1 Processor -- start 2023-11-04T01:39:04.595 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.591+0000 7f67e1ab4640 1 -- start start 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 0x7f67dc1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 0x7f67dc1e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c4f20 con 0x7f67dc06a830 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c5200 con 0x7f67dc0cce10 2023-11-04T01:39:04.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67e1ab4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c54e0 con 0x7f67dc0b18b0 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43258/0 (socket says 172.21.15.93:43258) 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 -- 172.21.15.93:0/4027627331 learned_addr learned my addr 172.21.15.93:0/4027627331 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67d2ffd640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 0x7f67dc1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67dbfff640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 0x7f67dc1e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 -- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 msgr2=0x7f67dc1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 0x7f67dc1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 -- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 msgr2=0x7f67dc1e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 0x7f67dc1e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67db7fe640 1 -- 172.21.15.93:0/4027627331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009a70 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67dbfff640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 0x7f67dc1e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.592+0000 7f67d2ffd640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 0x7f67dc1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67db7fe640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00c430 tx=0x7f67cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0074e0 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc007660 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc0c57c0 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc004a20 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.593+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0c5d80 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.594+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0c5fa0 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.594+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67cc004b80 con 0x7f67dc06a830 2023-11-04T01:39:04.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.594+0000 7f67d8ff9640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 0x7f67bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.595+0000 7f67d2ffd640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 0x7f67bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.595+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f67cc089550 con 0x7f67dc06a830 2023-11-04T01:39:04.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.595+0000 7f67d2ffd640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 0x7f67bc06d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0cea60 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.599+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67cc054370 con 0x7f67dc06a830 2023-11-04T01:39:04.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.766+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67dc15e6e0 con 0x7f67dc06a830 2023-11-04T01:39:04.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.767+0000 7f67d8ff9640 1 -- 172.21.15.93:0/4027627331 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f67dc15e6e0 con 0x7f67dc06a830 2023-11-04T01:39:04.769 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:04.769 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":86,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:39:03.470203+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6835/2732445196":"2023-11-05T01:39:00.463830+0000","172.21.15.125:6833/2732445196":"2023-11-05T01:39:00.463830+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:04.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 msgr2=0x7f67bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 0x7f67bc06d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0cea60 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 msgr2=0x7f67dc0c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00c430 tx=0x7f67cc00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 shutdown_connections 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67bc06ae70 0x7f67bc06d330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67dc0cce10 0x7f67dc1e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67dc0b18b0 0x7f67dc1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 --2- 172.21.15.93:0/4027627331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67dc06a830 0x7f67dc0c3ed0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 >> 172.21.15.93:0/4027627331 conn(0x7f67dc06d8b0 msgr2=0x7f67dc0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 shutdown_connections 2023-11-04T01:39:04.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.769+0000 7f67e1ab4640 1 -- 172.21.15.93:0/4027627331 wait complete. 2023-11-04T01:39:04.782 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:04.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:04.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.883+0000 7f74e220e640 1 Processor -- start 2023-11-04T01:39:04.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.883+0000 7f74e220e640 1 -- start start 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74e220e640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f74dc15e430 0x7f74dc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74e220e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc0d0280 con 0x7f74dc0d0710 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74e220e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc0cf670 con 0x7f74dc0cf160 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74e220e640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0cf950 con 0x7f74dc15e430 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74dbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f74dc0d0710 0x7f74dc0b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59484/0 (socket says 172.21.15.93:59484) 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74dbfff640 1 -- 172.21.15.93:0/3355135572 learned_addr learned my addr 172.21.15.93:0/3355135572 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139201001 0 0) 0x7f74dc0d0280 con 0x7f74dc0d0710 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c4003520 con 0x7f74dc0d0710 2023-11-04T01:39:04.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74db7fe640 1 --2- 172.21.15.93:0/3355135572 >> v2:172.21.15.125:3300/0 conn(0x7f74dc15e430 0x7f74dc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619916609 0 0) 0x7f74c4003520 con 0x7f74dc0d0710 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 >> v2:172.21.15.125:3300/0 conn(0x7f74dc15e430 msgr2=0x7f74dc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 --2- 172.21.15.93:0/3355135572 >> v2:172.21.15.125:3300/0 conn(0x7f74dc15e430 0x7f74dc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 >> v1:172.21.15.125:6789/0 conn(0x7f74dc0cf160 legacy=0x7f74dc0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0cfc30 con 0x7f74dc0d0710 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f74d40019f0 con 0x7f74dc0d0710 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.884+0000 7f74db7fe640 1 --2- 172.21.15.93:0/3355135572 >> v2:172.21.15.125:3300/0 conn(0x7f74dc15e430 0x7f74dc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 >> v1:172.21.15.93:6789/0 conn(0x7f74dc0d0710 legacy=0x7f74dc0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74c4003970 0x7f74c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 0x7f74c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c4005180 0x7f74c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0cf950 con 0x7f74c40047c0 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c400c0d0 con 0x7f74c4005180 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c400c290 con 0x7f74c4003970 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 0x7f74c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74db7fe640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74c4003970 0x7f74c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74dbfff640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c4005180 0x7f74c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 -- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74c4003970 msgr2=0x7f74c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74c4003970 0x7f74c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 -- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c4005180 msgr2=0x7f74c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c4005180 0x7f74c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74daffd640 1 -- 172.21.15.93:0/3355135572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4003520 con 0x7f74c40047c0 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74dbfff640 1 -- 172.21.15.93:0/3355135572 reap_dead start 2023-11-04T01:39:04.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.885+0000 7f74db7fe640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74c4003970 0x7f74c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74daffd640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 0x7f74c4004c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f74d0001750 tx=0x7f74c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6768bafe7c58eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d00052d0 con 0x7f74c40047c0 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d002e050 con 0x7f74c40047c0 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74da7fc640 1 -- 172.21.15.93:0/3355135572 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003830 con 0x7f74c40047c0 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 -- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 msgr2=0x7f74c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 0x7f74c4004c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f74d0001750 tx=0x7f74c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 -- 172.21.15.93:0/3355135572 shutdown_connections 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 --2- 172.21.15.93:0/3355135572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74c40047c0 0x7f74c4004c40 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 -- 172.21.15.93:0/3355135572 >> 172.21.15.93:0/3355135572 conn(0x7f74dc06ea20 msgr2=0x7f74dc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 -- 172.21.15.93:0/3355135572 shutdown_connections 2023-11-04T01:39:04.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.886+0000 7f74e220e640 1 -- 172.21.15.93:0/3355135572 wait complete. 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.887+0000 7f74e220e640 1 Processor -- start 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 -- start start 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c40047c0 0x7f74dc155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 0x7f74dc1f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0cca70 con 0x7f74dc146ee0 2023-11-04T01:39:04.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1f6e70 con 0x7f74c40047c0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74e220e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc151b50 con 0x7f74dc0cc5f0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74daffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74daffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43280/0 (socket says 172.21.15.93:43280) 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.888+0000 7f74daffd640 1 -- 172.21.15.93:0/2558032143 learned_addr learned my addr 172.21.15.93:0/2558032143 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74db7fe640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c40047c0 0x7f74dc155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74dbfff640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 0x7f74dc1f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 -- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 msgr2=0x7f74dc1f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 0x7f74dc1f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 -- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c40047c0 msgr2=0x7f74dc155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c40047c0 0x7f74dc155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 -- 172.21.15.93:0/2558032143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc1f2850 con 0x7f74dc146ee0 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74dbfff640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 0x7f74dc1f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:04.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74daffd640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034040 tx=0x7f74d0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0007a30 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d00069e0 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0006d70 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc1f6b90 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.889+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc1466e0 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.890+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc0cc9d0 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.891+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74d00035f0 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.891+0000 7f74c3fff640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 0x7f74c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.891+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f74d00ab8f0 con 0x7f74dc146ee0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.891+0000 7f74db7fe640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 0x7f74c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.891+0000 7f74db7fe640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 0x7f74c806d360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0687c0 tx=0x7f74cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:04.895+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74d00767a0 con 0x7f74dc146ee0 2023-11-04T01:39:05.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.061+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74dc074290 con 0x7f74dc146ee0 2023-11-04T01:39:05.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.061+0000 7f74c3fff640 1 -- 172.21.15.93:0/2558032143 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74d0079dc0 con 0x7f74dc146ee0 2023-11-04T01:39:05.064 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:39:05.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 msgr2=0x7f74c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 0x7f74c806d360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0687c0 tx=0x7f74cc008040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 msgr2=0x7f74dc0cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f74d0034040 tx=0x7f74d0001120 comp rx=0 tx=0).stop 2023-11-04T01:39:05.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 shutdown_connections 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f74c806aea0 0x7f74c806d360 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f74dc0cc5f0 0x7f74dc1f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74dc146ee0 0x7f74dc0cc0b0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 --2- 172.21.15.93:0/2558032143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74c40047c0 0x7f74dc155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 >> 172.21.15.93:0/2558032143 conn(0x7f74dc06ea20 msgr2=0x7f74dc0c4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 shutdown_connections 2023-11-04T01:39:05.067 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.063+0000 7f74e220e640 1 -- 172.21.15.93:0/2558032143 wait complete. 2023-11-04T01:39:05.076 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:05.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.176+0000 7f8a6754c640 1 Processor -- start 2023-11-04T01:39:05.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.176+0000 7f8a6754c640 1 -- start start 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a6754c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a60159c00 0x7f8a600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a6754c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 0x7f8a600c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a6754c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6015aff0 con 0x7f8a600adac0 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a6754c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600c52d0 con 0x7f8a60159c00 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a6754c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6015a3e0 con 0x7f8a600c48e0 2023-11-04T01:39:05.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a60159c00 0x7f8a600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a60159c00 0x7f8a600cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43292/0 (socket says 172.21.15.93:43292) 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 -- 172.21.15.93:0/3833251107 learned_addr learned my addr 172.21.15.93:0/3833251107 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a64ae7640 1 --2- 172.21.15.93:0/3833251107 >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 0x7f8a600c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 -- 172.21.15.93:0/3833251107 >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 msgr2=0x7f8a600c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 --2- 172.21.15.93:0/3833251107 >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 0x7f8a600c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 -- 172.21.15.93:0/3833251107 >> v1:172.21.15.125:6789/0 conn(0x7f8a600adac0 legacy=0x7f8a600adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a652e8640 1 -- 172.21.15.93:0/3833251107 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6015a6c0 con 0x7f8a60159c00 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.177+0000 7f8a64ae7640 1 --2- 172.21.15.93:0/3833251107 >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 0x7f8a600c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.178+0000 7f8a652e8640 1 --2- 172.21.15.93:0/3833251107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a600cc890 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006ebb0 tx=0x7f8a5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3cc3f15fd91041 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.178+0000 7f8a57fff640 1 -- 172.21.15.93:0/3833251107 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031870 con 0x7f8a60159c00 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.178+0000 7f8a57fff640 1 -- 172.21.15.93:0/3833251107 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0319d0 con 0x7f8a60159c00 2023-11-04T01:39:05.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.178+0000 7f8a57fff640 1 -- 172.21.15.93:0/3833251107 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031d60 con 0x7f8a60159c00 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 -- 172.21.15.93:0/3833251107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 msgr2=0x7f8a600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3833251107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a600cc890 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006ebb0 tx=0x7f8a5c02b910 comp rx=0 tx=0).stop 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 -- 172.21.15.93:0/3833251107 shutdown_connections 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3833251107 >> v2:172.21.15.125:3300/0 conn(0x7f8a600c48e0 0x7f8a600c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3833251107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a600cc890 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 -- 172.21.15.93:0/3833251107 >> 172.21.15.93:0/3833251107 conn(0x7f8a600ce950 msgr2=0x7f8a600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 -- 172.21.15.93:0/3833251107 shutdown_connections 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.179+0000 7f8a6754c640 1 -- 172.21.15.93:0/3833251107 wait complete. 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.180+0000 7f8a6754c640 1 Processor -- start 2023-11-04T01:39:05.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.180+0000 7f8a6754c640 1 -- start start 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a600adac0 0x7f8a6014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a600c48e0 0x7f8a6014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014cb20 con 0x7f8a60159c00 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014f050 con 0x7f8a600adac0 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014f330 con 0x7f8a600c48e0 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43304/0 (socket says 172.21.15.93:43304) 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 -- 172.21.15.93:0/3633411182 learned_addr learned my addr 172.21.15.93:0/3633411182 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a64ae7640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a600c48e0 0x7f8a6014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 -- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a600c48e0 msgr2=0x7f8a6014c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a652e8640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a600adac0 0x7f8a6014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a600c48e0 0x7f8a6014c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 -- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a600adac0 msgr2=0x7f8a6014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a600adac0 0x7f8a6014e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 -- 172.21.15.93:0/3633411182 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0094d0 con 0x7f8a60159c00 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a65ae9640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c7a0 tx=0x7f8a5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58003b70 con 0x7f8a60159c00 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58003cf0 con 0x7f8a60159c00 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a60156910 con 0x7f8a60159c00 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.181+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58003ea0 con 0x7f8a60159c00 2023-11-04T01:39:05.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.182+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6014e610 con 0x7f8a60159c00 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.182+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60156e30 con 0x7f8a60159c00 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.183+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a5800aa90 con 0x7f8a60159c00 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.183+0000 7f8a55ffb640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.183+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f8a58089690 con 0x7f8a60159c00 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.183+0000 7f8a652e8640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.184+0000 7f8a652e8640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.187+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a60156e30 con 0x7f8a60159c00 2023-11-04T01:39:05.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.352+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f8a60156e30 con 0x7f8a60159c00 2023-11-04T01:39:05.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.352+0000 7f8a55ffb640 1 -- 172.21.15.93:0/3633411182 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8a60156e30 con 0x7f8a60159c00 2023-11-04T01:39:05.355 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 msgr2=0x7f8a4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 msgr2=0x7f8a6014e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c7a0 tx=0x7f8a5800cc60 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 shutdown_connections 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a60159c00 0x7f8a6014e0d0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a600c48e0 0x7f8a6014c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 --2- 172.21.15.93:0/3633411182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a600adac0 0x7f8a6014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 >> 172.21.15.93:0/3633411182 conn(0x7f8a600ce950 msgr2=0x7f8a600c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 shutdown_connections 2023-11-04T01:39:05.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.354+0000 7f8a6754c640 1 -- 172.21.15.93:0/3633411182 wait complete. 2023-11-04T01:39:05.367 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:05.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.467+0000 7f7a4f8af640 1 Processor -- start 2023-11-04T01:39:05.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.467+0000 7f7a4f8af640 1 -- start start 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4f8af640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 0x7f7a4806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4f8af640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a4815b120 0x7f7a4815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4f8af640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a48065df0 con 0x7f7a480c9b60 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4f8af640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4806bc40 con 0x7f7a4815b120 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4f8af640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4815f910 con 0x7f7a4815ad40 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4ce4a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a4815b120 0x7f7a4815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4ce4a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7a4815b120 0x7f7a4815f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43310/0 (socket says 172.21.15.93:43310) 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/510988443 learned_addr learned my addr 172.21.15.93:0/510988443 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.468+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/510988443 >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 0x7f7a4806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/510988443 >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 msgr2=0x7f7a4806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4ce4a640 1 --2- 172.21.15.93:0/510988443 >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 0x7f7a4806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/510988443 >> v1:172.21.15.125:6789/0 conn(0x7f7a480c9b60 legacy=0x7f7a48070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/510988443 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48066040 con 0x7f7a4815b120 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/510988443 >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 0x7f7a4806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a4ce4a640 1 --2- 172.21.15.93:0/510988443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815b120 0x7f7a4815f3d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7a4806e030 tx=0x7f7a3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af2d06aead85368 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a3ffff640 1 -- 172.21.15.93:0/510988443 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38031870 con 0x7f7a4815b120 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a3ffff640 1 -- 172.21.15.93:0/510988443 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a380319d0 con 0x7f7a4815b120 2023-11-04T01:39:05.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.469+0000 7f7a3ffff640 1 -- 172.21.15.93:0/510988443 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38031d60 con 0x7f7a4815b120 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 -- 172.21.15.93:0/510988443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815b120 msgr2=0x7f7a4815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/510988443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815b120 0x7f7a4815f3d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7a4806e030 tx=0x7f7a3802b910 comp rx=0 tx=0).stop 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 -- 172.21.15.93:0/510988443 shutdown_connections 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/510988443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815b120 0x7f7a4815f3d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/510988443 >> v2:172.21.15.125:3300/0 conn(0x7f7a4815ad40 0x7f7a4806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 -- 172.21.15.93:0/510988443 >> 172.21.15.93:0/510988443 conn(0x7f7a480cbc90 msgr2=0x7f7a480cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 -- 172.21.15.93:0/510988443 shutdown_connections 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.470+0000 7f7a4f8af640 1 -- 172.21.15.93:0/510988443 wait complete. 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.471+0000 7f7a4f8af640 1 Processor -- start 2023-11-04T01:39:05.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.471+0000 7f7a4f8af640 1 -- start start 2023-11-04T01:39:05.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 0x7f7a480c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 0x7f7a480cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481f2b50 con 0x7f7a4815ad40 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481f2e30 con 0x7f7a4815b120 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4f8af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481f3110 con 0x7f7a480c9b60 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43316/0 (socket says 172.21.15.93:43316) 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/430960487 learned_addr learned my addr 172.21.15.93:0/430960487 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4de4c640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 0x7f7a480cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 msgr2=0x7f7a480c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 0x7f7a480c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 0x7f7a480c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 msgr2=0x7f7a480cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 0x7f7a480cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4ce4a640 1 -- 172.21.15.93:0/430960487 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380094d0 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 0x7f7a480c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.472+0000 7f7a4de4c640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 0x7f7a480cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a4ce4a640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000c00 tx=0x7f7a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3803ad10 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3803ae70 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a481f33f0 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38044610 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.473+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481f2840 con 0x7f7a4815ad40 2023-11-04T01:39:05.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.474+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4815ee90 con 0x7f7a4815ad40 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.477+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a380303c0 con 0x7f7a4815ad40 2023-11-04T01:39:05.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.477+0000 7f7a3dffb640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.477+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f7a3802d040 con 0x7f7a4815ad40 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.477+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.478+0000 7f7a4d64b640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 0x7f7a2c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400d430 tx=0x7f7a44007530 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.481+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a38077150 con 0x7f7a4815ad40 2023-11-04T01:39:05.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.646+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f7a4815ee90 con 0x7f7a4815ad40 2023-11-04T01:39:05.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.647+0000 7f7a3dffb640 1 -- 172.21.15.93:0/430960487 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7a4815ee90 con 0x7f7a4815ad40 2023-11-04T01:39:05.649 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.648+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 msgr2=0x7f7a2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.648+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 0x7f7a2c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400d430 tx=0x7f7a44007530 comp rx=0 tx=0).stop 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.648+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 msgr2=0x7f7a48159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.648+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000c00 tx=0x7f7a380046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 shutdown_connections 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a4815b120 0x7f7a480cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a4815ad40 0x7f7a48159da0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 --2- 172.21.15.93:0/430960487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7a480c9b60 0x7f7a480c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 >> 172.21.15.93:0/430960487 conn(0x7f7a480cbc90 msgr2=0x7f7a4815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 shutdown_connections 2023-11-04T01:39:05.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.649+0000 7f7a4f8af640 1 -- 172.21.15.93:0/430960487 wait complete. 2023-11-04T01:39:05.662 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:05.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.761+0000 7f77b25d0640 1 Processor -- start 2023-11-04T01:39:05.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.761+0000 7f77b25d0640 1 -- start start 2023-11-04T01:39:05.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b25d0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77ac0c4ff0 0x7f77ac0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b25d0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f77ac0adac0 0x7f77ac0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b25d0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac15aff0 con 0x7f77ac159c00 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b25d0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac0ae460 con 0x7f77ac0adac0 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b25d0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac15a3e0 con 0x7f77ac0c4ff0 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f77ac0adac0 0x7f77ac0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f77ac0adac0 0x7f77ac0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43326/0 (socket says 172.21.15.93:43326) 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 -- 172.21.15.93:0/2893012894 learned_addr learned my addr 172.21.15.93:0/2893012894 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 -- 172.21.15.93:0/2893012894 >> v2:172.21.15.125:3300/0 conn(0x7f77ac0c4ff0 msgr2=0x7f77ac0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 --2- 172.21.15.93:0/2893012894 >> v2:172.21.15.125:3300/0 conn(0x7f77ac0c4ff0 0x7f77ac0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 -- 172.21.15.93:0/2893012894 >> v1:172.21.15.125:6789/0 conn(0x7f77ac159c00 legacy=0x7f77ac0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.762+0000 7f77b0b6d640 1 -- 172.21.15.93:0/2893012894 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac15a6c0 con 0x7f77ac0adac0 2023-11-04T01:39:05.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b0b6d640 1 --2- 172.21.15.93:0/2893012894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac0adf20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0cde50 tx=0x7f77a402e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8cbd1e0f75a648 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77aaffd640 1 -- 172.21.15.93:0/2893012894 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a402eab0 con 0x7f77ac0adac0 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77aaffd640 1 -- 172.21.15.93:0/2893012894 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a402ec10 con 0x7f77ac0adac0 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77aaffd640 1 -- 172.21.15.93:0/2893012894 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4009600 con 0x7f77ac0adac0 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 -- 172.21.15.93:0/2893012894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 msgr2=0x7f77ac0adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2893012894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac0adf20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0cde50 tx=0x7f77a402e110 comp rx=0 tx=0).stop 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 -- 172.21.15.93:0/2893012894 shutdown_connections 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2893012894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac0adf20 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2893012894 >> v2:172.21.15.125:3300/0 conn(0x7f77ac0c4ff0 0x7f77ac0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 -- 172.21.15.93:0/2893012894 >> 172.21.15.93:0/2893012894 conn(0x7f77ac0ce950 msgr2=0x7f77ac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.763+0000 7f77b25d0640 1 -- 172.21.15.93:0/2893012894 shutdown_connections 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.764+0000 7f77b25d0640 1 -- 172.21.15.93:0/2893012894 wait complete. 2023-11-04T01:39:05.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 Processor -- start 2023-11-04T01:39:05.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 -- start start 2023-11-04T01:39:05.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.769 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ac0c4ff0 0x7f77ac145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ac159c00 0x7f77ac155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac154eb0 con 0x7f77ac0adac0 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac157630 con 0x7f77ac159c00 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.765+0000 7f77b25d0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac144eb0 con 0x7f77ac0c4ff0 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43328/0 (socket says 172.21.15.93:43328) 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 -- 172.21.15.93:0/2854440187 learned_addr learned my addr 172.21.15.93:0/2854440187 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77ab7fe640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ac0c4ff0 0x7f77ac145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77b0b6d640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ac159c00 0x7f77ac155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 -- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ac0c4ff0 msgr2=0x7f77ac145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ac0c4ff0 0x7f77ac145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 -- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ac159c00 msgr2=0x7f77ac155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ac159c00 0x7f77ac155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 -- 172.21.15.93:0/2854440187 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a400bd40 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77abfff640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c410 tx=0x7f779c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0035f0 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c003750 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac148150 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c003b40 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.766+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac157b20 con 0x7f77ac0adac0 2023-11-04T01:39:05.771 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.767+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac074290 con 0x7f77ac0adac0 2023-11-04T01:39:05.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.768+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f779c003ca0 con 0x7f77ac0adac0 2023-11-04T01:39:05.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.768+0000 7f77a8ff9640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 0x7f779806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.768+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f779c088ea0 con 0x7f77ac0adac0 2023-11-04T01:39:05.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.768+0000 7f77ab7fe640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 0x7f779806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.772 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.768+0000 7f77ab7fe640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 0x7f779806d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0b3a80 tx=0x7f77a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.774 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.772+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f779c053d50 con 0x7f77ac0adac0 2023-11-04T01:39:05.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.935+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f77ac1456a0 con 0x7f77ac0adac0 2023-11-04T01:39:05.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.936+0000 7f77a8ff9640 1 -- 172.21.15.93:0/2854440187 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f779c017020 con 0x7f77ac0adac0 2023-11-04T01:39:05.938 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.937+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 msgr2=0x7f779806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.937+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 0x7f779806d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0b3a80 tx=0x7f77a0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.937+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 msgr2=0x7f77ac154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.937+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c410 tx=0x7f779c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 shutdown_connections 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f779806ae70 0x7f779806d330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77ac159c00 0x7f77ac155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f77ac0c4ff0 0x7f77ac145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 --2- 172.21.15.93:0/2854440187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77ac0adac0 0x7f77ac154970 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 >> 172.21.15.93:0/2854440187 conn(0x7f77ac0ce950 msgr2=0x7f77ac0c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 shutdown_connections 2023-11-04T01:39:05.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:05.938+0000 7f77b25d0640 1 -- 172.21.15.93:0/2854440187 wait complete. 2023-11-04T01:39:05.951 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.047+0000 7f8365c4b640 1 Processor -- start 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.047+0000 7f8365c4b640 1 -- start start 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f8365c4b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 0x7f836014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f8365c4b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f83600ca4b0 0x7f8360150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f8365c4b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83600ca940 con 0x7f8360070e30 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f8365c4b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600cc930 con 0x7f83600ca4b0 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f8365c4b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600cc5e0 con 0x7f8360070a50 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f835effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8360070e30 0x7f83600c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59494/0 (socket says 172.21.15.93:59494) 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f835effd640 1 -- 172.21.15.93:0/3059365797 learned_addr learned my addr 172.21.15.93:0/3059365797 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f835ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f83600ca4b0 0x7f8360150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f835f7fe640 1 --2- 172.21.15.93:0/3059365797 >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 0x7f836014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.048+0000 7f835ffff640 1 -- 172.21.15.93:0/3059365797 >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 msgr2=0x7f836014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835ffff640 1 --2- 172.21.15.93:0/3059365797 >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 0x7f836014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835ffff640 1 -- 172.21.15.93:0/3059365797 >> v1:172.21.15.93:6789/0 conn(0x7f8360070e30 legacy=0x7f83600c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835e7fc640 1 -- 172.21.15.93:0/3059365797 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060913281 0 0) 0x7f83600ca940 con 0x7f8360070e30 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835ffff640 1 -- 172.21.15.93:0/3059365797 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360150960 con 0x7f83600ca4b0 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835f7fe640 1 --2- 172.21.15.93:0/3059365797 >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 0x7f836014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835ffff640 1 --2- 172.21.15.93:0/3059365797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83600ca4b0 0x7f8360150420 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f836006fe60 tx=0x7f835802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a707c479452a9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835e7fc640 1 -- 172.21.15.93:0/3059365797 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835802cbf0 con 0x7f83600ca4b0 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835e7fc640 1 -- 172.21.15.93:0/3059365797 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835802cd50 con 0x7f83600ca4b0 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.049+0000 7f835e7fc640 1 -- 172.21.15.93:0/3059365797 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358034660 con 0x7f83600ca4b0 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 -- 172.21.15.93:0/3059365797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83600ca4b0 msgr2=0x7f8360150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 --2- 172.21.15.93:0/3059365797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83600ca4b0 0x7f8360150420 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f836006fe60 tx=0x7f835802be40 comp rx=0 tx=0).stop 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 -- 172.21.15.93:0/3059365797 shutdown_connections 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 --2- 172.21.15.93:0/3059365797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83600ca4b0 0x7f8360150420 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 --2- 172.21.15.93:0/3059365797 >> v2:172.21.15.125:3300/0 conn(0x7f8360070a50 0x7f836014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 -- 172.21.15.93:0/3059365797 >> 172.21.15.93:0/3059365797 conn(0x7f83600cb490 msgr2=0x7f83600cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 -- 172.21.15.93:0/3059365797 shutdown_connections 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.050+0000 7f8365c4b640 1 -- 172.21.15.93:0/3059365797 wait complete. 2023-11-04T01:39:06.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.051+0000 7f8365c4b640 1 Processor -- start 2023-11-04T01:39:06.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.051+0000 7f8365c4b640 1 -- start start 2023-11-04T01:39:06.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8360070e30 0x7f8360151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83600ca4b0 0x7f83601471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360151eb0 con 0x7f8360070a50 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601539a0 con 0x7f8360070e30 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f8365c4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8360153510 con 0x7f83600ca4b0 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43336/0 (socket says 172.21.15.93:43336) 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 -- 172.21.15.93:0/1371879998 learned_addr learned my addr 172.21.15.93:0/1371879998 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835ffff640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83600ca4b0 0x7f83601471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835effd640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8360070e30 0x7f8360151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 -- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83600ca4b0 msgr2=0x7f83601471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83600ca4b0 0x7f83601471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 -- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8360070e30 msgr2=0x7f8360151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8360070e30 0x7f8360151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.052+0000 7f835f7fe640 1 -- 172.21.15.93:0/1371879998 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009a70 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f835f7fe640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f835000c820 tx=0x7f835000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350007a30 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350007b90 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8360152900 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000ce70 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.053+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8360152ec0 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.054+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836015d4d0 con 0x7f8360070a50 2023-11-04T01:39:06.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.054+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83500113f0 con 0x7f8360070a50 2023-11-04T01:39:06.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.054+0000 7f8347fff640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 0x7f834c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.055+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f8350089a00 con 0x7f8360070a50 2023-11-04T01:39:06.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.055+0000 7f835effd640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 0x7f834c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.055+0000 7f835effd640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 0x7f834c06d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f83601f3910 tx=0x7f8354007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.059+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83500548b0 con 0x7f8360070a50 2023-11-04T01:39:06.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.289+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7f8360074290 con 0x7f8360070a50 2023-11-04T01:39:06.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.482+0000 7f8347fff640 1 -- 172.21.15.93:0/1371879998 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v208) v1 ==== 142+0+0 (secure 0 0 0) 0x7f835001f0d0 con 0x7f8360070a50 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 msgr2=0x7f834c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 0x7f834c06d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f83601f3910 tx=0x7f8354007b50 comp rx=0 tx=0).stop 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 msgr2=0x7f8360152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f835000c820 tx=0x7f835000cc20 comp rx=0 tx=0).stop 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 shutdown_connections 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f834c06ae70 0x7f834c06d330 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f83600ca4b0 0x7f83601471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8360070e30 0x7f8360151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 --2- 172.21.15.93:0/1371879998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8360070a50 0x7f8360152220 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.484+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 >> 172.21.15.93:0/1371879998 conn(0x7f83600cb490 msgr2=0x7f836015cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.485+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 shutdown_connections 2023-11-04T01:39:06.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.485+0000 7f8365c4b640 1 -- 172.21.15.93:0/1371879998 wait complete. 2023-11-04T01:39:06.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:39:06.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.599+0000 7f3f719ee640 1 Processor -- start 2023-11-04T01:39:06.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.599+0000 7f3f719ee640 1 -- start start 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f719ee640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3f6c0cd6d0 0x7f3f6c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f719ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f6c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f719ee640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c0cde60 con 0x7f3f6c153e60 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f719ee640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c160f90 con 0x7f3f6c0cd6d0 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f719ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c161960 con 0x7f3f6c0b4880 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f6affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3f6c153e60 0x7f3f6c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59502/0 (socket says 172.21.15.93:59502) 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f6affd640 1 -- 172.21.15.93:0/129669406 learned_addr learned my addr 172.21.15.93:0/129669406 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f6b7fe640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f6c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582652332 0 0) 0x7f3f6c0cde60 con 0x7f3f6c153e60 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f6a7fc640 1 --2- 172.21.15.93:0/129669406 >> v2:172.21.15.125:3300/0 conn(0x7f3f6c0cd6d0 0x7f3f6c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f58003520 con 0x7f3f6c153e60 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3453481243 0 0) 0x7f3f58003520 con 0x7f3f6c153e60 2023-11-04T01:39:06.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 msgr2=0x7f3f6c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f6c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 >> v2:172.21.15.125:3300/0 conn(0x7f3f6c0cd6d0 msgr2=0x7f3f6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 --2- 172.21.15.93:0/129669406 >> v2:172.21.15.125:3300/0 conn(0x7f3f6c0cd6d0 0x7f3f6c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0b5220 con 0x7f3f6c153e60 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3f640019f0 con 0x7f3f6c153e60 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 >> v1:172.21.15.93:6789/0 conn(0x7f3f6c153e60 legacy=0x7f3f6c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f58004d00 0x7f3f58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c160f90 con 0x7f3f58003970 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c161960 con 0x7f3f58004d00 2023-11-04T01:39:06.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.600+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5800b980 con 0x7f3f6c0b4880 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6a7fc640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6b7fe640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f58004d00 0x7f3f58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 -- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 msgr2=0x7f3f580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c0b4880 0x7f3f580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 -- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f58004d00 msgr2=0x7f3f58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f58004d00 0x7f3f58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 -- 172.21.15.93:0/129669406 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f58003520 con 0x7f3f58003970 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.601+0000 7f3f6affd640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f58003d90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400a860 tx=0x7f3f580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8dd7dd2c772cdb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64034630 con 0x7f3f58003970 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6402f070 con 0x7f3f58003970 2023-11-04T01:39:06.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f69ffb640 1 -- 172.21.15.93:0/129669406 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640349d0 con 0x7f3f58003970 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 -- 172.21.15.93:0/129669406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 msgr2=0x7f3f58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 --2- 172.21.15.93:0/129669406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f58003d90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400a860 tx=0x7f3f580057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f6b7fe640 1 -- 172.21.15.93:0/129669406 reap_dead start 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 -- 172.21.15.93:0/129669406 shutdown_connections 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 -- 172.21.15.93:0/129669406 >> 172.21.15.93:0/129669406 conn(0x7f3f6c0cf880 msgr2=0x7f3f6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 -- 172.21.15.93:0/129669406 shutdown_connections 2023-11-04T01:39:06.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.602+0000 7f3f719ee640 1 -- 172.21.15.93:0/129669406 wait complete. 2023-11-04T01:39:06.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.603+0000 7f3f719ee640 1 Processor -- start 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 -- start start 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c1e8410 0x7f3f6c1e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c0d2de0 0x7f3f6c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0d37a0 con 0x7f3f58003970 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0c75b0 con 0x7f3f6c0d2de0 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f719ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c14d4e0 con 0x7f3f6c1e8410 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f6affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43362/0 (socket says 172.21.15.93:43362) 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f6affd640 1 -- 172.21.15.93:0/3042107777 learned_addr learned my addr 172.21.15.93:0/3042107777 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f6b7fe640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c0d2de0 0x7f3f6c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.604+0000 7f3f6a7fc640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c1e8410 0x7f3f6c1e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 -- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c1e8410 msgr2=0x7f3f6c1e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c1e8410 0x7f3f6c1e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 -- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c0d2de0 msgr2=0x7f3f6c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c0d2de0 0x7f3f6c0d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 -- 172.21.15.93:0/3042107777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0c69a0 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f6affd640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3f6402cb70 tx=0x7f3f6c160f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64034840 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f640349a0 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c0c6c80 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64034d10 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.605+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c0c7240 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.606+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c0c7400 con 0x7f3f58003970 2023-11-04T01:39:06.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.606+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f64031030 con 0x7f3f58003970 2023-11-04T01:39:06.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.607+0000 7f3f63fff640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 0x7f3f4c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.607+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f3f640abd80 con 0x7f3f58003970 2023-11-04T01:39:06.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.607+0000 7f3f6a7fc640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 0x7f3f4c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.607+0000 7f3f6a7fc640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 0x7f3f4c06d360 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0d0240 tx=0x7f3f54008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.611+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f64076ba0 con 0x7f3f58003970 2023-11-04T01:39:06.779 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.777+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3f6c0c7400 con 0x7f3f58003970 2023-11-04T01:39:06.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.782+0000 7f3f63fff640 1 -- 172.21.15.93:0/3042107777 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f6403ee60 con 0x7f3f58003970 2023-11-04T01:39:06.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 msgr2=0x7f3f4c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 0x7f3f4c06d360 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0d0240 tx=0x7f3f54008040 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 msgr2=0x7f3f6c14cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3f6402cb70 tx=0x7f3f6c160f00 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 shutdown_connections 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3f4c06aea0 0x7f3f4c06d360 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f6c0d2de0 0x7f3f6c0d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3f6c1e8410 0x7f3f6c1e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 --2- 172.21.15.93:0/3042107777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f58003970 0x7f3f6c14cfa0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 >> 172.21.15.93:0/3042107777 conn(0x7f3f6c0cf880 msgr2=0x7f3f6c15eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 shutdown_connections 2023-11-04T01:39:06.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:06.784+0000 7f3f719ee640 1 -- 172.21.15.93:0/3042107777 wait complete. 2023-11-04T01:39:06.797 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:06.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:06.835 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:06.878 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:06.879 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:39:06.879 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:06.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:06.894 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:39:06.894 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:06.937 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:06.937 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:39:06.937 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:06.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:06.952 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:39:06.952 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:06.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:06.994 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:39:06.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:07.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.091+0000 7fb3efc94640 1 Processor -- start 2023-11-04T01:39:07.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.091+0000 7fb3efc94640 1 -- start start 2023-11-04T01:39:07.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3efc94640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3efc94640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3efc94640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80cc990 con 0x7fb3e80cda60 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3efc94640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80ccc70 con 0x7fb3e80cde40 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3efc94640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c9ce0 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3ed22f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.092+0000 7fb3ee231640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ee231640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:51406/0 (socket says 172.21.15.93:51406) 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ed22f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:59702/0 (socket says 172.21.15.93:59702) 2023-11-04T01:39:07.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ee231640 1 -- 172.21.15.93:0/1354212383 learned_addr learned my addr 172.21.15.93:0/1354212383 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1354212383 >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 msgr2=0x7fb3e8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ed22f640 1 --2- 172.21.15.93:0/1354212383 >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1354212383 >> v1:172.21.15.125:6789/0 conn(0x7fb3e80cda60 legacy=0x7fb3e80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1354212383 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80c9fc0 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.093+0000 7fb3ee231640 1 --2- 172.21.15.93:0/1354212383 >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3ed22f640 1 --2- 172.21.15.93:0/1354212383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80097a0 tx=0x7fb3d802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701d640af2b2476d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3eca2e640 1 -- 172.21.15.93:0/1354212383 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8031830 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3eca2e640 1 -- 172.21.15.93:0/1354212383 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8031990 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3eca2e640 1 -- 172.21.15.93:0/1354212383 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8031d20 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 -- 172.21.15.93:0/1354212383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 msgr2=0x7fb3e8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1354212383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80097a0 tx=0x7fb3d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 -- 172.21.15.93:0/1354212383 shutdown_connections 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1354212383 >> v2:172.21.15.125:3300/0 conn(0x7fb3e80cde40 0x7fb3e8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1354212383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e8070630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.094+0000 7fb3efc94640 1 -- 172.21.15.93:0/1354212383 >> 172.21.15.93:0/1354212383 conn(0x7fb3e80ce950 msgr2=0x7fb3e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.095+0000 7fb3efc94640 1 -- 172.21.15.93:0/1354212383 shutdown_connections 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.095+0000 7fb3efc94640 1 -- 172.21.15.93:0/1354212383 wait complete. 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 Processor -- start 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 -- start start 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e81e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 0x7fb3e80aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e81e2670 con 0x7fb3e80cda60 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e81e2950 con 0x7fb3e80cde40 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3efc94640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e81e2c30 con 0x7fb3e80b0cd0 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.096+0000 7fb3ed22f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43364/0 (socket says 172.21.15.93:43364) 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1525578343 learned_addr learned my addr 172.21.15.93:0/1525578343 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3eda30640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e81e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ee231640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 0x7fb3e80aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 msgr2=0x7fb3e81e1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e81e1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 msgr2=0x7fb3e80aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 0x7fb3e80aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 -- 172.21.15.93:0/1525578343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0009b30 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ee231640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 0x7fb3e80aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3ed22f640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb3d802bee0 tx=0x7fb3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803a6f0 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d803a870 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d8009400 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803ac20 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.097+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e81e31f0 con 0x7fb3e80cda60 2023-11-04T01:39:07.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.098+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80cc470 con 0x7fb3e80cda60 2023-11-04T01:39:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.099+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3d804c3b0 con 0x7fb3e80cda60 2023-11-04T01:39:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.099+0000 7fb3de7fc640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 0x7fb3cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.099+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fb3d80ab430 con 0x7fb3e80cda60 2023-11-04T01:39:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.099+0000 7fb3eda30640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 0x7fb3cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.103 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.100+0000 7fb3eda30640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 0x7fb3cc06d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cf190 tx=0x7fb3e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.103+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3e80cc470 con 0x7fb3e80cda60 2023-11-04T01:39:07.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.304+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3e80cc470 con 0x7fb3e80cda60 2023-11-04T01:39:07.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.304+0000 7fb3de7fc640 1 -- 172.21.15.93:0/1525578343 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fb3e80cc470 con 0x7fb3e80cda60 2023-11-04T01:39:07.306 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:07.307 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/462118044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":462118044},{"type":"v1","addr":"172.21.15.125:6834","nonce":462118044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6070,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3198306486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3198306486},{"type":"v1","addr":"172.21.15.93:6837","nonce":3198306486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3548303695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3548303695},{"type":"v1","addr":"172.21.15.125:6835","nonce":3548303695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6909,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/4088776503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4088776503},{"type":"v1","addr":"172.21.15.93:6836","nonce":4088776503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2023-11-04T01:39:07.307 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 40 2023-11-04T01:39:07.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 msgr2=0x7fb3cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 0x7fb3cc06d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80cf190 tx=0x7fb3e4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:07.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 msgr2=0x7fb3e80ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb3d802bee0 tx=0x7fb3d80046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 shutdown_connections 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb3cc06ae70 0x7fb3cc06d330 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3e80cde40 0x7fb3e80aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3e80cda60 0x7fb3e80ae7c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 --2- 172.21.15.93:0/1525578343 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb3e80b0cd0 0x7fb3e81e1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 >> 172.21.15.93:0/1525578343 conn(0x7fb3e80ce950 msgr2=0x7fb3e80b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 shutdown_connections 2023-11-04T01:39:07.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.306+0000 7fb3efc94640 1 -- 172.21.15.93:0/1525578343 wait complete. 2023-11-04T01:39:07.319 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:07.319 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:39:07.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:39:07.319 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:07.320 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:07.320 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:39:07.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:39:07.320 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:07.320 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:07.320 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:39:07.320 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:39:07.320 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:07.321 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:07.321 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:39:07.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:39:07.321 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:07.328 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:39:07.328 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:07.330 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:39:07.330 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:07.332 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:39:07.332 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:07.332 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:39:07.332 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:07.372 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:07.372 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:07.373 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:07.373 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:07.374 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:07.374 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:07.375 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:07.375 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:07.375 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:39:07.448 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2023-11-04T01:39:07.448 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:39:07.455 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:39:07.456 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:39:07.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.477+0000 7f62a89d7640 1 Processor -- start 2023-11-04T01:39:07.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.477+0000 7f62a89d7640 1 -- start start 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a89d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f62a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a89d7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40cde60 con 0x7f62a40b4880 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a89d7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a4160f90 con 0x7f62a40cd6d0 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a89d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415e400 con 0x7f62a4153e60 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a2d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f62a40b4880 0x7f62a40d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59516/0 (socket says 172.21.15.93:59516) 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.478+0000 7f62a2d9d640 1 -- 172.21.15.93:0/2953754078 learned_addr learned my addr 172.21.15.93:0/2953754078 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a259c640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f62a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100529385 0 0) 0x7f62a40cde60 con 0x7f62a40b4880 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f628c003520 con 0x7f62a40b4880 2023-11-04T01:39:07.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609075537 0 0) 0x7f628c003520 con 0x7f62a40b4880 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 msgr2=0x7f62a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f62a415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 >> v1:172.21.15.125:6789/0 conn(0x7f62a40cd6d0 legacy=0x7f62a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40ce090 con 0x7f62a40b4880 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f629c0019f0 con 0x7f62a40b4880 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 >> v1:172.21.15.93:6789/0 conn(0x7f62a40b4880 legacy=0x7f62a40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f628c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f628c003f20 0x7f628c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f628c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415e400 con 0x7f628c004d00 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c014270 con 0x7f628c003f20 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c014430 con 0x7f62a4153e60 2023-11-04T01:39:07.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f628c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a1d9b640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f628c003f20 0x7f628c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a259c640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f628c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 -- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 msgr2=0x7f628c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a4153e60 0x7f628c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 -- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f628c003f20 msgr2=0x7f628c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f628c003f20 0x7f628c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.479+0000 7f62a2d9d640 1 -- 172.21.15.93:0/2953754078 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c003520 con 0x7f628c004d00 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.480+0000 7f62a2d9d640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f628c005180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f629c00a820 tx=0x7f628c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ed9f80f99037b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.480+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0072d0 con 0x7f628c004d00 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.480+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c02f070 con 0x7f628c004d00 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.480+0000 7f62a159a640 1 -- 172.21.15.93:0/2953754078 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c007690 con 0x7f628c004d00 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 -- 172.21.15.93:0/2953754078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 msgr2=0x7f628c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 --2- 172.21.15.93:0/2953754078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f628c005180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f629c00a820 tx=0x7f628c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a2d9d640 1 -- 172.21.15.93:0/2953754078 reap_dead start 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 -- 172.21.15.93:0/2953754078 shutdown_connections 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 -- 172.21.15.93:0/2953754078 >> 172.21.15.93:0/2953754078 conn(0x7f62a40cf880 msgr2=0x7f62a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 -- 172.21.15.93:0/2953754078 shutdown_connections 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.481+0000 7f62a89d7640 1 -- 172.21.15.93:0/2953754078 wait complete. 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.482+0000 7f62a89d7640 1 Processor -- start 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.482+0000 7f62a89d7640 1 -- start start 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62a406eb10 0x7f62a415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a406ef90 0x7f62a415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40c9460 con 0x7f628c004d00 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41ef340 con 0x7f62a406eb10 2023-11-04T01:39:07.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a89d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41f2890 con 0x7f62a406ef90 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43428/0 (socket says 172.21.15.93:43428) 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 -- 172.21.15.93:0/1652836602 learned_addr learned my addr 172.21.15.93:0/1652836602 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a1d9b640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62a406eb10 0x7f62a415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a2d9d640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a406ef90 0x7f62a415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 -- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a406ef90 msgr2=0x7f62a415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a406ef90 0x7f62a415ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 -- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62a406eb10 msgr2=0x7f62a415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62a406eb10 0x7f62a415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.483+0000 7f62a259c640 1 -- 172.21.15.93:0/1652836602 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a41f1930 con 0x7f628c004d00 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f62a259c640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f62940119a0 tx=0x7f6294011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400fa90 con 0x7f628c004d00 2023-11-04T01:39:07.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400fbf0 con 0x7f628c004d00 2023-11-04T01:39:07.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a41f1c10 con 0x7f628c004d00 2023-11-04T01:39:07.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294014440 con 0x7f628c004d00 2023-11-04T01:39:07.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.484+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a41f21d0 con 0x7f628c004d00 2023-11-04T01:39:07.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.485+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4074290 con 0x7f628c004d00 2023-11-04T01:39:07.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.485+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62940145a0 con 0x7f628c004d00 2023-11-04T01:39:07.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.485+0000 7f6292ffd640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 0x7f628406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.486+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f6294089e70 con 0x7f628c004d00 2023-11-04T01:39:07.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.486+0000 7f62a1d9b640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 0x7f628406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.486+0000 7f62a1d9b640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 0x7f628406d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f62a40d29e0 tx=0x7f6298009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.490+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6294054dd0 con 0x7f628c004d00 2023-11-04T01:39:07.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:07.670+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f62a40d0b80 con 0x7f628c004d00 2023-11-04T01:39:08.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.508+0000 7f6292ffd640 1 -- 172.21.15.93:0/1652836602 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f62940583f0 con 0x7f628c004d00 2023-11-04T01:39:08.511 INFO:teuthology.orchestra.run.smithi093.stderr: removed all blocklist entries 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 msgr2=0x7f628406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 0x7f628406d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f62a40d29e0 tx=0x7f6298009040 comp rx=0 tx=0).stop 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 msgr2=0x7f62a41eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f62940119a0 tx=0x7f6294011e60 comp rx=0 tx=0).stop 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 shutdown_connections 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628406ae70 0x7f628406d330 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62a406ef90 0x7f62a415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62a406eb10 0x7f62a415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 --2- 172.21.15.93:0/1652836602 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f628c004d00 0x7f62a41eee00 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 >> 172.21.15.93:0/1652836602 conn(0x7f62a40cf880 msgr2=0x7f62a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 shutdown_connections 2023-11-04T01:39:08.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.511+0000 7f62a89d7640 1 -- 172.21.15.93:0/1652836602 wait complete. 2023-11-04T01:39:08.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.630+0000 7f634c1a5640 1 Processor -- start 2023-11-04T01:39:08.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.630+0000 7f634c1a5640 1 -- start start 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634c1a5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f63440cda60 0x7f63440ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634c1a5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440cc990 con 0x7f6344070d40 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634c1a5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440ccc70 con 0x7f63440b0cd0 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634c1a5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440c9ce0 con 0x7f63440cda60 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f6349f41640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f63440cda60 0x7f63440ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634a742640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6344070d40 0x7f634406c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59520/0 (socket says 172.21.15.93:59520) 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.631+0000 7f634a742640 1 -- 172.21.15.93:0/1627575021 learned_addr learned my addr 172.21.15.93:0/1627575021 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.632+0000 7f6349f41640 1 -- 172.21.15.93:0/1627575021 >> v1:172.21.15.125:6789/0 conn(0x7f63440b0cd0 legacy=0x7f6344070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.632+0000 7f6349f41640 1 -- 172.21.15.93:0/1627575021 >> v1:172.21.15.93:6789/0 conn(0x7f6344070d40 legacy=0x7f634406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.632+0000 7f6348f3f640 1 -- 172.21.15.93:0/1627575021 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935760886 0 0) 0x7f63440cc990 con 0x7f6344070d40 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.632+0000 7f6349f41640 1 -- 172.21.15.93:0/1627575021 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440c9fc0 con 0x7f63440cda60 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.632+0000 7f6349f41640 1 --2- 172.21.15.93:0/1627575021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63440cda60 0x7f63440ca7a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f6340009d90 tx=0x7f634002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9d6d92e096a1b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f6348f3f640 1 -- 172.21.15.93:0/1627575021 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634002cc60 con 0x7f63440cda60 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f6348f3f640 1 -- 172.21.15.93:0/1627575021 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634002cdc0 con 0x7f63440cda60 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f6348f3f640 1 -- 172.21.15.93:0/1627575021 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340034660 con 0x7f63440cda60 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 -- 172.21.15.93:0/1627575021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63440cda60 msgr2=0x7f63440ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 --2- 172.21.15.93:0/1627575021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63440cda60 0x7f63440ca7a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f6340009d90 tx=0x7f634002beb0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 -- 172.21.15.93:0/1627575021 shutdown_connections 2023-11-04T01:39:08.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 --2- 172.21.15.93:0/1627575021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63440cda60 0x7f63440ca7a0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 -- 172.21.15.93:0/1627575021 >> 172.21.15.93:0/1627575021 conn(0x7f63440ce950 msgr2=0x7f63440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 -- 172.21.15.93:0/1627575021 shutdown_connections 2023-11-04T01:39:08.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.633+0000 7f634c1a5640 1 -- 172.21.15.93:0/1627575021 wait complete. 2023-11-04T01:39:08.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.634+0000 7f634c1a5640 1 Processor -- start 2023-11-04T01:39:08.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.634+0000 7f634c1a5640 1 -- start start 2023-11-04T01:39:08.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63440b0cd0 0x7f63440c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63440cda60 0x7f63440c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440c6bd0 con 0x7f6344070d40 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634406c200 con 0x7f63440b0cd0 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634c1a5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440c68f0 con 0x7f63440cda60 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43436/0 (socket says 172.21.15.93:43436) 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 -- 172.21.15.93:0/3399981485 learned_addr learned my addr 172.21.15.93:0/3399981485 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f634a742640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63440cda60 0x7f63440c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349740640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63440b0cd0 0x7f63440c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 -- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63440cda60 msgr2=0x7f63440c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63440cda60 0x7f63440c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 -- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63440b0cd0 msgr2=0x7f63440c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63440b0cd0 0x7f63440c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.635+0000 7f6349f41640 1 -- 172.21.15.93:0/3399981485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340009a70 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f6349f41640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f6340009d90 tx=0x7f6340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634003e610 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634003e770 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634406c410 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634003eb20 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.636+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634406c9d0 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.637+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6344074290 con 0x7f6344070d40 2023-11-04T01:39:08.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.637+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f634003b050 con 0x7f6344070d40 2023-11-04T01:39:08.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.638+0000 7f633a7fc640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.638+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f63400ac250 con 0x7f6344070d40 2023-11-04T01:39:08.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.638+0000 7f6349740640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.638+0000 7f6349740640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 0x7f632806d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f63440c2890 tx=0x7f6334009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.642+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6340077160 con 0x7f6344070d40 2023-11-04T01:39:08.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.871+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f63440713d0 con 0x7f6344070d40 2023-11-04T01:39:08.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.871+0000 7f633a7fc640 1 -- 172.21.15.93:0/3399981485 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f634007a780 con 0x7f6344070d40 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: "auth_dump": [ 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.a", 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vla8s0FhAAIZdp8VIkYcCXBh4/xCHsIA==", 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.874 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.b", 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlKwnDJRAACQLBbgLIPPyLbRj01DXV4Q==", 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.875 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.c", 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlz+pkIBAAXofXNYVuREQ6DMEpIyBKBA==", 2023-11-04T01:39:08.876 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mds.d", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlIlx3LRAAx0P3dHLpqulgp10Qkm293A==", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:39:08.877 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.0", 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDBn0Vlfvf0EhAAK6dKJOvGzAsRE74AcDozng==", 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.878 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.1", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDEn0VlGWg+EhAAlLZ8LeTUKNS/u0HRYGZUcg==", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.2", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDHn0VluNKMEBAAhaYS93nyLlhHUpRluxoaQQ==", 2023-11-04T01:39:08.879 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.3", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDKn0Vl642YDhAAHLIQci/33LvE4+KCkk+0Dw==", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.880 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.4", 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDQn0VlGq4fFRAANdZN+kbqsAjdVXKCpctVhw==", 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.881 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.5", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDTn0VlQ0LAExAAw2asXwDn27yQEwCst3F/ig==", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.6", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDWn0VlBBNOEhAA8x+bE2ltAN8gNFLDwqMU8Q==", 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.882 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "osd.7", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQDZn0Vl18DzDxAAs3Cp1oBr4jVCfqfJB5TWMg==", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile osd", 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.883 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.0", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA==", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow r", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.1", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl9xE+OxAAUhlF2baKq7cq9BOYv1EuhA==", 2023-11-04T01:39:08.884 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.2", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0Vl1nPXNxAAP+eK1yhFh54OXSFstIvIbA==", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.885 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.3", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC+n0VlJ0qbBRAAIyNPg6aoYNaIYTYPUXGKsA==", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow r", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow rw", 2023-11-04T01:39:08.886 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow rwx" 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "client.admin", 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC8n0VlXE3tMRAAENuvCH1TV9mwClMjb99rXg==", 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "mgr": "allow *", 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow *", 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.887 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.x", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlDiOmEhAAIpfWxnzD/DCNIbZrzILENA==", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "entity": "mgr.y", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "key": "AQC9n0VlAvRcDRAAseSpovlUwWsBrDHnduCnfA==", 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": { 2023-11-04T01:39:08.888 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": "allow *", 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout: "osd": "allow *" 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-11-04T01:39:08.889 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:39:08.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 msgr2=0x7f632806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 0x7f632806d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f63440c2890 tx=0x7f6334009040 comp rx=0 tx=0).stop 2023-11-04T01:39:08.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 msgr2=0x7f63440c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f6340009d90 tx=0x7f6340004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 shutdown_connections 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f63440cda60 0x7f63440c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63440b0cd0 0x7f63440c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 --2- 172.21.15.93:0/3399981485 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6344070d40 0x7f63440c6280 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 >> 172.21.15.93:0/3399981485 conn(0x7f63440ce950 msgr2=0x7f63440b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 shutdown_connections 2023-11-04T01:39:08.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.873+0000 7f634c1a5640 1 -- 172.21.15.93:0/3399981485 wait complete. 2023-11-04T01:39:08.892 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:08.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.988+0000 7f8b30e7c640 1 Processor -- start 2023-11-04T01:39:08.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 -- start start 2023-11-04T01:39:08.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c0ce240 0x7f8b2c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b2c157540 0x7f8b2c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c15e000 con 0x7f8b2c0cde60 2023-11-04T01:39:08.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c15e5c0 con 0x7f8b2c157540 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.989+0000 7f8b30e7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c15e2e0 con 0x7f8b2c0ce240 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b2c157540 0x7f8b2c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b2c157540 0x7f8b2c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43448/0 (socket says 172.21.15.93:43448) 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 -- 172.21.15.93:0/250759479 learned_addr learned my addr 172.21.15.93:0/250759479 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b29d9b640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c0ce240 0x7f8b2c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 -- 172.21.15.93:0/250759479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c0ce240 msgr2=0x7f8b2c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c0ce240 0x7f8b2c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 -- 172.21.15.93:0/250759479 >> v1:172.21.15.125:6789/0 conn(0x7f8b2c0cde60 legacy=0x7f8b2c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.990+0000 7f8b2ad9d640 1 -- 172.21.15.93:0/250759479 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0d1120 con 0x7f8b2c157540 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b2ad9d640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c157540 0x7f8b2c0d1920 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399dbf02e0587e44 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b2959a640 1 -- 172.21.15.93:0/250759479 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c030840 con 0x7f8b2c157540 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b2959a640 1 -- 172.21.15.93:0/250759479 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0309a0 con 0x7f8b2c157540 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b2959a640 1 -- 172.21.15.93:0/250759479 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c030d30 con 0x7f8b2c157540 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 -- 172.21.15.93:0/250759479 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c157540 msgr2=0x7f8b2c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c157540 0x7f8b2c0d1920 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c02b980 comp rx=0 tx=0).stop 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 -- 172.21.15.93:0/250759479 shutdown_connections 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c157540 0x7f8b2c0d1920 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/250759479 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c0ce240 0x7f8b2c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 -- 172.21.15.93:0/250759479 >> 172.21.15.93:0/250759479 conn(0x7f8b2c071f30 msgr2=0x7f8b2c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 -- 172.21.15.93:0/250759479 shutdown_connections 2023-11-04T01:39:08.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.991+0000 7f8b30e7c640 1 -- 172.21.15.93:0/250759479 wait complete. 2023-11-04T01:39:08.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 Processor -- start 2023-11-04T01:39:08.996 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 -- start start 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 0x7f8b2c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c157540 0x7f8b2c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1f4330 con 0x7f8b2c0cde60 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1f4610 con 0x7f8b2c0ce240 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b30e7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1f48f0 con 0x7f8b2c157540 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.993+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43462/0 (socket says 172.21.15.93:43462) 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 -- 172.21.15.93:0/467955329 learned_addr learned my addr 172.21.15.93:0/467955329 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2ad9d640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c157540 0x7f8b2c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b29d9b640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 0x7f8b2c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.999 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 -- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c157540 msgr2=0x7f8b2c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c157540 0x7f8b2c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 -- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 msgr2=0x7f8b2c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 0x7f8b2c156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 -- 172.21.15.93:0/467955329 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0094d0 con 0x7f8b2c0cde60 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b29d9b640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 0x7f8b2c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b2a59c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c450 tx=0x7f8b2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240052d0 con 0x7f8b2c0cde60 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24005430 con 0x7f8b2c0cde60 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c1f4bd0 con 0x7f8b2c0cde60 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24012870 con 0x7f8b2c0cde60 2023-11-04T01:39:09.000 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.994+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c1f5910 con 0x7f8b2c0cde60 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.995+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c1f50f0 con 0x7f8b2c0cde60 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.995+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b240129d0 con 0x7f8b2c0cde60 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.996+0000 7f8b1affd640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 0x7f8b0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.996+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f8b24089380 con 0x7f8b2c0cde60 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.996+0000 7f8b29d9b640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 0x7f8b0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:08.996+0000 7f8b29d9b640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 0x7f8b0c06d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0b6350 tx=0x7f8b2000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.000+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b24054200 con 0x7f8b2c0cde60 2023-11-04T01:39:09.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.170+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b2c074290 con 0x7f8b2c0cde60 2023-11-04T01:39:09.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.171+0000 7f8b1affd640 1 -- 172.21.15.93:0/467955329 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18359 (secure 0 0 0) 0x7f8b24057820 con 0x7f8b2c0cde60 2023-11-04T01:39:09.174 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:09.174 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":91,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:39:08.508386+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:09.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 msgr2=0x7f8b0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 0x7f8b0c06d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0b6350 tx=0x7f8b2000b040 comp rx=0 tx=0).stop 2023-11-04T01:39:09.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 msgr2=0x7f8b2c1f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c450 tx=0x7f8b2400c910 comp rx=0 tx=0).stop 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 shutdown_connections 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b0c06ae70 0x7f8b0c06d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b2c157540 0x7f8b2c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b2c0ce240 0x7f8b2c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 --2- 172.21.15.93:0/467955329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b2c0cde60 0x7f8b2c1f53d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 >> 172.21.15.93:0/467955329 conn(0x7f8b2c071f30 msgr2=0x7f8b2c0b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 shutdown_connections 2023-11-04T01:39:09.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.173+0000 7f8b30e7c640 1 -- 172.21.15.93:0/467955329 wait complete. 2023-11-04T01:39:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:09.187 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:09.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.286+0000 7f27c12c9640 1 Processor -- start 2023-11-04T01:39:09.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 -- start start 2023-11-04T01:39:09.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f27bc0cd6d0 0x7f27bc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f27bc0b4880 0x7f27bc0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0cde60 con 0x7f27bc153e60 2023-11-04T01:39:09.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc160f90 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27c12c9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc161960 con 0x7f27bc0b4880 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27ba7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f27bc0cd6d0 0x7f27bc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27ba7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f27bc0cd6d0 0x7f27bc161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43470/0 (socket says 172.21.15.93:43470) 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.287+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2475220565 learned_addr learned my addr 172.21.15.93:0/2475220565 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.288+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2475220565 >> v2:172.21.15.125:3300/0 conn(0x7f27bc0b4880 msgr2=0x7f27bc0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.288+0000 7f27ba7fc640 1 --2- 172.21.15.93:0/2475220565 >> v2:172.21.15.125:3300/0 conn(0x7f27bc0b4880 0x7f27bc0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.288+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2475220565 >> v1:172.21.15.125:6789/0 conn(0x7f27bc153e60 legacy=0x7f27bc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.288+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2475220565 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0b5220 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.288+0000 7f27ba7fc640 1 --2- 172.21.15.93:0/2475220565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc161420 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0b8f40 tx=0x7f27b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b976641fb1781cae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27b9ffb640 1 -- 172.21.15.93:0/2475220565 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031870 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27b9ffb640 1 -- 172.21.15.93:0/2475220565 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00319d0 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27b9ffb640 1 -- 172.21.15.93:0/2475220565 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031d60 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 -- 172.21.15.93:0/2475220565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 msgr2=0x7f27bc161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2475220565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc161420 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0b8f40 tx=0x7f27b002b910 comp rx=0 tx=0).stop 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 -- 172.21.15.93:0/2475220565 shutdown_connections 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2475220565 >> v2:172.21.15.125:3300/0 conn(0x7f27bc0b4880 0x7f27bc0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2475220565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc161420 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 -- 172.21.15.93:0/2475220565 >> 172.21.15.93:0/2475220565 conn(0x7f27bc0cf880 msgr2=0x7f27bc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 -- 172.21.15.93:0/2475220565 shutdown_connections 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.289+0000 7f27c12c9640 1 -- 172.21.15.93:0/2475220565 wait complete. 2023-11-04T01:39:09.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.290+0000 7f27c12c9640 1 Processor -- start 2023-11-04T01:39:09.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 -- start start 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27bc0b4880 0x7f27bc0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 0x7f27bc153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc15a580 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc15aa10 con 0x7f27bc153e60 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27c12c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc159970 con 0x7f27bc0b4880 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27ba7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27ba7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43478/0 (socket says 172.21.15.93:43478) 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2023193039 learned_addr learned my addr 172.21.15.93:0/2023193039 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.291+0000 7f27baffd640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27bc0b4880 0x7f27bc0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27bb7fe640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 0x7f27bc153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27bc0b4880 msgr2=0x7f27bc0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27bc0b4880 0x7f27bc0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 msgr2=0x7f27bc153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 0x7f27bc153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 -- 172.21.15.93:0/2023193039 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00094d0 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27bb7fe640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 0x7f27bc153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27ba7fc640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f27b0000c00 tx=0x7f27b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b003ad10 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b003ae70 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0044610 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc159c50 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.292+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc15a210 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.293+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc15a730 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.293+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27b004d450 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.294+0000 7f27a37fe640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 0x7f27a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.294+0000 7f27baffd640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 0x7f27a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.294+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f27b002d040 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.294+0000 7f27baffd640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 0x7f27a806d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009f60 tx=0x7f27ac0094f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.298+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27bc15a730 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.463+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27bc15add0 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.464+0000 7f27a37fe640 1 -- 172.21.15.93:0/2023193039 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27b00af030 con 0x7f27bc0cd6d0 2023-11-04T01:39:09.466 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.465+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 msgr2=0x7f27a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.465+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 0x7f27a806d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009f60 tx=0x7f27ac0094f0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.465+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 msgr2=0x7f27bc152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.465+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f27b0000c00 tx=0x7f27b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 shutdown_connections 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f27a806aea0 0x7f27a806d360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27bc153e60 0x7f27bc153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27bc0cd6d0 0x7f27bc152ce0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 --2- 172.21.15.93:0/2023193039 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f27bc0b4880 0x7f27bc0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 >> 172.21.15.93:0/2023193039 conn(0x7f27bc0cf880 msgr2=0x7f27bc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 shutdown_connections 2023-11-04T01:39:09.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.466+0000 7f27c12c9640 1 -- 172.21.15.93:0/2023193039 wait complete. 2023-11-04T01:39:09.479 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:09.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.579+0000 7f27436a2640 1 Processor -- start 2023-11-04T01:39:09.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.579+0000 7f27436a2640 1 -- start start 2023-11-04T01:39:09.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f27436a2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f27436a2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f273c0b4880 0x7f273c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f27436a2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0cde60 con 0x7f273c0cd6d0 2023-11-04T01:39:09.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f27436a2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c0b5230 con 0x7f273c0b4880 2023-11-04T01:39:09.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f27436a2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c160f90 con 0x7f273c153e60 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f2741c3f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f273c0b4880 0x7f273c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f2740c3d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f273c0cd6d0 0x7f273c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59526/0 (socket says 172.21.15.93:59526) 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.580+0000 7f2740c3d640 1 -- 172.21.15.93:0/925136242 learned_addr learned my addr 172.21.15.93:0/925136242 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f274143e640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2741c3f640 1 -- 172.21.15.93:0/925136242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 msgr2=0x7f273c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2741c3f640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2741c3f640 1 -- 172.21.15.93:0/925136242 >> v1:172.21.15.93:6789/0 conn(0x7f273c0cd6d0 legacy=0x7f273c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2741c3f640 1 -- 172.21.15.93:0/925136242 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c15e400 con 0x7f273c0b4880 2023-11-04T01:39:09.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2733fff640 1 -- 172.21.15.93:0/925136242 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773809684 0 0) 0x7f273c0cde60 con 0x7f273c0cd6d0 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.581+0000 7f2741c3f640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c0b4cf0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f27340097a0 tx=0x7f273402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c06138855c23602 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f2733fff640 1 -- 172.21.15.93:0/925136242 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734031830 con 0x7f273c0b4880 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f2733fff640 1 -- 172.21.15.93:0/925136242 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734031990 con 0x7f273c0b4880 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f2733fff640 1 -- 172.21.15.93:0/925136242 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734031d20 con 0x7f273c0b4880 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 -- 172.21.15.93:0/925136242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 msgr2=0x7f273c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c0b4cf0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f27340097a0 tx=0x7f273402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 -- 172.21.15.93:0/925136242 shutdown_connections 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c0b4cf0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 --2- 172.21.15.93:0/925136242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 -- 172.21.15.93:0/925136242 >> 172.21.15.93:0/925136242 conn(0x7f273c0cf880 msgr2=0x7f273c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 -- 172.21.15.93:0/925136242 shutdown_connections 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.582+0000 7f27436a2640 1 -- 172.21.15.93:0/925136242 wait complete. 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.583+0000 7f27436a2640 1 Processor -- start 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.583+0000 7f27436a2640 1 -- start start 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f273c0cd6d0 0x7f273c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c152b40 con 0x7f273c0b4880 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c7b20 con 0x7f273c0cd6d0 2023-11-04T01:39:09.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f27436a2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0c7e00 con 0x7f273c153e60 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43506/0 (socket says 172.21.15.93:43506) 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 -- 172.21.15.93:0/1749515349 learned_addr learned my addr 172.21.15.93:0/1749515349 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f2741c3f640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f2740c3d640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f273c0cd6d0 0x7f273c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 -- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 msgr2=0x7f273c15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 -- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f273c0cd6d0 msgr2=0x7f273c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.584+0000 7f274143e640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f273c0cd6d0 0x7f273c15f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f274143e640 1 -- 172.21.15.93:0/1749515349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009400 con 0x7f273c0b4880 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f274143e640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e40 tx=0x7f273800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738014620 con 0x7f273c0b4880 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800ee90 con 0x7f273c0b4880 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0c80e0 con 0x7f273c0b4880 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380149c0 con 0x7f273c0b4880 2023-11-04T01:39:09.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.585+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0c86a0 con 0x7f273c0b4880 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.586+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0c8830 con 0x7f273c0b4880 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.586+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2738014b20 con 0x7f273c0b4880 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.587+0000 7f2731ffb640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 0x7f272006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.587+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f273808a170 con 0x7f273c0b4880 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.587+0000 7f2740c3d640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 0x7f272006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.587+0000 7f2740c3d640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 0x7f272006d360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f272c000f60 tx=0x7f272c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.591+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2738054ff0 con 0x7f273c0b4880 2023-11-04T01:39:09.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.754+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f273c074290 con 0x7f273c0b4880 2023-11-04T01:39:09.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.754+0000 7f2731ffb640 1 -- 172.21.15.93:0/1749515349 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2738058610 con 0x7f273c0b4880 2023-11-04T01:39:09.757 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 msgr2=0x7f272006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 0x7f272006d360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f272c000f60 tx=0x7f272c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 msgr2=0x7f273c152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e40 tx=0x7f273800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 shutdown_connections 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f272006aea0 0x7f272006d360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f273c153e60 0x7f273c15fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f273c0cd6d0 0x7f273c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 --2- 172.21.15.93:0/1749515349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f273c0b4880 0x7f273c152600 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 >> 172.21.15.93:0/1749515349 conn(0x7f273c0cf880 msgr2=0x7f273c161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 shutdown_connections 2023-11-04T01:39:09.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.756+0000 7f27436a2640 1 -- 172.21.15.93:0/1749515349 wait complete. 2023-11-04T01:39:09.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 Processor -- start 2023-11-04T01:39:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 -- start start 2023-11-04T01:39:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fab280cd6d0 0x7fab28161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab280cde60 con 0x7fab28153e60 2023-11-04T01:39:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab28160f90 con 0x7fab280b4880 2023-11-04T01:39:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab2e125640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab28161960 con 0x7fab280cd6d0 2023-11-04T01:39:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.870+0000 7fab26ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fab280cd6d0 0x7fab28161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab277fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fab28153e60 0x7fab2815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59538/0 (socket says 172.21.15.93:59538) 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab277fe640 1 -- 172.21.15.93:0/1498319467 learned_addr learned my addr 172.21.15.93:0/1498319467 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab26ffd640 1 -- 172.21.15.93:0/1498319467 >> v1:172.21.15.125:6789/0 conn(0x7fab280b4880 legacy=0x7fab280d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab26ffd640 1 -- 172.21.15.93:0/1498319467 >> v1:172.21.15.93:6789/0 conn(0x7fab28153e60 legacy=0x7fab2815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab26ffd640 1 -- 172.21.15.93:0/1498319467 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280ce090 con 0x7fab280cd6d0 2023-11-04T01:39:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab267fc640 1 -- 172.21.15.93:0/1498319467 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854592407 0 0) 0x7fab280cde60 con 0x7fab28153e60 2023-11-04T01:39:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.871+0000 7fab26ffd640 1 --2- 172.21.15.93:0/1498319467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280cd6d0 0x7fab28161420 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4318a78b05e7e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab267fc640 1 -- 172.21.15.93:0/1498319467 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c031830 con 0x7fab280cd6d0 2023-11-04T01:39:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab267fc640 1 -- 172.21.15.93:0/1498319467 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c031990 con 0x7fab280cd6d0 2023-11-04T01:39:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab267fc640 1 -- 172.21.15.93:0/1498319467 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c031d20 con 0x7fab280cd6d0 2023-11-04T01:39:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 -- 172.21.15.93:0/1498319467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280cd6d0 msgr2=0x7fab28161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 --2- 172.21.15.93:0/1498319467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280cd6d0 0x7fab28161420 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 -- 172.21.15.93:0/1498319467 shutdown_connections 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 --2- 172.21.15.93:0/1498319467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280cd6d0 0x7fab28161420 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 -- 172.21.15.93:0/1498319467 >> 172.21.15.93:0/1498319467 conn(0x7fab280cf880 msgr2=0x7fab280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 -- 172.21.15.93:0/1498319467 shutdown_connections 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.872+0000 7fab2e125640 1 -- 172.21.15.93:0/1498319467 wait complete. 2023-11-04T01:39:09.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.873+0000 7fab2e125640 1 Processor -- start 2023-11-04T01:39:09.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 -- start start 2023-11-04T01:39:09.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 0x7fab28150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab28153e60 0x7fab280c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28150bb0 con 0x7fab280b4880 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280c79a0 con 0x7fab280cd6d0 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab2e125640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280c7c80 con 0x7fab28153e60 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43524/0 (socket says 172.21.15.93:43524) 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.874+0000 7fab277fe640 1 -- 172.21.15.93:0/2367417781 learned_addr learned my addr 172.21.15.93:0/2367417781 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 -- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab28153e60 msgr2=0x7fab280c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab26ffd640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 0x7fab28150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab27fff640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab28153e60 0x7fab280c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab28153e60 0x7fab280c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 -- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 msgr2=0x7fab28150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 0x7fab28150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 -- 172.21.15.93:0/2367417781 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009400 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab26ffd640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 0x7fab28150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab277fe640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c430 tx=0x7fab1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180074e0 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18007660 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab280c7f60 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18004a20 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.875+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab280c8520 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.876+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28074290 con 0x7fab280b4880 2023-11-04T01:39:09.880 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.876+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab18004b80 con 0x7fab280b4880 2023-11-04T01:39:09.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.877+0000 7fab0ffff640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 0x7fab1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.877+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fab180895c0 con 0x7fab280b4880 2023-11-04T01:39:09.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.877+0000 7fab26ffd640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 0x7fab1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.877+0000 7fab26ffd640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 0x7fab1406d360 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fab1c036000 tx=0x7fab1c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:09.881+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab180544d0 con 0x7fab280b4880 2023-11-04T01:39:10.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.044+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fab280cf0f0 con 0x7fab280b4880 2023-11-04T01:39:10.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.044+0000 7fab0ffff640 1 -- 172.21.15.93:0/2367417781 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7fab18057af0 con 0x7fab280b4880 2023-11-04T01:39:10.047 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 msgr2=0x7fab1406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 0x7fab1406d360 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fab1c036000 tx=0x7fab1c008030 comp rx=0 tx=0).stop 2023-11-04T01:39:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 msgr2=0x7fab28152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c430 tx=0x7fab1800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 shutdown_connections 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab1406aea0 0x7fab1406d360 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab28153e60 0x7fab280c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab280cd6d0 0x7fab28150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 --2- 172.21.15.93:0/2367417781 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab280b4880 0x7fab28152d60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 >> 172.21.15.93:0/2367417781 conn(0x7fab280cf880 msgr2=0x7fab280b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 shutdown_connections 2023-11-04T01:39:10.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.046+0000 7fab2e125640 1 -- 172.21.15.93:0/2367417781 wait complete. 2023-11-04T01:39:10.059 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:10.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.159+0000 7f53671e2640 1 Processor -- start 2023-11-04T01:39:10.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.159+0000 7f53671e2640 1 -- start start 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f53671e2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53600c4ff0 0x7f53600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f53671e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53600adac0 0x7f53600adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f53671e2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536015aff0 con 0x7f5360159c00 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f53671e2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600ae460 con 0x7f53600c4ff0 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f53671e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536015a3e0 con 0x7f53600adac0 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f535ffff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53600c4ff0 0x7f53600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f536577f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53600adac0 0x7f53600adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f5364f7e640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5360159c00 0x7f53600c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:38688/0 (socket says 172.21.15.93:38688) 2023-11-04T01:39:10.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f5364f7e640 1 -- 172.21.15.93:0/2567542229 learned_addr learned my addr 172.21.15.93:0/2567542229 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:10.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f535ffff640 1 -- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53600adac0 msgr2=0x7f53600adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f535ffff640 1 --2- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53600adac0 0x7f53600adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f535ffff640 1 -- 172.21.15.93:0/2567542229 >> v1:172.21.15.125:6789/0 conn(0x7f5360159c00 legacy=0x7f53600c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.160+0000 7f535ffff640 1 -- 172.21.15.93:0/2567542229 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536015a6c0 con 0x7f53600c4ff0 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.161+0000 7f535ffff640 1 --2- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53600cc890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f534c0097a0 tx=0x7f534c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eec84c6505018b43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.161+0000 7f535f7fe640 1 -- 172.21.15.93:0/2567542229 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c031830 con 0x7f53600c4ff0 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.161+0000 7f535f7fe640 1 -- 172.21.15.93:0/2567542229 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c031990 con 0x7f53600c4ff0 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.161+0000 7f535f7fe640 1 -- 172.21.15.93:0/2567542229 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c031d20 con 0x7f53600c4ff0 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 -- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 msgr2=0x7f53600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 --2- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53600cc890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f534c0097a0 tx=0x7f534c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 -- 172.21.15.93:0/2567542229 shutdown_connections 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 --2- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f53600adac0 0x7f53600adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 --2- 172.21.15.93:0/2567542229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53600cc890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 -- 172.21.15.93:0/2567542229 >> 172.21.15.93:0/2567542229 conn(0x7f53600ce950 msgr2=0x7f53600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 -- 172.21.15.93:0/2567542229 shutdown_connections 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.162+0000 7f53671e2640 1 -- 172.21.15.93:0/2567542229 wait complete. 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.163+0000 7f53671e2640 1 Processor -- start 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.163+0000 7f53671e2640 1 -- start start 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53601f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5360159c00 0x7f536014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c8260 con 0x7f53600adac0 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360158f20 con 0x7f53600c4ff0 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f53671e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53601f0560 con 0x7f5360159c00 2023-11-04T01:39:10.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43538/0 (socket says 172.21.15.93:43538) 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 -- 172.21.15.93:0/908328776 learned_addr learned my addr 172.21.15.93:0/908328776 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f535ffff640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53601f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f536577f640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5360159c00 0x7f536014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 -- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5360159c00 msgr2=0x7f536014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5360159c00 0x7f536014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 -- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 msgr2=0x7f53601f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53601f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.164+0000 7f5364f7e640 1 -- 172.21.15.93:0/908328776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009400 con 0x7f53600adac0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f5364f7e640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f535400c480 tx=0x7f535400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354005ce0 con 0x7f53600adac0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354005e40 con 0x7f53600adac0 2023-11-04T01:39:10.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536014e0b0 con 0x7f53600adac0 2023-11-04T01:39:10.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540072f0 con 0x7f53600adac0 2023-11-04T01:39:10.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.165+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536014e670 con 0x7f53600adac0 2023-11-04T01:39:10.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.166+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53600c5a00 con 0x7f53600adac0 2023-11-04T01:39:10.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.166+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5354007510 con 0x7f53600adac0 2023-11-04T01:39:10.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.166+0000 7f535d7fa640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.167+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f5354088c70 con 0x7f53600adac0 2023-11-04T01:39:10.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.167+0000 7f535ffff640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.167+0000 7f535ffff640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 0x7f534406d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f534c036000 tx=0x7f534c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.172+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5354053c30 con 0x7f53600adac0 2023-11-04T01:39:10.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.334+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f5360074290 con 0x7f53600adac0 2023-11-04T01:39:10.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.335+0000 7f535d7fa640 1 -- 172.21.15.93:0/908328776 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f53540170b0 con 0x7f53600adac0 2023-11-04T01:39:10.337 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 msgr2=0x7f534406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 0x7f534406d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f534c036000 tx=0x7f534c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 msgr2=0x7f53601589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f535400c480 tx=0x7f535400c940 comp rx=0 tx=0).stop 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 shutdown_connections 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5360159c00 0x7f536014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53600c4ff0 0x7f53601f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 --2- 172.21.15.93:0/908328776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53600adac0 0x7f53601589e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.336+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 >> 172.21.15.93:0/908328776 conn(0x7f53600ce950 msgr2=0x7f53600709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.337+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 shutdown_connections 2023-11-04T01:39:10.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.337+0000 7f53671e2640 1 -- 172.21.15.93:0/908328776 wait complete. 2023-11-04T01:39:10.349 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:39:10.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.446+0000 7f07607e2640 1 Processor -- start 2023-11-04T01:39:10.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.446+0000 7f07607e2640 1 -- start start 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f07607e2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f075815ce60 0x7f075806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f07607e2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07581615d0 con 0x7f07580cf160 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f07607e2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07581618b0 con 0x7f075806bd30 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f07607e2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580cbde0 con 0x7f075815ce60 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f075e57e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f075815ce60 0x7f075806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f075ed7f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f07580cf160 0x7f07580cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59542/0 (socket says 172.21.15.93:59542) 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.447+0000 7f075ed7f640 1 -- 172.21.15.93:0/1503621789 learned_addr learned my addr 172.21.15.93:0/1503621789 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.448+0000 7f075e57e640 1 -- 172.21.15.93:0/1503621789 >> v1:172.21.15.125:6789/0 conn(0x7f075806bd30 legacy=0x7f0758160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.448+0000 7f075e57e640 1 -- 172.21.15.93:0/1503621789 >> v1:172.21.15.93:6789/0 conn(0x7f07580cf160 legacy=0x7f07580cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.448+0000 7f075d57c640 1 -- 172.21.15.93:0/1503621789 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097413566 0 0) 0x7f07581615d0 con 0x7f07580cf160 2023-11-04T01:39:10.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.448+0000 7f075e57e640 1 -- 172.21.15.93:0/1503621789 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580cba00 con 0x7f075815ce60 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.448+0000 7f075e57e640 1 --2- 172.21.15.93:0/1503621789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f075806b7f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0754009d90 tx=0x7f075402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f67905192ca0f92 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f075d57c640 1 -- 172.21.15.93:0/1503621789 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075402cd00 con 0x7f075815ce60 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f075d57c640 1 -- 172.21.15.93:0/1503621789 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075402ce60 con 0x7f075815ce60 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f075d57c640 1 -- 172.21.15.93:0/1503621789 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754034660 con 0x7f075815ce60 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 -- 172.21.15.93:0/1503621789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 msgr2=0x7f075806b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 --2- 172.21.15.93:0/1503621789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f075806b7f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0754009d90 tx=0x7f075402bf50 comp rx=0 tx=0).stop 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 -- 172.21.15.93:0/1503621789 shutdown_connections 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 --2- 172.21.15.93:0/1503621789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f075806b7f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 -- 172.21.15.93:0/1503621789 >> 172.21.15.93:0/1503621789 conn(0x7f075806ea90 msgr2=0x7f075806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 -- 172.21.15.93:0/1503621789 shutdown_connections 2023-11-04T01:39:10.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.449+0000 7f07607e2640 1 -- 172.21.15.93:0/1503621789 wait complete. 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.450+0000 7f07607e2640 1 Processor -- start 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.450+0000 7f07607e2640 1 -- start start 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 0x7f07581f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f075815dbd0 0x7f07580b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580b2ef0 con 0x7f075815ce60 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07581f34e0 con 0x7f07580cf160 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f07607e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075815e090 con 0x7f075815dbd0 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43552/0 (socket says 172.21.15.93:43552) 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 -- 172.21.15.93:0/1772976737 learned_addr learned my addr 172.21.15.93:0/1772976737 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075ed7f640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f075815dbd0 0x7f07580b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075e57e640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 0x7f07581f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 -- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f075815dbd0 msgr2=0x7f07580b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f075815dbd0 0x7f07580b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 -- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 msgr2=0x7f07581f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.451+0000 7f075dd7d640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 0x7f07581f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f075dd7d640 1 -- 172.21.15.93:0/1772976737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009a70 con 0x7f075815ce60 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f075e57e640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 0x7f07581f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f075dd7d640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f074800c400 tx=0x7f074800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480052d0 con 0x7f075815ce60 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748005430 con 0x7f075815ce60 2023-11-04T01:39:10.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075815e370 con 0x7f075815ce60 2023-11-04T01:39:10.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748003830 con 0x7f075815ce60 2023-11-04T01:39:10.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.452+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075815e930 con 0x7f075815ce60 2023-11-04T01:39:10.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.453+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758074290 con 0x7f075815ce60 2023-11-04T01:39:10.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.453+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0748003990 con 0x7f075815ce60 2023-11-04T01:39:10.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.454+0000 7f074effd640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 0x7f073c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.454+0000 7f075e57e640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 0x7f073c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.454+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f0748088da0 con 0x7f075815ce60 2023-11-04T01:39:10.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.454+0000 7f075e57e640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 0x7f073c06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0754036000 tx=0x7f0754030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.458+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0748053c20 con 0x7f075815ce60 2023-11-04T01:39:10.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.627+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f075806b3e0 con 0x7f075815ce60 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.627+0000 7f074effd640 1 -- 172.21.15.93:0/1772976737 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+287 (secure 0 0 0) 0x7f0748017090 con 0x7f075815ce60 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": ".mgr" 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:10.630 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 7, 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "snap-test-pool" 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 12, 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "test_data_pool" 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: { 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 13, 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:10.631 INFO:teuthology.orchestra.run.smithi093.stdout:] 2023-11-04T01:39:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 msgr2=0x7f073c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 0x7f073c06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0754036000 tx=0x7f0754030000 comp rx=0 tx=0).stop 2023-11-04T01:39:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 msgr2=0x7f07580b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f074800c400 tx=0x7f074800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 shutdown_connections 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f073c06ae70 0x7f073c06d330 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f075815dbd0 0x7f07580b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f075815ce60 0x7f07580b37c0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 --2- 172.21.15.93:0/1772976737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07580cf160 0x7f07581f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 >> 172.21.15.93:0/1772976737 conn(0x7f075806ea90 msgr2=0x7f07580cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 shutdown_connections 2023-11-04T01:39:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.629+0000 7f07607e2640 1 -- 172.21.15.93:0/1772976737 wait complete. 2023-11-04T01:39:10.642 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:39:10.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:39:10.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.742+0000 7ff9de978640 1 Processor -- start 2023-11-04T01:39:10.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.742+0000 7ff9de978640 1 -- start start 2023-11-04T01:39:10.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9de978640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9d815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9de978640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d80d1320 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9de978640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d815df10 con 0x7ff9d80d17b0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9de978640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d815e4d0 con 0x7ff9d815d4b0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9d7fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff9d80cd9f0 0x7ff9d80cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59552/0 (socket says 172.21.15.93:59552) 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.743+0000 7ff9d7fff640 1 -- 172.21.15.93:0/2094604789 learned_addr learned my addr 172.21.15.93:0/2094604789 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d77fe640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9d815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299681864 0 0) 0x7ff9d80d1320 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c0003520 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980281668 0 0) 0x7ff9c0003520 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 msgr2=0x7ff9d815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9d815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 >> v1:172.21.15.125:6789/0 conn(0x7ff9d80d17b0 legacy=0x7ff9d80d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d815e1f0 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ff9c8001670 con 0x7ff9d80cd9f0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 >> v1:172.21.15.93:6789/0 conn(0x7ff9d80cd9f0 legacy=0x7ff9d80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c0004350 0x7ff9c0004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9c0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d815e4d0 con 0x7ff9c00039a0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000b980 con 0x7ff9c0004350 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000bb40 con 0x7ff9d815d4b0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d77fe640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c0004350 0x7ff9c0004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9dcf15640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9c0005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 -- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 msgr2=0x7ff9c0005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d815d4b0 0x7ff9c0005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 -- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c0004350 msgr2=0x7ff9c0004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9c0004350 0x7ff9c0004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.744+0000 7ff9d7fff640 1 -- 172.21.15.93:0/2094604789 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0003520 con 0x7ff9c00039a0 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.745+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9c0003d80 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c210 tx=0x7ff9c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7591730f6a2869b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.745+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c802cae0 con 0x7ff9c00039a0 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.745+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c802cc60 con 0x7ff9c00039a0 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.745+0000 7ff9d6ffd640 1 -- 172.21.15.93:0/2094604789 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80058d0 con 0x7ff9c00039a0 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 -- 172.21.15.93:0/2094604789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 msgr2=0x7ff9c0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 --2- 172.21.15.93:0/2094604789 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9c0003d80 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c210 tx=0x7ff9c00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9dcf15640 1 -- 172.21.15.93:0/2094604789 reap_dead start 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 -- 172.21.15.93:0/2094604789 shutdown_connections 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 -- 172.21.15.93:0/2094604789 >> 172.21.15.93:0/2094604789 conn(0x7ff9d8071c40 msgr2=0x7ff9d8072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 -- 172.21.15.93:0/2094604789 shutdown_connections 2023-11-04T01:39:10.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.746+0000 7ff9de978640 1 -- 172.21.15.93:0/2094604789 wait complete. 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.747+0000 7ff9de978640 1 Processor -- start 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.747+0000 7ff9de978640 1 -- start start 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d80b4fd0 0x7ff9d81e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d81e7170 0x7ff9d80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80b5450 con 0x7ff9c00039a0 2023-11-04T01:39:10.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81e75f0 con 0x7ff9d80b4fd0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9de978640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8158150 con 0x7ff9d81e7170 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:43566/0 (socket says 172.21.15.93:43566) 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 -- 172.21.15.93:0/1900802372 learned_addr learned my addr 172.21.15.93:0/1900802372 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 -- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d81e7170 msgr2=0x7ff9d80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d81e7170 0x7ff9d80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 -- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d80b4fd0 msgr2=0x7ff9d81e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d80b4fd0 0x7ff9d81e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 -- 172.21.15.93:0/1900802372 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d81583f0 con 0x7ff9c00039a0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.748+0000 7ff9d7fff640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff9c802c480 tx=0x7ff9c8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.749+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c803c050 con 0x7ff9c00039a0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.749+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c803a030 con 0x7ff9c00039a0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.749+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d81586d0 con 0x7ff9c00039a0 2023-11-04T01:39:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.749+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007270 con 0x7ff9c00039a0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.749+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80b5630 con 0x7ff9c00039a0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.750+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8158bf0 con 0x7ff9c00039a0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.750+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9c8032070 con 0x7ff9c00039a0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.750+0000 7ff9d4ff9640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.751+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6268+0+0 (secure 0 0 0) 0x7ff9c80aace0 con 0x7ff9c00039a0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.751+0000 7ff9d77fe640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.751+0000 7ff9d77fe640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 0x7ff9c406d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80b7dd0 tx=0x7ff9cc009d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.755+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9d8158bf0 con 0x7ff9c00039a0 2023-11-04T01:39:10.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:10.921+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9d8158bf0 con 0x7ff9c00039a0 2023-11-04T01:39:11.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.522+0000 7ff9d4ff9640 1 -- 172.21.15.93:0/1900802372 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9d8158bf0 con 0x7ff9c00039a0 2023-11-04T01:39:11.523 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2023-11-04T01:39:11.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 msgr2=0x7ff9c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 0x7ff9c406d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80b7dd0 tx=0x7ff9cc009d30 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 msgr2=0x7ff9d80b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff9c802c480 tx=0x7ff9c8001a00 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 shutdown_connections 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9c406aea0 0x7ff9c406d360 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff9d81e7170 0x7ff9d80b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d80b4fd0 0x7ff9d81e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 --2- 172.21.15.93:0/1900802372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9c00039a0 0x7ff9d80b4a90 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 >> 172.21.15.93:0/1900802372 conn(0x7ff9d8071c40 msgr2=0x7ff9d815c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 shutdown_connections 2023-11-04T01:39:11.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.524+0000 7ff9de978640 1 -- 172.21.15.93:0/1900802372 wait complete. 2023-11-04T01:39:11.541 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:39:11.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.646+0000 7f0e35ba5640 1 Processor -- start 2023-11-04T01:39:11.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.646+0000 7f0e35ba5640 1 -- start start 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e35ba5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e30070e20 0x7f0e300adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e35ba5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300c3900 con 0x7f0e300ad730 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e35ba5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300c3be0 con 0x7f0e3015ad30 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e35ba5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e300ae260 con 0x7f0e30070e20 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e30070e20 0x7f0e300adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e30070e20 0x7f0e300adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34890/0 (socket says 172.21.15.93:34890) 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2ffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0e300ad730 0x7f0e3015e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39534/0 (socket says 172.21.15.93:39534) 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 -- 172.21.15.93:0/1729415681 learned_addr learned my addr 172.21.15.93:0/1729415681 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 -- 172.21.15.93:0/1729415681 >> v1:172.21.15.125:6789/0 conn(0x7f0e3015ad30 legacy=0x7f0e30070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 -- 172.21.15.93:0/1729415681 >> v1:172.21.15.93:6789/0 conn(0x7f0e300ad730 legacy=0x7f0e3015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2e7fc640 1 -- 172.21.15.93:0/1729415681 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466450923 0 0) 0x7f0e300c3900 con 0x7f0e300ad730 2023-11-04T01:39:11.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.647+0000 7f0e2effd640 1 -- 172.21.15.93:0/1729415681 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300c3ec0 con 0x7f0e30070e20 2023-11-04T01:39:11.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.648+0000 7f0e2effd640 1 --2- 172.21.15.93:0/1729415681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e30070e20 0x7f0e300adc80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009870 tx=0x7f0e2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc23fe594da934f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.648+0000 7f0e2e7fc640 1 -- 172.21.15.93:0/1729415681 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031870 con 0x7f0e30070e20 2023-11-04T01:39:11.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.648+0000 7f0e2e7fc640 1 -- 172.21.15.93:0/1729415681 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e240319d0 con 0x7f0e30070e20 2023-11-04T01:39:11.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.648+0000 7f0e2e7fc640 1 -- 172.21.15.93:0/1729415681 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031d60 con 0x7f0e30070e20 2023-11-04T01:39:11.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 -- 172.21.15.93:0/1729415681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e30070e20 msgr2=0x7f0e300adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/1729415681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e30070e20 0x7f0e300adc80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009870 tx=0x7f0e2402b910 comp rx=0 tx=0).stop 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 -- 172.21.15.93:0/1729415681 shutdown_connections 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/1729415681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e30070e20 0x7f0e300adc80 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 -- 172.21.15.93:0/1729415681 >> 172.21.15.93:0/1729415681 conn(0x7f0e300ce950 msgr2=0x7f0e300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 -- 172.21.15.93:0/1729415681 shutdown_connections 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.649+0000 7f0e35ba5640 1 -- 172.21.15.93:0/1729415681 wait complete. 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.650+0000 7f0e35ba5640 1 Processor -- start 2023-11-04T01:39:11.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.650+0000 7f0e35ba5640 1 -- start start 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e30070e20 0x7f0e301f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e3015ad30 0x7f0e300abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300ac440 con 0x7f0e300ad730 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300ac720 con 0x7f0e30070e20 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e35ba5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300aca00 con 0x7f0e3015ad30 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34892/0 (socket says 172.21.15.93:34892) 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 -- 172.21.15.93:0/3257878661 learned_addr learned my addr 172.21.15.93:0/3257878661 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2f7fe640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e30070e20 0x7f0e301f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2ffff640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e3015ad30 0x7f0e300abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 -- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e3015ad30 msgr2=0x7f0e300abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e3015ad30 0x7f0e300abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 -- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e30070e20 msgr2=0x7f0e301f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e30070e20 0x7f0e301f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.651+0000 7f0e2effd640 1 -- 172.21.15.93:0/3257878661 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e240094d0 con 0x7f0e300ad730 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e2effd640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009870 tx=0x7f0e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031820 con 0x7f0e300ad730 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e240443f0 con 0x7f0e300ad730 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e300acce0 con 0x7f0e300ad730 2023-11-04T01:39:11.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e240447a0 con 0x7f0e300ad730 2023-11-04T01:39:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.652+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e301f2680 con 0x7f0e300ad730 2023-11-04T01:39:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.653+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e300ad1a0 con 0x7f0e300ad730 2023-11-04T01:39:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.653+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e2404d450 con 0x7f0e300ad730 2023-11-04T01:39:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.654+0000 7f0e17fff640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 0x7f0e1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.654+0000 7f0e2f7fe640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 0x7f0e1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.654+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6638+0+0 (secure 0 0 0) 0x7f0e2402d040 con 0x7f0e300ad730 2023-11-04T01:39:11.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.654+0000 7f0e2f7fe640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 0x7f0e1c06d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006fd0 tx=0x7f0e20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.658+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e24076e60 con 0x7f0e300ad730 2023-11-04T01:39:11.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:11.823+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0e30074290 con 0x7f0e300ad730 2023-11-04T01:39:12.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.524+0000 7f0e17fff640 1 -- 172.21.15.93:0/3257878661 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0e2407a480 con 0x7f0e300ad730 2023-11-04T01:39:12.525 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2023-11-04T01:39:12.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.527+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 msgr2=0x7f0e1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.527+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 0x7f0e1c06d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006fd0 tx=0x7f0e20008040 comp rx=0 tx=0).stop 2023-11-04T01:39:12.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.527+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 msgr2=0x7f0e300ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.527+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009870 tx=0x7f0e240046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 shutdown_connections 2023-11-04T01:39:12.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e1c06ae70 0x7f0e1c06d330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e3015ad30 0x7f0e300abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e300ad730 0x7f0e300ab8d0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 --2- 172.21.15.93:0/3257878661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e30070e20 0x7f0e301f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 >> 172.21.15.93:0/3257878661 conn(0x7f0e300ce950 msgr2=0x7f0e300c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 shutdown_connections 2023-11-04T01:39:12.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.529+0000 7f0e35ba5640 1 -- 172.21.15.93:0/3257878661 wait complete. 2023-11-04T01:39:12.559 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:39:12.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.662+0000 7f810be07640 1 Processor -- start 2023-11-04T01:39:12.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 -- start start 2023-11-04T01:39:12.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8104160600 0x7f81040cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810406e1a0 con 0x7f81040ccde0 2023-11-04T01:39:12.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040ce090 con 0x7f8104160600 2023-11-04T01:39:12.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.663+0000 7f810be07640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040cd330 con 0x7f81041609e0 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f81093a2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8104160600 0x7f81040cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f81093a2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:51420/0 (socket says 172.21.15.93:51420) 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f81093a2640 1 -- 172.21.15.93:0/4183271162 learned_addr learned my addr 172.21.15.93:0/4183271162 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f810a3a4640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f81040ccde0 0x7f81040c9380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:33674/0 (socket says 172.21.15.93:33674) 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8104160600 0x7f81040cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:52314/0 (socket says 172.21.15.93:52314) 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 -- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 msgr2=0x7f81040cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 -- 172.21.15.93:0/4183271162 >> v1:172.21.15.125:6789/0 conn(0x7f81040ccde0 legacy=0x7f81040c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f8109ba3640 1 -- 172.21.15.93:0/4183271162 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810406db50 con 0x7f8104160600 2023-11-04T01:39:12.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.664+0000 7f81093a2640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.665+0000 7f8109ba3640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040cd610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f81000097a0 tx=0x7f810002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fbc9d9cb16b15e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.665+0000 7f8108ba1640 1 -- 172.21.15.93:0/4183271162 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030610 con 0x7f8104160600 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.665+0000 7f8108ba1640 1 -- 172.21.15.93:0/4183271162 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100030770 con 0x7f8104160600 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.665+0000 7f8108ba1640 1 -- 172.21.15.93:0/4183271162 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030b00 con 0x7f8104160600 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 -- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 msgr2=0x7f81040cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040cd610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f81000097a0 tx=0x7f810002b960 comp rx=0 tx=0).stop 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 -- 172.21.15.93:0/4183271162 shutdown_connections 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81041609e0 0x7f81040cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 --2- 172.21.15.93:0/4183271162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040cd610 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 -- 172.21.15.93:0/4183271162 >> 172.21.15.93:0/4183271162 conn(0x7f810406a120 msgr2=0x7f810406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 -- 172.21.15.93:0/4183271162 shutdown_connections 2023-11-04T01:39:12.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.666+0000 7f810be07640 1 -- 172.21.15.93:0/4183271162 wait complete. 2023-11-04T01:39:12.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 Processor -- start 2023-11-04T01:39:12.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 -- start start 2023-11-04T01:39:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81040ccde0 0x7f8104153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040c3960 con 0x7f81041609e0 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810415c340 con 0x7f8104160600 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.667+0000 7f810be07640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040b2e90 con 0x7f81040ccde0 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34904/0 (socket says 172.21.15.93:34904) 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 -- 172.21.15.93:0/1987249321 learned_addr learned my addr 172.21.15.93:0/1987249321 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f8109ba3640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81040ccde0 0x7f8104153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f81093a2640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 -- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81040ccde0 msgr2=0x7f8104153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81040ccde0 0x7f8104153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 -- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 msgr2=0x7f81040c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 -- 172.21.15.93:0/1987249321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40094d0 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810a3a4640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c730 tx=0x7f80fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00ce40 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc00a640 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8100009400 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00a9f0 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.668+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81040c32a0 con 0x7f81041609e0 2023-11-04T01:39:12.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.669+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81040c3aa0 con 0x7f81041609e0 2023-11-04T01:39:12.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.670+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80fc00ab50 con 0x7f81041609e0 2023-11-04T01:39:12.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.670+0000 7f80fa7fc640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 0x7f80e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.670+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 7020+0+0 (secure 0 0 0) 0x7f80fc0891b0 con 0x7f81041609e0 2023-11-04T01:39:12.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.670+0000 7f8109ba3640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 0x7f80e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.671+0000 7f8109ba3640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 0x7f80e806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8100036000 tx=0x7f8100008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.675+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81040c3aa0 con 0x7f81041609e0 2023-11-04T01:39:12.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:12.876+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f81040c3aa0 con 0x7f81041609e0 2023-11-04T01:39:13.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.543+0000 7f80fa7fc640 1 -- 172.21.15.93:0/1987249321 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f81040c3aa0 con 0x7f81041609e0 2023-11-04T01:39:13.545 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 16 and data pool 17 2023-11-04T01:39:13.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.551+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 msgr2=0x7f80e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.551+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 0x7f80e806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8100036000 tx=0x7f8100008030 comp rx=0 tx=0).stop 2023-11-04T01:39:13.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.551+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 msgr2=0x7f81040b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.551+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c730 tx=0x7f80fc00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 shutdown_connections 2023-11-04T01:39:13.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80e806ae70 0x7f80e806d330 secure :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8100036000 tx=0x7f8100008030 comp rx=0 tx=0).stop 2023-11-04T01:39:13.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81041609e0 0x7f81040b3b70 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8104160600 0x7f81040c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 --2- 172.21.15.93:0/1987249321 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f81040ccde0 0x7f8104153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.552+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 >> 172.21.15.93:0/1987249321 conn(0x7f810406a120 msgr2=0x7f810406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.554+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 shutdown_connections 2023-11-04T01:39:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.555+0000 7f810be07640 1 -- 172.21.15.93:0/1987249321 wait complete. 2023-11-04T01:39:13.576 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 Processor -- start 2023-11-04T01:39:13.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 -- start start 2023-11-04T01:39:13.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad60159c70 0x7fad600ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad600b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad600b4110 con 0x7fad600b0910 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600b49b0 con 0x7fad60159c70 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.676+0000 7fad68007640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600b0da0 con 0x7fad6006db20 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad665a4640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fad600b0910 0x7fad6015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39550/0 (socket says 172.21.15.93:39550) 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad665a4640 1 -- 172.21.15.93:0/2282138466 learned_addr learned my addr 172.21.15.93:0/2282138466 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 --2- 172.21.15.93:0/2282138466 >> v2:172.21.15.125:3300/0 conn(0x7fad60159c70 0x7fad600ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177990622 0 0) 0x7fad600b4110 con 0x7fad600b0910 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad655a2640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad600b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c003520 con 0x7fad600b0910 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566190079 0 0) 0x7fad4c003520 con 0x7fad600b0910 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 msgr2=0x7fad600b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad600b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 >> v2:172.21.15.125:3300/0 conn(0x7fad60159c70 msgr2=0x7fad600ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 --2- 172.21.15.93:0/2282138466 >> v2:172.21.15.125:3300/0 conn(0x7fad60159c70 0x7fad600ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600b43f0 con 0x7fad600b0910 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fad5c001670 con 0x7fad600b0910 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 >> v1:172.21.15.93:6789/0 conn(0x7fad600b0910 legacy=0x7fad6015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad4c003970 0x7fad4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0047c0 0x7fad4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600b49b0 con 0x7fad4c003970 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600b0da0 con 0x7fad4c0047c0 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c00b980 con 0x7fad6006db20 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad4c003970 0x7fad4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad655a2640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0047c0 0x7fad4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad665a4640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 -- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 msgr2=0x7fad4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad6006db20 0x7fad4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 -- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0047c0 msgr2=0x7fad4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0047c0 0x7fad4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.677+0000 7fad65da3640 1 -- 172.21.15.93:0/2282138466 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c003520 con 0x7fad4c003970 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.678+0000 7fad655a2640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c0047c0 0x7fad4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.678+0000 7fad65da3640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad4c003970 0x7fad4c003d90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fad58009fc0 tx=0x7fad4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8e35fad0bdfc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.678+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5802cc60 con 0x7fad4c003970 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.678+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800f040 con 0x7fad4c003970 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.678+0000 7fad64da1640 1 -- 172.21.15.93:0/2282138466 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58034440 con 0x7fad4c003970 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 -- 172.21.15.93:0/2282138466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad4c003970 msgr2=0x7fad4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 --2- 172.21.15.93:0/2282138466 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad4c003970 0x7fad4c003d90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fad58009fc0 tx=0x7fad4c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad665a4640 1 -- 172.21.15.93:0/2282138466 reap_dead start 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 -- 172.21.15.93:0/2282138466 shutdown_connections 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 -- 172.21.15.93:0/2282138466 >> 172.21.15.93:0/2282138466 conn(0x7fad600ce950 msgr2=0x7fad600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 -- 172.21.15.93:0/2282138466 shutdown_connections 2023-11-04T01:39:13.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.679+0000 7fad68007640 1 -- 172.21.15.93:0/2282138466 wait complete. 2023-11-04T01:39:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.680+0000 7fad68007640 1 Processor -- start 2023-11-04T01:39:13.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.680+0000 7fad68007640 1 -- start start 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c003970 0x7fad601f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 0x7fad600af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600b35b0 con 0x7fad600b3130 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600ad580 con 0x7fad4c003970 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad68007640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6014c5f0 con 0x7fad600af220 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34922/0 (socket says 172.21.15.93:34922) 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 -- 172.21.15.93:0/3284917328 learned_addr learned my addr 172.21.15.93:0/3284917328 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad65da3640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c003970 0x7fad601f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad665a4640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 0x7fad600af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 -- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 msgr2=0x7fad600af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 0x7fad600af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 -- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c003970 msgr2=0x7fad601f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c003970 0x7fad601f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 -- 172.21.15.93:0/3284917328 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad601f2be0 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad665a4640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 0x7fad600af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.681+0000 7fad655a2640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fad50011700 tx=0x7fad50011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.682+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000f9c0 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.682+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000fb20 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.682+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad601f2ec0 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.682+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000fed0 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.682+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad600b0690 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.683+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60074290 con 0x7fad600b3130 2023-11-04T01:39:13.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.683+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad50015460 con 0x7fad600b3130 2023-11-04T01:39:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.683+0000 7fad567fc640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 0x7fad4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.683+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fad5008a350 con 0x7fad600b3130 2023-11-04T01:39:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.683+0000 7fad65da3640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 0x7fad4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.684+0000 7fad65da3640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 0x7fad4406d360 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fad58036000 tx=0x7fad5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.688+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad50054e80 con 0x7fad600b3130 2023-11-04T01:39:13.859 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.858+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad6006d3f0 con 0x7fad600b3130 2023-11-04T01:39:13.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.859+0000 7fad567fc640 1 -- 172.21.15.93:0/3284917328 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+22030 (secure 0 0 0) 0x7fad500584a0 con 0x7fad600b3130 2023-11-04T01:39:13.861 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:13.861 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":94,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:39:12.877117+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 msgr2=0x7fad4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 0x7fad4406d360 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fad58036000 tx=0x7fad5802e000 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 msgr2=0x7fad600b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fad50011700 tx=0x7fad50011bc0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 shutdown_connections 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fad4406aea0 0x7fad4406d360 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fad600af220 0x7fad600af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad600b3130 0x7fad600b0150 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 --2- 172.21.15.93:0/3284917328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad4c003970 0x7fad601f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 >> 172.21.15.93:0/3284917328 conn(0x7fad600ce950 msgr2=0x7fad600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 shutdown_connections 2023-11-04T01:39:13.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.861+0000 7fad68007640 1 -- 172.21.15.93:0/3284917328 wait complete. 2023-11-04T01:39:13.873 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:13.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 Processor -- start 2023-11-04T01:39:13.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 -- start start 2023-11-04T01:39:13.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c54159c70 0x7f2c540ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540b4110 con 0x7f2c5406db20 2023-11-04T01:39:13.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540b43f0 con 0x7f2c540b0ae0 2023-11-04T01:39:13.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.972+0000 7f2c5acc9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c540b49b0 con 0x7f2c54159c70 2023-11-04T01:39:13.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c58a65640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c54159c70 0x7f2c540ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c53fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2c5406db20 0x7f2c540b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39560/0 (socket says 172.21.15.93:39560) 2023-11-04T01:39:13.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c53fff640 1 -- 172.21.15.93:0/3890629933 learned_addr learned my addr 172.21.15.93:0/3890629933 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:13.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c58a65640 1 -- 172.21.15.93:0/3890629933 >> v1:172.21.15.125:6789/0 conn(0x7f2c540b0ae0 legacy=0x7f2c5415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c58a65640 1 -- 172.21.15.93:0/3890629933 >> v1:172.21.15.93:6789/0 conn(0x7f2c5406db20 legacy=0x7f2c540b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.973+0000 7f2c58a65640 1 -- 172.21.15.93:0/3890629933 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540b46d0 con 0x7f2c54159c70 2023-11-04T01:39:13.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c58a65640 1 --2- 172.21.15.93:0/3890629933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c54159c70 0x7f2c540ce370 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009d90 tx=0x7f2c4c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4e25a4c9dd221e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c537fe640 1 -- 172.21.15.93:0/3890629933 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c02cd00 con 0x7f2c54159c70 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c537fe640 1 -- 172.21.15.93:0/3890629933 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c02ce60 con 0x7f2c54159c70 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c537fe640 1 -- 172.21.15.93:0/3890629933 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c034660 con 0x7f2c54159c70 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 -- 172.21.15.93:0/3890629933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c54159c70 msgr2=0x7f2c540ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/3890629933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c54159c70 0x7f2c540ce370 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009d90 tx=0x7f2c4c02bf50 comp rx=0 tx=0).stop 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 -- 172.21.15.93:0/3890629933 shutdown_connections 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/3890629933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c54159c70 0x7f2c540ce370 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 -- 172.21.15.93:0/3890629933 >> 172.21.15.93:0/3890629933 conn(0x7f2c540ce950 msgr2=0x7f2c540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 -- 172.21.15.93:0/3890629933 shutdown_connections 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.974+0000 7f2c5acc9640 1 -- 172.21.15.93:0/3890629933 wait complete. 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.975+0000 7f2c5acc9640 1 Processor -- start 2023-11-04T01:39:13.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 -- start start 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c540b0ae0 0x7f2c54145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 0x7f2c540b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540c6b10 con 0x7f2c5406db20 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540c6df0 con 0x7f2c54159c70 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c5acc9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540c70d0 con 0x7f2c540b0ae0 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.976+0000 7f2c58a65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34940/0 (socket says 172.21.15.93:34940) 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 -- 172.21.15.93:0/45661868 learned_addr learned my addr 172.21.15.93:0/45661868 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:13.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c53fff640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c540b0ae0 0x7f2c54145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c59266640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 0x7f2c540b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 -- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c540b0ae0 msgr2=0x7f2c54145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c540b0ae0 0x7f2c54145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 -- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 msgr2=0x7f2c540b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 0x7f2c540b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 -- 172.21.15.93:0/45661868 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c009a70 con 0x7f2c5406db20 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c59266640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 0x7f2c540b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c58a65640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009d90 tx=0x7f2c4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c03d600 con 0x7f2c5406db20 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c03d760 con 0x7f2c5406db20 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c03db10 con 0x7f2c5406db20 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c540c73b0 con 0x7f2c5406db20 2023-11-04T01:39:13.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.977+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c540c85b0 con 0x7f2c5406db20 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.978+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c540c78d0 con 0x7f2c5406db20 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.978+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c4c03b040 con 0x7f2c5406db20 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.979+0000 7f2c517fa640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 0x7f2c3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.979+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2c4c0abbe0 con 0x7f2c5406db20 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.979+0000 7f2c53fff640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 0x7f2c3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.979+0000 7f2c53fff640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 0x7f2c3406d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c540b2cb0 tx=0x7f2c3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:13.983+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c540c78d0 con 0x7f2c5406db20 2023-11-04T01:39:14.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.150+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c54074290 con 0x7f2c5406db20 2023-11-04T01:39:14.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.152+0000 7f2c517fa640 1 -- 172.21.15.93:0/45661868 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+22030 (secure 0 0 0) 0x7f2c4c076720 con 0x7f2c5406db20 2023-11-04T01:39:14.153 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:14.154 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":94,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:39:12.877117+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:14.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 msgr2=0x7f2c3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 0x7f2c3406d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c540b2cb0 tx=0x7f2c3c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:14.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 msgr2=0x7f2c541f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009d90 tx=0x7f2c4c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 shutdown_connections 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c3406ae70 0x7f2c3406d330 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c54159c70 0x7f2c540b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c540b0ae0 0x7f2c54145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 --2- 172.21.15.93:0/45661868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c5406db20 0x7f2c541f2060 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 >> 172.21.15.93:0/45661868 conn(0x7f2c540ce950 msgr2=0x7f2c540cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 shutdown_connections 2023-11-04T01:39:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.154+0000 7f2c5acc9640 1 -- 172.21.15.93:0/45661868 wait complete. 2023-11-04T01:39:14.166 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:14.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.267+0000 7fa2d7061640 1 Processor -- start 2023-11-04T01:39:14.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.267+0000 7fa2d7061640 1 -- start start 2023-11-04T01:39:14.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2d7061640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa2d00cc9d0 0x7fa2d00c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2d7061640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d00c3860 con 0x7fa2d00cc520 2023-11-04T01:39:14.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2d7061640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d00c9250 con 0x7fa2d0153850 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2d7061640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0153c30 con 0x7fa2d00cc9d0 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2cffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa2d00cc520 0x7fa2d0070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39568/0 (socket says 172.21.15.93:39568) 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2cffff640 1 -- 172.21.15.93:0/4173024454 learned_addr learned my addr 172.21.15.93:0/4173024454 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.268+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/4173024454 >> v2:172.21.15.125:3300/0 conn(0x7fa2d00cc9d0 0x7fa2d00c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838051091 0 0) 0x7fa2d00c3860 con 0x7fa2d00cc520 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc003520 con 0x7fa2d00cc520 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281388081 0 0) 0x7fa2bc003520 con 0x7fa2d00cc520 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 >> v2:172.21.15.125:3300/0 conn(0x7fa2d00cc9d0 msgr2=0x7fa2d00c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 --2- 172.21.15.93:0/4173024454 >> v2:172.21.15.125:3300/0 conn(0x7fa2d00cc9d0 0x7fa2d00c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 >> v1:172.21.15.125:6789/0 conn(0x7fa2d0153850 legacy=0x7fa2d015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00ce590 con 0x7fa2d00cc520 2023-11-04T01:39:14.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa2c0001670 con 0x7fa2d00cc520 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 >> v1:172.21.15.93:6789/0 conn(0x7fa2d00cc520 legacy=0x7fa2d0070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 0x7fa2bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc0047c0 0x7fa2bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2bc005180 0x7fa2bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0153c30 con 0x7fa2bc003970 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc00c020 con 0x7fa2bc0047c0 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc00c1e0 con 0x7fa2bc005180 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 0x7fa2bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2cffff640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc0047c0 0x7fa2bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2bc005180 0x7fa2bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 -- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2bc005180 msgr2=0x7fa2bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2bc005180 0x7fa2bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 -- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc0047c0 msgr2=0x7fa2bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc0047c0 0x7fa2bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d4dfd640 1 -- 172.21.15.93:0/4173024454 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc003520 con 0x7fa2bc003970 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2bc005180 0x7fa2bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.269+0000 7fa2d55fe640 1 -- 172.21.15.93:0/4173024454 reap_dead start 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.270+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 0x7fa2bc003d90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001750 tx=0x7fa2bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f7683381d8d9b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.270+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80052d0 con 0x7fa2bc003970 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.270+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b802e050 con 0x7fa2bc003970 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.270+0000 7fa2cf7fe640 1 -- 172.21.15.93:0/4173024454 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8003830 con 0x7fa2bc003970 2023-11-04T01:39:14.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 -- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 msgr2=0x7fa2bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 0x7fa2bc003d90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001750 tx=0x7fa2bc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 -- 172.21.15.93:0/4173024454 shutdown_connections 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 --2- 172.21.15.93:0/4173024454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2bc003970 0x7fa2bc003d90 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 -- 172.21.15.93:0/4173024454 >> 172.21.15.93:0/4173024454 conn(0x7fa2d00ce950 msgr2=0x7fa2d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 -- 172.21.15.93:0/4173024454 shutdown_connections 2023-11-04T01:39:14.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.271+0000 7fa2d7061640 1 -- 172.21.15.93:0/4173024454 wait complete. 2023-11-04T01:39:14.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.272+0000 7fa2d7061640 1 Processor -- start 2023-11-04T01:39:14.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.272+0000 7fa2d7061640 1 -- start start 2023-11-04T01:39:14.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc003970 0x7fa2d00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2d0147790 0x7fa2d0148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00b1530 con 0x7fa2d00b3840 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00b4200 con 0x7fa2bc003970 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0147ec0 con 0x7fa2d0147790 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34960/0 (socket says 172.21.15.93:34960) 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 -- 172.21.15.93:0/1511650355 learned_addr learned my addr 172.21.15.93:0/1511650355 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 -- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2d0147790 msgr2=0x7fa2d0148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2d0147790 0x7fa2d0148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 -- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc003970 msgr2=0x7fa2d00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc003970 0x7fa2d00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 -- 172.21.15.93:0/1511650355 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0147c10 con 0x7fa2d00b3840 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d55fe640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00c4fe0 tx=0x7fa2c8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c801b070 con 0x7fa2d00b3840 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800f040 con 0x7fa2d00b3840 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800e050 con 0x7fa2d00b3840 2023-11-04T01:39:14.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.273+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d00b1710 con 0x7fa2d00b3840 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.274+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00b1cd0 con 0x7fa2d00b3840 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.274+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d0074290 con 0x7fa2d00b3840 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.275+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2c8015440 con 0x7fa2d00b3840 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.275+0000 7fa2cd7fa640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 0x7fa2b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.275+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa2c8089e80 con 0x7fa2d00b3840 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.275+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 0x7fa2b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.276+0000 7fa2d4dfd640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 0x7fa2b006d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8033000 tx=0x7fa2b802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.279+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2c80549b0 con 0x7fa2d00b3840 2023-11-04T01:39:14.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.485+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa2d00c5010 con 0x7fa2d00b3840 2023-11-04T01:39:14.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.551+0000 7fa2cd7fa640 1 -- 172.21.15.93:0/1511650355 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa2c8057fd0 con 0x7fa2d00b3840 2023-11-04T01:39:14.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 msgr2=0x7fa2b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 0x7fa2b006d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8033000 tx=0x7fa2b802f000 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 msgr2=0x7fa2d00b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00c4fe0 tx=0x7fa2c8010590 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 shutdown_connections 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006ae70 0x7fa2b006d330 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2d00b3840 0x7fa2d00b3cc0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2d0147790 0x7fa2d0148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 --2- 172.21.15.93:0/1511650355 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2bc003970 0x7fa2d00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 >> 172.21.15.93:0/1511650355 conn(0x7fa2d00ce950 msgr2=0x7fa2d00cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 shutdown_connections 2023-11-04T01:39:14.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.553+0000 7fa2d7061640 1 -- 172.21.15.93:0/1511650355 wait complete. 2023-11-04T01:39:14.565 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:14.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:14.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.666+0000 7f59f582d640 1 Processor -- start 2023-11-04T01:39:14.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.666+0000 7f59f582d640 1 -- start start 2023-11-04T01:39:14.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59f582d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59f00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59f582d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00cde60 con 0x7f59f00cd6d0 2023-11-04T01:39:14.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59f582d640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f0160f90 con 0x7f59f0153e60 2023-11-04T01:39:14.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59f582d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b5200 con 0x7f59f00b4880 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59ee7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f59f00cd6d0 0x7f59f0161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39572/0 (socket says 172.21.15.93:39572) 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.667+0000 7f59ee7fc640 1 -- 172.21.15.93:0/2638188562 learned_addr learned my addr 172.21.15.93:0/2638188562 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576895851 0 0) 0x7f59f00cde60 con 0x7f59f00cd6d0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003520 con 0x7f59f00cd6d0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59f00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511791712 0 0) 0x7f59d8003520 con 0x7f59f00cd6d0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 msgr2=0x7f59f00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59f00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 >> v1:172.21.15.125:6789/0 conn(0x7f59f0153e60 legacy=0x7f59f015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00ce090 con 0x7f59f00cd6d0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f59e4001670 con 0x7f59f00cd6d0 2023-11-04T01:39:14.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59f00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 >> v1:172.21.15.93:6789/0 conn(0x7f59f00cd6d0 legacy=0x7f59f0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59d80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59d8003f90 0x7f59d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d8004d00 0x7f59d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b5200 con 0x7f59d8004d00 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d800bae0 con 0x7f59d8003f90 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d800bca0 con 0x7f59f00b4880 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d8004d00 0x7f59d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59eeffd640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59d80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ee7fc640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59d8003f90 0x7f59d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 -- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 msgr2=0x7f59d80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f00b4880 0x7f59d80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 -- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59d8003f90 msgr2=0x7f59d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59d8003f90 0x7f59d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.668+0000 7f59ef7fe640 1 -- 172.21.15.93:0/2638188562 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8003520 con 0x7f59d8004d00 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.669+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d8004d00 0x7f59d8005180 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098a0 tx=0x7f59d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa101c118708e432 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.669+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004230 con 0x7f59d8004d00 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.669+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8004390 con 0x7f59d8004d00 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.669+0000 7f59edffb640 1 -- 172.21.15.93:0/2638188562 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8003830 con 0x7f59d8004d00 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 -- 172.21.15.93:0/2638188562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d8004d00 msgr2=0x7f59d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 --2- 172.21.15.93:0/2638188562 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d8004d00 0x7f59d8005180 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098a0 tx=0x7f59d80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59ef7fe640 1 -- 172.21.15.93:0/2638188562 reap_dead start 2023-11-04T01:39:14.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 -- 172.21.15.93:0/2638188562 shutdown_connections 2023-11-04T01:39:14.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 -- 172.21.15.93:0/2638188562 >> 172.21.15.93:0/2638188562 conn(0x7f59f00cf880 msgr2=0x7f59f00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 -- 172.21.15.93:0/2638188562 shutdown_connections 2023-11-04T01:39:14.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.670+0000 7f59f582d640 1 -- 172.21.15.93:0/2638188562 wait complete. 2023-11-04T01:39:14.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.671+0000 7f59f582d640 1 Processor -- start 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.671+0000 7f59f582d640 1 -- start start 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f0154dd0 0x7f59f01f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f00ca410 0x7f59f0145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0144b70 con 0x7f59f0155b60 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0157900 con 0x7f59f00ca410 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f01f30e0 con 0x7f59f0154dd0 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34982/0 (socket says 172.21.15.93:34982) 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 -- 172.21.15.93:0/240570017 learned_addr learned my addr 172.21.15.93:0/240570017 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:14.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ef7fe640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f00ca410 0x7f59f0145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59eeffd640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f0154dd0 0x7f59f01f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 -- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f0154dd0 msgr2=0x7f59f01f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f0154dd0 0x7f59f01f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 -- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f00ca410 msgr2=0x7f59f0145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f00ca410 0x7f59f0145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 -- 172.21.15.93:0/240570017 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f01f33c0 con 0x7f59f0155b60 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59ee7fc640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f59e400eaa0 tx=0x7f59e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400c820 con 0x7f59f0155b60 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400c9a0 con 0x7f59f0155b60 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f01f36a0 con 0x7f59f0155b60 2023-11-04T01:39:14.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.672+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400cd50 con 0x7f59f0155b60 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.673+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f0155fe0 con 0x7f59f0155b60 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.673+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f0074290 con 0x7f59f0155b60 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.674+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59e401d460 con 0x7f59f0155b60 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.674+0000 7f59d7fff640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 0x7f59dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.674+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f59e4089bf0 con 0x7f59f0155b60 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.674+0000 7f59eeffd640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 0x7f59dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.675+0000 7f59eeffd640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 0x7f59dc06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f59f00b7bf0 tx=0x7f59e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.678+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59e4054720 con 0x7f59f0155b60 2023-11-04T01:39:14.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:14.878+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f59f0074290 con 0x7f59f0155b60 2023-11-04T01:39:15.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.558+0000 7f59d7fff640 1 -- 172.21.15.93:0/240570017 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59e4057d40 con 0x7f59f0155b60 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 msgr2=0x7f59dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 0x7f59dc06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f59f00b7bf0 tx=0x7f59e0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 msgr2=0x7f59f00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f59e400eaa0 tx=0x7f59e400ef60 comp rx=0 tx=0).stop 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 shutdown_connections 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f59dc06ae70 0x7f59dc06d330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f00ca410 0x7f59f0145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59f0155b60 0x7f59f00c9ed0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.562 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 --2- 172.21.15.93:0/240570017 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f59f0154dd0 0x7f59f01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 >> 172.21.15.93:0/240570017 conn(0x7f59f00cf880 msgr2=0x7f59f00b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 shutdown_connections 2023-11-04T01:39:15.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.560+0000 7f59f582d640 1 -- 172.21.15.93:0/240570017 wait complete. 2023-11-04T01:39:15.574 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:39:15.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.675+0000 7fc47ac89640 1 Processor -- start 2023-11-04T01:39:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.675+0000 7fc47ac89640 1 -- start start 2023-11-04T01:39:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc47ac89640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4740b42c0 0x7fc4740c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc47ac89640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4740c9c40 0x7fc4740b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc47ac89640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4740ca050 con 0x7fc47415ad80 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc47ac89640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47406cfa0 con 0x7fc4740b42c0 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc47ac89640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47406d280 con 0x7fc4740c9c40 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc473fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4740b42c0 0x7fc4740c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc478a25640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc47415ad80 0x7fc47406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39586/0 (socket says 172.21.15.93:39586) 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc478a25640 1 -- 172.21.15.93:0/2015957499 learned_addr learned my addr 172.21.15.93:0/2015957499 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc473fff640 1 -- 172.21.15.93:0/2015957499 >> v2:172.21.15.125:3300/0 conn(0x7fc4740c9c40 msgr2=0x7fc4740b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc473fff640 1 --2- 172.21.15.93:0/2015957499 >> v2:172.21.15.125:3300/0 conn(0x7fc4740c9c40 0x7fc4740b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc473fff640 1 -- 172.21.15.93:0/2015957499 >> v1:172.21.15.93:6789/0 conn(0x7fc47415ad80 legacy=0x7fc47406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc4737fe640 1 -- 172.21.15.93:0/2015957499 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113560004 0 0) 0x7fc4740ca050 con 0x7fc47415ad80 2023-11-04T01:39:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.676+0000 7fc473fff640 1 -- 172.21.15.93:0/2015957499 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47406d560 con 0x7fc4740b42c0 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc473fff640 1 --2- 172.21.15.93:0/2015957499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4740b42c0 0x7fc4740c9700 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c8e50 tx=0x7fc46002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cbd27e05a3b591 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc4737fe640 1 -- 172.21.15.93:0/2015957499 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460030610 con 0x7fc4740b42c0 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc4737fe640 1 -- 172.21.15.93:0/2015957499 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460030770 con 0x7fc4740b42c0 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc4737fe640 1 -- 172.21.15.93:0/2015957499 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460030b00 con 0x7fc4740b42c0 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc47ac89640 1 -- 172.21.15.93:0/2015957499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4740b42c0 msgr2=0x7fc4740c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2015957499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4740b42c0 0x7fc4740c9700 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c8e50 tx=0x7fc46002b960 comp rx=0 tx=0).stop 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc47ac89640 1 -- 172.21.15.93:0/2015957499 shutdown_connections 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2015957499 >> v2:172.21.15.125:3300/0 conn(0x7fc4740c9c40 0x7fc4740b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.677+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2015957499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4740b42c0 0x7fc4740c9700 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.678+0000 7fc47ac89640 1 -- 172.21.15.93:0/2015957499 >> 172.21.15.93:0/2015957499 conn(0x7fc4740ce950 msgr2=0x7fc4740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.678+0000 7fc47ac89640 1 -- 172.21.15.93:0/2015957499 shutdown_connections 2023-11-04T01:39:15.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.678+0000 7fc47ac89640 1 -- 172.21.15.93:0/2015957499 wait complete. 2023-11-04T01:39:15.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 Processor -- start 2023-11-04T01:39:15.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 -- start start 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4740b42c0 0x7fc47414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4740c9c40 0x7fc4740a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740c7960 con 0x7fc47415ad80 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.679+0000 7fc47ac89640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740c6ce0 con 0x7fc4740c9c40 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc47ac89640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740c6fc0 con 0x7fc4740b42c0 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35008/0 (socket says 172.21.15.93:35008) 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 -- 172.21.15.93:0/2115086423 learned_addr learned my addr 172.21.15.93:0/2115086423 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 -- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4740b42c0 msgr2=0x7fc47414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4740b42c0 0x7fc47414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 -- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4740c9c40 msgr2=0x7fc4740a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4740c9c40 0x7fc4740a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 -- 172.21.15.93:0/2115086423 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc460009400 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc479226640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00b970 tx=0x7fc46c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00cb40 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c00ccc0 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c014680 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4740c72a0 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.680+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47414dc80 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.681+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4740c7aa0 con 0x7fc47415ad80 2023-11-04T01:39:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.682+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc46c01d3b0 con 0x7fc47415ad80 2023-11-04T01:39:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.682+0000 7fc4717fa640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.682+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc46c089b50 con 0x7fc47415ad80 2023-11-04T01:39:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.682+0000 7fc478a25640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.683+0000 7fc478a25640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc468007fd0 tx=0x7fc468007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.686+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4740c7aa0 con 0x7fc47415ad80 2023-11-04T01:39:15.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.886+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4740c7aa0 con 0x7fc47415ad80 2023-11-04T01:39:15.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.887+0000 7fc4717fa640 1 -- 172.21.15.93:0/2115086423 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fc4740c7aa0 con 0x7fc47415ad80 2023-11-04T01:39:15.889 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:15.889 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:14.879010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:15.889 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 44 2023-11-04T01:39:15.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 msgr2=0x7fc45806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc468007fd0 tx=0x7fc468007920 comp rx=0 tx=0).stop 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 msgr2=0x7fc4740aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00b970 tx=0x7fc46c00be30 comp rx=0 tx=0).stop 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 shutdown_connections 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc47415ad80 0x7fc4740aff10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4740c9c40 0x7fc4740a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 --2- 172.21.15.93:0/2115086423 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4740b42c0 0x7fc47414d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 >> 172.21.15.93:0/2115086423 conn(0x7fc4740ce950 msgr2=0x7fc4740ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 shutdown_connections 2023-11-04T01:39:15.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.889+0000 7fc47ac89640 1 -- 172.21.15.93:0/2115086423 wait complete. 2023-11-04T01:39:15.901 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:16.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.999+0000 7f1e90d3c640 1 Processor -- start 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:15.999+0000 7f1e90d3c640 1 -- start start 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e90d3c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e90d3c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e8c0cb5c0 0x7f1e8c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e90d3c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c06a120 con 0x7f1e8c15d250 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e90d3c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0cdc10 con 0x7f1e8c15ce70 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e90d3c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c06def0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35024/0 (socket says 172.21.15.93:35024) 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1289640603 learned_addr learned my addr 172.21.15.93:0/1289640603 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8ad9d640 1 --2- 172.21.15.93:0/1289640603 >> v2:172.21.15.125:3300/0 conn(0x7f1e8c0cb5c0 0x7f1e8c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1289640603 >> v2:172.21.15.125:3300/0 conn(0x7f1e8c0cb5c0 msgr2=0x7f1e8c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 --2- 172.21.15.93:0/1289640603 >> v2:172.21.15.125:3300/0 conn(0x7f1e8c0cb5c0 0x7f1e8c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1289640603 >> v1:172.21.15.125:6789/0 conn(0x7f1e8c15d250 legacy=0x7f1e8c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.000+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1289640603 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0c9f40 con 0x7f1e8c15ce70 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.001+0000 7f1e8a59c640 1 --2- 172.21.15.93:0/1289640603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c09cee0 tx=0x7f1e7c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74ed2e1b2b61915 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.001+0000 7f1e89d9b640 1 -- 172.21.15.93:0/1289640603 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c030860 con 0x7f1e8c15ce70 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.001+0000 7f1e89d9b640 1 -- 172.21.15.93:0/1289640603 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c0309c0 con 0x7f1e8c15ce70 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.001+0000 7f1e89d9b640 1 -- 172.21.15.93:0/1289640603 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c030d50 con 0x7f1e8c15ce70 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1289640603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c15ce70 msgr2=0x7f1e8c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1289640603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c09cee0 tx=0x7f1e7c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1289640603 shutdown_connections 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1289640603 >> v2:172.21.15.125:3300/0 conn(0x7f1e8c0cb5c0 0x7f1e8c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1289640603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c15ce70 0x7f1e8c06d9b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1289640603 >> 172.21.15.93:0/1289640603 conn(0x7f1e8c0b0cd0 msgr2=0x7f1e8c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1289640603 shutdown_connections 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.002+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1289640603 wait complete. 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.003+0000 7f1e90d3c640 1 Processor -- start 2023-11-04T01:39:16.012 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.003+0000 7f1e90d3c640 1 -- start start 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 0x7f1e8c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 0x7f1e8c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0b3a10 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0b5000 con 0x7f1e8c15d250 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c1f2c50 con 0x7f1e8c15ce70 2023-11-04T01:39:16.013 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35038/0 (socket says 172.21.15.93:35038) 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1791863140 learned_addr learned my addr 172.21.15.93:0/1791863140 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8ad9d640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 0x7f1e8c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e83fff640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 0x7f1e8c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 msgr2=0x7f1e8c1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 0x7f1e8c1552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.014 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 msgr2=0x7f1e8c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 0x7f1e8c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 -- 172.21.15.93:0/1791863140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0094d0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e83fff640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 0x7f1e8c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8ad9d640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 0x7f1e8c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e8a59c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c02b9e0 tx=0x7f1e7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c039d60 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c043400 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0437b0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.004+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c0b3730 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.005+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c0b4c20 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.006+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c0b47a0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.006+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e7c043910 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.006+0000 7f1e82ffd640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 0x7f1e6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.007+0000 7f1e83fff640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 0x7f1e6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.007+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1e7c03e070 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.007+0000 7f1e83fff640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 0x7f1e6c06d360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007fd0 tx=0x7f1e74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.011+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e8c0b47a0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.177+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e8c0b47a0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.178+0000 7f1e82ffd640 1 -- 172.21.15.93:0/1791863140 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22017 (secure 0 0 0) 0x7f1e8c0b47a0 con 0x7f1e8c0cb5c0 2023-11-04T01:39:16.180 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:16.180 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":95,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:39:14.543056+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:16.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 msgr2=0x7f1e6c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 0x7f1e6c06d360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007fd0 tx=0x7f1e74009040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 msgr2=0x7f1e8c0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c02b9e0 tx=0x7f1e7c004730 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 shutdown_connections 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e6c06aea0 0x7f1e6c06d360 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e8c15d250 0x7f1e8c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e8c15ce70 0x7f1e8c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 --2- 172.21.15.93:0/1791863140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e8c0cb5c0 0x7f1e8c0b6fb0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 >> 172.21.15.93:0/1791863140 conn(0x7f1e8c0b0cd0 msgr2=0x7f1e8c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 shutdown_connections 2023-11-04T01:39:16.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.180+0000 7f1e90d3c640 1 -- 172.21.15.93:0/1791863140 wait complete. 2023-11-04T01:39:16.192 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:39:16.192 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:16.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.291+0000 7f2847210640 1 Processor -- start 2023-11-04T01:39:16.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.291+0000 7f2847210640 1 -- start start 2023-11-04T01:39:16.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f284015cfd0 0x7f28400b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f28400b0910 0x7f2840070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2840070cc0 0x7f2840160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28400ab8e0 con 0x7f2840070cc0 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28400b0d70 con 0x7f28400b0910 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2847210640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28400714b0 con 0x7f284015cfd0 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2840070cc0 0x7f2840160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2840070cc0 0x7f2840160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35044/0 (socket says 172.21.15.93:35044) 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 -- 172.21.15.93:0/3330709432 learned_addr learned my addr 172.21.15.93:0/3330709432 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f283ffff640 1 --2- 172.21.15.93:0/3330709432 >> v2:172.21.15.125:3300/0 conn(0x7f28400b0910 0x7f2840070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f2844fac640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f284015cfd0 0x7f28400b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 -- 172.21.15.93:0/3330709432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f284015cfd0 msgr2=0x7f28400b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f284015cfd0 0x7f28400b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 -- 172.21.15.93:0/3330709432 >> v2:172.21.15.125:3300/0 conn(0x7f28400b0910 msgr2=0x7f2840070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 --2- 172.21.15.93:0/3330709432 >> v2:172.21.15.125:3300/0 conn(0x7f28400b0910 0x7f2840070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.292+0000 7f28457ad640 1 -- 172.21.15.93:0/3330709432 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840071790 con 0x7f2840070cc0 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.293+0000 7f28457ad640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f2840160a00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f28400cf710 tx=0x7f283802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee4cbde22794f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.293+0000 7f283f7fe640 1 -- 172.21.15.93:0/3330709432 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283802ca70 con 0x7f2840070cc0 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.293+0000 7f283f7fe640 1 -- 172.21.15.93:0/3330709432 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283802cbd0 con 0x7f2840070cc0 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.293+0000 7f283f7fe640 1 -- 172.21.15.93:0/3330709432 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28380343f0 con 0x7f2840070cc0 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 -- 172.21.15.93:0/3330709432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 msgr2=0x7f2840160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f2840160a00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f28400cf710 tx=0x7f283802bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 -- 172.21.15.93:0/3330709432 shutdown_connections 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f2840160a00 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 --2- 172.21.15.93:0/3330709432 >> v2:172.21.15.125:3300/0 conn(0x7f28400b0910 0x7f2840070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 --2- 172.21.15.93:0/3330709432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f284015cfd0 0x7f28400b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 -- 172.21.15.93:0/3330709432 >> 172.21.15.93:0/3330709432 conn(0x7f28400ce950 msgr2=0x7f28400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 -- 172.21.15.93:0/3330709432 shutdown_connections 2023-11-04T01:39:16.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.294+0000 7f2847210640 1 -- 172.21.15.93:0/3330709432 wait complete. 2023-11-04T01:39:16.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.295+0000 7f2847210640 1 Processor -- start 2023-11-04T01:39:16.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.295+0000 7f2847210640 1 -- start start 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28400b0910 0x7f28401f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 0x7f28401f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284015f000 con 0x7f2840070cc0 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28400c3bd0 con 0x7f284015cfd0 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284015e760 con 0x7f28400b0910 2023-11-04T01:39:16.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35050/0 (socket says 172.21.15.93:35050) 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 -- 172.21.15.93:0/365751432 learned_addr learned my addr 172.21.15.93:0/365751432 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f283ffff640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28400b0910 0x7f28401f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f28457ad640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 0x7f28401f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 -- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28400b0910 msgr2=0x7f28401f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28400b0910 0x7f28401f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 -- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 msgr2=0x7f28401f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 0x7f28401f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 -- 172.21.15.93:0/365751432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2838009b30 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f28457ad640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 0x7f28401f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2844fac640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f283400d800 tx=0x7f283400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283400b6c0 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283400b820 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.296+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284015ea40 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.297+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283400bbb0 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.297+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28400c3e70 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.297+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28400c4000 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.298+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f283400bd10 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.298+0000 7f283d7fa640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 0x7f282406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.298+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f283408a130 con 0x7f2840070cc0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.298+0000 7f283ffff640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 0x7f282406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.299+0000 7f283ffff640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 0x7f282406d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.303+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2834054c60 con 0x7f2840070cc0 2023-11-04T01:39:16.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.465+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f284006c970 con 0x7f282406ae70 2023-11-04T01:39:16.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.478+0000 7f283d7fa640 1 -- 172.21.15.93:0/365751432 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532271 (secure 0 0 0) 0x7f282c00f830 con 0x7f282406ae70 2023-11-04T01:39:16.486 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:16.490 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:39:16.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 msgr2=0x7f282406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 0x7f282406d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 msgr2=0x7f284015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f283400d800 tx=0x7f283400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 shutdown_connections 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f282406ae70 0x7f282406d330 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cfd0 0x7f28401f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f28400b0910 0x7f28401f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 --2- 172.21.15.93:0/365751432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2840070cc0 0x7f284015fba0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 >> 172.21.15.93:0/365751432 conn(0x7f28400ce950 msgr2=0x7f28400af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 shutdown_connections 2023-11-04T01:39:16.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.482+0000 7f2847210640 1 -- 172.21.15.93:0/365751432 wait complete. 2023-11-04T01:39:16.494 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-11-04T01:39:15.369389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":295,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243068,"kb_used_data":10252,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754731652,"statfs":{"total":773094113280,"available":772845211648,"internally_reserved":0,"allocated":10498048,"data_stored":5755520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000967"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565894+0000","last_change":"2023-11-04T01:39:13.562271+0000","last_active":"2023-11-04T01:39:13.565894+0000","last_peered":"2023-11-04T01:39:13.565894+0000","last_clean":"2023-11-04T01:39:13.565894+0000","last_became_active":"2023-11-04T01:39:13.562039+0000","last_became_peered":"2023-11-04T01:39:13.562039+0000","last_unstale":"2023-11-04T01:39:13.565894+0000","last_undegraded":"2023-11-04T01:39:13.565894+0000","last_fullsized":"2023-11-04T01:39:13.565894+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:01.197298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560825+0000","last_change":"2023-11-04T01:39:13.558408+0000","last_active":"2023-11-04T01:39:13.560825+0000","last_peered":"2023-11-04T01:39:13.560825+0000","last_clean":"2023-11-04T01:39:13.560825+0000","last_became_active":"2023-11-04T01:39:13.557837+0000","last_became_peered":"2023-11-04T01:39:13.557837+0000","last_unstale":"2023-11-04T01:39:13.560825+0000","last_undegraded":"2023-11-04T01:39:13.560825+0000","last_fullsized":"2023-11-04T01:39:13.560825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:13.480700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551111+0000","last_change":"2023-11-04T01:39:13.549164+0000","last_active":"2023-11-04T01:39:13.551111+0000","last_peered":"2023-11-04T01:39:13.551111+0000","last_clean":"2023-11-04T01:39:13.551111+0000","last_became_active":"2023-11-04T01:39:13.548897+0000","last_became_peered":"2023-11-04T01:39:13.548897+0000","last_unstale":"2023-11-04T01:39:13.551111+0000","last_undegraded":"2023-11-04T01:39:13.551111+0000","last_fullsized":"2023-11-04T01:39:13.551111+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:26.815136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566118+0000","last_change":"2023-11-04T01:39:13.556807+0000","last_active":"2023-11-04T01:39:13.566118+0000","last_peered":"2023-11-04T01:39:13.566118+0000","last_clean":"2023-11-04T01:39:13.566118+0000","last_became_active":"2023-11-04T01:39:13.555838+0000","last_became_peered":"2023-11-04T01:39:13.555838+0000","last_unstale":"2023-11-04T01:39:13.566118+0000","last_undegraded":"2023-11-04T01:39:13.566118+0000","last_fullsized":"2023-11-04T01:39:13.566118+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:12.987168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572586+0000","last_change":"2023-11-04T01:39:13.567174+0000","last_active":"2023-11-04T01:39:13.572586+0000","last_peered":"2023-11-04T01:39:13.572586+0000","last_clean":"2023-11-04T01:39:13.572586+0000","last_became_active":"2023-11-04T01:39:13.566932+0000","last_became_peered":"2023-11-04T01:39:13.566932+0000","last_unstale":"2023-11-04T01:39:13.572586+0000","last_undegraded":"2023-11-04T01:39:13.572586+0000","last_fullsized":"2023-11-04T01:39:13.572586+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:19.826301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552645+0000","last_change":"2023-11-04T01:39:13.549472+0000","last_active":"2023-11-04T01:39:13.552645+0000","last_peered":"2023-11-04T01:39:13.552645+0000","last_clean":"2023-11-04T01:39:13.552645+0000","last_became_active":"2023-11-04T01:39:13.549201+0000","last_became_peered":"2023-11-04T01:39:13.549201+0000","last_unstale":"2023-11-04T01:39:13.552645+0000","last_undegraded":"2023-11-04T01:39:13.552645+0000","last_fullsized":"2023-11-04T01:39:13.552645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:58.119539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561276+0000","last_change":"2023-11-04T01:39:13.559615+0000","last_active":"2023-11-04T01:39:13.561276+0000","last_peered":"2023-11-04T01:39:13.561276+0000","last_clean":"2023-11-04T01:39:13.561276+0000","last_became_active":"2023-11-04T01:39:13.559171+0000","last_became_peered":"2023-11-04T01:39:13.559171+0000","last_unstale":"2023-11-04T01:39:13.561276+0000","last_undegraded":"2023-11-04T01:39:13.561276+0000","last_fullsized":"2023-11-04T01:39:13.561276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:55:45.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550328+0000","last_change":"2023-11-04T01:39:13.547359+0000","last_active":"2023-11-04T01:39:13.550328+0000","last_peered":"2023-11-04T01:39:13.550328+0000","last_clean":"2023-11-04T01:39:13.550328+0000","last_became_active":"2023-11-04T01:39:13.547083+0000","last_became_peered":"2023-11-04T01:39:13.547083+0000","last_unstale":"2023-11-04T01:39:13.550328+0000","last_undegraded":"2023-11-04T01:39:13.550328+0000","last_fullsized":"2023-11-04T01:39:13.550328+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:01.398526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565878+0000","last_change":"2023-11-04T01:39:13.558630+0000","last_active":"2023-11-04T01:39:13.565878+0000","last_peered":"2023-11-04T01:39:13.565878+0000","last_clean":"2023-11-04T01:39:13.565878+0000","last_became_active":"2023-11-04T01:39:13.558344+0000","last_became_peered":"2023-11-04T01:39:13.558344+0000","last_unstale":"2023-11-04T01:39:13.565878+0000","last_undegraded":"2023-11-04T01:39:13.565878+0000","last_fullsized":"2023-11-04T01:39:13.565878+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:04.454043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.569211+0000","last_change":"2023-11-04T01:39:13.567569+0000","last_active":"2023-11-04T01:39:13.569211+0000","last_peered":"2023-11-04T01:39:13.569211+0000","last_clean":"2023-11-04T01:39:13.569211+0000","last_became_active":"2023-11-04T01:39:13.567308+0000","last_became_peered":"2023-11-04T01:39:13.567308+0000","last_unstale":"2023-11-04T01:39:13.569211+0000","last_undegraded":"2023-11-04T01:39:13.569211+0000","last_fullsized":"2023-11-04T01:39:13.569211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:12.490947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560799+0000","last_change":"2023-11-04T01:39:13.558983+0000","last_active":"2023-11-04T01:39:13.560799+0000","last_peered":"2023-11-04T01:39:13.560799+0000","last_clean":"2023-11-04T01:39:13.560799+0000","last_became_active":"2023-11-04T01:39:13.558755+0000","last_became_peered":"2023-11-04T01:39:13.558755+0000","last_unstale":"2023-11-04T01:39:13.560799+0000","last_undegraded":"2023-11-04T01:39:13.560799+0000","last_fullsized":"2023-11-04T01:39:13.560799+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:44:17.145347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.569096+0000","last_change":"2023-11-04T01:39:13.567070+0000","last_active":"2023-11-04T01:39:13.569096+0000","last_peered":"2023-11-04T01:39:13.569096+0000","last_clean":"2023-11-04T01:39:13.569096+0000","last_became_active":"2023-11-04T01:39:13.566811+0000","last_became_peered":"2023-11-04T01:39:13.566811+0000","last_unstale":"2023-11-04T01:39:13.569096+0000","last_undegraded":"2023-11-04T01:39:13.569096+0000","last_fullsized":"2023-11-04T01:39:13.569096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:39:37.567426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.562219+0000","last_change":"2023-11-04T01:39:13.560112+0000","last_active":"2023-11-04T01:39:13.562219+0000","last_peered":"2023-11-04T01:39:13.562219+0000","last_clean":"2023-11-04T01:39:13.562219+0000","last_became_active":"2023-11-04T01:39:13.559846+0000","last_became_peered":"2023-11-04T01:39:13.559846+0000","last_unstale":"2023-11-04T01:39:13.562219+0000","last_undegraded":"2023-11-04T01:39:13.562219+0000","last_fullsized":"2023-11-04T01:39:13.562219+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:19.553984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561207+0000","last_change":"2023-11-04T01:39:13.558936+0000","last_active":"2023-11-04T01:39:13.561207+0000","last_peered":"2023-11-04T01:39:13.561207+0000","last_clean":"2023-11-04T01:39:13.561207+0000","last_became_active":"2023-11-04T01:39:13.558627+0000","last_became_peered":"2023-11-04T01:39:13.558627+0000","last_unstale":"2023-11-04T01:39:13.561207+0000","last_undegraded":"2023-11-04T01:39:13.561207+0000","last_fullsized":"2023-11-04T01:39:13.561207+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:42.071422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556739+0000","last_change":"2023-11-04T01:39:13.552469+0000","last_active":"2023-11-04T01:39:13.556739+0000","last_peered":"2023-11-04T01:39:13.556739+0000","last_clean":"2023-11-04T01:39:13.556739+0000","last_became_active":"2023-11-04T01:39:13.551921+0000","last_became_peered":"2023-11-04T01:39:13.551921+0000","last_unstale":"2023-11-04T01:39:13.556739+0000","last_undegraded":"2023-11-04T01:39:13.556739+0000","last_fullsized":"2023-11-04T01:39:13.556739+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:00:26.098646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549897+0000","last_change":"2023-11-04T01:39:13.548183+0000","last_active":"2023-11-04T01:39:13.549897+0000","last_peered":"2023-11-04T01:39:13.549897+0000","last_clean":"2023-11-04T01:39:13.549897+0000","last_became_active":"2023-11-04T01:39:13.547795+0000","last_became_peered":"2023-11-04T01:39:13.547795+0000","last_unstale":"2023-11-04T01:39:13.549897+0000","last_undegraded":"2023-11-04T01:39:13.549897+0000","last_fullsized":"2023-11-04T01:39:13.549897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:32:00.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.562757+0000","last_change":"2023-11-04T01:39:13.560687+0000","last_active":"2023-11-04T01:39:13.562757+0000","last_peered":"2023-11-04T01:39:13.562757+0000","last_clean":"2023-11-04T01:39:13.562757+0000","last_became_active":"2023-11-04T01:39:13.560435+0000","last_became_peered":"2023-11-04T01:39:13.560435+0000","last_unstale":"2023-11-04T01:39:13.562757+0000","last_undegraded":"2023-11-04T01:39:13.562757+0000","last_fullsized":"2023-11-04T01:39:13.562757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:14.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559849+0000","last_change":"2023-11-04T01:39:13.557332+0000","last_active":"2023-11-04T01:39:13.559849+0000","last_peered":"2023-11-04T01:39:13.559849+0000","last_clean":"2023-11-04T01:39:13.559849+0000","last_became_active":"2023-11-04T01:39:13.557042+0000","last_became_peered":"2023-11-04T01:39:13.557042+0000","last_unstale":"2023-11-04T01:39:13.559849+0000","last_undegraded":"2023-11-04T01:39:13.559849+0000","last_fullsized":"2023-11-04T01:39:13.559849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:19.553984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559319+0000","last_change":"2023-11-04T01:39:13.556426+0000","last_active":"2023-11-04T01:39:13.559319+0000","last_peered":"2023-11-04T01:39:13.559319+0000","last_clean":"2023-11-04T01:39:13.559319+0000","last_became_active":"2023-11-04T01:39:13.556160+0000","last_became_peered":"2023-11-04T01:39:13.556160+0000","last_unstale":"2023-11-04T01:39:13.559319+0000","last_undegraded":"2023-11-04T01:39:13.559319+0000","last_fullsized":"2023-11-04T01:39:13.559319+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:06.603967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550845+0000","last_change":"2023-11-04T01:39:13.549543+0000","last_active":"2023-11-04T01:39:13.550845+0000","last_peered":"2023-11-04T01:39:13.550845+0000","last_clean":"2023-11-04T01:39:13.550845+0000","last_became_active":"2023-11-04T01:39:13.549257+0000","last_became_peered":"2023-11-04T01:39:13.549257+0000","last_unstale":"2023-11-04T01:39:13.550845+0000","last_undegraded":"2023-11-04T01:39:13.550845+0000","last_fullsized":"2023-11-04T01:39:13.550845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:41.923049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.553775+0000","last_change":"2023-11-04T01:39:13.552628+0000","last_active":"2023-11-04T01:39:13.553775+0000","last_peered":"2023-11-04T01:39:13.553775+0000","last_clean":"2023-11-04T01:39:13.553775+0000","last_became_active":"2023-11-04T01:39:13.552363+0000","last_became_peered":"2023-11-04T01:39:13.552363+0000","last_unstale":"2023-11-04T01:39:13.553775+0000","last_undegraded":"2023-11-04T01:39:13.553775+0000","last_fullsized":"2023-11-04T01:39:13.553775+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:52.909716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570734+0000","last_change":"2023-11-04T01:39:13.566204+0000","last_active":"2023-11-04T01:39:13.570734+0000","last_peered":"2023-11-04T01:39:13.570734+0000","last_clean":"2023-11-04T01:39:13.570734+0000","last_became_active":"2023-11-04T01:39:13.565884+0000","last_became_peered":"2023-11-04T01:39:13.565884+0000","last_unstale":"2023-11-04T01:39:13.570734+0000","last_undegraded":"2023-11-04T01:39:13.570734+0000","last_fullsized":"2023-11-04T01:39:13.570734+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.382978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549884+0000","last_change":"2023-11-04T01:39:13.549111+0000","last_active":"2023-11-04T01:39:13.549884+0000","last_peered":"2023-11-04T01:39:13.549884+0000","last_clean":"2023-11-04T01:39:13.549884+0000","last_became_active":"2023-11-04T01:39:13.548829+0000","last_became_peered":"2023-11-04T01:39:13.548829+0000","last_unstale":"2023-11-04T01:39:13.549884+0000","last_undegraded":"2023-11-04T01:39:13.549884+0000","last_fullsized":"2023-11-04T01:39:13.549884+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:49.739541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570695+0000","last_change":"2023-11-04T01:39:13.567415+0000","last_active":"2023-11-04T01:39:13.570695+0000","last_peered":"2023-11-04T01:39:13.570695+0000","last_clean":"2023-11-04T01:39:13.570695+0000","last_became_active":"2023-11-04T01:39:13.567156+0000","last_became_peered":"2023-11-04T01:39:13.567156+0000","last_unstale":"2023-11-04T01:39:13.570695+0000","last_undegraded":"2023-11-04T01:39:13.570695+0000","last_fullsized":"2023-11-04T01:39:13.570695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:36.687727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561949+0000","last_change":"2023-11-04T01:39:13.559990+0000","last_active":"2023-11-04T01:39:13.561949+0000","last_peered":"2023-11-04T01:39:13.561949+0000","last_clean":"2023-11-04T01:39:13.561949+0000","last_became_active":"2023-11-04T01:39:13.559744+0000","last_became_peered":"2023-11-04T01:39:13.559744+0000","last_unstale":"2023-11-04T01:39:13.561949+0000","last_undegraded":"2023-11-04T01:39:13.561949+0000","last_fullsized":"2023-11-04T01:39:13.561949+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:47.664700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.554199+0000","last_change":"2023-11-04T01:39:13.549716+0000","last_active":"2023-11-04T01:39:13.554199+0000","last_peered":"2023-11-04T01:39:13.554199+0000","last_clean":"2023-11-04T01:39:13.554199+0000","last_became_active":"2023-11-04T01:39:13.549455+0000","last_became_peered":"2023-11-04T01:39:13.549455+0000","last_unstale":"2023-11-04T01:39:13.554199+0000","last_undegraded":"2023-11-04T01:39:13.554199+0000","last_fullsized":"2023-11-04T01:39:13.554199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:43:47.675847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556242+0000","last_change":"2023-11-04T01:39:13.550843+0000","last_active":"2023-11-04T01:39:13.556242+0000","last_peered":"2023-11-04T01:39:13.556242+0000","last_clean":"2023-11-04T01:39:13.556242+0000","last_became_active":"2023-11-04T01:39:13.550586+0000","last_became_peered":"2023-11-04T01:39:13.550586+0000","last_unstale":"2023-11-04T01:39:13.556242+0000","last_undegraded":"2023-11-04T01:39:13.556242+0000","last_fullsized":"2023-11-04T01:39:13.556242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:08:27.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572641+0000","last_change":"2023-11-04T01:39:13.568834+0000","last_active":"2023-11-04T01:39:13.572641+0000","last_peered":"2023-11-04T01:39:13.572641+0000","last_clean":"2023-11-04T01:39:13.572641+0000","last_became_active":"2023-11-04T01:39:13.568197+0000","last_became_peered":"2023-11-04T01:39:13.568197+0000","last_unstale":"2023-11-04T01:39:13.572641+0000","last_undegraded":"2023-11-04T01:39:13.572641+0000","last_fullsized":"2023-11-04T01:39:13.572641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:56.670972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.555824+0000","last_change":"2023-11-04T01:39:13.555107+0000","last_active":"2023-11-04T01:39:13.555824+0000","last_peered":"2023-11-04T01:39:13.555824+0000","last_clean":"2023-11-04T01:39:13.555824+0000","last_became_active":"2023-11-04T01:39:13.554545+0000","last_became_peered":"2023-11-04T01:39:13.554545+0000","last_unstale":"2023-11-04T01:39:13.555824+0000","last_undegraded":"2023-11-04T01:39:13.555824+0000","last_fullsized":"2023-11-04T01:39:13.555824+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:12.964286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559896+0000","last_change":"2023-11-04T01:39:13.557263+0000","last_active":"2023-11-04T01:39:13.559896+0000","last_peered":"2023-11-04T01:39:13.559896+0000","last_clean":"2023-11-04T01:39:13.559896+0000","last_became_active":"2023-11-04T01:39:13.556374+0000","last_became_peered":"2023-11-04T01:39:13.556374+0000","last_unstale":"2023-11-04T01:39:13.559896+0000","last_undegraded":"2023-11-04T01:39:13.559896+0000","last_fullsized":"2023-11-04T01:39:13.559896+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:06.507210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549851+0000","last_change":"2023-11-04T01:39:13.548774+0000","last_active":"2023-11-04T01:39:13.549851+0000","last_peered":"2023-11-04T01:39:13.549851+0000","last_clean":"2023-11-04T01:39:13.549851+0000","last_became_active":"2023-11-04T01:39:13.548551+0000","last_became_peered":"2023-11-04T01:39:13.548551+0000","last_unstale":"2023-11-04T01:39:13.549851+0000","last_undegraded":"2023-11-04T01:39:13.549851+0000","last_fullsized":"2023-11-04T01:39:13.549851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:27:16.363261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568063+0000","last_change":"2023-11-04T01:39:13.566559+0000","last_active":"2023-11-04T01:39:13.568063+0000","last_peered":"2023-11-04T01:39:13.568063+0000","last_clean":"2023-11-04T01:39:13.568063+0000","last_became_active":"2023-11-04T01:39:13.566271+0000","last_became_peered":"2023-11-04T01:39:13.566271+0000","last_unstale":"2023-11-04T01:39:13.568063+0000","last_undegraded":"2023-11-04T01:39:13.568063+0000","last_fullsized":"2023-11-04T01:39:13.568063+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:41.663430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549826+0000","last_change":"2023-11-04T01:39:13.548203+0000","last_active":"2023-11-04T01:39:13.549826+0000","last_peered":"2023-11-04T01:39:13.549826+0000","last_clean":"2023-11-04T01:39:13.549826+0000","last_became_active":"2023-11-04T01:39:13.547899+0000","last_became_peered":"2023-11-04T01:39:13.547899+0000","last_unstale":"2023-11-04T01:39:13.549826+0000","last_undegraded":"2023-11-04T01:39:13.549826+0000","last_fullsized":"2023-11-04T01:39:13.549826+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:31.648635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.545167+0000","last_change":"2023-11-04T01:39:12.545390+0000","last_active":"2023-11-04T01:39:13.545167+0000","last_peered":"2023-11-04T01:39:13.545167+0000","last_clean":"2023-11-04T01:39:13.545167+0000","last_became_active":"2023-11-04T01:39:12.545129+0000","last_became_peered":"2023-11-04T01:39:12.545129+0000","last_unstale":"2023-11-04T01:39:13.545167+0000","last_undegraded":"2023-11-04T01:39:13.545167+0000","last_fullsized":"2023-11-04T01:39:13.545167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:17.898784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.537101+0000","last_change":"2023-11-04T01:38:22.072453+0000","last_active":"2023-11-04T01:39:12.537101+0000","last_peered":"2023-11-04T01:39:12.537101+0000","last_clean":"2023-11-04T01:39:12.537101+0000","last_became_active":"2023-11-04T01:38:22.071910+0000","last_became_peered":"2023-11-04T01:38:22.071910+0000","last_unstale":"2023-11-04T01:39:12.537101+0000","last_undegraded":"2023-11-04T01:39:12.537101+0000","last_fullsized":"2023-11-04T01:39:12.537101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541966+0000","last_change":"2023-11-04T01:38:23.405090+0000","last_active":"2023-11-04T01:39:12.541966+0000","last_peered":"2023-11-04T01:39:12.541966+0000","last_clean":"2023-11-04T01:39:12.541966+0000","last_became_active":"2023-11-04T01:38:21.069416+0000","last_became_peered":"2023-11-04T01:38:21.069416+0000","last_unstale":"2023-11-04T01:39:12.541966+0000","last_undegraded":"2023-11-04T01:39:12.541966+0000","last_fullsized":"2023-11-04T01:39:12.541966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:08.663648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078635399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535876+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:39:12.535876+0000","last_peered":"2023-11-04T01:39:12.535876+0000","last_clean":"2023-11-04T01:39:12.535876+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:39:12.535876+0000","last_undegraded":"2023-11-04T01:39:12.535876+0000","last_fullsized":"2023-11-04T01:39:12.535876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550295+0000","last_change":"2023-11-04T01:39:13.546712+0000","last_active":"2023-11-04T01:39:13.550295+0000","last_peered":"2023-11-04T01:39:13.550295+0000","last_clean":"2023-11-04T01:39:13.550295+0000","last_became_active":"2023-11-04T01:39:13.546487+0000","last_became_peered":"2023-11-04T01:39:13.546487+0000","last_unstale":"2023-11-04T01:39:13.550295+0000","last_undegraded":"2023-11-04T01:39:13.550295+0000","last_fullsized":"2023-11-04T01:39:13.550295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:01:48.694656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.571654+0000","last_change":"2023-11-04T01:39:12.544249+0000","last_active":"2023-11-04T01:39:13.571654+0000","last_peered":"2023-11-04T01:39:13.571654+0000","last_clean":"2023-11-04T01:39:13.571654+0000","last_became_active":"2023-11-04T01:39:12.544000+0000","last_became_peered":"2023-11-04T01:39:12.544000+0000","last_unstale":"2023-11-04T01:39:13.571654+0000","last_undegraded":"2023-11-04T01:39:13.571654+0000","last_fullsized":"2023-11-04T01:39:13.571654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:48.777801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541466+0000","last_change":"2023-11-04T01:38:22.076676+0000","last_active":"2023-11-04T01:39:12.541466+0000","last_peered":"2023-11-04T01:39:12.541466+0000","last_clean":"2023-11-04T01:39:12.541466+0000","last_became_active":"2023-11-04T01:38:22.076358+0000","last_became_peered":"2023-11-04T01:38:22.076358+0000","last_unstale":"2023-11-04T01:39:12.541466+0000","last_undegraded":"2023-11-04T01:39:12.541466+0000","last_fullsized":"2023-11-04T01:39:12.541466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:54.096380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541319+0000","last_change":"2023-11-04T01:38:23.405733+0000","last_active":"2023-11-04T01:39:12.541319+0000","last_peered":"2023-11-04T01:39:12.541319+0000","last_clean":"2023-11-04T01:39:12.541319+0000","last_became_active":"2023-11-04T01:38:21.072619+0000","last_became_peered":"2023-11-04T01:38:21.072619+0000","last_unstale":"2023-11-04T01:39:12.541319+0000","last_undegraded":"2023-11-04T01:39:12.541319+0000","last_fullsized":"2023-11-04T01:39:12.541319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:43.756589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010857900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536437+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:39:12.536437+0000","last_peered":"2023-11-04T01:39:12.536437+0000","last_clean":"2023-11-04T01:39:12.536437+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:39:12.536437+0000","last_undegraded":"2023-11-04T01:39:12.536437+0000","last_fullsized":"2023-11-04T01:39:12.536437+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572601+0000","last_change":"2023-11-04T01:39:13.568423+0000","last_active":"2023-11-04T01:39:13.572601+0000","last_peered":"2023-11-04T01:39:13.572601+0000","last_clean":"2023-11-04T01:39:13.572601+0000","last_became_active":"2023-11-04T01:39:13.568170+0000","last_became_peered":"2023-11-04T01:39:13.568170+0000","last_unstale":"2023-11-04T01:39:13.572601+0000","last_undegraded":"2023-11-04T01:39:13.572601+0000","last_fullsized":"2023-11-04T01:39:13.572601+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:55.606588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537437+0000","last_change":"2023-11-04T01:39:12.548731+0000","last_active":"2023-11-04T01:39:13.537437+0000","last_peered":"2023-11-04T01:39:13.537437+0000","last_clean":"2023-11-04T01:39:13.537437+0000","last_became_active":"2023-11-04T01:39:12.548486+0000","last_became_peered":"2023-11-04T01:39:12.548486+0000","last_unstale":"2023-11-04T01:39:13.537437+0000","last_undegraded":"2023-11-04T01:39:13.537437+0000","last_fullsized":"2023-11-04T01:39:13.537437+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:35.939365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533869+0000","last_change":"2023-11-04T01:38:22.069819+0000","last_active":"2023-11-04T01:39:12.533869+0000","last_peered":"2023-11-04T01:39:12.533869+0000","last_clean":"2023-11-04T01:39:12.533869+0000","last_became_active":"2023-11-04T01:38:22.068982+0000","last_became_peered":"2023-11-04T01:38:22.068982+0000","last_unstale":"2023-11-04T01:39:12.533869+0000","last_undegraded":"2023-11-04T01:39:12.533869+0000","last_fullsized":"2023-11-04T01:39:12.533869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:16.517766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536152+0000","last_change":"2023-11-04T01:38:23.334735+0000","last_active":"2023-11-04T01:39:12.536152+0000","last_peered":"2023-11-04T01:39:12.536152+0000","last_clean":"2023-11-04T01:39:12.536152+0000","last_became_active":"2023-11-04T01:38:21.067774+0000","last_became_peered":"2023-11-04T01:38:21.067774+0000","last_unstale":"2023-11-04T01:39:12.536152+0000","last_undegraded":"2023-11-04T01:39:12.536152+0000","last_fullsized":"2023-11-04T01:39:12.536152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:03.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050306999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541520+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:39:12.541520+0000","last_peered":"2023-11-04T01:39:12.541520+0000","last_clean":"2023-11-04T01:39:12.541520+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:39:12.541520+0000","last_undegraded":"2023-11-04T01:39:12.541520+0000","last_fullsized":"2023-11-04T01:39:12.541520+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559295+0000","last_change":"2023-11-04T01:39:13.556858+0000","last_active":"2023-11-04T01:39:13.559295+0000","last_peered":"2023-11-04T01:39:13.559295+0000","last_clean":"2023-11-04T01:39:13.559295+0000","last_became_active":"2023-11-04T01:39:13.556002+0000","last_became_peered":"2023-11-04T01:39:13.556002+0000","last_unstale":"2023-11-04T01:39:13.559295+0000","last_undegraded":"2023-11-04T01:39:13.559295+0000","last_fullsized":"2023-11-04T01:39:13.559295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:12:40.019067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.542130+0000","last_change":"2023-11-04T01:39:12.540227+0000","last_active":"2023-11-04T01:39:13.542130+0000","last_peered":"2023-11-04T01:39:13.542130+0000","last_clean":"2023-11-04T01:39:13.542130+0000","last_became_active":"2023-11-04T01:39:12.539963+0000","last_became_peered":"2023-11-04T01:39:12.539963+0000","last_unstale":"2023-11-04T01:39:13.542130+0000","last_undegraded":"2023-11-04T01:39:13.542130+0000","last_fullsized":"2023-11-04T01:39:13.542130+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:08.906207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528019+0000","last_change":"2023-11-04T01:38:22.069762+0000","last_active":"2023-11-04T01:39:12.528019+0000","last_peered":"2023-11-04T01:39:12.528019+0000","last_clean":"2023-11-04T01:39:12.528019+0000","last_became_active":"2023-11-04T01:38:22.069461+0000","last_became_peered":"2023-11-04T01:38:22.069461+0000","last_unstale":"2023-11-04T01:39:12.528019+0000","last_undegraded":"2023-11-04T01:39:12.528019+0000","last_fullsized":"2023-11-04T01:39:12.528019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:03.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538642+0000","last_change":"2023-11-04T01:38:23.405132+0000","last_active":"2023-11-04T01:39:12.538642+0000","last_peered":"2023-11-04T01:39:12.538642+0000","last_clean":"2023-11-04T01:39:12.538642+0000","last_became_active":"2023-11-04T01:38:21.070339+0000","last_became_peered":"2023-11-04T01:38:21.070339+0000","last_unstale":"2023-11-04T01:39:12.538642+0000","last_undegraded":"2023-11-04T01:39:12.538642+0000","last_fullsized":"2023-11-04T01:39:12.538642+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000921534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536276+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:39:12.536276+0000","last_peered":"2023-11-04T01:39:12.536276+0000","last_clean":"2023-11-04T01:39:12.536276+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:39:12.536276+0000","last_undegraded":"2023-11-04T01:39:12.536276+0000","last_fullsized":"2023-11-04T01:39:12.536276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556321+0000","last_change":"2023-11-04T01:39:13.551999+0000","last_active":"2023-11-04T01:39:13.556321+0000","last_peered":"2023-11-04T01:39:13.556321+0000","last_clean":"2023-11-04T01:39:13.556321+0000","last_became_active":"2023-11-04T01:39:13.551706+0000","last_became_peered":"2023-11-04T01:39:13.551706+0000","last_unstale":"2023-11-04T01:39:13.556321+0000","last_undegraded":"2023-11-04T01:39:13.556321+0000","last_fullsized":"2023-11-04T01:39:13.556321+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:18:06.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570087+0000","last_change":"2023-11-04T01:39:12.541710+0000","last_active":"2023-11-04T01:39:13.570087+0000","last_peered":"2023-11-04T01:39:13.570087+0000","last_clean":"2023-11-04T01:39:13.570087+0000","last_became_active":"2023-11-04T01:39:12.541453+0000","last_became_peered":"2023-11-04T01:39:12.541453+0000","last_unstale":"2023-11-04T01:39:13.570087+0000","last_undegraded":"2023-11-04T01:39:13.570087+0000","last_fullsized":"2023-11-04T01:39:13.570087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:26.061422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538953+0000","last_change":"2023-11-04T01:38:22.069939+0000","last_active":"2023-11-04T01:39:12.538953+0000","last_peered":"2023-11-04T01:39:12.538953+0000","last_clean":"2023-11-04T01:39:12.538953+0000","last_became_active":"2023-11-04T01:38:22.069690+0000","last_became_peered":"2023-11-04T01:38:22.069690+0000","last_unstale":"2023-11-04T01:39:12.538953+0000","last_undegraded":"2023-11-04T01:39:12.538953+0000","last_fullsized":"2023-11-04T01:39:12.538953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541817+0000","last_change":"2023-11-04T01:38:23.327651+0000","last_active":"2023-11-04T01:39:12.541817+0000","last_peered":"2023-11-04T01:39:12.541817+0000","last_clean":"2023-11-04T01:39:12.541817+0000","last_became_active":"2023-11-04T01:38:21.067028+0000","last_became_peered":"2023-11-04T01:38:21.067028+0000","last_unstale":"2023-11-04T01:39:12.541817+0000","last_undegraded":"2023-11-04T01:39:12.541817+0000","last_fullsized":"2023-11-04T01:39:12.541817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:13.072797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054701200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536300+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:39:12.536300+0000","last_peered":"2023-11-04T01:39:12.536300+0000","last_clean":"2023-11-04T01:39:12.536300+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:39:12.536300+0000","last_undegraded":"2023-11-04T01:39:12.536300+0000","last_fullsized":"2023-11-04T01:39:12.536300+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.567434+0000","last_change":"2023-11-04T01:39:13.562423+0000","last_active":"2023-11-04T01:39:13.567434+0000","last_peered":"2023-11-04T01:39:13.567434+0000","last_clean":"2023-11-04T01:39:13.567434+0000","last_became_active":"2023-11-04T01:39:13.561444+0000","last_became_peered":"2023-11-04T01:39:13.561444+0000","last_unstale":"2023-11-04T01:39:13.567434+0000","last_undegraded":"2023-11-04T01:39:13.567434+0000","last_fullsized":"2023-11-04T01:39:13.567434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:05.556714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566354+0000","last_change":"2023-11-04T01:39:12.547601+0000","last_active":"2023-11-04T01:39:13.566354+0000","last_peered":"2023-11-04T01:39:13.566354+0000","last_clean":"2023-11-04T01:39:13.566354+0000","last_became_active":"2023-11-04T01:39:12.547273+0000","last_became_peered":"2023-11-04T01:39:12.547273+0000","last_unstale":"2023-11-04T01:39:13.566354+0000","last_undegraded":"2023-11-04T01:39:13.566354+0000","last_fullsized":"2023-11-04T01:39:13.566354+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:35.544851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527555+0000","last_change":"2023-11-04T01:38:22.066355+0000","last_active":"2023-11-04T01:39:12.527555+0000","last_peered":"2023-11-04T01:39:12.527555+0000","last_clean":"2023-11-04T01:39:12.527555+0000","last_became_active":"2023-11-04T01:38:22.065849+0000","last_became_peered":"2023-11-04T01:38:22.065849+0000","last_unstale":"2023-11-04T01:39:12.527555+0000","last_undegraded":"2023-11-04T01:39:12.527555+0000","last_fullsized":"2023-11-04T01:39:12.527555+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536108+0000","last_change":"2023-11-04T01:38:23.358293+0000","last_active":"2023-11-04T01:39:12.536108+0000","last_peered":"2023-11-04T01:39:12.536108+0000","last_clean":"2023-11-04T01:39:12.536108+0000","last_became_active":"2023-11-04T01:38:21.070333+0000","last_became_peered":"2023-11-04T01:38:21.070333+0000","last_unstale":"2023-11-04T01:39:12.536108+0000","last_undegraded":"2023-11-04T01:39:12.536108+0000","last_fullsized":"2023-11-04T01:39:12.536108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:43.144500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059104700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.529033+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:39:12.529033+0000","last_peered":"2023-11-04T01:39:12.529033+0000","last_clean":"2023-11-04T01:39:12.529033+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:39:12.529033+0000","last_undegraded":"2023-11-04T01:39:12.529033+0000","last_fullsized":"2023-11-04T01:39:12.529033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552928+0000","last_change":"2023-11-04T01:39:13.551387+0000","last_active":"2023-11-04T01:39:13.552928+0000","last_peered":"2023-11-04T01:39:13.552928+0000","last_clean":"2023-11-04T01:39:13.552928+0000","last_became_active":"2023-11-04T01:39:13.551139+0000","last_became_peered":"2023-11-04T01:39:13.551139+0000","last_unstale":"2023-11-04T01:39:13.552928+0000","last_undegraded":"2023-11-04T01:39:13.552928+0000","last_fullsized":"2023-11-04T01:39:13.552928+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:31:04.008314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.539146+0000","last_change":"2023-11-04T01:39:12.547411+0000","last_active":"2023-11-04T01:39:13.539146+0000","last_peered":"2023-11-04T01:39:13.539146+0000","last_clean":"2023-11-04T01:39:13.539146+0000","last_became_active":"2023-11-04T01:39:12.547144+0000","last_became_peered":"2023-11-04T01:39:12.547144+0000","last_unstale":"2023-11-04T01:39:13.539146+0000","last_undegraded":"2023-11-04T01:39:13.539146+0000","last_fullsized":"2023-11-04T01:39:13.539146+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:37.731260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534650+0000","last_change":"2023-11-04T01:38:22.074795+0000","last_active":"2023-11-04T01:39:12.534650+0000","last_peered":"2023-11-04T01:39:12.534650+0000","last_clean":"2023-11-04T01:39:12.534650+0000","last_became_active":"2023-11-04T01:38:22.074381+0000","last_became_peered":"2023-11-04T01:38:22.074381+0000","last_unstale":"2023-11-04T01:39:12.534650+0000","last_undegraded":"2023-11-04T01:39:12.534650+0000","last_fullsized":"2023-11-04T01:39:12.534650+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:56:25.208149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528961+0000","last_change":"2023-11-04T01:38:23.061673+0000","last_active":"2023-11-04T01:39:12.528961+0000","last_peered":"2023-11-04T01:39:12.528961+0000","last_clean":"2023-11-04T01:39:12.528961+0000","last_became_active":"2023-11-04T01:38:21.062435+0000","last_became_peered":"2023-11-04T01:38:21.062435+0000","last_unstale":"2023-11-04T01:39:12.528961+0000","last_undegraded":"2023-11-04T01:39:12.528961+0000","last_fullsized":"2023-11-04T01:39:12.528961+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:52.059754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048859499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527810+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:39:12.527810+0000","last_peered":"2023-11-04T01:39:12.527810+0000","last_clean":"2023-11-04T01:39:12.527810+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:39:12.527810+0000","last_undegraded":"2023-11-04T01:39:12.527810+0000","last_fullsized":"2023-11-04T01:39:12.527810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552021+0000","last_change":"2023-11-04T01:39:13.549813+0000","last_active":"2023-11-04T01:39:13.552021+0000","last_peered":"2023-11-04T01:39:13.552021+0000","last_clean":"2023-11-04T01:39:13.552021+0000","last_became_active":"2023-11-04T01:39:13.549530+0000","last_became_peered":"2023-11-04T01:39:13.549530+0000","last_unstale":"2023-11-04T01:39:13.552021+0000","last_undegraded":"2023-11-04T01:39:13.552021+0000","last_fullsized":"2023-11-04T01:39:13.552021+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572994+0000","last_change":"2023-11-04T01:39:12.546634+0000","last_active":"2023-11-04T01:39:13.572994+0000","last_peered":"2023-11-04T01:39:13.572994+0000","last_clean":"2023-11-04T01:39:13.572994+0000","last_became_active":"2023-11-04T01:39:12.545747+0000","last_became_peered":"2023-11-04T01:39:12.545747+0000","last_unstale":"2023-11-04T01:39:13.572994+0000","last_undegraded":"2023-11-04T01:39:13.572994+0000","last_fullsized":"2023-11-04T01:39:13.572994+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:40.211611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535971+0000","last_change":"2023-11-04T01:38:22.075108+0000","last_active":"2023-11-04T01:39:12.535971+0000","last_peered":"2023-11-04T01:39:12.535971+0000","last_clean":"2023-11-04T01:39:12.535971+0000","last_became_active":"2023-11-04T01:38:22.074780+0000","last_became_peered":"2023-11-04T01:38:22.074780+0000","last_unstale":"2023-11-04T01:39:12.535971+0000","last_undegraded":"2023-11-04T01:39:12.535971+0000","last_fullsized":"2023-11-04T01:39:12.535971+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:13.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536296+0000","last_change":"2023-11-04T01:38:23.334648+0000","last_active":"2023-11-04T01:39:12.536296+0000","last_peered":"2023-11-04T01:39:12.536296+0000","last_clean":"2023-11-04T01:39:12.536296+0000","last_became_active":"2023-11-04T01:38:21.066335+0000","last_became_peered":"2023-11-04T01:38:21.066335+0000","last_unstale":"2023-11-04T01:39:12.536296+0000","last_undegraded":"2023-11-04T01:39:12.536296+0000","last_fullsized":"2023-11-04T01:39:12.536296+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:43.106209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047853300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533578+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:39:12.533578+0000","last_peered":"2023-11-04T01:39:12.533578+0000","last_clean":"2023-11-04T01:39:12.533578+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:39:12.533578+0000","last_undegraded":"2023-11-04T01:39:12.533578+0000","last_fullsized":"2023-11-04T01:39:12.533578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.563055+0000","last_change":"2023-11-04T01:39:13.560997+0000","last_active":"2023-11-04T01:39:13.563055+0000","last_peered":"2023-11-04T01:39:13.563055+0000","last_clean":"2023-11-04T01:39:13.563055+0000","last_became_active":"2023-11-04T01:39:13.560719+0000","last_became_peered":"2023-11-04T01:39:13.560719+0000","last_unstale":"2023-11-04T01:39:13.563055+0000","last_undegraded":"2023-11-04T01:39:13.563055+0000","last_fullsized":"2023-11-04T01:39:13.563055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:08.188723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.546926+0000","last_change":"2023-11-04T01:39:12.544321+0000","last_active":"2023-11-04T01:39:13.546926+0000","last_peered":"2023-11-04T01:39:13.546926+0000","last_clean":"2023-11-04T01:39:13.546926+0000","last_became_active":"2023-11-04T01:39:12.544041+0000","last_became_peered":"2023-11-04T01:39:12.544041+0000","last_unstale":"2023-11-04T01:39:13.546926+0000","last_undegraded":"2023-11-04T01:39:13.546926+0000","last_fullsized":"2023-11-04T01:39:13.546926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:05.597224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541607+0000","last_change":"2023-11-04T01:38:22.072789+0000","last_active":"2023-11-04T01:39:12.541607+0000","last_peered":"2023-11-04T01:39:12.541607+0000","last_clean":"2023-11-04T01:39:12.541607+0000","last_became_active":"2023-11-04T01:38:22.072509+0000","last_became_peered":"2023-11-04T01:38:22.072509+0000","last_unstale":"2023-11-04T01:39:12.541607+0000","last_undegraded":"2023-11-04T01:39:12.541607+0000","last_fullsized":"2023-11-04T01:39:12.541607+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534379+0000","last_change":"2023-11-04T01:38:23.061961+0000","last_active":"2023-11-04T01:39:12.534379+0000","last_peered":"2023-11-04T01:39:12.534379+0000","last_clean":"2023-11-04T01:39:12.534379+0000","last_became_active":"2023-11-04T01:38:21.063415+0000","last_became_peered":"2023-11-04T01:38:21.063415+0000","last_unstale":"2023-11-04T01:39:12.534379+0000","last_undegraded":"2023-11-04T01:39:12.534379+0000","last_fullsized":"2023-11-04T01:39:12.534379+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.820188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000396594,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538139+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:39:12.538139+0000","last_peered":"2023-11-04T01:39:12.538139+0000","last_clean":"2023-11-04T01:39:12.538139+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:39:12.538139+0000","last_undegraded":"2023-11-04T01:39:12.538139+0000","last_fullsized":"2023-11-04T01:39:12.538139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552855+0000","last_change":"2023-11-04T01:39:13.551191+0000","last_active":"2023-11-04T01:39:13.552855+0000","last_peered":"2023-11-04T01:39:13.552855+0000","last_clean":"2023-11-04T01:39:13.552855+0000","last_became_active":"2023-11-04T01:39:13.550922+0000","last_became_peered":"2023-11-04T01:39:13.550922+0000","last_unstale":"2023-11-04T01:39:13.552855+0000","last_undegraded":"2023-11-04T01:39:13.552855+0000","last_fullsized":"2023-11-04T01:39:13.552855+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:12:26.614533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.538881+0000","last_change":"2023-11-04T01:39:12.541709+0000","last_active":"2023-11-04T01:39:13.538881+0000","last_peered":"2023-11-04T01:39:13.538881+0000","last_clean":"2023-11-04T01:39:13.538881+0000","last_became_active":"2023-11-04T01:39:12.541394+0000","last_became_peered":"2023-11-04T01:39:12.541394+0000","last_unstale":"2023-11-04T01:39:13.538881+0000","last_undegraded":"2023-11-04T01:39:13.538881+0000","last_fullsized":"2023-11-04T01:39:13.538881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:48.777801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534178+0000","last_change":"2023-11-04T01:38:22.068816+0000","last_active":"2023-11-04T01:39:12.534178+0000","last_peered":"2023-11-04T01:39:12.534178+0000","last_clean":"2023-11-04T01:39:12.534178+0000","last_became_active":"2023-11-04T01:38:22.068537+0000","last_became_peered":"2023-11-04T01:38:22.068537+0000","last_unstale":"2023-11-04T01:39:12.534178+0000","last_undegraded":"2023-11-04T01:39:12.534178+0000","last_fullsized":"2023-11-04T01:39:12.534178+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:44.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541332+0000","last_change":"2023-11-04T01:38:23.405504+0000","last_active":"2023-11-04T01:39:12.541332+0000","last_peered":"2023-11-04T01:39:12.541332+0000","last_clean":"2023-11-04T01:39:12.541332+0000","last_became_active":"2023-11-04T01:38:21.073116+0000","last_became_peered":"2023-11-04T01:38:21.073116+0000","last_unstale":"2023-11-04T01:39:12.541332+0000","last_undegraded":"2023-11-04T01:39:12.541332+0000","last_fullsized":"2023-11-04T01:39:12.541332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:14.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098846799999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.542008+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:39:12.542008+0000","last_peered":"2023-11-04T01:39:12.542008+0000","last_clean":"2023-11-04T01:39:12.542008+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:39:12.542008+0000","last_undegraded":"2023-11-04T01:39:12.542008+0000","last_fullsized":"2023-11-04T01:39:12.542008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.548101+0000","last_change":"2023-11-04T01:39:13.544409+0000","last_active":"2023-11-04T01:39:13.548101+0000","last_peered":"2023-11-04T01:39:13.548101+0000","last_clean":"2023-11-04T01:39:13.548101+0000","last_became_active":"2023-11-04T01:39:13.544147+0000","last_became_peered":"2023-11-04T01:39:13.544147+0000","last_unstale":"2023-11-04T01:39:13.548101+0000","last_undegraded":"2023-11-04T01:39:13.548101+0000","last_fullsized":"2023-11-04T01:39:13.548101+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:56.559131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537567+0000","last_change":"2023-11-04T01:39:12.548070+0000","last_active":"2023-11-04T01:39:13.537567+0000","last_peered":"2023-11-04T01:39:13.537567+0000","last_clean":"2023-11-04T01:39:13.537567+0000","last_became_active":"2023-11-04T01:39:12.546710+0000","last_became_peered":"2023-11-04T01:39:12.546710+0000","last_unstale":"2023-11-04T01:39:13.537567+0000","last_undegraded":"2023-11-04T01:39:13.537567+0000","last_fullsized":"2023-11-04T01:39:13.537567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:34.805882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.537966+0000","last_change":"2023-11-04T01:38:22.069605+0000","last_active":"2023-11-04T01:39:12.537966+0000","last_peered":"2023-11-04T01:39:12.537966+0000","last_clean":"2023-11-04T01:39:12.537966+0000","last_became_active":"2023-11-04T01:38:22.069171+0000","last_became_peered":"2023-11-04T01:38:22.069171+0000","last_unstale":"2023-11-04T01:39:12.537966+0000","last_undegraded":"2023-11-04T01:39:12.537966+0000","last_fullsized":"2023-11-04T01:39:12.537966+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:07.216732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528227+0000","last_change":"2023-11-04T01:38:23.063133+0000","last_active":"2023-11-04T01:39:12.528227+0000","last_peered":"2023-11-04T01:39:12.528227+0000","last_clean":"2023-11-04T01:39:12.528227+0000","last_became_active":"2023-11-04T01:38:21.070011+0000","last_became_peered":"2023-11-04T01:38:21.070011+0000","last_unstale":"2023-11-04T01:39:12.528227+0000","last_undegraded":"2023-11-04T01:39:12.528227+0000","last_fullsized":"2023-11-04T01:39:12.528227+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:08.992301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.540837+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:39:12.540837+0000","last_peered":"2023-11-04T01:39:12.540837+0000","last_clean":"2023-11-04T01:39:12.540837+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:39:12.540837+0000","last_undegraded":"2023-11-04T01:39:12.540837+0000","last_fullsized":"2023-11-04T01:39:12.540837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561094+0000","last_change":"2023-11-04T01:39:13.558262+0000","last_active":"2023-11-04T01:39:13.561094+0000","last_peered":"2023-11-04T01:39:13.561094+0000","last_clean":"2023-11-04T01:39:13.561094+0000","last_became_active":"2023-11-04T01:39:13.557958+0000","last_became_peered":"2023-11-04T01:39:13.557958+0000","last_unstale":"2023-11-04T01:39:13.561094+0000","last_undegraded":"2023-11-04T01:39:13.561094+0000","last_fullsized":"2023-11-04T01:39:13.561094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:20.559682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.544094+0000","last_change":"2023-11-04T01:39:12.546217+0000","last_active":"2023-11-04T01:39:13.544094+0000","last_peered":"2023-11-04T01:39:13.544094+0000","last_clean":"2023-11-04T01:39:13.544094+0000","last_became_active":"2023-11-04T01:39:12.545554+0000","last_became_peered":"2023-11-04T01:39:12.545554+0000","last_unstale":"2023-11-04T01:39:13.544094+0000","last_undegraded":"2023-11-04T01:39:13.544094+0000","last_fullsized":"2023-11-04T01:39:13.544094+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:39.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536545+0000","last_change":"2023-11-04T01:38:22.077275+0000","last_active":"2023-11-04T01:39:12.536545+0000","last_peered":"2023-11-04T01:39:12.536545+0000","last_clean":"2023-11-04T01:39:12.536545+0000","last_became_active":"2023-11-04T01:38:22.076997+0000","last_became_peered":"2023-11-04T01:38:22.076997+0000","last_unstale":"2023-11-04T01:39:12.536545+0000","last_undegraded":"2023-11-04T01:39:12.536545+0000","last_fullsized":"2023-11-04T01:39:12.536545+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:14.205713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528672+0000","last_change":"2023-11-04T01:38:23.062882+0000","last_active":"2023-11-04T01:39:12.528672+0000","last_peered":"2023-11-04T01:39:12.528672+0000","last_clean":"2023-11-04T01:39:12.528672+0000","last_became_active":"2023-11-04T01:38:21.069964+0000","last_became_peered":"2023-11-04T01:38:21.069964+0000","last_unstale":"2023-11-04T01:39:12.528672+0000","last_undegraded":"2023-11-04T01:39:12.528672+0000","last_fullsized":"2023-11-04T01:39:12.528672+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:16.633121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083743200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534451+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:39:12.534451+0000","last_peered":"2023-11-04T01:39:12.534451+0000","last_clean":"2023-11-04T01:39:12.534451+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:39:12.534451+0000","last_undegraded":"2023-11-04T01:39:12.534451+0000","last_fullsized":"2023-11-04T01:39:12.534451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565851+0000","last_change":"2023-11-04T01:39:13.557844+0000","last_active":"2023-11-04T01:39:13.565851+0000","last_peered":"2023-11-04T01:39:13.565851+0000","last_clean":"2023-11-04T01:39:13.565851+0000","last_became_active":"2023-11-04T01:39:13.550121+0000","last_became_peered":"2023-11-04T01:39:13.550121+0000","last_unstale":"2023-11-04T01:39:13.565851+0000","last_undegraded":"2023-11-04T01:39:13.565851+0000","last_fullsized":"2023-11-04T01:39:13.565851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.693587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551351+0000","last_change":"2023-11-04T01:39:12.544001+0000","last_active":"2023-11-04T01:39:13.551351+0000","last_peered":"2023-11-04T01:39:13.551351+0000","last_clean":"2023-11-04T01:39:13.551351+0000","last_became_active":"2023-11-04T01:39:12.543169+0000","last_became_peered":"2023-11-04T01:39:12.543169+0000","last_unstale":"2023-11-04T01:39:13.551351+0000","last_undegraded":"2023-11-04T01:39:13.551351+0000","last_fullsized":"2023-11-04T01:39:13.551351+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:05.597224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533263+0000","last_change":"2023-11-04T01:38:22.062314+0000","last_active":"2023-11-04T01:39:12.533263+0000","last_peered":"2023-11-04T01:39:12.533263+0000","last_clean":"2023-11-04T01:39:12.533263+0000","last_became_active":"2023-11-04T01:38:22.062007+0000","last_became_peered":"2023-11-04T01:38:22.062007+0000","last_unstale":"2023-11-04T01:39:12.533263+0000","last_undegraded":"2023-11-04T01:39:12.533263+0000","last_fullsized":"2023-11-04T01:39:12.533263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:09.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533428+0000","last_change":"2023-11-04T01:38:23.060981+0000","last_active":"2023-11-04T01:39:12.533428+0000","last_peered":"2023-11-04T01:39:12.533428+0000","last_clean":"2023-11-04T01:39:12.533428+0000","last_became_active":"2023-11-04T01:38:21.065930+0000","last_became_peered":"2023-11-04T01:38:21.065930+0000","last_unstale":"2023-11-04T01:39:12.533428+0000","last_undegraded":"2023-11-04T01:39:12.533428+0000","last_fullsized":"2023-11-04T01:39:12.533428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535442+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:39:12.535442+0000","last_peered":"2023-11-04T01:39:12.535442+0000","last_clean":"2023-11-04T01:39:12.535442+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:39:12.535442+0000","last_undegraded":"2023-11-04T01:39:12.535442+0000","last_fullsized":"2023-11-04T01:39:12.535442+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560374+0000","last_change":"2023-11-04T01:39:13.558412+0000","last_active":"2023-11-04T01:39:13.560374+0000","last_peered":"2023-11-04T01:39:13.560374+0000","last_clean":"2023-11-04T01:39:13.560374+0000","last_became_active":"2023-11-04T01:39:13.558105+0000","last_became_peered":"2023-11-04T01:39:13.558105+0000","last_unstale":"2023-11-04T01:39:13.560374+0000","last_undegraded":"2023-11-04T01:39:13.560374+0000","last_fullsized":"2023-11-04T01:39:13.560374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:12.964286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572713+0000","last_change":"2023-11-04T01:39:12.547794+0000","last_active":"2023-11-04T01:39:13.572713+0000","last_peered":"2023-11-04T01:39:13.572713+0000","last_clean":"2023-11-04T01:39:13.572713+0000","last_became_active":"2023-11-04T01:39:12.547515+0000","last_became_peered":"2023-11-04T01:39:12.547515+0000","last_unstale":"2023-11-04T01:39:13.572713+0000","last_undegraded":"2023-11-04T01:39:13.572713+0000","last_fullsized":"2023-11-04T01:39:13.572713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.222453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534771+0000","last_change":"2023-11-04T01:38:22.075621+0000","last_active":"2023-11-04T01:39:12.534771+0000","last_peered":"2023-11-04T01:39:12.534771+0000","last_clean":"2023-11-04T01:39:12.534771+0000","last_became_active":"2023-11-04T01:38:22.075337+0000","last_became_peered":"2023-11-04T01:38:22.075337+0000","last_unstale":"2023-11-04T01:39:12.534771+0000","last_undegraded":"2023-11-04T01:39:12.534771+0000","last_fullsized":"2023-11-04T01:39:12.534771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:00.382893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533273+0000","last_change":"2023-11-04T01:38:23.061099+0000","last_active":"2023-11-04T01:39:12.533273+0000","last_peered":"2023-11-04T01:39:12.533273+0000","last_clean":"2023-11-04T01:39:12.533273+0000","last_became_active":"2023-11-04T01:38:21.063958+0000","last_became_peered":"2023-11-04T01:38:21.063958+0000","last_unstale":"2023-11-04T01:39:12.533273+0000","last_undegraded":"2023-11-04T01:39:12.533273+0000","last_fullsized":"2023-11-04T01:39:12.533273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:13.105036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541135+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:39:12.541135+0000","last_peered":"2023-11-04T01:39:12.541135+0000","last_clean":"2023-11-04T01:39:12.541135+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:39:12.541135+0000","last_undegraded":"2023-11-04T01:39:12.541135+0000","last_fullsized":"2023-11-04T01:39:12.541135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568184+0000","last_change":"2023-11-04T01:39:13.563482+0000","last_active":"2023-11-04T01:39:13.568184+0000","last_peered":"2023-11-04T01:39:13.568184+0000","last_clean":"2023-11-04T01:39:13.568184+0000","last_became_active":"2023-11-04T01:39:13.563124+0000","last_became_peered":"2023-11-04T01:39:13.563124+0000","last_unstale":"2023-11-04T01:39:13.568184+0000","last_undegraded":"2023-11-04T01:39:13.568184+0000","last_fullsized":"2023-11-04T01:39:13.568184+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551957+0000","last_change":"2023-11-04T01:39:12.550269+0000","last_active":"2023-11-04T01:39:13.551957+0000","last_peered":"2023-11-04T01:39:13.551957+0000","last_clean":"2023-11-04T01:39:13.551957+0000","last_became_active":"2023-11-04T01:39:12.550012+0000","last_became_peered":"2023-11-04T01:39:12.550012+0000","last_unstale":"2023-11-04T01:39:13.551957+0000","last_undegraded":"2023-11-04T01:39:13.551957+0000","last_fullsized":"2023-11-04T01:39:13.551957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:55.552387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541024+0000","last_change":"2023-11-04T01:38:22.070752+0000","last_active":"2023-11-04T01:39:12.541024+0000","last_peered":"2023-11-04T01:39:12.541024+0000","last_clean":"2023-11-04T01:39:12.541024+0000","last_became_active":"2023-11-04T01:38:22.070461+0000","last_became_peered":"2023-11-04T01:38:22.070461+0000","last_unstale":"2023-11-04T01:39:12.541024+0000","last_undegraded":"2023-11-04T01:39:12.541024+0000","last_fullsized":"2023-11-04T01:39:12.541024+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:27.426475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536105+0000","last_change":"2023-11-04T01:38:23.358397+0000","last_active":"2023-11-04T01:39:12.536105+0000","last_peered":"2023-11-04T01:39:12.536105+0000","last_clean":"2023-11-04T01:39:12.536105+0000","last_became_active":"2023-11-04T01:38:21.066012+0000","last_became_peered":"2023-11-04T01:38:21.066012+0000","last_unstale":"2023-11-04T01:39:12.536105+0000","last_undegraded":"2023-11-04T01:39:12.536105+0000","last_fullsized":"2023-11-04T01:39:12.536105+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.942370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051071600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527844+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:39:12.527844+0000","last_peered":"2023-11-04T01:39:12.527844+0000","last_clean":"2023-11-04T01:39:12.527844+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:39:12.527844+0000","last_undegraded":"2023-11-04T01:39:12.527844+0000","last_fullsized":"2023-11-04T01:39:12.527844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547555+0000","last_change":"2023-11-04T01:39:13.543727+0000","last_active":"2023-11-04T01:39:13.547555+0000","last_peered":"2023-11-04T01:39:13.547555+0000","last_clean":"2023-11-04T01:39:13.547555+0000","last_became_active":"2023-11-04T01:39:13.543434+0000","last_became_peered":"2023-11-04T01:39:13.543434+0000","last_unstale":"2023-11-04T01:39:13.547555+0000","last_undegraded":"2023-11-04T01:39:13.547555+0000","last_fullsized":"2023-11-04T01:39:13.547555+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:27:21.466089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.538665+0000","last_change":"2023-11-04T01:39:12.546972+0000","last_active":"2023-11-04T01:39:13.538665+0000","last_peered":"2023-11-04T01:39:13.538665+0000","last_clean":"2023-11-04T01:39:13.538665+0000","last_became_active":"2023-11-04T01:39:12.546680+0000","last_became_peered":"2023-11-04T01:39:12.546680+0000","last_unstale":"2023-11-04T01:39:13.538665+0000","last_undegraded":"2023-11-04T01:39:13.538665+0000","last_fullsized":"2023-11-04T01:39:13.538665+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:55.183528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534902+0000","last_change":"2023-11-04T01:38:22.067648+0000","last_active":"2023-11-04T01:39:12.534902+0000","last_peered":"2023-11-04T01:39:12.534902+0000","last_clean":"2023-11-04T01:39:12.534902+0000","last_became_active":"2023-11-04T01:38:22.067338+0000","last_became_peered":"2023-11-04T01:38:22.067338+0000","last_unstale":"2023-11-04T01:39:12.534902+0000","last_undegraded":"2023-11-04T01:39:12.534902+0000","last_fullsized":"2023-11-04T01:39:12.534902+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:04.184731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527454+0000","last_change":"2023-11-04T01:38:23.061682+0000","last_active":"2023-11-04T01:39:12.527454+0000","last_peered":"2023-11-04T01:39:12.527454+0000","last_clean":"2023-11-04T01:39:12.527454+0000","last_became_active":"2023-11-04T01:38:21.067953+0000","last_became_peered":"2023-11-04T01:38:21.067953+0000","last_unstale":"2023-11-04T01:39:12.527454+0000","last_undegraded":"2023-11-04T01:39:12.527454+0000","last_fullsized":"2023-11-04T01:39:12.527454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:06.211868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042784099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535856+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:39:12.535856+0000","last_peered":"2023-11-04T01:39:12.535856+0000","last_clean":"2023-11-04T01:39:12.535856+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:39:12.535856+0000","last_undegraded":"2023-11-04T01:39:12.535856+0000","last_fullsized":"2023-11-04T01:39:12.535856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561114+0000","last_change":"2023-11-04T01:39:13.559320+0000","last_active":"2023-11-04T01:39:13.561114+0000","last_peered":"2023-11-04T01:39:13.561114+0000","last_clean":"2023-11-04T01:39:13.561114+0000","last_became_active":"2023-11-04T01:39:13.558404+0000","last_became_peered":"2023-11-04T01:39:13.558404+0000","last_unstale":"2023-11-04T01:39:13.561114+0000","last_undegraded":"2023-11-04T01:39:13.561114+0000","last_fullsized":"2023-11-04T01:39:13.561114+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.574184+0000","last_change":"2023-11-04T01:39:12.547120+0000","last_active":"2023-11-04T01:39:13.574184+0000","last_peered":"2023-11-04T01:39:13.574184+0000","last_clean":"2023-11-04T01:39:13.574184+0000","last_became_active":"2023-11-04T01:39:12.546849+0000","last_became_peered":"2023-11-04T01:39:12.546849+0000","last_unstale":"2023-11-04T01:39:13.574184+0000","last_undegraded":"2023-11-04T01:39:13.574184+0000","last_fullsized":"2023-11-04T01:39:13.574184+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:18.335624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.540703+0000","last_change":"2023-11-04T01:38:22.069448+0000","last_active":"2023-11-04T01:39:12.540703+0000","last_peered":"2023-11-04T01:39:12.540703+0000","last_clean":"2023-11-04T01:39:12.540703+0000","last_became_active":"2023-11-04T01:38:22.069195+0000","last_became_peered":"2023-11-04T01:38:22.069195+0000","last_unstale":"2023-11-04T01:39:12.540703+0000","last_undegraded":"2023-11-04T01:39:12.540703+0000","last_fullsized":"2023-11-04T01:39:12.540703+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:21.047863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536165+0000","last_change":"2023-11-04T01:38:23.358753+0000","last_active":"2023-11-04T01:39:12.536165+0000","last_peered":"2023-11-04T01:39:12.536165+0000","last_clean":"2023-11-04T01:39:12.536165+0000","last_became_active":"2023-11-04T01:38:21.070981+0000","last_became_peered":"2023-11-04T01:38:21.070981+0000","last_unstale":"2023-11-04T01:39:12.536165+0000","last_undegraded":"2023-11-04T01:39:12.536165+0000","last_fullsized":"2023-11-04T01:39:12.536165+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:55.408316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043018,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538715+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:39:12.538715+0000","last_peered":"2023-11-04T01:39:12.538715+0000","last_clean":"2023-11-04T01:39:12.538715+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:39:12.538715+0000","last_undegraded":"2023-11-04T01:39:12.538715+0000","last_fullsized":"2023-11-04T01:39:12.538715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565811+0000","last_change":"2023-11-04T01:39:13.561388+0000","last_active":"2023-11-04T01:39:13.565811+0000","last_peered":"2023-11-04T01:39:13.565811+0000","last_clean":"2023-11-04T01:39:13.565811+0000","last_became_active":"2023-11-04T01:39:13.561115+0000","last_became_peered":"2023-11-04T01:39:13.561115+0000","last_unstale":"2023-11-04T01:39:13.565811+0000","last_undegraded":"2023-11-04T01:39:13.565811+0000","last_fullsized":"2023-11-04T01:39:13.565811+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:35.371118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565497+0000","last_change":"2023-11-04T01:39:12.544991+0000","last_active":"2023-11-04T01:39:13.565497+0000","last_peered":"2023-11-04T01:39:13.565497+0000","last_clean":"2023-11-04T01:39:13.565497+0000","last_became_active":"2023-11-04T01:39:12.544699+0000","last_became_peered":"2023-11-04T01:39:12.544699+0000","last_unstale":"2023-11-04T01:39:13.565497+0000","last_undegraded":"2023-11-04T01:39:13.565497+0000","last_fullsized":"2023-11-04T01:39:13.565497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:09.467797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534245+0000","last_change":"2023-11-04T01:38:22.070238+0000","last_active":"2023-11-04T01:39:12.534245+0000","last_peered":"2023-11-04T01:39:12.534245+0000","last_clean":"2023-11-04T01:39:12.534245+0000","last_became_active":"2023-11-04T01:38:22.069898+0000","last_became_peered":"2023-11-04T01:38:22.069898+0000","last_unstale":"2023-11-04T01:39:12.534245+0000","last_undegraded":"2023-11-04T01:39:12.534245+0000","last_fullsized":"2023-11-04T01:39:12.534245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:57.057392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536421+0000","last_change":"2023-11-04T01:38:23.358872+0000","last_active":"2023-11-04T01:39:12.536421+0000","last_peered":"2023-11-04T01:39:12.536421+0000","last_clean":"2023-11-04T01:39:12.536421+0000","last_became_active":"2023-11-04T01:38:21.069193+0000","last_became_peered":"2023-11-04T01:38:21.069193+0000","last_unstale":"2023-11-04T01:39:12.536421+0000","last_undegraded":"2023-11-04T01:39:12.536421+0000","last_fullsized":"2023-11-04T01:39:12.536421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:57.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055334700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536776+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:39:12.536776+0000","last_peered":"2023-11-04T01:39:12.536776+0000","last_clean":"2023-11-04T01:39:12.536776+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:39:12.536776+0000","last_undegraded":"2023-11-04T01:39:12.536776+0000","last_fullsized":"2023-11-04T01:39:12.536776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561259+0000","last_change":"2023-11-04T01:39:13.559430+0000","last_active":"2023-11-04T01:39:13.561259+0000","last_peered":"2023-11-04T01:39:13.561259+0000","last_clean":"2023-11-04T01:39:13.561259+0000","last_became_active":"2023-11-04T01:39:13.558818+0000","last_became_peered":"2023-11-04T01:39:13.558818+0000","last_unstale":"2023-11-04T01:39:13.561259+0000","last_undegraded":"2023-11-04T01:39:13.561259+0000","last_fullsized":"2023-11-04T01:39:13.561259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:18:06.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537704+0000","last_change":"2023-11-04T01:39:12.546141+0000","last_active":"2023-11-04T01:39:13.537704+0000","last_peered":"2023-11-04T01:39:13.537704+0000","last_clean":"2023-11-04T01:39:13.537704+0000","last_became_active":"2023-11-04T01:39:12.545864+0000","last_became_peered":"2023-11-04T01:39:12.545864+0000","last_unstale":"2023-11-04T01:39:13.537704+0000","last_undegraded":"2023-11-04T01:39:13.537704+0000","last_fullsized":"2023-11-04T01:39:13.537704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:34:05.339636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534035+0000","last_change":"2023-11-04T01:38:22.064805+0000","last_active":"2023-11-04T01:39:12.534035+0000","last_peered":"2023-11-04T01:39:12.534035+0000","last_clean":"2023-11-04T01:39:12.534035+0000","last_became_active":"2023-11-04T01:38:22.064524+0000","last_became_peered":"2023-11-04T01:38:22.064524+0000","last_unstale":"2023-11-04T01:39:12.534035+0000","last_undegraded":"2023-11-04T01:39:12.534035+0000","last_fullsized":"2023-11-04T01:39:12.534035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:15.823978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536618+0000","last_change":"2023-11-04T01:38:23.404752+0000","last_active":"2023-11-04T01:39:12.536618+0000","last_peered":"2023-11-04T01:39:12.536618+0000","last_clean":"2023-11-04T01:39:12.536618+0000","last_became_active":"2023-11-04T01:38:21.069815+0000","last_became_peered":"2023-11-04T01:38:21.069815+0000","last_unstale":"2023-11-04T01:39:12.536618+0000","last_undegraded":"2023-11-04T01:39:12.536618+0000","last_fullsized":"2023-11-04T01:39:12.536618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:15.512902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076771900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528199+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:39:12.528199+0000","last_peered":"2023-11-04T01:39:12.528199+0000","last_clean":"2023-11-04T01:39:12.528199+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:39:12.528199+0000","last_undegraded":"2023-11-04T01:39:12.528199+0000","last_fullsized":"2023-11-04T01:39:12.528199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547989+0000","last_change":"2023-11-04T01:39:13.543787+0000","last_active":"2023-11-04T01:39:13.547989+0000","last_peered":"2023-11-04T01:39:13.547989+0000","last_clean":"2023-11-04T01:39:13.547989+0000","last_became_active":"2023-11-04T01:39:13.543545+0000","last_became_peered":"2023-11-04T01:39:13.543545+0000","last_unstale":"2023-11-04T01:39:13.547989+0000","last_undegraded":"2023-11-04T01:39:13.547989+0000","last_fullsized":"2023-11-04T01:39:13.547989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:12.029246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.546585+0000","last_change":"2023-11-04T01:39:12.545249+0000","last_active":"2023-11-04T01:39:13.546585+0000","last_peered":"2023-11-04T01:39:13.546585+0000","last_clean":"2023-11-04T01:39:13.546585+0000","last_became_active":"2023-11-04T01:39:12.544854+0000","last_became_peered":"2023-11-04T01:39:12.544854+0000","last_unstale":"2023-11-04T01:39:13.546585+0000","last_undegraded":"2023-11-04T01:39:13.546585+0000","last_fullsized":"2023-11-04T01:39:13.546585+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:18.547240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536698+0000","last_change":"2023-11-04T01:38:22.071153+0000","last_active":"2023-11-04T01:39:12.536698+0000","last_peered":"2023-11-04T01:39:12.536698+0000","last_clean":"2023-11-04T01:39:12.536698+0000","last_became_active":"2023-11-04T01:38:22.070642+0000","last_became_peered":"2023-11-04T01:38:22.070642+0000","last_unstale":"2023-11-04T01:39:12.536698+0000","last_undegraded":"2023-11-04T01:39:12.536698+0000","last_fullsized":"2023-11-04T01:39:12.536698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:14.109900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538559+0000","last_change":"2023-11-04T01:38:23.405429+0000","last_active":"2023-11-04T01:39:12.538559+0000","last_peered":"2023-11-04T01:39:12.538559+0000","last_clean":"2023-11-04T01:39:12.538559+0000","last_became_active":"2023-11-04T01:38:21.073092+0000","last_became_peered":"2023-11-04T01:38:21.073092+0000","last_unstale":"2023-11-04T01:39:12.538559+0000","last_undegraded":"2023-11-04T01:39:12.538559+0000","last_fullsized":"2023-11-04T01:39:12.538559+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:05.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088544700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534616+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:39:12.534616+0000","last_peered":"2023-11-04T01:39:12.534616+0000","last_clean":"2023-11-04T01:39:12.534616+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:39:12.534616+0000","last_undegraded":"2023-11-04T01:39:12.534616+0000","last_fullsized":"2023-11-04T01:39:12.534616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559880+0000","last_change":"2023-11-04T01:39:13.556419+0000","last_active":"2023-11-04T01:39:13.559880+0000","last_peered":"2023-11-04T01:39:13.559880+0000","last_clean":"2023-11-04T01:39:13.559880+0000","last_became_active":"2023-11-04T01:39:13.556117+0000","last_became_peered":"2023-11-04T01:39:13.556117+0000","last_unstale":"2023-11-04T01:39:13.559880+0000","last_undegraded":"2023-11-04T01:39:13.559880+0000","last_fullsized":"2023-11-04T01:39:13.559880+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:13.480700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560394+0000","last_change":"2023-11-04T01:39:12.543671+0000","last_active":"2023-11-04T01:39:13.560394+0000","last_peered":"2023-11-04T01:39:13.560394+0000","last_clean":"2023-11-04T01:39:13.560394+0000","last_became_active":"2023-11-04T01:39:12.543399+0000","last_became_peered":"2023-11-04T01:39:12.543399+0000","last_unstale":"2023-11-04T01:39:13.560394+0000","last_undegraded":"2023-11-04T01:39:13.560394+0000","last_fullsized":"2023-11-04T01:39:13.560394+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:13.270814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527664+0000","last_change":"2023-11-04T01:38:22.066267+0000","last_active":"2023-11-04T01:39:12.527664+0000","last_peered":"2023-11-04T01:39:12.527664+0000","last_clean":"2023-11-04T01:39:12.527664+0000","last_became_active":"2023-11-04T01:38:22.065904+0000","last_became_peered":"2023-11-04T01:38:22.065904+0000","last_unstale":"2023-11-04T01:39:12.527664+0000","last_undegraded":"2023-11-04T01:39:12.527664+0000","last_fullsized":"2023-11-04T01:39:12.527664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533508+0000","last_change":"2023-11-04T01:38:23.062165+0000","last_active":"2023-11-04T01:39:12.533508+0000","last_peered":"2023-11-04T01:39:12.533508+0000","last_clean":"2023-11-04T01:39:12.533508+0000","last_became_active":"2023-11-04T01:38:21.065551+0000","last_became_peered":"2023-11-04T01:38:21.065551+0000","last_unstale":"2023-11-04T01:39:12.533508+0000","last_undegraded":"2023-11-04T01:39:12.533508+0000","last_fullsized":"2023-11-04T01:39:12.533508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:16.744946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068861599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527457+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:39:12.527457+0000","last_peered":"2023-11-04T01:39:12.527457+0000","last_clean":"2023-11-04T01:39:12.527457+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:39:12.527457+0000","last_undegraded":"2023-11-04T01:39:12.527457+0000","last_fullsized":"2023-11-04T01:39:12.527457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565286+0000","last_change":"2023-11-04T01:39:13.563712+0000","last_active":"2023-11-04T01:39:13.565286+0000","last_peered":"2023-11-04T01:39:13.565286+0000","last_clean":"2023-11-04T01:39:13.565286+0000","last_became_active":"2023-11-04T01:39:13.563369+0000","last_became_peered":"2023-11-04T01:39:13.563369+0000","last_unstale":"2023-11-04T01:39:13.565286+0000","last_undegraded":"2023-11-04T01:39:13.565286+0000","last_fullsized":"2023-11-04T01:39:13.565286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:10.470404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"94'4","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568610+0000","last_change":"2023-11-04T01:39:12.544641+0000","last_active":"2023-11-04T01:39:13.568610+0000","last_peered":"2023-11-04T01:39:13.568610+0000","last_clean":"2023-11-04T01:39:13.568610+0000","last_became_active":"2023-11-04T01:39:12.544339+0000","last_became_peered":"2023-11-04T01:39:12.544339+0000","last_unstale":"2023-11-04T01:39:13.568610+0000","last_undegraded":"2023-11-04T01:39:13.568610+0000","last_fullsized":"2023-11-04T01:39:13.568610+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:08.906207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535465+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:39:12.535465+0000","last_peered":"2023-11-04T01:39:12.535465+0000","last_clean":"2023-11-04T01:39:12.535465+0000","last_became_active":"2023-11-04T01:38:22.074718+0000","last_became_peered":"2023-11-04T01:38:22.074718+0000","last_unstale":"2023-11-04T01:39:12.535465+0000","last_undegraded":"2023-11-04T01:39:12.535465+0000","last_fullsized":"2023-11-04T01:39:12.535465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:12.056843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527753+0000","last_change":"2023-11-04T01:38:23.062210+0000","last_active":"2023-11-04T01:39:12.527753+0000","last_peered":"2023-11-04T01:39:12.527753+0000","last_clean":"2023-11-04T01:39:12.527753+0000","last_became_active":"2023-11-04T01:38:21.062480+0000","last_became_peered":"2023-11-04T01:38:21.062480+0000","last_unstale":"2023-11-04T01:39:12.527753+0000","last_undegraded":"2023-11-04T01:39:12.527753+0000","last_fullsized":"2023-11-04T01:39:12.527753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:20.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040890099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.532120+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:39:12.532120+0000","last_peered":"2023-11-04T01:39:12.532120+0000","last_clean":"2023-11-04T01:39:12.532120+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:39:12.532120+0000","last_undegraded":"2023-11-04T01:39:12.532120+0000","last_fullsized":"2023-11-04T01:39:12.532120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.558344+0000","last_change":"2023-11-04T01:39:13.556302+0000","last_active":"2023-11-04T01:39:13.558344+0000","last_peered":"2023-11-04T01:39:13.558344+0000","last_clean":"2023-11-04T01:39:13.558344+0000","last_became_active":"2023-11-04T01:39:13.556027+0000","last_became_peered":"2023-11-04T01:39:13.556027+0000","last_unstale":"2023-11-04T01:39:13.558344+0000","last_undegraded":"2023-11-04T01:39:13.558344+0000","last_fullsized":"2023-11-04T01:39:13.558344+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:41.218355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566618+0000","last_change":"2023-11-04T01:39:12.545701+0000","last_active":"2023-11-04T01:39:13.566618+0000","last_peered":"2023-11-04T01:39:13.566618+0000","last_clean":"2023-11-04T01:39:13.566618+0000","last_became_active":"2023-11-04T01:39:12.545188+0000","last_became_peered":"2023-11-04T01:39:12.545188+0000","last_unstale":"2023-11-04T01:39:13.566618+0000","last_undegraded":"2023-11-04T01:39:13.566618+0000","last_fullsized":"2023-11-04T01:39:13.566618+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:44.568689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536007+0000","last_change":"2023-11-04T01:38:22.070477+0000","last_active":"2023-11-04T01:39:12.536007+0000","last_peered":"2023-11-04T01:39:12.536007+0000","last_clean":"2023-11-04T01:39:12.536007+0000","last_became_active":"2023-11-04T01:38:22.070203+0000","last_became_peered":"2023-11-04T01:38:22.070203+0000","last_unstale":"2023-11-04T01:39:12.536007+0000","last_undegraded":"2023-11-04T01:39:12.536007+0000","last_fullsized":"2023-11-04T01:39:12.536007+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:07.694892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533191+0000","last_change":"2023-11-04T01:38:23.060125+0000","last_active":"2023-11-04T01:39:12.533191+0000","last_peered":"2023-11-04T01:39:12.533191+0000","last_clean":"2023-11-04T01:39:12.533191+0000","last_became_active":"2023-11-04T01:38:21.068722+0000","last_became_peered":"2023-11-04T01:38:21.068722+0000","last_unstale":"2023-11-04T01:39:12.533191+0000","last_undegraded":"2023-11-04T01:39:12.533191+0000","last_fullsized":"2023-11-04T01:39:12.533191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:13.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058911300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536181+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:39:12.536181+0000","last_peered":"2023-11-04T01:39:12.536181+0000","last_clean":"2023-11-04T01:39:12.536181+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:39:12.536181+0000","last_undegraded":"2023-11-04T01:39:12.536181+0000","last_fullsized":"2023-11-04T01:39:12.536181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568491+0000","last_change":"2023-11-04T01:39:13.567123+0000","last_active":"2023-11-04T01:39:13.568491+0000","last_peered":"2023-11-04T01:39:13.568491+0000","last_clean":"2023-11-04T01:39:13.568491+0000","last_became_active":"2023-11-04T01:39:13.566881+0000","last_became_peered":"2023-11-04T01:39:13.566881+0000","last_unstale":"2023-11-04T01:39:13.568491+0000","last_undegraded":"2023-11-04T01:39:13.568491+0000","last_fullsized":"2023-11-04T01:39:13.568491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:47.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570988+0000","last_change":"2023-11-04T01:39:12.544642+0000","last_active":"2023-11-04T01:39:13.570988+0000","last_peered":"2023-11-04T01:39:13.570988+0000","last_clean":"2023-11-04T01:39:13.570988+0000","last_became_active":"2023-11-04T01:39:12.544353+0000","last_became_peered":"2023-11-04T01:39:12.544353+0000","last_unstale":"2023-11-04T01:39:13.570988+0000","last_undegraded":"2023-11-04T01:39:13.570988+0000","last_fullsized":"2023-11-04T01:39:13.570988+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:32.899395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534988+0000","last_change":"2023-11-04T01:38:22.075956+0000","last_active":"2023-11-04T01:39:12.534988+0000","last_peered":"2023-11-04T01:39:12.534988+0000","last_clean":"2023-11-04T01:39:12.534988+0000","last_became_active":"2023-11-04T01:38:22.075635+0000","last_became_peered":"2023-11-04T01:38:22.075635+0000","last_unstale":"2023-11-04T01:39:12.534988+0000","last_undegraded":"2023-11-04T01:39:12.534988+0000","last_fullsized":"2023-11-04T01:39:12.534988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536099+0000","last_change":"2023-11-04T01:38:23.404427+0000","last_active":"2023-11-04T01:39:12.536099+0000","last_peered":"2023-11-04T01:39:12.536099+0000","last_clean":"2023-11-04T01:39:12.536099+0000","last_became_active":"2023-11-04T01:38:21.069870+0000","last_became_peered":"2023-11-04T01:38:21.069870+0000","last_unstale":"2023-11-04T01:39:12.536099+0000","last_undegraded":"2023-11-04T01:39:12.536099+0000","last_fullsized":"2023-11-04T01:39:12.536099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:47.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086834100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541941+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:39:12.541941+0000","last_peered":"2023-11-04T01:39:12.541941+0000","last_clean":"2023-11-04T01:39:12.541941+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:39:12.541941+0000","last_undegraded":"2023-11-04T01:39:12.541941+0000","last_fullsized":"2023-11-04T01:39:12.541941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559275+0000","last_change":"2023-11-04T01:39:13.553193+0000","last_active":"2023-11-04T01:39:13.559275+0000","last_peered":"2023-11-04T01:39:13.559275+0000","last_clean":"2023-11-04T01:39:13.559275+0000","last_became_active":"2023-11-04T01:39:13.552925+0000","last_became_peered":"2023-11-04T01:39:13.552925+0000","last_unstale":"2023-11-04T01:39:13.559275+0000","last_undegraded":"2023-11-04T01:39:13.559275+0000","last_fullsized":"2023-11-04T01:39:13.559275+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:01.398526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547414+0000","last_change":"2023-11-04T01:39:12.545875+0000","last_active":"2023-11-04T01:39:13.547414+0000","last_peered":"2023-11-04T01:39:13.547414+0000","last_clean":"2023-11-04T01:39:13.547414+0000","last_became_active":"2023-11-04T01:39:12.545601+0000","last_became_peered":"2023-11-04T01:39:12.545601+0000","last_unstale":"2023-11-04T01:39:13.547414+0000","last_undegraded":"2023-11-04T01:39:13.547414+0000","last_fullsized":"2023-11-04T01:39:13.547414+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:40.916306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541432+0000","last_change":"2023-11-04T01:38:22.071179+0000","last_active":"2023-11-04T01:39:12.541432+0000","last_peered":"2023-11-04T01:39:12.541432+0000","last_clean":"2023-11-04T01:39:12.541432+0000","last_became_active":"2023-11-04T01:38:22.070904+0000","last_became_peered":"2023-11-04T01:38:22.070904+0000","last_unstale":"2023-11-04T01:39:12.541432+0000","last_undegraded":"2023-11-04T01:39:12.541432+0000","last_fullsized":"2023-11-04T01:39:12.541432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:17.749810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527942+0000","last_change":"2023-11-04T01:38:23.062973+0000","last_active":"2023-11-04T01:39:12.527942+0000","last_peered":"2023-11-04T01:39:12.527942+0000","last_clean":"2023-11-04T01:39:12.527942+0000","last_became_active":"2023-11-04T01:38:21.060285+0000","last_became_peered":"2023-11-04T01:38:21.060285+0000","last_unstale":"2023-11-04T01:39:12.527942+0000","last_undegraded":"2023-11-04T01:39:12.527942+0000","last_fullsized":"2023-11-04T01:39:12.527942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:03.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097246599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538226+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:39:12.538226+0000","last_peered":"2023-11-04T01:39:12.538226+0000","last_clean":"2023-11-04T01:39:12.538226+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:39:12.538226+0000","last_undegraded":"2023-11-04T01:39:12.538226+0000","last_fullsized":"2023-11-04T01:39:12.538226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566089+0000","last_change":"2023-11-04T01:39:13.556498+0000","last_active":"2023-11-04T01:39:13.566089+0000","last_peered":"2023-11-04T01:39:13.566089+0000","last_clean":"2023-11-04T01:39:13.566089+0000","last_became_active":"2023-11-04T01:39:13.556234+0000","last_became_peered":"2023-11-04T01:39:13.556234+0000","last_unstale":"2023-11-04T01:39:13.566089+0000","last_undegraded":"2023-11-04T01:39:13.566089+0000","last_fullsized":"2023-11-04T01:39:13.566089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:57.821448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568719+0000","last_change":"2023-11-04T01:39:12.543549+0000","last_active":"2023-11-04T01:39:13.568719+0000","last_peered":"2023-11-04T01:39:13.568719+0000","last_clean":"2023-11-04T01:39:13.568719+0000","last_became_active":"2023-11-04T01:39:12.543288+0000","last_became_peered":"2023-11-04T01:39:12.543288+0000","last_unstale":"2023-11-04T01:39:13.568719+0000","last_undegraded":"2023-11-04T01:39:13.568719+0000","last_fullsized":"2023-11-04T01:39:13.568719+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:09.467797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536429+0000","last_change":"2023-11-04T01:38:22.070640+0000","last_active":"2023-11-04T01:39:12.536429+0000","last_peered":"2023-11-04T01:39:12.536429+0000","last_clean":"2023-11-04T01:39:12.536429+0000","last_became_active":"2023-11-04T01:38:22.070342+0000","last_became_peered":"2023-11-04T01:38:22.070342+0000","last_unstale":"2023-11-04T01:39:12.536429+0000","last_undegraded":"2023-11-04T01:39:12.536429+0000","last_fullsized":"2023-11-04T01:39:12.536429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541417+0000","last_change":"2023-11-04T01:38:23.405745+0000","last_active":"2023-11-04T01:39:12.541417+0000","last_peered":"2023-11-04T01:39:12.541417+0000","last_clean":"2023-11-04T01:39:12.541417+0000","last_became_active":"2023-11-04T01:38:21.071619+0000","last_became_peered":"2023-11-04T01:38:21.071619+0000","last_unstale":"2023-11-04T01:39:12.541417+0000","last_undegraded":"2023-11-04T01:39:12.541417+0000","last_fullsized":"2023-11-04T01:39:12.541417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:56.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096848099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528293+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:39:12.528293+0000","last_peered":"2023-11-04T01:39:12.528293+0000","last_clean":"2023-11-04T01:39:12.528293+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:39:12.528293+0000","last_undegraded":"2023-11-04T01:39:12.528293+0000","last_fullsized":"2023-11-04T01:39:12.528293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565384+0000","last_change":"2023-11-04T01:39:13.551446+0000","last_active":"2023-11-04T01:39:13.565384+0000","last_peered":"2023-11-04T01:39:13.565384+0000","last_clean":"2023-11-04T01:39:13.565384+0000","last_became_active":"2023-11-04T01:39:13.551189+0000","last_became_peered":"2023-11-04T01:39:13.551189+0000","last_unstale":"2023-11-04T01:39:13.565384+0000","last_undegraded":"2023-11-04T01:39:13.565384+0000","last_fullsized":"2023-11-04T01:39:13.565384+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:51:37.970849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"94'8","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.571992+0000","last_change":"2023-11-04T01:39:12.536587+0000","last_active":"2023-11-04T01:39:13.571992+0000","last_peered":"2023-11-04T01:39:13.571992+0000","last_clean":"2023-11-04T01:39:13.571992+0000","last_became_active":"2023-11-04T01:39:12.536360+0000","last_became_peered":"2023-11-04T01:39:12.536360+0000","last_unstale":"2023-11-04T01:39:13.571992+0000","last_undegraded":"2023-11-04T01:39:13.571992+0000","last_fullsized":"2023-11-04T01:39:13.571992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:16.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533945+0000","last_change":"2023-11-04T01:38:22.075348+0000","last_active":"2023-11-04T01:39:12.533945+0000","last_peered":"2023-11-04T01:39:12.533945+0000","last_clean":"2023-11-04T01:39:12.533945+0000","last_became_active":"2023-11-04T01:38:22.075069+0000","last_became_peered":"2023-11-04T01:38:22.075069+0000","last_unstale":"2023-11-04T01:39:12.533945+0000","last_undegraded":"2023-11-04T01:39:12.533945+0000","last_fullsized":"2023-11-04T01:39:12.533945+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:06.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528129+0000","last_change":"2023-11-04T01:38:23.062630+0000","last_active":"2023-11-04T01:39:12.528129+0000","last_peered":"2023-11-04T01:39:12.528129+0000","last_clean":"2023-11-04T01:39:12.528129+0000","last_became_active":"2023-11-04T01:38:21.066987+0000","last_became_peered":"2023-11-04T01:38:21.066987+0000","last_unstale":"2023-11-04T01:39:12.528129+0000","last_undegraded":"2023-11-04T01:39:12.528129+0000","last_fullsized":"2023-11-04T01:39:12.528129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:48.254134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064188099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541604+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:39:12.541604+0000","last_peered":"2023-11-04T01:39:12.541604+0000","last_clean":"2023-11-04T01:39:12.541604+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:39:12.541604+0000","last_undegraded":"2023-11-04T01:39:12.541604+0000","last_fullsized":"2023-11-04T01:39:12.541604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559900+0000","last_change":"2023-11-04T01:39:13.557170+0000","last_active":"2023-11-04T01:39:13.559900+0000","last_peered":"2023-11-04T01:39:13.559900+0000","last_clean":"2023-11-04T01:39:13.559900+0000","last_became_active":"2023-11-04T01:39:13.556834+0000","last_became_peered":"2023-11-04T01:39:13.556834+0000","last_unstale":"2023-11-04T01:39:13.559900+0000","last_undegraded":"2023-11-04T01:39:13.559900+0000","last_fullsized":"2023-11-04T01:39:13.559900+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:14.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551147+0000","last_change":"2023-11-04T01:39:12.547742+0000","last_active":"2023-11-04T01:39:13.551147+0000","last_peered":"2023-11-04T01:39:13.551147+0000","last_clean":"2023-11-04T01:39:13.551147+0000","last_became_active":"2023-11-04T01:39:12.547478+0000","last_became_peered":"2023-11-04T01:39:12.547478+0000","last_unstale":"2023-11-04T01:39:13.551147+0000","last_undegraded":"2023-11-04T01:39:13.551147+0000","last_fullsized":"2023-11-04T01:39:13.551147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:01.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536204+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:39:12.536204+0000","last_peered":"2023-11-04T01:39:12.536204+0000","last_clean":"2023-11-04T01:39:12.536204+0000","last_became_active":"2023-11-04T01:38:22.074743+0000","last_became_peered":"2023-11-04T01:38:22.074743+0000","last_unstale":"2023-11-04T01:39:12.536204+0000","last_undegraded":"2023-11-04T01:39:12.536204+0000","last_fullsized":"2023-11-04T01:39:12.536204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:33:48.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533285+0000","last_change":"2023-11-04T01:38:23.066643+0000","last_active":"2023-11-04T01:39:12.533285+0000","last_peered":"2023-11-04T01:39:12.533285+0000","last_clean":"2023-11-04T01:39:12.533285+0000","last_became_active":"2023-11-04T01:38:21.070223+0000","last_became_peered":"2023-11-04T01:38:21.070223+0000","last_unstale":"2023-11-04T01:39:12.533285+0000","last_undegraded":"2023-11-04T01:39:12.533285+0000","last_fullsized":"2023-11-04T01:39:12.533285+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:52.001252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000522103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533462+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:39:12.533462+0000","last_peered":"2023-11-04T01:39:12.533462+0000","last_clean":"2023-11-04T01:39:12.533462+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:39:12.533462+0000","last_undegraded":"2023-11-04T01:39:12.533462+0000","last_fullsized":"2023-11-04T01:39:12.533462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565609+0000","last_change":"2023-11-04T01:39:13.563700+0000","last_active":"2023-11-04T01:39:13.565609+0000","last_peered":"2023-11-04T01:39:13.565609+0000","last_clean":"2023-11-04T01:39:13.565609+0000","last_became_active":"2023-11-04T01:39:13.563444+0000","last_became_peered":"2023-11-04T01:39:13.563444+0000","last_unstale":"2023-11-04T01:39:13.565609+0000","last_undegraded":"2023-11-04T01:39:13.565609+0000","last_fullsized":"2023-11-04T01:39:13.565609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:13.810773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.544416+0000","last_change":"2023-11-04T01:39:12.544735+0000","last_active":"2023-11-04T01:39:13.544416+0000","last_peered":"2023-11-04T01:39:13.544416+0000","last_clean":"2023-11-04T01:39:13.544416+0000","last_became_active":"2023-11-04T01:39:12.544487+0000","last_became_peered":"2023-11-04T01:39:12.544487+0000","last_unstale":"2023-11-04T01:39:13.544416+0000","last_undegraded":"2023-11-04T01:39:13.544416+0000","last_fullsized":"2023-11-04T01:39:13.544416+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:00.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533360+0000","last_change":"2023-11-04T01:38:22.075923+0000","last_active":"2023-11-04T01:39:12.533360+0000","last_peered":"2023-11-04T01:39:12.533360+0000","last_clean":"2023-11-04T01:39:12.533360+0000","last_became_active":"2023-11-04T01:38:22.075005+0000","last_became_peered":"2023-11-04T01:38:22.075005+0000","last_unstale":"2023-11-04T01:39:12.533360+0000","last_undegraded":"2023-11-04T01:39:12.533360+0000","last_fullsized":"2023-11-04T01:39:12.533360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:53.841576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541387+0000","last_change":"2023-11-04T01:38:23.327369+0000","last_active":"2023-11-04T01:39:12.541387+0000","last_peered":"2023-11-04T01:39:12.541387+0000","last_clean":"2023-11-04T01:39:12.541387+0000","last_became_active":"2023-11-04T01:38:21.071839+0000","last_became_peered":"2023-11-04T01:38:21.071839+0000","last_unstale":"2023-11-04T01:39:12.541387+0000","last_undegraded":"2023-11-04T01:39:12.541387+0000","last_fullsized":"2023-11-04T01:39:12.541387+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:41.422222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044534300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536480+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:39:12.536480+0000","last_peered":"2023-11-04T01:39:12.536480+0000","last_clean":"2023-11-04T01:39:12.536480+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:39:12.536480+0000","last_undegraded":"2023-11-04T01:39:12.536480+0000","last_fullsized":"2023-11-04T01:39:12.536480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549374+0000","last_change":"2023-11-04T01:39:13.546642+0000","last_active":"2023-11-04T01:39:13.549374+0000","last_peered":"2023-11-04T01:39:13.549374+0000","last_clean":"2023-11-04T01:39:13.549374+0000","last_became_active":"2023-11-04T01:39:13.546376+0000","last_became_peered":"2023-11-04T01:39:13.546376+0000","last_unstale":"2023-11-04T01:39:13.549374+0000","last_undegraded":"2023-11-04T01:39:13.549374+0000","last_fullsized":"2023-11-04T01:39:13.549374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:38.689833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"94'6","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.573254+0000","last_change":"2023-11-04T01:39:12.547414+0000","last_active":"2023-11-04T01:39:13.573254+0000","last_peered":"2023-11-04T01:39:13.573254+0000","last_clean":"2023-11-04T01:39:13.573254+0000","last_became_active":"2023-11-04T01:39:12.546788+0000","last_became_peered":"2023-11-04T01:39:12.546788+0000","last_unstale":"2023-11-04T01:39:13.573254+0000","last_undegraded":"2023-11-04T01:39:13.573254+0000","last_fullsized":"2023-11-04T01:39:13.573254+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:19.011651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536112+0000","last_change":"2023-11-04T01:38:22.072700+0000","last_active":"2023-11-04T01:39:12.536112+0000","last_peered":"2023-11-04T01:39:12.536112+0000","last_clean":"2023-11-04T01:39:12.536112+0000","last_became_active":"2023-11-04T01:38:22.072280+0000","last_became_peered":"2023-11-04T01:38:22.072280+0000","last_unstale":"2023-11-04T01:39:12.536112+0000","last_undegraded":"2023-11-04T01:39:12.536112+0000","last_fullsized":"2023-11-04T01:39:12.536112+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541058+0000","last_change":"2023-11-04T01:38:23.327480+0000","last_active":"2023-11-04T01:39:12.541058+0000","last_peered":"2023-11-04T01:39:12.541058+0000","last_clean":"2023-11-04T01:39:12.541058+0000","last_became_active":"2023-11-04T01:38:21.071005+0000","last_became_peered":"2023-11-04T01:38:21.071005+0000","last_unstale":"2023-11-04T01:39:12.541058+0000","last_undegraded":"2023-11-04T01:39:12.541058+0000","last_fullsized":"2023-11-04T01:39:12.541058+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:25.393510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081827400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541474+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:39:12.541474+0000","last_peered":"2023-11-04T01:39:12.541474+0000","last_clean":"2023-11-04T01:39:12.541474+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:39:12.541474+0000","last_undegraded":"2023-11-04T01:39:12.541474+0000","last_fullsized":"2023-11-04T01:39:12.541474+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565829+0000","last_change":"2023-11-04T01:39:13.561174+0000","last_active":"2023-11-04T01:39:13.565829+0000","last_peered":"2023-11-04T01:39:13.565829+0000","last_clean":"2023-11-04T01:39:13.565829+0000","last_became_active":"2023-11-04T01:39:13.560844+0000","last_became_peered":"2023-11-04T01:39:13.560844+0000","last_unstale":"2023-11-04T01:39:13.565829+0000","last_undegraded":"2023-11-04T01:39:13.565829+0000","last_fullsized":"2023-11-04T01:39:13.565829+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:04.137904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"94'3","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565967+0000","last_change":"2023-11-04T01:39:12.542494+0000","last_active":"2023-11-04T01:39:13.565967+0000","last_peered":"2023-11-04T01:39:13.565967+0000","last_clean":"2023-11-04T01:39:13.565967+0000","last_became_active":"2023-11-04T01:39:12.542193+0000","last_became_peered":"2023-11-04T01:39:12.542193+0000","last_unstale":"2023-11-04T01:39:13.565967+0000","last_undegraded":"2023-11-04T01:39:13.565967+0000","last_fullsized":"2023-11-04T01:39:13.565967+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:49.154942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.531990+0000","last_change":"2023-11-04T01:38:22.070891+0000","last_active":"2023-11-04T01:39:12.531990+0000","last_peered":"2023-11-04T01:39:12.531990+0000","last_clean":"2023-11-04T01:39:12.531990+0000","last_became_active":"2023-11-04T01:38:22.070338+0000","last_became_peered":"2023-11-04T01:38:22.070338+0000","last_unstale":"2023-11-04T01:39:12.531990+0000","last_undegraded":"2023-11-04T01:39:12.531990+0000","last_fullsized":"2023-11-04T01:39:12.531990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:21.863324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.531589+0000","last_change":"2023-11-04T01:38:23.066474+0000","last_active":"2023-11-04T01:39:12.531589+0000","last_peered":"2023-11-04T01:39:12.531589+0000","last_clean":"2023-11-04T01:39:12.531589+0000","last_became_active":"2023-11-04T01:38:21.069750+0000","last_became_peered":"2023-11-04T01:38:21.069750+0000","last_unstale":"2023-11-04T01:39:12.531589+0000","last_undegraded":"2023-11-04T01:39:12.531589+0000","last_fullsized":"2023-11-04T01:39:12.531589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:07.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045060599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.542012+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:39:12.542012+0000","last_peered":"2023-11-04T01:39:12.542012+0000","last_clean":"2023-11-04T01:39:12.542012+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:39:12.542012+0000","last_undegraded":"2023-11-04T01:39:12.542012+0000","last_fullsized":"2023-11-04T01:39:12.542012+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565901+0000","last_change":"2023-11-04T01:39:13.560694+0000","last_active":"2023-11-04T01:39:13.565901+0000","last_peered":"2023-11-04T01:39:13.565901+0000","last_clean":"2023-11-04T01:39:13.565901+0000","last_became_active":"2023-11-04T01:39:13.560419+0000","last_became_peered":"2023-11-04T01:39:13.560419+0000","last_unstale":"2023-11-04T01:39:13.565901+0000","last_undegraded":"2023-11-04T01:39:13.565901+0000","last_fullsized":"2023-11-04T01:39:13.565901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:24.036674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.541992+0000","last_change":"2023-11-04T01:39:12.547357+0000","last_active":"2023-11-04T01:39:13.541992+0000","last_peered":"2023-11-04T01:39:13.541992+0000","last_clean":"2023-11-04T01:39:13.541992+0000","last_became_active":"2023-11-04T01:39:12.547075+0000","last_became_peered":"2023-11-04T01:39:12.547075+0000","last_unstale":"2023-11-04T01:39:13.541992+0000","last_undegraded":"2023-11-04T01:39:13.541992+0000","last_fullsized":"2023-11-04T01:39:13.541992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:43.085949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536556+0000","last_change":"2023-11-04T01:38:22.076759+0000","last_active":"2023-11-04T01:39:12.536556+0000","last_peered":"2023-11-04T01:39:12.536556+0000","last_clean":"2023-11-04T01:39:12.536556+0000","last_became_active":"2023-11-04T01:38:22.075797+0000","last_became_peered":"2023-11-04T01:38:22.075797+0000","last_unstale":"2023-11-04T01:39:12.536556+0000","last_undegraded":"2023-11-04T01:39:12.536556+0000","last_fullsized":"2023-11-04T01:39:12.536556+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:57.170559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538040+0000","last_change":"2023-11-04T01:38:23.061342+0000","last_active":"2023-11-04T01:39:12.538040+0000","last_peered":"2023-11-04T01:39:12.538040+0000","last_clean":"2023-11-04T01:39:12.538040+0000","last_became_active":"2023-11-04T01:38:21.070645+0000","last_became_peered":"2023-11-04T01:38:21.070645+0000","last_unstale":"2023-11-04T01:39:12.538040+0000","last_undegraded":"2023-11-04T01:39:12.538040+0000","last_fullsized":"2023-11-04T01:39:12.538040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053603500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528267+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:39:12.528267+0000","last_peered":"2023-11-04T01:39:12.528267+0000","last_clean":"2023-11-04T01:39:12.528267+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:39:12.528267+0000","last_undegraded":"2023-11-04T01:39:12.528267+0000","last_fullsized":"2023-11-04T01:39:12.528267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535203+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:39:12.535203+0000","last_peered":"2023-11-04T01:39:12.535203+0000","last_clean":"2023-11-04T01:39:12.535203+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:39:12.535203+0000","last_undegraded":"2023-11-04T01:39:12.535203+0000","last_fullsized":"2023-11-04T01:39:12.535203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1761280,"data_stored":1163523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71199999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70099999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.505},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61599999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65800000000000003,"5min":0.872,"15min":0.872},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.443}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":571590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61499999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.627}]},{"osd":4,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44800000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":573143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63900000000000001,"5min":0.752,"15min":0.752},"last":0.37},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.78800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":0.752},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70999999999999996,"5min":0.75,"15min":0.75},"last":0.498}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1159168,"data_stored":572539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":1.133,"15min":1.133},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.65400000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.77100000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":574221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.28599999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34999999999999998,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.502,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.375},"min":{"1min":0.29899999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72599999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.72199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.876,"15min":0.876},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":572539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.375,"15min":0.39500000000000002},"min":{"1min":0.215,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.47199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.376,"15min":0.40000000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.53300000000000003,"5min":1.427,"15min":1.427},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.438,"5min":1.375,"15min":1.375},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34899999999999998},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48199999999999998,"5min":1.266,"15min":1.266},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41399999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.251},{"interface":"front","average":{"1min":0.375,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.505,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.309}]},{"osd":4,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.378,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.179,"15min":1.179},"last":0.433}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83199999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61099999999999999,"15min":0.63500000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83999999999999997,"5min":1.498,"15min":1.498},"last":0.41799999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.276,"15min":1.276},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.39500000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.498},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":564353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.318,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.501,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.315,"15min":0.314},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34000000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.373,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.33000000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.437}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":1163612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.311,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42199999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.46999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.308},{"interface":"front","average":{"1min":0.372,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.502,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.376}]},{"osd":4,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":1.048,"15min":1.048},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73199999999999998,"5min":1.056,"15min":1.056},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72199999999999998,"5min":0.874,"15min":0.874},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.67500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:16.504 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:16.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.633+0000 7f1013eb4640 1 Processor -- start 2023-11-04T01:39:16.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.633+0000 7f1013eb4640 1 -- start start 2023-11-04T01:39:16.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1013eb4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1013eb4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f100c0ca2b0 0x7f100c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1013eb4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c0c9880 con 0x7f100c15cf10 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1013eb4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c0b11b0 con 0x7f100c0ca2b0 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1013eb4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0cac60 con 0x7f100c0b07f0 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f101144f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1012451640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f100c0ca2b0 0x7f100c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1011c50640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f100c15cf10 0x7f100c06c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:33732/0 (socket says 172.21.15.93:33732) 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1011c50640 1 -- 172.21.15.93:0/1239743445 learned_addr learned my addr 172.21.15.93:0/1239743445 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1012451640 1 -- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 msgr2=0x7f100c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1012451640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1012451640 1 -- 172.21.15.93:0/1239743445 >> v1:172.21.15.125:6789/0 conn(0x7f100c15cf10 legacy=0x7f100c06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f1012451640 1 -- 172.21.15.93:0/1239743445 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c06d0f0 con 0x7f100c0ca2b0 2023-11-04T01:39:16.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.634+0000 7f101144f640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.635+0000 7f1012451640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c0ca2b0 0x7f100c0ca720 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1004009d90 tx=0x7f100402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c582f9711ee940 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.635+0000 7f1010c4e640 1 -- 172.21.15.93:0/1239743445 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100402cc60 con 0x7f100c0ca2b0 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.635+0000 7f1010c4e640 1 -- 172.21.15.93:0/1239743445 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100402cdc0 con 0x7f100c0ca2b0 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.635+0000 7f1010c4e640 1 -- 172.21.15.93:0/1239743445 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004034660 con 0x7f100c0ca2b0 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 -- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c0ca2b0 msgr2=0x7f100c0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c0ca2b0 0x7f100c0ca720 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1004009d90 tx=0x7f100402beb0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 -- 172.21.15.93:0/1239743445 shutdown_connections 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c0ca2b0 0x7f100c0ca720 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 --2- 172.21.15.93:0/1239743445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 -- 172.21.15.93:0/1239743445 >> 172.21.15.93:0/1239743445 conn(0x7f100c0cb7f0 msgr2=0x7f100c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 -- 172.21.15.93:0/1239743445 shutdown_connections 2023-11-04T01:39:16.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.636+0000 7f1013eb4640 1 -- 172.21.15.93:0/1239743445 wait complete. 2023-11-04T01:39:16.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.637+0000 7f1013eb4640 1 Processor -- start 2023-11-04T01:39:16.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.637+0000 7f1013eb4640 1 -- start start 2023-11-04T01:39:16.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 0x7f100c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0c2cb0 con 0x7f100c0ca2b0 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c1562a0 con 0x7f100c15cf10 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1013eb4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c156580 con 0x7f100c0b07f0 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35066/0 (socket says 172.21.15.93:35066) 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 -- 172.21.15.93:0/646364652 learned_addr learned my addr 172.21.15.93:0/646364652 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1011c50640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1012451640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 0x7f100c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 -- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 msgr2=0x7f100c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 -- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 msgr2=0x7f100c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 0x7f100c0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f101144f640 1 -- 172.21.15.93:0/646364652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009400 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.638+0000 7f1012451640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 0x7f100c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f101144f640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00ebe0 tx=0x7f0ffc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc009760 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00cc30 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1004009a70 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00eee0 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.639+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c0c2940 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.640+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0c2e60 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.640+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ffc013470 con 0x7f100c0ca2b0 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.640+0000 7f10027fc640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 0x7f0ff006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.640+0000 7f1011c50640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 0x7f0ff006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.640+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0ffc08a120 con 0x7f100c0ca2b0 2023-11-04T01:39:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.641+0000 7f1011c50640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 0x7f0ff006d360 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1008005880 tx=0x7f1008009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.645+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f100c0c2e60 con 0x7f100c0ca2b0 2023-11-04T01:39:16.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.808+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 --> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f100c0cd930 con 0x7f0ff006aea0 2023-11-04T01:39:16.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.820+0000 7f10027fc640 1 -- 172.21.15.93:0/646364652 <== mgr.4113 v2:172.21.15.93:6832/4069824876 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532271 (secure 0 0 0) 0x7f10080014e0 con 0x7f0ff006aea0 2023-11-04T01:39:16.827 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:16.830 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2023-11-04T01:39:16.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 msgr2=0x7f0ff006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 0x7f0ff006d360 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1008005880 tx=0x7f1008009040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 msgr2=0x7f100c1f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00ebe0 tx=0x7f0ffc00c520 comp rx=0 tx=0).stop 2023-11-04T01:39:16.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 shutdown_connections 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ff006aea0 0x7f0ff006d360 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f100c15cf10 0x7f100c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f100c0ca2b0 0x7f100c1f2250 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 --2- 172.21.15.93:0/646364652 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f100c0b07f0 0x7f100c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 >> 172.21.15.93:0/646364652 conn(0x7f100c0cb7f0 msgr2=0x7f100c15c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 shutdown_connections 2023-11-04T01:39:16.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.824+0000 7f1013eb4640 1 -- 172.21.15.93:0/646364652 wait complete. 2023-11-04T01:39:16.836 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-11-04T01:39:15.369389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":295,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243068,"kb_used_data":10252,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754731652,"statfs":{"total":773094113280,"available":772845211648,"internally_reserved":0,"allocated":10498048,"data_stored":5755520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000967"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565894+0000","last_change":"2023-11-04T01:39:13.562271+0000","last_active":"2023-11-04T01:39:13.565894+0000","last_peered":"2023-11-04T01:39:13.565894+0000","last_clean":"2023-11-04T01:39:13.565894+0000","last_became_active":"2023-11-04T01:39:13.562039+0000","last_became_peered":"2023-11-04T01:39:13.562039+0000","last_unstale":"2023-11-04T01:39:13.565894+0000","last_undegraded":"2023-11-04T01:39:13.565894+0000","last_fullsized":"2023-11-04T01:39:13.565894+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:01.197298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560825+0000","last_change":"2023-11-04T01:39:13.558408+0000","last_active":"2023-11-04T01:39:13.560825+0000","last_peered":"2023-11-04T01:39:13.560825+0000","last_clean":"2023-11-04T01:39:13.560825+0000","last_became_active":"2023-11-04T01:39:13.557837+0000","last_became_peered":"2023-11-04T01:39:13.557837+0000","last_unstale":"2023-11-04T01:39:13.560825+0000","last_undegraded":"2023-11-04T01:39:13.560825+0000","last_fullsized":"2023-11-04T01:39:13.560825+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:13.480700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551111+0000","last_change":"2023-11-04T01:39:13.549164+0000","last_active":"2023-11-04T01:39:13.551111+0000","last_peered":"2023-11-04T01:39:13.551111+0000","last_clean":"2023-11-04T01:39:13.551111+0000","last_became_active":"2023-11-04T01:39:13.548897+0000","last_became_peered":"2023-11-04T01:39:13.548897+0000","last_unstale":"2023-11-04T01:39:13.551111+0000","last_undegraded":"2023-11-04T01:39:13.551111+0000","last_fullsized":"2023-11-04T01:39:13.551111+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:26.815136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566118+0000","last_change":"2023-11-04T01:39:13.556807+0000","last_active":"2023-11-04T01:39:13.566118+0000","last_peered":"2023-11-04T01:39:13.566118+0000","last_clean":"2023-11-04T01:39:13.566118+0000","last_became_active":"2023-11-04T01:39:13.555838+0000","last_became_peered":"2023-11-04T01:39:13.555838+0000","last_unstale":"2023-11-04T01:39:13.566118+0000","last_undegraded":"2023-11-04T01:39:13.566118+0000","last_fullsized":"2023-11-04T01:39:13.566118+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:12.987168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572586+0000","last_change":"2023-11-04T01:39:13.567174+0000","last_active":"2023-11-04T01:39:13.572586+0000","last_peered":"2023-11-04T01:39:13.572586+0000","last_clean":"2023-11-04T01:39:13.572586+0000","last_became_active":"2023-11-04T01:39:13.566932+0000","last_became_peered":"2023-11-04T01:39:13.566932+0000","last_unstale":"2023-11-04T01:39:13.572586+0000","last_undegraded":"2023-11-04T01:39:13.572586+0000","last_fullsized":"2023-11-04T01:39:13.572586+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:19.826301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552645+0000","last_change":"2023-11-04T01:39:13.549472+0000","last_active":"2023-11-04T01:39:13.552645+0000","last_peered":"2023-11-04T01:39:13.552645+0000","last_clean":"2023-11-04T01:39:13.552645+0000","last_became_active":"2023-11-04T01:39:13.549201+0000","last_became_peered":"2023-11-04T01:39:13.549201+0000","last_unstale":"2023-11-04T01:39:13.552645+0000","last_undegraded":"2023-11-04T01:39:13.552645+0000","last_fullsized":"2023-11-04T01:39:13.552645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:58.119539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561276+0000","last_change":"2023-11-04T01:39:13.559615+0000","last_active":"2023-11-04T01:39:13.561276+0000","last_peered":"2023-11-04T01:39:13.561276+0000","last_clean":"2023-11-04T01:39:13.561276+0000","last_became_active":"2023-11-04T01:39:13.559171+0000","last_became_peered":"2023-11-04T01:39:13.559171+0000","last_unstale":"2023-11-04T01:39:13.561276+0000","last_undegraded":"2023-11-04T01:39:13.561276+0000","last_fullsized":"2023-11-04T01:39:13.561276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:55:45.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550328+0000","last_change":"2023-11-04T01:39:13.547359+0000","last_active":"2023-11-04T01:39:13.550328+0000","last_peered":"2023-11-04T01:39:13.550328+0000","last_clean":"2023-11-04T01:39:13.550328+0000","last_became_active":"2023-11-04T01:39:13.547083+0000","last_became_peered":"2023-11-04T01:39:13.547083+0000","last_unstale":"2023-11-04T01:39:13.550328+0000","last_undegraded":"2023-11-04T01:39:13.550328+0000","last_fullsized":"2023-11-04T01:39:13.550328+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:01.398526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565878+0000","last_change":"2023-11-04T01:39:13.558630+0000","last_active":"2023-11-04T01:39:13.565878+0000","last_peered":"2023-11-04T01:39:13.565878+0000","last_clean":"2023-11-04T01:39:13.565878+0000","last_became_active":"2023-11-04T01:39:13.558344+0000","last_became_peered":"2023-11-04T01:39:13.558344+0000","last_unstale":"2023-11-04T01:39:13.565878+0000","last_undegraded":"2023-11-04T01:39:13.565878+0000","last_fullsized":"2023-11-04T01:39:13.565878+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:31:04.454043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.569211+0000","last_change":"2023-11-04T01:39:13.567569+0000","last_active":"2023-11-04T01:39:13.569211+0000","last_peered":"2023-11-04T01:39:13.569211+0000","last_clean":"2023-11-04T01:39:13.569211+0000","last_became_active":"2023-11-04T01:39:13.567308+0000","last_became_peered":"2023-11-04T01:39:13.567308+0000","last_unstale":"2023-11-04T01:39:13.569211+0000","last_undegraded":"2023-11-04T01:39:13.569211+0000","last_fullsized":"2023-11-04T01:39:13.569211+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:12.490947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560799+0000","last_change":"2023-11-04T01:39:13.558983+0000","last_active":"2023-11-04T01:39:13.560799+0000","last_peered":"2023-11-04T01:39:13.560799+0000","last_clean":"2023-11-04T01:39:13.560799+0000","last_became_active":"2023-11-04T01:39:13.558755+0000","last_became_peered":"2023-11-04T01:39:13.558755+0000","last_unstale":"2023-11-04T01:39:13.560799+0000","last_undegraded":"2023-11-04T01:39:13.560799+0000","last_fullsized":"2023-11-04T01:39:13.560799+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:44:17.145347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.569096+0000","last_change":"2023-11-04T01:39:13.567070+0000","last_active":"2023-11-04T01:39:13.569096+0000","last_peered":"2023-11-04T01:39:13.569096+0000","last_clean":"2023-11-04T01:39:13.569096+0000","last_became_active":"2023-11-04T01:39:13.566811+0000","last_became_peered":"2023-11-04T01:39:13.566811+0000","last_unstale":"2023-11-04T01:39:13.569096+0000","last_undegraded":"2023-11-04T01:39:13.569096+0000","last_fullsized":"2023-11-04T01:39:13.569096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:39:37.567426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.562219+0000","last_change":"2023-11-04T01:39:13.560112+0000","last_active":"2023-11-04T01:39:13.562219+0000","last_peered":"2023-11-04T01:39:13.562219+0000","last_clean":"2023-11-04T01:39:13.562219+0000","last_became_active":"2023-11-04T01:39:13.559846+0000","last_became_peered":"2023-11-04T01:39:13.559846+0000","last_unstale":"2023-11-04T01:39:13.562219+0000","last_undegraded":"2023-11-04T01:39:13.562219+0000","last_fullsized":"2023-11-04T01:39:13.562219+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:19.553984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561207+0000","last_change":"2023-11-04T01:39:13.558936+0000","last_active":"2023-11-04T01:39:13.561207+0000","last_peered":"2023-11-04T01:39:13.561207+0000","last_clean":"2023-11-04T01:39:13.561207+0000","last_became_active":"2023-11-04T01:39:13.558627+0000","last_became_peered":"2023-11-04T01:39:13.558627+0000","last_unstale":"2023-11-04T01:39:13.561207+0000","last_undegraded":"2023-11-04T01:39:13.561207+0000","last_fullsized":"2023-11-04T01:39:13.561207+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:42.071422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556739+0000","last_change":"2023-11-04T01:39:13.552469+0000","last_active":"2023-11-04T01:39:13.556739+0000","last_peered":"2023-11-04T01:39:13.556739+0000","last_clean":"2023-11-04T01:39:13.556739+0000","last_became_active":"2023-11-04T01:39:13.551921+0000","last_became_peered":"2023-11-04T01:39:13.551921+0000","last_unstale":"2023-11-04T01:39:13.556739+0000","last_undegraded":"2023-11-04T01:39:13.556739+0000","last_fullsized":"2023-11-04T01:39:13.556739+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:00:26.098646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549897+0000","last_change":"2023-11-04T01:39:13.548183+0000","last_active":"2023-11-04T01:39:13.549897+0000","last_peered":"2023-11-04T01:39:13.549897+0000","last_clean":"2023-11-04T01:39:13.549897+0000","last_became_active":"2023-11-04T01:39:13.547795+0000","last_became_peered":"2023-11-04T01:39:13.547795+0000","last_unstale":"2023-11-04T01:39:13.549897+0000","last_undegraded":"2023-11-04T01:39:13.549897+0000","last_fullsized":"2023-11-04T01:39:13.549897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:32:00.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.562757+0000","last_change":"2023-11-04T01:39:13.560687+0000","last_active":"2023-11-04T01:39:13.562757+0000","last_peered":"2023-11-04T01:39:13.562757+0000","last_clean":"2023-11-04T01:39:13.562757+0000","last_became_active":"2023-11-04T01:39:13.560435+0000","last_became_peered":"2023-11-04T01:39:13.560435+0000","last_unstale":"2023-11-04T01:39:13.562757+0000","last_undegraded":"2023-11-04T01:39:13.562757+0000","last_fullsized":"2023-11-04T01:39:13.562757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:14.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559849+0000","last_change":"2023-11-04T01:39:13.557332+0000","last_active":"2023-11-04T01:39:13.559849+0000","last_peered":"2023-11-04T01:39:13.559849+0000","last_clean":"2023-11-04T01:39:13.559849+0000","last_became_active":"2023-11-04T01:39:13.557042+0000","last_became_peered":"2023-11-04T01:39:13.557042+0000","last_unstale":"2023-11-04T01:39:13.559849+0000","last_undegraded":"2023-11-04T01:39:13.559849+0000","last_fullsized":"2023-11-04T01:39:13.559849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:19.553984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559319+0000","last_change":"2023-11-04T01:39:13.556426+0000","last_active":"2023-11-04T01:39:13.559319+0000","last_peered":"2023-11-04T01:39:13.559319+0000","last_clean":"2023-11-04T01:39:13.559319+0000","last_became_active":"2023-11-04T01:39:13.556160+0000","last_became_peered":"2023-11-04T01:39:13.556160+0000","last_unstale":"2023-11-04T01:39:13.559319+0000","last_undegraded":"2023-11-04T01:39:13.559319+0000","last_fullsized":"2023-11-04T01:39:13.559319+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:06.603967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550845+0000","last_change":"2023-11-04T01:39:13.549543+0000","last_active":"2023-11-04T01:39:13.550845+0000","last_peered":"2023-11-04T01:39:13.550845+0000","last_clean":"2023-11-04T01:39:13.550845+0000","last_became_active":"2023-11-04T01:39:13.549257+0000","last_became_peered":"2023-11-04T01:39:13.549257+0000","last_unstale":"2023-11-04T01:39:13.550845+0000","last_undegraded":"2023-11-04T01:39:13.550845+0000","last_fullsized":"2023-11-04T01:39:13.550845+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:41.923049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.553775+0000","last_change":"2023-11-04T01:39:13.552628+0000","last_active":"2023-11-04T01:39:13.553775+0000","last_peered":"2023-11-04T01:39:13.553775+0000","last_clean":"2023-11-04T01:39:13.553775+0000","last_became_active":"2023-11-04T01:39:13.552363+0000","last_became_peered":"2023-11-04T01:39:13.552363+0000","last_unstale":"2023-11-04T01:39:13.553775+0000","last_undegraded":"2023-11-04T01:39:13.553775+0000","last_fullsized":"2023-11-04T01:39:13.553775+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:52.909716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570734+0000","last_change":"2023-11-04T01:39:13.566204+0000","last_active":"2023-11-04T01:39:13.570734+0000","last_peered":"2023-11-04T01:39:13.570734+0000","last_clean":"2023-11-04T01:39:13.570734+0000","last_became_active":"2023-11-04T01:39:13.565884+0000","last_became_peered":"2023-11-04T01:39:13.565884+0000","last_unstale":"2023-11-04T01:39:13.570734+0000","last_undegraded":"2023-11-04T01:39:13.570734+0000","last_fullsized":"2023-11-04T01:39:13.570734+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.382978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549884+0000","last_change":"2023-11-04T01:39:13.549111+0000","last_active":"2023-11-04T01:39:13.549884+0000","last_peered":"2023-11-04T01:39:13.549884+0000","last_clean":"2023-11-04T01:39:13.549884+0000","last_became_active":"2023-11-04T01:39:13.548829+0000","last_became_peered":"2023-11-04T01:39:13.548829+0000","last_unstale":"2023-11-04T01:39:13.549884+0000","last_undegraded":"2023-11-04T01:39:13.549884+0000","last_fullsized":"2023-11-04T01:39:13.549884+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:49.739541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570695+0000","last_change":"2023-11-04T01:39:13.567415+0000","last_active":"2023-11-04T01:39:13.570695+0000","last_peered":"2023-11-04T01:39:13.570695+0000","last_clean":"2023-11-04T01:39:13.570695+0000","last_became_active":"2023-11-04T01:39:13.567156+0000","last_became_peered":"2023-11-04T01:39:13.567156+0000","last_unstale":"2023-11-04T01:39:13.570695+0000","last_undegraded":"2023-11-04T01:39:13.570695+0000","last_fullsized":"2023-11-04T01:39:13.570695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:36.687727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561949+0000","last_change":"2023-11-04T01:39:13.559990+0000","last_active":"2023-11-04T01:39:13.561949+0000","last_peered":"2023-11-04T01:39:13.561949+0000","last_clean":"2023-11-04T01:39:13.561949+0000","last_became_active":"2023-11-04T01:39:13.559744+0000","last_became_peered":"2023-11-04T01:39:13.559744+0000","last_unstale":"2023-11-04T01:39:13.561949+0000","last_undegraded":"2023-11-04T01:39:13.561949+0000","last_fullsized":"2023-11-04T01:39:13.561949+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:47.664700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.554199+0000","last_change":"2023-11-04T01:39:13.549716+0000","last_active":"2023-11-04T01:39:13.554199+0000","last_peered":"2023-11-04T01:39:13.554199+0000","last_clean":"2023-11-04T01:39:13.554199+0000","last_became_active":"2023-11-04T01:39:13.549455+0000","last_became_peered":"2023-11-04T01:39:13.549455+0000","last_unstale":"2023-11-04T01:39:13.554199+0000","last_undegraded":"2023-11-04T01:39:13.554199+0000","last_fullsized":"2023-11-04T01:39:13.554199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:43:47.675847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556242+0000","last_change":"2023-11-04T01:39:13.550843+0000","last_active":"2023-11-04T01:39:13.556242+0000","last_peered":"2023-11-04T01:39:13.556242+0000","last_clean":"2023-11-04T01:39:13.556242+0000","last_became_active":"2023-11-04T01:39:13.550586+0000","last_became_peered":"2023-11-04T01:39:13.550586+0000","last_unstale":"2023-11-04T01:39:13.556242+0000","last_undegraded":"2023-11-04T01:39:13.556242+0000","last_fullsized":"2023-11-04T01:39:13.556242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:08:27.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572641+0000","last_change":"2023-11-04T01:39:13.568834+0000","last_active":"2023-11-04T01:39:13.572641+0000","last_peered":"2023-11-04T01:39:13.572641+0000","last_clean":"2023-11-04T01:39:13.572641+0000","last_became_active":"2023-11-04T01:39:13.568197+0000","last_became_peered":"2023-11-04T01:39:13.568197+0000","last_unstale":"2023-11-04T01:39:13.572641+0000","last_undegraded":"2023-11-04T01:39:13.572641+0000","last_fullsized":"2023-11-04T01:39:13.572641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:56.670972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.555824+0000","last_change":"2023-11-04T01:39:13.555107+0000","last_active":"2023-11-04T01:39:13.555824+0000","last_peered":"2023-11-04T01:39:13.555824+0000","last_clean":"2023-11-04T01:39:13.555824+0000","last_became_active":"2023-11-04T01:39:13.554545+0000","last_became_peered":"2023-11-04T01:39:13.554545+0000","last_unstale":"2023-11-04T01:39:13.555824+0000","last_undegraded":"2023-11-04T01:39:13.555824+0000","last_fullsized":"2023-11-04T01:39:13.555824+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:12.964286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559896+0000","last_change":"2023-11-04T01:39:13.557263+0000","last_active":"2023-11-04T01:39:13.559896+0000","last_peered":"2023-11-04T01:39:13.559896+0000","last_clean":"2023-11-04T01:39:13.559896+0000","last_became_active":"2023-11-04T01:39:13.556374+0000","last_became_peered":"2023-11-04T01:39:13.556374+0000","last_unstale":"2023-11-04T01:39:13.559896+0000","last_undegraded":"2023-11-04T01:39:13.559896+0000","last_fullsized":"2023-11-04T01:39:13.559896+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:06.507210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549851+0000","last_change":"2023-11-04T01:39:13.548774+0000","last_active":"2023-11-04T01:39:13.549851+0000","last_peered":"2023-11-04T01:39:13.549851+0000","last_clean":"2023-11-04T01:39:13.549851+0000","last_became_active":"2023-11-04T01:39:13.548551+0000","last_became_peered":"2023-11-04T01:39:13.548551+0000","last_unstale":"2023-11-04T01:39:13.549851+0000","last_undegraded":"2023-11-04T01:39:13.549851+0000","last_fullsized":"2023-11-04T01:39:13.549851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:27:16.363261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568063+0000","last_change":"2023-11-04T01:39:13.566559+0000","last_active":"2023-11-04T01:39:13.568063+0000","last_peered":"2023-11-04T01:39:13.568063+0000","last_clean":"2023-11-04T01:39:13.568063+0000","last_became_active":"2023-11-04T01:39:13.566271+0000","last_became_peered":"2023-11-04T01:39:13.566271+0000","last_unstale":"2023-11-04T01:39:13.568063+0000","last_undegraded":"2023-11-04T01:39:13.568063+0000","last_fullsized":"2023-11-04T01:39:13.568063+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:41.663430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549826+0000","last_change":"2023-11-04T01:39:13.548203+0000","last_active":"2023-11-04T01:39:13.549826+0000","last_peered":"2023-11-04T01:39:13.549826+0000","last_clean":"2023-11-04T01:39:13.549826+0000","last_became_active":"2023-11-04T01:39:13.547899+0000","last_became_peered":"2023-11-04T01:39:13.547899+0000","last_unstale":"2023-11-04T01:39:13.549826+0000","last_undegraded":"2023-11-04T01:39:13.549826+0000","last_fullsized":"2023-11-04T01:39:13.549826+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:31.648635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.545167+0000","last_change":"2023-11-04T01:39:12.545390+0000","last_active":"2023-11-04T01:39:13.545167+0000","last_peered":"2023-11-04T01:39:13.545167+0000","last_clean":"2023-11-04T01:39:13.545167+0000","last_became_active":"2023-11-04T01:39:12.545129+0000","last_became_peered":"2023-11-04T01:39:12.545129+0000","last_unstale":"2023-11-04T01:39:13.545167+0000","last_undegraded":"2023-11-04T01:39:13.545167+0000","last_fullsized":"2023-11-04T01:39:13.545167+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:17.898784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.537101+0000","last_change":"2023-11-04T01:38:22.072453+0000","last_active":"2023-11-04T01:39:12.537101+0000","last_peered":"2023-11-04T01:39:12.537101+0000","last_clean":"2023-11-04T01:39:12.537101+0000","last_became_active":"2023-11-04T01:38:22.071910+0000","last_became_peered":"2023-11-04T01:38:22.071910+0000","last_unstale":"2023-11-04T01:39:12.537101+0000","last_undegraded":"2023-11-04T01:39:12.537101+0000","last_fullsized":"2023-11-04T01:39:12.537101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541966+0000","last_change":"2023-11-04T01:38:23.405090+0000","last_active":"2023-11-04T01:39:12.541966+0000","last_peered":"2023-11-04T01:39:12.541966+0000","last_clean":"2023-11-04T01:39:12.541966+0000","last_became_active":"2023-11-04T01:38:21.069416+0000","last_became_peered":"2023-11-04T01:38:21.069416+0000","last_unstale":"2023-11-04T01:39:12.541966+0000","last_undegraded":"2023-11-04T01:39:12.541966+0000","last_fullsized":"2023-11-04T01:39:12.541966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:08.663648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078635399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535876+0000","last_change":"2023-11-04T01:37:23.424528+0000","last_active":"2023-11-04T01:39:12.535876+0000","last_peered":"2023-11-04T01:39:12.535876+0000","last_clean":"2023-11-04T01:39:12.535876+0000","last_became_active":"2023-11-04T01:37:22.418225+0000","last_became_peered":"2023-11-04T01:37:22.418225+0000","last_unstale":"2023-11-04T01:39:12.535876+0000","last_undegraded":"2023-11-04T01:39:12.535876+0000","last_fullsized":"2023-11-04T01:39:12.535876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040266,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.550295+0000","last_change":"2023-11-04T01:39:13.546712+0000","last_active":"2023-11-04T01:39:13.550295+0000","last_peered":"2023-11-04T01:39:13.550295+0000","last_clean":"2023-11-04T01:39:13.550295+0000","last_became_active":"2023-11-04T01:39:13.546487+0000","last_became_peered":"2023-11-04T01:39:13.546487+0000","last_unstale":"2023-11-04T01:39:13.550295+0000","last_undegraded":"2023-11-04T01:39:13.550295+0000","last_fullsized":"2023-11-04T01:39:13.550295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:01:48.694656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.571654+0000","last_change":"2023-11-04T01:39:12.544249+0000","last_active":"2023-11-04T01:39:13.571654+0000","last_peered":"2023-11-04T01:39:13.571654+0000","last_clean":"2023-11-04T01:39:13.571654+0000","last_became_active":"2023-11-04T01:39:12.544000+0000","last_became_peered":"2023-11-04T01:39:12.544000+0000","last_unstale":"2023-11-04T01:39:13.571654+0000","last_undegraded":"2023-11-04T01:39:13.571654+0000","last_fullsized":"2023-11-04T01:39:13.571654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:48.777801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541466+0000","last_change":"2023-11-04T01:38:22.076676+0000","last_active":"2023-11-04T01:39:12.541466+0000","last_peered":"2023-11-04T01:39:12.541466+0000","last_clean":"2023-11-04T01:39:12.541466+0000","last_became_active":"2023-11-04T01:38:22.076358+0000","last_became_peered":"2023-11-04T01:38:22.076358+0000","last_unstale":"2023-11-04T01:39:12.541466+0000","last_undegraded":"2023-11-04T01:39:12.541466+0000","last_fullsized":"2023-11-04T01:39:12.541466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:54.096380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541319+0000","last_change":"2023-11-04T01:38:23.405733+0000","last_active":"2023-11-04T01:39:12.541319+0000","last_peered":"2023-11-04T01:39:12.541319+0000","last_clean":"2023-11-04T01:39:12.541319+0000","last_became_active":"2023-11-04T01:38:21.072619+0000","last_became_peered":"2023-11-04T01:38:21.072619+0000","last_unstale":"2023-11-04T01:39:12.541319+0000","last_undegraded":"2023-11-04T01:39:12.541319+0000","last_fullsized":"2023-11-04T01:39:12.541319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:43.756589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010857900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536437+0000","last_change":"2023-11-04T01:37:23.425485+0000","last_active":"2023-11-04T01:39:12.536437+0000","last_peered":"2023-11-04T01:39:12.536437+0000","last_clean":"2023-11-04T01:39:12.536437+0000","last_became_active":"2023-11-04T01:37:22.428403+0000","last_became_peered":"2023-11-04T01:37:22.428403+0000","last_unstale":"2023-11-04T01:39:12.536437+0000","last_undegraded":"2023-11-04T01:39:12.536437+0000","last_fullsized":"2023-11-04T01:39:12.536437+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:54.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010939420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572601+0000","last_change":"2023-11-04T01:39:13.568423+0000","last_active":"2023-11-04T01:39:13.572601+0000","last_peered":"2023-11-04T01:39:13.572601+0000","last_clean":"2023-11-04T01:39:13.572601+0000","last_became_active":"2023-11-04T01:39:13.568170+0000","last_became_peered":"2023-11-04T01:39:13.568170+0000","last_unstale":"2023-11-04T01:39:13.572601+0000","last_undegraded":"2023-11-04T01:39:13.572601+0000","last_fullsized":"2023-11-04T01:39:13.572601+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:55.606588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537437+0000","last_change":"2023-11-04T01:39:12.548731+0000","last_active":"2023-11-04T01:39:13.537437+0000","last_peered":"2023-11-04T01:39:13.537437+0000","last_clean":"2023-11-04T01:39:13.537437+0000","last_became_active":"2023-11-04T01:39:12.548486+0000","last_became_peered":"2023-11-04T01:39:12.548486+0000","last_unstale":"2023-11-04T01:39:13.537437+0000","last_undegraded":"2023-11-04T01:39:13.537437+0000","last_fullsized":"2023-11-04T01:39:13.537437+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:35.939365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533869+0000","last_change":"2023-11-04T01:38:22.069819+0000","last_active":"2023-11-04T01:39:12.533869+0000","last_peered":"2023-11-04T01:39:12.533869+0000","last_clean":"2023-11-04T01:39:12.533869+0000","last_became_active":"2023-11-04T01:38:22.068982+0000","last_became_peered":"2023-11-04T01:38:22.068982+0000","last_unstale":"2023-11-04T01:39:12.533869+0000","last_undegraded":"2023-11-04T01:39:12.533869+0000","last_fullsized":"2023-11-04T01:39:12.533869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:16.517766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536152+0000","last_change":"2023-11-04T01:38:23.334735+0000","last_active":"2023-11-04T01:39:12.536152+0000","last_peered":"2023-11-04T01:39:12.536152+0000","last_clean":"2023-11-04T01:39:12.536152+0000","last_became_active":"2023-11-04T01:38:21.067774+0000","last_became_peered":"2023-11-04T01:38:21.067774+0000","last_unstale":"2023-11-04T01:39:12.536152+0000","last_undegraded":"2023-11-04T01:39:12.536152+0000","last_fullsized":"2023-11-04T01:39:12.536152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:03.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050306999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541520+0000","last_change":"2023-11-04T01:37:23.576495+0000","last_active":"2023-11-04T01:39:12.541520+0000","last_peered":"2023-11-04T01:39:12.541520+0000","last_clean":"2023-11-04T01:39:12.541520+0000","last_became_active":"2023-11-04T01:37:22.422664+0000","last_became_peered":"2023-11-04T01:37:22.422664+0000","last_unstale":"2023-11-04T01:39:12.541520+0000","last_undegraded":"2023-11-04T01:39:12.541520+0000","last_fullsized":"2023-11-04T01:39:12.541520+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:24.942155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073041399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559295+0000","last_change":"2023-11-04T01:39:13.556858+0000","last_active":"2023-11-04T01:39:13.559295+0000","last_peered":"2023-11-04T01:39:13.559295+0000","last_clean":"2023-11-04T01:39:13.559295+0000","last_became_active":"2023-11-04T01:39:13.556002+0000","last_became_peered":"2023-11-04T01:39:13.556002+0000","last_unstale":"2023-11-04T01:39:13.559295+0000","last_undegraded":"2023-11-04T01:39:13.559295+0000","last_fullsized":"2023-11-04T01:39:13.559295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:12:40.019067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.542130+0000","last_change":"2023-11-04T01:39:12.540227+0000","last_active":"2023-11-04T01:39:13.542130+0000","last_peered":"2023-11-04T01:39:13.542130+0000","last_clean":"2023-11-04T01:39:13.542130+0000","last_became_active":"2023-11-04T01:39:12.539963+0000","last_became_peered":"2023-11-04T01:39:12.539963+0000","last_unstale":"2023-11-04T01:39:13.542130+0000","last_undegraded":"2023-11-04T01:39:13.542130+0000","last_fullsized":"2023-11-04T01:39:13.542130+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:08.906207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528019+0000","last_change":"2023-11-04T01:38:22.069762+0000","last_active":"2023-11-04T01:39:12.528019+0000","last_peered":"2023-11-04T01:39:12.528019+0000","last_clean":"2023-11-04T01:39:12.528019+0000","last_became_active":"2023-11-04T01:38:22.069461+0000","last_became_peered":"2023-11-04T01:38:22.069461+0000","last_unstale":"2023-11-04T01:39:12.528019+0000","last_undegraded":"2023-11-04T01:39:12.528019+0000","last_fullsized":"2023-11-04T01:39:12.528019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:03.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538642+0000","last_change":"2023-11-04T01:38:23.405132+0000","last_active":"2023-11-04T01:39:12.538642+0000","last_peered":"2023-11-04T01:39:12.538642+0000","last_clean":"2023-11-04T01:39:12.538642+0000","last_became_active":"2023-11-04T01:38:21.070339+0000","last_became_peered":"2023-11-04T01:38:21.070339+0000","last_unstale":"2023-11-04T01:39:12.538642+0000","last_undegraded":"2023-11-04T01:39:12.538642+0000","last_fullsized":"2023-11-04T01:39:12.538642+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000921534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536276+0000","last_change":"2023-11-04T01:37:23.424340+0000","last_active":"2023-11-04T01:39:12.536276+0000","last_peered":"2023-11-04T01:39:12.536276+0000","last_clean":"2023-11-04T01:39:12.536276+0000","last_became_active":"2023-11-04T01:37:22.423719+0000","last_became_peered":"2023-11-04T01:37:22.423719+0000","last_unstale":"2023-11-04T01:39:12.536276+0000","last_undegraded":"2023-11-04T01:39:12.536276+0000","last_fullsized":"2023-11-04T01:39:12.536276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035236499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.556321+0000","last_change":"2023-11-04T01:39:13.551999+0000","last_active":"2023-11-04T01:39:13.556321+0000","last_peered":"2023-11-04T01:39:13.556321+0000","last_clean":"2023-11-04T01:39:13.556321+0000","last_became_active":"2023-11-04T01:39:13.551706+0000","last_became_peered":"2023-11-04T01:39:13.551706+0000","last_unstale":"2023-11-04T01:39:13.556321+0000","last_undegraded":"2023-11-04T01:39:13.556321+0000","last_fullsized":"2023-11-04T01:39:13.556321+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:18:06.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570087+0000","last_change":"2023-11-04T01:39:12.541710+0000","last_active":"2023-11-04T01:39:13.570087+0000","last_peered":"2023-11-04T01:39:13.570087+0000","last_clean":"2023-11-04T01:39:13.570087+0000","last_became_active":"2023-11-04T01:39:12.541453+0000","last_became_peered":"2023-11-04T01:39:12.541453+0000","last_unstale":"2023-11-04T01:39:13.570087+0000","last_undegraded":"2023-11-04T01:39:13.570087+0000","last_fullsized":"2023-11-04T01:39:13.570087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:26.061422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538953+0000","last_change":"2023-11-04T01:38:22.069939+0000","last_active":"2023-11-04T01:39:12.538953+0000","last_peered":"2023-11-04T01:39:12.538953+0000","last_clean":"2023-11-04T01:39:12.538953+0000","last_became_active":"2023-11-04T01:38:22.069690+0000","last_became_peered":"2023-11-04T01:38:22.069690+0000","last_unstale":"2023-11-04T01:39:12.538953+0000","last_undegraded":"2023-11-04T01:39:12.538953+0000","last_fullsized":"2023-11-04T01:39:12.538953+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541817+0000","last_change":"2023-11-04T01:38:23.327651+0000","last_active":"2023-11-04T01:39:12.541817+0000","last_peered":"2023-11-04T01:39:12.541817+0000","last_clean":"2023-11-04T01:39:12.541817+0000","last_became_active":"2023-11-04T01:38:21.067028+0000","last_became_peered":"2023-11-04T01:38:21.067028+0000","last_unstale":"2023-11-04T01:39:12.541817+0000","last_undegraded":"2023-11-04T01:39:12.541817+0000","last_fullsized":"2023-11-04T01:39:12.541817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:13.072797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054701200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536300+0000","last_change":"2023-11-04T01:37:23.576202+0000","last_active":"2023-11-04T01:39:12.536300+0000","last_peered":"2023-11-04T01:39:12.536300+0000","last_clean":"2023-11-04T01:39:12.536300+0000","last_became_active":"2023-11-04T01:37:22.420048+0000","last_became_peered":"2023-11-04T01:37:22.420048+0000","last_unstale":"2023-11-04T01:39:12.536300+0000","last_undegraded":"2023-11-04T01:39:12.536300+0000","last_fullsized":"2023-11-04T01:39:12.536300+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:49.730143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072341899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.567434+0000","last_change":"2023-11-04T01:39:13.562423+0000","last_active":"2023-11-04T01:39:13.567434+0000","last_peered":"2023-11-04T01:39:13.567434+0000","last_clean":"2023-11-04T01:39:13.567434+0000","last_became_active":"2023-11-04T01:39:13.561444+0000","last_became_peered":"2023-11-04T01:39:13.561444+0000","last_unstale":"2023-11-04T01:39:13.567434+0000","last_undegraded":"2023-11-04T01:39:13.567434+0000","last_fullsized":"2023-11-04T01:39:13.567434+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:05.556714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566354+0000","last_change":"2023-11-04T01:39:12.547601+0000","last_active":"2023-11-04T01:39:13.566354+0000","last_peered":"2023-11-04T01:39:13.566354+0000","last_clean":"2023-11-04T01:39:13.566354+0000","last_became_active":"2023-11-04T01:39:12.547273+0000","last_became_peered":"2023-11-04T01:39:12.547273+0000","last_unstale":"2023-11-04T01:39:13.566354+0000","last_undegraded":"2023-11-04T01:39:13.566354+0000","last_fullsized":"2023-11-04T01:39:13.566354+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:35.544851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527555+0000","last_change":"2023-11-04T01:38:22.066355+0000","last_active":"2023-11-04T01:39:12.527555+0000","last_peered":"2023-11-04T01:39:12.527555+0000","last_clean":"2023-11-04T01:39:12.527555+0000","last_became_active":"2023-11-04T01:38:22.065849+0000","last_became_peered":"2023-11-04T01:38:22.065849+0000","last_unstale":"2023-11-04T01:39:12.527555+0000","last_undegraded":"2023-11-04T01:39:12.527555+0000","last_fullsized":"2023-11-04T01:39:12.527555+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536108+0000","last_change":"2023-11-04T01:38:23.358293+0000","last_active":"2023-11-04T01:39:12.536108+0000","last_peered":"2023-11-04T01:39:12.536108+0000","last_clean":"2023-11-04T01:39:12.536108+0000","last_became_active":"2023-11-04T01:38:21.070333+0000","last_became_peered":"2023-11-04T01:38:21.070333+0000","last_unstale":"2023-11-04T01:39:12.536108+0000","last_undegraded":"2023-11-04T01:39:12.536108+0000","last_fullsized":"2023-11-04T01:39:12.536108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:43.144500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059104700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.529033+0000","last_change":"2023-11-04T01:37:23.859806+0000","last_active":"2023-11-04T01:39:12.529033+0000","last_peered":"2023-11-04T01:39:12.529033+0000","last_clean":"2023-11-04T01:39:12.529033+0000","last_became_active":"2023-11-04T01:37:22.424643+0000","last_became_peered":"2023-11-04T01:37:22.424643+0000","last_unstale":"2023-11-04T01:39:12.529033+0000","last_undegraded":"2023-11-04T01:39:12.529033+0000","last_fullsized":"2023-11-04T01:39:12.529033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:23.210121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552928+0000","last_change":"2023-11-04T01:39:13.551387+0000","last_active":"2023-11-04T01:39:13.552928+0000","last_peered":"2023-11-04T01:39:13.552928+0000","last_clean":"2023-11-04T01:39:13.552928+0000","last_became_active":"2023-11-04T01:39:13.551139+0000","last_became_peered":"2023-11-04T01:39:13.551139+0000","last_unstale":"2023-11-04T01:39:13.552928+0000","last_undegraded":"2023-11-04T01:39:13.552928+0000","last_fullsized":"2023-11-04T01:39:13.552928+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:31:04.008314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.539146+0000","last_change":"2023-11-04T01:39:12.547411+0000","last_active":"2023-11-04T01:39:13.539146+0000","last_peered":"2023-11-04T01:39:13.539146+0000","last_clean":"2023-11-04T01:39:13.539146+0000","last_became_active":"2023-11-04T01:39:12.547144+0000","last_became_peered":"2023-11-04T01:39:12.547144+0000","last_unstale":"2023-11-04T01:39:13.539146+0000","last_undegraded":"2023-11-04T01:39:13.539146+0000","last_fullsized":"2023-11-04T01:39:13.539146+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:37.731260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534650+0000","last_change":"2023-11-04T01:38:22.074795+0000","last_active":"2023-11-04T01:39:12.534650+0000","last_peered":"2023-11-04T01:39:12.534650+0000","last_clean":"2023-11-04T01:39:12.534650+0000","last_became_active":"2023-11-04T01:38:22.074381+0000","last_became_peered":"2023-11-04T01:38:22.074381+0000","last_unstale":"2023-11-04T01:39:12.534650+0000","last_undegraded":"2023-11-04T01:39:12.534650+0000","last_fullsized":"2023-11-04T01:39:12.534650+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:56:25.208149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528961+0000","last_change":"2023-11-04T01:38:23.061673+0000","last_active":"2023-11-04T01:39:12.528961+0000","last_peered":"2023-11-04T01:39:12.528961+0000","last_clean":"2023-11-04T01:39:12.528961+0000","last_became_active":"2023-11-04T01:38:21.062435+0000","last_became_peered":"2023-11-04T01:38:21.062435+0000","last_unstale":"2023-11-04T01:39:12.528961+0000","last_undegraded":"2023-11-04T01:39:12.528961+0000","last_fullsized":"2023-11-04T01:39:12.528961+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:52.059754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048859499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527810+0000","last_change":"2023-11-04T01:37:23.860175+0000","last_active":"2023-11-04T01:39:12.527810+0000","last_peered":"2023-11-04T01:39:12.527810+0000","last_clean":"2023-11-04T01:39:12.527810+0000","last_became_active":"2023-11-04T01:37:22.427279+0000","last_became_peered":"2023-11-04T01:37:22.427279+0000","last_unstale":"2023-11-04T01:39:12.527810+0000","last_undegraded":"2023-11-04T01:39:12.527810+0000","last_fullsized":"2023-11-04T01:39:12.527810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674068,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552021+0000","last_change":"2023-11-04T01:39:13.549813+0000","last_active":"2023-11-04T01:39:13.552021+0000","last_peered":"2023-11-04T01:39:13.552021+0000","last_clean":"2023-11-04T01:39:13.552021+0000","last_became_active":"2023-11-04T01:39:13.549530+0000","last_became_peered":"2023-11-04T01:39:13.549530+0000","last_unstale":"2023-11-04T01:39:13.552021+0000","last_undegraded":"2023-11-04T01:39:13.552021+0000","last_fullsized":"2023-11-04T01:39:13.552021+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572994+0000","last_change":"2023-11-04T01:39:12.546634+0000","last_active":"2023-11-04T01:39:13.572994+0000","last_peered":"2023-11-04T01:39:13.572994+0000","last_clean":"2023-11-04T01:39:13.572994+0000","last_became_active":"2023-11-04T01:39:12.545747+0000","last_became_peered":"2023-11-04T01:39:12.545747+0000","last_unstale":"2023-11-04T01:39:13.572994+0000","last_undegraded":"2023-11-04T01:39:13.572994+0000","last_fullsized":"2023-11-04T01:39:13.572994+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:40.211611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535971+0000","last_change":"2023-11-04T01:38:22.075108+0000","last_active":"2023-11-04T01:39:12.535971+0000","last_peered":"2023-11-04T01:39:12.535971+0000","last_clean":"2023-11-04T01:39:12.535971+0000","last_became_active":"2023-11-04T01:38:22.074780+0000","last_became_peered":"2023-11-04T01:38:22.074780+0000","last_unstale":"2023-11-04T01:39:12.535971+0000","last_undegraded":"2023-11-04T01:39:12.535971+0000","last_fullsized":"2023-11-04T01:39:12.535971+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:13.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536296+0000","last_change":"2023-11-04T01:38:23.334648+0000","last_active":"2023-11-04T01:39:12.536296+0000","last_peered":"2023-11-04T01:39:12.536296+0000","last_clean":"2023-11-04T01:39:12.536296+0000","last_became_active":"2023-11-04T01:38:21.066335+0000","last_became_peered":"2023-11-04T01:38:21.066335+0000","last_unstale":"2023-11-04T01:39:12.536296+0000","last_undegraded":"2023-11-04T01:39:12.536296+0000","last_fullsized":"2023-11-04T01:39:12.536296+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:43.106209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047853300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533578+0000","last_change":"2023-11-04T01:37:23.611281+0000","last_active":"2023-11-04T01:39:12.533578+0000","last_peered":"2023-11-04T01:39:12.533578+0000","last_clean":"2023-11-04T01:39:12.533578+0000","last_became_active":"2023-11-04T01:37:22.417991+0000","last_became_peered":"2023-11-04T01:37:22.417991+0000","last_unstale":"2023-11-04T01:39:12.533578+0000","last_undegraded":"2023-11-04T01:39:12.533578+0000","last_fullsized":"2023-11-04T01:39:12.533578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:31.472388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.563055+0000","last_change":"2023-11-04T01:39:13.560997+0000","last_active":"2023-11-04T01:39:13.563055+0000","last_peered":"2023-11-04T01:39:13.563055+0000","last_clean":"2023-11-04T01:39:13.563055+0000","last_became_active":"2023-11-04T01:39:13.560719+0000","last_became_peered":"2023-11-04T01:39:13.560719+0000","last_unstale":"2023-11-04T01:39:13.563055+0000","last_undegraded":"2023-11-04T01:39:13.563055+0000","last_fullsized":"2023-11-04T01:39:13.563055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:08.188723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.546926+0000","last_change":"2023-11-04T01:39:12.544321+0000","last_active":"2023-11-04T01:39:13.546926+0000","last_peered":"2023-11-04T01:39:13.546926+0000","last_clean":"2023-11-04T01:39:13.546926+0000","last_became_active":"2023-11-04T01:39:12.544041+0000","last_became_peered":"2023-11-04T01:39:12.544041+0000","last_unstale":"2023-11-04T01:39:13.546926+0000","last_undegraded":"2023-11-04T01:39:13.546926+0000","last_fullsized":"2023-11-04T01:39:13.546926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:05.597224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541607+0000","last_change":"2023-11-04T01:38:22.072789+0000","last_active":"2023-11-04T01:39:12.541607+0000","last_peered":"2023-11-04T01:39:12.541607+0000","last_clean":"2023-11-04T01:39:12.541607+0000","last_became_active":"2023-11-04T01:38:22.072509+0000","last_became_peered":"2023-11-04T01:38:22.072509+0000","last_unstale":"2023-11-04T01:39:12.541607+0000","last_undegraded":"2023-11-04T01:39:12.541607+0000","last_fullsized":"2023-11-04T01:39:12.541607+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534379+0000","last_change":"2023-11-04T01:38:23.061961+0000","last_active":"2023-11-04T01:39:12.534379+0000","last_peered":"2023-11-04T01:39:12.534379+0000","last_clean":"2023-11-04T01:39:12.534379+0000","last_became_active":"2023-11-04T01:38:21.063415+0000","last_became_peered":"2023-11-04T01:38:21.063415+0000","last_unstale":"2023-11-04T01:39:12.534379+0000","last_undegraded":"2023-11-04T01:39:12.534379+0000","last_fullsized":"2023-11-04T01:39:12.534379+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.820188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000396594,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538139+0000","last_change":"2023-11-04T01:37:23.426538+0000","last_active":"2023-11-04T01:39:12.538139+0000","last_peered":"2023-11-04T01:39:12.538139+0000","last_clean":"2023-11-04T01:39:12.538139+0000","last_became_active":"2023-11-04T01:37:22.421087+0000","last_became_peered":"2023-11-04T01:37:22.421087+0000","last_unstale":"2023-11-04T01:39:12.538139+0000","last_undegraded":"2023-11-04T01:39:12.538139+0000","last_fullsized":"2023-11-04T01:39:12.538139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:09.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038761500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.552855+0000","last_change":"2023-11-04T01:39:13.551191+0000","last_active":"2023-11-04T01:39:13.552855+0000","last_peered":"2023-11-04T01:39:13.552855+0000","last_clean":"2023-11-04T01:39:13.552855+0000","last_became_active":"2023-11-04T01:39:13.550922+0000","last_became_peered":"2023-11-04T01:39:13.550922+0000","last_unstale":"2023-11-04T01:39:13.552855+0000","last_undegraded":"2023-11-04T01:39:13.552855+0000","last_fullsized":"2023-11-04T01:39:13.552855+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:12:26.614533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.538881+0000","last_change":"2023-11-04T01:39:12.541709+0000","last_active":"2023-11-04T01:39:13.538881+0000","last_peered":"2023-11-04T01:39:13.538881+0000","last_clean":"2023-11-04T01:39:13.538881+0000","last_became_active":"2023-11-04T01:39:12.541394+0000","last_became_peered":"2023-11-04T01:39:12.541394+0000","last_unstale":"2023-11-04T01:39:13.538881+0000","last_undegraded":"2023-11-04T01:39:13.538881+0000","last_fullsized":"2023-11-04T01:39:13.538881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:48.777801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534178+0000","last_change":"2023-11-04T01:38:22.068816+0000","last_active":"2023-11-04T01:39:12.534178+0000","last_peered":"2023-11-04T01:39:12.534178+0000","last_clean":"2023-11-04T01:39:12.534178+0000","last_became_active":"2023-11-04T01:38:22.068537+0000","last_became_peered":"2023-11-04T01:38:22.068537+0000","last_unstale":"2023-11-04T01:39:12.534178+0000","last_undegraded":"2023-11-04T01:39:12.534178+0000","last_fullsized":"2023-11-04T01:39:12.534178+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:44.761453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541332+0000","last_change":"2023-11-04T01:38:23.405504+0000","last_active":"2023-11-04T01:39:12.541332+0000","last_peered":"2023-11-04T01:39:12.541332+0000","last_clean":"2023-11-04T01:39:12.541332+0000","last_became_active":"2023-11-04T01:38:21.073116+0000","last_became_peered":"2023-11-04T01:38:21.073116+0000","last_unstale":"2023-11-04T01:39:12.541332+0000","last_undegraded":"2023-11-04T01:39:12.541332+0000","last_fullsized":"2023-11-04T01:39:12.541332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:14.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098846799999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.542008+0000","last_change":"2023-11-04T01:37:23.545560+0000","last_active":"2023-11-04T01:39:12.542008+0000","last_peered":"2023-11-04T01:39:12.542008+0000","last_clean":"2023-11-04T01:39:12.542008+0000","last_became_active":"2023-11-04T01:37:22.426639+0000","last_became_peered":"2023-11-04T01:37:22.426639+0000","last_unstale":"2023-11-04T01:39:12.542008+0000","last_undegraded":"2023-11-04T01:39:12.542008+0000","last_fullsized":"2023-11-04T01:39:12.542008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:36.995441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067188899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.548101+0000","last_change":"2023-11-04T01:39:13.544409+0000","last_active":"2023-11-04T01:39:13.548101+0000","last_peered":"2023-11-04T01:39:13.548101+0000","last_clean":"2023-11-04T01:39:13.548101+0000","last_became_active":"2023-11-04T01:39:13.544147+0000","last_became_peered":"2023-11-04T01:39:13.544147+0000","last_unstale":"2023-11-04T01:39:13.548101+0000","last_undegraded":"2023-11-04T01:39:13.548101+0000","last_fullsized":"2023-11-04T01:39:13.548101+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:56.559131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537567+0000","last_change":"2023-11-04T01:39:12.548070+0000","last_active":"2023-11-04T01:39:13.537567+0000","last_peered":"2023-11-04T01:39:13.537567+0000","last_clean":"2023-11-04T01:39:13.537567+0000","last_became_active":"2023-11-04T01:39:12.546710+0000","last_became_peered":"2023-11-04T01:39:12.546710+0000","last_unstale":"2023-11-04T01:39:13.537567+0000","last_undegraded":"2023-11-04T01:39:13.537567+0000","last_fullsized":"2023-11-04T01:39:13.537567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:34.805882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.537966+0000","last_change":"2023-11-04T01:38:22.069605+0000","last_active":"2023-11-04T01:39:12.537966+0000","last_peered":"2023-11-04T01:39:12.537966+0000","last_clean":"2023-11-04T01:39:12.537966+0000","last_became_active":"2023-11-04T01:38:22.069171+0000","last_became_peered":"2023-11-04T01:38:22.069171+0000","last_unstale":"2023-11-04T01:39:12.537966+0000","last_undegraded":"2023-11-04T01:39:12.537966+0000","last_fullsized":"2023-11-04T01:39:12.537966+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:07.216732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528227+0000","last_change":"2023-11-04T01:38:23.063133+0000","last_active":"2023-11-04T01:39:12.528227+0000","last_peered":"2023-11-04T01:39:12.528227+0000","last_clean":"2023-11-04T01:39:12.528227+0000","last_became_active":"2023-11-04T01:38:21.070011+0000","last_became_peered":"2023-11-04T01:38:21.070011+0000","last_unstale":"2023-11-04T01:39:12.528227+0000","last_undegraded":"2023-11-04T01:39:12.528227+0000","last_fullsized":"2023-11-04T01:39:12.528227+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:57:08.992301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.540837+0000","last_change":"2023-11-04T01:37:23.426755+0000","last_active":"2023-11-04T01:39:12.540837+0000","last_peered":"2023-11-04T01:39:12.540837+0000","last_clean":"2023-11-04T01:39:12.540837+0000","last_became_active":"2023-11-04T01:37:22.421708+0000","last_became_peered":"2023-11-04T01:37:22.421708+0000","last_unstale":"2023-11-04T01:39:12.540837+0000","last_undegraded":"2023-11-04T01:39:12.540837+0000","last_fullsized":"2023-11-04T01:39:12.540837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561094+0000","last_change":"2023-11-04T01:39:13.558262+0000","last_active":"2023-11-04T01:39:13.561094+0000","last_peered":"2023-11-04T01:39:13.561094+0000","last_clean":"2023-11-04T01:39:13.561094+0000","last_became_active":"2023-11-04T01:39:13.557958+0000","last_became_peered":"2023-11-04T01:39:13.557958+0000","last_unstale":"2023-11-04T01:39:13.561094+0000","last_undegraded":"2023-11-04T01:39:13.561094+0000","last_fullsized":"2023-11-04T01:39:13.561094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:20.559682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.544094+0000","last_change":"2023-11-04T01:39:12.546217+0000","last_active":"2023-11-04T01:39:13.544094+0000","last_peered":"2023-11-04T01:39:13.544094+0000","last_clean":"2023-11-04T01:39:13.544094+0000","last_became_active":"2023-11-04T01:39:12.545554+0000","last_became_peered":"2023-11-04T01:39:12.545554+0000","last_unstale":"2023-11-04T01:39:13.544094+0000","last_undegraded":"2023-11-04T01:39:13.544094+0000","last_fullsized":"2023-11-04T01:39:13.544094+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:39.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536545+0000","last_change":"2023-11-04T01:38:22.077275+0000","last_active":"2023-11-04T01:39:12.536545+0000","last_peered":"2023-11-04T01:39:12.536545+0000","last_clean":"2023-11-04T01:39:12.536545+0000","last_became_active":"2023-11-04T01:38:22.076997+0000","last_became_peered":"2023-11-04T01:38:22.076997+0000","last_unstale":"2023-11-04T01:39:12.536545+0000","last_undegraded":"2023-11-04T01:39:12.536545+0000","last_fullsized":"2023-11-04T01:39:12.536545+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:14.205713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528672+0000","last_change":"2023-11-04T01:38:23.062882+0000","last_active":"2023-11-04T01:39:12.528672+0000","last_peered":"2023-11-04T01:39:12.528672+0000","last_clean":"2023-11-04T01:39:12.528672+0000","last_became_active":"2023-11-04T01:38:21.069964+0000","last_became_peered":"2023-11-04T01:38:21.069964+0000","last_unstale":"2023-11-04T01:39:12.528672+0000","last_undegraded":"2023-11-04T01:39:12.528672+0000","last_fullsized":"2023-11-04T01:39:12.528672+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:16.633121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083743200000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534451+0000","last_change":"2023-11-04T01:37:23.611466+0000","last_active":"2023-11-04T01:39:12.534451+0000","last_peered":"2023-11-04T01:39:12.534451+0000","last_clean":"2023-11-04T01:39:12.534451+0000","last_became_active":"2023-11-04T01:37:22.425248+0000","last_became_peered":"2023-11-04T01:37:22.425248+0000","last_unstale":"2023-11-04T01:39:12.534451+0000","last_undegraded":"2023-11-04T01:39:12.534451+0000","last_fullsized":"2023-11-04T01:39:12.534451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:51.000059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048918799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565851+0000","last_change":"2023-11-04T01:39:13.557844+0000","last_active":"2023-11-04T01:39:13.565851+0000","last_peered":"2023-11-04T01:39:13.565851+0000","last_clean":"2023-11-04T01:39:13.565851+0000","last_became_active":"2023-11-04T01:39:13.550121+0000","last_became_peered":"2023-11-04T01:39:13.550121+0000","last_unstale":"2023-11-04T01:39:13.565851+0000","last_undegraded":"2023-11-04T01:39:13.565851+0000","last_fullsized":"2023-11-04T01:39:13.565851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.693587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551351+0000","last_change":"2023-11-04T01:39:12.544001+0000","last_active":"2023-11-04T01:39:13.551351+0000","last_peered":"2023-11-04T01:39:13.551351+0000","last_clean":"2023-11-04T01:39:13.551351+0000","last_became_active":"2023-11-04T01:39:12.543169+0000","last_became_peered":"2023-11-04T01:39:12.543169+0000","last_unstale":"2023-11-04T01:39:13.551351+0000","last_undegraded":"2023-11-04T01:39:13.551351+0000","last_fullsized":"2023-11-04T01:39:13.551351+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:58:05.597224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533263+0000","last_change":"2023-11-04T01:38:22.062314+0000","last_active":"2023-11-04T01:39:12.533263+0000","last_peered":"2023-11-04T01:39:12.533263+0000","last_clean":"2023-11-04T01:39:12.533263+0000","last_became_active":"2023-11-04T01:38:22.062007+0000","last_became_peered":"2023-11-04T01:38:22.062007+0000","last_unstale":"2023-11-04T01:39:12.533263+0000","last_undegraded":"2023-11-04T01:39:12.533263+0000","last_fullsized":"2023-11-04T01:39:12.533263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:09.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533428+0000","last_change":"2023-11-04T01:38:23.060981+0000","last_active":"2023-11-04T01:39:12.533428+0000","last_peered":"2023-11-04T01:39:12.533428+0000","last_clean":"2023-11-04T01:39:12.533428+0000","last_became_active":"2023-11-04T01:38:21.065930+0000","last_became_peered":"2023-11-04T01:38:21.065930+0000","last_unstale":"2023-11-04T01:39:12.533428+0000","last_undegraded":"2023-11-04T01:39:12.533428+0000","last_fullsized":"2023-11-04T01:39:12.533428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:17.505501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535442+0000","last_change":"2023-11-04T01:37:23.424684+0000","last_active":"2023-11-04T01:39:12.535442+0000","last_peered":"2023-11-04T01:39:12.535442+0000","last_clean":"2023-11-04T01:39:12.535442+0000","last_became_active":"2023-11-04T01:37:22.419235+0000","last_became_peered":"2023-11-04T01:37:22.419235+0000","last_unstale":"2023-11-04T01:39:12.535442+0000","last_undegraded":"2023-11-04T01:39:12.535442+0000","last_fullsized":"2023-11-04T01:39:12.535442+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049580000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560374+0000","last_change":"2023-11-04T01:39:13.558412+0000","last_active":"2023-11-04T01:39:13.560374+0000","last_peered":"2023-11-04T01:39:13.560374+0000","last_clean":"2023-11-04T01:39:13.560374+0000","last_became_active":"2023-11-04T01:39:13.558105+0000","last_became_peered":"2023-11-04T01:39:13.558105+0000","last_unstale":"2023-11-04T01:39:13.560374+0000","last_undegraded":"2023-11-04T01:39:13.560374+0000","last_fullsized":"2023-11-04T01:39:13.560374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:12.964286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.572713+0000","last_change":"2023-11-04T01:39:12.547794+0000","last_active":"2023-11-04T01:39:13.572713+0000","last_peered":"2023-11-04T01:39:13.572713+0000","last_clean":"2023-11-04T01:39:13.572713+0000","last_became_active":"2023-11-04T01:39:12.547515+0000","last_became_peered":"2023-11-04T01:39:12.547515+0000","last_unstale":"2023-11-04T01:39:13.572713+0000","last_undegraded":"2023-11-04T01:39:13.572713+0000","last_fullsized":"2023-11-04T01:39:13.572713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.222453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534771+0000","last_change":"2023-11-04T01:38:22.075621+0000","last_active":"2023-11-04T01:39:12.534771+0000","last_peered":"2023-11-04T01:39:12.534771+0000","last_clean":"2023-11-04T01:39:12.534771+0000","last_became_active":"2023-11-04T01:38:22.075337+0000","last_became_peered":"2023-11-04T01:38:22.075337+0000","last_unstale":"2023-11-04T01:39:12.534771+0000","last_undegraded":"2023-11-04T01:39:12.534771+0000","last_fullsized":"2023-11-04T01:39:12.534771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:00.382893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533273+0000","last_change":"2023-11-04T01:38:23.061099+0000","last_active":"2023-11-04T01:39:12.533273+0000","last_peered":"2023-11-04T01:39:12.533273+0000","last_clean":"2023-11-04T01:39:12.533273+0000","last_became_active":"2023-11-04T01:38:21.063958+0000","last_became_peered":"2023-11-04T01:38:21.063958+0000","last_unstale":"2023-11-04T01:39:12.533273+0000","last_undegraded":"2023-11-04T01:39:12.533273+0000","last_fullsized":"2023-11-04T01:39:12.533273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:13.105036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541135+0000","last_change":"2023-11-04T01:37:23.545090+0000","last_active":"2023-11-04T01:39:12.541135+0000","last_peered":"2023-11-04T01:39:12.541135+0000","last_clean":"2023-11-04T01:39:12.541135+0000","last_became_active":"2023-11-04T01:37:22.427413+0000","last_became_peered":"2023-11-04T01:37:22.427413+0000","last_unstale":"2023-11-04T01:39:12.541135+0000","last_undegraded":"2023-11-04T01:39:12.541135+0000","last_fullsized":"2023-11-04T01:39:12.541135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:28.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062486599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568184+0000","last_change":"2023-11-04T01:39:13.563482+0000","last_active":"2023-11-04T01:39:13.568184+0000","last_peered":"2023-11-04T01:39:13.568184+0000","last_clean":"2023-11-04T01:39:13.568184+0000","last_became_active":"2023-11-04T01:39:13.563124+0000","last_became_peered":"2023-11-04T01:39:13.563124+0000","last_unstale":"2023-11-04T01:39:13.568184+0000","last_undegraded":"2023-11-04T01:39:13.568184+0000","last_fullsized":"2023-11-04T01:39:13.568184+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551957+0000","last_change":"2023-11-04T01:39:12.550269+0000","last_active":"2023-11-04T01:39:13.551957+0000","last_peered":"2023-11-04T01:39:13.551957+0000","last_clean":"2023-11-04T01:39:13.551957+0000","last_became_active":"2023-11-04T01:39:12.550012+0000","last_became_peered":"2023-11-04T01:39:12.550012+0000","last_unstale":"2023-11-04T01:39:13.551957+0000","last_undegraded":"2023-11-04T01:39:13.551957+0000","last_fullsized":"2023-11-04T01:39:13.551957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:55.552387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541024+0000","last_change":"2023-11-04T01:38:22.070752+0000","last_active":"2023-11-04T01:39:12.541024+0000","last_peered":"2023-11-04T01:39:12.541024+0000","last_clean":"2023-11-04T01:39:12.541024+0000","last_became_active":"2023-11-04T01:38:22.070461+0000","last_became_peered":"2023-11-04T01:38:22.070461+0000","last_unstale":"2023-11-04T01:39:12.541024+0000","last_undegraded":"2023-11-04T01:39:12.541024+0000","last_fullsized":"2023-11-04T01:39:12.541024+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:27.426475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536105+0000","last_change":"2023-11-04T01:38:23.358397+0000","last_active":"2023-11-04T01:39:12.536105+0000","last_peered":"2023-11-04T01:39:12.536105+0000","last_clean":"2023-11-04T01:39:12.536105+0000","last_became_active":"2023-11-04T01:38:21.066012+0000","last_became_peered":"2023-11-04T01:38:21.066012+0000","last_unstale":"2023-11-04T01:39:12.536105+0000","last_undegraded":"2023-11-04T01:39:12.536105+0000","last_fullsized":"2023-11-04T01:39:12.536105+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.942370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051071600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527844+0000","last_change":"2023-11-04T01:37:23.860095+0000","last_active":"2023-11-04T01:39:12.527844+0000","last_peered":"2023-11-04T01:39:12.527844+0000","last_clean":"2023-11-04T01:39:12.527844+0000","last_became_active":"2023-11-04T01:37:22.423645+0000","last_became_peered":"2023-11-04T01:37:22.423645+0000","last_unstale":"2023-11-04T01:39:12.527844+0000","last_undegraded":"2023-11-04T01:39:12.527844+0000","last_fullsized":"2023-11-04T01:39:12.527844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:02.067316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059944299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547555+0000","last_change":"2023-11-04T01:39:13.543727+0000","last_active":"2023-11-04T01:39:13.547555+0000","last_peered":"2023-11-04T01:39:13.547555+0000","last_clean":"2023-11-04T01:39:13.547555+0000","last_became_active":"2023-11-04T01:39:13.543434+0000","last_became_peered":"2023-11-04T01:39:13.543434+0000","last_unstale":"2023-11-04T01:39:13.547555+0000","last_undegraded":"2023-11-04T01:39:13.547555+0000","last_fullsized":"2023-11-04T01:39:13.547555+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:27:21.466089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.538665+0000","last_change":"2023-11-04T01:39:12.546972+0000","last_active":"2023-11-04T01:39:13.538665+0000","last_peered":"2023-11-04T01:39:13.538665+0000","last_clean":"2023-11-04T01:39:13.538665+0000","last_became_active":"2023-11-04T01:39:12.546680+0000","last_became_peered":"2023-11-04T01:39:12.546680+0000","last_unstale":"2023-11-04T01:39:13.538665+0000","last_undegraded":"2023-11-04T01:39:13.538665+0000","last_fullsized":"2023-11-04T01:39:13.538665+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:55.183528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534902+0000","last_change":"2023-11-04T01:38:22.067648+0000","last_active":"2023-11-04T01:39:12.534902+0000","last_peered":"2023-11-04T01:39:12.534902+0000","last_clean":"2023-11-04T01:39:12.534902+0000","last_became_active":"2023-11-04T01:38:22.067338+0000","last_became_peered":"2023-11-04T01:38:22.067338+0000","last_unstale":"2023-11-04T01:39:12.534902+0000","last_undegraded":"2023-11-04T01:39:12.534902+0000","last_fullsized":"2023-11-04T01:39:12.534902+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:04.184731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527454+0000","last_change":"2023-11-04T01:38:23.061682+0000","last_active":"2023-11-04T01:39:12.527454+0000","last_peered":"2023-11-04T01:39:12.527454+0000","last_clean":"2023-11-04T01:39:12.527454+0000","last_became_active":"2023-11-04T01:38:21.067953+0000","last_became_peered":"2023-11-04T01:38:21.067953+0000","last_unstale":"2023-11-04T01:39:12.527454+0000","last_undegraded":"2023-11-04T01:39:12.527454+0000","last_fullsized":"2023-11-04T01:39:12.527454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:06.211868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042784099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535856+0000","last_change":"2023-11-04T01:37:23.576159+0000","last_active":"2023-11-04T01:39:12.535856+0000","last_peered":"2023-11-04T01:39:12.535856+0000","last_clean":"2023-11-04T01:39:12.535856+0000","last_became_active":"2023-11-04T01:37:22.425088+0000","last_became_peered":"2023-11-04T01:37:22.425088+0000","last_unstale":"2023-11-04T01:39:12.535856+0000","last_undegraded":"2023-11-04T01:39:12.535856+0000","last_fullsized":"2023-11-04T01:39:12.535856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:35.236400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000732268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561114+0000","last_change":"2023-11-04T01:39:13.559320+0000","last_active":"2023-11-04T01:39:13.561114+0000","last_peered":"2023-11-04T01:39:13.561114+0000","last_clean":"2023-11-04T01:39:13.561114+0000","last_became_active":"2023-11-04T01:39:13.558404+0000","last_became_peered":"2023-11-04T01:39:13.558404+0000","last_unstale":"2023-11-04T01:39:13.561114+0000","last_undegraded":"2023-11-04T01:39:13.561114+0000","last_fullsized":"2023-11-04T01:39:13.561114+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.642467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.574184+0000","last_change":"2023-11-04T01:39:12.547120+0000","last_active":"2023-11-04T01:39:13.574184+0000","last_peered":"2023-11-04T01:39:13.574184+0000","last_clean":"2023-11-04T01:39:13.574184+0000","last_became_active":"2023-11-04T01:39:12.546849+0000","last_became_peered":"2023-11-04T01:39:12.546849+0000","last_unstale":"2023-11-04T01:39:13.574184+0000","last_undegraded":"2023-11-04T01:39:13.574184+0000","last_fullsized":"2023-11-04T01:39:13.574184+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:18.335624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.540703+0000","last_change":"2023-11-04T01:38:22.069448+0000","last_active":"2023-11-04T01:39:12.540703+0000","last_peered":"2023-11-04T01:39:12.540703+0000","last_clean":"2023-11-04T01:39:12.540703+0000","last_became_active":"2023-11-04T01:38:22.069195+0000","last_became_peered":"2023-11-04T01:38:22.069195+0000","last_unstale":"2023-11-04T01:39:12.540703+0000","last_undegraded":"2023-11-04T01:39:12.540703+0000","last_fullsized":"2023-11-04T01:39:12.540703+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:21.047863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536165+0000","last_change":"2023-11-04T01:38:23.358753+0000","last_active":"2023-11-04T01:39:12.536165+0000","last_peered":"2023-11-04T01:39:12.536165+0000","last_clean":"2023-11-04T01:39:12.536165+0000","last_became_active":"2023-11-04T01:38:21.070981+0000","last_became_peered":"2023-11-04T01:38:21.070981+0000","last_unstale":"2023-11-04T01:39:12.536165+0000","last_undegraded":"2023-11-04T01:39:12.536165+0000","last_fullsized":"2023-11-04T01:39:12.536165+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:55.408316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043018,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538715+0000","last_change":"2023-11-04T01:37:23.576482+0000","last_active":"2023-11-04T01:39:12.538715+0000","last_peered":"2023-11-04T01:39:12.538715+0000","last_clean":"2023-11-04T01:39:12.538715+0000","last_became_active":"2023-11-04T01:37:22.421347+0000","last_became_peered":"2023-11-04T01:37:22.421347+0000","last_unstale":"2023-11-04T01:39:12.538715+0000","last_undegraded":"2023-11-04T01:39:12.538715+0000","last_fullsized":"2023-11-04T01:39:12.538715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:02.927196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081265299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565811+0000","last_change":"2023-11-04T01:39:13.561388+0000","last_active":"2023-11-04T01:39:13.565811+0000","last_peered":"2023-11-04T01:39:13.565811+0000","last_clean":"2023-11-04T01:39:13.565811+0000","last_became_active":"2023-11-04T01:39:13.561115+0000","last_became_peered":"2023-11-04T01:39:13.561115+0000","last_unstale":"2023-11-04T01:39:13.565811+0000","last_undegraded":"2023-11-04T01:39:13.565811+0000","last_fullsized":"2023-11-04T01:39:13.565811+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:35.371118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565497+0000","last_change":"2023-11-04T01:39:12.544991+0000","last_active":"2023-11-04T01:39:13.565497+0000","last_peered":"2023-11-04T01:39:13.565497+0000","last_clean":"2023-11-04T01:39:13.565497+0000","last_became_active":"2023-11-04T01:39:12.544699+0000","last_became_peered":"2023-11-04T01:39:12.544699+0000","last_unstale":"2023-11-04T01:39:13.565497+0000","last_undegraded":"2023-11-04T01:39:13.565497+0000","last_fullsized":"2023-11-04T01:39:13.565497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:09.467797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534245+0000","last_change":"2023-11-04T01:38:22.070238+0000","last_active":"2023-11-04T01:39:12.534245+0000","last_peered":"2023-11-04T01:39:12.534245+0000","last_clean":"2023-11-04T01:39:12.534245+0000","last_became_active":"2023-11-04T01:38:22.069898+0000","last_became_peered":"2023-11-04T01:38:22.069898+0000","last_unstale":"2023-11-04T01:39:12.534245+0000","last_undegraded":"2023-11-04T01:39:12.534245+0000","last_fullsized":"2023-11-04T01:39:12.534245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:57.057392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536421+0000","last_change":"2023-11-04T01:38:23.358872+0000","last_active":"2023-11-04T01:39:12.536421+0000","last_peered":"2023-11-04T01:39:12.536421+0000","last_clean":"2023-11-04T01:39:12.536421+0000","last_became_active":"2023-11-04T01:38:21.069193+0000","last_became_peered":"2023-11-04T01:38:21.069193+0000","last_unstale":"2023-11-04T01:39:12.536421+0000","last_undegraded":"2023-11-04T01:39:12.536421+0000","last_fullsized":"2023-11-04T01:39:12.536421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:57.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055334700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536776+0000","last_change":"2023-11-04T01:37:23.576819+0000","last_active":"2023-11-04T01:39:12.536776+0000","last_peered":"2023-11-04T01:39:12.536776+0000","last_clean":"2023-11-04T01:39:12.536776+0000","last_became_active":"2023-11-04T01:37:22.428270+0000","last_became_peered":"2023-11-04T01:37:22.428270+0000","last_unstale":"2023-11-04T01:39:12.536776+0000","last_undegraded":"2023-11-04T01:39:12.536776+0000","last_fullsized":"2023-11-04T01:39:12.536776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000832933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.561259+0000","last_change":"2023-11-04T01:39:13.559430+0000","last_active":"2023-11-04T01:39:13.561259+0000","last_peered":"2023-11-04T01:39:13.561259+0000","last_clean":"2023-11-04T01:39:13.561259+0000","last_became_active":"2023-11-04T01:39:13.558818+0000","last_became_peered":"2023-11-04T01:39:13.558818+0000","last_unstale":"2023-11-04T01:39:13.561259+0000","last_undegraded":"2023-11-04T01:39:13.561259+0000","last_fullsized":"2023-11-04T01:39:13.561259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:18:06.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.537704+0000","last_change":"2023-11-04T01:39:12.546141+0000","last_active":"2023-11-04T01:39:13.537704+0000","last_peered":"2023-11-04T01:39:13.537704+0000","last_clean":"2023-11-04T01:39:13.537704+0000","last_became_active":"2023-11-04T01:39:12.545864+0000","last_became_peered":"2023-11-04T01:39:12.545864+0000","last_unstale":"2023-11-04T01:39:13.537704+0000","last_undegraded":"2023-11-04T01:39:13.537704+0000","last_fullsized":"2023-11-04T01:39:13.537704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:34:05.339636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534035+0000","last_change":"2023-11-04T01:38:22.064805+0000","last_active":"2023-11-04T01:39:12.534035+0000","last_peered":"2023-11-04T01:39:12.534035+0000","last_clean":"2023-11-04T01:39:12.534035+0000","last_became_active":"2023-11-04T01:38:22.064524+0000","last_became_peered":"2023-11-04T01:38:22.064524+0000","last_unstale":"2023-11-04T01:39:12.534035+0000","last_undegraded":"2023-11-04T01:39:12.534035+0000","last_fullsized":"2023-11-04T01:39:12.534035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:54:15.823978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536618+0000","last_change":"2023-11-04T01:38:23.404752+0000","last_active":"2023-11-04T01:39:12.536618+0000","last_peered":"2023-11-04T01:39:12.536618+0000","last_clean":"2023-11-04T01:39:12.536618+0000","last_became_active":"2023-11-04T01:38:21.069815+0000","last_became_peered":"2023-11-04T01:38:21.069815+0000","last_unstale":"2023-11-04T01:39:12.536618+0000","last_undegraded":"2023-11-04T01:39:12.536618+0000","last_fullsized":"2023-11-04T01:39:12.536618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:07:15.512902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076771900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528199+0000","last_change":"2023-11-04T01:37:23.860317+0000","last_active":"2023-11-04T01:39:12.528199+0000","last_peered":"2023-11-04T01:39:12.528199+0000","last_clean":"2023-11-04T01:39:12.528199+0000","last_became_active":"2023-11-04T01:37:22.428402+0000","last_became_peered":"2023-11-04T01:37:22.428402+0000","last_unstale":"2023-11-04T01:39:12.528199+0000","last_undegraded":"2023-11-04T01:39:12.528199+0000","last_fullsized":"2023-11-04T01:39:12.528199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:06.773211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047771499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547989+0000","last_change":"2023-11-04T01:39:13.543787+0000","last_active":"2023-11-04T01:39:13.547989+0000","last_peered":"2023-11-04T01:39:13.547989+0000","last_clean":"2023-11-04T01:39:13.547989+0000","last_became_active":"2023-11-04T01:39:13.543545+0000","last_became_peered":"2023-11-04T01:39:13.543545+0000","last_unstale":"2023-11-04T01:39:13.547989+0000","last_undegraded":"2023-11-04T01:39:13.547989+0000","last_fullsized":"2023-11-04T01:39:13.547989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:12.029246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.546585+0000","last_change":"2023-11-04T01:39:12.545249+0000","last_active":"2023-11-04T01:39:13.546585+0000","last_peered":"2023-11-04T01:39:13.546585+0000","last_clean":"2023-11-04T01:39:13.546585+0000","last_became_active":"2023-11-04T01:39:12.544854+0000","last_became_peered":"2023-11-04T01:39:12.544854+0000","last_unstale":"2023-11-04T01:39:13.546585+0000","last_undegraded":"2023-11-04T01:39:13.546585+0000","last_fullsized":"2023-11-04T01:39:13.546585+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:18.547240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536698+0000","last_change":"2023-11-04T01:38:22.071153+0000","last_active":"2023-11-04T01:39:12.536698+0000","last_peered":"2023-11-04T01:39:12.536698+0000","last_clean":"2023-11-04T01:39:12.536698+0000","last_became_active":"2023-11-04T01:38:22.070642+0000","last_became_peered":"2023-11-04T01:38:22.070642+0000","last_unstale":"2023-11-04T01:39:12.536698+0000","last_undegraded":"2023-11-04T01:39:12.536698+0000","last_fullsized":"2023-11-04T01:39:12.536698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:05:14.109900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538559+0000","last_change":"2023-11-04T01:38:23.405429+0000","last_active":"2023-11-04T01:39:12.538559+0000","last_peered":"2023-11-04T01:39:12.538559+0000","last_clean":"2023-11-04T01:39:12.538559+0000","last_became_active":"2023-11-04T01:38:21.073092+0000","last_became_peered":"2023-11-04T01:38:21.073092+0000","last_unstale":"2023-11-04T01:39:12.538559+0000","last_undegraded":"2023-11-04T01:39:12.538559+0000","last_fullsized":"2023-11-04T01:39:12.538559+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:05.881981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088544700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534616+0000","last_change":"2023-11-04T01:37:23.790760+0000","last_active":"2023-11-04T01:39:12.534616+0000","last_peered":"2023-11-04T01:39:12.534616+0000","last_clean":"2023-11-04T01:39:12.534616+0000","last_became_active":"2023-11-04T01:37:22.426077+0000","last_became_peered":"2023-11-04T01:37:22.426077+0000","last_unstale":"2023-11-04T01:39:12.534616+0000","last_undegraded":"2023-11-04T01:39:12.534616+0000","last_fullsized":"2023-11-04T01:39:12.534616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:26.104180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000265841,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559880+0000","last_change":"2023-11-04T01:39:13.556419+0000","last_active":"2023-11-04T01:39:13.559880+0000","last_peered":"2023-11-04T01:39:13.559880+0000","last_clean":"2023-11-04T01:39:13.559880+0000","last_became_active":"2023-11-04T01:39:13.556117+0000","last_became_peered":"2023-11-04T01:39:13.556117+0000","last_unstale":"2023-11-04T01:39:13.559880+0000","last_undegraded":"2023-11-04T01:39:13.559880+0000","last_fullsized":"2023-11-04T01:39:13.559880+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:13.480700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.560394+0000","last_change":"2023-11-04T01:39:12.543671+0000","last_active":"2023-11-04T01:39:13.560394+0000","last_peered":"2023-11-04T01:39:13.560394+0000","last_clean":"2023-11-04T01:39:13.560394+0000","last_became_active":"2023-11-04T01:39:12.543399+0000","last_became_peered":"2023-11-04T01:39:12.543399+0000","last_unstale":"2023-11-04T01:39:13.560394+0000","last_undegraded":"2023-11-04T01:39:13.560394+0000","last_fullsized":"2023-11-04T01:39:13.560394+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:13.270814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527664+0000","last_change":"2023-11-04T01:38:22.066267+0000","last_active":"2023-11-04T01:39:12.527664+0000","last_peered":"2023-11-04T01:39:12.527664+0000","last_clean":"2023-11-04T01:39:12.527664+0000","last_became_active":"2023-11-04T01:38:22.065904+0000","last_became_peered":"2023-11-04T01:38:22.065904+0000","last_unstale":"2023-11-04T01:39:12.527664+0000","last_undegraded":"2023-11-04T01:39:12.527664+0000","last_fullsized":"2023-11-04T01:39:12.527664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:43.523897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533508+0000","last_change":"2023-11-04T01:38:23.062165+0000","last_active":"2023-11-04T01:39:12.533508+0000","last_peered":"2023-11-04T01:39:12.533508+0000","last_clean":"2023-11-04T01:39:12.533508+0000","last_became_active":"2023-11-04T01:38:21.065551+0000","last_became_peered":"2023-11-04T01:38:21.065551+0000","last_unstale":"2023-11-04T01:39:12.533508+0000","last_undegraded":"2023-11-04T01:39:12.533508+0000","last_fullsized":"2023-11-04T01:39:12.533508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:16.744946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068861599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527457+0000","last_change":"2023-11-04T01:37:23.859870+0000","last_active":"2023-11-04T01:39:12.527457+0000","last_peered":"2023-11-04T01:39:12.527457+0000","last_clean":"2023-11-04T01:39:12.527457+0000","last_became_active":"2023-11-04T01:37:22.423623+0000","last_became_peered":"2023-11-04T01:37:22.423623+0000","last_unstale":"2023-11-04T01:39:12.527457+0000","last_undegraded":"2023-11-04T01:39:12.527457+0000","last_fullsized":"2023-11-04T01:39:12.527457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:39.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047756099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565286+0000","last_change":"2023-11-04T01:39:13.563712+0000","last_active":"2023-11-04T01:39:13.565286+0000","last_peered":"2023-11-04T01:39:13.565286+0000","last_clean":"2023-11-04T01:39:13.565286+0000","last_became_active":"2023-11-04T01:39:13.563369+0000","last_became_peered":"2023-11-04T01:39:13.563369+0000","last_unstale":"2023-11-04T01:39:13.565286+0000","last_undegraded":"2023-11-04T01:39:13.565286+0000","last_fullsized":"2023-11-04T01:39:13.565286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:10.470404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"94'4","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568610+0000","last_change":"2023-11-04T01:39:12.544641+0000","last_active":"2023-11-04T01:39:13.568610+0000","last_peered":"2023-11-04T01:39:13.568610+0000","last_clean":"2023-11-04T01:39:13.568610+0000","last_became_active":"2023-11-04T01:39:12.544339+0000","last_became_peered":"2023-11-04T01:39:12.544339+0000","last_unstale":"2023-11-04T01:39:13.568610+0000","last_undegraded":"2023-11-04T01:39:13.568610+0000","last_fullsized":"2023-11-04T01:39:13.568610+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:08.906207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535465+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:39:12.535465+0000","last_peered":"2023-11-04T01:39:12.535465+0000","last_clean":"2023-11-04T01:39:12.535465+0000","last_became_active":"2023-11-04T01:38:22.074718+0000","last_became_peered":"2023-11-04T01:38:22.074718+0000","last_unstale":"2023-11-04T01:39:12.535465+0000","last_undegraded":"2023-11-04T01:39:12.535465+0000","last_fullsized":"2023-11-04T01:39:12.535465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:12.056843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527753+0000","last_change":"2023-11-04T01:38:23.062210+0000","last_active":"2023-11-04T01:39:12.527753+0000","last_peered":"2023-11-04T01:39:12.527753+0000","last_clean":"2023-11-04T01:39:12.527753+0000","last_became_active":"2023-11-04T01:38:21.062480+0000","last_became_peered":"2023-11-04T01:38:21.062480+0000","last_unstale":"2023-11-04T01:39:12.527753+0000","last_undegraded":"2023-11-04T01:39:12.527753+0000","last_fullsized":"2023-11-04T01:39:12.527753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:20.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040890099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.532120+0000","last_change":"2023-11-04T01:37:23.790544+0000","last_active":"2023-11-04T01:39:12.532120+0000","last_peered":"2023-11-04T01:39:12.532120+0000","last_clean":"2023-11-04T01:39:12.532120+0000","last_became_active":"2023-11-04T01:37:22.425999+0000","last_became_peered":"2023-11-04T01:37:22.425999+0000","last_unstale":"2023-11-04T01:39:12.532120+0000","last_undegraded":"2023-11-04T01:39:12.532120+0000","last_fullsized":"2023-11-04T01:39:12.532120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:12.331400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043525600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.558344+0000","last_change":"2023-11-04T01:39:13.556302+0000","last_active":"2023-11-04T01:39:13.558344+0000","last_peered":"2023-11-04T01:39:13.558344+0000","last_clean":"2023-11-04T01:39:13.558344+0000","last_became_active":"2023-11-04T01:39:13.556027+0000","last_became_peered":"2023-11-04T01:39:13.556027+0000","last_unstale":"2023-11-04T01:39:13.558344+0000","last_undegraded":"2023-11-04T01:39:13.558344+0000","last_fullsized":"2023-11-04T01:39:13.558344+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:41.218355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566618+0000","last_change":"2023-11-04T01:39:12.545701+0000","last_active":"2023-11-04T01:39:13.566618+0000","last_peered":"2023-11-04T01:39:13.566618+0000","last_clean":"2023-11-04T01:39:13.566618+0000","last_became_active":"2023-11-04T01:39:12.545188+0000","last_became_peered":"2023-11-04T01:39:12.545188+0000","last_unstale":"2023-11-04T01:39:13.566618+0000","last_undegraded":"2023-11-04T01:39:13.566618+0000","last_fullsized":"2023-11-04T01:39:13.566618+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:44.568689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536007+0000","last_change":"2023-11-04T01:38:22.070477+0000","last_active":"2023-11-04T01:39:12.536007+0000","last_peered":"2023-11-04T01:39:12.536007+0000","last_clean":"2023-11-04T01:39:12.536007+0000","last_became_active":"2023-11-04T01:38:22.070203+0000","last_became_peered":"2023-11-04T01:38:22.070203+0000","last_unstale":"2023-11-04T01:39:12.536007+0000","last_undegraded":"2023-11-04T01:39:12.536007+0000","last_fullsized":"2023-11-04T01:39:12.536007+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:51:07.694892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533191+0000","last_change":"2023-11-04T01:38:23.060125+0000","last_active":"2023-11-04T01:39:12.533191+0000","last_peered":"2023-11-04T01:39:12.533191+0000","last_clean":"2023-11-04T01:39:12.533191+0000","last_became_active":"2023-11-04T01:38:21.068722+0000","last_became_peered":"2023-11-04T01:38:21.068722+0000","last_unstale":"2023-11-04T01:39:12.533191+0000","last_undegraded":"2023-11-04T01:39:12.533191+0000","last_fullsized":"2023-11-04T01:39:12.533191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:13.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058911300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536181+0000","last_change":"2023-11-04T01:37:23.424168+0000","last_active":"2023-11-04T01:39:12.536181+0000","last_peered":"2023-11-04T01:39:12.536181+0000","last_clean":"2023-11-04T01:39:12.536181+0000","last_became_active":"2023-11-04T01:37:22.418030+0000","last_became_peered":"2023-11-04T01:37:22.418030+0000","last_unstale":"2023-11-04T01:39:12.536181+0000","last_undegraded":"2023-11-04T01:39:12.536181+0000","last_fullsized":"2023-11-04T01:39:12.536181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000419782,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568491+0000","last_change":"2023-11-04T01:39:13.567123+0000","last_active":"2023-11-04T01:39:13.568491+0000","last_peered":"2023-11-04T01:39:13.568491+0000","last_clean":"2023-11-04T01:39:13.568491+0000","last_became_active":"2023-11-04T01:39:13.566881+0000","last_became_peered":"2023-11-04T01:39:13.566881+0000","last_unstale":"2023-11-04T01:39:13.568491+0000","last_undegraded":"2023-11-04T01:39:13.568491+0000","last_fullsized":"2023-11-04T01:39:13.568491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:47.990192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.570988+0000","last_change":"2023-11-04T01:39:12.544642+0000","last_active":"2023-11-04T01:39:13.570988+0000","last_peered":"2023-11-04T01:39:13.570988+0000","last_clean":"2023-11-04T01:39:13.570988+0000","last_became_active":"2023-11-04T01:39:12.544353+0000","last_became_peered":"2023-11-04T01:39:12.544353+0000","last_unstale":"2023-11-04T01:39:13.570988+0000","last_undegraded":"2023-11-04T01:39:13.570988+0000","last_fullsized":"2023-11-04T01:39:13.570988+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:32.899395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.534988+0000","last_change":"2023-11-04T01:38:22.075956+0000","last_active":"2023-11-04T01:39:12.534988+0000","last_peered":"2023-11-04T01:39:12.534988+0000","last_clean":"2023-11-04T01:39:12.534988+0000","last_became_active":"2023-11-04T01:38:22.075635+0000","last_became_peered":"2023-11-04T01:38:22.075635+0000","last_unstale":"2023-11-04T01:39:12.534988+0000","last_undegraded":"2023-11-04T01:39:12.534988+0000","last_fullsized":"2023-11-04T01:39:12.534988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:53.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536099+0000","last_change":"2023-11-04T01:38:23.404427+0000","last_active":"2023-11-04T01:39:12.536099+0000","last_peered":"2023-11-04T01:39:12.536099+0000","last_clean":"2023-11-04T01:39:12.536099+0000","last_became_active":"2023-11-04T01:38:21.069870+0000","last_became_peered":"2023-11-04T01:38:21.069870+0000","last_unstale":"2023-11-04T01:39:12.536099+0000","last_undegraded":"2023-11-04T01:39:12.536099+0000","last_fullsized":"2023-11-04T01:39:12.536099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:47.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086834100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541941+0000","last_change":"2023-11-04T01:37:23.545155+0000","last_active":"2023-11-04T01:39:12.541941+0000","last_peered":"2023-11-04T01:39:12.541941+0000","last_clean":"2023-11-04T01:39:12.541941+0000","last_became_active":"2023-11-04T01:37:22.427255+0000","last_became_peered":"2023-11-04T01:37:22.427255+0000","last_unstale":"2023-11-04T01:39:12.541941+0000","last_undegraded":"2023-11-04T01:39:12.541941+0000","last_fullsized":"2023-11-04T01:39:12.541941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:46:00.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054766700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559275+0000","last_change":"2023-11-04T01:39:13.553193+0000","last_active":"2023-11-04T01:39:13.559275+0000","last_peered":"2023-11-04T01:39:13.559275+0000","last_clean":"2023-11-04T01:39:13.559275+0000","last_became_active":"2023-11-04T01:39:13.552925+0000","last_became_peered":"2023-11-04T01:39:13.552925+0000","last_unstale":"2023-11-04T01:39:13.559275+0000","last_undegraded":"2023-11-04T01:39:13.559275+0000","last_fullsized":"2023-11-04T01:39:13.559275+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:57:01.398526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.547414+0000","last_change":"2023-11-04T01:39:12.545875+0000","last_active":"2023-11-04T01:39:13.547414+0000","last_peered":"2023-11-04T01:39:13.547414+0000","last_clean":"2023-11-04T01:39:13.547414+0000","last_became_active":"2023-11-04T01:39:12.545601+0000","last_became_peered":"2023-11-04T01:39:12.545601+0000","last_unstale":"2023-11-04T01:39:13.547414+0000","last_undegraded":"2023-11-04T01:39:13.547414+0000","last_fullsized":"2023-11-04T01:39:13.547414+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:40.916306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541432+0000","last_change":"2023-11-04T01:38:22.071179+0000","last_active":"2023-11-04T01:39:12.541432+0000","last_peered":"2023-11-04T01:39:12.541432+0000","last_clean":"2023-11-04T01:39:12.541432+0000","last_became_active":"2023-11-04T01:38:22.070904+0000","last_became_peered":"2023-11-04T01:38:22.070904+0000","last_unstale":"2023-11-04T01:39:12.541432+0000","last_undegraded":"2023-11-04T01:39:12.541432+0000","last_fullsized":"2023-11-04T01:39:12.541432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:16:17.749810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.527942+0000","last_change":"2023-11-04T01:38:23.062973+0000","last_active":"2023-11-04T01:39:12.527942+0000","last_peered":"2023-11-04T01:39:12.527942+0000","last_clean":"2023-11-04T01:39:12.527942+0000","last_became_active":"2023-11-04T01:38:21.060285+0000","last_became_peered":"2023-11-04T01:38:21.060285+0000","last_unstale":"2023-11-04T01:39:12.527942+0000","last_undegraded":"2023-11-04T01:39:12.527942+0000","last_fullsized":"2023-11-04T01:39:12.527942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:03.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097246599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538226+0000","last_change":"2023-11-04T01:37:23.426586+0000","last_active":"2023-11-04T01:39:12.538226+0000","last_peered":"2023-11-04T01:39:12.538226+0000","last_clean":"2023-11-04T01:39:12.538226+0000","last_became_active":"2023-11-04T01:37:22.426342+0000","last_became_peered":"2023-11-04T01:37:22.426342+0000","last_unstale":"2023-11-04T01:39:12.538226+0000","last_undegraded":"2023-11-04T01:39:12.538226+0000","last_fullsized":"2023-11-04T01:39:12.538226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040759299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.566089+0000","last_change":"2023-11-04T01:39:13.556498+0000","last_active":"2023-11-04T01:39:13.566089+0000","last_peered":"2023-11-04T01:39:13.566089+0000","last_clean":"2023-11-04T01:39:13.566089+0000","last_became_active":"2023-11-04T01:39:13.556234+0000","last_became_peered":"2023-11-04T01:39:13.556234+0000","last_unstale":"2023-11-04T01:39:13.566089+0000","last_undegraded":"2023-11-04T01:39:13.566089+0000","last_fullsized":"2023-11-04T01:39:13.566089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:57.821448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.568719+0000","last_change":"2023-11-04T01:39:12.543549+0000","last_active":"2023-11-04T01:39:13.568719+0000","last_peered":"2023-11-04T01:39:13.568719+0000","last_clean":"2023-11-04T01:39:13.568719+0000","last_became_active":"2023-11-04T01:39:12.543288+0000","last_became_peered":"2023-11-04T01:39:12.543288+0000","last_unstale":"2023-11-04T01:39:13.568719+0000","last_undegraded":"2023-11-04T01:39:13.568719+0000","last_fullsized":"2023-11-04T01:39:13.568719+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:18:09.467797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536429+0000","last_change":"2023-11-04T01:38:22.070640+0000","last_active":"2023-11-04T01:39:12.536429+0000","last_peered":"2023-11-04T01:39:12.536429+0000","last_clean":"2023-11-04T01:39:12.536429+0000","last_became_active":"2023-11-04T01:38:22.070342+0000","last_became_peered":"2023-11-04T01:38:22.070342+0000","last_unstale":"2023-11-04T01:39:12.536429+0000","last_undegraded":"2023-11-04T01:39:12.536429+0000","last_fullsized":"2023-11-04T01:39:12.536429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:29.191472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541417+0000","last_change":"2023-11-04T01:38:23.405745+0000","last_active":"2023-11-04T01:39:12.541417+0000","last_peered":"2023-11-04T01:39:12.541417+0000","last_clean":"2023-11-04T01:39:12.541417+0000","last_became_active":"2023-11-04T01:38:21.071619+0000","last_became_peered":"2023-11-04T01:38:21.071619+0000","last_unstale":"2023-11-04T01:39:12.541417+0000","last_undegraded":"2023-11-04T01:39:12.541417+0000","last_fullsized":"2023-11-04T01:39:12.541417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:56.052528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096848099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528293+0000","last_change":"2023-11-04T01:37:23.860272+0000","last_active":"2023-11-04T01:39:12.528293+0000","last_peered":"2023-11-04T01:39:12.528293+0000","last_clean":"2023-11-04T01:39:12.528293+0000","last_became_active":"2023-11-04T01:37:22.424654+0000","last_became_peered":"2023-11-04T01:37:22.424654+0000","last_unstale":"2023-11-04T01:39:12.528293+0000","last_undegraded":"2023-11-04T01:39:12.528293+0000","last_fullsized":"2023-11-04T01:39:12.528293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:30.471429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067873100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565384+0000","last_change":"2023-11-04T01:39:13.551446+0000","last_active":"2023-11-04T01:39:13.565384+0000","last_peered":"2023-11-04T01:39:13.565384+0000","last_clean":"2023-11-04T01:39:13.565384+0000","last_became_active":"2023-11-04T01:39:13.551189+0000","last_became_peered":"2023-11-04T01:39:13.551189+0000","last_unstale":"2023-11-04T01:39:13.565384+0000","last_undegraded":"2023-11-04T01:39:13.565384+0000","last_fullsized":"2023-11-04T01:39:13.565384+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:51:37.970849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"94'8","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.571992+0000","last_change":"2023-11-04T01:39:12.536587+0000","last_active":"2023-11-04T01:39:13.571992+0000","last_peered":"2023-11-04T01:39:13.571992+0000","last_clean":"2023-11-04T01:39:13.571992+0000","last_became_active":"2023-11-04T01:39:12.536360+0000","last_became_peered":"2023-11-04T01:39:12.536360+0000","last_unstale":"2023-11-04T01:39:13.571992+0000","last_undegraded":"2023-11-04T01:39:13.571992+0000","last_fullsized":"2023-11-04T01:39:13.571992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:16.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533945+0000","last_change":"2023-11-04T01:38:22.075348+0000","last_active":"2023-11-04T01:39:12.533945+0000","last_peered":"2023-11-04T01:39:12.533945+0000","last_clean":"2023-11-04T01:39:12.533945+0000","last_became_active":"2023-11-04T01:38:22.075069+0000","last_became_peered":"2023-11-04T01:38:22.075069+0000","last_unstale":"2023-11-04T01:39:12.533945+0000","last_undegraded":"2023-11-04T01:39:12.533945+0000","last_fullsized":"2023-11-04T01:39:12.533945+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:06.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528129+0000","last_change":"2023-11-04T01:38:23.062630+0000","last_active":"2023-11-04T01:39:12.528129+0000","last_peered":"2023-11-04T01:39:12.528129+0000","last_clean":"2023-11-04T01:39:12.528129+0000","last_became_active":"2023-11-04T01:38:21.066987+0000","last_became_peered":"2023-11-04T01:38:21.066987+0000","last_unstale":"2023-11-04T01:39:12.528129+0000","last_undegraded":"2023-11-04T01:39:12.528129+0000","last_fullsized":"2023-11-04T01:39:12.528129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:48.254134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064188099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541604+0000","last_change":"2023-11-04T01:37:23.576763+0000","last_active":"2023-11-04T01:39:12.541604+0000","last_peered":"2023-11-04T01:39:12.541604+0000","last_clean":"2023-11-04T01:39:12.541604+0000","last_became_active":"2023-11-04T01:37:22.425401+0000","last_became_peered":"2023-11-04T01:37:22.425401+0000","last_unstale":"2023-11-04T01:39:12.541604+0000","last_undegraded":"2023-11-04T01:39:12.541604+0000","last_fullsized":"2023-11-04T01:39:12.541604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:13.159158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078827400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.559900+0000","last_change":"2023-11-04T01:39:13.557170+0000","last_active":"2023-11-04T01:39:13.559900+0000","last_peered":"2023-11-04T01:39:13.559900+0000","last_clean":"2023-11-04T01:39:13.559900+0000","last_became_active":"2023-11-04T01:39:13.556834+0000","last_became_peered":"2023-11-04T01:39:13.556834+0000","last_unstale":"2023-11-04T01:39:13.559900+0000","last_undegraded":"2023-11-04T01:39:13.559900+0000","last_fullsized":"2023-11-04T01:39:13.559900+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:58:14.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.551147+0000","last_change":"2023-11-04T01:39:12.547742+0000","last_active":"2023-11-04T01:39:13.551147+0000","last_peered":"2023-11-04T01:39:13.551147+0000","last_clean":"2023-11-04T01:39:13.551147+0000","last_became_active":"2023-11-04T01:39:12.547478+0000","last_became_peered":"2023-11-04T01:39:12.547478+0000","last_unstale":"2023-11-04T01:39:13.551147+0000","last_undegraded":"2023-11-04T01:39:13.551147+0000","last_fullsized":"2023-11-04T01:39:13.551147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:01.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536204+0000","last_change":"2023-11-04T01:38:22.075024+0000","last_active":"2023-11-04T01:39:12.536204+0000","last_peered":"2023-11-04T01:39:12.536204+0000","last_clean":"2023-11-04T01:39:12.536204+0000","last_became_active":"2023-11-04T01:38:22.074743+0000","last_became_peered":"2023-11-04T01:38:22.074743+0000","last_unstale":"2023-11-04T01:39:12.536204+0000","last_undegraded":"2023-11-04T01:39:12.536204+0000","last_fullsized":"2023-11-04T01:39:12.536204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:33:48.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533285+0000","last_change":"2023-11-04T01:38:23.066643+0000","last_active":"2023-11-04T01:39:12.533285+0000","last_peered":"2023-11-04T01:39:12.533285+0000","last_clean":"2023-11-04T01:39:12.533285+0000","last_became_active":"2023-11-04T01:38:21.070223+0000","last_became_peered":"2023-11-04T01:38:21.070223+0000","last_unstale":"2023-11-04T01:39:12.533285+0000","last_undegraded":"2023-11-04T01:39:12.533285+0000","last_fullsized":"2023-11-04T01:39:12.533285+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:52.001252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000522103,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":66,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533462+0000","last_change":"2023-11-04T01:37:23.611094+0000","last_active":"2023-11-04T01:39:12.533462+0000","last_peered":"2023-11-04T01:39:12.533462+0000","last_clean":"2023-11-04T01:39:12.533462+0000","last_became_active":"2023-11-04T01:37:22.418359+0000","last_became_peered":"2023-11-04T01:37:22.418359+0000","last_unstale":"2023-11-04T01:39:12.533462+0000","last_undegraded":"2023-11-04T01:39:12.533462+0000","last_fullsized":"2023-11-04T01:39:12.533462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:48.164965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565609+0000","last_change":"2023-11-04T01:39:13.563700+0000","last_active":"2023-11-04T01:39:13.565609+0000","last_peered":"2023-11-04T01:39:13.565609+0000","last_clean":"2023-11-04T01:39:13.565609+0000","last_became_active":"2023-11-04T01:39:13.563444+0000","last_became_peered":"2023-11-04T01:39:13.563444+0000","last_unstale":"2023-11-04T01:39:13.565609+0000","last_undegraded":"2023-11-04T01:39:13.565609+0000","last_fullsized":"2023-11-04T01:39:13.565609+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:13.810773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.544416+0000","last_change":"2023-11-04T01:39:12.544735+0000","last_active":"2023-11-04T01:39:13.544416+0000","last_peered":"2023-11-04T01:39:13.544416+0000","last_clean":"2023-11-04T01:39:13.544416+0000","last_became_active":"2023-11-04T01:39:12.544487+0000","last_became_peered":"2023-11-04T01:39:12.544487+0000","last_unstale":"2023-11-04T01:39:13.544416+0000","last_undegraded":"2023-11-04T01:39:13.544416+0000","last_fullsized":"2023-11-04T01:39:13.544416+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:00.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.533360+0000","last_change":"2023-11-04T01:38:22.075923+0000","last_active":"2023-11-04T01:39:12.533360+0000","last_peered":"2023-11-04T01:39:12.533360+0000","last_clean":"2023-11-04T01:39:12.533360+0000","last_became_active":"2023-11-04T01:38:22.075005+0000","last_became_peered":"2023-11-04T01:38:22.075005+0000","last_unstale":"2023-11-04T01:39:12.533360+0000","last_undegraded":"2023-11-04T01:39:12.533360+0000","last_fullsized":"2023-11-04T01:39:12.533360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:53.841576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541387+0000","last_change":"2023-11-04T01:38:23.327369+0000","last_active":"2023-11-04T01:39:12.541387+0000","last_peered":"2023-11-04T01:39:12.541387+0000","last_clean":"2023-11-04T01:39:12.541387+0000","last_became_active":"2023-11-04T01:38:21.071839+0000","last_became_peered":"2023-11-04T01:38:21.071839+0000","last_unstale":"2023-11-04T01:39:12.541387+0000","last_undegraded":"2023-11-04T01:39:12.541387+0000","last_fullsized":"2023-11-04T01:39:12.541387+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:41.422222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044534300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":62,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536480+0000","last_change":"2023-11-04T01:37:23.425150+0000","last_active":"2023-11-04T01:39:12.536480+0000","last_peered":"2023-11-04T01:39:12.536480+0000","last_clean":"2023-11-04T01:39:12.536480+0000","last_became_active":"2023-11-04T01:37:22.421406+0000","last_became_peered":"2023-11-04T01:37:22.421406+0000","last_unstale":"2023-11-04T01:39:12.536480+0000","last_undegraded":"2023-11-04T01:39:12.536480+0000","last_fullsized":"2023-11-04T01:39:12.536480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:33.287301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010820160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.549374+0000","last_change":"2023-11-04T01:39:13.546642+0000","last_active":"2023-11-04T01:39:13.549374+0000","last_peered":"2023-11-04T01:39:13.549374+0000","last_clean":"2023-11-04T01:39:13.549374+0000","last_became_active":"2023-11-04T01:39:13.546376+0000","last_became_peered":"2023-11-04T01:39:13.546376+0000","last_unstale":"2023-11-04T01:39:13.549374+0000","last_undegraded":"2023-11-04T01:39:13.549374+0000","last_fullsized":"2023-11-04T01:39:13.549374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:14:38.689833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"94'6","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.573254+0000","last_change":"2023-11-04T01:39:12.547414+0000","last_active":"2023-11-04T01:39:13.573254+0000","last_peered":"2023-11-04T01:39:13.573254+0000","last_clean":"2023-11-04T01:39:13.573254+0000","last_became_active":"2023-11-04T01:39:12.546788+0000","last_became_peered":"2023-11-04T01:39:12.546788+0000","last_unstale":"2023-11-04T01:39:13.573254+0000","last_undegraded":"2023-11-04T01:39:13.573254+0000","last_fullsized":"2023-11-04T01:39:13.573254+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:19.011651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536112+0000","last_change":"2023-11-04T01:38:22.072700+0000","last_active":"2023-11-04T01:39:12.536112+0000","last_peered":"2023-11-04T01:39:12.536112+0000","last_clean":"2023-11-04T01:39:12.536112+0000","last_became_active":"2023-11-04T01:38:22.072280+0000","last_became_peered":"2023-11-04T01:38:22.072280+0000","last_unstale":"2023-11-04T01:39:12.536112+0000","last_undegraded":"2023-11-04T01:39:12.536112+0000","last_fullsized":"2023-11-04T01:39:12.536112+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541058+0000","last_change":"2023-11-04T01:38:23.327480+0000","last_active":"2023-11-04T01:39:12.541058+0000","last_peered":"2023-11-04T01:39:12.541058+0000","last_clean":"2023-11-04T01:39:12.541058+0000","last_became_active":"2023-11-04T01:38:21.071005+0000","last_became_peered":"2023-11-04T01:38:21.071005+0000","last_unstale":"2023-11-04T01:39:12.541058+0000","last_undegraded":"2023-11-04T01:39:12.541058+0000","last_fullsized":"2023-11-04T01:39:12.541058+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:25.393510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081827400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.541474+0000","last_change":"2023-11-04T01:37:23.545356+0000","last_active":"2023-11-04T01:39:12.541474+0000","last_peered":"2023-11-04T01:39:12.541474+0000","last_clean":"2023-11-04T01:39:12.541474+0000","last_became_active":"2023-11-04T01:37:22.426546+0000","last_became_peered":"2023-11-04T01:37:22.426546+0000","last_unstale":"2023-11-04T01:39:12.541474+0000","last_undegraded":"2023-11-04T01:39:12.541474+0000","last_fullsized":"2023-11-04T01:39:12.541474+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:24.760724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074836599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565829+0000","last_change":"2023-11-04T01:39:13.561174+0000","last_active":"2023-11-04T01:39:13.565829+0000","last_peered":"2023-11-04T01:39:13.565829+0000","last_clean":"2023-11-04T01:39:13.565829+0000","last_became_active":"2023-11-04T01:39:13.560844+0000","last_became_peered":"2023-11-04T01:39:13.560844+0000","last_unstale":"2023-11-04T01:39:13.565829+0000","last_undegraded":"2023-11-04T01:39:13.565829+0000","last_fullsized":"2023-11-04T01:39:13.565829+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:04.137904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"94'3","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565967+0000","last_change":"2023-11-04T01:39:12.542494+0000","last_active":"2023-11-04T01:39:13.565967+0000","last_peered":"2023-11-04T01:39:13.565967+0000","last_clean":"2023-11-04T01:39:13.565967+0000","last_became_active":"2023-11-04T01:39:12.542193+0000","last_became_peered":"2023-11-04T01:39:12.542193+0000","last_unstale":"2023-11-04T01:39:13.565967+0000","last_undegraded":"2023-11-04T01:39:13.565967+0000","last_fullsized":"2023-11-04T01:39:13.565967+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:49.154942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.531990+0000","last_change":"2023-11-04T01:38:22.070891+0000","last_active":"2023-11-04T01:39:12.531990+0000","last_peered":"2023-11-04T01:39:12.531990+0000","last_clean":"2023-11-04T01:39:12.531990+0000","last_became_active":"2023-11-04T01:38:22.070338+0000","last_became_peered":"2023-11-04T01:38:22.070338+0000","last_unstale":"2023-11-04T01:39:12.531990+0000","last_undegraded":"2023-11-04T01:39:12.531990+0000","last_fullsized":"2023-11-04T01:39:12.531990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:21.863324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.531589+0000","last_change":"2023-11-04T01:38:23.066474+0000","last_active":"2023-11-04T01:39:12.531589+0000","last_peered":"2023-11-04T01:39:12.531589+0000","last_clean":"2023-11-04T01:39:12.531589+0000","last_became_active":"2023-11-04T01:38:21.069750+0000","last_became_peered":"2023-11-04T01:38:21.069750+0000","last_unstale":"2023-11-04T01:39:12.531589+0000","last_undegraded":"2023-11-04T01:39:12.531589+0000","last_fullsized":"2023-11-04T01:39:12.531589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:07.250121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045060599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.542012+0000","last_change":"2023-11-04T01:37:23.545380+0000","last_active":"2023-11-04T01:39:12.542012+0000","last_peered":"2023-11-04T01:39:12.542012+0000","last_clean":"2023-11-04T01:39:12.542012+0000","last_became_active":"2023-11-04T01:37:22.417561+0000","last_became_peered":"2023-11-04T01:37:22.417561+0000","last_unstale":"2023-11-04T01:39:12.542012+0000","last_undegraded":"2023-11-04T01:39:12.542012+0000","last_fullsized":"2023-11-04T01:39:12.542012+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:40:34.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064605900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.565901+0000","last_change":"2023-11-04T01:39:13.560694+0000","last_active":"2023-11-04T01:39:13.565901+0000","last_peered":"2023-11-04T01:39:13.565901+0000","last_clean":"2023-11-04T01:39:13.565901+0000","last_became_active":"2023-11-04T01:39:13.560419+0000","last_became_peered":"2023-11-04T01:39:13.560419+0000","last_unstale":"2023-11-04T01:39:13.565901+0000","last_undegraded":"2023-11-04T01:39:13.565901+0000","last_fullsized":"2023-11-04T01:39:13.565901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:12.522758+0000","last_clean_scrub_stamp":"2023-11-04T01:39:12.522758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:24.036674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:13.541992+0000","last_change":"2023-11-04T01:39:12.547357+0000","last_active":"2023-11-04T01:39:13.541992+0000","last_peered":"2023-11-04T01:39:13.541992+0000","last_clean":"2023-11-04T01:39:13.541992+0000","last_became_active":"2023-11-04T01:39:12.547075+0000","last_became_peered":"2023-11-04T01:39:12.547075+0000","last_unstale":"2023-11-04T01:39:13.541992+0000","last_undegraded":"2023-11-04T01:39:13.541992+0000","last_fullsized":"2023-11-04T01:39:13.541992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:11.516014+0000","last_clean_scrub_stamp":"2023-11-04T01:39:11.516014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:43.085949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.536556+0000","last_change":"2023-11-04T01:38:22.076759+0000","last_active":"2023-11-04T01:39:12.536556+0000","last_peered":"2023-11-04T01:39:12.536556+0000","last_clean":"2023-11-04T01:39:12.536556+0000","last_became_active":"2023-11-04T01:38:22.075797+0000","last_became_peered":"2023-11-04T01:38:22.075797+0000","last_unstale":"2023-11-04T01:39:12.536556+0000","last_undegraded":"2023-11-04T01:39:12.536556+0000","last_fullsized":"2023-11-04T01:39:12.536556+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:21.043706+0000","last_clean_scrub_stamp":"2023-11-04T01:38:21.043706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:57.170559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.538040+0000","last_change":"2023-11-04T01:38:23.061342+0000","last_active":"2023-11-04T01:39:12.538040+0000","last_peered":"2023-11-04T01:39:12.538040+0000","last_clean":"2023-11-04T01:39:12.538040+0000","last_became_active":"2023-11-04T01:38:21.070645+0000","last_became_peered":"2023-11-04T01:38:21.070645+0000","last_unstale":"2023-11-04T01:39:12.538040+0000","last_undegraded":"2023-11-04T01:39:12.538040+0000","last_fullsized":"2023-11-04T01:39:12.538040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:20.038842+0000","last_clean_scrub_stamp":"2023-11-04T01:38:20.038842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053603500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.528267+0000","last_change":"2023-11-04T01:37:23.860491+0000","last_active":"2023-11-04T01:39:12.528267+0000","last_peered":"2023-11-04T01:39:12.528267+0000","last_clean":"2023-11-04T01:39:12.528267+0000","last_became_active":"2023-11-04T01:37:22.423589+0000","last_became_peered":"2023-11-04T01:37:22.423589+0000","last_unstale":"2023-11-04T01:39:12.528267+0000","last_undegraded":"2023-11-04T01:39:12.528267+0000","last_fullsized":"2023-11-04T01:39:12.528267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:21.398265+0000","last_clean_scrub_stamp":"2023-11-04T01:37:21.398265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:05.688442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060108099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-04T01:39:12.535203+0000","last_change":"2023-11-04T01:35:40.638910+0000","last_active":"2023-11-04T01:39:12.535203+0000","last_peered":"2023-11-04T01:39:12.535203+0000","last_clean":"2023-11-04T01:39:12.535203+0000","last_became_active":"2023-11-04T01:35:40.638026+0000","last_became_peered":"2023-11-04T01:35:40.638026+0000","last_unstale":"2023-11-04T01:39:12.535203+0000","last_undegraded":"2023-11-04T01:39:12.535203+0000","last_fullsized":"2023-11-04T01:39:12.535203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:35:39.417915+0000","last_clean_scrub_stamp":"2023-11-04T01:35:39.417915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:58.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1761280,"data_stored":1163523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54800000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71199999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.38300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70099999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.505},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77000000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61599999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65800000000000003,"5min":0.872,"15min":0.872},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.443}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":571590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61499999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68899999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.627}]},{"osd":4,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41699999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.45700000000000002},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44800000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":573143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63900000000000001,"5min":0.752,"15min":0.752},"last":0.37},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.78800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":0.752},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70999999999999996,"5min":0.75,"15min":0.75},"last":0.498}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46999999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52100000000000002,"15min":0.52700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70599999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1159168,"data_stored":572539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.66200000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64600000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":1.133,"15min":1.133},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.65400000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.77100000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.33800000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.745,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76100000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1175552,"data_stored":574221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.28599999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27100000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51800000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34999999999999998,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.502,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.375},"min":{"1min":0.29899999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72599999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.72199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76100000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.876,"15min":0.876},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":572539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.375,"15min":0.39500000000000002},"min":{"1min":0.215,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.47199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.376,"15min":0.40000000000000002},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.53300000000000003,"5min":1.427,"15min":1.427},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.438,"5min":1.375,"15min":1.375},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34899999999999998},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48199999999999998,"5min":1.266,"15min":1.266},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.41399999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.251},{"interface":"front","average":{"1min":0.375,"5min":0.41899999999999998,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.505,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.309}]},{"osd":4,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72699999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.378,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.179,"15min":1.179},"last":0.433}]},{"osd":5,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83199999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.61099999999999999,"15min":0.63500000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83999999999999997,"5min":1.498,"15min":1.498},"last":0.41799999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61599999999999999,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.276,"15min":1.276},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.39500000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.498},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81799999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":564353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.318,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.501,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.315,"15min":0.314},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34000000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.373,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.33000000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60899999999999999},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.437}]},{"osd":6,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.79100000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":1163612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.311,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40999999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42199999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.374},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45100000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.46999999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38700000000000001,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.308},{"interface":"front","average":{"1min":0.372,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.502,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.376}]},{"osd":4,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.59099999999999997},"min":{"1min":0.377,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":1.048,"15min":1.048},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73199999999999998,"5min":1.056,"15min":1.056},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66300000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72199999999999998,"5min":0.874,"15min":0.874},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.67500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60799999999999998,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:39:16.845 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:39:16.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.980+0000 7fab25464640 1 Processor -- start 2023-11-04T01:39:16.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.980+0000 7fab25464640 1 -- start start 2023-11-04T01:39:16.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab25464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab200cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab25464640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2015aff0 con 0x7fab200c4ff0 2023-11-04T01:39:16.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab25464640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2015a3e0 con 0x7fab20159c00 2023-11-04T01:39:16.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab25464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015a6c0 con 0x7fab200ae1d0 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab1e7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fab200c4ff0 0x7fab200adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39602/0 (socket says 172.21.15.93:39602) 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab1e7fc640 1 -- 172.21.15.93:0/1561142169 learned_addr learned my addr 172.21.15.93:0/1561142169 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab1f7fe640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab200cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378896578 0 0) 0x7fab2015aff0 con 0x7fab200c4ff0 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.981+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab08003520 con 0x7fab200c4ff0 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504160748 0 0) 0x7fab2015a3e0 con 0x7fab20159c00 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2015aff0 con 0x7fab20159c00 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183757116 0 0) 0x7fab08003520 con 0x7fab200c4ff0 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 msgr2=0x7fab200cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab200cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 >> v1:172.21.15.125:6789/0 conn(0x7fab20159c00 legacy=0x7fab200c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2015a9a0 con 0x7fab200c4ff0 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fab14001670 con 0x7fab200c4ff0 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1f7fe640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab200cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 >> v1:172.21.15.93:6789/0 conn(0x7fab200c4ff0 legacy=0x7fab200adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab08003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab08004d00 0x7fab08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015a6c0 con 0x7fab08003b30 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0800ba30 con 0x7fab08004d00 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0800bba0 con 0x7fab200ae1d0 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab08003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1e7fc640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1f7fe640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab08004d00 0x7fab08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 -- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 msgr2=0x7fab080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200ae1d0 0x7fab080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 -- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab08004d00 msgr2=0x7fab08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab08004d00 0x7fab08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.982+0000 7fab1effd640 1 -- 172.21.15.93:0/1561142169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009400 con 0x7fab08003b30 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.983+0000 7fab1effd640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab08003f30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab10001fd0 tx=0x7fab080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5db1bae50be60e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.983+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10003b70 con 0x7fab08003b30 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.983+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10003cd0 con 0x7fab08003b30 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.983+0000 7fab1dffb640 1 -- 172.21.15.93:0/1561142169 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100052f0 con 0x7fab08003b30 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 -- 172.21.15.93:0/1561142169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 msgr2=0x7fab08003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 --2- 172.21.15.93:0/1561142169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab08003f30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fab10001fd0 tx=0x7fab080057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab1f7fe640 1 -- 172.21.15.93:0/1561142169 reap_dead start 2023-11-04T01:39:16.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 -- 172.21.15.93:0/1561142169 shutdown_connections 2023-11-04T01:39:16.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 -- 172.21.15.93:0/1561142169 >> 172.21.15.93:0/1561142169 conn(0x7fab200ce950 msgr2=0x7fab200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 -- 172.21.15.93:0/1561142169 shutdown_connections 2023-11-04T01:39:16.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.984+0000 7fab25464640 1 -- 172.21.15.93:0/1561142169 wait complete. 2023-11-04T01:39:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.985+0000 7fab25464640 1 Processor -- start 2023-11-04T01:39:16.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.985+0000 7fab25464640 1 -- start start 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200c37d0 0x7fab200c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 0x7fab2015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c4190 con 0x7fab08003b30 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2013e400 con 0x7fab2015c0d0 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015d3e0 con 0x7fab200c37d0 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35090/0 (socket says 172.21.15.93:35090) 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 -- 172.21.15.93:0/618130555 learned_addr learned my addr 172.21.15.93:0/618130555 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1e7fc640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200c37d0 0x7fab200c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1f7fe640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 0x7fab2015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 -- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200c37d0 msgr2=0x7fab200c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.993 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200c37d0 0x7fab200c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 -- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 msgr2=0x7fab2015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 0x7fab2015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 -- 172.21.15.93:0/618130555 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2015ce20 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1f7fe640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 0x7fab2015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab1effd640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab10005040 tx=0x7fab10001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10005700 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10005860 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2015d100 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.986+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1002c760 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.987+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2013dc10 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.987+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20074290 con 0x7fab08003b30 2023-11-04T01:39:16.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.988+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab1002c8c0 con 0x7fab08003b30 2023-11-04T01:39:16.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.988+0000 7fab077fe640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 0x7fab0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.988+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fab100aacb0 con 0x7fab08003b30 2023-11-04T01:39:16.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.988+0000 7fab1e7fc640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 0x7fab0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.989+0000 7fab1e7fc640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 0x7fab0c06d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab14000fd0 tx=0x7fab14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:16.992+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab10075870 con 0x7fab08003b30 2023-11-04T01:39:17.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.226+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fab20074290 con 0x7fab08003b30 2023-11-04T01:39:17.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.231+0000 7fab077fe640 1 -- 172.21.15.93:0/618130555 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fab10044070 con 0x7fab08003b30 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC9n0Vlf1HjMRAAucyI2A788waV2wO91ZrnxA== 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow" 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow r" 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:17.233 INFO:teuthology.orchestra.run.smithi093.stderr:updated caps for client.0 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 msgr2=0x7fab0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 0x7fab0c06d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab14000fd0 tx=0x7fab14009040 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 msgr2=0x7fab2013d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fab10005040 tx=0x7fab10001650 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 shutdown_connections 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fab0c06ae70 0x7fab0c06d330 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fab2015c0d0 0x7fab2015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fab200c37d0 0x7fab200c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 --2- 172.21.15.93:0/618130555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab08003b30 0x7fab2013d6d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 >> 172.21.15.93:0/618130555 conn(0x7fab200ce950 msgr2=0x7fab20154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 shutdown_connections 2023-11-04T01:39:17.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.233+0000 7fab25464640 1 -- 172.21.15.93:0/618130555 wait complete. 2023-11-04T01:39:17.245 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.344+0000 7f65933a5640 1 Processor -- start 2023-11-04T01:39:17.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.344+0000 7f65933a5640 1 -- start start 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f65933a5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 0x7f658c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f65933a5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f658c06db20 0x7f658c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f65933a5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c0b4110 con 0x7f658c0b0910 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f65933a5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0b49b0 con 0x7f658c06db20 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f65933a5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0b0da0 con 0x7f658c159c70 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6591942640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f658c0b0910 0x7f658c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39614/0 (socket says 172.21.15.93:39614) 2023-11-04T01:39:17.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6591942640 1 -- 172.21.15.93:0/1409430480 learned_addr learned my addr 172.21.15.93:0/1409430480 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6590940640 1 --2- 172.21.15.93:0/1409430480 >> v2:172.21.15.125:3300/0 conn(0x7f658c06db20 0x7f658c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6591141640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 0x7f658c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189914105 0 0) 0x7f658c0b4110 con 0x7f658c0b0910 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.345+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6578003520 con 0x7f658c0b0910 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2444148419 0 0) 0x7f6578003520 con 0x7f658c0b0910 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6590940640 1 -- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 msgr2=0x7f658c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6590940640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 0x7f658c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6590940640 1 -- 172.21.15.93:0/1409430480 >> v1:172.21.15.93:6789/0 conn(0x7f658c0b0910 legacy=0x7f658c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6590940640 1 -- 172.21.15.93:0/1409430480 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0b43f0 con 0x7f658c06db20 2023-11-04T01:39:17.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6591141640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 0x7f658c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.346+0000 7f6590940640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c06db20 0x7f658c0b03d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8991c7575d27be73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840019f0 con 0x7f658c06db20 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c02e050 con 0x7f658c06db20 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f6583fff640 1 -- 172.21.15.93:0/1409430480 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c030730 con 0x7f658c06db20 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 -- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c06db20 msgr2=0x7f658c0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c06db20 0x7f658c0b03d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b790 comp rx=0 tx=0).stop 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 -- 172.21.15.93:0/1409430480 shutdown_connections 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c06db20 0x7f658c0b03d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 --2- 172.21.15.93:0/1409430480 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c159c70 0x7f658c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 -- 172.21.15.93:0/1409430480 >> 172.21.15.93:0/1409430480 conn(0x7f658c0ce950 msgr2=0x7f658c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 -- 172.21.15.93:0/1409430480 shutdown_connections 2023-11-04T01:39:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.347+0000 7f65933a5640 1 -- 172.21.15.93:0/1409430480 wait complete. 2023-11-04T01:39:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.348+0000 7f65933a5640 1 Processor -- start 2023-11-04T01:39:17.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.348+0000 7f65933a5640 1 -- start start 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c0b0910 0x7f658c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 0x7f658c0ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c8380 con 0x7f658c06db20 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c72e0 con 0x7f658c159c70 2023-11-04T01:39:17.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f65933a5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c75c0 con 0x7f658c0b0910 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35094/0 (socket says 172.21.15.93:35094) 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 -- 172.21.15.93:0/2472725281 learned_addr learned my addr 172.21.15.93:0/2472725281 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591942640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 0x7f658c0ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6590940640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c0b0910 0x7f658c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 -- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c0b0910 msgr2=0x7f658c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c0b0910 0x7f658c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 -- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 msgr2=0x7f658c0ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 0x7f658c0ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591141640 1 -- 172.21.15.93:0/2472725281 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009400 con 0x7f658c06db20 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.349+0000 7f6591942640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 0x7f658c0ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:17.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f6591141640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f658800ebe0 tx=0x7f658800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588009760 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800cc30 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c009400 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800eee0 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.350+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c0c7b80 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.351+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c0c8f30 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.351+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6588013470 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.352+0000 7f6581ffb640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 0x7f657006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.352+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6588089f40 con 0x7f658c06db20 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.352+0000 7f6590940640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 0x7f657006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.352+0000 7f6590940640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 0x7f657006d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.356+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65880549f0 con 0x7f658c06db20 2023-11-04T01:39:17.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.556+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f658c074290 con 0x7f658c06db20 2023-11-04T01:39:17.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.557+0000 7f6581ffb640 1 -- 172.21.15.93:0/2472725281 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f6588058010 con 0x7f658c06db20 2023-11-04T01:39:17.558 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:17.558 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:14.879010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:17.559 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 44 2023-11-04T01:39:17.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 msgr2=0x7f657006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.560 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 0x7f657006d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c02f000 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 msgr2=0x7f658c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f658800ebe0 tx=0x7f658800c520 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 shutdown_connections 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f657006ae70 0x7f657006d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f658c159c70 0x7f658c0ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f658c0b0910 0x7f658c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 --2- 172.21.15.93:0/2472725281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f658c06db20 0x7f658c0c69e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 >> 172.21.15.93:0/2472725281 conn(0x7f658c0ce950 msgr2=0x7f658c15aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 shutdown_connections 2023-11-04T01:39:17.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:17.559+0000 7f65933a5640 1 -- 172.21.15.93:0/2472725281 wait complete. 2023-11-04T01:39:17.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:39:14.879010+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7359': {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6836/2331318607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 2331318607}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 2331318607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:17.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:39:17.974 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:39:18.053 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:39:18.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:18.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.077+0000 7f03c8dee640 1 Processor -- start 2023-11-04T01:39:18.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.077+0000 7f03c8dee640 1 -- start start 2023-11-04T01:39:18.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c8dee640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03c4153e60 0x7f03c415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c8dee640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03c40cd6d0 0x7f03c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c8dee640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40cde60 con 0x7f03c40b4880 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c8dee640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c4160f90 con 0x7f03c4153e60 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c8dee640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c415e400 con 0x7f03c40cd6d0 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03c4153e60 0x7f03c415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c2d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f03c40b4880 0x7f03c406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39622/0 (socket says 172.21.15.93:39622) 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.078+0000 7f03c2d9d640 1 -- 172.21.15.93:0/844768372 learned_addr learned my addr 172.21.15.93:0/844768372 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/844768372 >> v2:172.21.15.125:3300/0 conn(0x7f03c40cd6d0 0x7f03c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c259c640 1 -- 172.21.15.93:0/844768372 >> v2:172.21.15.125:3300/0 conn(0x7f03c40cd6d0 msgr2=0x7f03c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c259c640 1 --2- 172.21.15.93:0/844768372 >> v2:172.21.15.125:3300/0 conn(0x7f03c40cd6d0 0x7f03c4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c259c640 1 -- 172.21.15.93:0/844768372 >> v1:172.21.15.93:6789/0 conn(0x7f03c40b4880 legacy=0x7f03c406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c259c640 1 -- 172.21.15.93:0/844768372 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4161960 con 0x7f03c4153e60 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c159a640 1 -- 172.21.15.93:0/844768372 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214903705 0 0) 0x7f03c40cde60 con 0x7f03c40b4880 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.079+0000 7f03c259c640 1 --2- 172.21.15.93:0/844768372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4153e60 0x7f03c415dec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c9e80 tx=0x7f03b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba06c21b3b7236b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c159a640 1 -- 172.21.15.93:0/844768372 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4031830 con 0x7f03c4153e60 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c159a640 1 -- 172.21.15.93:0/844768372 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4031990 con 0x7f03c4153e60 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c159a640 1 -- 172.21.15.93:0/844768372 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4031d20 con 0x7f03c4153e60 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 -- 172.21.15.93:0/844768372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4153e60 msgr2=0x7f03c415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 --2- 172.21.15.93:0/844768372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4153e60 0x7f03c415dec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c9e80 tx=0x7f03b402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 -- 172.21.15.93:0/844768372 shutdown_connections 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 --2- 172.21.15.93:0/844768372 >> v2:172.21.15.125:3300/0 conn(0x7f03c40cd6d0 0x7f03c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 --2- 172.21.15.93:0/844768372 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4153e60 0x7f03c415dec0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 -- 172.21.15.93:0/844768372 >> 172.21.15.93:0/844768372 conn(0x7f03c40cf880 msgr2=0x7f03c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 -- 172.21.15.93:0/844768372 shutdown_connections 2023-11-04T01:39:18.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.080+0000 7f03c8dee640 1 -- 172.21.15.93:0/844768372 wait complete. 2023-11-04T01:39:18.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.081+0000 7f03c8dee640 1 Processor -- start 2023-11-04T01:39:18.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 -- start start 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03c40cd6d0 0x7f03c415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 0x7f03c415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c41f5b30 con 0x7f03c40b4880 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c41f32c0 con 0x7f03c4153e60 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c8dee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c41f5d40 con 0x7f03c40cd6d0 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35118/0 (socket says 172.21.15.93:35118) 2023-11-04T01:39:18.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c259c640 1 -- 172.21.15.93:0/3169564139 learned_addr learned my addr 172.21.15.93:0/3169564139 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.082+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 0x7f03c415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03c40cd6d0 0x7f03c415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 -- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03c40cd6d0 msgr2=0x7f03c415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03c40cd6d0 0x7f03c415ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 -- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 msgr2=0x7f03c415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 0x7f03c415ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 -- 172.21.15.93:0/3169564139 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009400 con 0x7f03c40b4880 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 0x7f03c415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c259c640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f03b4000c00 tx=0x7f03b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03b2ffd640 1 -- 172.21.15.93:0/3169564139 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b403aa60 con 0x7f03c40b4880 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03b2ffd640 1 -- 172.21.15.93:0/3169564139 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b403abe0 con 0x7f03c40b4880 2023-11-04T01:39:18.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c41f6020 con 0x7f03c40b4880 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03b2ffd640 1 -- 172.21.15.93:0/3169564139 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40443f0 con 0x7f03c40b4880 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.083+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4150580 con 0x7f03c40b4880 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.084+0000 7f03b2ffd640 1 -- 172.21.15.93:0/3169564139 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03b404d450 con 0x7f03c40b4880 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.085+0000 7f03b2ffd640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 0x7f03a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.085+0000 7f03b2ffd640 1 -- 172.21.15.93:0/3169564139 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f03b40abc10 con 0x7f03c40b4880 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.085+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 0x7f03a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.085+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 0x7f03a406d360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f03c40cc730 tx=0x7f03b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.086+0000 7f03cb978740 1 Processor -- start 2023-11-04T01:39:18.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.086+0000 7f03cb978740 1 -- start start 2023-11-04T01:39:18.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d556750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d5865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d467740 con 0x56032d556c90 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d4c98d0 con 0x56032d583850 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032d4c6fc0 con 0x56032d583c30 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35130/0 (socket says 172.21.15.93:35130) 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 -- 172.21.15.93:0/1075202936 learned_addr learned my addr 172.21.15.93:0/1075202936 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c259c640 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d556750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d5865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 -- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 msgr2=0x56032d5865e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d5865e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 -- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 msgr2=0x56032d556750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d556750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 -- 172.21.15.93:0/1075202936 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56032d485ca0 con 0x56032d556c90 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007390 tx=0x7f03bc007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24aec7040a85c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03a3fff640 1 -- 172.21.15.93:0/1075202936 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc001e20 con 0x56032d556c90 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03a3fff640 1 -- 172.21.15.93:0/1075202936 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc001f80 con 0x56032d556c90 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.087+0000 7f03a3fff640 1 -- 172.21.15.93:0/1075202936 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0114e0 con 0x56032d556c90 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 -- 172.21.15.93:0/1075202936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 msgr2=0x56032d586b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007390 tx=0x7f03bc007850 comp rx=0 tx=0).stop 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 -- 172.21.15.93:0/1075202936 shutdown_connections 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d556c90 0x56032d586b20 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d5865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 --2- 172.21.15.93:0/1075202936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d556750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 -- 172.21.15.93:0/1075202936 >> 172.21.15.93:0/1075202936 conn(0x56032d558a60 msgr2=0x56032d5a15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 -- 172.21.15.93:0/1075202936 shutdown_connections 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.088+0000 7f03cb978740 1 -- 172.21.15.93:0/1075202936 wait complete. 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.089+0000 7f03cb978740 1 -- start start 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.089+0000 7f03cb978740 1 Processor -- start 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d57e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d57c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d4c28b0 con 0x56032d57ec20 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d47cc80 con 0x56032d583850 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032d47c920 con 0x56032d583c30 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 10 client.0 _ll_register_callbacks cb 0x56032d1d4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35140/0 (socket says 172.21.15.93:35140) 2023-11-04T01:39:18.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 -- 172.21.15.93:0/4005548093 learned_addr learned my addr 172.21.15.93:0/4005548093 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 -- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 msgr2=0x56032d57c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d57c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 -- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 msgr2=0x56032d57e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d57e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 -- 172.21.15.93:0/4005548093 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc00f040 con 0x56032d57ec20 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007890 tx=0x7f03bc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b624973c5ffa7503 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc001e20 con 0x56032d57ec20 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56032d46ebf0 con 0x56032d57ec20 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.090+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f03bc0159c0 con 0x56032d57ec20 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03bc0020f0 con 0x56032d57ec20 2023-11-04T01:39:18.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 10 client.7524 fetch_fsmap learned FSMap version 44 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x56032d4c0f30 con 0x56032d57ec20 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56032d46ebf0 con 0x56032d57ec20 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f03bc024020 con 0x56032d57ec20 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 10 client.7524 fetch_fsmap finished waiting for FSMap version 44 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 10 client.7524 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 20 client.7524 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5850a0 0x56032d585480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 4 client.7524 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 --> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56032d4bb890 con 0x56032d5850a0 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03c259c640 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5850a0 0x56032d585480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03a17fa640 10 client.7524 ms_handle_connect on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:18.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.091+0000 7f03c259c640 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5850a0 0x56032d585480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79e1b4cf3ac637bf server_cookie=39fda5778efeb9d3 in_seq=0 out_seq=0 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03a17fa640 1 -- 172.21.15.93:0/4005548093 <== mds.0 v2:172.21.15.93:6834/2331318607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56032d4bb890 con 0x56032d5850a0 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03a17fa640 10 client.7524 handle_command_reply: tid=0 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 client.7524 shutdown 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 msgr2=0x56032d57c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f03bc007890 tx=0x7f03bc001250 comp rx=0 tx=0).stop 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 shutdown_connections 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57c9e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5850a0 0x56032d585480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d57c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 --2- 172.21.15.93:0/4005548093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d57e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03a17fa640 0 client.7524 ms_handle_reset on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 >> 172.21.15.93:0/4005548093 conn(0x56032d556c90 msgr2=0x56032d5554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 shutdown_connections 2023-11-04T01:39:18.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 1 -- 172.21.15.93:0/4005548093 wait complete. 2023-11-04T01:39:18.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.092+0000 7f03cb978740 20 client.7524 trim_cache size 0 max 16384 2023-11-04T01:39:18.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.107+0000 7f03cb978740 1 Processor -- start 2023-11-04T01:39:18.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.107+0000 7f03cb978740 1 -- start start 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d442280 con 0x56032d57ec20 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d4c1a50 con 0x56032d583850 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032d557240 con 0x56032d583c30 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35154/0 (socket says 172.21.15.93:35154) 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 -- 172.21.15.93:0/3224490309 learned_addr learned my addr 172.21.15.93:0/3224490309 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 -- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 msgr2=0x56032d589f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 -- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 msgr2=0x56032d589a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.108+0000 7f03c259c640 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03c259c640 1 -- 172.21.15.93:0/3224490309 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56032d45ed10 con 0x56032d57ec20 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03c259c640 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f03b4031960 tx=0x7f03b40a9b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bffcd853e2ea87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03b0ff9640 1 -- 172.21.15.93:0/3224490309 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40828b0 con 0x56032d57ec20 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03b0ff9640 1 -- 172.21.15.93:0/3224490309 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b40786f0 con 0x56032d57ec20 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03b0ff9640 1 -- 172.21.15.93:0/3224490309 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4076cc0 con 0x56032d57ec20 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 -- 172.21.15.93:0/3224490309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 msgr2=0x56032d57b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f03b4031960 tx=0x7f03b40a9b20 comp rx=0 tx=0).stop 2023-11-04T01:39:18.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 -- 172.21.15.93:0/3224490309 shutdown_connections 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 --2- 172.21.15.93:0/3224490309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d57ec20 0x56032d57b950 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 -- 172.21.15.93:0/3224490309 >> 172.21.15.93:0/3224490309 conn(0x56032d556c90 msgr2=0x56032d5577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 -- 172.21.15.93:0/3224490309 shutdown_connections 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.109+0000 7f03cb978740 1 -- 172.21.15.93:0/3224490309 wait complete. 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.110+0000 7f03cb978740 1 -- start start 2023-11-04T01:39:18.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.110+0000 7f03cb978740 1 Processor -- start 2023-11-04T01:39:18.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d57ec20 0x56032d579e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d5afd70 con 0x56032d583850 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56032d57b090 con 0x56032d57ec20 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56032d60c7e0 con 0x56032d583c30 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03cb978740 10 client.0 _ll_register_callbacks cb 0x7f03bc005cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35158/0 (socket says 172.21.15.93:35158) 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 -- 172.21.15.93:0/576025421 learned_addr learned my addr 172.21.15.93:0/576025421 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c259c640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d57ec20 0x56032d579e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c2d9d640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 -- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 msgr2=0x56032d589f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 -- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d57ec20 msgr2=0x56032d579e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d57ec20 0x56032d579e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 -- 172.21.15.93:0/576025421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4150580 con 0x56032d583850 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03c1d9b640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x56032d584590 tx=0x7f03b8014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ac41c23f72f796 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.111+0000 7f03a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8020610 con 0x56032d583850 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f03b8020770 con 0x56032d583850 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03bc001f80 con 0x56032d583850 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03b8020930 con 0x56032d583850 2023-11-04T01:39:18.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 10 client.7530 fetch_fsmap learned FSMap version 44 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x56032d484500 con 0x56032d583850 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc001f80 con 0x56032d583850 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f03b8020a90 con 0x56032d583850 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 10 client.7530 fetch_fsmap finished waiting for FSMap version 44 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 10 client.7530 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 20 client.7530 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5b0530 0x56032d5b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 4 client.7530 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 --> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56032d4bb5b0 con 0x56032d5b0530 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03c259c640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5b0530 0x56032d5b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03a17fa640 10 client.7530 ms_handle_connect on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.112+0000 7f03c259c640 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5b0530 0x56032d5b0910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea70263528102f3 server_cookie=f8232c2939c7d129 in_seq=0 out_seq=0 2023-11-04T01:39:18.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03a17fa640 1 -- 172.21.15.93:0/576025421 <== mds.0 v2:172.21.15.93:6834/2331318607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56032d4bb5b0 con 0x56032d5b0530 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03a17fa640 10 client.7530 handle_command_reply: tid=0 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 client.7530 shutdown 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 msgr2=0x56032d589a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x56032d584590 tx=0x7f03b8014830 comp rx=0 tx=0).stop 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 shutdown_connections 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x56032d5b0530 0x56032d5b0910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56032d583c30 0x56032d589f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03a17fa640 0 client.7530 ms_handle_reset on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56032d583850 0x56032d589a10 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 --2- 172.21.15.93:0/576025421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56032d57ec20 0x56032d579e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 >> 172.21.15.93:0/576025421 conn(0x56032d556c90 msgr2=0x56032d56a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 shutdown_connections 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 1 -- 172.21.15.93:0/576025421 wait complete. 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03cb978740 20 client.7530 trim_cache size 0 max 16384 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7359, 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 4.5692742510000004, 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 44, 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 95, 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 10.664614855 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 msgr2=0x7f03a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 0x7f03a406d360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f03c40cc730 tx=0x7f03b8008040 comp rx=0 tx=0).stop 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 msgr2=0x7f03c4150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f03b4000c00 tx=0x7f03b40046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 shutdown_connections 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a406aea0 0x7f03a406d360 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03c4153e60 0x7f03c415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03c40cd6d0 0x7f03c415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 --2- 172.21.15.93:0/3169564139 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c40b4880 0x7f03c4150040 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 >> 172.21.15.93:0/3169564139 conn(0x7f03c40cf880 msgr2=0x7f03c40b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 shutdown_connections 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.113+0000 7f03c8dee640 1 -- 172.21.15.93:0/3169564139 wait complete. 2023-11-04T01:39:18.125 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:39:18.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.223+0000 7f8bf761a640 1 Processor -- start 2023-11-04T01:39:18.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.223+0000 7f8bf761a640 1 -- start start 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf761a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bf00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf761a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf015bc30 con 0x7f8bf00ca280 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf761a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf015bf10 con 0x7f8bf006ce00 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf761a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00c9540 con 0x7f8bf015aa30 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf4bb5640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8bf00ca280 0x7f8bf006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39636/0 (socket says 172.21.15.93:39636) 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf4bb5640 1 -- 172.21.15.93:0/1904805919 learned_addr learned my addr 172.21.15.93:0/1904805919 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bf00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859313265 0 0) 0x7f8bf015bc30 con 0x7f8bf00ca280 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bdc003520 con 0x7f8bf00ca280 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650262020 0 0) 0x7f8bdc003520 con 0x7f8bf00ca280 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 msgr2=0x7f8bf00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bf00c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 >> v1:172.21.15.125:6789/0 conn(0x7f8bf006ce00 legacy=0x7f8bf00b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00c9820 con 0x7f8bf00ca280 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8be0001670 con 0x7f8bf00ca280 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.224+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 >> v1:172.21.15.93:6789/0 conn(0x7f8bf00ca280 legacy=0x7f8bf006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bdc0039a0 0x7f8bdc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bdc004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bdc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00c9540 con 0x7f8bdc004350 2023-11-04T01:39:18.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc00b980 con 0x7f8bdc0039a0 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc00bb40 con 0x7f8bf015aa30 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bdc004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bdc0039a0 0x7f8bdc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf5bb7640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bdc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 -- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 msgr2=0x7f8bdc005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf015aa30 0x7f8bdc005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 -- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bdc0039a0 msgr2=0x7f8bdc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bdc0039a0 0x7f8bdc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf4bb5640 1 -- 172.21.15.93:0/1904805919 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc003520 con 0x7f8bdc004350 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.225+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bdc0039a0 0x7f8bdc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bdc004820 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c210 tx=0x7f8bdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed874f24e6b9f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0005ad0 con 0x7f8bdc004350 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0005c50 con 0x7f8bdc004350 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8be7fff640 1 -- 172.21.15.93:0/1904805919 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be002c8d0 con 0x7f8bdc004350 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 -- 172.21.15.93:0/1904805919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 msgr2=0x7f8bdc004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 --2- 172.21.15.93:0/1904805919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bdc004820 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c210 tx=0x7f8bdc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf5bb7640 1 -- 172.21.15.93:0/1904805919 reap_dead start 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 -- 172.21.15.93:0/1904805919 shutdown_connections 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 -- 172.21.15.93:0/1904805919 >> 172.21.15.93:0/1904805919 conn(0x7f8bf00cb7f0 msgr2=0x7f8bf00cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 -- 172.21.15.93:0/1904805919 shutdown_connections 2023-11-04T01:39:18.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.226+0000 7f8bf761a640 1 -- 172.21.15.93:0/1904805919 wait complete. 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.227+0000 7f8bf761a640 1 Processor -- start 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 -- start start 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 0x7f8bf0153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf00acd40 0x7f8bf00b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01540a0 con 0x7f8bdc004350 2023-11-04T01:39:18.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01f2630 con 0x7f8bf0151da0 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf761a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0152230 con 0x7f8bf00acd40 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf53b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf53b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35180/0 (socket says 172.21.15.93:35180) 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.228+0000 7f8bf53b6640 1 -- 172.21.15.93:0/3594192843 learned_addr learned my addr 172.21.15.93:0/3594192843 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 0x7f8bf0153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 -- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf00acd40 msgr2=0x7f8bf00b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf5bb7640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf00acd40 0x7f8bf00b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf00acd40 0x7f8bf00b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 -- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 msgr2=0x7f8bf0153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 0x7f8bf0153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 -- 172.21.15.93:0/3594192843 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0152510 con 0x7f8bdc004350 2023-11-04T01:39:18.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 0x7f8bf0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf53b6640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8bec011650 tx=0x7f8bec011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00f9c0 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec00fb20 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf01527f0 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00fed0 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.229+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf01537c0 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.230+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf0074290 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.230+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8bec015460 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.231+0000 7f8be5ffb640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 0x7f8bd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.231+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8bec08a3d0 con 0x7f8bdc004350 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.231+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 0x7f8bd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.231+0000 7f8bf4bb5640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 0x7f8bd406d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c210 tx=0x7f8be0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.235+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8bec055040 con 0x7f8bdc004350 2023-11-04T01:39:18.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.437+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8bf00b1b20 con 0x7f8bdc004350 2023-11-04T01:39:18.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.438+0000 7f8be5ffb640 1 -- 172.21.15.93:0/3594192843 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8bec058660 con 0x7f8bdc004350 2023-11-04T01:39:18.439 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:39:18.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 msgr2=0x7f8bd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 0x7f8bd406d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c210 tx=0x7f8be0009030 comp rx=0 tx=0).stop 2023-11-04T01:39:18.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 msgr2=0x7f8bf0149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8bec011650 tx=0x7f8bec011b10 comp rx=0 tx=0).stop 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 shutdown_connections 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8bd406ae70 0x7f8bd406d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8bf00acd40 0x7f8bf00b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf0151da0 0x7f8bf0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 --2- 172.21.15.93:0/3594192843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8bdc004350 0x7f8bf0149240 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 >> 172.21.15.93:0/3594192843 conn(0x7f8bf00cb7f0 msgr2=0x7f8bf015d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 shutdown_connections 2023-11-04T01:39:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:18.440+0000 7f8bf761a640 1 -- 172.21.15.93:0/3594192843 wait complete. 2023-11-04T01:39:18.451 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:39:18.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:39:18.452 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:18.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.452 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:18.467 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41642sec preferred_lft 41642sec 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.468 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:18.469 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:18.470 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:39:18.470 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.470 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:39:18.532 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:39:18.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.535 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:39:18.591 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:39:18.591 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:39:18.591 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:39:18.591 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:39:18.591 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:39:18.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:39:18.592 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:39:18.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.687 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:39:18.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:39:18.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:39:18.701 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:18.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:39:18.768 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:39:18.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:18.768 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:18.823 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:18.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:18.823 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:18.877 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:18.933 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:39:18.933 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:39:18.934 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:39:18.935 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:18.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:18.937 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:39:18.988 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:39:18.988 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:39:19.030 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:19.045 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:39:19.045 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:39:19.045 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:39:19.046 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:19.047 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:19.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:19.048 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:39:19.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:39:19.119+0000 7f7905493480 -1 init, newargv = 0x560993dd19e0 newargc=15 2023-11-04T01:39:19.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[148217]: starting ceph client 2023-11-04T01:39:19.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[148217]: starting fuse 2023-11-04T01:39:20.202 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:20.222 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:39:20.222 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:39:20.222 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:39:20.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:20.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:20.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:20.225 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:39:20.281 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:39:20.281 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:39:20.282 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:39:20.283 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:39:20.284 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:39:20.284 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:39:20.284 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:39:20.284 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:39:20.415 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.148217.asok 2023-11-04T01:39:20.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:20.426 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.148217.asok 2023-11-04T01:39:20.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:20.427 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.148217.asok status 2023-11-04T01:39:20.529 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:20.601 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:39:20.601 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "148217", 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:39:20.602 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7542, 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 7542 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3671080369 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:39:20.603 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3671080369 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.7542 192.168.0.1:0/3671080369", 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/3671080369", 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 44, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 95, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:39:20.604 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:39:20.605 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:39:20.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:20.616 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:20.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:39:20.616 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:20.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:20.675 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:39:20.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:20.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:20.682 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:20.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:20.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:20.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:20.751 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:39:20.862 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:39:20.862 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:39:20.862 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:39:20.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.964+0000 7f9b633a9640 1 Processor -- start 2023-11-04T01:39:20.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.964+0000 7f9b633a9640 1 -- start start 2023-11-04T01:39:20.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b633a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b5c151ea0 0x7f9b5c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b633a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9b5c06dd50 0x7f9b5c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b633a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c06cf90 con 0x7f9b5c15f510 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b633a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c06d270 con 0x7f9b5c06dd50 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b633a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c06d550 con 0x7f9b5c151ea0 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9b5c06dd50 0x7f9b5c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9b5c06dd50 0x7f9b5c0c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35186/0 (socket says 172.21.15.93:35186) 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 -- 172.21.15.93:0/3720738066 learned_addr learned my addr 172.21.15.93:0/3720738066 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61145640 1 --2- 172.21.15.93:0/3720738066 >> v2:172.21.15.125:3300/0 conn(0x7f9b5c151ea0 0x7f9b5c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 -- 172.21.15.93:0/3720738066 >> v2:172.21.15.125:3300/0 conn(0x7f9b5c151ea0 msgr2=0x7f9b5c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 --2- 172.21.15.93:0/3720738066 >> v2:172.21.15.125:3300/0 conn(0x7f9b5c151ea0 0x7f9b5c15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 -- 172.21.15.93:0/3720738066 >> v1:172.21.15.125:6789/0 conn(0x7f9b5c15f510 legacy=0x7f9b5c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.965+0000 7f9b61946640 1 -- 172.21.15.93:0/3720738066 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c06d830 con 0x7f9b5c06dd50 2023-11-04T01:39:20.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.966+0000 7f9b61946640 1 --2- 172.21.15.93:0/3720738066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c0c9010 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cfac0 tx=0x7f9b5402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ba65ed920dd172 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.966+0000 7f9b53fff640 1 -- 172.21.15.93:0/3720738066 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5402ca80 con 0x7f9b5c06dd50 2023-11-04T01:39:20.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.966+0000 7f9b53fff640 1 -- 172.21.15.93:0/3720738066 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5402cbe0 con 0x7f9b5c06dd50 2023-11-04T01:39:20.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.966+0000 7f9b53fff640 1 -- 172.21.15.93:0/3720738066 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540343f0 con 0x7f9b5c06dd50 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 -- 172.21.15.93:0/3720738066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c06dd50 msgr2=0x7f9b5c0c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3720738066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c0c9010 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cfac0 tx=0x7f9b5402bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 -- 172.21.15.93:0/3720738066 shutdown_connections 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3720738066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c0c9010 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3720738066 >> v2:172.21.15.125:3300/0 conn(0x7f9b5c151ea0 0x7f9b5c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 -- 172.21.15.93:0/3720738066 >> 172.21.15.93:0/3720738066 conn(0x7f9b5c0b05d0 msgr2=0x7f9b5c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 -- 172.21.15.93:0/3720738066 shutdown_connections 2023-11-04T01:39:20.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.967+0000 7f9b633a9640 1 -- 172.21.15.93:0/3720738066 wait complete. 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.968+0000 7f9b633a9640 1 Processor -- start 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.968+0000 7f9b633a9640 1 -- start start 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 0x7f9b5c1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b48f0 con 0x7f9b5c15f510 2023-11-04T01:39:20.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1554b0 con 0x7f9b5c06dd50 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b3d70 con 0x7f9b5c151ea0 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35202/0 (socket says 172.21.15.93:35202) 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 -- 172.21.15.93:0/3928123353 learned_addr learned my addr 172.21.15.93:0/3928123353 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61145640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b60944640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 0x7f9b5c1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 -- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 msgr2=0x7f9b5c1f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 0x7f9b5c1f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 -- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b5c06dd50 msgr2=0x7f9b5c154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 -- 172.21.15.93:0/3928123353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009b30 con 0x7f9b5c15f510 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b60944640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 0x7f9b5c1f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b61946640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9b54036040 tx=0x7f9b54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54009510 con 0x7f9b5c15f510 2023-11-04T01:39:20.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5403e450 con 0x7f9b5c15f510 2023-11-04T01:39:20.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c0b4050 con 0x7f9b5c15f510 2023-11-04T01:39:20.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5403e7e0 con 0x7f9b5c15f510 2023-11-04T01:39:20.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.969+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c0b4610 con 0x7f9b5c15f510 2023-11-04T01:39:20.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.970+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0c6b90 con 0x7f9b5c15f510 2023-11-04T01:39:20.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.971+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b5402cd50 con 0x7f9b5c15f510 2023-11-04T01:39:20.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.971+0000 7f9b51ffb640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 0x7f9b4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.971+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f9b540ac6f0 con 0x7f9b5c15f510 2023-11-04T01:39:20.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.971+0000 7f9b61145640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 0x7f9b4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.972+0000 7f9b61145640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 0x7f9b4006d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9b58006fd0 tx=0x7f9b58008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:20.975+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b54077220 con 0x7f9b5c15f510 2023-11-04T01:39:21.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.175+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9b5c04e490 con 0x7f9b5c15f510 2023-11-04T01:39:21.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.250+0000 7f9b51ffb640 1 -- 172.21.15.93:0/3928123353 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v45) v1 ==== 167+0+0 (secure 0 0 0) 0x7f9b5403e940 con 0x7f9b5c15f510 2023-11-04T01:39:21.251 INFO:teuthology.orchestra.run.smithi093.stderr:enabled new snapshots 2023-11-04T01:39:21.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 msgr2=0x7f9b4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 0x7f9b4006d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9b58006fd0 tx=0x7f9b58008040 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 msgr2=0x7f9b5c153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9b54036040 tx=0x7f9b54004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 shutdown_connections 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9b4006ae70 0x7f9b4006d330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b5c15f510 0x7f9b5c153990 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9b5c151ea0 0x7f9b5c1f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 --2- 172.21.15.93:0/3928123353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b5c06dd50 0x7f9b5c154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 >> 172.21.15.93:0/3928123353 conn(0x7f9b5c0b05d0 msgr2=0x7f9b5c0c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 shutdown_connections 2023-11-04T01:39:21.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.252+0000 7f9b633a9640 1 -- 172.21.15.93:0/3928123353 wait complete. 2023-11-04T01:39:21.264 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.364+0000 7f68e11d7640 1 Processor -- start 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.364+0000 7f68e11d7640 1 -- start start 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68e11d7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f68dc070e20 0x7f68dc1658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68e11d7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc155790 con 0x7f68dc0ade40 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68e11d7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc15c240 con 0x7f68dc1553b0 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68e11d7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68dc0c3870 con 0x7f68dc070e20 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68da59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f68dc0ade40 0x7f68dc070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39650/0 (socket says 172.21.15.93:39650) 2023-11-04T01:39:21.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.365+0000 7f68da59c640 1 -- 172.21.15.93:0/1929802333 learned_addr learned my addr 172.21.15.93:0/1929802333 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309562148 0 0) 0x7f68dc155790 con 0x7f68dc0ade40 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c4003520 con 0x7f68dc0ade40 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68db59e640 1 --2- 172.21.15.93:0/1929802333 >> v2:172.21.15.125:3300/0 conn(0x7f68dc070e20 0x7f68dc1658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3468322705 0 0) 0x7f68c4003520 con 0x7f68dc0ade40 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 >> v2:172.21.15.125:3300/0 conn(0x7f68dc070e20 msgr2=0x7f68dc1658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 --2- 172.21.15.93:0/1929802333 >> v2:172.21.15.125:3300/0 conn(0x7f68dc070e20 0x7f68dc1658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 >> v1:172.21.15.125:6789/0 conn(0x7f68dc1553b0 legacy=0x7f68dc0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0c3b50 con 0x7f68dc0ade40 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f68d0001690 con 0x7f68dc0ade40 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 >> v1:172.21.15.93:6789/0 conn(0x7f68dc0ade40 legacy=0x7f68dc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68c4003970 0x7f68c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68c4005180 0x7f68c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0c3870 con 0x7f68c40047c0 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c400c120 con 0x7f68c4003970 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c400c2e0 con 0x7f68c4005180 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68dad9d640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68c4003970 0x7f68c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68db59e640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68c4005180 0x7f68c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 -- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68c4005180 msgr2=0x7f68c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68c4005180 0x7f68c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 -- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68c4003970 msgr2=0x7f68c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68c4003970 0x7f68c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68da59c640 1 -- 172.21.15.93:0/1929802333 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c4003520 con 0x7f68c40047c0 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.366+0000 7f68db59e640 1 -- 172.21.15.93:0/1929802333 reap_dead start 2023-11-04T01:39:21.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.367+0000 7f68da59c640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68c4004c40 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f68dc155920 tx=0x7f68c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c470d7d6872739e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.367+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0005ad0 con 0x7f68c40047c0 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.367+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0005c30 con 0x7f68c40047c0 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.367+0000 7f68d9d9b640 1 -- 172.21.15.93:0/1929802333 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d002ca30 con 0x7f68c40047c0 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 -- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 msgr2=0x7f68c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68c4004c40 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f68dc155920 tx=0x7f68c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 -- 172.21.15.93:0/1929802333 shutdown_connections 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 --2- 172.21.15.93:0/1929802333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68c4004c40 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 -- 172.21.15.93:0/1929802333 >> 172.21.15.93:0/1929802333 conn(0x7f68dc0ce950 msgr2=0x7f68dc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 -- 172.21.15.93:0/1929802333 shutdown_connections 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.368+0000 7f68e11d7640 1 -- 172.21.15.93:0/1929802333 wait complete. 2023-11-04T01:39:21.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.369+0000 7f68e11d7640 1 Processor -- start 2023-11-04T01:39:21.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.369+0000 7f68e11d7640 1 -- start start 2023-11-04T01:39:21.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc151e90 0x7f68dc0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc0c73f0 0x7f68dc0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0c7de0 con 0x7f68c40047c0 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc0ca990 con 0x7f68dc151e90 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68e11d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc145ab0 con 0x7f68dc0c73f0 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35220/0 (socket says 172.21.15.93:35220) 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 -- 172.21.15.93:0/140788753 learned_addr learned my addr 172.21.15.93:0/140788753 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68db59e640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc0c73f0 0x7f68dc0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68da59c640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc151e90 0x7f68dc0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 -- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc0c73f0 msgr2=0x7f68dc0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc0c73f0 0x7f68dc0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 -- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc151e90 msgr2=0x7f68dc0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc151e90 0x7f68dc0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.370+0000 7f68dad9d640 1 -- 172.21.15.93:0/140788753 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0c9e10 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68dad9d640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00f960 tx=0x7f68cc00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc003b80 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc003ce0 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc0ca0f0 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00da10 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.371+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc0ca6b0 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.372+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc074290 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.372+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68cc00db70 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.373+0000 7f68c37fe640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 0x7f68c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.373+0000 7f68da59c640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 0x7f68c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.373+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f68cc089c60 con 0x7f68c40047c0 2023-11-04T01:39:21.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.373+0000 7f68da59c640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 0x7f68c806d360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68d0034000 tx=0x7f68d0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.377+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68cc054820 con 0x7f68c40047c0 2023-11-04T01:39:21.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:21.581+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f68dc14eeb0 con 0x7f68c40047c0 2023-11-04T01:39:21.708 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:21.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:22.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.043+0000 7f68c37fe640 1 -- 172.21.15.93:0/140788753 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v46) v1 ==== 105+0+0 (secure 0 0 0) 0x7f68cc057e40 con 0x7f68c40047c0 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 msgr2=0x7f68c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 0x7f68c806d360 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68d0034000 tx=0x7f68d0009030 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 msgr2=0x7f68dc145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00f960 tx=0x7f68cc00fe20 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 shutdown_connections 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f68c806aea0 0x7f68c806d360 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f68dc0c73f0 0x7f68dc0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68dc151e90 0x7f68dc0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 --2- 172.21.15.93:0/140788753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68c40047c0 0x7f68dc145570 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 >> 172.21.15.93:0/140788753 conn(0x7f68dc0ce950 msgr2=0x7f68dc0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 shutdown_connections 2023-11-04T01:39:22.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.045+0000 7f68e11d7640 1 -- 172.21.15.93:0/140788753 wait complete. 2023-11-04T01:39:22.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:22.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.160+0000 7f6f418d7640 1 Processor -- start 2023-11-04T01:39:22.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.160+0000 7f6f418d7640 1 -- start start 2023-11-04T01:39:22.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f418d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 0x7f6f3c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f418d7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15e000 con 0x7f6f3c0cde60 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f418d7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15e2e0 con 0x7f6f3c157540 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f418d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15e5c0 con 0x7f6f3c0ce240 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6f3c0cde60 0x7f6f3c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41916/0 (socket says 172.21.15.93:41916) 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3affd640 1 -- 172.21.15.93:0/3505603275 learned_addr learned my addr 172.21.15.93:0/3505603275 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f33fff640 1 --2- 172.21.15.93:0/3505603275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 0x7f6f3c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294997611 0 0) 0x7f6f3c15e000 con 0x7f6f3c0cde60 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f28003520 con 0x7f6f3c0cde60 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442339509 0 0) 0x7f6f3c15e2e0 con 0x7f6f3c157540 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3c15e000 con 0x7f6f3c157540 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f33fff640 1 -- 172.21.15.93:0/3505603275 >> v1:172.21.15.125:6789/0 conn(0x7f6f3c157540 legacy=0x7f6f3c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f33fff640 1 -- 172.21.15.93:0/3505603275 >> v1:172.21.15.93:6789/0 conn(0x7f6f3c0cde60 legacy=0x7f6f3c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.161+0000 7f6f33fff640 1 -- 172.21.15.93:0/3505603275 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0d1120 con 0x7f6f3c0ce240 2023-11-04T01:39:22.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.162+0000 7f6f33fff640 1 --2- 172.21.15.93:0/3505603275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 0x7f6f3c157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f240097d0 tx=0x7f6f2402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d35ea1e086ff71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.162+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24031890 con 0x7f6f3c0ce240 2023-11-04T01:39:22.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.162+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f240319f0 con 0x7f6f3c0ce240 2023-11-04T01:39:22.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.162+0000 7f6f3a7fc640 1 -- 172.21.15.93:0/3505603275 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24031d60 con 0x7f6f3c0ce240 2023-11-04T01:39:22.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 -- 172.21.15.93:0/3505603275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 msgr2=0x7f6f3c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 --2- 172.21.15.93:0/3505603275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 0x7f6f3c157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f240097d0 tx=0x7f6f2402b930 comp rx=0 tx=0).stop 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 -- 172.21.15.93:0/3505603275 shutdown_connections 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 --2- 172.21.15.93:0/3505603275 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c0ce240 0x7f6f3c157000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 -- 172.21.15.93:0/3505603275 >> 172.21.15.93:0/3505603275 conn(0x7f6f3c071f30 msgr2=0x7f6f3c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 -- 172.21.15.93:0/3505603275 shutdown_connections 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.163+0000 7f6f418d7640 1 -- 172.21.15.93:0/3505603275 wait complete. 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.164+0000 7f6f418d7640 1 Processor -- start 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.164+0000 7f6f418d7640 1 -- start start 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 0x7f6f3c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 0x7f6f3c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1f2810 con 0x7f6f3c0cde60 2023-11-04T01:39:22.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c7fb0 con 0x7f6f3c0ce240 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c8290 con 0x7f6f3c157540 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58730/0 (socket says 172.21.15.93:58730) 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 -- 172.21.15.93:0/1680792778 learned_addr learned my addr 172.21.15.93:0/1680792778 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3b7fe640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 0x7f6f3c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f33fff640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 0x7f6f3c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 -- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 msgr2=0x7f6f3c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 0x7f6f3c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 -- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 msgr2=0x7f6f3c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 0x7f6f3c0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 -- 172.21.15.93:0/1680792778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009400 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f33fff640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 0x7f6f3c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3b7fe640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 0x7f6f3c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f3affd640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c4d0 tx=0x7f6f2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c005ce0 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c005e40 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c0c8570 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c007270 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.165+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c0c8b30 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.166+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c1579b0 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.167+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f2c0073d0 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.167+0000 7f6f38ff9640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 0x7f6f1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.167+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6f2c089120 con 0x7f6f3c0cde60 2023-11-04T01:39:22.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.167+0000 7f6f33fff640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 0x7f6f1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.168+0000 7f6f33fff640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 0x7f6f1c06d360 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6f24036000 tx=0x7f6f24008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.171+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f2c053c70 con 0x7f6f3c0cde60 2023-11-04T01:39:22.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.376+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f3c0c8d50 con 0x7f6f3c0cde60 2023-11-04T01:39:22.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.377+0000 7f6f38ff9640 1 -- 172.21.15.93:0/1680792778 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f6f2c017090 con 0x7f6f3c0cde60 2023-11-04T01:39:22.378 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:22.378 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.042432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:creating","state_seq":1,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:22.379 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 46 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.378+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 msgr2=0x7f6f1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 0x7f6f1c06d360 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6f24036000 tx=0x7f6f24008030 comp rx=0 tx=0).stop 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 msgr2=0x7f6f3c0b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c4d0 tx=0x7f6f2c00c990 comp rx=0 tx=0).stop 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 shutdown_connections 2023-11-04T01:39:22.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6f1c06aea0 0x7f6f1c06d360 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6f3c157540 0x7f6f3c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f3c0ce240 0x7f6f3c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 --2- 172.21.15.93:0/1680792778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f3c0cde60 0x7f6f3c0b4030 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 >> 172.21.15.93:0/1680792778 conn(0x7f6f3c071f30 msgr2=0x7f6f3c0cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 shutdown_connections 2023-11-04T01:39:22.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:22.379+0000 7f6f418d7640 1 -- 172.21.15.93:0/1680792778 wait complete. 2023-11-04T01:39:22.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:39:22.042432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7359, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7359': {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6836/2331318607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 2331318607}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 2331318607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:22.793 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5750:up:creating 2023-11-04T01:39:23.053 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:39:23.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:23.793 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:23.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.907+0000 7f9701e1a640 1 Processor -- start 2023-11-04T01:39:23.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.907+0000 7f9701e1a640 1 -- start start 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f9701e1a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f96fc0b42c0 0x7f96fc0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f9701e1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 0x7f96fc0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f9701e1a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc0ca090 con 0x7f96fc15ad80 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f9701e1a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc06cfa0 con 0x7f96fc0b42c0 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f9701e1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc06d280 con 0x7f96fc0c9c40 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fb7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f96fc15ad80 0x7f96fc06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41930/0 (socket says 172.21.15.93:41930) 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fb7fe640 1 -- 172.21.15.93:0/2087505555 learned_addr learned my addr 172.21.15.93:0/2087505555 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fbfff640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 0x7f96fc0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96faffd640 1 --2- 172.21.15.93:0/2087505555 >> v2:172.21.15.125:3300/0 conn(0x7f96fc0b42c0 0x7f96fc0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999413035 0 0) 0x7f96f0001110 con 0x7f96fc15ad80 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e4003520 con 0x7f96fc15ad80 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105668600 0 0) 0x7f96e4003520 con 0x7f96fc15ad80 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96faffd640 1 -- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 msgr2=0x7f96fc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96faffd640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 0x7f96fc0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96faffd640 1 -- 172.21.15.93:0/2087505555 >> v1:172.21.15.93:6789/0 conn(0x7f96fc15ad80 legacy=0x7f96fc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96faffd640 1 -- 172.21.15.93:0/2087505555 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc06d560 con 0x7f96fc0b42c0 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.908+0000 7f96fbfff640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 0x7f96fc0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.909+0000 7f96faffd640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc0b42c0 0x7f96fc0c9700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097a0 tx=0x7f96ec02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=436428cfbbda9bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.909+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec02f050 con 0x7f96fc0b42c0 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.909+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec031500 con 0x7f96fc0b42c0 2023-11-04T01:39:23.912 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.909+0000 7f96fa7fc640 1 -- 172.21.15.93:0/2087505555 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0001800 con 0x7f96fc0b42c0 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 -- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc0b42c0 msgr2=0x7f96fc0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc0b42c0 0x7f96fc0c9700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097a0 tx=0x7f96ec02b820 comp rx=0 tx=0).stop 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 -- 172.21.15.93:0/2087505555 shutdown_connections 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0c9c40 0x7f96fc0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2087505555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc0b42c0 0x7f96fc0c9700 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 -- 172.21.15.93:0/2087505555 >> 172.21.15.93:0/2087505555 conn(0x7f96fc0ce950 msgr2=0x7f96fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 -- 172.21.15.93:0/2087505555 shutdown_connections 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.910+0000 7f9701e1a640 1 -- 172.21.15.93:0/2087505555 wait complete. 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.911+0000 7f9701e1a640 1 Processor -- start 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 -- start start 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0b42c0 0x7f96fc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc15ad80 0x7f96fc0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15d1c0 con 0x7f96fc0c9c40 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15cc00 con 0x7f96fc15ad80 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f9701e1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15cee0 con 0x7f96fc0b42c0 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f96faffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f96faffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58744/0 (socket says 172.21.15.93:58744) 2023-11-04T01:39:23.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.912+0000 7f96faffd640 1 -- 172.21.15.93:0/2583166618 learned_addr learned my addr 172.21.15.93:0/2583166618 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96fb7fe640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0b42c0 0x7f96fc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96fbfff640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc15ad80 0x7f96fc0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 -- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0b42c0 msgr2=0x7f96fc15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0b42c0 0x7f96fc15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 -- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc15ad80 msgr2=0x7f96fc0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc15ad80 0x7f96fc0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 -- 172.21.15.93:0/2583166618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4009a70 con 0x7f96fc0c9c40 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96faffd640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000c00 tx=0x7f96ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec033880 con 0x7f96fc0c9c40 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec033a00 con 0x7f96fc0c9c40 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec009400 con 0x7f96fc0c9c40 2023-11-04T01:39:23.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec033db0 con 0x7f96fc0c9c40 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.913+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc15b4e0 con 0x7f96fc0c9c40 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.914+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc15d330 con 0x7f96fc0c9c40 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.915+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96ec03a050 con 0x7f96fc0c9c40 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.915+0000 7f96e3fff640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 0x7f96e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.915+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f96ec0ab500 con 0x7f96fc0c9c40 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.915+0000 7f96fb7fe640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 0x7f96e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.916+0000 7f96fb7fe640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 0x7f96e806d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f96f0001930 tx=0x7f96f0001760 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:23.919+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96ec0761e0 con 0x7f96fc0c9c40 2023-11-04T01:39:24.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.121+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96fc15b6d0 con 0x7f96fc0c9c40 2023-11-04T01:39:24.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.121+0000 7f96e3fff640 1 -- 172.21.15.93:0/2583166618 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f96ec079800 con 0x7f96fc0c9c40 2023-11-04T01:39:24.123 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:24.123 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.063286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:24.123 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 47 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 msgr2=0x7f96e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 0x7f96e806d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f96f0001930 tx=0x7f96f0001760 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 msgr2=0x7f96fc0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000c00 tx=0x7f96ec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 shutdown_connections 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f96e806ae70 0x7f96e806d330 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f96fc15ad80 0x7f96fc0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96fc0c9c40 0x7f96fc0af730 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 --2- 172.21.15.93:0/2583166618 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f96fc0b42c0 0x7f96fc15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 >> 172.21.15.93:0/2583166618 conn(0x7f96fc0ce950 msgr2=0x7f96fc0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 shutdown_connections 2023-11-04T01:39:24.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.123+0000 7f9701e1a640 1 -- 172.21.15.93:0/2583166618 wait complete. 2023-11-04T01:39:24.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:39:22.063286+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7359, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7359': {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6836/2331318607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 2331318607}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 2331318607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:24.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:39:24.538 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:39:24.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.638+0000 7fa50e361640 1 Processor -- start 2023-11-04T01:39:24.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.638+0000 7fa50e361640 1 -- start start 2023-11-04T01:39:24.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa50e361640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa508159c00 0x7fa5080cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa50e361640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50815aff0 con 0x7fa5080c48e0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa50e361640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50815a3e0 con 0x7fa5080ae1d0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa50e361640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50815a6c0 con 0x7fa508159c00 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa5077fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa5080c48e0 0x7fa5080adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41946/0 (socket says 172.21.15.93:41946) 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa5077fe640 1 -- 172.21.15.93:0/3813436510 learned_addr learned my addr 172.21.15.93:0/3813436510 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa507fff640 1 --2- 172.21.15.93:0/3813436510 >> v2:172.21.15.125:3300/0 conn(0x7fa508159c00 0x7fa5080cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651988541 0 0) 0x7fa50815aff0 con 0x7fa5080c48e0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003520 con 0x7fa5080c48e0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757534728 0 0) 0x7fa4f0003520 con 0x7fa5080c48e0 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 >> v2:172.21.15.125:3300/0 conn(0x7fa508159c00 msgr2=0x7fa5080cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 --2- 172.21.15.93:0/3813436510 >> v2:172.21.15.125:3300/0 conn(0x7fa508159c00 0x7fa5080cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 >> v1:172.21.15.125:6789/0 conn(0x7fa5080ae1d0 legacy=0x7fa5080709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50815a9a0 con 0x7fa5080c48e0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fa4fc001670 con 0x7fa5080c48e0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.639+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 >> v1:172.21.15.93:6789/0 conn(0x7fa5080c48e0 legacy=0x7fa5080adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4f0003970 0x7fa4f0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa4f0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4f00050e0 0x7fa4f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815a6c0 con 0x7fa4f0004370 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f000c020 con 0x7fa4f00050e0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f000c1e0 con 0x7fa4f0003970 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa4f0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4f00050e0 0x7fa4f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa507fff640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4f0003970 0x7fa4f0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 -- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4f0003970 msgr2=0x7fa4f0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4f0003970 0x7fa4f0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 -- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4f00050e0 msgr2=0x7fa4f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4f00050e0 0x7fa4f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa50c8fe640 1 -- 172.21.15.93:0/3813436510 reap_dead start 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.640+0000 7fa5077fe640 1 -- 172.21.15.93:0/3813436510 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f0003520 con 0x7fa4f0004370 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa4f0004840 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c210 tx=0x7fa4f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c05d7f79734b416 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc005ad0 con 0x7fa4f0004370 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc005c50 con 0x7fa4f0004370 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa506ffd640 1 -- 172.21.15.93:0/3813436510 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc02c8d0 con 0x7fa4f0004370 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 -- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 msgr2=0x7fa4f0004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa4f0004840 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c210 tx=0x7fa4f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 -- 172.21.15.93:0/3813436510 shutdown_connections 2023-11-04T01:39:24.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 --2- 172.21.15.93:0/3813436510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa4f0004840 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 -- 172.21.15.93:0/3813436510 >> 172.21.15.93:0/3813436510 conn(0x7fa5080ce950 msgr2=0x7fa5080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 -- 172.21.15.93:0/3813436510 shutdown_connections 2023-11-04T01:39:24.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.641+0000 7fa50e361640 1 -- 172.21.15.93:0/3813436510 wait complete. 2023-11-04T01:39:24.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.642+0000 7fa50e361640 1 Processor -- start 2023-11-04T01:39:24.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 -- start start 2023-11-04T01:39:24.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50815b550 0x7fa5080b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5081f5ea0 0x7fa5081f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5081f5a10 con 0x7fa4f0004370 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5081f2910 con 0x7fa5081f5ea0 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa50e361640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5081f2bf0 con 0x7fa50815b550 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa507fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa507fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58760/0 (socket says 172.21.15.93:58760) 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.643+0000 7fa507fff640 1 -- 172.21.15.93:0/2191856473 learned_addr learned my addr 172.21.15.93:0/2191856473 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa5077fe640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50815b550 0x7fa5080b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5081f5ea0 0x7fa5081f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 -- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50815b550 msgr2=0x7fa5080b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50815b550 0x7fa5080b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 -- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5081f5ea0 msgr2=0x7fa5081f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5081f5ea0 0x7fa5081f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 -- 172.21.15.93:0/2191856473 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5081f2ed0 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa507fff640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8011600 tx=0x7fa4f8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa504ff9640 1 -- 172.21.15.93:0/2191856473 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800f920 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa504ff9640 1 -- 172.21.15.93:0/2191856473 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f800fa80 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa504ff9640 1 -- 172.21.15.93:0/2191856473 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800fdf0 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080b4410 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.644+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50815bb90 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.646+0000 7fa504ff9640 1 -- 172.21.15.93:0/2191856473 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4f8015460 con 0x7fa4f0004370 2023-11-04T01:39:24.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.646+0000 7fa504ff9640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.646+0000 7fa504ff9640 1 -- 172.21.15.93:0/2191856473 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa4f808a070 con 0x7fa4f0004370 2023-11-04T01:39:24.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.646+0000 7fa5077fe640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.647+0000 7fa5077fe640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 0x7fa4f406d330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc034000 tx=0x7fa4fc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.647+0000 7fa510fcd740 1 Processor -- start 2023-11-04T01:39:24.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.647+0000 7fa510fcd740 1 -- start start 2023-11-04T01:39:24.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 0x563e30be75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30ac8740 con 0x563e30bb7c90 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30b2a8d0 con 0x563e30be4c30 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e30b27fc0 con 0x563e30be4850 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58768/0 (socket says 172.21.15.93:58768) 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 -- 172.21.15.93:0/1525221086 learned_addr learned my addr 172.21.15.93:0/1525221086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa5077fe640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 0x563e30be75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa507fff640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 -- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 msgr2=0x563e30bb7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 -- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 msgr2=0x563e30be75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 0x563e30be75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 -- 172.21.15.93:0/1525221086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e30ae6ca0 con 0x563e30bb7c90 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa5077fe640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 0x563e30be75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa507fff640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa50815d5c0 tx=0x7fa500001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de5c623f8d17bca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.648+0000 7fa4edffb640 1 -- 172.21.15.93:0/1525221086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5000055b0 con 0x563e30bb7c90 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa4edffb640 1 -- 172.21.15.93:0/1525221086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500005710 con 0x563e30bb7c90 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa4edffb640 1 -- 172.21.15.93:0/1525221086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500006d50 con 0x563e30bb7c90 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 -- 172.21.15.93:0/1525221086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 msgr2=0x563e30be7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa50815d5c0 tx=0x7fa500001da0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 -- 172.21.15.93:0/1525221086 shutdown_connections 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30bb7c90 0x563e30be7b20 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4c30 0x563e30be75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 --2- 172.21.15.93:0/1525221086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 -- 172.21.15.93:0/1525221086 >> 172.21.15.93:0/1525221086 conn(0x563e30bb9a60 msgr2=0x563e30c025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 -- 172.21.15.93:0/1525221086 shutdown_connections 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.649+0000 7fa510fcd740 1 -- 172.21.15.93:0/1525221086 wait complete. 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.650+0000 7fa510fcd740 1 -- start start 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.650+0000 7fa510fcd740 1 Processor -- start 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 0x563e30bfa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30be9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30b238b0 con 0x563e30be4850 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30addc80 con 0x563e30bfade0 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e30add920 con 0x563e30be4c30 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 10 client.0 _ll_register_callbacks cb 0x563e30835ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58774/0 (socket says 172.21.15.93:58774) 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 -- 172.21.15.93:0/3424115098 learned_addr learned my addr 172.21.15.93:0/3424115098 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30be9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 0x563e30bfa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 -- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 msgr2=0x563e30bfa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 0x563e30bfa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 -- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 msgr2=0x563e30be9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30be9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 -- 172.21.15.93:0/3424115098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa500003be0 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 0x563e30bfa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa507fff640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80115d0 tx=0x7fa4f8058920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d8a918472c34cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80701c0 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa4f8057f50 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e30acfbf0 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4f80606d0 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 10 client.7578 fetch_fsmap learned FSMap version 47 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.651+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x563e30b21f30 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e30acfbf0 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa4f801b020 con 0x563e30be4850 2023-11-04T01:39:24.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 10 client.7578 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 10 client.7578 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 20 client.7578 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30c1e1b0 0x563e30c205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 4 client.7578 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e30b1c890 con 0x563e30c1e1b0 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30c1e1b0 0x563e30c205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa5077fe640 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30c1e1b0 0x563e30c205a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15df1fd07fc73bdb server_cookie=f0a7522e2f6f1448 in_seq=0 out_seq=0 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.652+0000 7fa4e6ffd640 10 client.7578 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/3424115098 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563e30b1c890 con 0x563e30c1e1b0 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa4e6ffd640 10 client.7578 handle_command_reply: tid=0 2023-11-04T01:39:24.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 client.7578 shutdown 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 msgr2=0x563e30c162f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80115d0 tx=0x7fa4f8058920 comp rx=0 tx=0).stop 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 shutdown_connections 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30c1e1b0 0x563e30c205a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30be9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4c30 0x563e30bfa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 --2- 172.21.15.93:0/3424115098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4850 0x563e30c162f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 >> 172.21.15.93:0/3424115098 conn(0x563e30bb7c90 msgr2=0x563e30c06380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa4e6ffd640 0 client.7578 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 shutdown_connections 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 1 -- 172.21.15.93:0/3424115098 wait complete. 2023-11-04T01:39:24.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.653+0000 7fa510fcd740 20 client.7578 trim_cache size 0 max 16384 2023-11-04T01:39:24.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.669+0000 7fa510fcd740 1 Processor -- start 2023-11-04T01:39:24.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.669+0000 7fa510fcd740 1 -- start start 2023-11-04T01:39:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4850 0x563e30bfcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30bfade0 0x563e30bd3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30aa3280 con 0x563e30be4c30 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30c02d60 con 0x563e30be4850 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e30be8dc0 con 0x563e30bfade0 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58778/0 (socket says 172.21.15.93:58778) 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 -- 172.21.15.93:0/754304741 learned_addr learned my addr 172.21.15.93:0/754304741 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 -- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30bfade0 msgr2=0x563e30bd3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30bfade0 0x563e30bd3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 -- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4850 msgr2=0x563e30bfcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4850 0x563e30bfcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 -- 172.21.15.93:0/754304741 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e30abfd10 con 0x563e30be4c30 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa5077fe640 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c210 tx=0x7fa4fc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718d0141fa71d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa4ee7fc640 1 -- 172.21.15.93:0/754304741 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0014c0 con 0x563e30be4c30 2023-11-04T01:39:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa4ee7fc640 1 -- 172.21.15.93:0/754304741 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc047040 con 0x563e30be4c30 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.670+0000 7fa4ee7fc640 1 -- 172.21.15.93:0/754304741 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc004e30 con 0x563e30be4c30 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 -- 172.21.15.93:0/754304741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 msgr2=0x563e30c02f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00c210 tx=0x7fa4fc007000 comp rx=0 tx=0).stop 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 -- 172.21.15.93:0/754304741 shutdown_connections 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30bfade0 0x563e30bd3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c02f80 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 --2- 172.21.15.93:0/754304741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30be4850 0x563e30bfcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 -- 172.21.15.93:0/754304741 >> 172.21.15.93:0/754304741 conn(0x563e30bb7c90 msgr2=0x563e30bb2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 -- 172.21.15.93:0/754304741 shutdown_connections 2023-11-04T01:39:24.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.671+0000 7fa510fcd740 1 -- 172.21.15.93:0/754304741 wait complete. 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.672+0000 7fa510fcd740 1 -- start start 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.672+0000 7fa510fcd740 1 Processor -- start 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30c19d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30c60e20 con 0x563e30be4c30 2023-11-04T01:39:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e30c1a750 con 0x563e30bfade0 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e30bd2b40 con 0x563e30be4850 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 10 client.0 _ll_register_callbacks cb 0x7fa500003a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58784/0 (socket says 172.21.15.93:58784) 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 -- 172.21.15.93:0/741602225 learned_addr learned my addr 172.21.15.93:0/741602225 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa507fff640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa50c8fe640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30c19d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 -- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 msgr2=0x563e30bb6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 -- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 msgr2=0x563e30c19d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30c19d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 -- 172.21.15.93:0/741602225 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0003520 con 0x563e30be4c30 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa5077fe640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0017a0 tx=0x7fa4fc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601f7452e19f8230 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0074d0 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa500005710 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fa4fc007630 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4fc052220 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 10 client.7584 fetch_fsmap learned FSMap version 47 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.673+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x563e30ae5500 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500005710 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa4fc04c040 con 0x563e30be4c30 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 10 client.7584 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 10 client.7584 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 20 client.7584 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30bbc4f0 0x563e30bbc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 4 client.7584 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563e30b1c5b0 con 0x563e30bbc4f0 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa507fff640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30bbc4f0 0x563e30bbc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa4e6ffd640 10 client.7584 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa507fff640 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30bbc4f0 0x563e30bbc8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad770b978f5a9f6a server_cookie=31b6997e4f54d05c in_seq=0 out_seq=0 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.674+0000 7fa4e6ffd640 1 -- 172.21.15.93:0/741602225 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563e30b1c5b0 con 0x563e30bbc4f0 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa4e6ffd640 10 client.7584 handle_command_reply: tid=0 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 client.7584 shutdown 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 msgr2=0x563e30c608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0017a0 tx=0x7fa4fc02e070 comp rx=0 tx=0).stop 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 shutdown_connections 2023-11-04T01:39:24.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x563e30bbc4f0 0x563e30bbc8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563e30bfade0 0x563e30c19d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563e30be4c30 0x563e30c608e0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 --2- 172.21.15.93:0/741602225 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x563e30be4850 0x563e30bb6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa4e6ffd640 0 client.7584 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 >> 172.21.15.93:0/741602225 conn(0x563e30bb7c90 msgr2=0x563e30be75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 shutdown_connections 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 1 -- 172.21.15.93:0/741602225 wait complete. 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa510fcd740 20 client.7584 trim_cache size 0 max 16384 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:39:24.683 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 1, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5750, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 2.6309269300000002, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 47, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 95, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 17.218256482000001 2023-11-04T01:39:24.684 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:39:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 msgr2=0x7fa4f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 0x7fa4f406d330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc034000 tx=0x7fa4fc009030 comp rx=0 tx=0).stop 2023-11-04T01:39:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 msgr2=0x7fa5081f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8011600 tx=0x7fa4f8011ac0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 shutdown_connections 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5081f5ea0 0x7fa5081f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa50815b550 0x7fa5080b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 --2- 172.21.15.93:0/2191856473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4f0004370 0x7fa5081f2210 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 >> 172.21.15.93:0/2191856473 conn(0x7fa5080ce950 msgr2=0x7fa5080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 shutdown_connections 2023-11-04T01:39:24.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.675+0000 7fa50e361640 1 -- 172.21.15.93:0/2191856473 wait complete. 2023-11-04T01:39:24.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:39:24.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.785+0000 7f1abb6e5640 1 Processor -- start 2023-11-04T01:39:24.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.785+0000 7f1abb6e5640 1 -- start start 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1abb6e5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ab40ae1d0 0x7f1ab40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1abb6e5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab415aff0 con 0x7f1ab4159c00 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1abb6e5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab415a3e0 con 0x7f1ab40c4ff0 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1abb6e5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab415a6c0 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1ab9481640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1ab4159c00 0x7f1ab40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41952/0 (socket says 172.21.15.93:41952) 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1ab9481640 1 -- 172.21.15.93:0/3491583259 learned_addr learned my addr 172.21.15.93:0/3491583259 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/3491583259 >> v2:172.21.15.125:3300/0 conn(0x7f1ab40ae1d0 0x7f1ab40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947733903 0 0) 0x7f1ab415aff0 con 0x7f1ab4159c00 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa0003520 con 0x7f1ab4159c00 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1ab9c82640 1 -- 172.21.15.93:0/3491583259 >> v1:172.21.15.125:6789/0 conn(0x7f1ab40c4ff0 legacy=0x7f1ab40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1ab9c82640 1 -- 172.21.15.93:0/3491583259 >> v1:172.21.15.93:6789/0 conn(0x7f1ab4159c00 legacy=0x7f1ab40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.786+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929503087 0 0) 0x7f1aa0003520 con 0x7f1ab4159c00 2023-11-04T01:39:24.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.787+0000 7f1ab9c82640 1 -- 172.21.15.93:0/3491583259 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab415a9a0 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.787+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/3491583259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab40cc890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00097a0 tx=0x7f1ab002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21e2acc0ca21a93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.787+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab002f050 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0031500 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1aabfff640 1 -- 172.21.15.93:0/3491583259 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0019f0 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 -- 172.21.15.93:0/3491583259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab40ae1d0 msgr2=0x7f1ab40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/3491583259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab40cc890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00097a0 tx=0x7f1ab002b820 comp rx=0 tx=0).stop 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 -- 172.21.15.93:0/3491583259 shutdown_connections 2023-11-04T01:39:24.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/3491583259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab40cc890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 -- 172.21.15.93:0/3491583259 >> 172.21.15.93:0/3491583259 conn(0x7f1ab40ce950 msgr2=0x7f1ab40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 -- 172.21.15.93:0/3491583259 shutdown_connections 2023-11-04T01:39:24.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.788+0000 7f1abb6e5640 1 -- 172.21.15.93:0/3491583259 wait complete. 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.789+0000 7f1abb6e5640 1 Processor -- start 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.789+0000 7f1abb6e5640 1 -- start start 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 0x7f1ab40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 0x7f1ab40ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41f4920 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41f1350 con 0x7f1ab4159c00 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1abb6e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41f07d0 con 0x7f1ab40c4ff0 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58792/0 (socket says 172.21.15.93:58792) 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 -- 172.21.15.93:0/2406605869 learned_addr learned my addr 172.21.15.93:0/2406605869 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 0x7f1ab40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 0x7f1ab40ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 -- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 msgr2=0x7f1ab40c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 0x7f1ab40c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 -- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 msgr2=0x7f1ab40ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 0x7f1ab40ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9481640 1 -- 172.21.15.93:0/2406605869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009400 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 0x7f1ab40c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.790+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 0x7f1ab40ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1ab9481640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1aac001560 tx=0x7f1aac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1aa9ffb640 1 -- 172.21.15.93:0/2406605869 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00ce20 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1aa9ffb640 1 -- 172.21.15.93:0/2406605869 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac012400 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab41f0ab0 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1aa9ffb640 1 -- 172.21.15.93:0/2406605869 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac012830 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.791+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41f1070 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.792+0000 7f1aa9ffb640 1 -- 172.21.15.93:0/2406605869 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1aac007070 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.793+0000 7f1aa9ffb640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 0x7f1a9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.793+0000 7f1aa9ffb640 1 -- 172.21.15.93:0/2406605869 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1aac089d20 con 0x7f1ab40ae1d0 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.793+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 0x7f1a9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.793+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 0x7f1a9806d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4071660 tx=0x7f1aa4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 Processor -- start 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 -- start start 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0da9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 0x5636c0d8e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0c6f740 con 0x5636c0d8bc10 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0cd18d0 con 0x5636c0dac3d0 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c0ccefc0 con 0x5636c0d63e40 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.794+0000 7f1ab8c80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58808/0 (socket says 172.21.15.93:58808) 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 -- 172.21.15.93:0/2759994483 learned_addr learned my addr 172.21.15.93:0/2759994483 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab9481640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0da9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 0x5636c0d8e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 -- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 msgr2=0x5636c0d8e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 0x5636c0d8e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 -- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 msgr2=0x5636c0da9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0da9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 -- 172.21.15.93:0/2759994483 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c0c8dca0 con 0x5636c0d8bc10 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 0x5636c0d8e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400d7d0 tx=0x7f1aa4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e4406e4cf4ea90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1a9effd640 1 -- 172.21.15.93:0/2759994483 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4014ba0 con 0x5636c0d8bc10 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1a9effd640 1 -- 172.21.15.93:0/2759994483 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4014d00 con 0x5636c0d8bc10 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.795+0000 7f1a9effd640 1 -- 172.21.15.93:0/2759994483 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4007230 con 0x5636c0d8bc10 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- 172.21.15.93:0/2759994483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 msgr2=0x5636c0d63900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400d7d0 tx=0x7f1aa4010000 comp rx=0 tx=0).stop 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- 172.21.15.93:0/2759994483 shutdown_connections 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d63e40 0x5636c0d8e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d63900 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 --2- 172.21.15.93:0/2759994483 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0da9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- 172.21.15.93:0/2759994483 >> 172.21.15.93:0/2759994483 conn(0x5636c0d60a60 msgr2=0x5636c0da95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- 172.21.15.93:0/2759994483 shutdown_connections 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- 172.21.15.93:0/2759994483 wait complete. 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 -- start start 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.796+0000 7f1abe276740 1 Processor -- start 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8bc10 0x5636c0d91900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 0x5636c0d75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0cca8b0 con 0x5636c0dac3d0 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0c84c80 con 0x5636c0d8dd10 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c0c84920 con 0x5636c0d8bc10 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1abe276740 10 client.0 _ll_register_callbacks cb 0x5636c09dcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1ab8c80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1ab8c80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58814/0 (socket says 172.21.15.93:58814) 2023-11-04T01:39:24.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1ab8c80640 1 -- 172.21.15.93:0/980245643 learned_addr learned my addr 172.21.15.93:0/980245643 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1ab9481640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8bc10 0x5636c0d91900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.797+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 0x5636c0d75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 -- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8bc10 msgr2=0x5636c0d91900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8bc10 0x5636c0d91900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 -- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 msgr2=0x5636c0d75600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 0x5636c0d75600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 -- 172.21.15.93:0/980245643 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab415a3e0 con 0x5636c0dac3d0 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 0x5636c0d75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4007000 tx=0x7f1aa4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a138b5249f18bc9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:24.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa402e070 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636c0c76bf0 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1aa4007340 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa4007500 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 10 client.7596 fetch_fsmap learned FSMap version 47 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5636c0cc8f30 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636c0c76bf0 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1aa4031020 con 0x5636c0dac3d0 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 10 client.7596 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 10 client.7596 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 20 client.7596 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0d8ffc0 0x5636c0d903a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 4 client.7596 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 --> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636c0cc3890 con 0x5636c0d8ffc0 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.798+0000 7f1ab9481640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0d8ffc0 0x5636c0d903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1a93fff640 10 client.7596 ms_handle_connect on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1ab9481640 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0d8ffc0 0x5636c0d903a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dadb7c0413eb5623 server_cookie=89809f0c9093b7c in_seq=0 out_seq=0 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1a93fff640 1 -- 172.21.15.93:0/980245643 <== mds.0 v2:172.21.15.93:6834/2331318607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5636c0cc3890 con 0x5636c0d8ffc0 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1a93fff640 10 client.7596 handle_command_reply: tid=0 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 client.7596 shutdown 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 msgr2=0x5636c0d8d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4007000 tx=0x7f1aa4000ed0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 shutdown_connections 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0d8dd10 0x5636c0d75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0dac3d0 0x5636c0d8d7d0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0d8ffc0 0x5636c0d903a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 --2- 172.21.15.93:0/980245643 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8bc10 0x5636c0d91900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1a93fff640 0 client.7596 ms_handle_reset on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.799+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 >> 172.21.15.93:0/980245643 conn(0x5636c0d63e40 msgr2=0x5636c0dac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.800+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 shutdown_connections 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.800+0000 7f1abe276740 1 -- 172.21.15.93:0/980245643 wait complete. 2023-11-04T01:39:24.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.800+0000 7f1abe276740 20 client.7596 trim_cache size 0 max 16384 2023-11-04T01:39:24.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 Processor -- start 2023-11-04T01:39:24.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 -- start start 2023-11-04T01:39:24.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d63160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0c4a280 con 0x5636c0d8bc10 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0d62a10 con 0x5636c0dac3d0 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c0dad0e0 con 0x5636c0d8dd10 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58826/0 (socket says 172.21.15.93:58826) 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1ab9481640 1 -- 172.21.15.93:0/854874314 learned_addr learned my addr 172.21.15.93:0/854874314 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.816+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d63160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 -- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 msgr2=0x5636c0d63160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d63160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 -- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 msgr2=0x5636c0d636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 -- 172.21.15.93:0/854874314 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c0c66d10 con 0x5636c0d8bc10 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1ab9481640 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac054a10 tx=0x7f1aac058390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73a4c824c03ae5c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1a9f7fe640 1 -- 172.21.15.93:0/854874314 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac056650 con 0x5636c0d8bc10 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1a9f7fe640 1 -- 172.21.15.93:0/854874314 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac0568b0 con 0x5636c0d8bc10 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1a9f7fe640 1 -- 172.21.15.93:0/854874314 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac058770 con 0x5636c0d8bc10 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 -- 172.21.15.93:0/854874314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 msgr2=0x5636c0d8d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac054a10 tx=0x7f1aac058390 comp rx=0 tx=0).stop 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 -- 172.21.15.93:0/854874314 shutdown_connections 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d63160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 --2- 172.21.15.93:0/854874314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8d740 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.817+0000 7f1abe276740 1 -- 172.21.15.93:0/854874314 >> 172.21.15.93:0/854874314 conn(0x5636c0d63e40 msgr2=0x5636c0d59c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.818+0000 7f1abe276740 1 -- 172.21.15.93:0/854874314 shutdown_connections 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.818+0000 7f1abe276740 1 -- 172.21.15.93:0/854874314 wait complete. 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.818+0000 7f1abe276740 1 -- start start 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.818+0000 7f1abe276740 1 Processor -- start 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d64350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d64890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0e1bc90 con 0x5636c0d8bc10 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0e18d70 con 0x5636c0dac3d0 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c0daa6b0 con 0x5636c0d8dd10 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1abe276740 10 client.0 _ll_register_callbacks cb 0x7f1aa4001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58842/0 (socket says 172.21.15.93:58842) 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 -- 172.21.15.93:0/4198367821 learned_addr learned my addr 172.21.15.93:0/4198367821 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9c82640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d64890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d64350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 -- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 msgr2=0x5636c0d64350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d64350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 -- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 msgr2=0x5636c0d64890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d64890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 -- 172.21.15.93:0/4198367821 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41f1070 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1ab9481640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1aac087d20 tx=0x7f1aac00af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c2ff38df2410e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.819+0000 7f1a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac057c00 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1aac074040 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa4014d00 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aac056710 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 10 client.7602 fetch_fsmap learned FSMap version 47 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5636c0c8c500 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac065020 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1aac07a030 con 0x5636c0d8bc10 2023-11-04T01:39:24.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 10 client.7602 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 10 client.7602 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 20 client.7602 populate_metadata read hostname 'smithi093' 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0e1c0e0 0x5636c0e1c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 4 client.7602 mds_command: new command op to 7359 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 --> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5636c0cc35b0 con 0x5636c0e1c0e0 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0e1c0e0 0x5636c0e1c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1ab8c80640 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0e1c0e0 0x5636c0e1c4c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec8e25f51e871c9a server_cookie=f153b5af982f1ce8 in_seq=0 out_seq=0 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.820+0000 7f1a93fff640 10 client.7602 ms_handle_connect on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1a93fff640 1 -- 172.21.15.93:0/4198367821 <== mds.0 v2:172.21.15.93:6834/2331318607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5636c0cc35b0 con 0x5636c0e1c0e0 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1a93fff640 10 client.7602 handle_command_reply: tid=0 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 client.7602 shutdown 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 msgr2=0x5636c0d8af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1aac087d20 tx=0x7f1aac00af50 comp rx=0 tx=0).stop 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 shutdown_connections 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5636c0dac3d0 0x5636c0d64890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:6834/2331318607,v1:172.21.15.93:6836/2331318607] conn(0x5636c0e1c0e0 0x5636c0e1c4c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5636c0d8dd10 0x5636c0d64350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 --2- 172.21.15.93:0/4198367821 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5636c0d8bc10 0x5636c0d8af10 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1a93fff640 0 client.7602 ms_handle_reset on v2:172.21.15.93:6834/2331318607 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 >> 172.21.15.93:0/4198367821 conn(0x5636c0d63e40 msgr2=0x5636c0dac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 shutdown_connections 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 1 -- 172.21.15.93:0/4198367821 wait complete. 2023-11-04T01:39:24.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abe276740 20 client.7602 trim_cache size 0 max 16384 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7359, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 11.277308321, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 47, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 95, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:39:24.831 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 17.372657566000001 2023-11-04T01:39:24.832 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:39:24.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 msgr2=0x7f1a9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 0x7f1a9806d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4071660 tx=0x7f1aa4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:24.832 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 msgr2=0x7f1ab41f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1aac001560 tx=0x7f1aac00a430 comp rx=0 tx=0).stop 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 shutdown_connections 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a9806ae70 0x7f1a9806d330 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab4159c00 0x7f1ab40ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1ab40c4ff0 0x7f1ab40c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 --2- 172.21.15.93:0/2406605869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab40ae1d0 0x7f1ab41f43e0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.821+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 >> 172.21.15.93:0/2406605869 conn(0x7f1ab40ce950 msgr2=0x7f1ab40c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.822+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 shutdown_connections 2023-11-04T01:39:24.833 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:24.822+0000 7f1abb6e5640 1 -- 172.21.15.93:0/2406605869 wait complete. 2023-11-04T01:39:24.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:24.834 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:39:24.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:24.855 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:39:24.912 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:25.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.050+0000 7fdba841a640 1 Processor -- start 2023-11-04T01:39:25.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.050+0000 7fdba841a640 1 -- start start 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba841a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba00b42c0 0x7fdba00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba841a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdba00c9c40 0x7fdba00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba841a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba00ca090 con 0x7fdba015ad80 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba841a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba006cfa0 con 0x7fdba00c9c40 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba841a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba006d280 con 0x7fdba00b42c0 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdba00c9c40 0x7fdba00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdba00c9c40 0x7fdba00b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58844/0 (socket says 172.21.15.93:58844) 2023-11-04T01:39:25.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 -- 172.21.15.93:0/1753275494 learned_addr learned my addr 172.21.15.93:0/1753275494 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba59b5640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba00b42c0 0x7fdba00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 -- 172.21.15.93:0/1753275494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba00b42c0 msgr2=0x7fdba00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba00b42c0 0x7fdba00c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 -- 172.21.15.93:0/1753275494 >> v1:172.21.15.125:6789/0 conn(0x7fdba015ad80 legacy=0x7fdba006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.051+0000 7fdba69b7640 1 -- 172.21.15.93:0/1753275494 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba006d560 con 0x7fdba00c9c40 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba69b7640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00c9c40 0x7fdba00b1a40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009e50 tx=0x7fdb9802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a591aa9d67b628 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba51b4640 1 -- 172.21.15.93:0/1753275494 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9802cb00 con 0x7fdba00c9c40 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba51b4640 1 -- 172.21.15.93:0/1753275494 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9802cc60 con 0x7fdba00c9c40 2023-11-04T01:39:25.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba51b4640 1 -- 172.21.15.93:0/1753275494 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980343f0 con 0x7fdba00c9c40 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 -- 172.21.15.93:0/1753275494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00c9c40 msgr2=0x7fdba00b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00c9c40 0x7fdba00b1a40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009e50 tx=0x7fdb9802bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 -- 172.21.15.93:0/1753275494 shutdown_connections 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00c9c40 0x7fdba00b1a40 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 --2- 172.21.15.93:0/1753275494 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba00b42c0 0x7fdba00c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 -- 172.21.15.93:0/1753275494 >> 172.21.15.93:0/1753275494 conn(0x7fdba00ce950 msgr2=0x7fdba00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.052+0000 7fdba841a640 1 -- 172.21.15.93:0/1753275494 shutdown_connections 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.053+0000 7fdba841a640 1 -- 172.21.15.93:0/1753275494 wait complete. 2023-11-04T01:39:25.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 Processor -- start 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 -- start start 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba00c9c40 0x7fdba0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 0x7fdba0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015bf60 con 0x7fdba00b42c0 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0151910 con 0x7fdba00c9c40 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba841a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0156570 con 0x7fdba015ad80 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba61b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba61b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58846/0 (socket says 172.21.15.93:58846) 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.054+0000 7fdba61b6640 1 -- 172.21.15.93:0/1589305731 learned_addr learned my addr 172.21.15.93:0/1589305731 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba69b7640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 0x7fdba0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba59b5640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba00c9c40 0x7fdba0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.059 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 -- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 msgr2=0x7fdba0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 0x7fdba0156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 -- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba00c9c40 msgr2=0x7fdba0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba00c9c40 0x7fdba0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 -- 172.21.15.93:0/1589305731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009b30 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba69b7640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 0x7fdba0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba61b6640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c490 tx=0x7fdb9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c012830 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c012990 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c012d40 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba015b2e0 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.055+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba015b8a0 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.056+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba0074290 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.056+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb9c01b400 con 0x7fdba00b42c0 2023-11-04T01:39:25.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.057+0000 7fdb96ffd640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.057+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fdb9c089b40 con 0x7fdba00b42c0 2023-11-04T01:39:25.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.057+0000 7fdba59b5640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.057+0000 7fdba59b5640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 0x7fdb8406d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdb90006fd0 tx=0x7fdb90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.061+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb9c054670 con 0x7fdba00b42c0 2023-11-04T01:39:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.263+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba00b4880 con 0x7fdba00b42c0 2023-11-04T01:39:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.264+0000 7fdb96ffd640 1 -- 172.21.15.93:0/1589305731 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fdb9c016020 con 0x7fdba00b42c0 2023-11-04T01:39:25.265 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:25.266 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.063286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:25.266 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 47 2023-11-04T01:39:25.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 msgr2=0x7fdb8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 0x7fdb8406d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdb90006fd0 tx=0x7fdb90008040 comp rx=0 tx=0).stop 2023-11-04T01:39:25.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 msgr2=0x7fdba0158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c490 tx=0x7fdb9c00c950 comp rx=0 tx=0).stop 2023-11-04T01:39:25.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 shutdown_connections 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdba015ad80 0x7fdba0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdba00c9c40 0x7fdba0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 --2- 172.21.15.93:0/1589305731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdba00b42c0 0x7fdba0158d90 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 >> 172.21.15.93:0/1589305731 conn(0x7fdba00ce950 msgr2=0x7fdba00ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 shutdown_connections 2023-11-04T01:39:25.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:25.266+0000 7fdba841a640 1 -- 172.21.15.93:0/1589305731 wait complete. 2023-11-04T01:39:25.277 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:39:25.408 INFO:teuthology.orchestra.run.smithi125.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:25.409 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:25.409 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:27.410 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.524+0000 7f9ec3bf5640 1 Processor -- start 2023-11-04T01:39:27.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.525+0000 7f9ec3bf5640 1 -- start start 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec3bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ebc06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec3bf5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc0ae200 con 0x7f9ebc0ade20 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec3bf5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc0c9d10 con 0x7f9ebc0c1e80 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec3bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1617c0 con 0x7f9ebc0cd520 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec1991640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9ebc0ade20 0x7f9ebc0c92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41962/0 (socket says 172.21.15.93:41962) 2023-11-04T01:39:27.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec1991640 1 -- 172.21.15.93:0/1586708370 learned_addr learned my addr 172.21.15.93:0/1586708370 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec2192640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ebc06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160022803 0 0) 0x7f9ebc0ae200 con 0x7f9ebc0ade20 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea8003520 con 0x7f9ebc0ade20 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928504798 0 0) 0x7f9ea8003520 con 0x7f9ebc0ade20 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 msgr2=0x7f9ebc06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ebc06c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 >> v1:172.21.15.125:6789/0 conn(0x7f9ebc0c1e80 legacy=0x7f9ebc0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0c9ff0 con 0x7f9ebc0ade20 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f9eb8001670 con 0x7f9ebc0ade20 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 >> v1:172.21.15.93:6789/0 conn(0x7f9ebc0ade20 legacy=0x7f9ebc0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ea80039a0 0x7f9ea8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ea80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ea8004d00 0x7f9ea8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1617c0 con 0x7f9ea80039a0 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea800b9b0 con 0x7f9ea8004d00 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea800bb70 con 0x7f9ebc0cd520 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.526+0000 7f9ec1991640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ea80039a0 0x7f9ea8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1190640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ea80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec2192640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ea8004d00 0x7f9ea8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.531 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1991640 1 -- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 msgr2=0x7f9ea80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1991640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ebc0cd520 0x7f9ea80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1991640 1 -- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ea8004d00 msgr2=0x7f9ea8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1991640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ea8004d00 0x7f9ea8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.527+0000 7f9ec1991640 1 -- 172.21.15.93:0/1586708370 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8003520 con 0x7f9ea80039a0 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec1991640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ea80039a0 0x7f9ea8003d80 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800c210 tx=0x7f9ea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db5ae3a4eae159a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8005ad0 con 0x7f9ea80039a0 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8005c50 con 0x7f9ea80039a0 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec098f640 1 -- 172.21.15.93:0/1586708370 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb802c830 con 0x7f9ea80039a0 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/1586708370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ea80039a0 msgr2=0x7f9ea8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/1586708370 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ea80039a0 0x7f9ea8003d80 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800c210 tx=0x7f9ea80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec2192640 1 -- 172.21.15.93:0/1586708370 reap_dead start 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/1586708370 shutdown_connections 2023-11-04T01:39:27.532 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/1586708370 >> 172.21.15.93:0/1586708370 conn(0x7f9ebc0ce950 msgr2=0x7f9ebc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/1586708370 shutdown_connections 2023-11-04T01:39:27.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.528+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/1586708370 wait complete. 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 Processor -- start 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 -- start start 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 0x7f9ebc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 0x7f9ebc1f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc06dc70 con 0x7f9ebc1f7780 2023-11-04T01:39:27.535 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc162840 con 0x7f9ebc06d7f0 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.530+0000 7f9ec3bf5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc161c30 con 0x7f9ea80039a0 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58856/0 (socket says 172.21.15.93:58856) 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 -- 172.21.15.93:0/869569222 learned_addr learned my addr 172.21.15.93:0/869569222 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec1991640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 0x7f9ebc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec1190640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 0x7f9ebc1f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 -- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 msgr2=0x7f9ebc06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 0x7f9ebc06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 -- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 msgr2=0x7f9ebc1f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 0x7f9ebc1f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 -- 172.21.15.93:0/869569222 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc161f10 con 0x7f9ebc1f7780 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec1991640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 0x7f9ebc06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.536 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec1190640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 0x7f9ebc1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec2192640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0c1d30 tx=0x7f9eb400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400e040 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb400f040 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4015430 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc1621f0 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.531+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc161900 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.532+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc074290 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.533+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9eb4015590 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.533+0000 7f9eb27fc640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 0x7f9ea006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.533+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f9eb408a1e0 con 0x7f9ebc1f7780 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.533+0000 7f9ec1991640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 0x7f9ea006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.534+0000 7f9ec1991640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 0x7f9ea006d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8034000 tx=0x7f9eb8009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.537+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9eb4054d10 con 0x7f9ebc1f7780 2023-11-04T01:39:27.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.740+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ebc162980 con 0x7f9ebc1f7780 2023-11-04T01:39:27.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.740+0000 7f9eb27fc640 1 -- 172.21.15.93:0/869569222 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f9eb4058330 con 0x7f9ebc1f7780 2023-11-04T01:39:27.742 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:27.742 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.063286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:27.742 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 47 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 msgr2=0x7f9ea006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 0x7f9ea006d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8034000 tx=0x7f9eb8009030 comp rx=0 tx=0).stop 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 msgr2=0x7f9ebc0c2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0c1d30 tx=0x7f9eb400f580 comp rx=0 tx=0).stop 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 shutdown_connections 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ea006ae70 0x7f9ea006d330 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ebc1f7780 0x7f9ebc0c2280 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ebc06d7f0 0x7f9ebc1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 --2- 172.21.15.93:0/869569222 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ea80039a0 0x7f9ebc06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 >> 172.21.15.93:0/869569222 conn(0x7f9ebc0ce950 msgr2=0x7f9ebc0c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 shutdown_connections 2023-11-04T01:39:27.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:27.742+0000 7f9ec3bf5640 1 -- 172.21.15.93:0/869569222 wait complete. 2023-11-04T01:39:27.754 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:39:27.883 INFO:teuthology.orchestra.run.smithi125.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:27.884 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:27.884 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:29.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:29.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.994+0000 7f2282bbb640 1 Processor -- start 2023-11-04T01:39:29.995 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.994+0000 7f2282bbb640 1 -- start start 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2282bbb640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f227c15ad80 0x7f227c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2282bbb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f227c0c9e10 0x7f227c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2282bbb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c06cd00 con 0x7f227c0b42c0 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2282bbb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c06cfa0 con 0x7f227c0c9e10 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2282bbb640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c06d280 con 0x7f227c15ad80 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f227c0c9e10 0x7f227c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:29.997 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f227c0c9e10 0x7f227c0b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58858/0 (socket says 172.21.15.93:58858) 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 -- 172.21.15.93:0/3637531171 learned_addr learned my addr 172.21.15.93:0/3637531171 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f227bfff640 1 --1- 172.21.15.93:0/3637531171 >> v1:172.21.15.93:6789/0 conn(0x7f227c0b42c0 0x7f227c0c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41972/0 (socket says 172.21.15.93:41972) 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 -- 172.21.15.93:0/3637531171 >> v2:172.21.15.125:3300/0 conn(0x7f227c15ad80 msgr2=0x7f227c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 --2- 172.21.15.93:0/3637531171 >> v2:172.21.15.125:3300/0 conn(0x7f227c15ad80 0x7f227c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 -- 172.21.15.93:0/3637531171 >> v1:172.21.15.93:6789/0 conn(0x7f227c0b42c0 legacy=0x7f227c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f227b7fe640 1 -- 172.21.15.93:0/3637531171 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480462102 0 0) 0x7f227c06cd00 con 0x7f227c0b42c0 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.995+0000 7f2281158640 1 -- 172.21.15.93:0/3637531171 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c06d560 con 0x7f227c0c9e10 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.996+0000 7f2281158640 1 --2- 172.21.15.93:0/3637531171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0c9e10 0x7f227c0b1a40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f227c0b4ac0 tx=0x7f227402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d49692468086e85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.996+0000 7f227b7fe640 1 -- 172.21.15.93:0/3637531171 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227402cbb0 con 0x7f227c0c9e10 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.996+0000 7f227b7fe640 1 -- 172.21.15.93:0/3637531171 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227402cd10 con 0x7f227c0c9e10 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.996+0000 7f227b7fe640 1 -- 172.21.15.93:0/3637531171 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274034610 con 0x7f227c0c9e10 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 -- 172.21.15.93:0/3637531171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0c9e10 msgr2=0x7f227c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 --2- 172.21.15.93:0/3637531171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0c9e10 0x7f227c0b1a40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f227c0b4ac0 tx=0x7f227402c010 comp rx=0 tx=0).stop 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 -- 172.21.15.93:0/3637531171 shutdown_connections 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 --2- 172.21.15.93:0/3637531171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0c9e10 0x7f227c0b1a40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 --2- 172.21.15.93:0/3637531171 >> v2:172.21.15.125:3300/0 conn(0x7f227c15ad80 0x7f227c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 -- 172.21.15.93:0/3637531171 >> 172.21.15.93:0/3637531171 conn(0x7f227c0ce950 msgr2=0x7f227c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 -- 172.21.15.93:0/3637531171 shutdown_connections 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.997+0000 7f2282bbb640 1 -- 172.21.15.93:0/3637531171 wait complete. 2023-11-04T01:39:30.001 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.998+0000 7f2282bbb640 1 Processor -- start 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.998+0000 7f2282bbb640 1 -- start start 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 0x7f227c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f227c15ad80 0x7f227c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15c1e0 con 0x7f227c0b42c0 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15b6a0 con 0x7f227c0c9e10 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15b940 con 0x7f227c15ad80 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58874/0 (socket says 172.21.15.93:58874) 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 -- 172.21.15.93:0/2461602446 learned_addr learned my addr 172.21.15.93:0/2461602446 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:30.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 -- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f227c15ad80 msgr2=0x7f227c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f227c15ad80 0x7f227c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 -- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 msgr2=0x7f227c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f227bfff640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 0x7f227c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 0x7f227c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 -- 172.21.15.93:0/2461602446 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009b30 con 0x7f227c0b42c0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f227bfff640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 0x7f227c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2280957640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f227000b410 tx=0x7f227000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270011830 con 0x7f227c0b42c0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22700119b0 con 0x7f227c0b42c0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c15bc20 con 0x7f227c0b42c0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270011d60 con 0x7f227c0b42c0 2023-11-04T01:39:30.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:29.999+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c15c9a0 con 0x7f227c0b42c0 2023-11-04T01:39:30.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.000+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c15cbc0 con 0x7f227c0b42c0 2023-11-04T01:39:30.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.001+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f227001a400 con 0x7f227c0b42c0 2023-11-04T01:39:30.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.001+0000 7f22797fa640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 0x7f226006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.001+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2270089cc0 con 0x7f227c0b42c0 2023-11-04T01:39:30.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.001+0000 7f227bfff640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 0x7f226006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.002+0000 7f227bfff640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 0x7f226006d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2268000f60 tx=0x7f2268009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.006+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22700547f0 con 0x7f227c0b42c0 2023-11-04T01:39:30.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.206+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f227c074290 con 0x7f227c0b42c0 2023-11-04T01:39:30.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.207+0000 7f22797fa640 1 -- 172.21.15.93:0/2461602446 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f2270015020 con 0x7f227c0b42c0 2023-11-04T01:39:30.208 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:30.209 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.063286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:30.209 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 47 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 msgr2=0x7f226006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 0x7f226006d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2268000f60 tx=0x7f2268009040 comp rx=0 tx=0).stop 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 msgr2=0x7f227c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f227000b410 tx=0x7f227000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 shutdown_connections 2023-11-04T01:39:30.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f226006ae70 0x7f226006d330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f227c15ad80 0x7f227c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f227c0c9e10 0x7f227c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 --2- 172.21.15.93:0/2461602446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f227c0b42c0 0x7f227c157540 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 >> 172.21.15.93:0/2461602446 conn(0x7f227c0ce950 msgr2=0x7f227c0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 shutdown_connections 2023-11-04T01:39:30.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:30.209+0000 7f2282bbb640 1 -- 172.21.15.93:0/2461602446 wait complete. 2023-11-04T01:39:30.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:39:30.349 INFO:teuthology.orchestra.run.smithi125.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:30.349 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:30.350 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:32.350 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:32.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.459+0000 7f0034961640 1 Processor -- start 2023-11-04T01:39:32.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.459+0000 7f0034961640 1 -- start start 2023-11-04T01:39:32.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0034961640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f003006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0034961640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003006e060 con 0x7f00300b0ae0 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0034961640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00300b4110 con 0x7f0030159c70 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0034961640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b49b0 con 0x7f00300ce370 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0025d9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f00300b0ae0 0x7f003015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51392/0 (socket says 172.21.15.93:51392) 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f0025d9b640 1 -- 172.21.15.93:0/4191600143 learned_addr learned my addr 172.21.15.93:0/4191600143 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002ed9d640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f003006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098927404 0 0) 0x7f003006e060 con 0x7f00300b0ae0 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003520 con 0x7f00300b0ae0 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825500928 0 0) 0x7f00300b4110 con 0x7f0030159c70 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003006e060 con 0x7f0030159c70 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1029419361 0 0) 0x7f001c003520 con 0x7f00300b0ae0 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 msgr2=0x7f003006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f003006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 >> v1:172.21.15.125:6789/0 conn(0x7f0030159c70 legacy=0x7f00300b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300b43f0 con 0x7f00300b0ae0 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f0018001670 con 0x7f00300b0ae0 2023-11-04T01:39:32.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.460+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 >> v1:172.21.15.93:6789/0 conn(0x7f00300b0ae0 legacy=0x7f003015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f001c003b30 0x7f001c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c0047c0 0x7f001c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f001c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b49b0 con 0x7f001c003b30 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c00ba30 con 0x7f001c0047c0 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c00bbc0 con 0x7f00300ce370 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f001c003b30 0x7f001c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002ed9d640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f001c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f0025d9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c0047c0 0x7f001c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 -- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 msgr2=0x7f001c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00300ce370 0x7f001c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 -- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c0047c0 msgr2=0x7f001c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c0047c0 0x7f001c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f002e59c640 1 -- 172.21.15.93:0/4191600143 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c003520 con 0x7f001c003b30 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.461+0000 7f0025d9b640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c0047c0 0x7f001c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f002e59c640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f001c003b30 0x7f001c003f30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f00200018d0 tx=0x7f001c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac60ef2f6e6d303d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200052d0 con 0x7f001c003b30 2023-11-04T01:39:32.469 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020005430 con 0x7f001c003b30 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f002dd9b640 1 -- 172.21.15.93:0/4191600143 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020003810 con 0x7f001c003b30 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 -- 172.21.15.93:0/4191600143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f001c003b30 msgr2=0x7f001c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 --2- 172.21.15.93:0/4191600143 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f001c003b30 0x7f001c003f30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f00200018d0 tx=0x7f001c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f002ed9d640 1 -- 172.21.15.93:0/4191600143 reap_dead start 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 -- 172.21.15.93:0/4191600143 shutdown_connections 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 -- 172.21.15.93:0/4191600143 >> 172.21.15.93:0/4191600143 conn(0x7f00300ce950 msgr2=0x7f00300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 -- 172.21.15.93:0/4191600143 shutdown_connections 2023-11-04T01:39:32.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.462+0000 7f0034961640 1 -- 172.21.15.93:0/4191600143 wait complete. 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.464+0000 7f0034961640 1 Processor -- start 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.464+0000 7f0034961640 1 -- start start 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 0x7f00300a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00301f0340 0x7f00300706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300a8420 con 0x7f00300aa350 2023-11-04T01:39:32.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300aa7d0 con 0x7f001c003b30 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0034961640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300a8610 con 0x7f00301f0340 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51758/0 (socket says 172.21.15.93:51758) 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 -- 172.21.15.93:0/2689946202 learned_addr learned my addr 172.21.15.93:0/2689946202 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f002ed9d640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00301f0340 0x7f00300706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f002e59c640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 0x7f00300a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 -- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00301f0340 msgr2=0x7f00300706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00301f0340 0x7f00300706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 -- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 msgr2=0x7f00300a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 0x7f00300a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 -- 172.21.15.93:0/2689946202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300a88f0 con 0x7f00300aa350 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f002e59c640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 0x7f00300a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.465+0000 7f0025d9b640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f001800e730 tx=0x7f001800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.466+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800ee40 con 0x7f00300aa350 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.466+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800c870 con 0x7f00300aa350 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.466+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00300a8bd0 con 0x7f00300aa350 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.466+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800cc20 con 0x7f00300aa350 2023-11-04T01:39:32.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.466+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0030070c30 con 0x7f00300aa350 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.467+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0030074290 con 0x7f00300aa350 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.467+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f001801d460 con 0x7f00300aa350 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.467+0000 7f00277fe640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 0x7f001006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.468+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0018089a50 con 0x7f00300aa350 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.468+0000 7f002e59c640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 0x7f001006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.468+0000 7f002e59c640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 0x7f001006d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0020034000 tx=0x7f0020031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.472+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0018054610 con 0x7f00300aa350 2023-11-04T01:39:32.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.673+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0030074290 con 0x7f00300aa350 2023-11-04T01:39:32.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.673+0000 7f00277fe640 1 -- 172.21.15.93:0/2689946202 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f0018057c30 con 0x7f00300aa350 2023-11-04T01:39:32.676 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:32.676 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:22.063286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:32.676 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 47 2023-11-04T01:39:32.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 msgr2=0x7f001006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 0x7f001006d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0020034000 tx=0x7f0020031000 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 msgr2=0x7f00301efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f001800e730 tx=0x7f001800ebf0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 shutdown_connections 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f001006ae70 0x7f001006d330 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f00301f0340 0x7f00300706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00300aa350 0x7f00301efe00 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 --2- 172.21.15.93:0/2689946202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f001c003b30 0x7f00300a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 >> 172.21.15.93:0/2689946202 conn(0x7f00300ce950 msgr2=0x7f00300ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 shutdown_connections 2023-11-04T01:39:32.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:32.675+0000 7f0034961640 1 -- 172.21.15.93:0/2689946202 wait complete. 2023-11-04T01:39:32.688 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:39:32.810 INFO:teuthology.orchestra.run.smithi125.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:39:32.811 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:39:32.811 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:39:34.812 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:34.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.919+0000 7f820833c640 1 Processor -- start 2023-11-04T01:39:34.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.919+0000 7f820833c640 1 -- start start 2023-11-04T01:39:34.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.920+0000 7f820833c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.920+0000 7f820833c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f820015daa0 0x7f8200157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.920+0000 7f820833c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820015e000 con 0x7f82000ce240 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.920+0000 7f820833c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820015e5c0 con 0x7f820015daa0 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.920+0000 7f820833c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820015e2e0 con 0x7f82000cde60 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f820015daa0 0x7f8200157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f820015daa0 0x7f8200157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51766/0 (socket says 172.21.15.93:51766) 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 -- 172.21.15.93:0/2685071122 learned_addr learned my addr 172.21.15.93:0/2685071122 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82060d8640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 -- 172.21.15.93:0/2685071122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 msgr2=0x7f820015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 -- 172.21.15.93:0/2685071122 >> v1:172.21.15.125:6789/0 conn(0x7f82000ce240 legacy=0x7f820006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.921+0000 7f82058d7640 1 -- 172.21.15.93:0/2685071122 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000d1120 con 0x7f820015daa0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f82058d7640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f820015daa0 0x7f8200157000 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d8e400c3623894 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f82050d6640 1 -- 172.21.15.93:0/2685071122 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0031640 con 0x7f820015daa0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f82050d6640 1 -- 172.21.15.93:0/2685071122 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f00317a0 con 0x7f820015daa0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f82050d6640 1 -- 172.21.15.93:0/2685071122 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0031b30 con 0x7f820015daa0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 -- 172.21.15.93:0/2685071122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f820015daa0 msgr2=0x7f8200157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f820015daa0 0x7f8200157000 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 -- 172.21.15.93:0/2685071122 shutdown_connections 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f820015daa0 0x7f8200157000 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 --2- 172.21.15.93:0/2685071122 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 -- 172.21.15.93:0/2685071122 >> 172.21.15.93:0/2685071122 conn(0x7f8200071f30 msgr2=0x7f82000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 -- 172.21.15.93:0/2685071122 shutdown_connections 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.922+0000 7f820833c640 1 -- 172.21.15.93:0/2685071122 wait complete. 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 Processor -- start 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 -- start start 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820013ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f820015daa0 0x7f8200152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820014e3a0 con 0x7f82000ce240 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cd590 con 0x7f820015daa0 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f820833c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cc6b0 con 0x7f82000cde60 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f82058d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f82058d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51778/0 (socket says 172.21.15.93:51778) 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.924+0000 7f82058d7640 1 -- 172.21.15.93:0/2563586367 learned_addr learned my addr 172.21.15.93:0/2563586367 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82060d8640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820013ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82068d9640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f820015daa0 0x7f8200152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 -- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 msgr2=0x7f820013ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820013ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 -- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f820015daa0 msgr2=0x7f8200152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f820015daa0 0x7f8200152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 -- 172.21.15.93:0/2563586367 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00094d0 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f82058d7640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f003ac60 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f003ade0 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000cc980 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0044630 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.925+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82000ccf40 con 0x7f82000ce240 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.926+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200074290 con 0x7f82000ce240 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.927+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81f002f050 con 0x7f82000ce240 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.927+0000 7f81f6ffd640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 0x7f81e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.927+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f81f00ab9f0 con 0x7f82000ce240 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.927+0000 7f82060d8640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 0x7f81e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.927+0000 7f82060d8640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 0x7f81e406d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81fc006fd0 tx=0x7f81fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:34.931+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81f0076570 con 0x7f82000ce240 2023-11-04T01:39:35.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.131+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82000c5f90 con 0x7f82000ce240 2023-11-04T01:39:35.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.132+0000 7f81f6ffd640 1 -- 172.21.15.93:0/2563586367 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f81f0079b90 con 0x7f82000ce240 2023-11-04T01:39:35.134 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:35.135 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:32.451371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:35.135 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 48 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 msgr2=0x7f81e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 0x7f81e406d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81fc006fd0 tx=0x7f81fc008040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 msgr2=0x7f82000c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 shutdown_connections 2023-11-04T01:39:35.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f81e406ae70 0x7f81e406d330 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f820015daa0 0x7f8200152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82000ce240 0x7f82000c9ef0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 --2- 172.21.15.93:0/2563586367 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f82000cde60 0x7f820013ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 >> 172.21.15.93:0/2563586367 conn(0x7f8200071f30 msgr2=0x7f82000b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 shutdown_connections 2023-11-04T01:39:35.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.134+0000 7f820833c640 1 -- 172.21.15.93:0/2563586367 wait complete. 2023-11-04T01:39:35.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:39:35.271 INFO:teuthology.orchestra.run.smithi125.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-11-04T01:39:35.272 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-11-04T01:39:35.272 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:39:35.272 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:39:35.386 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:39:35.386 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:39:35.386 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:39:35.387 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:35.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.484+0000 7fb1f004f640 1 Processor -- start 2023-11-04T01:39:35.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.484+0000 7fb1f004f640 1 -- start start 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1f004f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb1e815ad80 0x7fb1e806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1f004f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 0x7fb1e80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1f004f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80ca070 con 0x7fb1e80c9c40 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1f004f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e806cd00 con 0x7fb1e815ad80 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1f004f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e806cfa0 con 0x7fb1e80b42c0 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1eddeb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb1e815ad80 0x7fb1e806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1ee5ec640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb1e80c9c40 0x7fb1e8070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51408/0 (socket says 172.21.15.93:51408) 2023-11-04T01:39:35.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1ee5ec640 1 -- 172.21.15.93:0/101427967 learned_addr learned my addr 172.21.15.93:0/101427967 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.485+0000 7fb1ed5ea640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 0x7fb1e80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1eddeb640 1 -- 172.21.15.93:0/101427967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 msgr2=0x7fb1e80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1eddeb640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 0x7fb1e80c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1eddeb640 1 -- 172.21.15.93:0/101427967 >> v1:172.21.15.93:6789/0 conn(0x7fb1e80c9c40 legacy=0x7fb1e8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1eddeb640 1 -- 172.21.15.93:0/101427967 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e806d280 con 0x7fb1e815ad80 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1ecde9640 1 -- 172.21.15.93:0/101427967 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158610220 0 0) 0x7fb1e80ca070 con 0x7fb1e80c9c40 2023-11-04T01:39:35.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1ed5ea640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 0x7fb1e80c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:35.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1eddeb640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e815ad80 0x7fb1e806c7c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009d90 tx=0x7fb1e402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41e98d33910342e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.486+0000 7fb1ecde9640 1 -- 172.21.15.93:0/101427967 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e402cce0 con 0x7fb1e815ad80 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1ecde9640 1 -- 172.21.15.93:0/101427967 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e402ce40 con 0x7fb1e815ad80 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1ecde9640 1 -- 172.21.15.93:0/101427967 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4034660 con 0x7fb1e815ad80 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 -- 172.21.15.93:0/101427967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e815ad80 msgr2=0x7fb1e806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e815ad80 0x7fb1e806c7c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009d90 tx=0x7fb1e402bf30 comp rx=0 tx=0).stop 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 -- 172.21.15.93:0/101427967 shutdown_connections 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e80b42c0 0x7fb1e80c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 --2- 172.21.15.93:0/101427967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e815ad80 0x7fb1e806c7c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 -- 172.21.15.93:0/101427967 >> 172.21.15.93:0/101427967 conn(0x7fb1e80ce950 msgr2=0x7fb1e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 -- 172.21.15.93:0/101427967 shutdown_connections 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.487+0000 7fb1f004f640 1 -- 172.21.15.93:0/101427967 wait complete. 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.488+0000 7fb1f004f640 1 Processor -- start 2023-11-04T01:39:35.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.488+0000 7fb1f004f640 1 -- start start 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e80c9c40 0x7fb1e80c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e815ad80 0x7fb1e80ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c8cb0 con 0x7fb1e80b42c0 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8153690 con 0x7fb1e80c9c40 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1f004f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c5b30 con 0x7fb1e815ad80 2023-11-04T01:39:35.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51790/0 (socket says 172.21.15.93:51790) 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 -- 172.21.15.93:0/2519882129 learned_addr learned my addr 172.21.15.93:0/2519882129 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 -- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e815ad80 msgr2=0x7fb1e80ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e815ad80 0x7fb1e80ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 -- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e80c9c40 msgr2=0x7fb1e80c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e80c9c40 0x7fb1e80c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.489+0000 7fb1eddeb640 1 -- 172.21.15.93:0/2519882129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009a70 con 0x7fb1e80b42c0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1eddeb640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009d90 tx=0x7fb1e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e403d600 con 0x7fb1e80b42c0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e403d760 con 0x7fb1e80b42c0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e403db10 con 0x7fb1e80b42c0 2023-11-04T01:39:35.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e80c5e10 con 0x7fb1e80b42c0 2023-11-04T01:39:35.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.490+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e80c63d0 con 0x7fb1e80b42c0 2023-11-04T01:39:35.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.491+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8074290 con 0x7fb1e80b42c0 2023-11-04T01:39:35.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.491+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1e403b040 con 0x7fb1e80b42c0 2023-11-04T01:39:35.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.492+0000 7fb1de7fc640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 0x7fb1cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.492+0000 7fb1ed5ea640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 0x7fb1cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.492+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fb1e40abe00 con 0x7fb1e80b42c0 2023-11-04T01:39:35.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.492+0000 7fb1ed5ea640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 0x7fb1cc06d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006fd0 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.496+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1e4076980 con 0x7fb1e80b42c0 2023-11-04T01:39:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.695+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1e80b4880 con 0x7fb1e80b42c0 2023-11-04T01:39:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.695+0000 7fb1de7fc640 1 -- 172.21.15.93:0/2519882129 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fb1e404d090 con 0x7fb1e80b42c0 2023-11-04T01:39:35.698 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:35.699 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:32.451371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:35.700 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 48 2023-11-04T01:39:35.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 msgr2=0x7fb1cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 0x7fb1cc06d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006fd0 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 msgr2=0x7fb1e8153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009d90 tx=0x7fb1e4004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 shutdown_connections 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb1cc06ae70 0x7fb1cc06d330 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb1e815ad80 0x7fb1e80ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1e80c9c40 0x7fb1e80c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 --2- 172.21.15.93:0/2519882129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1e80b42c0 0x7fb1e8153150 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 >> 172.21.15.93:0/2519882129 conn(0x7fb1e80ce950 msgr2=0x7fb1e8070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 shutdown_connections 2023-11-04T01:39:35.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.697+0000 7fb1f004f640 1 -- 172.21.15.93:0/2519882129 wait complete. 2023-11-04T01:39:35.710 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.809+0000 7f0f9c597640 1 Processor -- start 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.809+0000 7f0f9c597640 1 -- start start 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9c597640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0f94159c00 0x7f0f940cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9c597640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9415aff0 con 0x7f0f940c48e0 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9c597640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9415a3e0 con 0x7f0f940ae1d0 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9c597640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9415a6c0 con 0x7f0f94159c00 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9a333640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0f94159c00 0x7f0f940cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f99b32640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f0f940c48e0 0x7f0f940adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51416/0 (socket says 172.21.15.93:51416) 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f99b32640 1 -- 172.21.15.93:0/3596744931 learned_addr learned my addr 172.21.15.93:0/3596744931 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9a333640 1 -- 172.21.15.93:0/3596744931 >> v1:172.21.15.125:6789/0 conn(0x7f0f940ae1d0 legacy=0x7f0f940709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9a333640 1 -- 172.21.15.93:0/3596744931 >> v1:172.21.15.93:6789/0 conn(0x7f0f940c48e0 legacy=0x7f0f940adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f9a333640 1 -- 172.21.15.93:0/3596744931 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9415a9a0 con 0x7f0f94159c00 2023-11-04T01:39:35.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.810+0000 7f0f99331640 1 -- 172.21.15.93:0/3596744931 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878163981 0 0) 0x7f0f9415aff0 con 0x7f0f940c48e0 2023-11-04T01:39:35.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.811+0000 7f0f9a333640 1 --2- 172.21.15.93:0/3596744931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f94159c00 0x7f0f940cc890 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097a0 tx=0x7f0f8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83701313d82ad080 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.811+0000 7f0f99331640 1 -- 172.21.15.93:0/3596744931 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c031830 con 0x7f0f94159c00 2023-11-04T01:39:35.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.811+0000 7f0f99331640 1 -- 172.21.15.93:0/3596744931 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c031990 con 0x7f0f94159c00 2023-11-04T01:39:35.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.811+0000 7f0f99331640 1 -- 172.21.15.93:0/3596744931 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c031d20 con 0x7f0f94159c00 2023-11-04T01:39:35.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 -- 172.21.15.93:0/3596744931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f94159c00 msgr2=0x7f0f940cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 --2- 172.21.15.93:0/3596744931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f94159c00 0x7f0f940cc890 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0097a0 tx=0x7f0f8c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 -- 172.21.15.93:0/3596744931 shutdown_connections 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 --2- 172.21.15.93:0/3596744931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f94159c00 0x7f0f940cc890 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 -- 172.21.15.93:0/3596744931 >> 172.21.15.93:0/3596744931 conn(0x7f0f940ce950 msgr2=0x7f0f940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 -- 172.21.15.93:0/3596744931 shutdown_connections 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.812+0000 7f0f9c597640 1 -- 172.21.15.93:0/3596744931 wait complete. 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.813+0000 7f0f9c597640 1 Processor -- start 2023-11-04T01:39:35.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.813+0000 7f0f9c597640 1 -- start start 2023-11-04T01:39:35.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f940ae1d0 0x7f0f940c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 0x7f0f9414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9414df90 con 0x7f0f940c48e0 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9414c780 con 0x7f0f940ae1d0 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9414c9b0 con 0x7f0f94159c00 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51806/0 (socket says 172.21.15.93:51806) 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 -- 172.21.15.93:0/900195662 learned_addr learned my addr 172.21.15.93:0/900195662 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9ab34640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 0x7f0f9414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9a333640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f940ae1d0 0x7f0f940c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 -- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 msgr2=0x7f0f9414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 0x7f0f9414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 -- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f940ae1d0 msgr2=0x7f0f940c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f940ae1d0 0x7f0f940c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 -- 172.21.15.93:0/900195662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c009400 con 0x7f0f940c48e0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9ab34640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 0x7f0f9414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f99b32640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c4a0 tx=0x7f0f8400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840074e0 con 0x7f0f940c48e0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84007640 con 0x7f0f940c48e0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9414cc90 con 0x7f0f940c48e0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004a00 con 0x7f0f940c48e0 2023-11-04T01:39:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.814+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9414d250 con 0x7f0f940c48e0 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.815+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f94074290 con 0x7f0f940c48e0 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.816+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f84004b60 con 0x7f0f940c48e0 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.816+0000 7f0f8affd640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.816+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f0f84089080 con 0x7f0f940c48e0 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.816+0000 7f0f9a333640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.817+0000 7f0f9a333640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 0x7f0f7806d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c036000 tx=0x7f0f8c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:35.820+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f84053c00 con 0x7f0f940c48e0 2023-11-04T01:39:36.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.051+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f0f940ca8d0 con 0x7f0f940c48e0 2023-11-04T01:39:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.299+0000 7f0f8affd640 1 -- 172.21.15.93:0/900195662 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7359 v49) v1 ==== 112+0+0 (secure 0 0 0) 0x7f0f840180a0 con 0x7f0f940c48e0 2023-11-04T01:39:36.301 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.7359 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 msgr2=0x7f0f7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 0x7f0f7806d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c036000 tx=0x7f0f8c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 msgr2=0x7f0f9414da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c4a0 tx=0x7f0f8400c960 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 shutdown_connections 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0f94159c00 0x7f0f9414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f940c48e0 0x7f0f9414da50 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 --2- 172.21.15.93:0/900195662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0f940ae1d0 0x7f0f940c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 >> 172.21.15.93:0/900195662 conn(0x7f0f940ce950 msgr2=0x7f0f9406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 shutdown_connections 2023-11-04T01:39:36.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.301+0000 7f0f9c597640 1 -- 172.21.15.93:0/900195662 wait complete. 2023-11-04T01:39:36.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:39:36.426 INFO:teuthology.orchestra.run.smithi093.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:39:36.426 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:39:36.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:36.426 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:39:36.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:39:36.445 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f0c33dd8640 time 2023-11-04T01:39:36.445192+0000 2023-11-04T01:39:36.445 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3996efaf] 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.447 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f0c33dd8640 time 2023-11-04T01:39:36.445192+0000 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3996efaf] 2023-11-04T01:39:36.448 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f0c33dd8640 thread_name:ms_dispatch 2023-11-04T01:39:36.449 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0c39054db0] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0c390a154c] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3996f009] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.450 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f0c33dd8640 thread_name:ms_dispatch 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0c39054db0] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0c390a154c] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3996f009] 2023-11-04T01:39:36.451 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:36.452 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr: -2586> 2023-11-04T01:39:18.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr: -2118> 2023-11-04T01:39:23.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr: -1> 2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f0c33dd8640 time 2023-11-04T01:39:36.445192+0000 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.453 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3996efaf] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.454 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 0> 2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f0c33dd8640 thread_name:ms_dispatch 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0c39054db0] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0c390a154c] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3996f009] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.455 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:36.456 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.457 INFO:tasks.ceph.mds.c.smithi093.stderr: -2589> 2023-11-04T01:39:18.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:36.457 INFO:tasks.ceph.mds.c.smithi093.stderr: -2121> 2023-11-04T01:39:23.052+0000 7f0c315d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:36.457 INFO:tasks.ceph.mds.c.smithi093.stderr: -4> 2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f0c33dd8640 time 2023-11-04T01:39:36.445192+0000 2023-11-04T01:39:36.457 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:39:36.457 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3996efaf] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.458 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: -3> 2023-11-04T01:39:36.444+0000 7f0c33dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f0c33dd8640 thread_name:ms_dispatch 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0c39054db0] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0c390a154c] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3996f009] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f0c3996f16d] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x55e01696f254] 2023-11-04T01:39:36.459 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55e0167020a9] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e016704b2b] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e01670501c] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e0166ee325] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f0c39b5ff9a] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f0c39bf1741] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f0c3909f802] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f0c3903f450] 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:39:36.460 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:39:36.552 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:39:36.553 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:39:36.553 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:36.665 INFO:tasks.ceph.mds.c.smithi093.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:39:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.691+0000 7f7aab4c9640 1 Processor -- start 2023-11-04T01:39:36.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.692+0000 7f7aab4c9640 1 -- start start 2023-11-04T01:39:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.692+0000 7f7aab4c9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7aa415ab70 0x7f7aa40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.692+0000 7f7aab4c9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa406d310 con 0x7f7aa406a830 2023-11-04T01:39:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.692+0000 7f7aab4c9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa415d860 con 0x7f7aa406eba0 2023-11-04T01:39:36.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.692+0000 7f7aab4c9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40cba70 con 0x7f7aa415ab70 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9a66640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7aa406a830 0x7f7aa40ae5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:51432/0 (socket says 172.21.15.93:51432) 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9a66640 1 -- 172.21.15.93:0/3009964086 learned_addr learned my addr 172.21.15.93:0/3009964086 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9265640 1 --2- 172.21.15.93:0/3009964086 >> v2:172.21.15.125:3300/0 conn(0x7f7aa415ab70 0x7f7aa40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa3fff640 1 -- 172.21.15.93:0/3009964086 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738014894 0 0) 0x7f7aa406d310 con 0x7f7aa406a830 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa3fff640 1 -- 172.21.15.93:0/3009964086 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c003520 con 0x7f7aa406a830 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9265640 1 -- 172.21.15.93:0/3009964086 >> v1:172.21.15.125:6789/0 conn(0x7f7aa406eba0 legacy=0x7f7aa406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9265640 1 -- 172.21.15.93:0/3009964086 >> v1:172.21.15.93:6789/0 conn(0x7f7aa406a830 legacy=0x7f7aa40ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.693+0000 7f7aa9265640 1 -- 172.21.15.93:0/3009964086 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa415db40 con 0x7f7aa415ab70 2023-11-04T01:39:36.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aa9265640 1 --2- 172.21.15.93:0/3009964086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa415ab70 0x7f7aa40cbea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009790 tx=0x7f7a9c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77cf60f7c092b2d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aa3fff640 1 -- 172.21.15.93:0/3009964086 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c031830 con 0x7f7aa415ab70 2023-11-04T01:39:36.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aa3fff640 1 -- 172.21.15.93:0/3009964086 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c031990 con 0x7f7aa415ab70 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aa3fff640 1 -- 172.21.15.93:0/3009964086 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c031d20 con 0x7f7aa415ab70 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aab4c9640 1 -- 172.21.15.93:0/3009964086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa415ab70 msgr2=0x7f7aa40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.694+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/3009964086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa415ab70 0x7f7aa40cbea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009790 tx=0x7f7a9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.695+0000 7f7aab4c9640 1 -- 172.21.15.93:0/3009964086 shutdown_connections 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.695+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/3009964086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa415ab70 0x7f7aa40cbea0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.695+0000 7f7aab4c9640 1 -- 172.21.15.93:0/3009964086 >> 172.21.15.93:0/3009964086 conn(0x7f7aa4098d40 msgr2=0x7f7aa40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.695+0000 7f7aab4c9640 1 -- 172.21.15.93:0/3009964086 shutdown_connections 2023-11-04T01:39:36.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.695+0000 7f7aab4c9640 1 -- 172.21.15.93:0/3009964086 wait complete. 2023-11-04T01:39:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 Processor -- start 2023-11-04T01:39:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 -- start start 2023-11-04T01:39:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa406a830 0x7f7aa414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa415ab70 0x7f7aa415f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4161c50 con 0x7f7aa406eba0 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa414e300 con 0x7f7aa406a830 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.696+0000 7f7aab4c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c4030 con 0x7f7aa415ab70 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:51818/0 (socket says 172.21.15.93:51818) 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 -- 172.21.15.93:0/609432536 learned_addr learned my addr 172.21.15.93:0/609432536 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa9a66640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa415ab70 0x7f7aa415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa9265640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa406a830 0x7f7aa414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 -- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa415ab70 msgr2=0x7f7aa415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa415ab70 0x7f7aa415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 -- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa406a830 msgr2=0x7f7aa414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa406a830 0x7f7aa414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 -- 172.21.15.93:0/609432536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c0093a0 con 0x7f7aa406eba0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa8a64640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800c450 tx=0x7f7a9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980052d0 con 0x7f7aa406eba0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa40c4310 con 0x7f7aa406eba0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a98005430 con 0x7f7aa406eba0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003830 con 0x7f7aa406eba0 2023-11-04T01:39:36.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.697+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40c48d0 con 0x7f7aa406eba0 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.698+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4074290 con 0x7f7aa406eba0 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.699+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a98003990 con 0x7f7aa406eba0 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.699+0000 7f7aa1ffb640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.699+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f7a980892c0 con 0x7f7aa406eba0 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.699+0000 7f7aa9265640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.699+0000 7f7aa9265640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c036000 tx=0x7f7a9c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.703+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a98053ca0 con 0x7f7aa406eba0 2023-11-04T01:39:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.905+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7aa406ae70 con 0x7f7aa406eba0 2023-11-04T01:39:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.905+0000 7f7aa1ffb640 1 -- 172.21.15.93:0/609432536 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f7a980572c0 con 0x7f7aa406eba0 2023-11-04T01:39:36.908 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:36.908 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:36.053577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 49 2023-11-04T01:39:36.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 msgr2=0x7f7a9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c036000 tx=0x7f7a9c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 msgr2=0x7f7aa40c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800c450 tx=0x7f7a9800c910 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 shutdown_connections 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7aa415ab70 0x7f7aa415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7aa406eba0 0x7f7aa40c3670 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 --2- 172.21.15.93:0/609432536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7aa406a830 0x7f7aa414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 >> 172.21.15.93:0/609432536 conn(0x7f7aa4098d40 msgr2=0x7f7aa415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 shutdown_connections 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:36.907+0000 7f7aab4c9640 1 -- 172.21.15.93:0/609432536 wait complete. 2023-11-04T01:39:36.920 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:39:40.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:39:41.921 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:42.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.029+0000 7f1e62490640 1 Processor -- start 2023-11-04T01:39:42.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.029+0000 7f1e62490640 1 -- start start 2023-11-04T01:39:42.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e62490640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1e5c0b0ae0 0x7f1e5c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e62490640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5c0b4110 con 0x7f1e5c159c70 2023-11-04T01:39:42.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e62490640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5c0b43f0 con 0x7f1e5c06db20 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e62490640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5c0b49b0 con 0x7f1e5c0b0ae0 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1e5c159c70 0x7f1e5c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52546/0 (socket says 172.21.15.93:52546) 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5bfff640 1 -- 172.21.15.93:0/689190484 learned_addr learned my addr 172.21.15.93:0/689190484 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496379693 0 0) 0x7f1e5c0b4110 con 0x7f1e5c159c70 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e44003520 con 0x7f1e5c159c70 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/689190484 >> v2:172.21.15.125:3300/0 conn(0x7f1e5c0b0ae0 0x7f1e5c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743170160 0 0) 0x7f1e44003520 con 0x7f1e5c159c70 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 >> v2:172.21.15.125:3300/0 conn(0x7f1e5c0b0ae0 msgr2=0x7f1e5c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 --2- 172.21.15.93:0/689190484 >> v2:172.21.15.125:3300/0 conn(0x7f1e5c0b0ae0 0x7f1e5c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 >> v1:172.21.15.125:6789/0 conn(0x7f1e5c06db20 legacy=0x7f1e5c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0b46d0 con 0x7f1e5c159c70 2023-11-04T01:39:42.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.030+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1e4c001670 con 0x7f1e5c159c70 2023-11-04T01:39:42.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 >> v1:172.21.15.93:6789/0 conn(0x7f1e5c159c70 legacy=0x7f1e5c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44003970 0x7f1e44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 0x7f1e44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0b49b0 con 0x7f1e440047c0 2023-11-04T01:39:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4400c0d0 con 0x7f1e44003970 2023-11-04T01:39:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4400c290 con 0x7f1e44005180 2023-11-04T01:39:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 0x7f1e44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5bfff640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44003970 0x7f1e44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e60a2d640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 -- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44005180 msgr2=0x7f1e4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 -- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44003970 msgr2=0x7f1e44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e44003970 0x7f1e44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e5b7fe640 1 -- 172.21.15.93:0/689190484 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44003520 con 0x7f1e440047c0 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.031+0000 7f1e60a2d640 1 -- 172.21.15.93:0/689190484 reap_dead start 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 0x7f1e44004c40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ba30 tx=0x7f1e440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87367ab5768caf34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032640 con 0x7f1e440047c0 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500327a0 con 0x7f1e440047c0 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e5affd640 1 -- 172.21.15.93:0/689190484 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032b30 con 0x7f1e440047c0 2023-11-04T01:39:42.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e62490640 1 -- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 msgr2=0x7f1e44004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e62490640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 0x7f1e44004c40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ba30 tx=0x7f1e440057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e62490640 1 -- 172.21.15.93:0/689190484 shutdown_connections 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e62490640 1 --2- 172.21.15.93:0/689190484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e440047c0 0x7f1e44004c40 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.032+0000 7f1e62490640 1 -- 172.21.15.93:0/689190484 >> 172.21.15.93:0/689190484 conn(0x7f1e5c0ce950 msgr2=0x7f1e5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.033+0000 7f1e62490640 1 -- 172.21.15.93:0/689190484 shutdown_connections 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.033+0000 7f1e62490640 1 -- 172.21.15.93:0/689190484 wait complete. 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.034+0000 7f1e62490640 1 Processor -- start 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.034+0000 7f1e62490640 1 -- start start 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e440047c0 0x7f1e5c1f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e5c153a10 0x7f1e5c0a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c154a70 con 0x7f1e5c14a980 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c1f4900 con 0x7f1e440047c0 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c14b370 con 0x7f1e5c153a10 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36300/0 (socket says 172.21.15.93:36300) 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 -- 172.21.15.93:0/2063657861 learned_addr learned my addr 172.21.15.93:0/2063657861 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e5b7fe640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e5c153a10 0x7f1e5c0a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e5bfff640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e440047c0 0x7f1e5c1f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 -- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e5c153a10 msgr2=0x7f1e5c0a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e5c153a10 0x7f1e5c0a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 -- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e440047c0 msgr2=0x7f1e5c1f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e440047c0 0x7f1e5c1f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 -- 172.21.15.93:0/2063657861 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c070a10 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e60a2d640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06d3c0 tx=0x7f1e5400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54003b80 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e54003d00 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54005310 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c153ef0 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.035+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c1544b0 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.036+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c074290 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.037+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e54005470 con 0x7f1e5c14a980 2023-11-04T01:39:42.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.037+0000 7f1e58ff9640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 0x7f1e4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.037+0000 7f1e5bfff640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 0x7f1e4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.037+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f1e54089a20 con 0x7f1e5c14a980 2023-11-04T01:39:42.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.038+0000 7f1e5bfff640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 0x7f1e4806d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001050 tx=0x7f1e4c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.042+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e540545a0 con 0x7f1e5c14a980 2023-11-04T01:39:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.244+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e5c0c8ef0 con 0x7f1e5c14a980 2023-11-04T01:39:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.244+0000 7f1e58ff9640 1 -- 172.21.15.93:0/2063657861 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f1e54057bc0 con 0x7f1e5c14a980 2023-11-04T01:39:42.247 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:42.247 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:36.053577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 49 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 msgr2=0x7f1e4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 0x7f1e4806d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c001050 tx=0x7f1e4c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 msgr2=0x7f1e5c14ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06d3c0 tx=0x7f1e5400fd40 comp rx=0 tx=0).stop 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 shutdown_connections 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1e4806ae70 0x7f1e4806d330 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5c14a980 0x7f1e5c14ae30 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1e5c153a10 0x7f1e5c0a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 --2- 172.21.15.93:0/2063657861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e440047c0 0x7f1e5c1f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 >> 172.21.15.93:0/2063657861 conn(0x7f1e5c0ce950 msgr2=0x7f1e5c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 shutdown_connections 2023-11-04T01:39:42.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:42.246+0000 7f1e62490640 1 -- 172.21.15.93:0/2063657861 wait complete. 2023-11-04T01:39:42.259 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:39:46.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:39:47.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:47.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.369+0000 7fcb85a44640 1 Processor -- start 2023-11-04T01:39:47.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.369+0000 7fcb85a44640 1 -- start start 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb85a44640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb800cde60 0x7fcb8015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb85a44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb80157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb85a44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8015e000 con 0x7fcb800ce240 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb85a44640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8015e5c0 con 0x7fcb800cde60 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb85a44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e2e0 con 0x7fcb8015daa0 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcb800ce240 0x7fcb8006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:52550/0 (socket says 172.21.15.93:52550) 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7f7fe640 1 -- 172.21.15.93:0/3578840261 learned_addr learned my addr 172.21.15.93:0/3578840261 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86203286 0 0) 0x7fcb8015e000 con 0x7fcb800ce240 2023-11-04T01:39:47.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7effd640 1 --2- 172.21.15.93:0/3578840261 >> v2:172.21.15.125:3300/0 conn(0x7fcb800cde60 0x7fcb8015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb767fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb80157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb6c003520 con 0x7fcb800ce240 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284030503 0 0) 0x7fcb6c003520 con 0x7fcb800ce240 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 msgr2=0x7fcb80157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb80157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 >> v2:172.21.15.125:3300/0 conn(0x7fcb800cde60 msgr2=0x7fcb8015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 --2- 172.21.15.93:0/3578840261 >> v2:172.21.15.125:3300/0 conn(0x7fcb800cde60 0x7fcb8015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800d1120 con 0x7fcb800ce240 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fcb780019f0 con 0x7fcb800ce240 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb767fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb80157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 >> v1:172.21.15.93:6789/0 conn(0x7fcb800ce240 legacy=0x7fcb8006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.370+0000 7fcb7e7fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb6c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7e7fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c003eb0 0x7fcb6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7e7fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb6c004d00 0x7fcb6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e5c0 con 0x7fcb6c004d00 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e2e0 con 0x7fcb6c003eb0 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c00b9b0 con 0x7fcb8015daa0 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb6c004d00 0x7fcb6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb767fc640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c003eb0 0x7fcb6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7effd640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb6c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 -- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 msgr2=0x7fcb6c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb8015daa0 0x7fcb6c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 -- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c003eb0 msgr2=0x7fcb6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c003eb0 0x7fcb6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.371+0000 7fcb7f7fe640 1 -- 172.21.15.93:0/3578840261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c003520 con 0x7fcb6c004d00 2023-11-04T01:39:47.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb7f7fe640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb6c004d00 0x7fcb6c005180 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800a860 tx=0x7fcb6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f099e39b4bf82662 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78034630 con 0x7fcb6c004d00 2023-11-04T01:39:47.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7802f070 con 0x7fcb6c004d00 2023-11-04T01:39:47.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb7e7fc640 1 -- 172.21.15.93:0/3578840261 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78034a30 con 0x7fcb6c004d00 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 -- 172.21.15.93:0/3578840261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb6c004d00 msgr2=0x7fcb6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 --2- 172.21.15.93:0/3578840261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb6c004d00 0x7fcb6c005180 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800a860 tx=0x7fcb6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb7f7fe640 1 -- 172.21.15.93:0/3578840261 reap_dead start 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 -- 172.21.15.93:0/3578840261 shutdown_connections 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 -- 172.21.15.93:0/3578840261 >> 172.21.15.93:0/3578840261 conn(0x7fcb80071f30 msgr2=0x7fcb800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 -- 172.21.15.93:0/3578840261 shutdown_connections 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.372+0000 7fcb85a44640 1 -- 172.21.15.93:0/3578840261 wait complete. 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.374+0000 7fcb85a44640 1 Processor -- start 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.374+0000 7fcb85a44640 1 -- start start 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c004d00 0x7fcb8014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb800d1b80 0x7fcb8015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800d2000 con 0x7fcb801599e0 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8014d710 con 0x7fcb6c004d00 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80158c20 con 0x7fcb800d1b80 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36324/0 (socket says 172.21.15.93:36324) 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 -- 172.21.15.93:0/350860132 learned_addr learned my addr 172.21.15.93:0/350860132 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb7f7fe640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb800d1b80 0x7fcb8015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb7effd640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c004d00 0x7fcb8014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 -- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb800d1b80 msgr2=0x7fcb8015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb800d1b80 0x7fcb8015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 -- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c004d00 msgr2=0x7fcb8014d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c004d00 0x7fcb8014d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 -- 172.21.15.93:0/350860132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80158f00 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb767fc640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fcb680115c0 tx=0x7fcb68011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800c070 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68004220 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb801591e0 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800f6f0 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.375+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb801588f0 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.376+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb80074290 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.377+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb6800f850 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.377+0000 7fcb7cff9640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 0x7fcb6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.377+0000 7fcb7effd640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 0x7fcb6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.377+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fcb68089b70 con 0x7fcb801599e0 2023-11-04T01:39:47.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.378+0000 7fcb7effd640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 0x7fcb6006d360 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009b80 tx=0x7fcb70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.382+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb68054660 con 0x7fcb801599e0 2023-11-04T01:39:47.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.580+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb800b6840 con 0x7fcb801599e0 2023-11-04T01:39:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.581+0000 7fcb7cff9640 1 -- 172.21.15.93:0/350860132 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fcb68057c80 con 0x7fcb801599e0 2023-11-04T01:39:47.583 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:47.583 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:36.053577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 49 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 msgr2=0x7fcb6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 0x7fcb6006d360 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009b80 tx=0x7fcb70008040 comp rx=0 tx=0).stop 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 msgr2=0x7fcb800d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fcb680115c0 tx=0x7fcb68011a80 comp rx=0 tx=0).stop 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 shutdown_connections 2023-11-04T01:39:47.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcb6006aea0 0x7fcb6006d360 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcb800d1b80 0x7fcb8015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcb801599e0 0x7fcb800d1640 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 --2- 172.21.15.93:0/350860132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c004d00 0x7fcb8014d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.582+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 >> 172.21.15.93:0/350860132 conn(0x7fcb80071f30 msgr2=0x7fcb800d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.583+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 shutdown_connections 2023-11-04T01:39:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:47.583+0000 7fcb85a44640 1 -- 172.21.15.93:0/350860132 wait complete. 2023-11-04T01:39:47.596 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:39:51.848 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:51.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:52.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 Processor -- start 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 -- start start 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f49700cde60 0x7f497015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497015e000 con 0x7f497015daa0 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497015e2e0 con 0x7f49700ce240 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.704+0000 7f49766d4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497015e5c0 con 0x7f49700cde60 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f497015daa0 0x7f4970157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42608/0 (socket says 172.21.15.93:42608) 2023-11-04T01:39:52.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496f7fe640 1 -- 172.21.15.93:0/4078022604 learned_addr learned my addr 172.21.15.93:0/4078022604 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496ffff640 1 --2- 172.21.15.93:0/4078022604 >> v2:172.21.15.125:3300/0 conn(0x7f49700cde60 0x7f497015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472319464 0 0) 0x7f497015e000 con 0x7f497015daa0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4958003520 con 0x7f497015daa0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571804186 0 0) 0x7f4958003520 con 0x7f497015daa0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 >> v2:172.21.15.125:3300/0 conn(0x7f49700cde60 msgr2=0x7f497015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 --2- 172.21.15.93:0/4078022604 >> v2:172.21.15.125:3300/0 conn(0x7f49700cde60 0x7f497015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 >> v1:172.21.15.125:6789/0 conn(0x7f49700ce240 legacy=0x7f49700d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700d1120 con 0x7f497015daa0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4964001670 con 0x7f497015daa0 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 >> v1:172.21.15.93:6789/0 conn(0x7f497015daa0 legacy=0x7f4970157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958003970 0x7f4958003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497015e5c0 con 0x7f4958005180 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c020 con 0x7f49580047c0 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c1e0 con 0x7f4958003970 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.705+0000 7f4974c71640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f496f7fe640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f496ffff640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958003970 0x7f4958003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 -- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958003970 msgr2=0x7f4958003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4958003970 0x7f4958003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 -- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 msgr2=0x7f4958004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49580047c0 0x7f4958004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 -- 172.21.15.93:0/4078022604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958003520 con 0x7f4958005180 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.706+0000 7f4974c71640 1 -- 172.21.15.93:0/4078022604 reap_dead start 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f4974c71640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f495800b980 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4968001e20 tx=0x7f49580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dd320da28f113 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968003b70 con 0x7f4958005180 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4968003cd0 con 0x7f4958005180 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f496effd640 1 -- 172.21.15.93:0/4078022604 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968005310 con 0x7f4958005180 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 -- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 msgr2=0x7f495800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f495800b980 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4968001e20 tx=0x7f49580057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 -- 172.21.15.93:0/4078022604 shutdown_connections 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 --2- 172.21.15.93:0/4078022604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f495800b980 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 -- 172.21.15.93:0/4078022604 >> 172.21.15.93:0/4078022604 conn(0x7f4970071f30 msgr2=0x7f49700cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 -- 172.21.15.93:0/4078022604 shutdown_connections 2023-11-04T01:39:52.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.707+0000 7f49766d4640 1 -- 172.21.15.93:0/4078022604 wait complete. 2023-11-04T01:39:52.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.708+0000 7f49766d4640 1 Processor -- start 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 -- start start 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 0x7f49701556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 0x7f497015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4970155c20 con 0x7f4958005180 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497015a770 con 0x7f4970155260 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f49766d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49701f3080 con 0x7f4970159db0 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f496ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f496ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56944/0 (socket says 172.21.15.93:56944) 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.709+0000 7f496ffff640 1 -- 172.21.15.93:0/3417993201 learned_addr learned my addr 172.21.15.93:0/3417993201 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496f7fe640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 0x7f49701556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f4974c71640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 0x7f497015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 -- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 msgr2=0x7f497015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 0x7f497015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 -- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 msgr2=0x7f49701556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 0x7f49701556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 -- 172.21.15.93:0/3417993201 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49701549a0 con 0x7f4958005180 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496f7fe640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 0x7f49701556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f4974c71640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 0x7f497015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496ffff640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4960011940 tx=0x7f4960011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000fa90 con 0x7f4958005180 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000fbf0 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49701567b0 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960014440 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.710+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49701f2a30 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.711+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4970074290 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.712+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49600145a0 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.712+0000 7f496cff9640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 0x7f495c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.712+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f496008a420 con 0x7f4958005180 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.712+0000 7f496f7fe640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 0x7f495c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.713+0000 7f496f7fe640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 0x7f495c06d360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4970159ae0 tx=0x7f4964009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.717+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4960054f10 con 0x7f4958005180 2023-11-04T01:39:52.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.918+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49700b6f90 con 0x7f4958005180 2023-11-04T01:39:52.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.918+0000 7f496cff9640 1 -- 172.21.15.93:0/3417993201 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4981 (secure 0 0 0) 0x7f4960058530 con 0x7f4958005180 2023-11-04T01:39:52.921 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:52.921 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:52.048318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7359,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6836/2331318607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2331318607},{"type":"v1","addr":"172.21.15.93:6836","nonce":2331318607}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:39:52.048318+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:52.921 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 50 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 msgr2=0x7f495c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 0x7f495c06d360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4970159ae0 tx=0x7f4964009040 comp rx=0 tx=0).stop 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 msgr2=0x7f4970154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4960011940 tx=0x7f4960011e00 comp rx=0 tx=0).stop 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 shutdown_connections 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f495c06aea0 0x7f495c06d360 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4970159db0 0x7f497015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4970155260 0x7f49701556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 --2- 172.21.15.93:0/3417993201 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4958005180 0x7f4970154460 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 >> 172.21.15.93:0/3417993201 conn(0x7f4970071f30 msgr2=0x7f49700b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 shutdown_connections 2023-11-04T01:39:52.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:52.920+0000 7f49766d4640 1 -- 172.21.15.93:0/3417993201 wait complete. 2023-11-04T01:39:52.933 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:39:52.934 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:39:52.959 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:39:52.960 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:39:52.960 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:39:53.029 INFO:teuthology.orchestra.run.smithi093.stdout:1699061976.146960.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:39:53.031 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699061976.146960.core'] 2023-11-04T01:39:53.031 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699061976.146960.core, deleting it 2023-11-04T01:39:53.031 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699061976.146960.core 2023-11-04T01:39:53.101 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:39:53.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 Processor -- start 2023-11-04T01:39:53.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 -- start start 2023-11-04T01:39:53.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdcd40cd6d0 0x7fdcd4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdcd40b4880 0x7fdcd40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd40cde60 con 0x7fdcd4153e60 2023-11-04T01:39:53.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd4160f90 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdcd93f5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd4161960 con 0x7fdcd40b4880 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.240+0000 7fdccbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdcd40cd6d0 0x7fdcd4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdcd40cd6d0 0x7fdcd4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56956/0 (socket says 172.21.15.93:56956) 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 -- 172.21.15.93:0/3400121771 learned_addr learned my addr 172.21.15.93:0/3400121771 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdcd37fe640 1 --2- 172.21.15.93:0/3400121771 >> v2:172.21.15.125:3300/0 conn(0x7fdcd40b4880 0x7fdcd40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 -- 172.21.15.93:0/3400121771 >> v2:172.21.15.125:3300/0 conn(0x7fdcd40b4880 msgr2=0x7fdcd40b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 --2- 172.21.15.93:0/3400121771 >> v2:172.21.15.125:3300/0 conn(0x7fdcd40b4880 0x7fdcd40b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 -- 172.21.15.93:0/3400121771 >> v1:172.21.15.125:6789/0 conn(0x7fdcd4153e60 legacy=0x7fdcd415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.241+0000 7fdccbfff640 1 -- 172.21.15.93:0/3400121771 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40b5220 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdccbfff640 1 --2- 172.21.15.93:0/3400121771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4161420 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40b8f40 tx=0x7fdcbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c7b269d009a0f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd27fc640 1 -- 172.21.15.93:0/3400121771 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc031870 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd27fc640 1 -- 172.21.15.93:0/3400121771 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0319d0 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd27fc640 1 -- 172.21.15.93:0/3400121771 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc031d60 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 -- 172.21.15.93:0/3400121771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 msgr2=0x7fdcd4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/3400121771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4161420 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40b8f40 tx=0x7fdcbc02b910 comp rx=0 tx=0).stop 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 -- 172.21.15.93:0/3400121771 shutdown_connections 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/3400121771 >> v2:172.21.15.125:3300/0 conn(0x7fdcd40b4880 0x7fdcd40b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/3400121771 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4161420 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 -- 172.21.15.93:0/3400121771 >> 172.21.15.93:0/3400121771 conn(0x7fdcd40cf880 msgr2=0x7fdcd40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 -- 172.21.15.93:0/3400121771 shutdown_connections 2023-11-04T01:39:53.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.242+0000 7fdcd93f5640 1 -- 172.21.15.93:0/3400121771 wait complete. 2023-11-04T01:39:53.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.243+0000 7fdcd93f5640 1 Processor -- start 2023-11-04T01:39:53.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.243+0000 7fdcd93f5640 1 -- start start 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 0x7fdcd4152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 0x7fdcd40c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4157e80 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4157120 con 0x7fdcd4153e60 2023-11-04T01:39:53.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd93f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4158120 con 0x7fdcd40b4880 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56960/0 (socket says 172.21.15.93:56960) 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdccbfff640 1 -- 172.21.15.93:0/2698057003 learned_addr learned my addr 172.21.15.93:0/2698057003 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd37fe640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 0x7fdcd40c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.244+0000 7fdcd2ffd640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 0x7fdcd4152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 -- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 msgr2=0x7fdcd4152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 0x7fdcd4152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 -- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 msgr2=0x7fdcd40c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 0x7fdcd40c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 -- 172.21.15.93:0/2698057003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0094d0 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdcd37fe640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 0x7fdcd40c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdcd2ffd640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 0x7fdcd4152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccbfff640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc03abe0 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc03ad40 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd4158400 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc044610 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.245+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd4156d80 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.246+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4158920 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.246+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcbc04d450 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.247+0000 7fdccb7fe640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 0x7fdcb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.247+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fdcbc02d040 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.247+0000 7fdcd2ffd640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 0x7fdcb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.247+0000 7fdcd2ffd640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 0x7fdcb406d360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006fd0 tx=0x7fdcc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.251+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcd4158920 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:39:53.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.483+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fdcd4158920 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.485+0000 7fdccb7fe640 1 -- 172.21.15.93:0/2698057003 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7359 v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdcd4158920 con 0x7fdcd40cd6d0 2023-11-04T01:39:53.488 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 7359 2023-11-04T01:39:53.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.488+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 msgr2=0x7fdcb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.488+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 0x7fdcb406d360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006fd0 tx=0x7fdcc4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.488+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 msgr2=0x7fdcd4156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.488+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 shutdown_connections 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdcb406aea0 0x7fdcb406d360 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4153e60 0x7fdcd40c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcd40cd6d0 0x7fdcd4156840 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 --2- 172.21.15.93:0/2698057003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcd40b4880 0x7fdcd4152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 >> 172.21.15.93:0/2698057003 conn(0x7fdcd40cf880 msgr2=0x7fdcd40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 shutdown_connections 2023-11-04T01:39:53.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.489+0000 7fdcd93f5640 1 -- 172.21.15.93:0/2698057003 wait complete. 2023-11-04T01:39:53.505 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:53.505 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:39:53.505 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:39:53.505 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:53.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:53.505 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:39:53.506 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:39:53.507 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:53.509 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:53.509 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:53.585 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:39:53.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.610+0000 7fccaca87640 1 Processor -- start 2023-11-04T01:39:53.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.610+0000 7fccaca87640 1 -- start start 2023-11-04T01:39:53.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fccaca87640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 0x7fcca815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fccaca87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fccaca87640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca815e000 con 0x7fcca80ce240 2023-11-04T01:39:53.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fccaca87640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca815e5c0 con 0x7fcca80cde60 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fccaca87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca815e2e0 con 0x7fcca815daa0 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fcca6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcca80ce240 0x7fcca806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42610/0 (socket says 172.21.15.93:42610) 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fcca6d9d640 1 -- 172.21.15.93:0/318931978 learned_addr learned my addr 172.21.15.93:0/318931978 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fcca659c640 1 --2- 172.21.15.93:0/318931978 >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 0x7fcca815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.611+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/318931978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcca5d9b640 1 -- 172.21.15.93:0/318931978 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478220395 0 0) 0x7fcca815e000 con 0x7fcca80ce240 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcca5d9b640 1 -- 172.21.15.93:0/318931978 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc94003520 con 0x7fcca80ce240 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcc9ffff640 1 -- 172.21.15.93:0/318931978 >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 msgr2=0x7fcca815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/318931978 >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 0x7fcca815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcc9ffff640 1 -- 172.21.15.93:0/318931978 >> v1:172.21.15.93:6789/0 conn(0x7fcca80ce240 legacy=0x7fcca806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcc9ffff640 1 -- 172.21.15.93:0/318931978 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80d1120 con 0x7fcca815daa0 2023-11-04T01:39:53.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcca659c640 1 --2- 172.21.15.93:0/318931978 >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 0x7fcca815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.612+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/318931978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca8157000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc900097a0 tx=0x7fcc9002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb404c51e7be9be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fcca5d9b640 1 -- 172.21.15.93:0/318931978 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90031830 con 0x7fcca815daa0 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fcca5d9b640 1 -- 172.21.15.93:0/318931978 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90031990 con 0x7fcca815daa0 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fcca5d9b640 1 -- 172.21.15.93:0/318931978 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90031d00 con 0x7fcca815daa0 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 -- 172.21.15.93:0/318931978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 msgr2=0x7fcca8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 --2- 172.21.15.93:0/318931978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca8157000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc900097a0 tx=0x7fcc9002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 -- 172.21.15.93:0/318931978 shutdown_connections 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 --2- 172.21.15.93:0/318931978 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca8157000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 --2- 172.21.15.93:0/318931978 >> v2:172.21.15.125:3300/0 conn(0x7fcca80cde60 0x7fcca815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 -- 172.21.15.93:0/318931978 >> 172.21.15.93:0/318931978 conn(0x7fcca8071f30 msgr2=0x7fcca80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 -- 172.21.15.93:0/318931978 shutdown_connections 2023-11-04T01:39:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.613+0000 7fccaca87640 1 -- 172.21.15.93:0/318931978 wait complete. 2023-11-04T01:39:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 Processor -- start 2023-11-04T01:39:53.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 -- start start 2023-11-04T01:39:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcca80ce240 0x7fcca80c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca81f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80ca430 con 0x7fcca80cde60 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80cb1a0 con 0x7fcca80ce240 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fccaca87640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80cb480 con 0x7fcca815daa0 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fcca659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fcca659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:56992/0 (socket says 172.21.15.93:56992) 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fcca659c640 1 -- 172.21.15.93:0/1038906656 learned_addr learned my addr 172.21.15.93:0/1038906656 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcca80ce240 0x7fcca80c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.615+0000 7fcca6d9d640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca81f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 -- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 msgr2=0x7fcca81f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca81f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 -- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcca80ce240 msgr2=0x7fcca80c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcca80ce240 0x7fcca80c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 -- 172.21.15.93:0/1038906656 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009400 con 0x7fcca80cde60 2023-11-04T01:39:53.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcca659c640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ebe0 tx=0x7fcc9800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98009760 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800cc30 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc90009400 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800eee0 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.616+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca81541d0 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.617+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8074290 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.617+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc98013470 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.618+0000 7fcc9effd640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 0x7fcc8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.618+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fcc98089e20 con 0x7fcca80cde60 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.618+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 0x7fcc8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.618+0000 7fcc9ffff640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 0x7fcc8806d360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.622+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc98054970 con 0x7fcca80cde60 2023-11-04T01:39:53.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.821+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcca80c66f0 con 0x7fcca80cde60 2023-11-04T01:39:53.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.822+0000 7fcc9effd640 1 -- 172.21.15.93:0/1038906656 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4142 (secure 0 0 0) 0x7fcc98017090 con 0x7fcca80cde60 2023-11-04T01:39:53.824 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:53.824 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:53.490773+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:53.825 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 52 2023-11-04T01:39:53.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 msgr2=0x7fcc8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 0x7fcc8806d360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc90008030 comp rx=0 tx=0).stop 2023-11-04T01:39:53.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 msgr2=0x7fcca80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ebe0 tx=0x7fcc9800c520 comp rx=0 tx=0).stop 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 shutdown_connections 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcc8806aea0 0x7fcc8806d360 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcca815daa0 0x7fcca81f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcca80ce240 0x7fcca80c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 --2- 172.21.15.93:0/1038906656 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcca80cde60 0x7fcca80cabc0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 >> 172.21.15.93:0/1038906656 conn(0x7fcca8071f30 msgr2=0x7fcca80c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 shutdown_connections 2023-11-04T01:39:53.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:53.824+0000 7fccaca87640 1 -- 172.21.15.93:0/1038906656 wait complete. 2023-11-04T01:39:53.837 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:39:58.057 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:58.058 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:39:58.837 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:58.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.945+0000 7ff12bb3c640 1 Processor -- start 2023-11-04T01:39:58.947 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.945+0000 7ff12bb3c640 1 -- start start 2023-11-04T01:39:58.948 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12bb3c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff124159c70 0x7ff1240ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12bb3c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff1240b0ae0 0x7ff12415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12bb3c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1240b4110 con 0x7ff12406db20 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12bb3c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1240b49b0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12bb3c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1240b43f0 con 0x7ff124159c70 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12a0d9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff1240b0ae0 0x7ff12415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff1290d7640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff12406db20 0x7ff1240b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42616/0 (socket says 172.21.15.93:42616) 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff1290d7640 1 -- 172.21.15.93:0/2101016778 learned_addr learned my addr 172.21.15.93:0/2101016778 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff1298d8640 1 --2- 172.21.15.93:0/2101016778 >> v2:172.21.15.125:3300/0 conn(0x7ff124159c70 0x7ff1240ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12a0d9640 1 -- 172.21.15.93:0/2101016778 >> v2:172.21.15.125:3300/0 conn(0x7ff124159c70 msgr2=0x7ff1240ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12a0d9640 1 --2- 172.21.15.93:0/2101016778 >> v2:172.21.15.125:3300/0 conn(0x7ff124159c70 0x7ff1240ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.949 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12a0d9640 1 -- 172.21.15.93:0/2101016778 >> v1:172.21.15.93:6789/0 conn(0x7ff12406db20 legacy=0x7ff1240b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.946+0000 7ff12a0d9640 1 -- 172.21.15.93:0/2101016778 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240b46d0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.947+0000 7ff12a0d9640 1 --2- 172.21.15.93:0/2101016778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12415d7d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc440 tx=0x7ff11c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39797333c30fa749 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.947+0000 7ff1288d6640 1 -- 172.21.15.93:0/2101016778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c02cc80 con 0x7ff1240b0ae0 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.947+0000 7ff1288d6640 1 -- 172.21.15.93:0/2101016778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c02cde0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.947+0000 7ff1288d6640 1 -- 172.21.15.93:0/2101016778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c034660 con 0x7ff1240b0ae0 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 -- 172.21.15.93:0/2101016778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 msgr2=0x7ff12415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/2101016778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12415d7d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff1240cc440 tx=0x7ff11c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 -- 172.21.15.93:0/2101016778 shutdown_connections 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/2101016778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12415d7d0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/2101016778 >> v2:172.21.15.125:3300/0 conn(0x7ff124159c70 0x7ff1240ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 -- 172.21.15.93:0/2101016778 >> 172.21.15.93:0/2101016778 conn(0x7ff1240ce950 msgr2=0x7ff1240ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 -- 172.21.15.93:0/2101016778 shutdown_connections 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.948+0000 7ff12bb3c640 1 -- 172.21.15.93:0/2101016778 wait complete. 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.949+0000 7ff12bb3c640 1 Processor -- start 2023-11-04T01:39:58.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.949+0000 7ff12bb3c640 1 -- start start 2023-11-04T01:39:58.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12406db20 0x7ff1240b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 0x7ff124154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12414fa50 con 0x7ff1240b0ae0 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124156580 con 0x7ff12406db20 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff124156860 con 0x7ff124159c70 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57000/0 (socket says 172.21.15.93:57000) 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 -- 172.21.15.93:0/3994169462 learned_addr learned my addr 172.21.15.93:0/3994169462 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1298d8640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12406db20 0x7ff1240b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12a0d9640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 0x7ff124154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 -- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 msgr2=0x7ff124154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 0x7ff124154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 -- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12406db20 msgr2=0x7ff1240b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12406db20 0x7ff1240b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 -- 172.21.15.93:0/3994169462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009a70 con 0x7ff1240b0ae0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12a0d9640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 0x7ff124154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff1290d7640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff11400e8c0 tx=0x7ff11400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400cea0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114005ce0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114007270 con 0x7ff1240b0ae0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff124156b40 con 0x7ff1240b0ae0 2023-11-04T01:39:58.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.951+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1240c6a80 con 0x7ff1240b0ae0 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.952+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124074290 con 0x7ff1240b0ae0 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.952+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1140073d0 con 0x7ff1240b0ae0 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.952+0000 7ff11a7fc640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.952+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ff11408c340 con 0x7ff1240b0ae0 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.952+0000 7ff1298d8640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.953+0000 7ff1298d8640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 0x7ff10806d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff120006fd0 tx=0x7ff120008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:58.957+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff114056de0 con 0x7ff1240b0ae0 2023-11-04T01:39:59.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.157+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12406d3f0 con 0x7ff1240b0ae0 2023-11-04T01:39:59.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.157+0000 7ff11a7fc640 1 -- 172.21.15.93:0/3994169462 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4931 (secure 0 0 0) 0x7ff11405a400 con 0x7ff1240b0ae0 2023-11-04T01:39:59.159 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:56.505734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:59.159 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 56 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 msgr2=0x7ff10806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 0x7ff10806d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff120006fd0 tx=0x7ff120008040 comp rx=0 tx=0).stop 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 msgr2=0x7ff12414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff11400e8c0 tx=0x7ff11400ed80 comp rx=0 tx=0).stop 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 shutdown_connections 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff124159c70 0x7ff124154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1240b0ae0 0x7ff12414f510 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 --2- 172.21.15.93:0/3994169462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12406db20 0x7ff1240b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 >> 172.21.15.93:0/3994169462 conn(0x7ff1240ce950 msgr2=0x7ff1240cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 shutdown_connections 2023-11-04T01:39:59.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.159+0000 7ff12bb3c640 1 -- 172.21.15.93:0/3994169462 wait complete. 2023-11-04T01:39:59.171 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:39:59.171 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:59.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.270+0000 7ff84ba1a640 1 Processor -- start 2023-11-04T01:39:59.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.270+0000 7ff84ba1a640 1 -- start start 2023-11-04T01:39:59.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff84415ae40 0x7ff84415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff8440cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8440cd860 0x7ff8440b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440cc450 con 0x7ff84415ae40 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84415f400 con 0x7ff8440cd860 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff84ba1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84415b220 con 0x7ff8440cbc00 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff84415ae40 0x7ff84415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff84415ae40 0x7ff84415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57008/0 (socket says 172.21.15.93:57008) 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 -- 172.21.15.93:0/850778419 learned_addr learned my addr 172.21.15.93:0/850778419 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 -- 172.21.15.93:0/850778419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 msgr2=0x7ff8440cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff848fb5640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff8440cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff849fb7640 1 --2- 172.21.15.93:0/850778419 >> v2:172.21.15.125:3300/0 conn(0x7ff8440cd860 0x7ff8440b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff8440cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 -- 172.21.15.93:0/850778419 >> v2:172.21.15.125:3300/0 conn(0x7ff8440cd860 msgr2=0x7ff8440b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 --2- 172.21.15.93:0/850778419 >> v2:172.21.15.125:3300/0 conn(0x7ff8440cd860 0x7ff8440b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.271+0000 7ff8497b6640 1 -- 172.21.15.93:0/850778419 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84415f890 con 0x7ff84415ae40 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff8497b6640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84415ae40 0x7ff84415bfb0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff84415f370 tx=0x7ff84002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03617709da5208d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff83bfff640 1 -- 172.21.15.93:0/850778419 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840031870 con 0x7ff84415ae40 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff83bfff640 1 -- 172.21.15.93:0/850778419 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400319d0 con 0x7ff84415ae40 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff83bfff640 1 -- 172.21.15.93:0/850778419 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840031d60 con 0x7ff84415ae40 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff84ba1a640 1 -- 172.21.15.93:0/850778419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84415ae40 msgr2=0x7ff84415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.272+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84415ae40 0x7ff84415bfb0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff84415f370 tx=0x7ff84002b910 comp rx=0 tx=0).stop 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 -- 172.21.15.93:0/850778419 shutdown_connections 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/850778419 >> v2:172.21.15.125:3300/0 conn(0x7ff8440cd860 0x7ff8440b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff8440cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/850778419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84415ae40 0x7ff84415bfb0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 -- 172.21.15.93:0/850778419 >> 172.21.15.93:0/850778419 conn(0x7ff84406ea90 msgr2=0x7ff84406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 -- 172.21.15.93:0/850778419 shutdown_connections 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.273+0000 7ff84ba1a640 1 -- 172.21.15.93:0/850778419 wait complete. 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 Processor -- start 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 -- start start 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff84414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84415ae40 0x7ff8440c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844150bf0 con 0x7ff8440cd860 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844150e60 con 0x7ff84415ae40 2023-11-04T01:39:59.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.274+0000 7ff84ba1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844151140 con 0x7ff8440cbc00 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57024/0 (socket says 172.21.15.93:57024) 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 -- 172.21.15.93:0/3725832830 learned_addr learned my addr 172.21.15.93:0/3725832830 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff849fb7640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84415ae40 0x7ff8440c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff8497b6640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff84414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 -- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 msgr2=0x7ff84414f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff84414f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 -- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84415ae40 msgr2=0x7ff8440c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84415ae40 0x7ff8440c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 -- 172.21.15.93:0/3725832830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400094d0 con 0x7ff8440cd860 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff848fb5640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c7f0 tx=0x7ff83400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834004220 con 0x7ff8440cd860 2023-11-04T01:39:59.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834004380 con 0x7ff8440cd860 2023-11-04T01:39:59.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834007860 con 0x7ff8440cd860 2023-11-04T01:39:59.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844151420 con 0x7ff8440cd860 2023-11-04T01:39:59.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.275+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8441e52a0 con 0x7ff8440cd860 2023-11-04T01:39:59.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.276+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8440ce2d0 con 0x7ff8440cd860 2023-11-04T01:39:59.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.277+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff834007bd0 con 0x7ff8440cd860 2023-11-04T01:39:59.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.277+0000 7ff839ffb640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.277+0000 7ff8497b6640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.277+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ff834089b50 con 0x7ff8440cd860 2023-11-04T01:39:59.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.277+0000 7ff8497b6640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 0x7ff82806d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff840036000 tx=0x7ff84003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.281+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8340545f0 con 0x7ff8440cd860 2023-11-04T01:39:59.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.484+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff844074290 con 0x7ff8440cd860 2023-11-04T01:39:59.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.485+0000 7ff839ffb640 1 -- 172.21.15.93:0/3725832830 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4931 (secure 0 0 0) 0x7ff834057c10 con 0x7ff8440cd860 2023-11-04T01:39:59.486 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:39:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:56.505734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:59.486 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 56 2023-11-04T01:39:59.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 msgr2=0x7ff82806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 0x7ff82806d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff840036000 tx=0x7ff84003c040 comp rx=0 tx=0).stop 2023-11-04T01:39:59.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 msgr2=0x7ff8440c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c7f0 tx=0x7ff83400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 shutdown_connections 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff84415ae40 0x7ff8440c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8440cd860 0x7ff8440c6390 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 --2- 172.21.15.93:0/3725832830 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff8440cbc00 0x7ff84414f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 >> 172.21.15.93:0/3725832830 conn(0x7ff84406ea90 msgr2=0x7ff8440ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 shutdown_connections 2023-11-04T01:39:59.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:39:59.487+0000 7ff84ba1a640 1 -- 172.21.15.93:0/3725832830 wait complete. 2023-11-04T01:39:59.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:39:56.505734+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5747, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5747': {'gid': 5747, 'name': 'd', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.125:6834/596691451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6832', 'nonce': 596691451}, {'type': 'v1', 'addr': '172.21.15.125:6834', 'nonce': 596691451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:59.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:39:59.902 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:40:00.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.002+0000 7f679873c640 1 Processor -- start 2023-11-04T01:40:00.003 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.002+0000 7f679873c640 1 -- start start 2023-11-04T01:40:00.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f679873c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6790070ff0 0x7f67900cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f679873c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900c9bf0 con 0x7f6790066000 2023-11-04T01:40:00.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f679873c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900cd890 con 0x7f679015d1b0 2023-11-04T01:40:00.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f679873c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67900cdb30 con 0x7f6790070ff0 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f6796cd9640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6790066000 0x7f679006a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42624/0 (socket says 172.21.15.93:42624) 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f6796cd9640 1 -- 172.21.15.93:0/3523325600 learned_addr learned my addr 172.21.15.93:0/3523325600 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305994082 0 0) 0x7f67900c9bf0 con 0x7f6790066000 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c003520 con 0x7f6790066000 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.003+0000 7f67964d8640 1 --2- 172.21.15.93:0/3523325600 >> v2:172.21.15.125:3300/0 conn(0x7f6790070ff0 0x7f67900cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795672239 0 0) 0x7f677c003520 con 0x7f6790066000 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 >> v2:172.21.15.125:3300/0 conn(0x7f6790070ff0 msgr2=0x7f67900cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 --2- 172.21.15.93:0/3523325600 >> v2:172.21.15.125:3300/0 conn(0x7f6790070ff0 0x7f67900cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 >> v1:172.21.15.125:6789/0 conn(0x7f679015d1b0 legacy=0x7f67900713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900cde10 con 0x7f6790066000 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f67880019f0 con 0x7f6790066000 2023-11-04T01:40:00.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 >> v1:172.21.15.93:6789/0 conn(0x7f6790066000 legacy=0x7f679006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f677c003970 0x7f677c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f677c0047c0 0x7f677c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f677c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900cdb30 con 0x7f677c005180 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c00c0d0 con 0x7f677c003970 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c00c290 con 0x7f677c0047c0 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67964d8640 1 --2- 172.21.15.93:0/3523325600 >> v2:172.21.15.125:3300/0 conn(0x7f6790070ff0 0x7f67900cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f677c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f677c0047c0 0x7f677c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67964d8640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f677c003970 0x7f677c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 -- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f677c0047c0 msgr2=0x7f677c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f677c0047c0 0x7f677c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 -- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f677c003970 msgr2=0x7f677c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f677c003970 0x7f677c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f6796cd9640 1 -- 172.21.15.93:0/3523325600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c003520 con 0x7f677c005180 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.004+0000 7f67964d8640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f677c003970 0x7f677c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f6796cd9640 1 -- 172.21.15.93:0/3523325600 reap_dead start 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f677c00b980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f678800a830 tx=0x7f677c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fa5193141a229c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880072d0 con 0x7f677c005180 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678802f070 con 0x7f677c005180 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f67954d6640 1 -- 172.21.15.93:0/3523325600 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788007650 con 0x7f677c005180 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f679873c640 1 -- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 msgr2=0x7f677c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.005+0000 7f679873c640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f677c00b980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f678800a830 tx=0x7f677c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.006+0000 7f679873c640 1 -- 172.21.15.93:0/3523325600 shutdown_connections 2023-11-04T01:40:00.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.006+0000 7f679873c640 1 --2- 172.21.15.93:0/3523325600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f677c00b980 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.006+0000 7f679873c640 1 -- 172.21.15.93:0/3523325600 >> 172.21.15.93:0/3523325600 conn(0x7f67900cbc90 msgr2=0x7f67900cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.006+0000 7f679873c640 1 -- 172.21.15.93:0/3523325600 shutdown_connections 2023-11-04T01:40:00.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.006+0000 7f679873c640 1 -- 172.21.15.93:0/3523325600 wait complete. 2023-11-04T01:40:00.015 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 Processor -- start 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 -- start start 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67900b2f70 0x7f679015e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679015e890 0x7f67900b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679015ed10 con 0x7f677c005180 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900b33f0 con 0x7f679015e890 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.007+0000 7f679873c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900b1ed0 con 0x7f67900b2f70 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57038/0 (socket says 172.21.15.93:57038) 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 -- 172.21.15.93:0/1877652797 learned_addr learned my addr 172.21.15.93:0/1877652797 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.016 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 -- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67900b2f70 msgr2=0x7f679015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67900b2f70 0x7f679015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 -- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679015e890 msgr2=0x7f67900b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f6796cd9640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679015e890 0x7f67900b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679015e890 0x7f67900b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 -- 172.21.15.93:0/1877652797 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900b21b0 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f67964d8640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f678c010890 tx=0x7f678c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f6786ffd640 1 -- 172.21.15.93:0/1877652797 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00cae0 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f6786ffd640 1 -- 172.21.15.93:0/1877652797 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c00cc40 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67900b2490 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f6786ffd640 1 -- 172.21.15.93:0/1877652797 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00ee50 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.008+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900b2a50 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.010+0000 7f6786ffd640 1 -- 172.21.15.93:0/1877652797 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f678c015470 con 0x7f677c005180 2023-11-04T01:40:00.017 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.010+0000 7f6786ffd640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 0x7f677406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.010+0000 7f6786ffd640 1 -- 172.21.15.93:0/1877652797 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f678c08a280 con 0x7f677c005180 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.010+0000 7f6795cd7640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 0x7f677406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.011+0000 7f6795cd7640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 0x7f677406d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f679015f020 tx=0x7f6780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.011+0000 7f679b3af740 1 Processor -- start 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.011+0000 7f679b3af740 1 -- start start 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c6375c90 0x5611c63a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c6286740 con 0x5611c63a2850 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c62e88d0 con 0x5611c63a2c30 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611c62e5fc0 con 0x5611c6375c90 2023-11-04T01:40:00.018 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57042/0 (socket says 172.21.15.93:57042) 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 -- 172.21.15.93:0/1557683445 learned_addr learned my addr 172.21.15.93:0/1557683445 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 -- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c6375c90 msgr2=0x5611c63a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c6375c90 0x5611c63a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 -- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 msgr2=0x5611c63a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 -- 172.21.15.93:0/1557683445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c62a4ca0 con 0x5611c63a2850 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.012+0000 7f67964d8640 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f678c0607b0 tx=0x7f678c0590e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7703b86b51f07d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f6773fff640 1 -- 172.21.15.93:0/1557683445 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c08a0f0 con 0x5611c63a2850 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f6773fff640 1 -- 172.21.15.93:0/1557683445 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c05cb30 con 0x5611c63a2850 2023-11-04T01:40:00.019 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f6773fff640 1 -- 172.21.15.93:0/1557683445 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c060ce0 con 0x5611c63a2850 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 -- 172.21.15.93:0/1557683445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 msgr2=0x5611c6375750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f678c0607b0 tx=0x7f678c0590e0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 -- 172.21.15.93:0/1557683445 shutdown_connections 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c6375c90 0x5611c63a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 --2- 172.21.15.93:0/1557683445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c6375750 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 -- 172.21.15.93:0/1557683445 >> 172.21.15.93:0/1557683445 conn(0x5611c6377a60 msgr2=0x5611c63c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 -- 172.21.15.93:0/1557683445 shutdown_connections 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.013+0000 7f679b3af740 1 -- 172.21.15.93:0/1557683445 wait complete. 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.014+0000 7f679b3af740 1 -- start start 2023-11-04T01:40:00.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.014+0000 7f679b3af740 1 Processor -- start 2023-11-04T01:40:00.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c62e18b0 con 0x5611c63bac10 2023-11-04T01:40:00.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c629bc80 con 0x5611c63a2c30 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611c629b920 con 0x5611c63a2850 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f679b3af740 10 client.0 _ll_register_callbacks cb 0x5611c5ff3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57052/0 (socket says 172.21.15.93:57052) 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 -- 172.21.15.93:0/1629123648 learned_addr learned my addr 172.21.15.93:0/1629123648 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f67964d8640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6795cd7640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 -- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 msgr2=0x5611c63d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 -- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 msgr2=0x5611c63bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63bc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 -- 172.21.15.93:0/1629123648 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900b2a50 con 0x5611c63bac10 2023-11-04T01:40:00.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6795cd7640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f6796cd9640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f678800a920 tx=0x7f6788001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8925744dd291d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.015+0000 7f67717fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788004d60 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611c628dbf0 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f6788040480 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67880019c0 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 10 client.7722 fetch_fsmap learned FSMap version 56 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5611c62dff30 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611c628dbf0 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6788040640 con 0x5611c63bac10 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 10 client.7722 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:40:00.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 10 client.7722 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 20 client.7722 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d4090 0x5611c63d4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 4 client.7722 mds_command: new command op to 5747 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 --> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611c62da890 con 0x5611c63d4090 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.016+0000 7f67964d8640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d4090 0x5611c63d4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.017+0000 7f67964d8640 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d4090 0x5611c63d4470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f192ff7e0d52dd5 server_cookie=dd77debc5ba386c in_seq=0 out_seq=0 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.017+0000 7f67717fa640 10 client.7722 ms_handle_connect on v2:172.21.15.125:6832/596691451 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.017+0000 7f67717fa640 1 -- 172.21.15.93:0/1629123648 <== mds.0 v2:172.21.15.125:6832/596691451 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611c62da890 con 0x5611c63d4090 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.017+0000 7f67717fa640 10 client.7722 handle_command_reply: tid=0 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.017+0000 7f679b3af740 1 client.7722 shutdown 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 msgr2=0x5611c63a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f678800a920 tx=0x7f6788001d80 comp rx=0 tx=0).stop 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 shutdown_connections 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d4090 0x5611c63d4470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63bac10 0x5611c63a1bc0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63a2c30 0x5611c63bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 --2- 172.21.15.93:0/1629123648 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f67717fa640 0 client.7722 ms_handle_reset on v2:172.21.15.125:6832/596691451 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 >> 172.21.15.93:0/1629123648 conn(0x5611c6375c90 msgr2=0x5611c63744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 shutdown_connections 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 1 -- 172.21.15.93:0/1629123648 wait complete. 2023-11-04T01:40:00.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.018+0000 7f679b3af740 20 client.7722 trim_cache size 0 max 16384 2023-11-04T01:40:00.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.033+0000 7f679b3af740 1 Processor -- start 2023-11-04T01:40:00.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.033+0000 7f679b3af740 1 -- start start 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c6261280 con 0x5611c63a2c30 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c62e0a50 con 0x5611c63bac10 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611c63d4eb0 con 0x5611c63a2850 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57062/0 (socket says 172.21.15.93:57062) 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 -- 172.21.15.93:0/3454244778 learned_addr learned my addr 172.21.15.93:0/3454244778 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 -- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 msgr2=0x5611c63be3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 -- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 msgr2=0x5611c63a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 -- 172.21.15.93:0/3454244778 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c627dd10 con 0x5611c63a2c30 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6796cd9640 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.034+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6780005330 tx=0x7f6780011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c48bd1985cc6d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f6784ff9640 1 -- 172.21.15.93:0/3454244778 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780013420 con 0x5611c63a2c30 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f6784ff9640 1 -- 172.21.15.93:0/3454244778 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780013580 con 0x5611c63a2c30 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f6784ff9640 1 -- 172.21.15.93:0/3454244778 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800136f0 con 0x5611c63a2c30 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 -- 172.21.15.93:0/3454244778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 msgr2=0x5611c63c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6780005330 tx=0x7f6780011000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 -- 172.21.15.93:0/3454244778 shutdown_connections 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2c30 0x5611c63c3af0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 --2- 172.21.15.93:0/3454244778 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2850 0x5611c63be3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 -- 172.21.15.93:0/3454244778 >> 172.21.15.93:0/3454244778 conn(0x5611c6375c90 msgr2=0x5611c63b9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 -- 172.21.15.93:0/3454244778 shutdown_connections 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.035+0000 7f679b3af740 1 -- 172.21.15.93:0/3454244778 wait complete. 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.036+0000 7f679b3af740 1 -- start start 2023-11-04T01:40:00.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.036+0000 7f679b3af740 1 Processor -- start 2023-11-04T01:40:00.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2c30 0x5611c642b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c63c1e90 con 0x5611c63a2850 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c63d0a20 con 0x5611c63bac10 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611c63a7250 con 0x5611c63a2c30 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 10 client.0 _ll_register_callbacks cb 0x7f678c054d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57066/0 (socket says 172.21.15.93:57066) 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 -- 172.21.15.93:0/3994388638 learned_addr learned my addr 172.21.15.93:0/3994388638 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 -- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2c30 msgr2=0x5611c642b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2c30 0x5611c642b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 -- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 msgr2=0x5611c63a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 -- 172.21.15.93:0/3994388638 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678001d040 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67964d8640 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f678c059290 tx=0x7f678c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b36f985df95067c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67717fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c056d80 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f678c05cb30 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f678c070170 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f678c070330 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 10 client.7728 fetch_fsmap learned FSMap version 56 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5611c62a3500 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.037+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c05cb30 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f678c0550f0 con 0x5611c63a2850 2023-11-04T01:40:00.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 10 client.7728 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 10 client.7728 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 20 client.7728 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d0ee0 0x5611c63d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 4 client.7728 mds_command: new command op to 5747 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 --> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611c62da5b0 con 0x5611c63d0ee0 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d0ee0 0x5611c63d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f6795cd7640 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d0ee0 0x5611c63d12c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698d0cc63050b7bf server_cookie=926dc83f8136c299 in_seq=0 out_seq=0 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f67717fa640 10 client.7728 ms_handle_connect on v2:172.21.15.125:6832/596691451 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f67717fa640 1 -- 172.21.15.93:0/3994388638 <== mds.0 v2:172.21.15.125:6832/596691451 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5611c62da5b0 con 0x5611c63d0ee0 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f67717fa640 10 client.7728 handle_command_reply: tid=0 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 1 client.7728 shutdown 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 msgr2=0x5611c63a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.038+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f678c059290 tx=0x7f678c022000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 shutdown_connections 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:6832/596691451,v1:172.21.15.125:6834/596691451] conn(0x5611c63d0ee0 0x5611c63d12c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5611c63bac10 0x5611c63a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5611c63a2c30 0x5611c642b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f67717fa640 0 client.7728 ms_handle_reset on v2:172.21.15.125:6832/596691451 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 --2- 172.21.15.93:0/3994388638 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5611c63a2850 0x5611c63a6d10 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 >> 172.21.15.93:0/3994388638 conn(0x5611c6375c90 msgr2=0x5611c63d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 shutdown_connections 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 1 -- 172.21.15.93:0/3994388638 wait complete. 2023-11-04T01:40:00.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679b3af740 20 client.7728 trim_cache size 0 max 16384 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5747, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 6.5449492359999999, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 56, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 98, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:40:00.047 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 52.582566374000002 2023-11-04T01:40:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:00.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 msgr2=0x7f677406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 0x7f677406d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f679015f020 tx=0x7f6780009040 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 msgr2=0x7f67901535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f678c010890 tx=0x7f678c010d50 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 shutdown_connections 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f677406aea0 0x7f677406d360 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f679015e890 0x7f67900b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67900b2f70 0x7f679015e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 --2- 172.21.15.93:0/1877652797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f677c005180 0x7f67901535c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 >> 172.21.15.93:0/1877652797 conn(0x7f67900cbc90 msgr2=0x7f679015fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 shutdown_connections 2023-11-04T01:40:00.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.039+0000 7f679873c640 1 -- 172.21.15.93:0/1877652797 wait complete. 2023-11-04T01:40:00.051 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:40:00.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:40:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 Processor -- start 2023-11-04T01:40:00.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 -- start start 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 0x7f66700adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f667015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66700c3900 con 0x7f667015ad30 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66700ae260 con 0x7f6670070e20 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.151+0000 7f6675c1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c3be0 con 0x7f66700ad730 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666effd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 0x7f66700adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666f7fe640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f667015ad30 0x7f6670070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:50918/0 (socket says 172.21.15.93:50918) 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666ffff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f667015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666f7fe640 1 -- 172.21.15.93:0/740799949 learned_addr learned my addr 172.21.15.93:0/740799949 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:00.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666ffff640 1 -- 172.21.15.93:0/740799949 >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 msgr2=0x7f66700adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666ffff640 1 --2- 172.21.15.93:0/740799949 >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 0x7f66700adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666ffff640 1 -- 172.21.15.93:0/740799949 >> v1:172.21.15.125:6789/0 conn(0x7f667015ad30 legacy=0x7f6670070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666ffff640 1 -- 172.21.15.93:0/740799949 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700c3ec0 con 0x7f66700ad730 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.152+0000 7f666effd640 1 --2- 172.21.15.93:0/740799949 >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 0x7f66700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.153+0000 7f666ffff640 1 --2- 172.21.15.93:0/740799949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f667015e740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6668009d90 tx=0x7f666802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4369f112b3307ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.153+0000 7f666e7fc640 1 -- 172.21.15.93:0/740799949 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666802cbc0 con 0x7f66700ad730 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.153+0000 7f666e7fc640 1 -- 172.21.15.93:0/740799949 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666802cd20 con 0x7f66700ad730 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.153+0000 7f666e7fc640 1 -- 172.21.15.93:0/740799949 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668034660 con 0x7f66700ad730 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 -- 172.21.15.93:0/740799949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 msgr2=0x7f667015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 --2- 172.21.15.93:0/740799949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f667015e740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6668009d90 tx=0x7f666802be10 comp rx=0 tx=0).stop 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 -- 172.21.15.93:0/740799949 shutdown_connections 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 --2- 172.21.15.93:0/740799949 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f667015e740 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 --2- 172.21.15.93:0/740799949 >> v2:172.21.15.125:3300/0 conn(0x7f6670070e20 0x7f66700adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 -- 172.21.15.93:0/740799949 >> 172.21.15.93:0/740799949 conn(0x7f66700ce950 msgr2=0x7f66700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 -- 172.21.15.93:0/740799949 shutdown_connections 2023-11-04T01:40:00.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.154+0000 7f6675c1a640 1 -- 172.21.15.93:0/740799949 wait complete. 2023-11-04T01:40:00.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.155+0000 7f6675c1a640 1 Processor -- start 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.155+0000 7f6675c1a640 1 -- start start 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670070e20 0x7f667014c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f66700c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667014ca70 con 0x7f667015ad30 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c6d10 con 0x7f6670070e20 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f6675c1a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667015c990 con 0x7f66700ad730 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57068/0 (socket says 172.21.15.93:57068) 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 -- 172.21.15.93:0/838815405 learned_addr learned my addr 172.21.15.93:0/838815405 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666f7fe640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670070e20 0x7f667014c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666effd640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f66700c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 -- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 msgr2=0x7f66700c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f66700c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 -- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670070e20 msgr2=0x7f667014c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670070e20 0x7f667014c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.156+0000 7f666ffff640 1 -- 172.21.15.93:0/838815405 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664009400 con 0x7f667015ad30 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f666ffff640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6668009d90 tx=0x7f6668004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f6657fff640 1 -- 172.21.15.93:0/838815405 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668040650 con 0x7f667015ad30 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f6657fff640 1 -- 172.21.15.93:0/838815405 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666802ce90 con 0x7f667015ad30 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6668009a70 con 0x7f667015ad30 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f6657fff640 1 -- 172.21.15.93:0/838815405 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680409f0 con 0x7f667015ad30 2023-11-04T01:40:00.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.157+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667015cf50 con 0x7f667015ad30 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.159+0000 7f6657fff640 1 -- 172.21.15.93:0/838815405 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6668040b50 con 0x7f667015ad30 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.159+0000 7f6657fff640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 0x7f665c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.159+0000 7f6657fff640 1 -- 172.21.15.93:0/838815405 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f66680ac640 con 0x7f667015ad30 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.159+0000 7f666f7fe640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 0x7f665c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.160+0000 7f666f7fe640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 0x7f665c06d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6660005880 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.160+0000 7f66787ac740 1 Processor -- start 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.160+0000 7f66787ac740 1 -- start start 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb17f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcad1e40 0x55d2fcafc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fc9dd740 con 0x55d2fcaf9c10 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fca3f8d0 con 0x55d2fcad1e40 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fca3cfc0 con 0x55d2fcb1a3d0 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57076/0 (socket says 172.21.15.93:57076) 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 -- 172.21.15.93:0/1100034211 learned_addr learned my addr 172.21.15.93:0/1100034211 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 -- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 msgr2=0x55d2fcb17f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 -- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcad1e40 msgr2=0x55d2fcafc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666ffff640 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcad1e40 0x55d2fcafc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcad1e40 0x55d2fcafc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 -- 172.21.15.93:0/1100034211 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2fc9fbca0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f666effd640 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6664009d20 tx=0x7f6664011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33335b5a14cbfae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66557fa640 1 -- 172.21.15.93:0/1100034211 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664014440 con 0x55d2fcaf9c10 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66557fa640 1 -- 172.21.15.93:0/1100034211 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640145a0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.161+0000 7f66557fa640 1 -- 172.21.15.93:0/1100034211 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664014930 con 0x55d2fcaf9c10 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 -- 172.21.15.93:0/1100034211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 msgr2=0x55d2fcad1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6664009d20 tx=0x7f6664011690 comp rx=0 tx=0).stop 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 -- 172.21.15.93:0/1100034211 shutdown_connections 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcad1e40 0x55d2fcafc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcad1900 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 --2- 172.21.15.93:0/1100034211 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb17f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 -- 172.21.15.93:0/1100034211 >> 172.21.15.93:0/1100034211 conn(0x55d2fcacea60 msgr2=0x55d2fcb175e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 -- 172.21.15.93:0/1100034211 shutdown_connections 2023-11-04T01:40:00.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.162+0000 7f66787ac740 1 -- 172.21.15.93:0/1100034211 wait complete. 2023-11-04T01:40:00.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.163+0000 7f66787ac740 1 -- start start 2023-11-04T01:40:00.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.163+0000 7f66787ac740 1 Processor -- start 2023-11-04T01:40:00.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcaf4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb144e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fca388b0 con 0x55d2fcaf5990 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fc9f2c80 con 0x55d2fcaf9c10 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fc9f2920 con 0x55d2fcb1a3d0 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 10 client.0 _ll_register_callbacks cb 0x55d2fc74aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57082/0 (socket says 172.21.15.93:57082) 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 -- 172.21.15.93:0/1969250066 learned_addr learned my addr 172.21.15.93:0/1969250066 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666effd640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666f7fe640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcaf4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 -- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 msgr2=0x55d2fcb144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 -- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 msgr2=0x55d2fcaf4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcaf4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 -- 172.21.15.93:0/1969250066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6664009950 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666f7fe640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcaf4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f666ffff640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f666807abe0 tx=0x7f6668081050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac27c842202d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f664e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668083130 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f666807b140 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2fc9e4bf0 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f666807b320 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 10 client.7737 fetch_fsmap learned FSMap version 56 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55d2fca36f30 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.164+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2fc9e4bf0 con 0x55d2fcaf5990 2023-11-04T01:40:00.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f66680a6d20 con 0x55d2fcaf5990 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 10 client.7737 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 10 client.7737 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 20 client.7737 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcb0feb0 0x55d2fcb12b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 4 client.7737 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2fca31890 con 0x55d2fcb0feb0 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f666f7fe640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcb0feb0 0x55d2fcb12b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f664e7fc640 10 client.7737 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.165+0000 7f666f7fe640 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcb0feb0 0x55d2fcb12b30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96500754e6e5034c server_cookie=6a9e673ce09fc43e in_seq=0 out_seq=0 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f664e7fc640 1 -- 172.21.15.93:0/1969250066 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d2fca31890 con 0x55d2fcb0feb0 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f664e7fc640 10 client.7737 handle_command_reply: tid=0 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 client.7737 shutdown 2023-11-04T01:40:00.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 msgr2=0x55d2fcb14a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f666807abe0 tx=0x7f6668081050 comp rx=0 tx=0).stop 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 shutdown_connections 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcb0feb0 0x55d2fcb12b30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb14a20 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f664e7fc640 0 client.7737 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 --2- 172.21.15.93:0/1969250066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcaf4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 >> 172.21.15.93:0/1969250066 conn(0x55d2fcad1e40 msgr2=0x55d2fcb17500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 shutdown_connections 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.166+0000 7f66787ac740 1 -- 172.21.15.93:0/1969250066 wait complete. 2023-11-04T01:40:00.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.167+0000 7f66787ac740 20 client.7737 trim_cache size 0 max 16384 2023-11-04T01:40:00.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.182+0000 7f66787ac740 1 Processor -- start 2023-11-04T01:40:00.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.182+0000 7f66787ac740 1 -- start start 2023-11-04T01:40:00.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb19320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb81960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fc9b8280 con 0x55d2fcaf5990 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fcad3760 con 0x55d2fcaf9c10 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fcacfdc0 con 0x55d2fcb1a3d0 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57090/0 (socket says 172.21.15.93:57090) 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 -- 172.21.15.93:0/3947612235 learned_addr learned my addr 172.21.15.93:0/3947612235 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 -- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 msgr2=0x55d2fcb81960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb81960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 -- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 msgr2=0x55d2fcb19320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb19320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 -- 172.21.15.93:0/3947612235 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2fc9d4d10 con 0x55d2fcaf5990 2023-11-04T01:40:00.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.183+0000 7f666f7fe640 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f666000f9d0 tx=0x7f6660012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3a86aadbd801b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f6655ffb640 1 -- 172.21.15.93:0/3947612235 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600223a0 con 0x55d2fcaf5990 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f6655ffb640 1 -- 172.21.15.93:0/3947612235 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666001b030 con 0x55d2fcaf5990 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f6655ffb640 1 -- 172.21.15.93:0/3947612235 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660022700 con 0x55d2fcaf5990 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 -- 172.21.15.93:0/3947612235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 msgr2=0x55d2fcb36080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f666000f9d0 tx=0x7f6660012000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 -- 172.21.15.93:0/3947612235 shutdown_connections 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcb1a3d0 0x55d2fcb81960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb19320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 --2- 172.21.15.93:0/3947612235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf5990 0x55d2fcb36080 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 -- 172.21.15.93:0/3947612235 >> 172.21.15.93:0/3947612235 conn(0x55d2fcad1e40 msgr2=0x55d2fcb3ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 -- 172.21.15.93:0/3947612235 shutdown_connections 2023-11-04T01:40:00.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.184+0000 7f66787ac740 1 -- 172.21.15.93:0/3947612235 wait complete. 2023-11-04T01:40:00.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.185+0000 7f66787ac740 1 -- start start 2023-11-04T01:40:00.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.185+0000 7f66787ac740 1 Processor -- start 2023-11-04T01:40:00.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.185+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 0x55d2fcb2ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 0x55d2fcaf2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fcb806c0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2fcaf87d0 con 0x55d2fcb1a3d0 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2fcaf8a20 con 0x55d2fcaf5990 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 10 client.0 _ll_register_callbacks cb 0x7f66640098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57100/0 (socket says 172.21.15.93:57100) 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 -- 172.21.15.93:0/2613760856 learned_addr learned my addr 172.21.15.93:0/2613760856 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666f7fe640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 0x55d2fcb2ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 -- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 msgr2=0x55d2fcb2ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666ffff640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 0x55d2fcaf2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 0x55d2fcb2ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 -- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 msgr2=0x55d2fcaf2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 0x55d2fcaf2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 -- 172.21.15.93:0/2613760856 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700c3900 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666f7fe640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 0x55d2fcb2ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666ffff640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 0x55d2fcaf2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f666effd640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6664011b90 tx=0x7f6664004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750b0e7cfd9de76f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664023040 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f66640044d0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66640145a0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6664009ed0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 10 client.7743 fetch_fsmap learned FSMap version 56 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55d2fc9fa500 con 0x55d2fcaf9c10 2023-11-04T01:40:00.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640145a0 con 0x55d2fcaf9c10 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.186+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f666401b020 con 0x55d2fcaf9c10 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 10 client.7743 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 10 client.7743 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 20 client.7743 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcacbe50 0x55d2fcacc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 4 client.7743 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2fca315b0 con 0x55d2fcacbe50 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f666f7fe640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcacbe50 0x55d2fcacc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f664e7fc640 10 client.7743 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f666f7fe640 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcacbe50 0x55d2fcacc230 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2680400ac212404 server_cookie=7c987ab18ade13db in_seq=0 out_seq=0 2023-11-04T01:40:00.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f664e7fc640 1 -- 172.21.15.93:0/2613760856 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d2fca315b0 con 0x55d2fcacbe50 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f664e7fc640 10 client.7743 handle_command_reply: tid=0 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 1 client.7743 shutdown 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 msgr2=0x55d2fcb7dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.187+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6664011b90 tx=0x7f6664004730 comp rx=0 tx=0).stop 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 shutdown_connections 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55d2fcacbe50 0x55d2fcacc230 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d2fcb1a3d0 0x55d2fcaf2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d2fcaf9c10 0x55d2fcb7dcf0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 --2- 172.21.15.93:0/2613760856 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d2fcaf5990 0x55d2fcb2ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f664e7fc640 0 client.7743 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 >> 172.21.15.93:0/2613760856 conn(0x55d2fcad1e40 msgr2=0x55d2fcaf4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 shutdown_connections 2023-11-04T01:40:00.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 1 -- 172.21.15.93:0/2613760856 wait complete. 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f66787ac740 20 client.7743 trim_cache size 0 max 16384 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 1, 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5750, 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:00.196 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 38.143821107999997, 2023-11-04T01:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 56, 2023-11-04T01:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 98, 2023-11-04T01:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 52.731153018000001 2023-11-04T01:40:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 msgr2=0x7f665c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 0x7f665c06d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6660005880 tx=0x7f6660009040 comp rx=0 tx=0).stop 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 msgr2=0x7f667015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6668009d90 tx=0x7f6668004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 shutdown_connections 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f665c06ae70 0x7f665c06d330 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f667015ad30 0x7f667015da30 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f66700ad730 0x7f66700c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 --2- 172.21.15.93:0/838815405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670070e20 0x7f667014c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 >> 172.21.15.93:0/838815405 conn(0x7f66700ce950 msgr2=0x7f6670151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 shutdown_connections 2023-11-04T01:40:00.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.188+0000 7f6675c1a640 1 -- 172.21.15.93:0/838815405 wait complete. 2023-11-04T01:40:00.200 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:00.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.298+0000 7fd3743cc640 1 Processor -- start 2023-11-04T01:40:00.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.298+0000 7fd3743cc640 1 -- start start 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd3743cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c15cf10 0x7fd36c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd3743cc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd36c06cf20 0x7fd36c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd3743cc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c0c9880 con 0x7fd36c0b0d30 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd3743cc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0b1180 con 0x7fd36c06cf20 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd3743cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c0cd650 con 0x7fd36c15cf10 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd371967640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd36c06cf20 0x7fd36c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd371967640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd36c06cf20 0x7fd36c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57106/0 (socket says 172.21.15.93:57106) 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd371967640 1 -- 172.21.15.93:0/942731779 learned_addr learned my addr 172.21.15.93:0/942731779 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.299+0000 7fd372168640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c15cf10 0x7fd36c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371967640 1 -- 172.21.15.93:0/942731779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c15cf10 msgr2=0x7fd36c06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371967640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c15cf10 0x7fd36c06c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371967640 1 -- 172.21.15.93:0/942731779 >> v1:172.21.15.125:6789/0 conn(0x7fd36c0b0d30 legacy=0x7fd36c0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371967640 1 -- 172.21.15.93:0/942731779 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0cd930 con 0x7fd36c06cf20 2023-11-04T01:40:00.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371967640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c06cf20 0x7fd36c0b07f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009870 tx=0x7fd35c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249ab3debec382a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371166640 1 -- 172.21.15.93:0/942731779 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c031640 con 0x7fd36c06cf20 2023-11-04T01:40:00.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371166640 1 -- 172.21.15.93:0/942731779 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c0317a0 con 0x7fd36c06cf20 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.300+0000 7fd371166640 1 -- 172.21.15.93:0/942731779 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c031b30 con 0x7fd36c06cf20 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 -- 172.21.15.93:0/942731779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c06cf20 msgr2=0x7fd36c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c06cf20 0x7fd36c0b07f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009870 tx=0x7fd35c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 -- 172.21.15.93:0/942731779 shutdown_connections 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c06cf20 0x7fd36c0b07f0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 --2- 172.21.15.93:0/942731779 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c15cf10 0x7fd36c06c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 -- 172.21.15.93:0/942731779 >> 172.21.15.93:0/942731779 conn(0x7fd36c0cb7f0 msgr2=0x7fd36c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 -- 172.21.15.93:0/942731779 shutdown_connections 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.301+0000 7fd3743cc640 1 -- 172.21.15.93:0/942731779 wait complete. 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.302+0000 7fd3743cc640 1 Processor -- start 2023-11-04T01:40:00.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.302+0000 7fd3743cc640 1 -- start start 2023-11-04T01:40:00.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd36c15cf10 0x7fd36c159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c157990 0x7fd36c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.306 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c157e20 con 0x7fd36c0b0d30 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c158100 con 0x7fd36c15cf10 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd3743cc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1583e0 con 0x7fd36c157990 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57122/0 (socket says 172.21.15.93:57122) 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 -- 172.21.15.93:0/3848124635 learned_addr learned my addr 172.21.15.93:0/3848124635 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372969640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c157990 0x7fd36c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd371967640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd36c15cf10 0x7fd36c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 -- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c157990 msgr2=0x7fd36c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c157990 0x7fd36c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 -- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd36c15cf10 msgr2=0x7fd36c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd36c15cf10 0x7fd36c159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.303+0000 7fd372168640 1 -- 172.21.15.93:0/3848124635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0094d0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd372168640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd368007e40 tx=0x7fd36800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368014620 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800ee90 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c1586c0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680149c0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.304+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c152910 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.305+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c074290 con 0x7fd36c0b0d30 2023-11-04T01:40:00.308 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.305+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd368014b20 con 0x7fd36c0b0d30 2023-11-04T01:40:00.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.306+0000 7fd362ffd640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 0x7fd35006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.306+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fd36808a4c0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.306+0000 7fd371967640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 0x7fd35006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.306+0000 7fd371967640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 0x7fd35006d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd35c036000 tx=0x7fd35c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.310+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd368054ff0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.510+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd36c06c7c0 con 0x7fd36c0b0d30 2023-11-04T01:40:00.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.510+0000 7fd362ffd640 1 -- 172.21.15.93:0/3848124635 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fd368058610 con 0x7fd36c0b0d30 2023-11-04T01:40:00.512 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:56.505734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:00.512 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 56 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 msgr2=0x7fd35006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 0x7fd35006d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd35c036000 tx=0x7fd35c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 msgr2=0x7fd36c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd368007e40 tx=0x7fd36800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 shutdown_connections 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd35006aea0 0x7fd35006d360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd36c157990 0x7fd36c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd36c15cf10 0x7fd36c159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 --2- 172.21.15.93:0/3848124635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36c0b0d30 0x7fd36c1523d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 >> 172.21.15.93:0/3848124635 conn(0x7fd36c0cb7f0 msgr2=0x7fd36c06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 shutdown_connections 2023-11-04T01:40:00.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.512+0000 7fd3743cc640 1 -- 172.21.15.93:0/3848124635 wait complete. 2023-11-04T01:40:00.525 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:40:00.653 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:36.445011+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:00.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:36.445011+0000" } ] } 2023-11-04T01:40:00.653 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:00.653 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:40:00.654 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:00.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.751+0000 7f73b7475640 1 Processor -- start 2023-11-04T01:40:00.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 -- start start 2023-11-04T01:40:00.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73b00cde60 0x7f73b015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73b015daa0 0x7f73b0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b015e000 con 0x7f73b00ce240 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b015e5c0 con 0x7f73b00cde60 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b7475640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b015e2e0 con 0x7f73b015daa0 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b5211640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73b00cde60 0x7f73b015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b5211640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73b00cde60 0x7f73b015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57132/0 (socket says 172.21.15.93:57132) 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b5a12640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f73b00ce240 0x7f73b006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42632/0 (socket says 172.21.15.93:42632) 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.752+0000 7f73b5211640 1 -- 172.21.15.93:0/2159429697 learned_addr learned my addr 172.21.15.93:0/2159429697 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73b5211640 1 -- 172.21.15.93:0/2159429697 >> v2:172.21.15.125:3300/0 conn(0x7f73b015daa0 msgr2=0x7f73b0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73b5211640 1 --2- 172.21.15.93:0/2159429697 >> v2:172.21.15.125:3300/0 conn(0x7f73b015daa0 0x7f73b0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73b5211640 1 -- 172.21.15.93:0/2159429697 >> v1:172.21.15.93:6789/0 conn(0x7f73b00ce240 legacy=0x7f73b006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73a7fff640 1 -- 172.21.15.93:0/2159429697 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867369725 0 0) 0x7f73b015e000 con 0x7f73b00ce240 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73b5211640 1 -- 172.21.15.93:0/2159429697 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00d1120 con 0x7f73b00cde60 2023-11-04T01:40:00.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.753+0000 7f73b5211640 1 --2- 172.21.15.93:0/2159429697 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00cde60 0x7f73b015d560 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f73b00cf5f0 tx=0x7f73ac02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2161e4b33e545a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73a7fff640 1 -- 172.21.15.93:0/2159429697 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac02cb20 con 0x7f73b00cde60 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73a7fff640 1 -- 172.21.15.93:0/2159429697 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac02cc80 con 0x7f73b00cde60 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73a7fff640 1 -- 172.21.15.93:0/2159429697 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0343f0 con 0x7f73b00cde60 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 -- 172.21.15.93:0/2159429697 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00cde60 msgr2=0x7f73b015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 --2- 172.21.15.93:0/2159429697 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00cde60 0x7f73b015d560 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f73b00cf5f0 tx=0x7f73ac02bf80 comp rx=0 tx=0).stop 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 -- 172.21.15.93:0/2159429697 shutdown_connections 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 --2- 172.21.15.93:0/2159429697 >> v2:172.21.15.125:3300/0 conn(0x7f73b015daa0 0x7f73b0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 --2- 172.21.15.93:0/2159429697 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00cde60 0x7f73b015d560 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 -- 172.21.15.93:0/2159429697 >> 172.21.15.93:0/2159429697 conn(0x7f73b0071f30 msgr2=0x7f73b00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 -- 172.21.15.93:0/2159429697 shutdown_connections 2023-11-04T01:40:00.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.754+0000 7f73b7475640 1 -- 172.21.15.93:0/2159429697 wait complete. 2023-11-04T01:40:00.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.755+0000 7f73b7475640 1 Processor -- start 2023-11-04T01:40:00.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.755+0000 7f73b7475640 1 -- start start 2023-11-04T01:40:00.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 0x7f73b00b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73b015daa0 0x7f73b0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01f5970 con 0x7f73b00ce240 2023-11-04T01:40:00.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b015a1a0 con 0x7f73b00cde60 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b7475640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b015a470 con 0x7f73b015daa0 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57146/0 (socket says 172.21.15.93:57146) 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 -- 172.21.15.93:0/817618893 learned_addr learned my addr 172.21.15.93:0/817618893 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b5211640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 0x7f73b00b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 -- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73b015daa0 msgr2=0x7f73b0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73b015daa0 0x7f73b0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 -- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 msgr2=0x7f73b00b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 0x7f73b00b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b4a10640 1 -- 172.21.15.93:0/817618893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac009b30 con 0x7f73b00ce240 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.756+0000 7f73b5211640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 0x7f73b00b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73b4a10640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f73a000b410 tx=0x7f73a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011830 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0011990 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b01f5c10 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011d40 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.757+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b015a750 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.758+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0074290 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.758+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73a001a400 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.759+0000 7f73a5ffb640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 0x7f739406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.759+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f73a0089d70 con 0x7f73b00ce240 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.759+0000 7f73b5211640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 0x7f739406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.759+0000 7f73b5211640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 0x7f739406d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f73ac035000 tx=0x7f73ac030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.764 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.763+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73a0054810 con 0x7f73b00ce240 2023-11-04T01:40:00.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.963+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73b00cd130 con 0x7f73b00ce240 2023-11-04T01:40:00.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.964+0000 7f73a5ffb640 1 -- 172.21.15.93:0/817618893 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f73a0015020 con 0x7f73b00ce240 2023-11-04T01:40:00.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:39:56.505734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:00.966 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 56 2023-11-04T01:40:00.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 msgr2=0x7f739406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 0x7f739406d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f73ac035000 tx=0x7f73ac030000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 msgr2=0x7f73b01f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f73a000b410 tx=0x7f73a000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 shutdown_connections 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f739406ae70 0x7f739406d330 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73b015daa0 0x7f73b0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73b00ce240 0x7f73b01f6410 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 --2- 172.21.15.93:0/817618893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73b00cde60 0x7f73b00b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 >> 172.21.15.93:0/817618893 conn(0x7f73b0071f30 msgr2=0x7f73b00c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 shutdown_connections 2023-11-04T01:40:00.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:00.966+0000 7f73b7475640 1 -- 172.21.15.93:0/817618893 wait complete. 2023-11-04T01:40:00.978 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:01.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.079+0000 7fd55954c640 1 Processor -- start 2023-11-04T01:40:01.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.079+0000 7fd55954c640 1 -- start start 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.079+0000 7fd55954c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 0x7fd55415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.079+0000 7fd55954c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd5540b4880 0x7fd5540b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.079+0000 7fd55954c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540cde60 con 0x7fd5540cd6d0 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd55954c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5540b5230 con 0x7fd5540b4880 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd55954c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554160f90 con 0x7fd554153e60 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd5540b4880 0x7fd5540b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.082 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd5540b4880 0x7fd5540b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57150/0 (socket says 172.21.15.93:57150) 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 -- 172.21.15.93:0/1054257420 learned_addr learned my addr 172.21.15.93:0/1054257420 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd552ffd640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 0x7fd55415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 -- 172.21.15.93:0/1054257420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 msgr2=0x7fd55415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 0x7fd55415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 -- 172.21.15.93:0/1054257420 >> v1:172.21.15.125:6789/0 conn(0x7fd5540cd6d0 legacy=0x7fd554161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd5537fe640 1 -- 172.21.15.93:0/1054257420 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55415e400 con 0x7fd5540b4880 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.080+0000 7fd552ffd640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 0x7fd55415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd5537fe640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540b4880 0x7fd5540b4cf0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009e50 tx=0x7fd54c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82c55582c806350 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd551ffb640 1 -- 172.21.15.93:0/1054257420 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c02cb00 con 0x7fd5540b4880 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd551ffb640 1 -- 172.21.15.93:0/1054257420 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c02cc60 con 0x7fd5540b4880 2023-11-04T01:40:01.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd551ffb640 1 -- 172.21.15.93:0/1054257420 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0343f0 con 0x7fd5540b4880 2023-11-04T01:40:01.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 -- 172.21.15.93:0/1054257420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540b4880 msgr2=0x7fd5540b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540b4880 0x7fd5540b4cf0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009e50 tx=0x7fd54c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:01.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 -- 172.21.15.93:0/1054257420 shutdown_connections 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540b4880 0x7fd5540b4cf0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 --2- 172.21.15.93:0/1054257420 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd554153e60 0x7fd55415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 -- 172.21.15.93:0/1054257420 >> 172.21.15.93:0/1054257420 conn(0x7fd5540cf880 msgr2=0x7fd5540cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 -- 172.21.15.93:0/1054257420 shutdown_connections 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.081+0000 7fd55954c640 1 -- 172.21.15.93:0/1054257420 wait complete. 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 Processor -- start 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 -- start start 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5540b4880 0x7fd5540c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 0x7fd5541f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554150d70 con 0x7fd5540cd6d0 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c8ef0 con 0x7fd554153e60 2023-11-04T01:40:01.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd55954c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c82e0 con 0x7fd5540b4880 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.083+0000 7fd5527fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57154/0 (socket says 172.21.15.93:57154) 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 -- 172.21.15.93:0/1818937180 learned_addr learned my addr 172.21.15.93:0/1818937180 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd552ffd640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5540b4880 0x7fd5540c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5537fe640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 0x7fd5541f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 -- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5540b4880 msgr2=0x7fd5540c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5540b4880 0x7fd5540c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 -- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 msgr2=0x7fd5541f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 0x7fd5541f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 -- 172.21.15.93:0/1818937180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c009b30 con 0x7fd5540cd6d0 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5537fe640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 0x7fd5541f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd5527fc640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c430 tx=0x7fd54800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480052d0 con 0x7fd5540cd6d0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548005430 con 0x7fd5540cd6d0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5540c85c0 con 0x7fd5540cd6d0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548003830 con 0x7fd5540cd6d0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.084+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5540c8b80 con 0x7fd5540cd6d0 2023-11-04T01:40:01.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.085+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554074290 con 0x7fd5540cd6d0 2023-11-04T01:40:01.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.086+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd548003990 con 0x7fd5540cd6d0 2023-11-04T01:40:01.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.086+0000 7fd53b7fe640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 0x7fd54006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.086+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fd5480891d0 con 0x7fd5540cd6d0 2023-11-04T01:40:01.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.086+0000 7fd552ffd640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 0x7fd54006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.086+0000 7fd552ffd640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 0x7fd54006d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd5440096d0 tx=0x7fd544008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.090+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd548053c70 con 0x7fd5540cd6d0 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.320+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fd5540b83b0 con 0x7fd5540cd6d0 2023-11-04T01:40:01.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.519+0000 7fd53b7fe640 1 -- 172.21.15.93:0/1818937180 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.5747 v57) v1 ==== 112+0+0 (secure 0 0 0) 0x7fd548057290 con 0x7fd5540cd6d0 2023-11-04T01:40:01.520 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.5747 2023-11-04T01:40:01.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 msgr2=0x7fd54006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 0x7fd54006d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd5440096d0 tx=0x7fd544008040 comp rx=0 tx=0).stop 2023-11-04T01:40:01.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 msgr2=0x7fd554150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c430 tx=0x7fd54800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 shutdown_connections 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd54006ae70 0x7fd54006d330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd554153e60 0x7fd5541f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5540cd6d0 0x7fd554150830 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 --2- 172.21.15.93:0/1818937180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5540b4880 0x7fd5540c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 >> 172.21.15.93:0/1818937180 conn(0x7fd5540cf880 msgr2=0x7fd55415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 shutdown_connections 2023-11-04T01:40:01.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.521+0000 7fd55954c640 1 -- 172.21.15.93:0/1818937180 wait complete. 2023-11-04T01:40:01.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:40:01.659 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:40:01.659 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:40:01.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:01.660 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:40:01.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:01.680 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f10ed58c640 time 2023-11-04T01:40:01.679368+0000 2023-11-04T01:40:01.680 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:01.680 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.680 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f10f916efaf] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f10ed58c640 thread_name:MR_Finisher 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:01.678+0000 7f10ed58c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f10ed58c640 time 2023-11-04T01:40:01.679368+0000 2023-11-04T01:40:01.681 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f10f916efaf] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.682 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f10f8854db0] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10f88a154c] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f10f916f009] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.683 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:01.679+0000 7f10ed58c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f10ed58c640 thread_name:MR_Finisher 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f10f8854db0] 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10f88a154c] 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:01.684 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f10f916f009] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:01.685 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: -353> 2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: -351> 2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:40:01.678+0000 7f10ed58c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f10ed58c640 time 2023-11-04T01:40:01.679368+0000 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f10f916efaf] 2023-11-04T01:40:01.686 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:40:01.679+0000 7f10ed58c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f10ed58c640 thread_name:MR_Finisher 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.687 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f10f8854db0] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10f88a154c] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f10f916f009] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.688 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: -353> 2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: -351> 2023-11-04T01:39:58.055+0000 7f10f0d93640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:40:01.678+0000 7f10ed58c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f10ed58c640 time 2023-11-04T01:40:01.679368+0000 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.689 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f10f916efaf] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.690 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:40:01.679+0000 7f10ed58c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f10ed58c640 thread_name:MR_Finisher 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f10f8854db0] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10f88a154c] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f10f916f009] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f10f916f16d] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55df9d43d9ce] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55df9d46dbcc] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55df9d476b0c] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55df9d476c63] 2023-11-04T01:40:01.691 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f10f92164a5] 2023-11-04T01:40:01.692 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f10f889f802] 2023-11-04T01:40:01.692 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f10f883f450] 2023-11-04T01:40:01.692 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:01.692 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:01.808 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:01.808 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:01.808 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:01.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.906+0000 7ff646739640 1 Processor -- start 2023-11-04T01:40:01.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.906+0000 7ff646739640 1 -- start start 2023-11-04T01:40:01.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff646739640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff640159c70 0x7ff6400ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff646739640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 0x7ff64015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff646739640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400b4110 con 0x7ff64006db20 2023-11-04T01:40:01.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff646739640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400b49b0 con 0x7ff640159c70 2023-11-04T01:40:01.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff646739640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400b43f0 con 0x7ff6400b0ae0 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff640159c70 0x7ff6400ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff64006db20 0x7ff6400b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:48684/0 (socket says 172.21.15.93:48684) 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff640159c70 0x7ff6400ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58576/0 (socket says 172.21.15.93:58576) 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63f7fe640 1 -- 172.21.15.93:0/1803389943 learned_addr learned my addr 172.21.15.93:0/1803389943 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff644cd6640 1 --2- 172.21.15.93:0/1803389943 >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 0x7ff64015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 -- 172.21.15.93:0/1803389943 >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 msgr2=0x7ff64015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 --2- 172.21.15.93:0/1803389943 >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 0x7ff64015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 -- 172.21.15.93:0/1803389943 >> v1:172.21.15.93:6789/0 conn(0x7ff64006db20 legacy=0x7ff6400b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63ffff640 1 -- 172.21.15.93:0/1803389943 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400b46d0 con 0x7ff640159c70 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff63effd640 1 -- 172.21.15.93:0/1803389943 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567198621 0 0) 0x7ff6400b4110 con 0x7ff64006db20 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.907+0000 7ff644cd6640 1 --2- 172.21.15.93:0/1803389943 >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 0x7ff64015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.908+0000 7ff63ffff640 1 --2- 172.21.15.93:0/1803389943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff640159c70 0x7ff6400ce370 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff6400c5910 tx=0x7ff63002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e4912e4c5dcc82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.908+0000 7ff63effd640 1 -- 172.21.15.93:0/1803389943 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630031830 con 0x7ff640159c70 2023-11-04T01:40:01.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.908+0000 7ff63effd640 1 -- 172.21.15.93:0/1803389943 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630031990 con 0x7ff640159c70 2023-11-04T01:40:01.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.908+0000 7ff63effd640 1 -- 172.21.15.93:0/1803389943 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630031d20 con 0x7ff640159c70 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 -- 172.21.15.93:0/1803389943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff640159c70 msgr2=0x7ff6400ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 --2- 172.21.15.93:0/1803389943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff640159c70 0x7ff6400ce370 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff6400c5910 tx=0x7ff63002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 -- 172.21.15.93:0/1803389943 shutdown_connections 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 --2- 172.21.15.93:0/1803389943 >> v2:172.21.15.125:3300/0 conn(0x7ff6400b0ae0 0x7ff64015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 --2- 172.21.15.93:0/1803389943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff640159c70 0x7ff6400ce370 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 -- 172.21.15.93:0/1803389943 >> 172.21.15.93:0/1803389943 conn(0x7ff6400ce950 msgr2=0x7ff6400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 -- 172.21.15.93:0/1803389943 shutdown_connections 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.909+0000 7ff646739640 1 -- 172.21.15.93:0/1803389943 wait complete. 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.910+0000 7ff646739640 1 Processor -- start 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.910+0000 7ff646739640 1 -- start start 2023-11-04T01:40:01.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 0x7ff6401526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 0x7ff640154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400c4fd0 con 0x7ff64006db20 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015c470 con 0x7ff6400b0ae0 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64015c750 con 0x7ff640159c70 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58582/0 (socket says 172.21.15.93:58582) 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 -- 172.21.15.93:0/2673967472 learned_addr learned my addr 172.21.15.93:0/2673967472 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63f7fe640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 0x7ff6401526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff644cd6640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 0x7ff640154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 -- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 msgr2=0x7ff640154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 0x7ff640154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 -- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 msgr2=0x7ff6401526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 0x7ff6401526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 -- 172.21.15.93:0/2673967472 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630009400 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63f7fe640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 0x7ff6401526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff644cd6640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 0x7ff640154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63ffff640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ff630009890 tx=0x7ff6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63003ba70 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63003bbd0 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64015ca30 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300453f0 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.911+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64015cff0 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.912+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff640074290 con 0x7ff64006db20 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.913+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff630045550 con 0x7ff64006db20 2023-11-04T01:40:01.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.913+0000 7ff63cff9640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 0x7ff62c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.913+0000 7ff63f7fe640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 0x7ff62c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.913+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ff6300abe20 con 0x7ff64006db20 2023-11-04T01:40:01.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.914+0000 7ff63f7fe640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 0x7ff62c06d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff6400b0ab0 tx=0x7ff634007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:01.917+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff630076950 con 0x7ff64006db20 2023-11-04T01:40:02.109 INFO:tasks.ceph.mds.d.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:02.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.119+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff64014f880 con 0x7ff64006db20 2023-11-04T01:40:02.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.120+0000 7ff63cff9640 1 -- 172.21.15.93:0/2673967472 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4931 (secure 0 0 0) 0x7ff630035090 con 0x7ff64006db20 2023-11-04T01:40:02.121 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:02.121 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:01.321108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:02.122 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 57 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 msgr2=0x7ff62c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 0x7ff62c06d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff6400b0ab0 tx=0x7ff634007ca0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 msgr2=0x7ff64015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ff630009890 tx=0x7ff6300046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 shutdown_connections 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff62c06ae70 0x7ff62c06d330 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff640159c70 0x7ff640154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6400b0ae0 0x7ff6401526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 --2- 172.21.15.93:0/2673967472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff64006db20 0x7ff64015bb00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 >> 172.21.15.93:0/2673967472 conn(0x7ff6400ce950 msgr2=0x7ff6400b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 shutdown_connections 2023-11-04T01:40:02.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:02.122+0000 7ff646739640 1 -- 172.21.15.93:0/2673967472 wait complete. 2023-11-04T01:40:02.134 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:06.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:40:07.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.243+0000 7fdad87e7640 1 Processor -- start 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.243+0000 7fdad87e7640 1 -- start start 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad87e7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdad00ce240 0x7fdad0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad87e7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdad0157540 0x7fdad00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad87e7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad015e000 con 0x7fdad00cde60 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad87e7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad015e5c0 con 0x7fdad0157540 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad87e7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad015e2e0 con 0x7fdad00ce240 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad6d84640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdad0157540 0x7fdad00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad6d84640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdad0157540 0x7fdad00d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58590/0 (socket says 172.21.15.93:58590) 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.244+0000 7fdad6d84640 1 -- 172.21.15.93:0/2879899635 learned_addr learned my addr 172.21.15.93:0/2879899635 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad5d82640 1 --2- 172.21.15.93:0/2879899635 >> v2:172.21.15.125:3300/0 conn(0x7fdad00ce240 0x7fdad0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad6d84640 1 -- 172.21.15.93:0/2879899635 >> v2:172.21.15.125:3300/0 conn(0x7fdad00ce240 msgr2=0x7fdad0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad6d84640 1 --2- 172.21.15.93:0/2879899635 >> v2:172.21.15.125:3300/0 conn(0x7fdad00ce240 0x7fdad0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad6d84640 1 -- 172.21.15.93:0/2879899635 >> v1:172.21.15.125:6789/0 conn(0x7fdad00cde60 legacy=0x7fdad015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad6d84640 1 -- 172.21.15.93:0/2879899635 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00d1120 con 0x7fdad0157540 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.245+0000 7fdad6d84640 1 --2- 172.21.15.93:0/2879899635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad0157540 0x7fdad00d1920 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fdad00cf5f0 tx=0x7fdacc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520ff0f3e0e9dd4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad5581640 1 -- 172.21.15.93:0/2879899635 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc02ca80 con 0x7fdad0157540 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad5581640 1 -- 172.21.15.93:0/2879899635 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc02cbe0 con 0x7fdad0157540 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad5581640 1 -- 172.21.15.93:0/2879899635 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0343f0 con 0x7fdad0157540 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 -- 172.21.15.93:0/2879899635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad0157540 msgr2=0x7fdad00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 --2- 172.21.15.93:0/2879899635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad0157540 0x7fdad00d1920 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fdad00cf5f0 tx=0x7fdacc02bee0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 -- 172.21.15.93:0/2879899635 shutdown_connections 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 --2- 172.21.15.93:0/2879899635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad0157540 0x7fdad00d1920 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 --2- 172.21.15.93:0/2879899635 >> v2:172.21.15.125:3300/0 conn(0x7fdad00ce240 0x7fdad0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 -- 172.21.15.93:0/2879899635 >> 172.21.15.93:0/2879899635 conn(0x7fdad0071f30 msgr2=0x7fdad00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 -- 172.21.15.93:0/2879899635 shutdown_connections 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.246+0000 7fdad87e7640 1 -- 172.21.15.93:0/2879899635 wait complete. 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.247+0000 7fdad87e7640 1 Processor -- start 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.247+0000 7fdad87e7640 1 -- start start 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdad00cde60 0x7fdad01533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdad0157540 0x7fdad01f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0153900 con 0x7fdad00ce240 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad015be60 con 0x7fdad0157540 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad87e7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad015c140 con 0x7fdad00cde60 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad5d82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad5d82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58594/0 (socket says 172.21.15.93:58594) 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.248+0000 7fdad5d82640 1 -- 172.21.15.93:0/176787181 learned_addr learned my addr 172.21.15.93:0/176787181 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad6d84640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdad0157540 0x7fdad01f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 -- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdad00cde60 msgr2=0x7fdad01533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdad00cde60 0x7fdad01533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 -- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdad0157540 msgr2=0x7fdad01f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdad0157540 0x7fdad01f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 -- 172.21.15.93:0/176787181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009b30 con 0x7fdad00ce240 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad5d82640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c7f0 tx=0x7fdac000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0004220 con 0x7fdad00ce240 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac00043a0 con 0x7fdad00ce240 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad015c420 con 0x7fdad00ce240 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0007860 con 0x7fdad00ce240 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.249+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad00cc7d0 con 0x7fdad00ce240 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.250+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad0074290 con 0x7fdad00ce240 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.250+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdac0007bd0 con 0x7fdad00ce240 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.251+0000 7fdac6ffd640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.251+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fdac0089b10 con 0x7fdad00ce240 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.251+0000 7fdad6583640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.251+0000 7fdad6583640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 0x7fdab406d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009650 tx=0x7fdac8006ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.255+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdac0054640 con 0x7fdad00ce240 2023-11-04T01:40:07.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.457+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad00d24d0 con 0x7fdad00ce240 2023-11-04T01:40:07.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.457+0000 7fdac6ffd640 1 -- 172.21.15.93:0/176787181 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fdac001e090 con 0x7fdad00ce240 2023-11-04T01:40:07.459 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:07.459 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:01.321108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:07.459 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 57 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 msgr2=0x7fdab406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 0x7fdab406d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009650 tx=0x7fdac8006ba0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 msgr2=0x7fdad00cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c7f0 tx=0x7fdac000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 shutdown_connections 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdab406ae70 0x7fdab406d330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdad0157540 0x7fdad01f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdad00ce240 0x7fdad00cc290 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 --2- 172.21.15.93:0/176787181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdad00cde60 0x7fdad01533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 >> 172.21.15.93:0/176787181 conn(0x7fdad0071f30 msgr2=0x7fdad00b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 shutdown_connections 2023-11-04T01:40:07.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:07.459+0000 7fdad87e7640 1 -- 172.21.15.93:0/176787181 wait complete. 2023-11-04T01:40:07.471 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:12.472 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:12.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.580+0000 7f67f8b6c640 1 Processor -- start 2023-11-04T01:40:12.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.580+0000 7f67f8b6c640 1 -- start start 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f8b6c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67f40cde60 0x7f67f415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f8b6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40ce240 0x7f67f40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f8b6c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f415e000 con 0x7f67f415daa0 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f8b6c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f415e5c0 con 0x7f67f40cde60 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f8b6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f415e2e0 con 0x7f67f40ce240 2023-11-04T01:40:12.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.581+0000 7f67f259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67f40cde60 0x7f67f415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67f40cde60 0x7f67f415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59672/0 (socket says 172.21.15.93:59672) 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 -- 172.21.15.93:0/3395222399 learned_addr learned my addr 172.21.15.93:0/3395222399 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f2d9d640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40ce240 0x7f67f40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 -- 172.21.15.93:0/3395222399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40ce240 msgr2=0x7f67f40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40ce240 0x7f67f40d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 -- 172.21.15.93:0/3395222399 >> v1:172.21.15.125:6789/0 conn(0x7f67f415daa0 legacy=0x7f67f4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.582+0000 7f67f259c640 1 -- 172.21.15.93:0/3395222399 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40d1120 con 0x7f67f40cde60 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f259c640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40cde60 0x7f67f415d560 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009e50 tx=0x7f67e402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caba85d30c69086e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f159a640 1 -- 172.21.15.93:0/3395222399 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e402cb00 con 0x7f67f40cde60 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f159a640 1 -- 172.21.15.93:0/3395222399 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e402cc60 con 0x7f67f40cde60 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f159a640 1 -- 172.21.15.93:0/3395222399 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e40343f0 con 0x7f67f40cde60 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 -- 172.21.15.93:0/3395222399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40cde60 msgr2=0x7f67f415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40cde60 0x7f67f415d560 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009e50 tx=0x7f67e402bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 -- 172.21.15.93:0/3395222399 shutdown_connections 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40ce240 0x7f67f40d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/3395222399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40cde60 0x7f67f415d560 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 -- 172.21.15.93:0/3395222399 >> 172.21.15.93:0/3395222399 conn(0x7f67f4071f30 msgr2=0x7f67f40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 -- 172.21.15.93:0/3395222399 shutdown_connections 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.583+0000 7f67f8b6c640 1 -- 172.21.15.93:0/3395222399 wait complete. 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 Processor -- start 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 -- start start 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40cde60 0x7f67f4156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 0x7f67f41f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4157d70 con 0x7f67f40ce240 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41574d0 con 0x7f67f415daa0 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.585+0000 7f67f8b6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41577b0 con 0x7f67f40cde60 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59676/0 (socket says 172.21.15.93:59676) 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 -- 172.21.15.93:0/352478170 learned_addr learned my addr 172.21.15.93:0/352478170 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:12.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f2d9d640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 0x7f67f41f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f259c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40cde60 0x7f67f4156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 -- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40cde60 msgr2=0x7f67f4156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40cde60 0x7f67f4156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 -- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 msgr2=0x7f67f41f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 0x7f67f41f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 -- 172.21.15.93:0/352478170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e4009b30 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f2d9d640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 0x7f67f41f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f1d9b640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f67e800c3c0 tx=0x7f67e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80052d0 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8005450 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f4157a90 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8003830 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.586+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f41472f0 con 0x7f67f40ce240 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.587+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f4147970 con 0x7f67f40ce240 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.588+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67e8003990 con 0x7f67f40ce240 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.588+0000 7f67e2ffd640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.588+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f67e8089110 con 0x7f67f40ce240 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.588+0000 7f67f259c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.589+0000 7f67f259c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 0x7f67d406d330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f67e4035000 tx=0x7f67e4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.592+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67f4147970 con 0x7f67f40ce240 2023-11-04T01:40:12.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.794+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67f4147970 con 0x7f67f40ce240 2023-11-04T01:40:12.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.794+0000 7f67e2ffd640 1 -- 172.21.15.93:0/352478170 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f67f4147970 con 0x7f67f40ce240 2023-11-04T01:40:12.796 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:12.796 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:01.321108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:12.796 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 57 2023-11-04T01:40:12.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 msgr2=0x7f67d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 0x7f67d406d330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f67e4035000 tx=0x7f67e4030000 comp rx=0 tx=0).stop 2023-11-04T01:40:12.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 msgr2=0x7f67f4146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f67e800c3c0 tx=0x7f67e800c880 comp rx=0 tx=0).stop 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 shutdown_connections 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67d406ae70 0x7f67d406d330 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67f415daa0 0x7f67f41f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67f40ce240 0x7f67f4146db0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 --2- 172.21.15.93:0/352478170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67f40cde60 0x7f67f4156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 >> 172.21.15.93:0/352478170 conn(0x7f67f4071f30 msgr2=0x7f67f40c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 shutdown_connections 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:12.796+0000 7f67f8b6c640 1 -- 172.21.15.93:0/352478170 wait complete. 2023-11-04T01:40:12.808 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:13.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:40:17.809 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:17.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.921+0000 7fa5fefb6640 1 Processor -- start 2023-11-04T01:40:17.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.921+0000 7fa5fefb6640 1 -- start start 2023-11-04T01:40:17.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fefb6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5f815ad80 0x7fa5f806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fefb6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f80b42c0 0x7fa5f80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fefb6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80ca070 con 0x7fa5f80c9c40 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fefb6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f806cd00 con 0x7fa5f815ad80 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fefb6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806cfa0 con 0x7fa5f80b42c0 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5f815ad80 0x7fa5f806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fd553640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa5f80c9c40 0x7fa5f8070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:50996/0 (socket says 172.21.15.93:50996) 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5f815ad80 0x7fa5f806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59692/0 (socket says 172.21.15.93:59692) 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fd553640 1 -- 172.21.15.93:0/1177972607 learned_addr learned my addr 172.21.15.93:0/1177972607 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5f7fff640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f80b42c0 0x7fa5f80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 -- 172.21.15.93:0/1177972607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f80b42c0 msgr2=0x7fa5f80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f80b42c0 0x7fa5f80c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 -- 172.21.15.93:0/1177972607 >> v1:172.21.15.93:6789/0 conn(0x7fa5f80c9c40 legacy=0x7fa5f8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5fcd52640 1 -- 172.21.15.93:0/1177972607 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f806d280 con 0x7fa5f815ad80 2023-11-04T01:40:17.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.922+0000 7fa5f77fe640 1 -- 172.21.15.93:0/1177972607 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537452451 0 0) 0x7fa5f80ca070 con 0x7fa5f80c9c40 2023-11-04T01:40:17.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.923+0000 7fa5fcd52640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f815ad80 0x7fa5f806c7c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0097a0 tx=0x7fa5ec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f1ea68a2e193de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.923+0000 7fa5f77fe640 1 -- 172.21.15.93:0/1177972607 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec030610 con 0x7fa5f815ad80 2023-11-04T01:40:17.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.923+0000 7fa5f77fe640 1 -- 172.21.15.93:0/1177972607 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec030770 con 0x7fa5f815ad80 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.923+0000 7fa5f77fe640 1 -- 172.21.15.93:0/1177972607 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec030b00 con 0x7fa5f815ad80 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1177972607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f815ad80 msgr2=0x7fa5f806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f815ad80 0x7fa5f806c7c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0097a0 tx=0x7fa5ec02b960 comp rx=0 tx=0).stop 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1177972607 shutdown_connections 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f80b42c0 0x7fa5f80c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1177972607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f815ad80 0x7fa5f806c7c0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1177972607 >> 172.21.15.93:0/1177972607 conn(0x7fa5f80ce950 msgr2=0x7fa5f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1177972607 shutdown_connections 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.924+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1177972607 wait complete. 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.925+0000 7fa5fefb6640 1 Processor -- start 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.925+0000 7fa5fefb6640 1 -- start start 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5f80b42c0 0x7fa5f81ec920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f815ad80 0x7fa5f81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80c8c60 con 0x7fa5f80c9c40 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81f2c30 con 0x7fa5f80b42c0 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fefb6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80c8980 con 0x7fa5f815ad80 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59696/0 (socket says 172.21.15.93:59696) 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 -- 172.21.15.93:0/1440282374 learned_addr learned my addr 172.21.15.93:0/1440282374 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fcd52640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5f80b42c0 0x7fa5f81ec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 -- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f815ad80 msgr2=0x7fa5f81571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5fd553640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f815ad80 0x7fa5f81571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f815ad80 0x7fa5f81571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 -- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5f80b42c0 msgr2=0x7fa5f81ec920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5f80b42c0 0x7fa5f81ec920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.926+0000 7fa5f7fff640 1 -- 172.21.15.93:0/1440282374 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009400 con 0x7fa5f80c9c40 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5f7fff640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400d5f0 tx=0x7fa5e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40125f0 con 0x7fa5f80c9c40 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4012750 con 0x7fa5f80c9c40 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f81f2ed0 con 0x7fa5f80c9c40 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4012b00 con 0x7fa5f80c9c40 2023-11-04T01:40:17.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.927+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f81ece60 con 0x7fa5f80c9c40 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.928+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f81f2a90 con 0x7fa5f80c9c40 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.928+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5e4012c60 con 0x7fa5f80c9c40 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.928+0000 7fa5f57fa640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 0x7fa5dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.929+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fa5e408a110 con 0x7fa5f80c9c40 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.929+0000 7fa5fcd52640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 0x7fa5dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.929+0000 7fa5fcd52640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 0x7fa5dc06d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec036000 tx=0x7fa5ec03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:17.933+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5f81f2a90 con 0x7fa5f80c9c40 2023-11-04T01:40:18.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.134+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5f81f2a90 con 0x7fa5f80c9c40 2023-11-04T01:40:18.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.134+0000 7fa5f57fa640 1 -- 172.21.15.93:0/1440282374 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4979 (secure 0 0 0) 0x7fa5f81f2a90 con 0x7fa5f80c9c40 2023-11-04T01:40:18.136 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:18.136 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:17.053332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5747,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5747":{"gid":5747,"name":"d","rank":0,"incarnation":52,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6834/596691451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":596691451},{"type":"v1","addr":"172.21.15.125:6834","nonce":596691451}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:17.053332+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:18.136 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 58 2023-11-04T01:40:18.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 msgr2=0x7fa5dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 0x7fa5dc06d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec036000 tx=0x7fa5ec03b040 comp rx=0 tx=0).stop 2023-11-04T01:40:18.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 msgr2=0x7fa5f80c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400d5f0 tx=0x7fa5e400dab0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 shutdown_connections 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa5dc06ae70 0x7fa5dc06d330 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa5f815ad80 0x7fa5f81571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5f80c9c40 0x7fa5f80c7fa0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 --2- 172.21.15.93:0/1440282374 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa5f80b42c0 0x7fa5f81ec920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 >> 172.21.15.93:0/1440282374 conn(0x7fa5f80ce950 msgr2=0x7fa5f80af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 shutdown_connections 2023-11-04T01:40:18.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.137+0000 7fa5fefb6640 1 -- 172.21.15.93:0/1440282374 wait complete. 2023-11-04T01:40:18.149 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:40:18.149 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:18.179 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:18.181 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:18.181 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:18.253 INFO:teuthology.orchestra.run.smithi125.stdout:1699062001.95607.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:18.256 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062001.95607.core'] 2023-11-04T01:40:18.256 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062001.95607.core, deleting it 2023-11-04T01:40:18.256 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062001.95607.core 2023-11-04T01:40:18.327 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:18.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.427+0000 7f4cf77ee640 1 Processor -- start 2023-11-04T01:40:18.428 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.427+0000 7f4cf77ee640 1 -- start start 2023-11-04T01:40:18.429 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4cf0160430 0x7f4cf00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf00b2b60 0x7f4cf006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4cf006c1d0 0x7f4cf0160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf00cb580 con 0x7f4cf0160430 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf00b2fc0 con 0x7f4cf006c1d0 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf77ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf006ca40 con 0x7f4cf00b2b60 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4cf0160430 0x7f4cf00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4cf0160430 0x7f4cf00b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59704/0 (socket says 172.21.15.93:59704) 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 -- 172.21.15.93:0/2333058736 learned_addr learned my addr 172.21.15.93:0/2333058736 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf5d8b640 1 --2- 172.21.15.93:0/2333058736 >> v2:172.21.15.125:3300/0 conn(0x7f4cf006c1d0 0x7f4cf0160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf4d89640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf00b2b60 0x7f4cf006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 -- 172.21.15.93:0/2333058736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf00b2b60 msgr2=0x7f4cf006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf00b2b60 0x7f4cf006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 -- 172.21.15.93:0/2333058736 >> v2:172.21.15.125:3300/0 conn(0x7f4cf006c1d0 msgr2=0x7f4cf0160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2333058736 >> v2:172.21.15.125:3300/0 conn(0x7f4cf006c1d0 0x7f4cf0160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.431 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.428+0000 7f4cf558a640 1 -- 172.21.15.93:0/2333058736 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf006cd20 con 0x7f4cf0160430 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.429+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf0160430 0x7f4cf00b2620 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00ce900 tx=0x7f4cec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3864cc4fe1b0bc45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.429+0000 7f4ce7fff640 1 -- 172.21.15.93:0/2333058736 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec031870 con 0x7f4cf0160430 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.429+0000 7f4ce7fff640 1 -- 172.21.15.93:0/2333058736 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0319d0 con 0x7f4cf0160430 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4ce7fff640 1 -- 172.21.15.93:0/2333058736 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec031d60 con 0x7f4cf0160430 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2333058736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf0160430 msgr2=0x7f4cf00b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf0160430 0x7f4cf00b2620 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00ce900 tx=0x7f4cec02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2333058736 shutdown_connections 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2333058736 >> v2:172.21.15.125:3300/0 conn(0x7f4cf006c1d0 0x7f4cf0160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.432 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf00b2b60 0x7f4cf006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2333058736 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf0160430 0x7f4cf00b2620 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2333058736 >> 172.21.15.93:0/2333058736 conn(0x7f4cf006ea20 msgr2=0x7f4cf006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2333058736 shutdown_connections 2023-11-04T01:40:18.433 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.430+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2333058736 wait complete. 2023-11-04T01:40:18.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.431+0000 7f4cf77ee640 1 Processor -- start 2023-11-04T01:40:18.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.431+0000 7f4cf77ee640 1 -- start start 2023-11-04T01:40:18.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf006c1d0 0x7f4cf01f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cf0160430 0x7f4cf0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c60e0 con 0x7f4cf00b2b60 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c54d0 con 0x7f4cf0160430 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf77ee640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c57b0 con 0x7f4cf006c1d0 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59710/0 (socket says 172.21.15.93:59710) 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 -- 172.21.15.93:0/2870632566 learned_addr learned my addr 172.21.15.93:0/2870632566 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf006c1d0 0x7f4cf01f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 -- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf006c1d0 msgr2=0x7f4cf01f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf006c1d0 0x7f4cf01f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 -- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cf0160430 msgr2=0x7f4cf0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cf0160430 0x7f4cf0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.432+0000 7f4cf4d89640 1 -- 172.21.15.93:0/2870632566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0094d0 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4cf4d89640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000e9b0 tx=0x7f4ce000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0009670 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000c920 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf00c5a90 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000ccd0 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.433+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0155580 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.434+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf00c6290 con 0x7f4cf00b2b60 2023-11-04T01:40:18.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.434+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ce0013470 con 0x7f4cf00b2b60 2023-11-04T01:40:18.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.435+0000 7f4ce5ffb640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 0x7f4cd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.435+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 0x7f4cd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.435+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f4ce0089d00 con 0x7f4cf00b2b60 2023-11-04T01:40:18.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.435+0000 7f4cf558a640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 0x7f4cd406d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.440 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.439+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4cf00c6290 con 0x7f4cf00b2b60 2023-11-04T01:40:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.670+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f4cf0074290 con 0x7f4cf00b2b60 2023-11-04T01:40:18.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.672+0000 7f4ce5ffb640 1 -- 172.21.15.93:0/2870632566 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 5747 v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ce00582c0 con 0x7f4cf00b2b60 2023-11-04T01:40:18.673 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 5747 2023-11-04T01:40:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 msgr2=0x7f4cd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 0x7f4cd406d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 msgr2=0x7f4cf00c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000e9b0 tx=0x7f4ce000ee70 comp rx=0 tx=0).stop 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 shutdown_connections 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4cd406ae70 0x7f4cd406d330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cf0160430 0x7f4cf0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4cf00b2b60 0x7f4cf00c6570 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 --2- 172.21.15.93:0/2870632566 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4cf006c1d0 0x7f4cf01f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 >> 172.21.15.93:0/2870632566 conn(0x7f4cf006ea20 msgr2=0x7f4cf00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 shutdown_connections 2023-11-04T01:40:18.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.675+0000 7f4cf77ee640 1 -- 172.21.15.93:0/2870632566 wait complete. 2023-11-04T01:40:18.690 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:40:18.690 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:40:18.690 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:40:18.690 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:18.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:18.690 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:40:18.691 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:40:18.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:40:18.693 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:40:18.694 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:18.770 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:40:18.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.792+0000 7f187a125640 1 Processor -- start 2023-11-04T01:40:18.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.792+0000 7f187a125640 1 -- start start 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f187a125640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f187415ad80 0x7f187406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f187a125640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18740c9e10 0x7f18740b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f187a125640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406cd00 con 0x7f18740b42c0 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f187a125640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187406cfa0 con 0x7f18740c9e10 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f187a125640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187406d280 con 0x7f187415ad80 2023-11-04T01:40:18.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18740c9e10 0x7f18740b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18740c9e10 0x7f18740b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59712/0 (socket says 172.21.15.93:59712) 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 -- 172.21.15.93:0/3337540329 learned_addr learned my addr 172.21.15.93:0/3337540329 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f18737fe640 1 --2- 172.21.15.93:0/3337540329 >> v2:172.21.15.125:3300/0 conn(0x7f187415ad80 0x7f187406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 -- 172.21.15.93:0/3337540329 >> v2:172.21.15.125:3300/0 conn(0x7f187415ad80 msgr2=0x7f187406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 --2- 172.21.15.93:0/3337540329 >> v2:172.21.15.125:3300/0 conn(0x7f187415ad80 0x7f187406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 -- 172.21.15.93:0/3337540329 >> v1:172.21.15.125:6789/0 conn(0x7f18740b42c0 legacy=0x7f18740c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.793+0000 7f1873fff640 1 -- 172.21.15.93:0/3337540329 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187406d560 con 0x7f18740c9e10 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.794+0000 7f1873fff640 1 --2- 172.21.15.93:0/3337540329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18740c9e10 0x7f18740b1a40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f18740b4ac0 tx=0x7f186c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edecde187c2282c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.794+0000 7f18727fc640 1 -- 172.21.15.93:0/3337540329 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c02cbb0 con 0x7f18740c9e10 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.794+0000 7f18727fc640 1 -- 172.21.15.93:0/3337540329 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c02cd10 con 0x7f18740c9e10 2023-11-04T01:40:18.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.794+0000 7f18727fc640 1 -- 172.21.15.93:0/3337540329 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c034610 con 0x7f18740c9e10 2023-11-04T01:40:18.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 -- 172.21.15.93:0/3337540329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18740c9e10 msgr2=0x7f18740b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 --2- 172.21.15.93:0/3337540329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18740c9e10 0x7f18740b1a40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f18740b4ac0 tx=0x7f186c02c010 comp rx=0 tx=0).stop 2023-11-04T01:40:18.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 -- 172.21.15.93:0/3337540329 shutdown_connections 2023-11-04T01:40:18.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 --2- 172.21.15.93:0/3337540329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18740c9e10 0x7f18740b1a40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 --2- 172.21.15.93:0/3337540329 >> v2:172.21.15.125:3300/0 conn(0x7f187415ad80 0x7f187406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 -- 172.21.15.93:0/3337540329 >> 172.21.15.93:0/3337540329 conn(0x7f18740ce950 msgr2=0x7f18740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 -- 172.21.15.93:0/3337540329 shutdown_connections 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.795+0000 7f187a125640 1 -- 172.21.15.93:0/3337540329 wait complete. 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.796+0000 7f187a125640 1 Processor -- start 2023-11-04T01:40:18.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.796+0000 7f187a125640 1 -- start start 2023-11-04T01:40:18.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18740b42c0 0x7f18741f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18740c9e10 0x7f187414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187415ccb0 con 0x7f187415ad80 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187415cf90 con 0x7f18740b42c0 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18740c5990 con 0x7f18740c9e10 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:59714/0 (socket says 172.21.15.93:59714) 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 -- 172.21.15.93:0/1311126631 learned_addr learned my addr 172.21.15.93:0/1311126631 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1872ffd640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18740c9e10 0x7f187414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f18737fe640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18740b42c0 0x7f18741f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 -- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18740c9e10 msgr2=0x7f187414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18740c9e10 0x7f187414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 -- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18740b42c0 msgr2=0x7f18741f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18740b42c0 0x7f18741f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 -- 172.21.15.93:0/1311126631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009b30 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f1873fff640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f186c036040 tx=0x7f186c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c009510 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c03e450 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c03e800 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18740c5c70 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.797+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187415de40 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.798+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18740c6130 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.799+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f186c03e960 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.799+0000 7f185bfff640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 0x7f186006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.799+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f186c0ac9e0 con 0x7f187415ad80 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.799+0000 7f18737fe640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 0x7f186006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.800+0000 7f18737fe640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 0x7f186006d360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1864006fd0 tx=0x7f1864008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:18.803+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f186c077420 con 0x7f187415ad80 2023-11-04T01:40:19.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.003+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1874074290 con 0x7f187415ad80 2023-11-04T01:40:19.004 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.003+0000 7f185bfff640 1 -- 172.21.15.93:0/1311126631 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4139 (secure 0 0 0) 0x7f186c07aa40 con 0x7f187415ad80 2023-11-04T01:40:19.005 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:19.005 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:18.676188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:replay","state_seq":1,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:19.005 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 60 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 msgr2=0x7f186006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 0x7f186006d360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1864006fd0 tx=0x7f1864008040 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 msgr2=0x7f187415c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f186c036040 tx=0x7f186c004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 shutdown_connections 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f186006aea0 0x7f186006d360 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f187415ad80 0x7f187415c1b0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18740c9e10 0x7f187414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 --2- 172.21.15.93:0/1311126631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18740b42c0 0x7f18741f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 >> 172.21.15.93:0/1311126631 conn(0x7f18740ce950 msgr2=0x7f18740b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 shutdown_connections 2023-11-04T01:40:19.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:19.005+0000 7f187a125640 1 -- 172.21.15.93:0/1311126631 wait complete. 2023-11-04T01:40:19.017 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:20.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:40:21.977 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:21.980 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:24.018 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:24.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.127+0000 7f1264b05640 1 Processor -- start 2023-11-04T01:40:24.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.127+0000 7f1264b05640 1 -- start start 2023-11-04T01:40:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f1264b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f12600ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f1264b05640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f12600b0ae0 0x7f126015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f1264b05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600b4110 con 0x7f126006db20 2023-11-04T01:40:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f1264b05640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600b49b0 con 0x7f12600b0ae0 2023-11-04T01:40:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f1264b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600b43f0 con 0x7f1260159c70 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f125dd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f126006db20 0x7f12600b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59750/0 (socket says 172.21.15.93:59750) 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f125dd9b640 1 -- 172.21.15.93:0/3191469205 learned_addr learned my addr 172.21.15.93:0/3191469205 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.128+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526861081 0 0) 0x7f12600b4110 con 0x7f126006db20 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125e59c640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f12600ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125ed9d640 1 --2- 172.21.15.93:0/3191469205 >> v2:172.21.15.125:3300/0 conn(0x7f12600b0ae0 0x7f126015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1248003520 con 0x7f126006db20 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2296257785 0 0) 0x7f1248003520 con 0x7f126006db20 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 msgr2=0x7f12600ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f12600ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 >> v2:172.21.15.125:3300/0 conn(0x7f12600b0ae0 msgr2=0x7f126015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 --2- 172.21.15.93:0/3191469205 >> v2:172.21.15.125:3300/0 conn(0x7f12600b0ae0 0x7f126015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600b46d0 con 0x7f126006db20 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1254001670 con 0x7f126006db20 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 >> v1:172.21.15.93:6789/0 conn(0x7f126006db20 legacy=0x7f12600b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1248003970 0x7f1248003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12480047c0 0x7f1248004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f1248005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600b49b0 con 0x7f12480047c0 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600b43f0 con 0x7f1248003970 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124800b980 con 0x7f1260159c70 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12480047c0 0x7f1248004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125e59c640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1248003970 0x7f1248003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125ed9d640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f1248005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 -- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 msgr2=0x7f1248005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f1248005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 -- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1248003970 msgr2=0x7f1248003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1248003970 0x7f1248003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125dd9b640 1 -- 172.21.15.93:0/3191469205 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248003520 con 0x7f12480047c0 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.129+0000 7f125ed9d640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260159c70 0x7f1248005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.130+0000 7f125dd9b640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12480047c0 0x7f1248004c40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f125400c210 tx=0x7f12480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7fd0b18ebdd9c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.130+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254005ad0 con 0x7f12480047c0 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.130+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254005c30 con 0x7f12480047c0 2023-11-04T01:40:24.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.130+0000 7f125d59a640 1 -- 172.21.15.93:0/3191469205 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125402c8d0 con 0x7f12480047c0 2023-11-04T01:40:24.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 -- 172.21.15.93:0/3191469205 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12480047c0 msgr2=0x7f1248004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 --2- 172.21.15.93:0/3191469205 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12480047c0 0x7f1248004c40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f125400c210 tx=0x7f12480057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f125ed9d640 1 -- 172.21.15.93:0/3191469205 reap_dead start 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 -- 172.21.15.93:0/3191469205 shutdown_connections 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 -- 172.21.15.93:0/3191469205 >> 172.21.15.93:0/3191469205 conn(0x7f12600ce950 msgr2=0x7f12600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 -- 172.21.15.93:0/3191469205 shutdown_connections 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.131+0000 7f1264b05640 1 -- 172.21.15.93:0/3191469205 wait complete. 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.132+0000 7f1264b05640 1 Processor -- start 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.132+0000 7f1264b05640 1 -- start start 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12480047c0 0x7f1260151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260070710 0x7f1260070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c7b00 con 0x7f12600c7680 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600710d0 con 0x7f12480047c0 2023-11-04T01:40:24.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f1264b05640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126014fc80 con 0x7f1260070710 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47646/0 (socket says 172.21.15.93:47646) 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 -- 172.21.15.93:0/2945755003 learned_addr learned my addr 172.21.15.93:0/2945755003 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125ed9d640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260070710 0x7f1260070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125e59c640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12480047c0 0x7f1260151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 -- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260070710 msgr2=0x7f1260070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260070710 0x7f1260070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 -- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12480047c0 msgr2=0x7f1260151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12480047c0 0x7f1260151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 -- 172.21.15.93:0/2945755003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12601f2750 con 0x7f12600c7680 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.133+0000 7f125dd9b640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f125400c210 tx=0x7f12600ce8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.134+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125403c040 con 0x7f12600c7680 2023-11-04T01:40:24.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.134+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254007270 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.134+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600c7d10 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.134+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125402dea0 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.134+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600c82d0 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.135+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1260074290 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.135+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1254032070 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.135+0000 7f124effd640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 0x7f124006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.135+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f12540ab4b0 con 0x7f12600c7680 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.135+0000 7f125e59c640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 0x7f124006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.136+0000 7f125e59c640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 0x7f124006d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12500099c0 tx=0x7f1250008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.140+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1254075ef0 con 0x7f12600c7680 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.342+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f126006d3f0 con 0x7f12600c7680 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.342+0000 7f124effd640 1 -- 172.21.15.93:0/2945755003 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f125403f350 con 0x7f12600c7680 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:21.694732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 64 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 msgr2=0x7f124006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 0x7f124006d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12500099c0 tx=0x7f1250008040 comp rx=0 tx=0).stop 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 msgr2=0x7f12600c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f125400c210 tx=0x7f12600ce8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 shutdown_connections 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f124006ae70 0x7f124006d330 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1260070710 0x7f1260070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12600c7680 0x7f12600c4a20 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 --2- 172.21.15.93:0/2945755003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f12480047c0 0x7f1260151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 >> 172.21.15.93:0/2945755003 conn(0x7f12600ce950 msgr2=0x7f1260158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.344+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 shutdown_connections 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.345+0000 7f1264b05640 1 -- 172.21.15.93:0/2945755003 wait complete. 2023-11-04T01:40:24.357 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:40:24.358 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:24.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.455+0000 7f46dcbd0640 1 Processor -- start 2023-11-04T01:40:24.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.455+0000 7f46dcbd0640 1 -- start start 2023-11-04T01:40:24.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46dcbd0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d815d250 0x7f46d80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46dcbd0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46d80c9d70 0x7f46d80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46dcbd0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d806a120 con 0x7f46d815ce70 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46dcbd0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80cdc10 con 0x7f46d815d250 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46dcbd0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d806a370 con 0x7f46d80c9d70 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d815d250 0x7f46d80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46d815d250 0x7f46d80c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47656/0 (socket says 172.21.15.93:47656) 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 -- 172.21.15.93:0/1779944677 learned_addr learned my addr 172.21.15.93:0/1779944677 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 -- 172.21.15.93:0/1779944677 >> v2:172.21.15.125:3300/0 conn(0x7f46d80c9d70 msgr2=0x7f46d80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 --2- 172.21.15.93:0/1779944677 >> v2:172.21.15.125:3300/0 conn(0x7f46d80c9d70 0x7f46d80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 -- 172.21.15.93:0/1779944677 >> v1:172.21.15.125:6789/0 conn(0x7f46d815ce70 legacy=0x7f46d806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.456+0000 7f46cffff640 1 -- 172.21.15.93:0/1779944677 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d806a650 con 0x7f46d815d250 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46cffff640 1 --2- 172.21.15.93:0/1779944677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815d250 0x7f46d80c9830 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f46d809cee0 tx=0x7f46c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab23e886d88572e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46d5d9b640 1 -- 172.21.15.93:0/1779944677 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0031870 con 0x7f46d815d250 2023-11-04T01:40:24.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46d5d9b640 1 -- 172.21.15.93:0/1779944677 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c00319d0 con 0x7f46d815d250 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46d5d9b640 1 -- 172.21.15.93:0/1779944677 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0031d60 con 0x7f46d815d250 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 -- 172.21.15.93:0/1779944677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815d250 msgr2=0x7f46d80c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/1779944677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815d250 0x7f46d80c9830 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f46d809cee0 tx=0x7f46c002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 -- 172.21.15.93:0/1779944677 shutdown_connections 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/1779944677 >> v2:172.21.15.125:3300/0 conn(0x7f46d80c9d70 0x7f46d80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/1779944677 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815d250 0x7f46d80c9830 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.457+0000 7f46dcbd0640 1 -- 172.21.15.93:0/1779944677 >> 172.21.15.93:0/1779944677 conn(0x7f46d80b0cd0 msgr2=0x7f46d80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.458+0000 7f46dcbd0640 1 -- 172.21.15.93:0/1779944677 shutdown_connections 2023-11-04T01:40:24.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.458+0000 7f46dcbd0640 1 -- 172.21.15.93:0/1779944677 wait complete. 2023-11-04T01:40:24.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 Processor -- start 2023-11-04T01:40:24.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 -- start start 2023-11-04T01:40:24.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d815d250 0x7f46d8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d81571a0 0x7f46d80aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80b0290 con 0x7f46d815ce70 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80c3450 con 0x7f46d815d250 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.459+0000 7f46dcbd0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80c2b20 con 0x7f46d81571a0 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47658/0 (socket says 172.21.15.93:47658) 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 -- 172.21.15.93:0/3527690086 learned_addr learned my addr 172.21.15.93:0/3527690086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 -- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d81571a0 msgr2=0x7f46d80aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d81571a0 0x7f46d80aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 -- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d815d250 msgr2=0x7f46d8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d815d250 0x7f46d8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.465 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 -- 172.21.15.93:0/3527690086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00094d0 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46d659c640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f46c800c460 tx=0x7f46c800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8012830 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c80129d0 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d80c2e00 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8012d80 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.460+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d8158700 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.461+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d81588f0 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.461+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46c801a3b0 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.462+0000 7f46ceffd640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 0x7f46b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.462+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f46c80898e0 con 0x7f46d815ce70 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.462+0000 7f46cffff640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 0x7f46b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.466 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.462+0000 7f46cffff640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 0x7f46b806d360 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f46c0036000 tx=0x7f46c0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.466+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46d81588f0 con 0x7f46d815ce70 2023-11-04T01:40:24.504 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:24.505 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:24.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.667+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46d81588f0 con 0x7f46d815ce70 2023-11-04T01:40:24.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.668+0000 7f46ceffd640 1 -- 172.21.15.93:0/3527690086 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f46d81588f0 con 0x7f46d815ce70 2023-11-04T01:40:24.671 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:24.671 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:21.694732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 64 2023-11-04T01:40:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 msgr2=0x7f46b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 0x7f46b806d360 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f46c0036000 tx=0x7f46c0030000 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 msgr2=0x7f46d80afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f46c800c460 tx=0x7f46c800c920 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 shutdown_connections 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46b806aea0 0x7f46b806d360 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46d81571a0 0x7f46d80aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46d815d250 0x7f46d8156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 --2- 172.21.15.93:0/3527690086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46d815ce70 0x7f46d80afcb0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 >> 172.21.15.93:0/3527690086 conn(0x7f46d80b0cd0 msgr2=0x7f46d806b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 shutdown_connections 2023-11-04T01:40:24.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:24.670+0000 7f46dcbd0640 1 -- 172.21.15.93:0/3527690086 wait complete. 2023-11-04T01:40:25.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:40:21.694732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 99, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7689, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7689': {'gid': 7689, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.93:6836/448915336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 448915336}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 448915336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:25.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:25.086 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:40:25.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.186+0000 7f232b664640 1 Processor -- start 2023-11-04T01:40:25.189 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 -- start start 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f232415e430 0x7f23240cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23240d0710 0x7f23240b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240d0280 con 0x7f23240cf160 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240cf670 con 0x7f232415e430 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.187+0000 7f232b664640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240cf950 con 0x7f23240d0710 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329400640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f232415e430 0x7f23240cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2328bff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f23240cf160 0x7f23240cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59762/0 (socket says 172.21.15.93:59762) 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2328bff640 1 -- 172.21.15.93:0/3160326815 learned_addr learned my addr 172.21.15.93:0/3160326815 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329c01640 1 --2- 172.21.15.93:0/3160326815 >> v2:172.21.15.125:3300/0 conn(0x7f23240d0710 0x7f23240b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329400640 1 -- 172.21.15.93:0/3160326815 >> v2:172.21.15.125:3300/0 conn(0x7f23240d0710 msgr2=0x7f23240b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329400640 1 --2- 172.21.15.93:0/3160326815 >> v2:172.21.15.125:3300/0 conn(0x7f23240d0710 0x7f23240b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329400640 1 -- 172.21.15.93:0/3160326815 >> v1:172.21.15.93:6789/0 conn(0x7f23240cf160 legacy=0x7f23240cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.188+0000 7f2329400640 1 -- 172.21.15.93:0/3160326815 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240cfc30 con 0x7f232415e430 2023-11-04T01:40:25.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.189+0000 7f2329400640 1 --2- 172.21.15.93:0/3160326815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232415e430 0x7f23240cec20 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f23240b6250 tx=0x7f232002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31efc8f2237c57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.189+0000 7f231bfff640 1 -- 172.21.15.93:0/3160326815 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232002cc80 con 0x7f232415e430 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.189+0000 7f231bfff640 1 -- 172.21.15.93:0/3160326815 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232002cde0 con 0x7f232415e430 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.189+0000 7f231bfff640 1 -- 172.21.15.93:0/3160326815 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320034660 con 0x7f232415e430 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 -- 172.21.15.93:0/3160326815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232415e430 msgr2=0x7f23240cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 --2- 172.21.15.93:0/3160326815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232415e430 0x7f23240cec20 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f23240b6250 tx=0x7f232002bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 -- 172.21.15.93:0/3160326815 shutdown_connections 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 --2- 172.21.15.93:0/3160326815 >> v2:172.21.15.125:3300/0 conn(0x7f23240d0710 0x7f23240b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 --2- 172.21.15.93:0/3160326815 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f232415e430 0x7f23240cec20 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 -- 172.21.15.93:0/3160326815 >> 172.21.15.93:0/3160326815 conn(0x7f232406ea20 msgr2=0x7f232406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 -- 172.21.15.93:0/3160326815 shutdown_connections 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.190+0000 7f232b664640 1 -- 172.21.15.93:0/3160326815 wait complete. 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.191+0000 7f232b664640 1 Processor -- start 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.191+0000 7f232b664640 1 -- start start 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23240d0710 0x7f23241f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232415e430 0x7f232415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241f31c0 con 0x7f23240cf160 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241f34a0 con 0x7f232415e430 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23241575e0 con 0x7f23240d0710 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47672/0 (socket says 172.21.15.93:47672) 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 -- 172.21.15.93:0/3903650549 learned_addr learned my addr 172.21.15.93:0/3903650549 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 -- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23240d0710 msgr2=0x7f23241f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23240d0710 0x7f23241f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 -- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232415e430 msgr2=0x7f232415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232415e430 0x7f232415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 -- 172.21.15.93:0/3903650549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320009a70 con 0x7f23240cf160 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2329400640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f2320009e80 tx=0x7f2320004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2319ffb640 1 -- 172.21.15.93:0/3903650549 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232003e610 con 0x7f23240cf160 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2319ffb640 1 -- 172.21.15.93:0/3903650549 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232003e790 con 0x7f23240cf160 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241578c0 con 0x7f23240cf160 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f2319ffb640 1 -- 172.21.15.93:0/3903650549 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232003eb40 con 0x7f23240cf160 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.192+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23241556a0 con 0x7f23240cf160 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.194+0000 7f2319ffb640 1 -- 172.21.15.93:0/3903650549 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f232003b050 con 0x7f23240cf160 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.194+0000 7f2319ffb640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 0x7f230806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.194+0000 7f2328bff640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 0x7f230806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.194+0000 7f2319ffb640 1 -- 172.21.15.93:0/3903650549 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f23200ac6a0 con 0x7f23240cf160 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.195+0000 7f2328bff640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 0x7f230806d330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f232415a880 tx=0x7f2314007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.195+0000 7f232e1f6740 1 Processor -- start 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.195+0000 7f232e1f6740 1 -- start start 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x560814984750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x560814984c90 0x5608149b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x560814895740 con 0x5608149b1c30 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608148f78d0 con 0x5608149b1850 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608148f4fc0 con 0x560814984c90 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47676/0 (socket says 172.21.15.93:47676) 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 -- 172.21.15.93:0/1946927874 learned_addr learned my addr 172.21.15.93:0/1946927874 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2329400640 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x560814984750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2329c01640 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x560814984c90 0x5608149b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 -- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x560814984c90 msgr2=0x5608149b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x560814984c90 0x5608149b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 -- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 msgr2=0x560814984750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x560814984750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.196+0000 7f2328bff640 1 -- 172.21.15.93:0/1946927874 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608148b3ca0 con 0x5608149b1c30 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f2328bff640 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2314005b80 tx=0x7f231400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f2f5c614032fc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f230effd640 1 -- 172.21.15.93:0/1946927874 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231401b070 con 0x5608149b1c30 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f230effd640 1 -- 172.21.15.93:0/1946927874 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314012440 con 0x5608149b1c30 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f230effd640 1 -- 172.21.15.93:0/1946927874 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140127d0 con 0x5608149b1c30 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 -- 172.21.15.93:0/1946927874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 msgr2=0x5608149b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2314005b80 tx=0x7f231400f000 comp rx=0 tx=0).stop 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 -- 172.21.15.93:0/1946927874 shutdown_connections 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x560814984c90 0x5608149b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b45e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1946927874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x560814984750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 -- 172.21.15.93:0/1946927874 >> 172.21.15.93:0/1946927874 conn(0x560814986a60 msgr2=0x5608149cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 -- 172.21.15.93:0/1946927874 shutdown_connections 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.197+0000 7f232e1f6740 1 -- 172.21.15.93:0/1946927874 wait complete. 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.198+0000 7f232e1f6740 1 -- start start 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.198+0000 7f232e1f6740 1 Processor -- start 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149a2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x56081499f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608148f08b0 con 0x5608149b1c30 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608148aac80 con 0x5608149b1850 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608148aa920 con 0x56081499f160 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f232e1f6740 10 client.0 _ll_register_callbacks cb 0x560814602ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47680/0 (socket says 172.21.15.93:47680) 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 -- 172.21.15.93:0/1650675622 learned_addr learned my addr 172.21.15.93:0/1650675622 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2329400640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2329c01640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x56081499f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 -- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 msgr2=0x56081499f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x56081499f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 -- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 msgr2=0x5608149a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 -- 172.21.15.93:0/1650675622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240d0280 con 0x5608149b1c30 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2329400640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2328bff640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2314000f60 tx=0x7f2314001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6c04bc7ba687ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.199+0000 7f2303fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314025070 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f2314014640 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56081489cbf0 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2314014800 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 10 client.7842 fetch_fsmap learned FSMap version 64 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5608148eef30 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56081489cbf0 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2314014960 con 0x5608149b1c30 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 10 client.7842 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 10 client.7842 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 20 client.7842 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5608149a0c00 0x5608149a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 4 client.7842 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608148e9890 con 0x5608149a0c00 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.200+0000 7f2329400640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5608149a0c00 0x5608149a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f2303fff640 10 client.7842 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f2329400640 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5608149a0c00 0x5608149a0fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9141a92b968e899d server_cookie=53fa6194e650d0cf in_seq=0 out_seq=0 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f2303fff640 1 -- 172.21.15.93:0/1650675622 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5608148e9890 con 0x5608149a0c00 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f2303fff640 10 client.7842 handle_command_reply: tid=0 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 client.7842 shutdown 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 msgr2=0x5608149b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2314000f60 tx=0x7f2314001080 comp rx=0 tx=0).stop 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 shutdown_connections 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5608149a0c00 0x5608149a0fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x56081499f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f2303fff640 0 client.7842 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149b6fe0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 --2- 172.21.15.93:0/1650675622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.201+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 >> 172.21.15.93:0/1650675622 conn(0x560814984c90 msgr2=0x5608149c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.202+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 shutdown_connections 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.202+0000 7f232e1f6740 1 -- 172.21.15.93:0/1650675622 wait complete. 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.202+0000 7f232e1f6740 20 client.7842 trim_cache size 0 max 16384 2023-11-04T01:40:25.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.217+0000 7f232e1f6740 1 Processor -- start 2023-11-04T01:40:25.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.217+0000 7f232e1f6740 1 -- start start 2023-11-04T01:40:25.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x5608149c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x560814870280 con 0x5608149b1c30 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560814987ec0 con 0x5608149b1850 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608149f1eb0 con 0x56081499f160 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47690/0 (socket says 172.21.15.93:47690) 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 -- 172.21.15.93:0/4105043037 learned_addr learned my addr 172.21.15.93:0/4105043037 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 -- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 msgr2=0x5608149c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x5608149c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 -- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 msgr2=0x5608149c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 -- 172.21.15.93:0/4105043037 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56081488cd10 con 0x5608149b1c30 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f2329c01640 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f23240d0b70 tx=0x7f231c00bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1141ed48b97b03cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f230f7fe640 1 -- 172.21.15.93:0/4105043037 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00bda0 con 0x5608149b1c30 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f230f7fe640 1 -- 172.21.15.93:0/4105043037 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c004030 con 0x5608149b1c30 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.218+0000 7f230f7fe640 1 -- 172.21.15.93:0/4105043037 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0043a0 con 0x5608149b1c30 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 -- 172.21.15.93:0/4105043037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 msgr2=0x5608149ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f23240d0b70 tx=0x7f231c00bb50 comp rx=0 tx=0).stop 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 -- 172.21.15.93:0/4105043037 shutdown_connections 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1c30 0x5608149ca150 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1850 0x5608149c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 --2- 172.21.15.93:0/4105043037 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x5608149c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 -- 172.21.15.93:0/4105043037 >> 172.21.15.93:0/4105043037 conn(0x560814984c90 msgr2=0x5608149883f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 -- 172.21.15.93:0/4105043037 shutdown_connections 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.219+0000 7f232e1f6740 1 -- 172.21.15.93:0/4105043037 wait complete. 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 -- start start 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 Processor -- start 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x560814a3b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1c30 0x5608149b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608149b6340 con 0x5608149b1850 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608149dda50 con 0x5608149b1c30 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.220+0000 7f232e1f6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x560814983a20 con 0x56081499f160 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 10 client.0 _ll_register_callbacks cb 0x7f2314001270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47694/0 (socket says 172.21.15.93:47694) 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 -- 172.21.15.93:0/3332937860 learned_addr learned my addr 172.21.15.93:0/3332937860 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2329400640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x560814a3b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2329c01640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1c30 0x5608149b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 -- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 msgr2=0x560814a3b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x560814a3b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 -- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1c30 msgr2=0x5608149b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1c30 0x5608149b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 -- 172.21.15.93:0/3332937860 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c00e040 con 0x5608149b1850 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2328bff640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2314012940 tx=0x7f23140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9403e2ecc667fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.229 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231402ac60 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f2314014dd0 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2314012440 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2314007ed0 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 10 client.7848 fetch_fsmap learned FSMap version 64 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5608148b2500 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314012440 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2314037440 con 0x5608149b1850 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 10 client.7848 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 10 client.7848 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.221+0000 7f232e1f6740 20 client.7848 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x560814a3a930 0x560814a3ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 4 client.7848 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5608148e95b0 con 0x560814a3a930 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2329400640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x560814a3a930 0x560814a3ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2329400640 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x560814a3a930 0x560814a3ad10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7caeabbdec61a70f server_cookie=4b33778c930ec7d9 in_seq=0 out_seq=0 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2303fff640 10 client.7848 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2303fff640 1 -- 172.21.15.93:0/3332937860 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5608148e95b0 con 0x560814a3a930 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2303fff640 10 client.7848 handle_command_reply: tid=0 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 client.7848 shutdown 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 msgr2=0x5608149b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2314012940 tx=0x7f23140057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 shutdown_connections 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x560814a3a930 0x560814a3ad10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608149b1c30 0x5608149b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f2303fff640 0 client.7848 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5608149b1850 0x5608149b56f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.222+0000 7f232e1f6740 1 --2- 172.21.15.93:0/3332937860 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56081499f160 0x560814a3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 >> 172.21.15.93:0/3332937860 conn(0x560814984c90 msgr2=0x5608149883f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 shutdown_connections 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232e1f6740 1 -- 172.21.15.93:0/3332937860 wait complete. 2023-11-04T01:40:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232e1f6740 20 client.7848 trim_cache size 0 max 16384 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 1, 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5750, 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 63.179760940999998, 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 64, 2023-11-04T01:40:25.233 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:25.234 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:25.234 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 77.767092423999998 2023-11-04T01:40:25.234 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 msgr2=0x7f230806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 0x7f230806d330 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f232415a880 tx=0x7f2314007a40 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 msgr2=0x7f2324155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f2320009e80 tx=0x7f2320004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 shutdown_connections 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f230806ae70 0x7f230806d330 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f232415e430 0x7f232415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f23240d0710 0x7f23241f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 --2- 172.21.15.93:0/3903650549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23240cf160 0x7f2324155160 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 >> 172.21.15.93:0/3903650549 conn(0x7f232406ea20 msgr2=0x7f23240b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.235 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 shutdown_connections 2023-11-04T01:40:25.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.223+0000 7f232b664640 1 -- 172.21.15.93:0/3903650549 wait complete. 2023-11-04T01:40:25.237 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:40:25.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.334+0000 7fa6b7b7c640 1 Processor -- start 2023-11-04T01:40:25.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 -- start start 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa6b00cd6d0 0x7fa6b0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa6b00b4880 0x7fa6b00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00cde60 con 0x7fa6b0153e60 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b0160f90 con 0x7fa6b00b4880 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.335+0000 7fa6b7b7c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b0161960 con 0x7fa6b00cd6d0 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b6119640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa6b00b4880 0x7fa6b00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b5918640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa6b0153e60 0x7fa6b015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59776/0 (socket says 172.21.15.93:59776) 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b5918640 1 -- 172.21.15.93:0/3581142248 learned_addr learned my addr 172.21.15.93:0/3581142248 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b5117640 1 --2- 172.21.15.93:0/3581142248 >> v2:172.21.15.125:3300/0 conn(0x7fa6b00cd6d0 0x7fa6b0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b6119640 1 -- 172.21.15.93:0/3581142248 >> v2:172.21.15.125:3300/0 conn(0x7fa6b00cd6d0 msgr2=0x7fa6b0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.339 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b6119640 1 --2- 172.21.15.93:0/3581142248 >> v2:172.21.15.125:3300/0 conn(0x7fa6b00cd6d0 0x7fa6b0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b6119640 1 -- 172.21.15.93:0/3581142248 >> v1:172.21.15.93:6789/0 conn(0x7fa6b0153e60 legacy=0x7fa6b015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b6119640 1 -- 172.21.15.93:0/3581142248 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b00b5220 con 0x7fa6b00b4880 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.336+0000 7fa6b4916640 1 -- 172.21.15.93:0/3581142248 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754991407 0 0) 0x7fa6b00cde60 con 0x7fa6b0153e60 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b6119640 1 --2- 172.21.15.93:0/3581142248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00b4ce0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9e80 tx=0x7fa6a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d4eef159d40700 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b4916640 1 -- 172.21.15.93:0/3581142248 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a802cc80 con 0x7fa6b00b4880 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b4916640 1 -- 172.21.15.93:0/3581142248 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a802cde0 con 0x7fa6b00b4880 2023-11-04T01:40:25.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b4916640 1 -- 172.21.15.93:0/3581142248 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8034660 con 0x7fa6b00b4880 2023-11-04T01:40:25.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/3581142248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 msgr2=0x7fa6b00b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/3581142248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00b4ce0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9e80 tx=0x7fa6a802bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/3581142248 shutdown_connections 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/3581142248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00b4ce0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/3581142248 >> v2:172.21.15.125:3300/0 conn(0x7fa6b00cd6d0 0x7fa6b0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/3581142248 >> 172.21.15.93:0/3581142248 conn(0x7fa6b00cf880 msgr2=0x7fa6b00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/3581142248 shutdown_connections 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.337+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/3581142248 wait complete. 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.338+0000 7fa6b7b7c640 1 Processor -- start 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.338+0000 7fa6b7b7c640 1 -- start start 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6b00cd6d0 0x7fa6b00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 0x7fa6b0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c9340 con 0x7fa6b00b4880 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00ca2f0 con 0x7fa6b00cd6d0 2023-11-04T01:40:25.344 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b7b7c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c8db0 con 0x7fa6b0153e60 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b5918640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b5918640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47710/0 (socket says 172.21.15.93:47710) 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b5918640 1 -- 172.21.15.93:0/548589362 learned_addr learned my addr 172.21.15.93:0/548589362 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b6119640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 0x7fa6b0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.339+0000 7fa6b5117640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6b00cd6d0 0x7fa6b00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.345 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 -- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 msgr2=0x7fa6b0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 0x7fa6b0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 -- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6b00cd6d0 msgr2=0x7fa6b00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6b00cd6d0 0x7fa6b00cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 -- 172.21.15.93:0/548589362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009a70 con 0x7fa6b00b4880 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b6119640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 0x7fa6b0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b5918640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c430 tx=0x7fa6a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6a67fc640 1 -- 172.21.15.93:0/548589362 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00074e0 con 0x7fa6b00b4880 2023-11-04T01:40:25.346 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6a67fc640 1 -- 172.21.15.93:0/548589362 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0007660 con 0x7fa6b00b4880 2023-11-04T01:40:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6a67fc640 1 -- 172.21.15.93:0/548589362 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004a20 con 0x7fa6b00b4880 2023-11-04T01:40:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b00c9060 con 0x7fa6b00b4880 2023-11-04T01:40:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.340+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00ca870 con 0x7fa6b00b4880 2023-11-04T01:40:25.347 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.341+0000 7fa6a67fc640 1 -- 172.21.15.93:0/548589362 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6a0004b80 con 0x7fa6b00b4880 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.342+0000 7fa6a67fc640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 0x7fa69406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.342+0000 7fa6a67fc640 1 -- 172.21.15.93:0/548589362 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa6a0089a10 con 0x7fa6b00b4880 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.342+0000 7fa6b5117640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 0x7fa69406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.342+0000 7fa6b5117640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 0x7fa69406d330 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0155450 tx=0x7fa6ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.343+0000 7fa6ba7eb740 1 Processor -- start 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.343+0000 7fa6ba7eb740 1 -- start start 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d421538750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421538c90 0x55d421568b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d421449740 con 0x55d421565c30 2023-11-04T01:40:25.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4214ab8d0 con 0x55d421565850 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4214a8fc0 con 0x55d421538c90 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47724/0 (socket says 172.21.15.93:47724) 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 -- 172.21.15.93:0/2915895570 learned_addr learned my addr 172.21.15.93:0/2915895570 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5918640 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d421538750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b6119640 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421538c90 0x55d421568b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 -- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421538c90 msgr2=0x55d421568b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421538c90 0x55d421568b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 -- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 msgr2=0x55d421538750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d421538750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 -- 172.21.15.93:0/2915895570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d421467ca0 con 0x55d421565c30 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6b5117640 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e920 tx=0x7fa6ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a4c914f4892d1b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6937fe640 1 -- 172.21.15.93:0/2915895570 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0157c0 con 0x55d421565c30 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6937fe640 1 -- 172.21.15.93:0/2915895570 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac015920 con 0x55d421565c30 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.344+0000 7fa6937fe640 1 -- 172.21.15.93:0/2915895570 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac015c90 con 0x55d421565c30 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/2915895570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 msgr2=0x55d4215685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e920 tx=0x7fa6ac011000 comp rx=0 tx=0).stop 2023-11-04T01:40:25.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/2915895570 shutdown_connections 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421538c90 0x55d421568b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565c30 0x55d4215685e0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/2915895570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d421538750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/2915895570 >> 172.21.15.93:0/2915895570 conn(0x55d42153aa60 msgr2=0x55d4215835e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/2915895570 shutdown_connections 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.345+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/2915895570 wait complete. 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 -- start start 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 Processor -- start 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d42156c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d42157b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4214a48b0 con 0x55d421559d00 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d42145ec80 con 0x55d421565850 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.346+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d42145e920 con 0x55d421565c30 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6ba7eb740 10 client.0 _ll_register_callbacks cb 0x55d4211b6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47728/0 (socket says 172.21.15.93:47728) 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 -- 172.21.15.93:0/837742170 learned_addr learned my addr 172.21.15.93:0/837742170 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b5117640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d42157b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 -- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 msgr2=0x55d42157b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d42157b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 -- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 msgr2=0x55d42156c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.358 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d42156c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 -- 172.21.15.93:0/837742170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac009de0 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6b6119640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009e80 tx=0x7fa6a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c651963516ad96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8034d70 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa6a803f450 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d421450bf0 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6a803f650 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6ba7eb740 10 client.7863 fetch_fsmap learned FSMap version 64 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.347+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55d4214a2f30 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d421450bf0 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa6a803f7b0 con 0x55d421559d00 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 10 client.7863 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:40:25.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 10 client.7863 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 20 client.7863 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d42156ac10 0x55d4215a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 4 client.7863 mds_command: new command op to 7689 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 --> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d42149d890 con 0x55d42156ac10 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6b5918640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d42156ac10 0x55d4215a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa6b5918640 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d42156ac10 0x55d4215a0a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4612d115e29c1c6 server_cookie=4ea919fcc52f0fc5 in_seq=0 out_seq=0 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.348+0000 7fa690ff9640 10 client.7863 ms_handle_connect on v2:172.21.15.93:6834/448915336 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa690ff9640 1 -- 172.21.15.93:0/837742170 <== mds.0 v2:172.21.15.93:6834/448915336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d42149d890 con 0x55d42156ac10 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa690ff9640 10 client.7863 handle_command_reply: tid=0 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 client.7863 shutdown 2023-11-04T01:40:25.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 msgr2=0x55d42157bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009e80 tx=0x7fa6a8004ab0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 shutdown_connections 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d42156ac10 0x55d4215a0a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421559d00 0x55d42157bc20 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d42157b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa690ff9640 0 client.7863 ms_handle_reset on v2:172.21.15.93:6834/448915336 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/837742170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d42156c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.361 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 >> 172.21.15.93:0/837742170 conn(0x55d421538c90 msgr2=0x55d42153c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 shutdown_connections 2023-11-04T01:40:25.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/837742170 wait complete. 2023-11-04T01:40:25.362 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.349+0000 7fa6ba7eb740 20 client.7863 trim_cache size 0 max 16384 2023-11-04T01:40:25.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.364+0000 7fa6ba7eb740 1 Processor -- start 2023-11-04T01:40:25.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.364+0000 7fa6ba7eb740 1 -- start start 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d4215685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d421568b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d421424280 con 0x55d42157c6d0 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d42157e320 con 0x55d421565850 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d421539070 con 0x55d421565c30 2023-11-04T01:40:25.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47734/0 (socket says 172.21.15.93:47734) 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 -- 172.21.15.93:0/1649279590 learned_addr learned my addr 172.21.15.93:0/1649279590 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 -- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 msgr2=0x55d421568b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d421568b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 -- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 msgr2=0x55d4215685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d4215685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.365+0000 7fa6b6119640 1 -- 172.21.15.93:0/1649279590 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d421440d10 con 0x55d42157c6d0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6b6119640 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8002230 tx=0x7fa6a8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844573b8c64d300d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa693fff640 1 -- 172.21.15.93:0/1649279590 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8034a50 con 0x55d42157c6d0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa693fff640 1 -- 172.21.15.93:0/1649279590 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8034bd0 con 0x55d42157c6d0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa693fff640 1 -- 172.21.15.93:0/1649279590 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a803f450 con 0x55d42157c6d0 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/1649279590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 msgr2=0x55d421537550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8002230 tx=0x7fa6a8040000 comp rx=0 tx=0).stop 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/1649279590 shutdown_connections 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d42157c6d0 0x55d421537550 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d421568b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/1649279590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d421565850 0x55d4215685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/1649279590 >> 172.21.15.93:0/1649279590 conn(0x55d421538c90 msgr2=0x55d421533c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/1649279590 shutdown_connections 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.366+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/1649279590 wait complete. 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.367+0000 7fa6ba7eb740 1 -- start start 2023-11-04T01:40:25.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.367+0000 7fa6ba7eb740 1 Processor -- start 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d4215a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d4215d71f0 0x55d4215a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4215a1800 con 0x55d421565850 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d42156bef0 con 0x55d4215d71f0 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d421592860 con 0x55d421565c30 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 10 client.0 _ll_register_callbacks cb 0x7fa6ac009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47746/0 (socket says 172.21.15.93:47746) 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 -- 172.21.15.93:0/3131053436 learned_addr learned my addr 172.21.15.93:0/3131053436 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b6119640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d4215d71f0 0x55d4215a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5117640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d4215a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 -- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 msgr2=0x55d4215a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d4215a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 -- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d4215d71f0 msgr2=0x55d4215a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d4215d71f0 0x55d4215a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 -- 172.21.15.93:0/3131053436 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4214a2f30 con 0x55d421565850 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5117640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d4215a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6b5918640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00546a0 tx=0x7fa6a000c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f030890845d783 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00604a0 con 0x55d421565850 2023-11-04T01:40:25.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa6a00548b0 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.368+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6ac015920 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6a0054a70 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 10 client.7869 fetch_fsmap learned FSMap version 64 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55d421466500 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac015920 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa6a001b060 con 0x55d421565850 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 10 client.7869 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 10 client.7869 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 20 client.7869 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d421537990 0x55d42159b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 4 client.7869 mds_command: new command op to 7689 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 --> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d42149d5b0 con 0x55d421537990 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6b5117640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d421537990 0x55d42159b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 10 client.7869 ms_handle_connect on v2:172.21.15.93:6834/448915336 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6b5117640 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d421537990 0x55d42159b650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ef26686bcc53c0 server_cookie=b2b3a34d9483f6e in_seq=0 out_seq=0 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 1 -- 172.21.15.93:0/3131053436 <== mds.0 v2:172.21.15.93:6834/448915336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d42149d5b0 con 0x55d421537990 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa690ff9640 10 client.7869 handle_command_reply: tid=0 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 client.7869 shutdown 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 msgr2=0x55d42153e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00546a0 tx=0x7fa6a000c3b0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 shutdown_connections 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.369+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55d4215d71f0 0x55d4215a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55d421565c30 0x55d4215a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:6834/448915336,v1:172.21.15.93:6836/448915336] conn(0x55d421537990 0x55d42159b650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 --2- 172.21.15.93:0/3131053436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d421565850 0x55d42153e190 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa690ff9640 0 client.7869 ms_handle_reset on v2:172.21.15.93:6834/448915336 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 >> 172.21.15.93:0/3131053436 conn(0x55d421538c90 msgr2=0x55d4215690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 shutdown_connections 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 1 -- 172.21.15.93:0/3131053436 wait complete. 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6ba7eb740 20 client.7869 trim_cache size 0 max 16384 2023-11-04T01:40:25.379 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7689, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 6.6936344490000002, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 64, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 31.784597174000002 2023-11-04T01:40:25.380 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:25.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 msgr2=0x7fa69406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 0x7fa69406d330 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0155450 tx=0x7fa6ac008040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 msgr2=0x7fa6b00c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c430 tx=0x7fa6a000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 shutdown_connections 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa69406ae70 0x7fa69406d330 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa6b0153e60 0x7fa6b0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6b00cd6d0 0x7fa6b00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 --2- 172.21.15.93:0/548589362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6b00b4880 0x7fa6b00c8870 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 >> 172.21.15.93:0/548589362 conn(0x7fa6b00cf880 msgr2=0x7fa6b015b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 shutdown_connections 2023-11-04T01:40:25.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.370+0000 7fa6b7b7c640 1 -- 172.21.15.93:0/548589362 wait complete. 2023-11-04T01:40:25.384 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:25.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 Processor -- start 2023-11-04T01:40:25.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 -- start start 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d0015ce60 0x7f8d0006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d001615d0 con 0x7f8d0006bd30 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d001618b0 con 0x7f8d000cf160 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.481+0000 7f8d0647c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000cbde0 con 0x7f8d0015ce60 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d0006bd30 0x7f8d00160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59792/0 (socket says 172.21.15.93:59792) 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2890770148 learned_addr learned my addr 172.21.15.93:0/2890770148 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2890770148 >> v2:172.21.15.125:3300/0 conn(0x7f8d0015ce60 0x7f8d0006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796992436 0 0) 0x7f8d001615d0 con 0x7f8d0006bd30 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce8003520 con 0x7f8d0006bd30 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295453679 0 0) 0x7f8ce8003520 con 0x7f8d0006bd30 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 >> v2:172.21.15.125:3300/0 conn(0x7f8d0015ce60 msgr2=0x7f8d0006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 --2- 172.21.15.93:0/2890770148 >> v2:172.21.15.125:3300/0 conn(0x7f8d0015ce60 0x7f8d0006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 >> v1:172.21.15.125:6789/0 conn(0x7f8d000cf160 legacy=0x7f8d000cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000cba00 con 0x7f8d0006bd30 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f8cf4001670 con 0x7f8d0006bd30 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 >> v1:172.21.15.93:6789/0 conn(0x7f8d0006bd30 legacy=0x7f8d00160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ce8003970 0x7f8ce8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 0x7f8ce8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8005040 0x7f8ce800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000cbde0 con 0x7f8ce8004370 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800bfa0 con 0x7f8ce8003970 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800c160 con 0x7f8ce8005040 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 0x7f8ce8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ce8003970 0x7f8ce8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8d04a19640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8005040 0x7f8ce800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8005040 msgr2=0x7f8ce800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8005040 0x7f8ce800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ce8003970 msgr2=0x7f8ce8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ce8003970 0x7f8ce8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.482+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2890770148 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8003520 con 0x7f8ce8004370 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8d04a19640 1 -- 172.21.15.93:0/2890770148 reap_dead start 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ce8003970 0x7f8ce8003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 0x7f8ce8004840 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c210 tx=0x7f8ce80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33da8293ce24b7c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4005ad0 con 0x7f8ce8004370 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4005c50 con 0x7f8ce8004370 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.483+0000 7f8cfeffd640 1 -- 172.21.15.93:0/2890770148 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf402c8d0 con 0x7f8ce8004370 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 -- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 msgr2=0x7f8ce8004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 0x7f8ce8004840 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c210 tx=0x7f8ce80057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 -- 172.21.15.93:0/2890770148 shutdown_connections 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2890770148 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8ce8004370 0x7f8ce8004840 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 -- 172.21.15.93:0/2890770148 >> 172.21.15.93:0/2890770148 conn(0x7f8d0006ea90 msgr2=0x7f8d0006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 -- 172.21.15.93:0/2890770148 shutdown_connections 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.484+0000 7f8d0647c640 1 -- 172.21.15.93:0/2890770148 wait complete. 2023-11-04T01:40:25.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.485+0000 7f8d0647c640 1 Processor -- start 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.485+0000 7f8d0647c640 1 -- start start 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 0x7f8d000b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 0x7f8d001f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00158b20 con 0x7f8d001fa3a0 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b5120 con 0x7f8d001fa820 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d0647c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b6910 con 0x7f8ce8004370 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47776/0 (socket says 172.21.15.93:47776) 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2108053134 learned_addr learned my addr 172.21.15.93:0/2108053134 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 0x7f8d000b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d04a19640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 0x7f8d001f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 msgr2=0x7f8d000b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 0x7f8d000b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 msgr2=0x7f8d001f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 0x7f8d001f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 -- 172.21.15.93:0/2108053134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d001faef0 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 0x7f8d000b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8d04a19640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 0x7f8d001f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.486+0000 7f8cff7fe640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8cf402c470 tx=0x7f8cf402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.487+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf403c040 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.487+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf402cda0 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.487+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4007290 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.487+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d000b5330 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.487+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d000b58f0 con 0x7f8d001fa3a0 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.488+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d00074290 con 0x7f8d001fa3a0 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.488+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cf4032070 con 0x7f8d001fa3a0 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.488+0000 7f8cfcff9640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 0x7f8cec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.488+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f8cf40aaf90 con 0x7f8d001fa3a0 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.488+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 0x7f8cec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.489+0000 7f8cfffff640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 0x7f8cec06d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8d000687c0 tx=0x7f8cf0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.493+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cf40ddca0 con 0x7f8d001fa3a0 2023-11-04T01:40:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.695+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d0006b3e0 con 0x7f8d001fa3a0 2023-11-04T01:40:25.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.695+0000 7f8cfcff9640 1 -- 172.21.15.93:0/2108053134 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f8cf4075a60 con 0x7f8d001fa3a0 2023-11-04T01:40:25.698 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:25.698 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:21.694732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:25.698 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 64 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 msgr2=0x7f8cec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 0x7f8cec06d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8d000687c0 tx=0x7f8cf0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 msgr2=0x7f8d0015fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8cf402c470 tx=0x7f8cf402e070 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 shutdown_connections 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8cec06ae70 0x7f8cec06d330 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d001fa820 0x7f8d001f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d001fa3a0 0x7f8d0015fc80 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 --2- 172.21.15.93:0/2108053134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8ce8004370 0x7f8d000b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 >> 172.21.15.93:0/2108053134 conn(0x7f8d0006ea90 msgr2=0x7f8d000cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 shutdown_connections 2023-11-04T01:40:25.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.697+0000 7f8d0647c640 1 -- 172.21.15.93:0/2108053134 wait complete. 2023-11-04T01:40:25.711 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:40:25.822 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:36.445011+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:01.677855+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:25.822 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:36.445011+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:01.677855+0000" } ] } 2023-11-04T01:40:25.823 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:25.823 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:25.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.920+0000 7f587e47c640 1 Processor -- start 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.920+0000 7f587e47c640 1 -- start start 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587e47c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f58780b0ae0 0x7f58780ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587e47c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 0x7f587815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587e47c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58780b4110 con 0x7f5878159c70 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587e47c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780b49b0 con 0x7f58780b0ae0 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587e47c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780b43f0 con 0x7f587806db20 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f58780b0ae0 0x7f58780ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f58780b0ae0 0x7f58780ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47792/0 (socket says 172.21.15.93:47792) 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 -- 172.21.15.93:0/3620792229 learned_addr learned my addr 172.21.15.93:0/3620792229 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587ca19640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 0x7f587815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 -- 172.21.15.93:0/3620792229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 msgr2=0x7f587815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 0x7f587815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 -- 172.21.15.93:0/3620792229 >> v1:172.21.15.125:6789/0 conn(0x7f5878159c70 legacy=0x7f58780b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f58777fe640 1 -- 172.21.15.93:0/3620792229 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780b46d0 con 0x7f58780b0ae0 2023-11-04T01:40:25.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.921+0000 7f587ca19640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 0x7f587815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f58777fe640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780b0ae0 0x7f58780ce370 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f586c009870 tx=0x7f586c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa24a45b0eb5e606 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f5876ffd640 1 -- 172.21.15.93:0/3620792229 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c031640 con 0x7f58780b0ae0 2023-11-04T01:40:25.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f5876ffd640 1 -- 172.21.15.93:0/3620792229 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0317a0 con 0x7f58780b0ae0 2023-11-04T01:40:25.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f5876ffd640 1 -- 172.21.15.93:0/3620792229 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c031b30 con 0x7f58780b0ae0 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 -- 172.21.15.93:0/3620792229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780b0ae0 msgr2=0x7f58780ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780b0ae0 0x7f58780ce370 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f586c009870 tx=0x7f586c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 -- 172.21.15.93:0/3620792229 shutdown_connections 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f587806db20 0x7f587815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 --2- 172.21.15.93:0/3620792229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58780b0ae0 0x7f58780ce370 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 -- 172.21.15.93:0/3620792229 >> 172.21.15.93:0/3620792229 conn(0x7f58780ce950 msgr2=0x7f58780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 -- 172.21.15.93:0/3620792229 shutdown_connections 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.922+0000 7f587e47c640 1 -- 172.21.15.93:0/3620792229 wait complete. 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 Processor -- start 2023-11-04T01:40:25.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 -- start start 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58780b0ae0 0x7f5878157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 0x7f58781580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c6870 con 0x7f587806db20 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58781f3330 con 0x7f58780b0ae0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.924+0000 7f587e47c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58781f3050 con 0x7f5878159c70 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47802/0 (socket says 172.21.15.93:47802) 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 -- 172.21.15.93:0/2354225823 learned_addr learned my addr 172.21.15.93:0/2354225823 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f587ca19640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 0x7f58781580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f58777fe640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58780b0ae0 0x7f5878157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 -- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 msgr2=0x7f58781580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 0x7f58781580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 -- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58780b0ae0 msgr2=0x7f5878157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58780b0ae0 0x7f5878157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 -- 172.21.15.93:0/2354225823 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0094d0 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f587ca19640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 0x7f58781580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5877fff640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f586800b3f0 tx=0x7f586800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011830 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868011990 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011d40 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58781f5b00 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.925+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58781f60c0 con 0x7f587806db20 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.926+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58781f62b0 con 0x7f587806db20 2023-11-04T01:40:25.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.926+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f586801a400 con 0x7f587806db20 2023-11-04T01:40:25.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.927+0000 7f5874ff9640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 0x7f586406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.927+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f5868089db0 con 0x7f587806db20 2023-11-04T01:40:25.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.927+0000 7f58777fe640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 0x7f586406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.927+0000 7f58777fe640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 0x7f586406d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f586c036000 tx=0x7f586c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:25.931+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5868054880 con 0x7f587806db20 2023-11-04T01:40:26.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.129+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58780cdb40 con 0x7f587806db20 2023-11-04T01:40:26.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.130+0000 7f5874ff9640 1 -- 172.21.15.93:0/2354225823 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f5868015090 con 0x7f587806db20 2023-11-04T01:40:26.133 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:26.133 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:21.694732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:26.133 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 64 2023-11-04T01:40:26.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 msgr2=0x7f586406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 0x7f586406d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f586c036000 tx=0x7f586c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 msgr2=0x7f5878150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f586800b3f0 tx=0x7f586800b8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 shutdown_connections 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f586406ae70 0x7f586406d330 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5878159c70 0x7f58781580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58780b0ae0 0x7f5878157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 --2- 172.21.15.93:0/2354225823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f587806db20 0x7f5878150e10 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 >> 172.21.15.93:0/2354225823 conn(0x7f58780ce950 msgr2=0x7f587815cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 shutdown_connections 2023-11-04T01:40:26.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.132+0000 7f587e47c640 1 -- 172.21.15.93:0/2354225823 wait complete. 2023-11-04T01:40:26.145 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:26.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.243+0000 7f3d270af640 1 Processor -- start 2023-11-04T01:40:26.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.243+0000 7f3d270af640 1 -- start start 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d270af640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3d200cd6d0 0x7f3d20161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d270af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d200b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d270af640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d200cde60 con 0x7f3d20153e60 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d270af640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d20160f90 con 0x7f3d200cd6d0 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d270af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20161960 con 0x7f3d200b4880 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d24e4b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3d20153e60 0x7f3d2015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59796/0 (socket says 172.21.15.93:59796) 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d24e4b640 1 -- 172.21.15.93:0/1390097246 learned_addr learned my addr 172.21.15.93:0/1390097246 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/1390097246 >> v2:172.21.15.125:3300/0 conn(0x7f3d200cd6d0 0x7f3d20161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d2564c640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d200b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015862767 0 0) 0x7f3d200cde60 con 0x7f3d20153e60 2023-11-04T01:40:26.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d10003520 con 0x7f3d20153e60 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335626889 0 0) 0x7f3d10003520 con 0x7f3d20153e60 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 msgr2=0x7f3d200b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d200b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 >> v2:172.21.15.125:3300/0 conn(0x7f3d200cd6d0 msgr2=0x7f3d20161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 --2- 172.21.15.93:0/1390097246 >> v2:172.21.15.125:3300/0 conn(0x7f3d200cd6d0 0x7f3d20161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200b5220 con 0x7f3d20153e60 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3d14001670 con 0x7f3d20153e60 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 >> v1:172.21.15.93:6789/0 conn(0x7f3d20153e60 legacy=0x7f3d2015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d10003970 0x7f3d10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d100047c0 0x7f3d10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20160f90 con 0x7f3d100047c0 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20161960 con 0x7f3d10003970 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1000b980 con 0x7f3d200b4880 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.244+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d100047c0 0x7f3d10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d24e4b640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d10003970 0x7f3d10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d2564c640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 -- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 msgr2=0x7f3d10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200b4880 0x7f3d10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 -- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d10003970 msgr2=0x7f3d10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d10003970 0x7f3d10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 -- 172.21.15.93:0/1390097246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10003520 con 0x7f3d100047c0 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.245+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d100047c0 0x7f3d10004c40 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009ac0 tx=0x7f3d100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882c7e04215ad061 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c02c710 con 0x7f3d100047c0 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c02c870 con 0x7f3d100047c0 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d1f7fe640 1 -- 172.21.15.93:0/1390097246 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c02cc00 con 0x7f3d100047c0 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 -- 172.21.15.93:0/1390097246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d100047c0 msgr2=0x7f3d10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 --2- 172.21.15.93:0/1390097246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d100047c0 0x7f3d10004c40 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009ac0 tx=0x7f3d100057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d2564c640 1 -- 172.21.15.93:0/1390097246 reap_dead start 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 -- 172.21.15.93:0/1390097246 shutdown_connections 2023-11-04T01:40:26.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 -- 172.21.15.93:0/1390097246 >> 172.21.15.93:0/1390097246 conn(0x7f3d200cf880 msgr2=0x7f3d200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:26.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 -- 172.21.15.93:0/1390097246 shutdown_connections 2023-11-04T01:40:26.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.246+0000 7f3d270af640 1 -- 172.21.15.93:0/1390097246 wait complete. 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.247+0000 7f3d270af640 1 Processor -- start 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.247+0000 7f3d270af640 1 -- start start 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d100047c0 0x7f3d200c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200cb740 0x7f3d20155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200cae50 con 0x7f3d200cb2e0 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200ca240 con 0x7f3d100047c0 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d270af640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200ca520 con 0x7f3d200cb740 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d1ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47822/0 (socket says 172.21.15.93:47822) 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d1ffff640 1 -- 172.21.15.93:0/4059184647 learned_addr learned my addr 172.21.15.93:0/4059184647 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d24e4b640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d100047c0 0x7f3d200c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.248+0000 7f3d2564c640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200cb740 0x7f3d20155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 -- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200cb740 msgr2=0x7f3d20155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200cb740 0x7f3d20155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 -- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d100047c0 msgr2=0x7f3d200c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d100047c0 0x7f3d200c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 -- 172.21.15.93:0/4059184647 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200ca800 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1ffff640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c02c2b0 tx=0x7f3d0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c003810 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c02de90 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d200caae0 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c003b70 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.249+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d20155220 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.250+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d200cb000 con 0x7f3d200cb2e0 2023-11-04T01:40:26.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.250+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d0c003cd0 con 0x7f3d200cb2e0 2023-11-04T01:40:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.251+0000 7f3d1d7fa640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 0x7f3d0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.251+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f3d0c0abba0 con 0x7f3d200cb2e0 2023-11-04T01:40:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.251+0000 7f3d24e4b640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 0x7f3d0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.251+0000 7f3d24e4b640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 0x7f3d0406d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001eb0 tx=0x7f3d140078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.255+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d0c076720 con 0x7f3d200cb2e0 2023-11-04T01:40:26.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.491+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f3d20074290 con 0x7f3d200cb2e0 2023-11-04T01:40:26.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.713+0000 7f3d1d7fa640 1 -- 172.21.15.93:0/4059184647 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7689 v65) v1 ==== 112+0+0 (secure 0 0 0) 0x7f3d0c079d40 con 0x7f3d200cb2e0 2023-11-04T01:40:26.715 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.7689 2023-11-04T01:40:26.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 msgr2=0x7f3d0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 0x7f3d0406d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001eb0 tx=0x7f3d140078f0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 msgr2=0x7f3d20154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c02c2b0 tx=0x7f3d0c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 shutdown_connections 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d0406ae70 0x7f3d0406d330 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3d200cb740 0x7f3d20155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200cb2e0 0x7f3d20154ce0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 --2- 172.21.15.93:0/4059184647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d100047c0 0x7f3d200c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 >> 172.21.15.93:0/4059184647 conn(0x7f3d200cf880 msgr2=0x7f3d200d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 shutdown_connections 2023-11-04T01:40:26.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:26.715+0000 7f3d270af640 1 -- 172.21.15.93:0/4059184647 wait complete. 2023-11-04T01:40:26.728 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:40:26.839 INFO:teuthology.orchestra.run.smithi093.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:40:26.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:40:26.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:26.840 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:40:26.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:26.863 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1dd8481640 time 2023-11-04T01:40:26.862372+0000 2023-11-04T01:40:26.863 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1dddf6efaf] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.864 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:40:26.861+0000 7f1dd8481640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1dd8481640 time 2023-11-04T01:40:26.862372+0000 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1dddf6efaf] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.865 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:26.866 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1dd8481640 thread_name:ms_dispatch 2023-11-04T01:40:26.867 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.867 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ddd654db0] 2023-11-04T01:40:26.867 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ddd6a154c] 2023-11-04T01:40:26.867 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1dddf6f009] 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.868 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:40:26.862+0000 7f1dd8481640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1dd8481640 thread_name:ms_dispatch 2023-11-04T01:40:26.869 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ddd654db0] 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ddd6a154c] 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:40:26.870 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1dddf6f009] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.871 INFO:tasks.ceph.mds.c.smithi093.stderr: -183> 2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: -181> 2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: -1> 2023-11-04T01:40:26.861+0000 7f1dd8481640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1dd8481640 time 2023-11-04T01:40:26.862372+0000 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1dddf6efaf] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.872 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 0> 2023-11-04T01:40:26.862+0000 7f1dd8481640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1dd8481640 thread_name:ms_dispatch 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ddd654db0] 2023-11-04T01:40:26.873 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ddd6a154c] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1dddf6f009] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.874 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: -183> 2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: -181> 2023-11-04T01:40:24.502+0000 7f1dd5c7c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: -1> 2023-11-04T01:40:26.861+0000 7f1dd8481640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1dd8481640 time 2023-11-04T01:40:26.862372+0000 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:40:26.875 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1dddf6efaf] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.876 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 0> 2023-11-04T01:40:26.862+0000 7f1dd8481640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1dd8481640 thread_name:ms_dispatch 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ddd654db0] 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ddd6a154c] 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1dddf6f009] 2023-11-04T01:40:26.877 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1dddf6f16d] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x563521f77187] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x563521d060a9] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x563521d08b2b] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563521d0901c] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563521cf2325] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1dde15ff9a] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1dde1f1741] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f1ddd69f802] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f1ddd63f450] 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:26.878 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:40:26.968 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:26.968 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:26.969 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:27.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.105+0000 7ff33ca4b640 1 Processor -- start 2023-11-04T01:40:27.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.105+0000 7ff33ca4b640 1 -- start start 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33ca4b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3380ce240 0x7ff338157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33ca4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 0x7ff3380d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33ca4b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33815e000 con 0x7ff3380cde60 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33ca4b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33815e5c0 con 0x7ff3380ce240 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33ca4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33815e2e0 con 0x7ff338157540 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff335d9b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3380ce240 0x7ff338157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff336d9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 0x7ff3380d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33659c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3380cde60 0x7ff33815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:43042/0 (socket says 172.21.15.93:43042) 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.106+0000 7ff33659c640 1 -- 172.21.15.93:0/210821248 learned_addr learned my addr 172.21.15.93:0/210821248 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff33559a640 1 -- 172.21.15.93:0/210821248 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365935127 0 0) 0x7ff33815e000 con 0x7ff3380cde60 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff33559a640 1 -- 172.21.15.93:0/210821248 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003520 con 0x7ff3380cde60 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff336d9d640 1 -- 172.21.15.93:0/210821248 >> v2:172.21.15.125:3300/0 conn(0x7ff3380ce240 msgr2=0x7ff338157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff336d9d640 1 --2- 172.21.15.93:0/210821248 >> v2:172.21.15.125:3300/0 conn(0x7ff3380ce240 0x7ff338157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff336d9d640 1 -- 172.21.15.93:0/210821248 >> v1:172.21.15.125:6789/0 conn(0x7ff3380cde60 legacy=0x7ff33815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.107+0000 7ff336d9d640 1 -- 172.21.15.93:0/210821248 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380d1120 con 0x7ff338157540 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff336d9d640 1 --2- 172.21.15.93:0/210821248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 0x7ff3380d1920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3300097a0 tx=0x7ff33002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488b0f7c2121458 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33559a640 1 -- 172.21.15.93:0/210821248 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330031830 con 0x7ff338157540 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33559a640 1 -- 172.21.15.93:0/210821248 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330031990 con 0x7ff338157540 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33559a640 1 -- 172.21.15.93:0/210821248 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330031d00 con 0x7ff338157540 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 -- 172.21.15.93:0/210821248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 msgr2=0x7ff3380d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/210821248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 0x7ff3380d1920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3300097a0 tx=0x7ff33002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 -- 172.21.15.93:0/210821248 shutdown_connections 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/210821248 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff338157540 0x7ff3380d1920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/210821248 >> v2:172.21.15.125:3300/0 conn(0x7ff3380ce240 0x7ff338157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.108+0000 7ff33ca4b640 1 -- 172.21.15.93:0/210821248 >> 172.21.15.93:0/210821248 conn(0x7ff338071f30 msgr2=0x7ff3380cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.109+0000 7ff33ca4b640 1 -- 172.21.15.93:0/210821248 shutdown_connections 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.109+0000 7ff33ca4b640 1 -- 172.21.15.93:0/210821248 wait complete. 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.110+0000 7ff33ca4b640 1 Processor -- start 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.110+0000 7ff33ca4b640 1 -- start start 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.110+0000 7ff33ca4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 0x7ff3381f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 0x7ff3380b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381f67f0 con 0x7ff3380ce240 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381e6dc0 con 0x7ff338157540 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381e5ed0 con 0x7ff3380cde60 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:47824/0 (socket says 172.21.15.93:47824) 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 -- 172.21.15.93:0/1196306086 learned_addr learned my addr 172.21.15.93:0/1196306086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff336d9d640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 0x7ff3380b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33659c640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 0x7ff3381f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 -- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 msgr2=0x7ff3381f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 0x7ff3381f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 -- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 msgr2=0x7ff3380b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 0x7ff3380b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 -- 172.21.15.93:0/1196306086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009400 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff336d9d640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 0x7ff3380b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33659c640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 0x7ff3381f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff335d9b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9b0 tx=0x7ff32c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c009670 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00c9a0 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3381e61b0 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00cd50 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.111+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3381e6770 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.112+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338074290 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.113+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff32c013470 con 0x7ff3380ce240 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.113+0000 7ff326ffd640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.113+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7ff32c089f30 con 0x7ff3380ce240 2023-11-04T01:40:27.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.113+0000 7ff33659c640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.114+0000 7ff33659c640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff328005c00 tx=0x7ff328009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.117+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff32c054970 con 0x7ff3380ce240 2023-11-04T01:40:27.210 INFO:tasks.ceph.mds.c.smithi093.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:27.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.320+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3380b8860 con 0x7ff3380ce240 2023-11-04T01:40:27.326 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.321+0000 7ff326ffd640 1 -- 172.21.15.93:0/1196306086 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4934 (secure 0 0 0) 0x7ff32c017090 con 0x7ff3380ce240 2023-11-04T01:40:27.326 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:27.326 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:26.493433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:27.327 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 65 2023-11-04T01:40:27.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 msgr2=0x7ff31806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff328005c00 tx=0x7ff328009040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 msgr2=0x7ff3380cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9b0 tx=0x7ff32c00ee70 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 shutdown_connections 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338157540 0x7ff3380b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3380ce240 0x7ff3380cb860 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 --2- 172.21.15.93:0/1196306086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3380cde60 0x7ff3381f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 >> 172.21.15.93:0/1196306086 conn(0x7ff338071f30 msgr2=0x7ff338156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 shutdown_connections 2023-11-04T01:40:27.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:27.323+0000 7ff33ca4b640 1 -- 172.21.15.93:0/1196306086 wait complete. 2023-11-04T01:40:27.336 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:32.336 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.445+0000 7f0e52161640 1 Processor -- start 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.445+0000 7f0e52161640 1 -- start start 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e4c0cde60 0x7f0e4c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c15daa0 0x7f0e4c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0e4c0ce240 0x7f0e4c157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c15e5c0 con 0x7f0e4c0cde60 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c157a80 con 0x7f0e4c0ce240 2023-11-04T01:40:32.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e52161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15e000 con 0x7f0e4c15daa0 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e4b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e4c0cde60 0x7f0e4c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.446+0000 7f0e4b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0e4c0cde60 0x7f0e4c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34132/0 (socket says 172.21.15.93:34132) 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 -- 172.21.15.93:0/1730142507 learned_addr learned my addr 172.21.15.93:0/1730142507 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e42ffd640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c15daa0 0x7f0e4c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4bfff640 1 --2- 172.21.15.93:0/1730142507 >> v2:172.21.15.125:3300/0 conn(0x7f0e4c0ce240 0x7f0e4c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 -- 172.21.15.93:0/1730142507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c15daa0 msgr2=0x7f0e4c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c15daa0 0x7f0e4c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 -- 172.21.15.93:0/1730142507 >> v2:172.21.15.125:3300/0 conn(0x7f0e4c0ce240 msgr2=0x7f0e4c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/1730142507 >> v2:172.21.15.125:3300/0 conn(0x7f0e4c0ce240 0x7f0e4c157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 -- 172.21.15.93:0/1730142507 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c15e2e0 con 0x7f0e4c0cde60 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.447+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0cde60 0x7f0e4c15d560 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c15df30 tx=0x7f0e3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e233001197dba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e4affd640 1 -- 172.21.15.93:0/1730142507 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c031870 con 0x7f0e4c0cde60 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e4affd640 1 -- 172.21.15.93:0/1730142507 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0319d0 con 0x7f0e4c0cde60 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e4affd640 1 -- 172.21.15.93:0/1730142507 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c031d60 con 0x7f0e4c0cde60 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 -- 172.21.15.93:0/1730142507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0cde60 msgr2=0x7f0e4c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0cde60 0x7f0e4c15d560 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c15df30 tx=0x7f0e3c02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 -- 172.21.15.93:0/1730142507 shutdown_connections 2023-11-04T01:40:32.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 --2- 172.21.15.93:0/1730142507 >> v2:172.21.15.125:3300/0 conn(0x7f0e4c0ce240 0x7f0e4c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c15daa0 0x7f0e4c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 --2- 172.21.15.93:0/1730142507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0cde60 0x7f0e4c15d560 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 -- 172.21.15.93:0/1730142507 >> 172.21.15.93:0/1730142507 conn(0x7f0e4c071f30 msgr2=0x7f0e4c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 -- 172.21.15.93:0/1730142507 shutdown_connections 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.448+0000 7f0e52161640 1 -- 172.21.15.93:0/1730142507 wait complete. 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.449+0000 7f0e52161640 1 Processor -- start 2023-11-04T01:40:32.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 -- start start 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c0cde60 0x7f0e4c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 0x7f0e4c1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15ba70 con 0x7f0e4c0ce240 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15b1d0 con 0x7f0e4c15daa0 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e52161640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c15b4b0 con 0x7f0e4c0cde60 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.450+0000 7f0e42ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34144/0 (socket says 172.21.15.93:34144) 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 -- 172.21.15.93:0/3689849738 learned_addr learned my addr 172.21.15.93:0/3689849738 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c0cde60 0x7f0e4c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e4bfff640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 0x7f0e4c1f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 -- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c0cde60 msgr2=0x7f0e4c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c0cde60 0x7f0e4c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 -- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 msgr2=0x7f0e4c1f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 0x7f0e4c1f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 -- 172.21.15.93:0/3689849738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0094d0 con 0x7f0e4c0ce240 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e4bfff640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 0x7f0e4c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e42ffd640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d5f0 tx=0x7f0e3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340125f0 con 0x7f0e4c0ce240 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34012750 con 0x7f0e4c0ce240 2023-11-04T01:40:32.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c15b790 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012b00 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.451+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c15aec0 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.452+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c074290 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.453+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e34012c60 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.453+0000 7f0e48ff9640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 0x7f0e2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.453+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f0e3408a0d0 con 0x7f0e4c0ce240 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.453+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 0x7f0e2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.453+0000 7f0e4b7fe640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 0x7f0e2c06d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c036000 tx=0x7f0e3c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.457+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e34054b10 con 0x7f0e4c0ce240 2023-11-04T01:40:32.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.664+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e4c0d2990 con 0x7f0e4c0ce240 2023-11-04T01:40:32.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.665+0000 7f0e48ff9640 1 -- 172.21.15.93:0/3689849738 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f0e34058130 con 0x7f0e4c0ce240 2023-11-04T01:40:32.667 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:32.667 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:26.493433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:32.667 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 65 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.666+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 msgr2=0x7f0e2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.666+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 0x7f0e2c06d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c036000 tx=0x7f0e3c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.666+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 msgr2=0x7f0e4c0cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.666+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400d5f0 tx=0x7f0e3400dab0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 shutdown_connections 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0e2c06ae70 0x7f0e2c06d330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4c15daa0 0x7f0e4c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e4c0ce240 0x7f0e4c0cccb0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 --2- 172.21.15.93:0/3689849738 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0e4c0cde60 0x7f0e4c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 >> 172.21.15.93:0/3689849738 conn(0x7f0e4c071f30 msgr2=0x7f0e4c156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 shutdown_connections 2023-11-04T01:40:32.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:32.667+0000 7f0e52161640 1 -- 172.21.15.93:0/3689849738 wait complete. 2023-11-04T01:40:32.679 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:33.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:40:37.680 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:37.790 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.788+0000 7ff33b4e5640 1 Processor -- start 2023-11-04T01:40:37.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.788+0000 7ff33b4e5640 1 -- start start 2023-11-04T01:40:37.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff33b4e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff33b4e5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3340c9c40 0x7ff3340b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff33b4e5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3340ca090 con 0x7ff33415ad80 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff33b4e5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33406cfa0 con 0x7ff3340c9c40 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff33b4e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33406d280 con 0x7ff3340b42c0 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff339a82640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3340c9c40 0x7ff3340b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff338a80640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff339281640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff33415ad80 0x7ff33406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:47022/0 (socket says 172.21.15.93:47022) 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff338a80640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:60262/0 (socket says 172.21.15.93:60262) 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff339a82640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3340c9c40 0x7ff3340b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:52902/0 (socket says 172.21.15.93:52902) 2023-11-04T01:40:37.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.789+0000 7ff339281640 1 -- 172.21.15.93:0/3932325853 learned_addr learned my addr 172.21.15.93:0/3932325853 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff32bfff640 1 -- 172.21.15.93:0/3932325853 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845500843 0 0) 0x7ff330001490 con 0x7ff33415ad80 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff32bfff640 1 -- 172.21.15.93:0/3932325853 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003520 con 0x7ff33415ad80 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff339a82640 1 -- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 msgr2=0x7ff3340c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff339a82640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff339a82640 1 -- 172.21.15.93:0/3932325853 >> v1:172.21.15.125:6789/0 conn(0x7ff33415ad80 legacy=0x7ff33406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff339a82640 1 -- 172.21.15.93:0/3932325853 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33406d560 con 0x7ff3340c9c40 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.790+0000 7ff338a80640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff339a82640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3340b1a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5eb4d9d3ec2462 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff32bfff640 1 -- 172.21.15.93:0/3932325853 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c030610 con 0x7ff3340c9c40 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff32bfff640 1 -- 172.21.15.93:0/3932325853 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c030770 con 0x7ff3340c9c40 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff32bfff640 1 -- 172.21.15.93:0/3932325853 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c030b00 con 0x7ff3340c9c40 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 -- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 msgr2=0x7ff3340b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3340b1a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02b960 comp rx=0 tx=0).stop 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 -- 172.21.15.93:0/3932325853 shutdown_connections 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3340b1a40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/3932325853 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3340b42c0 0x7ff3340c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.791+0000 7ff33b4e5640 1 -- 172.21.15.93:0/3932325853 >> 172.21.15.93:0/3932325853 conn(0x7ff3340ce950 msgr2=0x7ff3340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.792+0000 7ff33b4e5640 1 -- 172.21.15.93:0/3932325853 shutdown_connections 2023-11-04T01:40:37.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.792+0000 7ff33b4e5640 1 -- 172.21.15.93:0/3932325853 wait complete. 2023-11-04T01:40:37.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 Processor -- start 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 -- start start 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3341519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 0x7ff334156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340c5ac0 con 0x7ff3340b42c0 2023-11-04T01:40:37.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f48b0 con 0x7ff3340c9c40 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.793+0000 7ff33b4e5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f4b90 con 0x7ff33415ad80 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:34154/0 (socket says 172.21.15.93:34154) 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 -- 172.21.15.93:0/2334489297 learned_addr learned my addr 172.21.15.93:0/2334489297 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff338a80640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3341519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339a82640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 0x7ff334156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 -- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 msgr2=0x7ff334156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 0x7ff334156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 -- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 msgr2=0x7ff3341519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3341519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 -- 172.21.15.93:0/2334489297 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009400 con 0x7ff3340b42c0 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339a82640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 0x7ff334156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff339281640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ff33000cb40 tx=0x7ff33000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000aca0 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000ae20 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330012640 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.794+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c009400 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.795+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334153a80 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.795+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff334074290 con 0x7ff3340b42c0 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.796+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff330007070 con 0x7ff3340b42c0 2023-11-04T01:40:37.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.796+0000 7ff329ffb640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.796+0000 7ff338a80640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.796+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7ff330089ac0 con 0x7ff3340b42c0 2023-11-04T01:40:37.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.797+0000 7ff338a80640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff3341557c0 tx=0x7ff324008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:37.801+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff330054590 con 0x7ff3340b42c0 2023-11-04T01:40:38.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.000+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3340ca090 con 0x7ff3340b42c0 2023-11-04T01:40:38.002 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.000+0000 7ff329ffb640 1 -- 172.21.15.93:0/2334489297 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4934 (secure 0 0 0) 0x7ff3340ca090 con 0x7ff3340b42c0 2023-11-04T01:40:38.003 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:38.003 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:26.493433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:38.003 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 65 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 msgr2=0x7ff31806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff3341557c0 tx=0x7ff324008040 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 msgr2=0x7ff3340c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ff33000cb40 tx=0x7ff33000a060 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 shutdown_connections 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff31806ae70 0x7ff31806d330 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff33415ad80 0x7ff334156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3340c9c40 0x7ff3341519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 --2- 172.21.15.93:0/2334489297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3340b42c0 0x7ff3340c79b0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.005 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 >> 172.21.15.93:0/2334489297 conn(0x7ff3340ce950 msgr2=0x7ff3340b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 shutdown_connections 2023-11-04T01:40:38.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:38.002+0000 7ff33b4e5640 1 -- 172.21.15.93:0/2334489297 wait complete. 2023-11-04T01:40:38.015 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:39.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:40:43.016 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:43.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.124+0000 7f4631965640 1 Processor -- start 2023-11-04T01:40:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.124+0000 7f4631965640 1 -- start start 2023-11-04T01:40:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4631965640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4631965640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f462c15daa0 0x7f462c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4631965640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c15e000 con 0x7f462c0ce240 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4631965640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c15e5c0 con 0x7f462c15daa0 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4631965640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c15e2e0 con 0x7f462c0cde60 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462a7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f462c15daa0 0x7f462c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f462c0ce240 0x7f462c06b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39748/0 (socket says 172.21.15.93:39748) 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462b7fe640 1 -- 172.21.15.93:0/3075618348 learned_addr learned my addr 172.21.15.93:0/3075618348 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462affd640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462a7fc640 1 -- 172.21.15.93:0/3075618348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 msgr2=0x7f462c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462a7fc640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462a7fc640 1 -- 172.21.15.93:0/3075618348 >> v1:172.21.15.93:6789/0 conn(0x7f462c0ce240 legacy=0x7f462c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f462a7fc640 1 -- 172.21.15.93:0/3075618348 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0d1120 con 0x7f462c15daa0 2023-11-04T01:40:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.125+0000 7f4629ffb640 1 -- 172.21.15.93:0/3075618348 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951889503 0 0) 0x7f462c15e000 con 0x7f462c0ce240 2023-11-04T01:40:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.126+0000 7f462a7fc640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c157000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6f4c75ac4ee81e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.126+0000 7f4629ffb640 1 -- 172.21.15.93:0/3075618348 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620031830 con 0x7f462c15daa0 2023-11-04T01:40:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.126+0000 7f4629ffb640 1 -- 172.21.15.93:0/3075618348 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620031990 con 0x7f462c15daa0 2023-11-04T01:40:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.126+0000 7f4629ffb640 1 -- 172.21.15.93:0/3075618348 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620031d20 con 0x7f462c15daa0 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 -- 172.21.15.93:0/3075618348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 msgr2=0x7f462c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c157000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 -- 172.21.15.93:0/3075618348 shutdown_connections 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c157000 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 --2- 172.21.15.93:0/3075618348 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 -- 172.21.15.93:0/3075618348 >> 172.21.15.93:0/3075618348 conn(0x7f462c071f30 msgr2=0x7f462c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 -- 172.21.15.93:0/3075618348 shutdown_connections 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.127+0000 7f4631965640 1 -- 172.21.15.93:0/3075618348 wait complete. 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.128+0000 7f4631965640 1 Processor -- start 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.128+0000 7f4631965640 1 -- start start 2023-11-04T01:40:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 0x7f462c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c152d50 con 0x7f462c15daa0 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1523d0 con 0x7f462c0ce240 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f4631965640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1f6b80 con 0x7f462c0cde60 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52426/0 (socket says 172.21.15.93:52426) 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 -- 172.21.15.93:0/1122446462 learned_addr learned my addr 172.21.15.93:0/1122446462 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462affd640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462a7fc640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 0x7f462c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 -- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 msgr2=0x7f462c0c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c0c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 -- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 msgr2=0x7f462c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 0x7f462c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462b7fe640 1 -- 172.21.15.93:0/1122446462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009400 con 0x7f462c15daa0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462affd640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c0c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.129+0000 7f462a7fc640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 0x7f462c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f462b7fe640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7e0 tx=0x7f462400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400a640 con 0x7f462c15daa0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400a7c0 con 0x7f462c15daa0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c152690 con 0x7f462c15daa0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400ab70 con 0x7f462c15daa0 2023-11-04T01:40:43.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.130+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0c5f40 con 0x7f462c15daa0 2023-11-04T01:40:43.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.131+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c152e90 con 0x7f462c15daa0 2023-11-04T01:40:43.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.131+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f462400acd0 con 0x7f462c15daa0 2023-11-04T01:40:43.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.132+0000 7f4613fff640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 0x7f461806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.132+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f46240894c0 con 0x7f462c15daa0 2023-11-04T01:40:43.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.132+0000 7f462affd640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 0x7f461806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.132+0000 7f462affd640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 0x7f461806d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f461c008890 tx=0x7f461c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.136+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f462c152e90 con 0x7f462c15daa0 2023-11-04T01:40:43.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.338+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f462c152e90 con 0x7f462c15daa0 2023-11-04T01:40:43.340 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.338+0000 7f4613fff640 1 -- 172.21.15.93:0/1122446462 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4982 (secure 0 0 0) 0x7f462c152e90 con 0x7f462c15daa0 2023-11-04T01:40:43.341 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:43.341 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:42.058195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/448915336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":448915336},{"type":"v1","addr":"172.21.15.93:6836","nonce":448915336}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:42.058195+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:43.341 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 66 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 msgr2=0x7f461806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 0x7f461806d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f461c008890 tx=0x7f461c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 msgr2=0x7f462c151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7e0 tx=0x7f462400cca0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 shutdown_connections 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f461806ae70 0x7f461806d330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f462c15daa0 0x7f462c151020 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f462c0ce240 0x7f462c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 --2- 172.21.15.93:0/1122446462 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f462c0cde60 0x7f462c0c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 >> 172.21.15.93:0/1122446462 conn(0x7f462c071f30 msgr2=0x7f462c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 shutdown_connections 2023-11-04T01:40:43.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.340+0000 7f4631965640 1 -- 172.21.15.93:0/1122446462 wait complete. 2023-11-04T01:40:43.353 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:40:43.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:43.378 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:43.380 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:43.380 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:43.450 INFO:teuthology.orchestra.run.smithi093.stdout:1699062026.149431.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:43.452 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062026.149431.core'] 2023-11-04T01:40:43.452 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062026.149431.core, deleting it 2023-11-04T01:40:43.452 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062026.149431.core 2023-11-04T01:40:43.522 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:43.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 Processor -- start 2023-11-04T01:40:43.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 -- start start 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd158159c00 0x7fd1580cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd1580ae1d0 0x7fd1580c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15815aff0 con 0x7fd1580c48e0 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580c52d0 con 0x7fd158159c00 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.661+0000 7fd15e694640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15815a3e0 con 0x7fd1580ae1d0 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd158159c00 0x7fd1580cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd158159c00 0x7fd1580cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52430/0 (socket says 172.21.15.93:52430) 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 -- 172.21.15.93:0/1893402895 learned_addr learned my addr 172.21.15.93:0/1893402895 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:43.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd15cc31640 1 --2- 172.21.15.93:0/1893402895 >> v2:172.21.15.125:3300/0 conn(0x7fd1580ae1d0 0x7fd1580c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 -- 172.21.15.93:0/1893402895 >> v2:172.21.15.125:3300/0 conn(0x7fd1580ae1d0 msgr2=0x7fd1580c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 --2- 172.21.15.93:0/1893402895 >> v2:172.21.15.125:3300/0 conn(0x7fd1580ae1d0 0x7fd1580c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 -- 172.21.15.93:0/1893402895 >> v1:172.21.15.125:6789/0 conn(0x7fd1580c48e0 legacy=0x7fd1580adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.662+0000 7fd157fff640 1 -- 172.21.15.93:0/1893402895 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15815a6c0 con 0x7fd158159c00 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd157fff640 1 --2- 172.21.15.93:0/1893402895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd158159c00 0x7fd1580cc890 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd1580ce800 tx=0x7fd14802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf5ee084de84803 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd156ffd640 1 -- 172.21.15.93:0/1893402895 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031870 con 0x7fd158159c00 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd156ffd640 1 -- 172.21.15.93:0/1893402895 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1480319d0 con 0x7fd158159c00 2023-11-04T01:40:43.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd156ffd640 1 -- 172.21.15.93:0/1893402895 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031d60 con 0x7fd158159c00 2023-11-04T01:40:43.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 -- 172.21.15.93:0/1893402895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd158159c00 msgr2=0x7fd1580cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 --2- 172.21.15.93:0/1893402895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd158159c00 0x7fd1580cc890 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd1580ce800 tx=0x7fd14802b910 comp rx=0 tx=0).stop 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 -- 172.21.15.93:0/1893402895 shutdown_connections 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 --2- 172.21.15.93:0/1893402895 >> v2:172.21.15.125:3300/0 conn(0x7fd1580ae1d0 0x7fd1580c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 --2- 172.21.15.93:0/1893402895 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd158159c00 0x7fd1580cc890 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 -- 172.21.15.93:0/1893402895 >> 172.21.15.93:0/1893402895 conn(0x7fd1580ce950 msgr2=0x7fd1580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 -- 172.21.15.93:0/1893402895 shutdown_connections 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.663+0000 7fd15e694640 1 -- 172.21.15.93:0/1893402895 wait complete. 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.664+0000 7fd15e694640 1 Processor -- start 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 -- start start 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1580ae1d0 0x7fd15814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 0x7fd15806da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581f6860 con 0x7fd1580c48e0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15814a970 con 0x7fd158159c00 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd15e694640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581f5be0 con 0x7fd1580ae1d0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd1577fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd1577fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52434/0 (socket says 172.21.15.93:52434) 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.665+0000 7fd1577fe640 1 -- 172.21.15.93:0/2169544798 learned_addr learned my addr 172.21.15.93:0/2169544798 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd157fff640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1580ae1d0 0x7fd15814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd15cc31640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 0x7fd15806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 -- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1580ae1d0 msgr2=0x7fd15814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1580ae1d0 0x7fd15814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 -- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 msgr2=0x7fd15806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 0x7fd15806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 -- 172.21.15.93:0/2169544798 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480094d0 con 0x7fd1580c48e0 2023-11-04T01:40:43.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd15cc31640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 0x7fd15806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd1577fe640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c450 tx=0x7fd14c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0052d0 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c005430 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1581f5ec0 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c012870 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.666+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1581f6480 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.667+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd158074290 con 0x7fd1580c48e0 2023-11-04T01:40:43.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.668+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd14c0129d0 con 0x7fd1580c48e0 2023-11-04T01:40:43.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.668+0000 7fd154ff9640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 0x7fd14406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.668+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fd14c0896f0 con 0x7fd1580c48e0 2023-11-04T01:40:43.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.668+0000 7fd157fff640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 0x7fd14406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.668+0000 7fd157fff640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 0x7fd14406d360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd148036000 tx=0x7fd14803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.672+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd14c0541c0 con 0x7fd1580c48e0 2023-11-04T01:40:43.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.902+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fd1580cd9a0 con 0x7fd1580c48e0 2023-11-04T01:40:43.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.904+0000 7fd154ff9640 1 -- 172.21.15.93:0/2169544798 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7689 v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd14c0577e0 con 0x7fd1580c48e0 2023-11-04T01:40:43.906 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 7689 2023-11-04T01:40:43.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 msgr2=0x7fd14406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 0x7fd14406d360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd148036000 tx=0x7fd14803c040 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 msgr2=0x7fd1580aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c450 tx=0x7fd14c00c910 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 shutdown_connections 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd14406aea0 0x7fd14406d360 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158159c00 0x7fd15806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c48e0 0x7fd1580aca20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 --2- 172.21.15.93:0/2169544798 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd1580ae1d0 0x7fd15814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 >> 172.21.15.93:0/2169544798 conn(0x7fd1580ce950 msgr2=0x7fd1580709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 shutdown_connections 2023-11-04T01:40:43.911 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:43.908+0000 7fd15e694640 1 -- 172.21.15.93:0/2169544798 wait complete. 2023-11-04T01:40:43.925 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:40:43.925 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:40:43.925 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:40:43.925 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:43.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:43.925 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:40:43.925 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:40:43.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:40:43.928 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:40:43.928 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:44.002 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:40:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.027+0000 7f1246bc0640 1 Processor -- start 2023-11-04T01:40:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.027+0000 7f1246bc0640 1 -- start start 2023-11-04T01:40:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.028+0000 7f1246bc0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 0x7f12401613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.028+0000 7f1246bc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.028+0000 7f1246bc0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124006c650 con 0x7f124006cae0 2023-11-04T01:40:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.028+0000 7f1246bc0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124006b830 con 0x7f124015cd20 2023-11-04T01:40:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.028+0000 7f1246bc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12401618f0 con 0x7f12400b2d10 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124495c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 0x7f12401613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f123ffff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f124006cae0 0x7f12400b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:50444/0 (socket says 172.21.15.93:50444) 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54168/0 (socket says 172.21.15.93:54168) 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f123ffff640 1 -- 172.21.15.93:0/3697010706 learned_addr learned my addr 172.21.15.93:0/3697010706 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 -- 172.21.15.93:0/3697010706 >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 msgr2=0x7f12401613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 --2- 172.21.15.93:0/3697010706 >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 0x7f12401613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 -- 172.21.15.93:0/3697010706 >> v1:172.21.15.125:6789/0 conn(0x7f124006cae0 legacy=0x7f12400b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124515d640 1 -- 172.21.15.93:0/3697010706 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124006ba40 con 0x7f12400b2d10 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.029+0000 7f124495c640 1 --2- 172.21.15.93:0/3697010706 >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 0x7f12401613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.030+0000 7f124515d640 1 --2- 172.21.15.93:0/3697010706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1238009d90 tx=0x7f123802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2e183699ba9a51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.030+0000 7f123f7fe640 1 -- 172.21.15.93:0/3697010706 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123802cc50 con 0x7f12400b2d10 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.030+0000 7f123f7fe640 1 -- 172.21.15.93:0/3697010706 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123802cdb0 con 0x7f12400b2d10 2023-11-04T01:40:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.030+0000 7f123f7fe640 1 -- 172.21.15.93:0/3697010706 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238034660 con 0x7f12400b2d10 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 -- 172.21.15.93:0/3697010706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 msgr2=0x7f12400cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3697010706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1238009d90 tx=0x7f123802bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 -- 172.21.15.93:0/3697010706 shutdown_connections 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3697010706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f12400b2d10 0x7f12400cb490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3697010706 >> v2:172.21.15.125:3300/0 conn(0x7f124015cd20 0x7f12401613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 -- 172.21.15.93:0/3697010706 >> 172.21.15.93:0/3697010706 conn(0x7f12400cd600 msgr2=0x7f12400cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 -- 172.21.15.93:0/3697010706 shutdown_connections 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.031+0000 7f1246bc0640 1 -- 172.21.15.93:0/3697010706 wait complete. 2023-11-04T01:40:44.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.032+0000 7f1246bc0640 1 Processor -- start 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.032+0000 7f1246bc0640 1 -- start start 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f124006cae0 0x7f1240150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f124015cd20 0x7f1240153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240151430 con 0x7f12400b2d10 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240157860 con 0x7f124006cae0 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240153f60 con 0x7f124015cd20 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52454/0 (socket says 172.21.15.93:52454) 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 -- 172.21.15.93:0/3003902908 learned_addr learned my addr 172.21.15.93:0/3003902908 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f124495c640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f124006cae0 0x7f1240150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f124515d640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f124015cd20 0x7f1240153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 -- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f124015cd20 msgr2=0x7f1240153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f124015cd20 0x7f1240153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 -- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f124006cae0 msgr2=0x7f1240150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f124006cae0 0x7f1240150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 -- 172.21.15.93:0/3003902908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300093a0 con 0x7f12400b2d10 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123ffff640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f123400c4a0 tx=0x7f123400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234005ce0 con 0x7f12400b2d10 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234005e40 con 0x7f12400b2d10 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238009a70 con 0x7f12400b2d10 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234007270 con 0x7f12400b2d10 2023-11-04T01:40:44.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.033+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1240154520 con 0x7f12400b2d10 2023-11-04T01:40:44.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.034+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124006d3c0 con 0x7f12400b2d10 2023-11-04T01:40:44.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.035+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12340073d0 con 0x7f12400b2d10 2023-11-04T01:40:44.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.035+0000 7f123d7fa640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 0x7f122c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.035+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f1234089090 con 0x7f12400b2d10 2023-11-04T01:40:44.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.035+0000 7f124495c640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 0x7f122c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.035+0000 7f124495c640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 0x7f122c06d330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f12401581e0 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.039+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1234053bc0 con 0x7f12400b2d10 2023-11-04T01:40:44.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.243+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12400b6b00 con 0x7f12400b2d10 2023-11-04T01:40:44.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.243+0000 7f123d7fa640 1 -- 172.21.15.93:0/3003902908 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f12340571e0 con 0x7f12400b2d10 2023-11-04T01:40:44.246 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:44.246 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:43.910135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:44.246 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 68 2023-11-04T01:40:44.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 msgr2=0x7f122c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 0x7f122c06d330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f12401581e0 tx=0x7f1230008040 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 msgr2=0x7f1240156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f123400c4a0 tx=0x7f123400c960 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 shutdown_connections 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f122c06ae70 0x7f122c06d330 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f124015cd20 0x7f1240153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12400b2d10 0x7f1240156da0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 --2- 172.21.15.93:0/3003902908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f124006cae0 0x7f1240150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 >> 172.21.15.93:0/3003902908 conn(0x7f12400cd600 msgr2=0x7f124015c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 shutdown_connections 2023-11-04T01:40:44.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:44.245+0000 7f1246bc0640 1 -- 172.21.15.93:0/3003902908 wait complete. 2023-11-04T01:40:44.258 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:46.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:40:49.258 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:49.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.369+0000 7f46f8e4f640 1 Processor -- start 2023-11-04T01:40:49.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.369+0000 7f46f8e4f640 1 -- start start 2023-11-04T01:40:49.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f8e4f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f8e4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f8e4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f40b1590 con 0x7f46f406ef40 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f8e4f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f4155a40 con 0x7f46f40aec80 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f8e4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f406a660 con 0x7f46f40af060 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f259c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f1d9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f2d9d640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f46f406ef40 0x7f46f40cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:50458/0 (socket says 172.21.15.93:50458) 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f259c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:39468/0 (socket says 172.21.15.93:39468) 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f2d9d640 1 -- 172.21.15.93:0/2014229134 learned_addr learned my addr 172.21.15.93:0/2014229134 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:49.372 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.370+0000 7f46f1d9b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:54182/0 (socket says 172.21.15.93:54182) 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.371+0000 7f46f1d9b640 1 -- 172.21.15.93:0/2014229134 >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 msgr2=0x7f46f40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.371+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2014229134 >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.371+0000 7f46f1d9b640 1 -- 172.21.15.93:0/2014229134 >> v1:172.21.15.125:6789/0 conn(0x7f46f406ef40 legacy=0x7f46f40cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.371+0000 7f46f1d9b640 1 -- 172.21.15.93:0/2014229134 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f406a8e0 con 0x7f46f40af060 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.371+0000 7f46f259c640 1 --2- 172.21.15.93:0/2014229134 >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2014229134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009790 tx=0x7f46e802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f229798f3a75ea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f159a640 1 -- 172.21.15.93:0/2014229134 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8031800 con 0x7f46f40af060 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f159a640 1 -- 172.21.15.93:0/2014229134 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e8031960 con 0x7f46f40af060 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f159a640 1 -- 172.21.15.93:0/2014229134 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e8031cf0 con 0x7f46f40af060 2023-11-04T01:40:49.374 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2014229134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 msgr2=0x7f46f406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2014229134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009790 tx=0x7f46e802b8a0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2014229134 shutdown_connections 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2014229134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40af060 0x7f46f406a120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2014229134 >> v2:172.21.15.125:3300/0 conn(0x7f46f40aec80 0x7f46f40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.372+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2014229134 >> 172.21.15.93:0/2014229134 conn(0x7f46f4098d40 msgr2=0x7f46f40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.373+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2014229134 shutdown_connections 2023-11-04T01:40:49.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.373+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2014229134 wait complete. 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.374+0000 7f46f8e4f640 1 Processor -- start 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.374+0000 7f46f8e4f640 1 -- start start 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 0x7f46f40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 0x7f46f4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40cf3d0 con 0x7f46f406ef40 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40ce7c0 con 0x7f46f40af060 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f8e4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40ceaa0 con 0x7f46f40aec80 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52456/0 (socket says 172.21.15.93:52456) 2023-11-04T01:40:49.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 -- 172.21.15.93:0/2656567903 learned_addr learned my addr 172.21.15.93:0/2656567903 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 0x7f46f40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f2d9d640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 0x7f46f4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 -- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 msgr2=0x7f46f40c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 0x7f46f40c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 -- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 msgr2=0x7f46f4159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 0x7f46f4159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f259c640 1 -- 172.21.15.93:0/2656567903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40093a0 con 0x7f46f406ef40 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 0x7f46f40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.375+0000 7f46f2d9d640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 0x7f46f4159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46f259c640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9b0 tx=0x7f46e400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4005990 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4005af0 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80093a0 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4005e80 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.376+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f40cf060 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.377+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f40672a0 con 0x7f46f406ef40 2023-11-04T01:40:49.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.377+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46e400c9a0 con 0x7f46f406ef40 2023-11-04T01:40:49.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.378+0000 7f46e2ffd640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 0x7f46d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.378+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f46e408a0e0 con 0x7f46f406ef40 2023-11-04T01:40:49.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.378+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 0x7f46d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.378+0000 7f46f1d9b640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 0x7f46d406d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f46e8036000 tx=0x7f46e8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.382+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46e4054ad0 con 0x7f46f406ef40 2023-11-04T01:40:49.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.586+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46f4074290 con 0x7f46f406ef40 2023-11-04T01:40:49.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.587+0000 7f46e2ffd640 1 -- 172.21.15.93:0/2656567903 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f46e4020090 con 0x7f46f406ef40 2023-11-04T01:40:49.588 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:49.588 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:46.922345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:49.589 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 72 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 msgr2=0x7f46d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 0x7f46d406d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f46e8036000 tx=0x7f46e8008030 comp rx=0 tx=0).stop 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 msgr2=0x7f46f415f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9b0 tx=0x7f46e400ee70 comp rx=0 tx=0).stop 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 shutdown_connections 2023-11-04T01:40:49.590 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f46d406ae70 0x7f46d406d330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f40af060 0x7f46f4159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f46f40aec80 0x7f46f40c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 --2- 172.21.15.93:0/2656567903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46f406ef40 0x7f46f415f390 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 >> 172.21.15.93:0/2656567903 conn(0x7f46f4098d40 msgr2=0x7f46f41534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 shutdown_connections 2023-11-04T01:40:49.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.589+0000 7f46f8e4f640 1 -- 172.21.15.93:0/2656567903 wait complete. 2023-11-04T01:40:49.601 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:40:49.601 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:49.690 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:49.690 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:49.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.699+0000 7ff005eaf640 1 Processor -- start 2023-11-04T01:40:49.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.699+0000 7ff005eaf640 1 -- start start 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.699+0000 7ff005eaf640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff00015ce60 0x7ff00006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.699+0000 7ff005eaf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 0x7ff000160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7ff005eaf640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0001615d0 con 0x7ff000161050 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7ff005eaf640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0000cbde0 con 0x7ff00015ce60 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7ff005eaf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0001618b0 con 0x7ff00006bd30 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7feffeffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 0x7ff000160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7fefff7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff00015ce60 0x7ff00006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7feffffff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff000161050 0x7ff0000cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:50460/0 (socket says 172.21.15.93:50460) 2023-11-04T01:40:49.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7feffffff640 1 -- 172.21.15.93:0/4091335194 learned_addr learned my addr 172.21.15.93:0/4091335194 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:49.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7fefff7fe640 1 -- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 msgr2=0x7ff000160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7fefff7fe640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 0x7ff000160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7fefff7fe640 1 -- 172.21.15.93:0/4091335194 >> v1:172.21.15.125:6789/0 conn(0x7ff000161050 legacy=0x7ff0000cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7fefff7fe640 1 -- 172.21.15.93:0/4091335194 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000cba00 con 0x7ff00015ce60 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.700+0000 7feffeffd640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 0x7ff000160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.701+0000 7fefff7fe640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff00015ce60 0x7ff00006b7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feff00097a0 tx=0x7feff002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72eb09ca7df53228 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.701+0000 7feffe7fc640 1 -- 172.21.15.93:0/4091335194 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0031830 con 0x7ff00015ce60 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.701+0000 7feffe7fc640 1 -- 172.21.15.93:0/4091335194 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0031990 con 0x7ff00015ce60 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.701+0000 7feffe7fc640 1 -- 172.21.15.93:0/4091335194 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0031d20 con 0x7ff00015ce60 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 -- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff00015ce60 msgr2=0x7ff00006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff00015ce60 0x7ff00006b7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feff00097a0 tx=0x7feff002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 -- 172.21.15.93:0/4091335194 shutdown_connections 2023-11-04T01:40:49.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00006bd30 0x7ff000160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 --2- 172.21.15.93:0/4091335194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff00015ce60 0x7ff00006b7f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 -- 172.21.15.93:0/4091335194 >> 172.21.15.93:0/4091335194 conn(0x7ff00006ea90 msgr2=0x7ff00006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 -- 172.21.15.93:0/4091335194 shutdown_connections 2023-11-04T01:40:49.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.702+0000 7ff005eaf640 1 -- 172.21.15.93:0/4091335194 wait complete. 2023-11-04T01:40:49.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.703+0000 7ff005eaf640 1 Processor -- start 2023-11-04T01:40:49.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.703+0000 7ff005eaf640 1 -- start start 2023-11-04T01:40:49.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 0x7ff0000b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 0x7ff000156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000b2150 con 0x7ff0000b59c0 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000b23a0 con 0x7ff000161050 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7ff005eaf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000b2680 con 0x7ff00015ce60 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52466/0 (socket says 172.21.15.93:52466) 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 -- 172.21.15.93:0/2225350775 learned_addr learned my addr 172.21.15.93:0/2225350775 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7fefff7fe640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 0x7ff0000b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffeffd640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 0x7ff000156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 -- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 msgr2=0x7ff0000b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 0x7ff0000b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 -- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 msgr2=0x7ff000156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 0x7ff000156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffffff640 1 -- 172.21.15.93:0/2225350775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4009400 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7fefff7fe640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 0x7ff0000b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.704+0000 7feffeffd640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 0x7ff000156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7feffffff640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7feff800caf0 tx=0x7feff800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800aca0 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800ae00 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff0009400 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8012600 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.705+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000157700 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.706+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0000c87f0 con 0x7ff0000b59c0 2023-11-04T01:40:49.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.706+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feff8007070 con 0x7ff0000b59c0 2023-11-04T01:40:49.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.707+0000 7fefe7fff640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 0x7fefec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.707+0000 7fefff7fe640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 0x7fefec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.707+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7feff8089b20 con 0x7ff0000b59c0 2023-11-04T01:40:49.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.707+0000 7fefff7fe640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 0x7fefec06d360 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7feff0036000 tx=0x7feff003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.712 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.711+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0000c87f0 con 0x7ff0000b59c0 2023-11-04T01:40:49.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.913+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0000c87f0 con 0x7ff0000b59c0 2023-11-04T01:40:49.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.913+0000 7fefe7fff640 1 -- 172.21.15.93:0/2225350775 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff0000c87f0 con 0x7ff0000b59c0 2023-11-04T01:40:49.915 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:49.915 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:46.922345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:49.915 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 72 2023-11-04T01:40:49.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 msgr2=0x7fefec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 0x7fefec06d360 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7feff0036000 tx=0x7feff003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 msgr2=0x7ff0000c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7feff800caf0 tx=0x7feff800a060 comp rx=0 tx=0).stop 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 shutdown_connections 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefec06aea0 0x7fefec06d360 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0000b59c0 0x7ff0000c46d0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff000161050 0x7ff000156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 --2- 172.21.15.93:0/2225350775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff00015ce60 0x7ff0000b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 >> 172.21.15.93:0/2225350775 conn(0x7ff00006ea90 msgr2=0x7ff0000c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 shutdown_connections 2023-11-04T01:40:49.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:49.915+0000 7ff005eaf640 1 -- 172.21.15.93:0/2225350775 wait complete. 2023-11-04T01:40:50.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:40:46.922345+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5969, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_5969': {'gid': 5969, 'name': 'd', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.125:6834/4131141051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6832', 'nonce': 4131141051}, {'type': 'v1', 'addr': '172.21.15.125:6834', 'nonce': 4131141051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:50.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:50.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:40:50.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 Processor -- start 2023-11-04T01:40:50.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 -- start start 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6ba8153e60 0x7f6ba815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 0x7f6ba8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80cde60 con 0x7f6ba80b4880 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba8160f90 con 0x7f6ba8153e60 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.433+0000 7f6baccd4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba815e400 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6ba8153e60 0x7f6ba815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6ba80b4880 0x7f6ba806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39752/0 (socket says 172.21.15.93:39752) 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba6d9d640 1 -- 172.21.15.93:0/2540852038 learned_addr learned my addr 172.21.15.93:0/2540852038 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:50.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/2540852038 >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 0x7f6ba8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba5d9b640 1 -- 172.21.15.93:0/2540852038 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134876749 0 0) 0x7f6ba80cde60 con 0x7f6ba80b4880 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba5d9b640 1 -- 172.21.15.93:0/2540852038 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b94003520 con 0x7f6ba80b4880 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba659c640 1 -- 172.21.15.93:0/2540852038 >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 msgr2=0x7f6ba8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba659c640 1 --2- 172.21.15.93:0/2540852038 >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 0x7f6ba8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba659c640 1 -- 172.21.15.93:0/2540852038 >> v1:172.21.15.93:6789/0 conn(0x7f6ba80b4880 legacy=0x7f6ba806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6ba659c640 1 -- 172.21.15.93:0/2540852038 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8161960 con 0x7f6ba8153e60 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.434+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/2540852038 >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 0x7f6ba8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6ba659c640 1 --2- 172.21.15.93:0/2540852038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba8153e60 0x7f6ba815dec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80c9e80 tx=0x7f6b9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b38413de7a75c8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6ba5d9b640 1 -- 172.21.15.93:0/2540852038 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98031830 con 0x7f6ba8153e60 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6ba5d9b640 1 -- 172.21.15.93:0/2540852038 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98031990 con 0x7f6ba8153e60 2023-11-04T01:40:50.437 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6ba5d9b640 1 -- 172.21.15.93:0/2540852038 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98031d20 con 0x7f6ba8153e60 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 -- 172.21.15.93:0/2540852038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba8153e60 msgr2=0x7f6ba815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 --2- 172.21.15.93:0/2540852038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba8153e60 0x7f6ba815dec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80c9e80 tx=0x7f6b9802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 -- 172.21.15.93:0/2540852038 shutdown_connections 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 --2- 172.21.15.93:0/2540852038 >> v2:172.21.15.125:3300/0 conn(0x7f6ba80cd6d0 0x7f6ba8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 --2- 172.21.15.93:0/2540852038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba8153e60 0x7f6ba815dec0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 -- 172.21.15.93:0/2540852038 >> 172.21.15.93:0/2540852038 conn(0x7f6ba80cf880 msgr2=0x7f6ba80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 -- 172.21.15.93:0/2540852038 shutdown_connections 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.435+0000 7f6baccd4640 1 -- 172.21.15.93:0/2540852038 wait complete. 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 Processor -- start 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 -- start start 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 0x7f6ba8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 0x7f6ba81f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80c9fd0 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8153770 con 0x7f6ba80b4880 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6baccd4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815c130 con 0x7f6ba8153e60 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.437+0000 7f6b9ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52480/0 (socket says 172.21.15.93:52480) 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 -- 172.21.15.93:0/573042242 learned_addr learned my addr 172.21.15.93:0/573042242 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6ba659c640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 0x7f6ba8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 -- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 msgr2=0x7f6ba81f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 0x7f6ba81f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 0x7f6ba81f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 -- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 msgr2=0x7f6ba8153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 0x7f6ba8153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 -- 172.21.15.93:0/573042242 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009400 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6ba659c640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 0x7f6ba8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 0x7f6ba81f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000e7e0 tx=0x7f6b9000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9effd640 1 -- 172.21.15.93:0/573042242 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90004030 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9effd640 1 -- 172.21.15.93:0/573042242 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90004190 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba815c410 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6b9effd640 1 -- 172.21.15.93:0/573042242 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90004520 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.438+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba815c9d0 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.440+0000 7f6b9effd640 1 -- 172.21.15.93:0/573042242 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b9000c6d0 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.440+0000 7f6b9effd640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 0x7f6b8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.440+0000 7f6b9effd640 1 -- 172.21.15.93:0/573042242 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f6b900898d0 con 0x7f6ba80cd6d0 2023-11-04T01:40:50.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.440+0000 7f6ba659c640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 0x7f6b8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.440+0000 7f6ba659c640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 0x7f6b8806d360 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6b98036000 tx=0x7f6b9803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.441+0000 7f6baf860740 1 Processor -- start 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.441+0000 7f6baf860740 1 -- start start 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558c30 0x56433155b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56433152bc90 0x56433155bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433143c740 con 0x564331558850 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433149e8d0 con 0x564331558c30 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x56433149bfc0 con 0x56433152bc90 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52490/0 (socket says 172.21.15.93:52490) 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 -- 172.21.15.93:0/3540692257 learned_addr learned my addr 172.21.15.93:0/3540692257 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 -- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56433152bc90 msgr2=0x56433155bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56433152bc90 0x56433155bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 -- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558c30 msgr2=0x56433155b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558c30 0x56433155b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 -- 172.21.15.93:0/3540692257 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433145aca0 con 0x564331558850 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009860 tx=0x7f6b98030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc01cee3056768c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6b87fff640 1 -- 172.21.15.93:0/3540692257 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9803acc0 con 0x564331558850 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6b87fff640 1 -- 172.21.15.93:0/3540692257 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9804a070 con 0x564331558850 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.442+0000 7f6b87fff640 1 -- 172.21.15.93:0/3540692257 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9804f630 con 0x564331558850 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 -- 172.21.15.93:0/3540692257 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 msgr2=0x56433152b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009860 tx=0x7f6b98030000 comp rx=0 tx=0).stop 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 -- 172.21.15.93:0/3540692257 shutdown_connections 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x56433152bc90 0x56433155bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558c30 0x56433155b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 --2- 172.21.15.93:0/3540692257 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x56433152b750 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 -- 172.21.15.93:0/3540692257 >> 172.21.15.93:0/3540692257 conn(0x56433152da60 msgr2=0x5643315765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 -- 172.21.15.93:0/3540692257 shutdown_connections 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.443+0000 7f6baf860740 1 -- 172.21.15.93:0/3540692257 wait complete. 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.444+0000 7f6baf860740 1 -- start start 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.444+0000 7f6baf860740 1 Processor -- start 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558850 0x564331589860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x56433155daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643314978b0 con 0x564331558c30 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331451c80 con 0x564331587160 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x564331451920 con 0x564331558850 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 10 client.0 _ll_register_callbacks cb 0x5643311a9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52496/0 (socket says 172.21.15.93:52496) 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 -- 172.21.15.93:0/3482194354 learned_addr learned my addr 172.21.15.93:0/3482194354 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x56433155daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558850 0x564331589860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 -- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558850 msgr2=0x564331589860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558850 0x564331589860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 -- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 msgr2=0x56433155daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x56433155daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 -- 172.21.15.93:0/3482194354 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba8161960 con 0x564331558c30 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f6b90054510 tx=0x7f6b9005c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c42813ff3794e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b857fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9005cea0 con 0x564331558c30 2023-11-04T01:40:50.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f6b90056470 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564331443bf0 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b9005e280 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 10 client.7944 fetch_fsmap learned FSMap version 72 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.445+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x564331495f30 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564331443bf0 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6b90087b60 con 0x564331558c30 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 10 client.7944 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 10 client.7944 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 20 client.7944 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315499b0 0x564331587e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 4 client.7944 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564331490890 con 0x5643315499b0 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315499b0 0x564331587e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6ba659c640 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315499b0 0x564331587e00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=42a151824f586085 server_cookie=72a418941c04949e in_seq=0 out_seq=0 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.446+0000 7f6b857fa640 10 client.7944 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6b857fa640 1 -- 172.21.15.93:0/3482194354 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564331490890 con 0x5643315499b0 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6b857fa640 10 client.7944 handle_command_reply: tid=0 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 client.7944 shutdown 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 msgr2=0x564331586c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f6b90054510 tx=0x7f6b9005c220 comp rx=0 tx=0).stop 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 shutdown_connections 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315499b0 0x564331587e00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x56433155daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558c30 0x564331586c20 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 --2- 172.21.15.93:0/3482194354 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558850 0x564331589860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6b857fa640 0 client.7944 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:50.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 >> 172.21.15.93:0/3482194354 conn(0x56433152bc90 msgr2=0x56433152a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 shutdown_connections 2023-11-04T01:40:50.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 1 -- 172.21.15.93:0/3482194354 wait complete. 2023-11-04T01:40:50.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.447+0000 7f6baf860740 20 client.7944 trim_cache size 0 max 16384 2023-11-04T01:40:50.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 Processor -- start 2023-11-04T01:40:50.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 -- start start 2023-11-04T01:40:50.470 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558850 0x56433152a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x56433152aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331417280 con 0x564331587160 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564331527050 con 0x564331558850 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.463+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x564331599a70 con 0x564331558c30 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52506/0 (socket says 172.21.15.93:52506) 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 -- 172.21.15.93:0/1621464000 learned_addr learned my addr 172.21.15.93:0/1621464000 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba659c640 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558850 0x56433152a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x56433152aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 -- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 msgr2=0x56433152aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x56433152aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.471 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 -- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558850 msgr2=0x56433152a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558850 0x56433152a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 -- 172.21.15.93:0/1621464000 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643315771d0 con 0x564331587160 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001ea0 tx=0x7f6ba000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56060b53758c5f79 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6b9cff9640 1 -- 172.21.15.93:0/1621464000 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000fec0 con 0x564331587160 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6b9cff9640 1 -- 172.21.15.93:0/1621464000 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000d050 con 0x564331587160 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.464+0000 7f6b9cff9640 1 -- 172.21.15.93:0/1621464000 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0005e10 con 0x564331587160 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- 172.21.15.93:0/1621464000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 msgr2=0x56433158f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001ea0 tx=0x7f6ba000f5a0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- 172.21.15.93:0/1621464000 shutdown_connections 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331587160 0x56433158f6a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x56433152aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 --2- 172.21.15.93:0/1621464000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331558850 0x56433152a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- 172.21.15.93:0/1621464000 >> 172.21.15.93:0/1621464000 conn(0x56433152bc90 msgr2=0x564331586910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- 172.21.15.93:0/1621464000 shutdown_connections 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- 172.21.15.93:0/1621464000 wait complete. 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 -- start start 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.465+0000 7f6baf860740 1 Processor -- start 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x5643315eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x5643315ed870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643315ea790 con 0x564331558850 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643315ee340 con 0x564331587160 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643315900b0 con 0x564331558c30 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6baf860740 10 client.0 _ll_register_callbacks cb 0x7f6b940036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52518/0 (socket says 172.21.15.93:52518) 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6ba659c640 1 -- 172.21.15.93:0/1366737445 learned_addr learned my addr 172.21.15.93:0/1366737445 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x5643315eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.466+0000 7f6ba6d9d640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x5643315ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 -- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 msgr2=0x5643315eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x5643315eabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 -- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 msgr2=0x5643315ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x5643315ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 -- 172.21.15.93:0/1366737445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b94003520 con 0x564331558850 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6ba659c640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006f80 tx=0x7f6b9802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c2187068c9031 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98004280 con 0x564331558850 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f6b980043e0 con 0x564331558850 2023-11-04T01:40:50.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b9804a070 con 0x564331558850 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b98057410 con 0x564331558850 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 10 client.7950 fetch_fsmap learned FSMap version 72 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x564331433d10 con 0x564331558850 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9804a070 con 0x564331558850 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6b98057570 con 0x564331558850 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 10 client.7950 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:40:50.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 10 client.7950 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 20 client.7950 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315304f0 0x5643315308d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 4 client.7950 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5643314905b0 con 0x5643315304f0 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.467+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315304f0 0x5643315308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6b9ffff640 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315304f0 0x5643315308d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc22cd397117316a server_cookie=87d30969c0d40bdc in_seq=0 out_seq=0 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6b857fa640 10 client.7950 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6b857fa640 1 -- 172.21.15.93:0/1366737445 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5643314905b0 con 0x5643315304f0 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6b857fa640 10 client.7950 handle_command_reply: tid=0 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 client.7950 shutdown 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 msgr2=0x5643315e0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006f80 tx=0x7f6b9802e000 comp rx=0 tx=0).stop 2023-11-04T01:40:50.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 shutdown_connections 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x5643315304f0 0x5643315308d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564331587160 0x5643315ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x564331558c30 0x5643315eabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6b857fa640 0 client.7950 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 --2- 172.21.15.93:0/1366737445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564331558850 0x5643315e0f20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 >> 172.21.15.93:0/1366737445 conn(0x56433152bc90 msgr2=0x564331570f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 shutdown_connections 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 1 -- 172.21.15.93:0/1366737445 wait complete. 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.468+0000 7f6baf860740 20 client.7950 trim_cache size 0 max 16384 2023-11-04T01:40:50.477 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 1, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5750, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 88.424450007000004, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 72, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 100, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 103.011772161 2023-11-04T01:40:50.478 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:50.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 msgr2=0x7f6b8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 0x7f6b8806d360 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6b98036000 tx=0x7f6b9803c040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 msgr2=0x7f6ba80cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000e7e0 tx=0x7f6b9000eca0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 shutdown_connections 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6b8806aea0 0x7f6b8806d360 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6ba8153e60 0x7f6ba81f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ba80cd6d0 0x7f6ba80cc3e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 --2- 172.21.15.93:0/573042242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ba80b4880 0x7f6ba8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 >> 172.21.15.93:0/573042242 conn(0x7f6ba80cf880 msgr2=0x7f6ba80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 shutdown_connections 2023-11-04T01:40:50.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.469+0000 7f6baccd4640 1 -- 172.21.15.93:0/573042242 wait complete. 2023-11-04T01:40:50.481 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:40:50.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.580+0000 7f6980c10640 1 Processor -- start 2023-11-04T01:40:50.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.580+0000 7f6980c10640 1 -- start start 2023-11-04T01:40:50.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6980c10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c070ff0 0x7f697c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6980c10640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0c9bf0 con 0x7f697c15d1b0 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6980c10640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c0cd890 con 0x7f697c066000 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6980c10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0cdb30 con 0x7f697c070ff0 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6973fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f697c15d1b0 0x7f697c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39764/0 (socket says 172.21.15.93:39764) 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6973fff640 1 -- 172.21.15.93:0/4127910455 learned_addr learned my addr 172.21.15.93:0/4127910455 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663615389 0 0) 0x7f697c0c9bf0 con 0x7f697c15d1b0 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f697a59c640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c070ff0 0x7f697c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6968003520 con 0x7f697c15d1b0 2023-11-04T01:40:50.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3996546981 0 0) 0x7f6968003520 con 0x7f697c15d1b0 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c070ff0 msgr2=0x7f697c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c070ff0 0x7f697c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 >> v1:172.21.15.125:6789/0 conn(0x7f697c066000 legacy=0x7f697c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0cde10 con 0x7f697c15d1b0 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6964001670 con 0x7f697c15d1b0 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 >> v1:172.21.15.93:6789/0 conn(0x7f697c15d1b0 legacy=0x7f697c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680039a0 0x7f6968003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69680047c0 0x7f6968004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6968005180 0x7f696800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0cdb30 con 0x7f69680047c0 2023-11-04T01:40:50.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.581+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696800c050 con 0x7f6968005180 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696800c210 con 0x7f69680039a0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f697a59c640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f697c070ff0 0x7f697c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69680047c0 0x7f6968004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f697ad9d640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6968005180 0x7f696800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f697a59c640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680039a0 0x7f6968003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 -- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680039a0 msgr2=0x7f6968003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680039a0 0x7f6968003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 -- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6968005180 msgr2=0x7f696800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6968005180 0x7f696800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.582+0000 7f6973fff640 1 -- 172.21.15.93:0/4127910455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968003520 con 0x7f69680047c0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6973fff640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69680047c0 0x7f6968004c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f696400c240 tx=0x7f69680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30706eeb897c773 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964005ad0 con 0x7f69680047c0 2023-11-04T01:40:50.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964005c30 con 0x7f69680047c0 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6979d9b640 1 -- 172.21.15.93:0/4127910455 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696402c8b0 con 0x7f69680047c0 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 -- 172.21.15.93:0/4127910455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69680047c0 msgr2=0x7f6968004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 --2- 172.21.15.93:0/4127910455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69680047c0 0x7f6968004c40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f696400c240 tx=0x7f69680057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f697ad9d640 1 -- 172.21.15.93:0/4127910455 reap_dead start 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 -- 172.21.15.93:0/4127910455 shutdown_connections 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 -- 172.21.15.93:0/4127910455 >> 172.21.15.93:0/4127910455 conn(0x7f697c0cbc90 msgr2=0x7f697c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 -- 172.21.15.93:0/4127910455 shutdown_connections 2023-11-04T01:40:50.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.583+0000 7f6980c10640 1 -- 172.21.15.93:0/4127910455 wait complete. 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 Processor -- start 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 -- start start 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680047c0 0x7f697c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c1f6a60 0x7f697c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0c87e0 con 0x7f697c0c9140 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1f3130 con 0x7f697c1f6a60 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6980c10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1f3410 con 0x7f69680047c0 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.585+0000 7f6973fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52530/0 (socket says 172.21.15.93:52530) 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 -- 172.21.15.93:0/18127716 learned_addr learned my addr 172.21.15.93:0/18127716 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f697a59c640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680047c0 0x7f697c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f697ad9d640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c1f6a60 0x7f697c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 -- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680047c0 msgr2=0x7f697c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680047c0 0x7f697c0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 -- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c1f6a60 msgr2=0x7f697c0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c1f6a60 0x7f697c0c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 -- 172.21.15.93:0/18127716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c1f36f0 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6973fff640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6964001930 tx=0x7f6964001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6972ffd640 1 -- 172.21.15.93:0/18127716 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696403c040 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6972ffd640 1 -- 172.21.15.93:0/18127716 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696402ccc0 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c0c8400 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6972ffd640 1 -- 172.21.15.93:0/18127716 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640072b0 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.586+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c1445d0 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.588+0000 7f6972ffd640 1 -- 172.21.15.93:0/18127716 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6964032070 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.588+0000 7f6972ffd640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 0x7f695c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.588+0000 7f6972ffd640 1 -- 172.21.15.93:0/18127716 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f69640ab070 con 0x7f697c0c9140 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.588+0000 7f697a59c640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 0x7f695c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.588+0000 7f697a59c640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 0x7f695c06d360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f697c0ce870 tx=0x7f696c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.589+0000 7f69837a6740 1 Processor -- start 2023-11-04T01:40:50.601 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.589+0000 7f69837a6740 1 -- start start 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fcb850 0x558bd7f9e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 0x558bd7fceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7eaf740 con 0x558bd7fcbc30 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7f118d0 con 0x558bd7fcb850 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bd7f0efc0 con 0x558bd7f9ec90 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52540/0 (socket says 172.21.15.93:52540) 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 -- 172.21.15.93:0/2421654332 learned_addr learned my addr 172.21.15.93:0/2421654332 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f697a59c640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fcb850 0x558bd7f9e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 0x558bd7fceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.602 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 -- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 msgr2=0x558bd7fceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 0x558bd7fceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 -- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fcb850 msgr2=0x558bd7f9e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fcb850 0x558bd7f9e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 -- 172.21.15.93:0/2421654332 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bd7ecdca0 con 0x558bd7fcbc30 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 0x558bd7fceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f6973fff640 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6964001d10 tx=0x7f69640791f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c55c56014cddb4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f695bfff640 1 -- 172.21.15.93:0/2421654332 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964081a20 con 0x558bd7fcbc30 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f695bfff640 1 -- 172.21.15.93:0/2421654332 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964077910 con 0x558bd7fcbc30 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.590+0000 7f695bfff640 1 -- 172.21.15.93:0/2421654332 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964007ce0 con 0x558bd7fcbc30 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 -- 172.21.15.93:0/2421654332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 msgr2=0x558bd7fce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6964001d10 tx=0x7f69640791f0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.603 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 -- 172.21.15.93:0/2421654332 shutdown_connections 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7f9ec90 0x558bd7fceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcbc30 0x558bd7fce5e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 --2- 172.21.15.93:0/2421654332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fcb850 0x558bd7f9e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 -- 172.21.15.93:0/2421654332 >> 172.21.15.93:0/2421654332 conn(0x558bd7fa0a60 msgr2=0x558bd7fe95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 -- 172.21.15.93:0/2421654332 shutdown_connections 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.591+0000 7f69837a6740 1 -- 172.21.15.93:0/2421654332 wait complete. 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.592+0000 7f69837a6740 1 -- start start 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.592+0000 7f69837a6740 1 Processor -- start 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7ffc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7fe3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7f0a8b0 con 0x558bd7fcb850 2023-11-04T01:40:50.604 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7ec4c80 con 0x558bd7fe35c0 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bd7ec4920 con 0x558bd7fcbc30 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 10 client.0 _ll_register_callbacks cb 0x558bd7c1cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52542/0 (socket says 172.21.15.93:52542) 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 -- 172.21.15.93:0/2539703511 learned_addr learned my addr 172.21.15.93:0/2539703511 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 -- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 msgr2=0x558bd7ffc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f6973fff640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7ffc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7fe3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7ffc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 -- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 msgr2=0x558bd7fe3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7fe3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 -- 172.21.15.93:0/2539703511 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c1445d0 con 0x558bd7fcb850 2023-11-04T01:40:50.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f6973fff640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7ffc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7fe3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f697a59c640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f696c0166e0 tx=0x7f696c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b948e94be000fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69597fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c004500 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f696c003610 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bd7eb6bf0 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f696c0037d0 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.593+0000 7f69837a6740 10 client.7962 fetch_fsmap learned FSMap version 72 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x558bd7f08f30 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558bd7eb6bf0 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f696c003930 con 0x558bd7fcb850 2023-11-04T01:40:50.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 10 client.7962 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 10 client.7962 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 20 client.7962 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fe2250 0x558bd7ff9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 4 client.7962 mds_command: new command op to 5969 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 --> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bd7f03890 con 0x558bd7fe2250 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f6973fff640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fe2250 0x558bd7ff9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f69597fa640 10 client.7962 ms_handle_connect on v2:172.21.15.125:6832/4131141051 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.594+0000 7f6973fff640 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fe2250 0x558bd7ff9300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f02b84fdb571da server_cookie=4bc3fb3ab036e2b9 in_seq=0 out_seq=0 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69597fa640 1 -- 172.21.15.93:0/2539703511 <== mds.0 v2:172.21.15.125:6832/4131141051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558bd7f03890 con 0x558bd7fe2250 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69597fa640 10 client.7962 handle_command_reply: tid=0 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 client.7962 shutdown 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 msgr2=0x558bd7fe11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f696c0166e0 tx=0x7f696c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 shutdown_connections 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fe2250 0x558bd7ff9300 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7fe3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7ffc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 --2- 172.21.15.93:0/2539703511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fe11b0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69597fa640 0 client.7962 ms_handle_reset on v2:172.21.15.125:6832/4131141051 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 >> 172.21.15.93:0/2539703511 conn(0x558bd7f9ec90 msgr2=0x558bd7fa2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 shutdown_connections 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 1 -- 172.21.15.93:0/2539703511 wait complete. 2023-11-04T01:40:50.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.595+0000 7f69837a6740 20 client.7962 trim_cache size 0 max 16384 2023-11-04T01:40:50.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 Processor -- start 2023-11-04T01:40:50.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 -- start start 2023-11-04T01:40:50.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7fce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7ffa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7e8a280 con 0x558bd7fcb850 2023-11-04T01:40:50.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd7ffbc70 con 0x558bd7fe35c0 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bd7f9f240 con 0x558bd7fcbc30 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.611+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52552/0 (socket says 172.21.15.93:52552) 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 -- 172.21.15.93:0/2868871199 learned_addr learned my addr 172.21.15.93:0/2868871199 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f6973fff640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7fce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7ffa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 -- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 msgr2=0x558bd7fce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7fce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 -- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 msgr2=0x558bd7ffa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7ffa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 -- 172.21.15.93:0/2868871199 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bd7ea6d10 con 0x558bd7fcb850 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697ad9d640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7ffa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f6973fff640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7fce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f697a59c640 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f696c006dc0 tx=0x7f696c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1498e586334c9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f6970ff9640 1 -- 172.21.15.93:0/2868871199 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003e70 con 0x558bd7fcb850 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f6970ff9640 1 -- 172.21.15.93:0/2868871199 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c03d070 con 0x558bd7fcb850 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f6970ff9640 1 -- 172.21.15.93:0/2868871199 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003610 con 0x558bd7fcb850 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f69837a6740 1 -- 172.21.15.93:0/2868871199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 msgr2=0x558bd7fce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.612+0000 7f69837a6740 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f696c006dc0 tx=0x7f696c026000 comp rx=0 tx=0).stop 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 -- 172.21.15.93:0/2868871199 shutdown_connections 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd7ffa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd7fce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 --2- 172.21.15.93:0/2868871199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd7fce020 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 -- 172.21.15.93:0/2868871199 >> 172.21.15.93:0/2868871199 conn(0x558bd7f9ec90 msgr2=0x558bd7fe10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 -- 172.21.15.93:0/2868871199 shutdown_connections 2023-11-04T01:40:50.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 -- 172.21.15.93:0/2868871199 wait complete. 2023-11-04T01:40:50.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 -- start start 2023-11-04T01:40:50.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.613+0000 7f69837a6740 1 Processor -- start 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd8008ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd8002930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd8057ae0 con 0x558bd7fcb850 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bd8009a40 con 0x558bd7fe35c0 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bd7ffb4e0 con 0x558bd7fcbc30 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f69837a6740 10 client.0 _ll_register_callbacks cb 0x7f696c009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52564/0 (socket says 172.21.15.93:52564) 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 -- 172.21.15.93:0/1217110262 learned_addr learned my addr 172.21.15.93:0/1217110262 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697ad9d640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd8002930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f6973fff640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd8008ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 -- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 msgr2=0x558bd8008ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd8008ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 -- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 msgr2=0x558bd8002930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd8002930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.614+0000 7f697a59c640 1 -- 172.21.15.93:0/1217110262 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bd7f08f30 con 0x558bd7fcb850 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f697a59c640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f696c006e20 tx=0x7f696c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8e9e2abc2b1ef8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:40:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c004500 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f696c02fdb0 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6964077910 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f696c0164f0 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 10 client.7968 fetch_fsmap learned FSMap version 72 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x558bd7ecc500 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964077910 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f696c003610 con 0x558bd7fcb850 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 10 client.7968 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 10 client.7968 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 20 client.7968 populate_metadata read hostname 'smithi093' 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fce020 0x558bd7fce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 4 client.7968 mds_command: new command op to 5969 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 --> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558bd7f035b0 con 0x558bd7fce020 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.615+0000 7f6973fff640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fce020 0x558bd7fce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69597fa640 10 client.7968 ms_handle_connect on v2:172.21.15.125:6832/4131141051 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f6973fff640 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fce020 0x558bd7fce400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fac8084eda3a4c6 server_cookie=676bd1341139c75c in_seq=0 out_seq=0 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69597fa640 1 -- 172.21.15.93:0/1217110262 <== mds.0 v2:172.21.15.125:6832/4131141051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x558bd7f035b0 con 0x558bd7fce020 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69597fa640 10 client.7968 handle_command_reply: tid=0 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 client.7968 shutdown 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 msgr2=0x558bd80575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f696c006e20 tx=0x7f696c01b000 comp rx=0 tx=0).stop 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 shutdown_connections 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:6832/4131141051,v1:172.21.15.125:6834/4131141051] conn(0x558bd7fce020 0x558bd7fce400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558bd7fe35c0 0x558bd8002930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.624 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x558bd7fcbc30 0x558bd8008ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 --2- 172.21.15.93:0/1217110262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558bd7fcb850 0x558bd80575a0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69597fa640 0 client.7968 ms_handle_reset on v2:172.21.15.125:6832/4131141051 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 >> 172.21.15.93:0/1217110262 conn(0x558bd7f9ec90 msgr2=0x558bd7fa2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 shutdown_connections 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 1 -- 172.21.15.93:0/1217110262 wait complete. 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.616+0000 7f69837a6740 20 client.7968 trim_cache size 0 max 16384 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:40:50.625 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5969, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 6.7047604349999999, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 72, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 100, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 31.845636504000002 2023-11-04T01:40:50.626 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 msgr2=0x7f695c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 0x7f695c06d360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f697c0ce870 tx=0x7f696c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 msgr2=0x7f697c0c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6964001930 tx=0x7f6964001a00 comp rx=0 tx=0).stop 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 shutdown_connections 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f695c06aea0 0x7f695c06d360 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f697c1f6a60 0x7f697c0c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f697c0c9140 0x7f697c0c62e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 --2- 172.21.15.93:0/18127716 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f69680047c0 0x7f697c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 >> 172.21.15.93:0/18127716 conn(0x7f697c0cbc90 msgr2=0x7f697c160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 shutdown_connections 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.617+0000 7f6980c10640 1 -- 172.21.15.93:0/18127716 wait complete. 2023-11-04T01:40:50.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:50.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.726+0000 7f7572eaf640 1 Processor -- start 2023-11-04T01:40:50.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.726+0000 7f7572eaf640 1 -- start start 2023-11-04T01:40:50.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f7572eaf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f756c0b0ae0 0x7f756c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f7572eaf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 0x7f756c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f7572eaf640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0b4110 con 0x7f756c159c70 2023-11-04T01:40:50.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f7572eaf640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c0b49b0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f7572eaf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0b43f0 con 0x7f756c06db20 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f756c0b0ae0 0x7f756c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f756c0b0ae0 0x7f756c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52576/0 (socket says 172.21.15.93:52576) 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 -- 172.21.15.93:0/1785797135 learned_addr learned my addr 172.21.15.93:0/1785797135 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f757144c640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 0x7f756c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 -- 172.21.15.93:0/1785797135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 msgr2=0x7f756c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 0x7f756c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 -- 172.21.15.93:0/1785797135 >> v1:172.21.15.125:6789/0 conn(0x7f756c159c70 legacy=0x7f756c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f756bfff640 1 -- 172.21.15.93:0/1785797135 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0b46d0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.727+0000 7f757144c640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 0x7f756c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.728+0000 7f756bfff640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0ce370 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7558009870 tx=0x7f755802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a170549f2869ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.728+0000 7f756b7fe640 1 -- 172.21.15.93:0/1785797135 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558031640 con 0x7f756c0b0ae0 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.728+0000 7f756b7fe640 1 -- 172.21.15.93:0/1785797135 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75580317a0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.728+0000 7f756b7fe640 1 -- 172.21.15.93:0/1785797135 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558031b30 con 0x7f756c0b0ae0 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 -- 172.21.15.93:0/1785797135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 msgr2=0x7f756c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0ce370 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7558009870 tx=0x7f755802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 -- 172.21.15.93:0/1785797135 shutdown_connections 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c06db20 0x7f756c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 --2- 172.21.15.93:0/1785797135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0ce370 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 -- 172.21.15.93:0/1785797135 >> 172.21.15.93:0/1785797135 conn(0x7f756c0ce950 msgr2=0x7f756c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 -- 172.21.15.93:0/1785797135 shutdown_connections 2023-11-04T01:40:50.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.729+0000 7f7572eaf640 1 -- 172.21.15.93:0/1785797135 wait complete. 2023-11-04T01:40:50.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.730+0000 7f7572eaf640 1 Processor -- start 2023-11-04T01:40:50.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.730+0000 7f7572eaf640 1 -- start start 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f756c06db20 0x7f756c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c159c70 0x7f756c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0ae710 con 0x7f756c0b0ae0 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0ae9b0 con 0x7f756c06db20 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7572eaf640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0aec90 con 0x7f756c159c70 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52588/0 (socket says 172.21.15.93:52588) 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 -- 172.21.15.93:0/2218372762 learned_addr learned my addr 172.21.15.93:0/2218372762 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f757144c640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c159c70 0x7f756c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f7570c4b640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f756c06db20 0x7f756c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 -- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c159c70 msgr2=0x7f756c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c159c70 0x7f756c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 -- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f756c06db20 msgr2=0x7f756c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f756c06db20 0x7f756c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.731+0000 7f756bfff640 1 -- 172.21.15.93:0/2218372762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580094d0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f756bfff640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c00 tx=0x7f75580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755803ac60 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755803ade0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c0aef70 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558044630 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.732+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c0b4af0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.733+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c0b4ce0 con 0x7f756c0b0ae0 2023-11-04T01:40:50.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.733+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f755802f050 con 0x7f756c0b0ae0 2023-11-04T01:40:50.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.733+0000 7f75697fa640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 0x7f755006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.734+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f75580abe60 con 0x7f756c0b0ae0 2023-11-04T01:40:50.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.734+0000 7f7570c4b640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 0x7f755006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.734+0000 7f7570c4b640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 0x7f755006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.738+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7558076830 con 0x7f756c0b0ae0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.938+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f756c074290 con 0x7f756c0b0ae0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.938+0000 7f75697fa640 1 -- 172.21.15.93:0/2218372762 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7558035090 con 0x7f756c0b0ae0 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:46.922345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 72 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 msgr2=0x7f755006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 0x7f755006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7560006fd0 tx=0x7f7560008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 msgr2=0x7f756c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c00 tx=0x7f75580046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 shutdown_connections 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f755006ae70 0x7f755006d330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f756c159c70 0x7f756c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f756c0b0ae0 0x7f756c0c5c00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 --2- 172.21.15.93:0/2218372762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f756c06db20 0x7f756c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 >> 172.21.15.93:0/2218372762 conn(0x7f756c0ce950 msgr2=0x7f756c0706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 shutdown_connections 2023-11-04T01:40:50.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:50.940+0000 7f7572eaf640 1 -- 172.21.15.93:0/2218372762 wait complete. 2023-11-04T01:40:50.952 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:40:51.074 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:36.445011+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:01.677855+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:40:26.858287+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:51.074 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:36.445011+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:01.677855+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:40:26.858287+0000" } ] } 2023-11-04T01:40:51.075 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:51.075 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:40:51.075 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.173+0000 7f5a2fae1640 1 Processor -- start 2023-11-04T01:40:51.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.173+0000 7f5a2fae1640 1 -- start start 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2fae1640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a280b0ae0 0x7f5a280ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2fae1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280b4110 con 0x7f5a28159c70 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2fae1640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280b43f0 con 0x7f5a2806db20 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2fae1640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280b49b0 con 0x7f5a280b0ae0 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2d87d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5a28159c70 0x7f5a280b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39774/0 (socket says 172.21.15.93:39774) 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.174+0000 7f5a2d87d640 1 -- 172.21.15.93:0/1333735611 learned_addr learned my addr 172.21.15.93:0/1333735611 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/1333735611 >> v2:172.21.15.125:3300/0 conn(0x7f5a280b0ae0 0x7f5a280ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250803072 0 0) 0x7f5a280b4110 con 0x7f5a28159c70 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a14003520 con 0x7f5a28159c70 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927986067 0 0) 0x7f5a14003520 con 0x7f5a28159c70 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 >> v2:172.21.15.125:3300/0 conn(0x7f5a280b0ae0 msgr2=0x7f5a280ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 --2- 172.21.15.93:0/1333735611 >> v2:172.21.15.125:3300/0 conn(0x7f5a280b0ae0 0x7f5a280ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 >> v1:172.21.15.125:6789/0 conn(0x7f5a2806db20 legacy=0x7f5a2815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280b46d0 con 0x7f5a28159c70 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5a240019f0 con 0x7f5a28159c70 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 >> v1:172.21.15.93:6789/0 conn(0x7f5a28159c70 legacy=0x7f5a280b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14003970 0x7f5a14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 0x7f5a14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a14005180 0x7f5a1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280b49b0 con 0x7f5a140047c0 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1400c020 con 0x7f5a14003970 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1400c1e0 con 0x7f5a14005180 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 0x7f5a14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d87d640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14003970 0x7f5a14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2e07e640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a14005180 0x7f5a1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 -- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a14005180 msgr2=0x7f5a1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a14005180 0x7f5a1400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 -- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14003970 msgr2=0x7f5a14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14003970 0x7f5a14003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2d07c640 1 -- 172.21.15.93:0/1333735611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14003520 con 0x7f5a140047c0 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.175+0000 7f5a2e07e640 1 -- 172.21.15.93:0/1333735611 reap_dead start 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.176+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 0x7f5a14004c40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009ac0 tx=0x7f5a140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53321049aacfadae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.176+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1802c6b0 con 0x7f5a140047c0 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.176+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1802c810 con 0x7f5a140047c0 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.176+0000 7f5a2c87b640 1 -- 172.21.15.93:0/1333735611 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1802cba0 con 0x7f5a140047c0 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 -- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 msgr2=0x7f5a14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 0x7f5a14004c40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009ac0 tx=0x7f5a140057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 -- 172.21.15.93:0/1333735611 shutdown_connections 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/1333735611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a140047c0 0x7f5a14004c40 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 -- 172.21.15.93:0/1333735611 >> 172.21.15.93:0/1333735611 conn(0x7f5a280ce950 msgr2=0x7f5a280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 -- 172.21.15.93:0/1333735611 shutdown_connections 2023-11-04T01:40:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.177+0000 7f5a2fae1640 1 -- 172.21.15.93:0/1333735611 wait complete. 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.178+0000 7f5a2fae1640 1 Processor -- start 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.178+0000 7f5a2fae1640 1 -- start start 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a140047c0 0x7f5a28146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a28169960 0x7f5a2814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281496d0 con 0x7f5a281694e0 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281499b0 con 0x7f5a28169960 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28149c90 con 0x7f5a140047c0 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52598/0 (socket says 172.21.15.93:52598) 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 -- 172.21.15.93:0/2828320104 learned_addr learned my addr 172.21.15.93:0/2828320104 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d87d640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a140047c0 0x7f5a28146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2e07e640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a28169960 0x7f5a2814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 -- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a140047c0 msgr2=0x7f5a28146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a140047c0 0x7f5a28146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 -- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a28169960 msgr2=0x7f5a2814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a28169960 0x7f5a2814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 -- 172.21.15.93:0/2828320104 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28149f70 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2d07c640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5a1802c250 tx=0x7f5a18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18003810 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18003970 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18003d00 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2815a230 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.179+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2814a3d0 con 0x7f5a281694e0 2023-11-04T01:40:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.180+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2815a3c0 con 0x7f5a281694e0 2023-11-04T01:40:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.181+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a18034440 con 0x7f5a281694e0 2023-11-04T01:40:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.181+0000 7f5a1e7fc640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 0x7f5a0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.181+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f5a180abc30 con 0x7f5a281694e0 2023-11-04T01:40:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.181+0000 7f5a2d87d640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 0x7f5a0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.182+0000 7f5a2d87d640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 0x7f5a0c06d360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a280687c0 tx=0x7f5a24006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.185+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a18076880 con 0x7f5a281694e0 2023-11-04T01:40:51.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.386+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a28074290 con 0x7f5a281694e0 2023-11-04T01:40:51.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.387+0000 7f5a1e7fc640 1 -- 172.21.15.93:0/2828320104 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f5a18003e60 con 0x7f5a281694e0 2023-11-04T01:40:51.389 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:51.389 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:46.922345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:51.389 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 72 2023-11-04T01:40:51.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 msgr2=0x7f5a0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 0x7f5a0c06d360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a280687c0 tx=0x7f5a24006040 comp rx=0 tx=0).stop 2023-11-04T01:40:51.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 msgr2=0x7f5a2814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5a1802c250 tx=0x7f5a18004730 comp rx=0 tx=0).stop 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 shutdown_connections 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a0c06aea0 0x7f5a0c06d360 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a28169960 0x7f5a2814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a281694e0 0x7f5a2814b940 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 --2- 172.21.15.93:0/2828320104 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a140047c0 0x7f5a28146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 >> 172.21.15.93:0/2828320104 conn(0x7f5a280ce950 msgr2=0x7f5a280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 shutdown_connections 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.389+0000 7f5a2fae1640 1 -- 172.21.15.93:0/2828320104 wait complete. 2023-11-04T01:40:51.401 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:51.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.500+0000 7f4325525640 1 Processor -- start 2023-11-04T01:40:51.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.500+0000 7f4325525640 1 -- start start 2023-11-04T01:40:51.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f4325525640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43200cd6d0 0x7f4320161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f4325525640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200cde60 con 0x7f43200b4880 2023-11-04T01:40:51.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f4325525640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4320160f90 con 0x7f4320153e60 2023-11-04T01:40:51.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f4325525640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4320161960 con 0x7f43200cd6d0 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f431f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f43200b4880 0x7f43200d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39050/0 (socket says 172.21.15.93:39050) 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f431f7fe640 1 -- 172.21.15.93:0/3055570933 learned_addr learned my addr 172.21.15.93:0/3055570933 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.501+0000 7f431e7fc640 1 --2- 172.21.15.93:0/3055570933 >> v2:172.21.15.125:3300/0 conn(0x7f43200cd6d0 0x7f4320161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431dffb640 1 -- 172.21.15.93:0/3055570933 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135520318 0 0) 0x7f43200cde60 con 0x7f43200b4880 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431dffb640 1 -- 172.21.15.93:0/3055570933 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4308003520 con 0x7f43200b4880 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431e7fc640 1 -- 172.21.15.93:0/3055570933 >> v1:172.21.15.125:6789/0 conn(0x7f4320153e60 legacy=0x7f432015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431e7fc640 1 -- 172.21.15.93:0/3055570933 >> v1:172.21.15.93:6789/0 conn(0x7f43200b4880 legacy=0x7f43200d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431e7fc640 1 -- 172.21.15.93:0/3055570933 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200ce090 con 0x7f43200cd6d0 2023-11-04T01:40:51.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.502+0000 7f431e7fc640 1 --2- 172.21.15.93:0/3055570933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f4320161420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43140097a0 tx=0x7f431402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab179b628980ce3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f431dffb640 1 -- 172.21.15.93:0/3055570933 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314030610 con 0x7f43200cd6d0 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f431dffb640 1 -- 172.21.15.93:0/3055570933 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314030770 con 0x7f43200cd6d0 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f431dffb640 1 -- 172.21.15.93:0/3055570933 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314030b00 con 0x7f43200cd6d0 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 -- 172.21.15.93:0/3055570933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 msgr2=0x7f4320161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 --2- 172.21.15.93:0/3055570933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f4320161420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43140097a0 tx=0x7f431402b960 comp rx=0 tx=0).stop 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 -- 172.21.15.93:0/3055570933 shutdown_connections 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 --2- 172.21.15.93:0/3055570933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f4320161420 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 -- 172.21.15.93:0/3055570933 >> 172.21.15.93:0/3055570933 conn(0x7f43200cf880 msgr2=0x7f43200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 -- 172.21.15.93:0/3055570933 shutdown_connections 2023-11-04T01:40:51.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.503+0000 7f4325525640 1 -- 172.21.15.93:0/3055570933 wait complete. 2023-11-04T01:40:51.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.504+0000 7f4325525640 1 Processor -- start 2023-11-04T01:40:51.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 -- start start 2023-11-04T01:40:51.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f43201599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4320153e60 0x7f4320159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4320142f30 con 0x7f43200b4880 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432015a440 con 0x7f43200cd6d0 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f4325525640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432015a6d0 con 0x7f4320153e60 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f431effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f431effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41748/0 (socket says 172.21.15.93:41748) 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f431effd640 1 -- 172.21.15.93:0/2260070461 learned_addr learned my addr 172.21.15.93:0/2260070461 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:51.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f431e7fc640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f43201599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.505+0000 7f431f7fe640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4320153e60 0x7f4320159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 -- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4320153e60 msgr2=0x7f4320159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4320153e60 0x7f4320159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 -- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 msgr2=0x7f43201599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f43201599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 -- 172.21.15.93:0/2260070461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4314009400 con 0x7f43200b4880 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f431effd640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f431000c730 tx=0x7f431000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310003b70 con 0x7f43200b4880 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310003cf0 con 0x7f43200b4880 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432015a9b0 con 0x7f43200b4880 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310003ea0 con 0x7f43200b4880 2023-11-04T01:40:51.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.506+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4320143460 con 0x7f43200b4880 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.507+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320074290 con 0x7f43200b4880 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.507+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f431000aa90 con 0x7f43200b4880 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.508+0000 7f43077fe640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 0x7f430c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.508+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f4310089940 con 0x7f43200b4880 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.508+0000 7f431e7fc640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 0x7f430c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.508+0000 7f431e7fc640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 0x7f430c06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4314036000 tx=0x7f4314008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.512+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4310054470 con 0x7f43200b4880 2023-11-04T01:40:51.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.746+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f43200ce340 con 0x7f43200b4880 2023-11-04T01:40:51.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.936+0000 7f43077fe640 1 -- 172.21.15.93:0/2260070461 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.5969 v73) v1 ==== 112+0+0 (secure 0 0 0) 0x7f4310057a90 con 0x7f43200b4880 2023-11-04T01:40:51.937 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.5969 2023-11-04T01:40:51.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 msgr2=0x7f430c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 0x7f430c06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4314036000 tx=0x7f4314008030 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 msgr2=0x7f43201e8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f431000c730 tx=0x7f431000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 shutdown_connections 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f430c06ae70 0x7f430c06d330 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4320153e60 0x7f4320159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43200cd6d0 0x7f43201599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 --2- 172.21.15.93:0/2260070461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43200b4880 0x7f43201e8160 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 >> 172.21.15.93:0/2260070461 conn(0x7f43200cf880 msgr2=0x7f43200d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 shutdown_connections 2023-11-04T01:40:51.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:51.938+0000 7f4325525640 1 -- 172.21.15.93:0/2260070461 wait complete. 2023-11-04T01:40:51.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:40:52.077 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:40:52.078 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:40:52.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:52.078 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:40:52.081 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:52.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:52.144 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:52.207 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:52.207 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:52.208 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:52.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.346+0000 7fde27afc640 1 Processor -- start 2023-11-04T01:40:52.348 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 -- start start 2023-11-04T01:40:52.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fde20159c70 0x7fde200ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde2006db20 0x7fde200b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200b4110 con 0x7fde200b0910 2023-11-04T01:40:52.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200b49b0 con 0x7fde20159c70 2023-11-04T01:40:52.349 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.347+0000 7fde27afc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde200b0da0 con 0x7fde2006db20 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fde20159c70 0x7fde200ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fde20159c70 0x7fde200ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41764/0 (socket says 172.21.15.93:41764) 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 -- 172.21.15.93:0/152056588 learned_addr learned my addr 172.21.15.93:0/152056588 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 -- 172.21.15.93:0/152056588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde2006db20 msgr2=0x7fde200b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25097640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde2006db20 0x7fde200b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde2006db20 0x7fde200b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 -- 172.21.15.93:0/152056588 >> v1:172.21.15.125:6789/0 conn(0x7fde200b0910 legacy=0x7fde2015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.348+0000 7fde25898640 1 -- 172.21.15.93:0/152056588 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200b43f0 con 0x7fde20159c70 2023-11-04T01:40:52.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde25898640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde20159c70 0x7fde200ce370 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fde10009870 tx=0x7fde1002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56508d8aabb86a51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde24896640 1 -- 172.21.15.93:0/152056588 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10031640 con 0x7fde20159c70 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde24896640 1 -- 172.21.15.93:0/152056588 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde100317a0 con 0x7fde20159c70 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde24896640 1 -- 172.21.15.93:0/152056588 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10031b30 con 0x7fde20159c70 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 -- 172.21.15.93:0/152056588 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde20159c70 msgr2=0x7fde200ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde20159c70 0x7fde200ce370 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fde10009870 tx=0x7fde1002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 -- 172.21.15.93:0/152056588 shutdown_connections 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde2006db20 0x7fde200b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 --2- 172.21.15.93:0/152056588 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde20159c70 0x7fde200ce370 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 -- 172.21.15.93:0/152056588 >> 172.21.15.93:0/152056588 conn(0x7fde200ce950 msgr2=0x7fde200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 -- 172.21.15.93:0/152056588 shutdown_connections 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.349+0000 7fde27afc640 1 -- 172.21.15.93:0/152056588 wait complete. 2023-11-04T01:40:52.352 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 Processor -- start 2023-11-04T01:40:52.353 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 -- start start 2023-11-04T01:40:52.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 0x7fde20151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde20159c70 0x7fde200c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201f47b0 con 0x7fde2006db20 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200c87b0 con 0x7fde200b0910 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde27afc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde201528d0 con 0x7fde20159c70 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde25898640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde25898640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41780/0 (socket says 172.21.15.93:41780) 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.351+0000 7fde25898640 1 -- 172.21.15.93:0/3557106477 learned_addr learned my addr 172.21.15.93:0/3557106477 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25097640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 0x7fde20151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde26099640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde20159c70 0x7fde200c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 -- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde20159c70 msgr2=0x7fde200c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde20159c70 0x7fde200c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 -- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 msgr2=0x7fde20151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 0x7fde20151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 -- 172.21.15.93:0/3557106477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100094d0 con 0x7fde2006db20 2023-11-04T01:40:52.356 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25097640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 0x7fde20151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde25898640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde10000c00 tx=0x7fde100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1003ac60 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1003ade0 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10044630 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde201f3e10 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.352+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde201f43d0 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.353+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20074290 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.353+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde1002f050 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.354+0000 7fde167fc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 0x7fde0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.354+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fde100abd80 con 0x7fde2006db20 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.354+0000 7fde25097640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 0x7fde0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.357 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.354+0000 7fde25097640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 0x7fde0406d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fde200cdae0 tx=0x7fde1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.359 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.358+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde10076800 con 0x7fde2006db20 2023-11-04T01:40:52.464 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fad72e2c640 time 2023-11-04T01:40:52.463861+0000 2023-11-04T01:40:52.464 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fad7e96efaf] 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.465 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fad72e2c640 time 2023-11-04T01:40:52.463861+0000 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fad7e96efaf] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.466 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7fad72e2c640 thread_name:MR_Finisher 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fad7e054db0] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fad7e0a154c] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fad7e96f009] 2023-11-04T01:40:52.467 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7fad72e2c640 thread_name:MR_Finisher 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fad7e054db0] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fad7e0a154c] 2023-11-04T01:40:52.468 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fad7e96f009] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:52.469 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: -418> 2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: -416> 2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fad72e2c640 time 2023-11-04T01:40:52.463861+0000 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.470 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fad7e96efaf] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7fad72e2c640 thread_name:MR_Finisher 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.471 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fad7e054db0] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fad7e0a154c] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fad7e96f009] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.472 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: -418> 2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: -416> 2023-11-04T01:40:49.685+0000 7fad76633640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fad72e2c640 time 2023-11-04T01:40:52.463861+0000 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.473 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fad7e96efaf] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:40:52.463+0000 7fad72e2c640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:52.474 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7fad72e2c640 thread_name:MR_Finisher 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fad7e054db0] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fad7e0a154c] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fad7e96f009] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fad7e96f16d] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x555faf89c21b] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x555faf8cbbcc] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x555faf8d4b0c] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x555faf8d4c63] 2023-11-04T01:40:52.475 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fad7ea164a5] 2023-11-04T01:40:52.476 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fad7e09f802] 2023-11-04T01:40:52.476 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fad7e03f450] 2023-11-04T01:40:52.476 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:52.476 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:40:52.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.563+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde2006d3f0 con 0x7fde2006db20 2023-11-04T01:40:52.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.563+0000 7fde167fc640 1 -- 172.21.15.93:0/3557106477 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fde10035090 con 0x7fde2006db20 2023-11-04T01:40:52.565 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:52.565 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:51.746973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:52.565 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 73 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.565+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 msgr2=0x7fde0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 0x7fde0406d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fde200cdae0 tx=0x7fde1c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 msgr2=0x7fde201522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde10000c00 tx=0x7fde100046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 shutdown_connections 2023-11-04T01:40:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fde0406ae70 0x7fde0406d330 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fde20159c70 0x7fde200c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde200b0910 0x7fde20151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 --2- 172.21.15.93:0/3557106477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde2006db20 0x7fde201522a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 >> 172.21.15.93:0/3557106477 conn(0x7fde200ce950 msgr2=0x7fde20158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 shutdown_connections 2023-11-04T01:40:52.568 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:52.566+0000 7fde27afc640 1 -- 172.21.15.93:0/3557106477 wait complete. 2023-11-04T01:40:52.577 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:52.798 INFO:tasks.ceph.mds.d.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:53.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:40:57.578 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.688+0000 7f9ecf176640 1 Processor -- start 2023-11-04T01:40:57.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.689+0000 7f9ecf176640 1 -- start start 2023-11-04T01:40:57.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.689+0000 7f9ecf176640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ec80cde60 0x7f9ec815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.689+0000 7f9ecf176640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec815e000 con 0x7f9ec80ce240 2023-11-04T01:40:57.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.689+0000 7f9ecf176640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec815e2e0 con 0x7f9ec815daa0 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.689+0000 7f9ecf176640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec815e5c0 con 0x7f9ec80cde60 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ecd713640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9ec80ce240 0x7f9ec80d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39056/0 (socket says 172.21.15.93:39056) 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ecd713640 1 -- 172.21.15.93:0/48246180 learned_addr learned my addr 172.21.15.93:0/48246180 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9eccf12640 1 --2- 172.21.15.93:0/48246180 >> v2:172.21.15.125:3300/0 conn(0x7f9ec80cde60 0x7f9ec815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236961580 0 0) 0x7f9ec815e000 con 0x7f9ec80ce240 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003520 con 0x7f9ec80ce240 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372620371 0 0) 0x7f9eb0003520 con 0x7f9ec80ce240 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 >> v2:172.21.15.125:3300/0 conn(0x7f9ec80cde60 msgr2=0x7f9ec815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 --2- 172.21.15.93:0/48246180 >> v2:172.21.15.125:3300/0 conn(0x7f9ec80cde60 0x7f9ec815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 >> v1:172.21.15.125:6789/0 conn(0x7f9ec815daa0 legacy=0x7f9ec8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80d1120 con 0x7f9ec80ce240 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f9ec00019f0 con 0x7f9ec80ce240 2023-11-04T01:40:57.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 >> v1:172.21.15.93:6789/0 conn(0x7f9ec80ce240 legacy=0x7f9ec80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 0x7f9eb0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0004370 0x7f9eb0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9eb0005040 0x7f9eb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec815e5c0 con 0x7f9eb0003970 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000bfa0 con 0x7f9eb0005040 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000c160 con 0x7f9eb0004370 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9eccf12640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 0x7f9eb0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ecd713640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9eb0005040 0x7f9eb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.690+0000 7f9ec7fff640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0004370 0x7f9eb0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 -- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0004370 msgr2=0x7f9eb0004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0004370 0x7f9eb0004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 -- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9eb0005040 msgr2=0x7f9eb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9eb0005040 0x7f9eb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 -- 172.21.15.93:0/48246180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0003520 con 0x7f9eb0003970 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9ecd713640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9eb0005040 0x7f9eb000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9ecd713640 1 -- 172.21.15.93:0/48246180 reap_dead start 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9eccf12640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 0x7f9eb0003d50 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009ac0 tx=0x7f9eb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ea0b1c1757375c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb802c6b0 con 0x7f9eb0003970 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb802c810 con 0x7f9eb0003970 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.691+0000 7f9ec77fe640 1 -- 172.21.15.93:0/48246180 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb802cba0 con 0x7f9eb0003970 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 -- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 msgr2=0x7f9eb0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 0x7f9eb0003d50 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009ac0 tx=0x7f9eb00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 -- 172.21.15.93:0/48246180 shutdown_connections 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 --2- 172.21.15.93:0/48246180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eb0003970 0x7f9eb0003d50 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 -- 172.21.15.93:0/48246180 >> 172.21.15.93:0/48246180 conn(0x7f9ec8071f30 msgr2=0x7f9ec80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 -- 172.21.15.93:0/48246180 shutdown_connections 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.692+0000 7f9ecf176640 1 -- 172.21.15.93:0/48246180 wait complete. 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.693+0000 7f9ecf176640 1 Processor -- start 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.693+0000 7f9ecf176640 1 -- start start 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0003970 0x7f9ec814f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ec81e4640 0x7f9ec81e4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c77b0 con 0x7f9ec80b6430 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80b6df0 con 0x7f9ec81e4640 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecf176640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81e4ff0 con 0x7f9eb0003970 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:41794/0 (socket says 172.21.15.93:41794) 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ec7fff640 1 -- 172.21.15.93:0/3399749385 learned_addr learned my addr 172.21.15.93:0/3399749385 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:40:57.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9ecd713640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ec81e4640 0x7f9ec81e4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.694+0000 7f9eccf12640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0003970 0x7f9ec814f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 -- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0003970 msgr2=0x7f9ec814f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0003970 0x7f9ec814f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 -- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ec81e4640 msgr2=0x7f9ec81e4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ec81e4640 0x7f9ec81e4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 -- 172.21.15.93:0/3399749385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec81e5e10 con 0x7f9ec80b6430 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec7fff640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00f7f0 tx=0x7f9ebc00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0050d0 con 0x7f9ec80b6430 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc005250 con 0x7f9ec80b6430 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec81e5290 con 0x7f9ec80b6430 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00d6b0 con 0x7f9ec80b6430 2023-11-04T01:40:57.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.695+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec81e5850 con 0x7f9ec80b6430 2023-11-04T01:40:57.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.696+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec8074290 con 0x7f9ec80b6430 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.697+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ebc00d810 con 0x7f9ec80b6430 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.697+0000 7f9ec57fa640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.697+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f9ebc089b10 con 0x7f9ec80b6430 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.697+0000 7f9eccf12640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.697+0000 7f9eccf12640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 0x7f9eb406d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8036000 tx=0x7f9eb8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.701+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ebc054500 con 0x7f9ec80b6430 2023-11-04T01:40:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.901+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ec80b45d0 con 0x7f9ec80b6430 2023-11-04T01:40:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.902+0000 7f9ec57fa640 1 -- 172.21.15.93:0/3399749385 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f9ebc057b20 con 0x7f9ec80b6430 2023-11-04T01:40:57.903 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:40:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:51.746973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:57.904 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 73 2023-11-04T01:40:57.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 msgr2=0x7f9eb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 0x7f9eb406d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8036000 tx=0x7f9eb8030000 comp rx=0 tx=0).stop 2023-11-04T01:40:57.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 msgr2=0x7f9ec80b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00f7f0 tx=0x7f9ebc00fbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 shutdown_connections 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ec81e4640 0x7f9ec81e4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ec80b6430 0x7f9ec80b68b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 --2- 172.21.15.93:0/3399749385 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9eb0003970 0x7f9ec814f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 >> 172.21.15.93:0/3399749385 conn(0x7f9ec8071f30 msgr2=0x7f9ec815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 shutdown_connections 2023-11-04T01:40:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:40:57.904+0000 7f9ecf176640 1 -- 172.21.15.93:0/3399749385 wait complete. 2023-11-04T01:40:57.916 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:59.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:41:02.917 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:03.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.024+0000 7f3472789640 1 Processor -- start 2023-11-04T01:41:03.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.024+0000 7f3472789640 1 -- start start 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3472789640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 0x7f346c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3472789640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f346c0ce240 0x7f346c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3472789640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c15e000 con 0x7f346c15daa0 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3472789640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c15e5c0 con 0x7f346c0ce240 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3472789640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c15e2e0 con 0x7f346c0cde60 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f3470d26640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f346c0ce240 0x7f346c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f346b7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f346c15daa0 0x7f346c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59544/0 (socket says 172.21.15.93:59544) 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.025+0000 7f346b7fe640 1 -- 172.21.15.93:0/3801986377 learned_addr learned my addr 172.21.15.93:0/3801986377 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:03.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f346bfff640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 0x7f346c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f3470d26640 1 -- 172.21.15.93:0/3801986377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 msgr2=0x7f346c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f3470d26640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 0x7f346c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f3470d26640 1 -- 172.21.15.93:0/3801986377 >> v1:172.21.15.93:6789/0 conn(0x7f346c15daa0 legacy=0x7f346c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f3470d26640 1 -- 172.21.15.93:0/3801986377 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0d1120 con 0x7f346c0ce240 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f346affd640 1 -- 172.21.15.93:0/3801986377 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052968513 0 0) 0x7f346c15e000 con 0x7f346c15daa0 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.026+0000 7f346bfff640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 0x7f346c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3470d26640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0ce240 0x7f346c0d1920 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3464009d90 tx=0x7f346402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479532f98a37b8a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f346affd640 1 -- 172.21.15.93:0/3801986377 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346402cc50 con 0x7f346c0ce240 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f346affd640 1 -- 172.21.15.93:0/3801986377 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346402cdb0 con 0x7f346c0ce240 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f346affd640 1 -- 172.21.15.93:0/3801986377 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464034660 con 0x7f346c0ce240 2023-11-04T01:41:03.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 -- 172.21.15.93:0/3801986377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0ce240 msgr2=0x7f346c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0ce240 0x7f346c0d1920 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3464009d90 tx=0x7f346402bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 -- 172.21.15.93:0/3801986377 shutdown_connections 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0ce240 0x7f346c0d1920 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 --2- 172.21.15.93:0/3801986377 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0cde60 0x7f346c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 -- 172.21.15.93:0/3801986377 >> 172.21.15.93:0/3801986377 conn(0x7f346c071f30 msgr2=0x7f346c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 -- 172.21.15.93:0/3801986377 shutdown_connections 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.027+0000 7f3472789640 1 -- 172.21.15.93:0/3801986377 wait complete. 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.028+0000 7f3472789640 1 Processor -- start 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 -- start start 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 0x7f346c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 0x7f346c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0cd670 con 0x7f346c0cde60 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0ccdd0 con 0x7f346c15daa0 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f3472789640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0cd0b0 con 0x7f346c0ce240 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f346bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f346bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36852/0 (socket says 172.21.15.93:36852) 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.029+0000 7f346bfff640 1 -- 172.21.15.93:0/1805132105 learned_addr learned my addr 172.21.15.93:0/1805132105 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3470d26640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 0x7f346c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346b7fe640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 0x7f346c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 -- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 msgr2=0x7f346c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 0x7f346c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 -- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 msgr2=0x7f346c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 0x7f346c153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 -- 172.21.15.93:0/1805132105 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009a70 con 0x7f346c0cde60 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3470d26640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 0x7f346c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346b7fe640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 0x7f346c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f346bfff640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e7e0 tx=0x7f345c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c004030 con 0x7f346c0cde60 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c004190 con 0x7f346c0cde60 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0cd390 con 0x7f346c0cde60 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c004520 con 0x7f346c0cde60 2023-11-04T01:41:03.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.030+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c0ca430 con 0x7f346c0cde60 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.031+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c074290 con 0x7f346c0cde60 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.032+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f345c00c6d0 con 0x7f346c0cde60 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.032+0000 7f3468ff9640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 0x7f345806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.032+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f345c089900 con 0x7f346c0cde60 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.032+0000 7f346b7fe640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 0x7f345806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.033+0000 7f346b7fe640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 0x7f345806d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f346c0b8720 tx=0x7f3460009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.036+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f345c054380 con 0x7f346c0cde60 2023-11-04T01:41:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.240+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346c0c9780 con 0x7f346c0cde60 2023-11-04T01:41:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.241+0000 7f3468ff9640 1 -- 172.21.15.93:0/1805132105 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f345c0579a0 con 0x7f346c0cde60 2023-11-04T01:41:03.242 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:03.243 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:40:51.746973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:03.243 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 73 2023-11-04T01:41:03.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 msgr2=0x7f345806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 0x7f345806d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f346c0b8720 tx=0x7f3460009040 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 msgr2=0x7f346c1f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e7e0 tx=0x7f345c00eca0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 shutdown_connections 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f345806ae70 0x7f345806d330 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f346c15daa0 0x7f346c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f346c0ce240 0x7f346c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 --2- 172.21.15.93:0/1805132105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f346c0cde60 0x7f346c1f2070 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 >> 172.21.15.93:0/1805132105 conn(0x7f346c071f30 msgr2=0x7f346c0d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 shutdown_connections 2023-11-04T01:41:03.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:03.243+0000 7f3472789640 1 -- 172.21.15.93:0/1805132105 wait complete. 2023-11-04T01:41:03.255 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:06.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-04T01:41:08.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:08.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.366+0000 7ff5f2a10640 1 Processor -- start 2023-11-04T01:41:08.369 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.366+0000 7ff5f2a10640 1 -- start start 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f2a10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec0b42c0 0x7ff5ec0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f2a10640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff5ec0c9c40 0x7ff5ec0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f2a10640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0ca090 con 0x7ff5ec15ad80 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f2a10640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec06cfa0 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f2a10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec06d280 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f0fad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff5ec0c9c40 0x7ff5ec0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5ebfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff5ec15ad80 0x7ff5ec06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59560/0 (socket says 172.21.15.93:59560) 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5ebfff640 1 -- 172.21.15.93:0/1348412517 learned_addr learned my addr 172.21.15.93:0/1348412517 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5eb7fe640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec0b42c0 0x7ff5ec0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f0fad640 1 -- 172.21.15.93:0/1348412517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec0b42c0 msgr2=0x7ff5ec0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f0fad640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec0b42c0 0x7ff5ec0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f0fad640 1 -- 172.21.15.93:0/1348412517 >> v1:172.21.15.93:6789/0 conn(0x7ff5ec15ad80 legacy=0x7ff5ec06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5f0fad640 1 -- 172.21.15.93:0/1348412517 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec06d560 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.367+0000 7ff5eaffd640 1 -- 172.21.15.93:0/1348412517 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743579215 0 0) 0x7ff5dc001110 con 0x7ff5ec15ad80 2023-11-04T01:41:08.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.368+0000 7ff5f0fad640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec0b1a40 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009d90 tx=0x7ff5e402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d97529d9d3d56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.368+0000 7ff5eaffd640 1 -- 172.21.15.93:0/1348412517 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e402cce0 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.368+0000 7ff5eaffd640 1 -- 172.21.15.93:0/1348412517 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e402ce40 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.368+0000 7ff5eaffd640 1 -- 172.21.15.93:0/1348412517 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4034660 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 -- 172.21.15.93:0/1348412517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0c9c40 msgr2=0x7ff5ec0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec0b1a40 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009d90 tx=0x7ff5e402bf30 comp rx=0 tx=0).stop 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 -- 172.21.15.93:0/1348412517 shutdown_connections 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec0b1a40 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/1348412517 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec0b42c0 0x7ff5ec0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 -- 172.21.15.93:0/1348412517 >> 172.21.15.93:0/1348412517 conn(0x7ff5ec0ce950 msgr2=0x7ff5ec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 -- 172.21.15.93:0/1348412517 shutdown_connections 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.369+0000 7ff5f2a10640 1 -- 172.21.15.93:0/1348412517 wait complete. 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.370+0000 7ff5f2a10640 1 Processor -- start 2023-11-04T01:41:08.376 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.370+0000 7ff5f2a10640 1 -- start start 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec15ad80 0x7ff5ec0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec1f0880 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec1574b0 con 0x7ff5ec0c9c40 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f2a10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec15cf30 con 0x7ff5ec15ad80 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36868/0 (socket says 172.21.15.93:36868) 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5ebfff640 1 -- 172.21.15.93:0/3969387465 learned_addr learned my addr 172.21.15.93:0/3969387465 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.371+0000 7ff5f0fad640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec15ad80 0x7ff5ec0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 -- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec15ad80 msgr2=0x7ff5ec0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec15ad80 0x7ff5ec0c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 -- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5ec0c9c40 msgr2=0x7ff5ec15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5eb7fe640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec15c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 -- 172.21.15.93:0/3969387465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4009a70 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5ebfff640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c780 tx=0x7ff5dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0072d0 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc007450 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0047e0 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec15d210 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.372+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec15d7d0 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.373+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec074290 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.373+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5dc004960 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.374+0000 7ff5e8ff9640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 0x7ff5d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.374+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7ff5dc088de0 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.374+0000 7ff5eb7fe640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 0x7ff5d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.374+0000 7ff5eb7fe640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 0x7ff5d806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0006fd0 tx=0x7ff5e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.378+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5dc0537d0 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.579+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5ec0ca090 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.579+0000 7ff5e8ff9640 1 -- 172.21.15.93:0/3969387465 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4986 (secure 0 0 0) 0x7ff5ec0ca090 con 0x7ff5ec0b42c0 2023-11-04T01:41:08.582 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:08.582 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:07.063173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5969,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_5969":{"gid":5969,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.125:6834/4131141051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":4131141051},{"type":"v1","addr":"172.21.15.125:6834","nonce":4131141051}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:07.063172+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:08.582 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 74 2023-11-04T01:41:08.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 msgr2=0x7ff5d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 0x7ff5d806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0006fd0 tx=0x7ff5e0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 msgr2=0x7ff5ec156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c780 tx=0x7ff5dc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 shutdown_connections 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff5d806ae70 0x7ff5d806d330 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff5ec15ad80 0x7ff5ec0c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5ec0c9c40 0x7ff5ec15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 --2- 172.21.15.93:0/3969387465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5ec0b42c0 0x7ff5ec156f70 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 >> 172.21.15.93:0/3969387465 conn(0x7ff5ec0ce950 msgr2=0x7ff5ec0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 shutdown_connections 2023-11-04T01:41:08.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.581+0000 7ff5f2a10640 1 -- 172.21.15.93:0/3969387465 wait complete. 2023-11-04T01:41:08.594 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:08.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:08.624 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:08.626 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:08.626 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:08.701 INFO:teuthology.orchestra.run.smithi125.stdout:1699062052.95925.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:08.703 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062052.95925.core'] 2023-11-04T01:41:08.703 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062052.95925.core, deleting it 2023-11-04T01:41:08.703 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062052.95925.core 2023-11-04T01:41:08.776 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:08.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.874+0000 7f0af02a9640 1 Processor -- start 2023-11-04T01:41:08.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.874+0000 7f0af02a9640 1 -- start start 2023-11-04T01:41:08.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0af02a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0af02a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0af02a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae815aff0 con 0x7f0ae80c48e0 2023-11-04T01:41:08.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0af02a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80c52a0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0af02a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae815a3e0 con 0x7f0ae8159c00 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36880/0 (socket says 172.21.15.93:36880) 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 -- 172.21.15.93:0/2331335217 learned_addr learned my addr 172.21.15.93:0/2331335217 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee045640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 -- 172.21.15.93:0/2331335217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 msgr2=0x7f0ae80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 -- 172.21.15.93:0/2331335217 >> v1:172.21.15.125:6789/0 conn(0x7f0ae80c48e0 legacy=0x7f0ae80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.875+0000 7f0aee846640 1 -- 172.21.15.93:0/2331335217 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae815a6c0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.876+0000 7f0aee846640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800d150 tx=0x7f0ad802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a832649e685771 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.876+0000 7f0aed043640 1 -- 172.21.15.93:0/2331335217 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800b0d0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.876+0000 7f0aed043640 1 -- 172.21.15.93:0/2331335217 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800b230 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.876+0000 7f0aed043640 1 -- 172.21.15.93:0/2331335217 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8009600 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 -- 172.21.15.93:0/2331335217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 msgr2=0x7f0ae80c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800d150 tx=0x7f0ad802e160 comp rx=0 tx=0).stop 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 -- 172.21.15.93:0/2331335217 shutdown_connections 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae80c4d60 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2331335217 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 -- 172.21.15.93:0/2331335217 >> 172.21.15.93:0/2331335217 conn(0x7f0ae80ce950 msgr2=0x7f0ae80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 -- 172.21.15.93:0/2331335217 shutdown_connections 2023-11-04T01:41:08.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.877+0000 7f0af02a9640 1 -- 172.21.15.93:0/2331335217 wait complete. 2023-11-04T01:41:08.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.878+0000 7f0af02a9640 1 Processor -- start 2023-11-04T01:41:08.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.878+0000 7f0af02a9640 1 -- start start 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ae80c48e0 0x7f0ae81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8154ed0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8157650 con 0x7f0ae80c48e0 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0af02a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8157930 con 0x7f0ae8159c00 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36896/0 (socket says 172.21.15.93:36896) 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 -- 172.21.15.93:0/2539078230 learned_addr learned my addr 172.21.15.93:0/2539078230 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aed844640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ae80c48e0 0x7f0ae81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee846640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 -- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 msgr2=0x7f0ae8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 -- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ae80c48e0 msgr2=0x7f0ae81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ae80c48e0 0x7f0ae81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.879+0000 7f0aee045640 1 -- 172.21.15.93:0/2539078230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad800bd40 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0aee045640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000d5f0 tx=0x7f0ae000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00125f0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0012750 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8157c10 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0012b00 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.880+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81581d0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.881+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8158360 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.881+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ae0012c60 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.881+0000 7f0ae6ffd640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 0x7f0ad406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.881+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f0ae0089fd0 con 0x7f0ae80ae1d0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.881+0000 7f0aed844640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 0x7f0ad406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.882+0000 7f0aed844640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 0x7f0ad406d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0ae81e2eb0 tx=0x7f0adc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.888 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:08.886+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ae0054b00 con 0x7f0ae80ae1d0 2023-11-04T01:41:09.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.119+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f0ae8074290 con 0x7f0ae80ae1d0 2023-11-04T01:41:09.123 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.121+0000 7f0ae6ffd640 1 -- 172.21.15.93:0/2539078230 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 5969 v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ae0058120 con 0x7f0ae80ae1d0 2023-11-04T01:41:09.123 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 5969 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 msgr2=0x7f0ad406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 0x7f0ad406d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0ae81e2eb0 tx=0x7f0adc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 msgr2=0x7f0ae8154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000d5f0 tx=0x7f0ae000dab0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 shutdown_connections 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f0ad406ae70 0x7f0ad406d330 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f0ae8159c00 0x7f0ae8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ae80c48e0 0x7f0ae81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 --2- 172.21.15.93:0/2539078230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae80ae1d0 0x7f0ae8154990 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.123+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 >> 172.21.15.93:0/2539078230 conn(0x7f0ae80ce950 msgr2=0x7f0ae80708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.124+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 shutdown_connections 2023-11-04T01:41:09.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.124+0000 7f0af02a9640 1 -- 172.21.15.93:0/2539078230 wait complete. 2023-11-04T01:41:09.137 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:09.137 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:09.137 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:09.137 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:09.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:09.137 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:41:09.137 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:09.138 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:09.140 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:09.140 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:09.219 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:41:09.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.238+0000 7f8da4fce640 1 Processor -- start 2023-11-04T01:41:09.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.238+0000 7f8da4fce640 1 -- start start 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8da4fce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 0x7f8da00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8da4fce640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00b4110 con 0x7f8da006db20 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8da4fce640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00b43f0 con 0x7f8da0159c70 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8da4fce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00b49b0 con 0x7f8da00b0ae0 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d9ed9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8da006db20 0x7f8da015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:59568/0 (socket says 172.21.15.93:59568) 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d9ed9d640 1 -- 172.21.15.93:0/2519297996 learned_addr learned my addr 172.21.15.93:0/2519297996 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d97fff640 1 --2- 172.21.15.93:0/2519297996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 0x7f8da00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842432119 0 0) 0x7f8da00b4110 con 0x7f8da006db20 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d8c003520 con 0x7f8da006db20 2023-11-04T01:41:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727703890 0 0) 0x7f8da00b43f0 con 0x7f8da0159c70 2023-11-04T01:41:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d97fff640 1 -- 172.21.15.93:0/2519297996 >> v1:172.21.15.125:6789/0 conn(0x7f8da0159c70 legacy=0x7f8da00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d97fff640 1 -- 172.21.15.93:0/2519297996 >> v1:172.21.15.93:6789/0 conn(0x7f8da006db20 legacy=0x7f8da015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.239+0000 7f8d97fff640 1 -- 172.21.15.93:0/2519297996 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00b46d0 con 0x7f8da00b0ae0 2023-11-04T01:41:09.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.240+0000 7f8d97fff640 1 --2- 172.21.15.93:0/2519297996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 0x7f8da00ce370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097d0 tx=0x7f8d8802b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae61dbf87c108e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.240+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98001970 con 0x7f8da00b0ae0 2023-11-04T01:41:09.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.240+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8802e050 con 0x7f8da00b0ae0 2023-11-04T01:41:09.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.240+0000 7f8d9dd9b640 1 -- 172.21.15.93:0/2519297996 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88030730 con 0x7f8da00b0ae0 2023-11-04T01:41:09.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 -- 172.21.15.93:0/2519297996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 msgr2=0x7f8da00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 --2- 172.21.15.93:0/2519297996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 0x7f8da00ce370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097d0 tx=0x7f8d8802b730 comp rx=0 tx=0).stop 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 -- 172.21.15.93:0/2519297996 shutdown_connections 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 --2- 172.21.15.93:0/2519297996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da00b0ae0 0x7f8da00ce370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 -- 172.21.15.93:0/2519297996 >> 172.21.15.93:0/2519297996 conn(0x7f8da00ce950 msgr2=0x7f8da00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 -- 172.21.15.93:0/2519297996 shutdown_connections 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.241+0000 7f8da4fce640 1 -- 172.21.15.93:0/2519297996 wait complete. 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.242+0000 7f8da4fce640 1 Processor -- start 2023-11-04T01:41:09.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.242+0000 7f8da4fce640 1 -- start start 2023-11-04T01:41:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da00b0ae0 0x7f8da00ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da0159c70 0x7f8da00add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00ae330 con 0x7f8da006db20 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00ae610 con 0x7f8da00b0ae0 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8da4fce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00ae8f0 con 0x7f8da0159c70 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:36898/0 (socket says 172.21.15.93:36898) 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 -- 172.21.15.93:0/1371816213 learned_addr learned my addr 172.21.15.93:0/1371816213 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9ed9d640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da0159c70 0x7f8da00add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 -- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da0159c70 msgr2=0x7f8da00add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da0159c70 0x7f8da00add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d97fff640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da00b0ae0 0x7f8da00ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 -- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da00b0ae0 msgr2=0x7f8da00ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da00b0ae0 0x7f8da00ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 -- 172.21.15.93:0/1371816213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88009400 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.243+0000 7f8d9e59c640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c520 tx=0x7f8d9000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.244+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900035f0 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.244+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90003750 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.244+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da00aebd0 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.244+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003b20 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.244+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0149240 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.245+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da0074290 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.245+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d90003c80 con 0x7f8da006db20 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.245+0000 7f8d96ffd640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 0x7f8d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.245+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f8d900892d0 con 0x7f8da006db20 2023-11-04T01:41:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.246+0000 7f8d97fff640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 0x7f8d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.246+0000 7f8d97fff640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 0x7f8d8006d330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8d88034000 tx=0x7f8d88008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.250+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d90053cf0 con 0x7f8da006db20 2023-11-04T01:41:09.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.452+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8da01501c0 con 0x7f8da006db20 2023-11-04T01:41:09.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.453+0000 7f8d96ffd640 1 -- 172.21.15.93:0/1371816213 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4143 (secure 0 0 0) 0x7f8d90017090 con 0x7f8da006db20 2023-11-04T01:41:09.455 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:09.455 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:09.125426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:replay","state_seq":1,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:09.455 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 76 2023-11-04T01:41:09.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 msgr2=0x7f8d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 0x7f8d8006d330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8d88034000 tx=0x7f8d88008030 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 msgr2=0x7f8da0148d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c520 tx=0x7f8d9000c9e0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 shutdown_connections 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d8006ae70 0x7f8d8006d330 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8da0159c70 0x7f8da00add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8da00b0ae0 0x7f8da00ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 --2- 172.21.15.93:0/1371816213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8da006db20 0x7f8da0148d00 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 >> 172.21.15.93:0/1371816213 conn(0x7f8da00ce950 msgr2=0x7f8da015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 shutdown_connections 2023-11-04T01:41:09.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:09.455+0000 7f8da4fce640 1 -- 172.21.15.93:0/1371816213 wait complete. 2023-11-04T01:41:09.468 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:13.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:41:14.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:14.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.572+0000 7f03bae4f640 1 Processor -- start 2023-11-04T01:41:14.575 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 -- start start 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 0x7f03b4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03b4157540 0x7f03b40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b415e000 con 0x7f03b40cde60 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b415e5c0 con 0x7f03b4157540 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03bae4f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b415e2e0 con 0x7f03b40ce240 2023-11-04T01:41:14.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.573+0000 7f03b93ec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03b4157540 0x7f03b40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03b4157540 0x7f03b40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37076/0 (socket says 172.21.15.93:37076) 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 -- 172.21.15.93:0/4284273138 learned_addr learned my addr 172.21.15.93:0/4284273138 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b3fff640 1 --2- 172.21.15.93:0/4284273138 >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 0x7f03b4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 -- 172.21.15.93:0/4284273138 >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 msgr2=0x7f03b4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 --2- 172.21.15.93:0/4284273138 >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 0x7f03b4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 -- 172.21.15.93:0/4284273138 >> v1:172.21.15.125:6789/0 conn(0x7f03b40cde60 legacy=0x7f03b415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b93ec640 1 -- 172.21.15.93:0/4284273138 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40d1120 con 0x7f03b4157540 2023-11-04T01:41:14.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.574+0000 7f03b3fff640 1 --2- 172.21.15.93:0/4284273138 >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 0x7f03b4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:14.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03b93ec640 1 --2- 172.21.15.93:0/4284273138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b40d1920 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f03b40cf5f0 tx=0x7f03ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0c988783b22d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03b37fe640 1 -- 172.21.15.93:0/4284273138 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac02ca80 con 0x7f03b4157540 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03b37fe640 1 -- 172.21.15.93:0/4284273138 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac02cbe0 con 0x7f03b4157540 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03b37fe640 1 -- 172.21.15.93:0/4284273138 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0343f0 con 0x7f03b4157540 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 -- 172.21.15.93:0/4284273138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 msgr2=0x7f03b40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 --2- 172.21.15.93:0/4284273138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b40d1920 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f03b40cf5f0 tx=0x7f03ac02bee0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 -- 172.21.15.93:0/4284273138 shutdown_connections 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 --2- 172.21.15.93:0/4284273138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b40d1920 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 --2- 172.21.15.93:0/4284273138 >> v2:172.21.15.125:3300/0 conn(0x7f03b40ce240 0x7f03b4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 -- 172.21.15.93:0/4284273138 >> 172.21.15.93:0/4284273138 conn(0x7f03b4071f30 msgr2=0x7f03b40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 -- 172.21.15.93:0/4284273138 shutdown_connections 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.575+0000 7f03bae4f640 1 -- 172.21.15.93:0/4284273138 wait complete. 2023-11-04T01:41:14.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.576+0000 7f03bae4f640 1 Processor -- start 2023-11-04T01:41:14.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.576+0000 7f03bae4f640 1 -- start start 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03b40cde60 0x7f03b40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b40ce240 0x7f03b40b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4149260 con 0x7f03b4157540 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4159a60 con 0x7f03b40ce240 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03bae4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b41594c0 con 0x7f03b40cde60 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03b93ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03b93ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37078/0 (socket says 172.21.15.93:37078) 2023-11-04T01:41:14.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03b93ec640 1 -- 172.21.15.93:0/3694382477 learned_addr learned my addr 172.21.15.93:0/3694382477 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03b8beb640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03b40cde60 0x7f03b40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.577+0000 7f03b3fff640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b40ce240 0x7f03b40b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 -- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03b40cde60 msgr2=0x7f03b40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03b40cde60 0x7f03b40b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 -- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b40ce240 msgr2=0x7f03b40b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b40ce240 0x7f03b40b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 -- 172.21.15.93:0/3694382477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009b30 con 0x7f03b4157540 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b93ec640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009f40 tx=0x7f03ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac03e450 con 0x7f03b4157540 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac03e5d0 con 0x7f03b4157540 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b41494b0 con 0x7f03b4157540 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac03e980 con 0x7f03b4157540 2023-11-04T01:41:14.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.578+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b4149a70 con 0x7f03b4157540 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.579+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4074290 con 0x7f03b4157540 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.579+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03ac02cd50 con 0x7f03b4157540 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.580+0000 7f03b17fa640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.580+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f03ac0ac4a0 con 0x7f03b4157540 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.580+0000 7f03b8beb640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.580+0000 7f03b8beb640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 0x7f03a006d360 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f03a4006fd0 tx=0x7f03a4009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.584+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03ac076ee0 con 0x7f03b4157540 2023-11-04T01:41:14.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.784+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03b40b4b20 con 0x7f03b4157540 2023-11-04T01:41:14.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.784+0000 7f03b17fa640 1 -- 172.21.15.93:0/3694382477 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f03ac07a500 con 0x7f03b4157540 2023-11-04T01:41:14.787 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:12.145499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:14.787 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 80 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 msgr2=0x7f03a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 0x7f03a006d360 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f03a4006fd0 tx=0x7f03a4009060 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 msgr2=0x7f03b415c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009f40 tx=0x7f03ac004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 shutdown_connections 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b4157540 0x7f03b415c480 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b40ce240 0x7f03b40b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 --2- 172.21.15.93:0/3694382477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03b40cde60 0x7f03b40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 >> 172.21.15.93:0/3694382477 conn(0x7f03b4071f30 msgr2=0x7f03b40d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 shutdown_connections 2023-11-04T01:41:14.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.786+0000 7f03bae4f640 1 -- 172.21.15.93:0/3694382477 wait complete. 2023-11-04T01:41:14.799 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:14.799 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:14.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.896+0000 7f0367ae0640 1 Processor -- start 2023-11-04T01:41:14.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 -- start start 2023-11-04T01:41:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03600cde60 0x7f036015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f036015daa0 0x7f0360157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036015e5c0 con 0x7f03600cde60 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0360157a80 con 0x7f036015daa0 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f0367ae0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036015e000 con 0x7f03600ce240 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.897+0000 7f036587c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03600cde60 0x7f036015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03600cde60 0x7f036015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37094/0 (socket says 172.21.15.93:37094) 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 -- 172.21.15.93:0/891964674 learned_addr learned my addr 172.21.15.93:0/891964674 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036507b640 1 --2- 172.21.15.93:0/891964674 >> v2:172.21.15.125:3300/0 conn(0x7f036015daa0 0x7f0360157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036607d640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 -- 172.21.15.93:0/891964674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 msgr2=0x7f0360157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 -- 172.21.15.93:0/891964674 >> v2:172.21.15.125:3300/0 conn(0x7f036015daa0 msgr2=0x7f0360157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 --2- 172.21.15.93:0/891964674 >> v2:172.21.15.125:3300/0 conn(0x7f036015daa0 0x7f0360157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036587c640 1 -- 172.21.15.93:0/891964674 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036015e2e0 con 0x7f03600cde60 2023-11-04T01:41:14.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.898+0000 7f036607d640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:14.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f036587c640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03600cde60 0x7f036015d560 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f03600cf5f0 tx=0x7f035002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0680ead9dcf50f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f036487a640 1 -- 172.21.15.93:0/891964674 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350031870 con 0x7f03600cde60 2023-11-04T01:41:14.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f036487a640 1 -- 172.21.15.93:0/891964674 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500319d0 con 0x7f03600cde60 2023-11-04T01:41:14.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f036487a640 1 -- 172.21.15.93:0/891964674 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350031d60 con 0x7f03600cde60 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 -- 172.21.15.93:0/891964674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03600cde60 msgr2=0x7f036015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03600cde60 0x7f036015d560 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f03600cf5f0 tx=0x7f035002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 -- 172.21.15.93:0/891964674 shutdown_connections 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 --2- 172.21.15.93:0/891964674 >> v2:172.21.15.125:3300/0 conn(0x7f036015daa0 0x7f0360157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 --2- 172.21.15.93:0/891964674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03600cde60 0x7f036015d560 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 -- 172.21.15.93:0/891964674 >> 172.21.15.93:0/891964674 conn(0x7f0360071f30 msgr2=0x7f03600cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 -- 172.21.15.93:0/891964674 shutdown_connections 2023-11-04T01:41:14.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.899+0000 7f0367ae0640 1 -- 172.21.15.93:0/891964674 wait complete. 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.900+0000 7f0367ae0640 1 Processor -- start 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 -- start start 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03600cde60 0x7f03600b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360159590 con 0x7f036015daa0 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03600b4c80 con 0x7f03600cde60 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f0367ae0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03601584f0 con 0x7f03600ce240 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f036607d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f036607d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37096/0 (socket says 172.21.15.93:37096) 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f036607d640 1 -- 172.21.15.93:0/2804362970 learned_addr learned my addr 172.21.15.93:0/2804362970 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:14.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f036507b640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.901+0000 7f036587c640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03600cde60 0x7f03600b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 -- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 msgr2=0x7f0360157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 -- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03600cde60 msgr2=0x7f03600b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03600cde60 0x7f03600b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 -- 172.21.15.93:0/2804362970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500094d0 con 0x7f036015daa0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f036607d640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f035800ce20 tx=0x7f035800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358003b90 con 0x7f036015daa0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0358003d10 con 0x7f036015daa0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358004260 con 0x7f036015daa0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03601587d0 con 0x7f036015daa0 2023-11-04T01:41:14.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.902+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0360158d90 con 0x7f036015daa0 2023-11-04T01:41:14.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.903+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360074290 con 0x7f036015daa0 2023-11-04T01:41:14.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.903+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03580043c0 con 0x7f036015daa0 2023-11-04T01:41:14.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.904+0000 7f03567fc640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 0x7f034406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.904+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f035808a5d0 con 0x7f036015daa0 2023-11-04T01:41:14.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.904+0000 7f036587c640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 0x7f034406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.909 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.904+0000 7f036587c640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 0x7f034406d360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0350036000 tx=0x7f035003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:14.908+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0358054f60 con 0x7f036015daa0 2023-11-04T01:41:14.922 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:14.922 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:15.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.107+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03600b71e0 con 0x7f036015daa0 2023-11-04T01:41:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.108+0000 7f03567fc640 1 -- 172.21.15.93:0/2804362970 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f0358003e80 con 0x7f036015daa0 2023-11-04T01:41:15.110 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:15.110 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:12.145499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:15.110 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 80 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 msgr2=0x7f034406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 0x7f034406d360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0350036000 tx=0x7f035003c040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 msgr2=0x7f036015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f035800ce20 tx=0x7f035800a710 comp rx=0 tx=0).stop 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 shutdown_connections 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.109+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f034406aea0 0x7f034406d360 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f036015daa0 0x7f036015c640 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03600ce240 0x7f0360157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 --2- 172.21.15.93:0/2804362970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03600cde60 0x7f03600b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 >> 172.21.15.93:0/2804362970 conn(0x7f0360071f30 msgr2=0x7f0360156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 shutdown_connections 2023-11-04T01:41:15.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.110+0000 7f0367ae0640 1 -- 172.21.15.93:0/2804362970 wait complete. 2023-11-04T01:41:15.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:12.877413+0000', 'modified': '2023-11-04T01:41:12.145499+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7920, 'mds_1': 5750}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5750': {'gid': 5750, 'name': 'b', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.125:6835/1185165139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6833', 'nonce': 1185165139}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 1185165139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7920': {'gid': 7920, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.93:6836/3572539978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6834', 'nonce': 3572539978}, {'type': 'v1', 'addr': '172.21.15.93:6836', 'nonce': 3572539978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:15.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:15.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:41:15.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.629+0000 7f1422dc0640 1 Processor -- start 2023-11-04T01:41:15.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.629+0000 7f1422dc0640 1 -- start start 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f1422dc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f141c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f1422dc0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c160990 con 0x7f141c06a830 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f1422dc0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0cc7c0 con 0x7f141c0b1a40 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f1422dc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0cd750 con 0x7f141c1605b0 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f142135d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f141c06a830 0x7f141c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57752/0 (socket says 172.21.15.93:57752) 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f142135d640 1 -- 172.21.15.93:0/1955987996 learned_addr learned my addr 172.21.15.93:0/1955987996 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325876276 0 0) 0x7f141c160990 con 0x7f141c06a830 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c003520 con 0x7f141c06a830 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f1420b5c640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f141c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278174111 0 0) 0x7f140c003520 con 0x7f141c06a830 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 msgr2=0x7f141c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f141c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 >> v1:172.21.15.125:6789/0 conn(0x7f141c0b1a40 legacy=0x7f141c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0cc4e0 con 0x7f141c06a830 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f14140019f0 con 0x7f141c06a830 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 >> v1:172.21.15.93:6789/0 conn(0x7f141c06a830 legacy=0x7f141c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f140c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c003fd0 0x7f140c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f140c004d50 0x7f140c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0cd750 con 0x7f140c004d50 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c00bc60 con 0x7f140c003fd0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c00be20 con 0x7f141c1605b0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.630+0000 7f142135d640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f140c004d50 0x7f140c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f141bfff640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c003fd0 0x7f140c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f1420b5c640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f140c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 -- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 msgr2=0x7f140c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c1605b0 0x7f140c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 -- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c003fd0 msgr2=0x7f140c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f140c003fd0 0x7f140c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 -- 172.21.15.93:0/1955987996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c003520 con 0x7f140c004d50 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.631+0000 7f142135d640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f140c004d50 0x7f140c0051d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f141c0717d0 tx=0x7f140c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d31cb23cb5a80c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140072d0 con 0x7f140c004d50 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141402f070 con 0x7f140c004d50 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f141b7fe640 1 -- 172.21.15.93:0/1955987996 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140076f0 con 0x7f140c004d50 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 -- 172.21.15.93:0/1955987996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f140c004d50 msgr2=0x7f140c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 --2- 172.21.15.93:0/1955987996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f140c004d50 0x7f140c0051d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f141c0717d0 tx=0x7f140c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f142135d640 1 -- 172.21.15.93:0/1955987996 reap_dead start 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 -- 172.21.15.93:0/1955987996 shutdown_connections 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 -- 172.21.15.93:0/1955987996 >> 172.21.15.93:0/1955987996 conn(0x7f141c071820 msgr2=0x7f141c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 -- 172.21.15.93:0/1955987996 shutdown_connections 2023-11-04T01:41:15.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.632+0000 7f1422dc0640 1 -- 172.21.15.93:0/1955987996 wait complete. 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.633+0000 7f1422dc0640 1 Processor -- start 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.633+0000 7f1422dc0640 1 -- start start 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 0x7f141c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c0b5370 0x7f141c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0c9e30 con 0x7f141c0c95f0 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0c9b50 con 0x7f141c0b4f90 2023-11-04T01:41:15.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1422dc0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0aca40 con 0x7f141c0b5370 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f142135d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f142135d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37110/0 (socket says 172.21.15.93:37110) 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f142135d640 1 -- 172.21.15.93:0/2944509624 learned_addr learned my addr 172.21.15.93:0/2944509624 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.634+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 0x7f141c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f141bfff640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c0b5370 0x7f141c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 -- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c0b5370 msgr2=0x7f141c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c0b5370 0x7f141c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 -- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 msgr2=0x7f141c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 0x7f141c14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 -- 172.21.15.93:0/2944509624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0acd20 con 0x7f141c0c95f0 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 0x7f141c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f142135d640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f141402cad0 tx=0x7f141c0b2230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f14197fa640 1 -- 172.21.15.93:0/2944509624 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414044070 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f14197fa640 1 -- 172.21.15.93:0/2944509624 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414001b20 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f14197fa640 1 -- 172.21.15.93:0/2944509624 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140074e0 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0ad000 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.635+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c1f6330 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.637+0000 7f14197fa640 1 -- 172.21.15.93:0/2944509624 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1414031030 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.637+0000 7f14197fa640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 0x7f140006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.637+0000 7f14197fa640 1 -- 172.21.15.93:0/2944509624 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f14140ab8b0 con 0x7f141c0c95f0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.637+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 0x7f140006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.638+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 0x7f140006d360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.638+0000 7f1425a2f740 1 Processor -- start 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.638+0000 7f1425a2f740 1 -- start start 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb83813750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb838435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb83724740 con 0x55cb83813c90 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb837868d0 con 0x55cb83840850 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb83783fc0 con 0x55cb83840c30 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37112/0 (socket says 172.21.15.93:37112) 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 -- 172.21.15.93:0/2789042168 learned_addr learned my addr 172.21.15.93:0/2789042168 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 -- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 msgr2=0x55cb838435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb83813750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb838435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 -- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 msgr2=0x55cb83813750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb83813750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 -- 172.21.15.93:0/2789042168 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb83742ca0 con 0x55cb83813c90 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f1420b5c640 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb83813750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f142135d640 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1414076520 tx=0x7f141407a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213b101a54509ae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f14067fc640 1 -- 172.21.15.93:0/2789042168 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414091070 con 0x55cb83813c90 2023-11-04T01:41:15.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f14067fc640 1 -- 172.21.15.93:0/2789042168 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14140783c0 con 0x55cb83813c90 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.639+0000 7f14067fc640 1 -- 172.21.15.93:0/2789042168 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140011c0 con 0x55cb83813c90 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- 172.21.15.93:0/2789042168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 msgr2=0x55cb83843b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1414076520 tx=0x7f141407a0e0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- 172.21.15.93:0/2789042168 shutdown_connections 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83813c90 0x55cb83843b20 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb838435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 --2- 172.21.15.93:0/2789042168 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb83813750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- 172.21.15.93:0/2789042168 >> 172.21.15.93:0/2789042168 conn(0x55cb83815a60 msgr2=0x55cb8385e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- 172.21.15.93:0/2789042168 shutdown_connections 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- 172.21.15.93:0/2789042168 wait complete. 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.640+0000 7f1425a2f740 1 -- start start 2023-11-04T01:41:15.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 Processor -- start 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83871950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb838345b0 0x55cb83871e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8377f8b0 con 0x55cb83840850 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb83739c80 con 0x55cb838345b0 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.641+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb83739920 con 0x55cb83840c30 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1425a2f740 10 client.0 _ll_register_callbacks cb 0x55cb83491ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37116/0 (socket says 172.21.15.93:37116) 2023-11-04T01:41:15.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 -- 172.21.15.93:0/251922687 learned_addr learned my addr 172.21.15.93:0/251922687 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f142135d640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb838345b0 0x55cb83871e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f141bfff640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83871950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 -- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 msgr2=0x55cb83871950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83871950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 -- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb838345b0 msgr2=0x55cb83871e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb838345b0 0x55cb83871e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 -- 172.21.15.93:0/251922687 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c1f6330 con 0x55cb83840850 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1420b5c640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f14100156e0 tx=0x7f1410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444aac2c73b1d703 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f13fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410014800 con 0x55cb83840850 2023-11-04T01:41:15.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f1410014960 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb8372bbf0 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1410014b20 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1425a2f740 10 client.8061 fetch_fsmap learned FSMap version 80 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x55cb8377df30 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.642+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb8372bbf0 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1410014c80 con 0x55cb83840850 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 10 client.8061 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 10 client.8061 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 20 client.8061 populate_metadata read hostname 'smithi093' 2023-11-04T01:41:15.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb83846d00 0x55cb8387b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 4 client.8061 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:15.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb83778890 con 0x55cb83846d00 2023-11-04T01:41:15.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f141bfff640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb83846d00 0x55cb8387b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f13fb7fe640 10 client.8061 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.643+0000 7f141bfff640 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb83846d00 0x55cb8387b9a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6afdec84dd702370 server_cookie=efc467914fc92ca3 in_seq=0 out_seq=0 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f13fb7fe640 1 -- 172.21.15.93:0/251922687 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb83778890 con 0x55cb83846d00 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f13fb7fe640 10 client.8061 handle_command_reply: tid=0 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 client.8061 shutdown 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 msgr2=0x55cb838327a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f14100156e0 tx=0x7f1410004730 comp rx=0 tx=0).stop 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 shutdown_connections 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb83846d00 0x55cb8387b9a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb838345b0 0x55cb83871e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83871950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.658 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f13fb7fe640 0 client.8061 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:41:15.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 --2- 172.21.15.93:0/251922687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb838327a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 >> 172.21.15.93:0/251922687 conn(0x55cb83813c90 msgr2=0x55cb83862380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 shutdown_connections 2023-11-04T01:41:15.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 1 -- 172.21.15.93:0/251922687 wait complete. 2023-11-04T01:41:15.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.644+0000 7f1425a2f740 20 client.8061 trim_cache size 0 max 16384 2023-11-04T01:41:15.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 Processor -- start 2023-11-04T01:41:15.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 -- start start 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb838184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83818a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb836ff280 con 0x55cb838345b0 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8374b7e0 con 0x55cb83840850 2023-11-04T01:41:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.660+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb83858820 con 0x55cb83840c30 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37120/0 (socket says 172.21.15.93:37120) 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 -- 172.21.15.93:0/646063799 learned_addr learned my addr 172.21.15.93:0/646063799 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f141bfff640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb838184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 -- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 msgr2=0x55cb83818a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f142135d640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83818a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83818a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 -- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 msgr2=0x55cb838184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb838184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 -- 172.21.15.93:0/646063799 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb8371bd10 con 0x55cb838345b0 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f141bfff640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb838184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1420b5c640 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f141000b570 tx=0x7f1410023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f011b37073fa600 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1406ffd640 1 -- 172.21.15.93:0/646063799 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410014a00 con 0x55cb838345b0 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1406ffd640 1 -- 172.21.15.93:0/646063799 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410014b60 con 0x55cb838345b0 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.661+0000 7f1406ffd640 1 -- 172.21.15.93:0/646063799 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100143b0 con 0x55cb838345b0 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- 172.21.15.93:0/646063799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 msgr2=0x55cb8383ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f141000b570 tx=0x7f1410023000 comp rx=0 tx=0).stop 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- 172.21.15.93:0/646063799 shutdown_connections 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb83840c30 0x55cb83818a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840850 0x55cb838184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 --2- 172.21.15.93:0/646063799 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb838345b0 0x55cb8383ebd0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- 172.21.15.93:0/646063799 >> 172.21.15.93:0/646063799 conn(0x55cb83813c90 msgr2=0x55cb8383f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- 172.21.15.93:0/646063799 shutdown_connections 2023-11-04T01:41:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- 172.21.15.93:0/646063799 wait complete. 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 -- start start 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.662+0000 7f1425a2f740 1 Processor -- start 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 0x55cb838184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840c30 0x55cb838c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb83831770 con 0x55cb83840850 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8385c2a0 con 0x55cb83840c30 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb83818a30 con 0x55cb838345b0 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1425a2f740 10 client.0 _ll_register_callbacks cb 0x7f1414079df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f141bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f141bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37122/0 (socket says 172.21.15.93:37122) 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f141bfff640 1 -- 172.21.15.93:0/3153172259 learned_addr learned my addr 172.21.15.93:0/3153172259 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f1420b5c640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 0x55cb838184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.663+0000 7f142135d640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840c30 0x55cb838c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 -- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 msgr2=0x55cb838184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 0x55cb838184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 -- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840c30 msgr2=0x55cb838c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840c30 0x55cb838c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 -- 172.21.15.93:0/3153172259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb8377df30 con 0x55cb83840850 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1420b5c640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 0x55cb838184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f141bfff640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x55cb83841590 tx=0x7f140801a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f818ff7881f852f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408004fa0 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f1408016420 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14140783c0 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14080165e0 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 10 client.8067 fetch_fsmap learned FSMap version 80 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x55cb83741500 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14140783c0 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1408016740 con 0x55cb83840850 2023-11-04T01:41:15.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 10 client.8067 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 10 client.8067 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 20 client.8067 populate_metadata read hostname 'smithi093' 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb838309d0 0x55cb83830db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 4 client.8067 mds_command: new command op to 5750 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 --> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb837785b0 con 0x55cb838309d0 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.664+0000 7f1420b5c640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb838309d0 0x55cb83830db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f13fb7fe640 10 client.8067 ms_handle_connect on v2:172.21.15.125:6833/1185165139 2023-11-04T01:41:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1420b5c640 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb838309d0 0x55cb83830db0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af417bc02b43c675 server_cookie=95319f3f84d7eb6f in_seq=0 out_seq=0 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f13fb7fe640 1 -- 172.21.15.93:0/3153172259 <== mds.1 v2:172.21.15.125:6833/1185165139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55cb837785b0 con 0x55cb838309d0 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f13fb7fe640 10 client.8067 handle_command_reply: tid=0 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 client.8067 shutdown 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 msgr2=0x55cb8387ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x55cb83841590 tx=0x7f140801a920 comp rx=0 tx=0).stop 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 shutdown_connections 2023-11-04T01:41:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:6833/1185165139,v1:172.21.15.125:6835/1185165139] conn(0x55cb838309d0 0x55cb83830db0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cb83840c30 0x55cb838c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cb83840850 0x55cb8387ff60 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f13fb7fe640 0 client.8067 ms_handle_reset on v2:172.21.15.125:6833/1185165139 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 --2- 172.21.15.93:0/3153172259 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55cb838345b0 0x55cb838184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 >> 172.21.15.93:0/3153172259 conn(0x55cb83813c90 msgr2=0x55cb838475d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 shutdown_connections 2023-11-04T01:41:15.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.665+0000 7f1425a2f740 1 -- 172.21.15.93:0/3153172259 wait complete. 2023-11-04T01:41:15.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1425a2f740 20 client.8067 trim_cache size 0 max 16384 2023-11-04T01:41:15.678 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:41:15.678 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 1, 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 5750, 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:41:15.679 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 113.62258091699999, 2023-11-04T01:41:15.680 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 80, 2023-11-04T01:41:15.680 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:15.680 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:15.681 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 128.20990356900001 2023-11-04T01:41:15.681 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:41:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 msgr2=0x7f140006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 0x7f140006d360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 msgr2=0x7f141c1f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f141402cad0 tx=0x7f141c0b2230 comp rx=0 tx=0).stop 2023-11-04T01:41:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 shutdown_connections 2023-11-04T01:41:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f140006aea0 0x7f140006d360 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f141c0c95f0 0x7f141c1f5df0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f141c0b5370 0x7f141c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 --2- 172.21.15.93:0/2944509624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0b4f90 0x7f141c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 >> 172.21.15.93:0/2944509624 conn(0x7f141c071820 msgr2=0x7f141c0cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 shutdown_connections 2023-11-04T01:41:15.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.666+0000 7f1422dc0640 1 -- 172.21.15.93:0/2944509624 wait complete. 2023-11-04T01:41:15.686 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:15.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.783+0000 7f7900ba9640 1 Processor -- start 2023-11-04T01:41:15.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.783+0000 7f7900ba9640 1 -- start start 2023-11-04T01:41:15.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f7900ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 0x7f78fc0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f7900ba9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78fc0ca0a0 0x7f78fc0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f7900ba9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0caa20 con 0x7f78fc0cc300 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f7900ba9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0cb230 con 0x7f78fc0ca0a0 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f7900ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0ca530 con 0x7f78fc15e3f0 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f78f9d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78fc0ca0a0 0x7f78fc0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f78f9d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78fc0ca0a0 0x7f78fc0cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37134/0 (socket says 172.21.15.93:37134) 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.784+0000 7f78f9d9b640 1 -- 172.21.15.93:0/2374128490 learned_addr learned my addr 172.21.15.93:0/2374128490 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78fa59c640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 0x7f78fc0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f9d9b640 1 -- 172.21.15.93:0/2374128490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 msgr2=0x7f78fc0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 0x7f78fc0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f9d9b640 1 -- 172.21.15.93:0/2374128490 >> v1:172.21.15.125:6789/0 conn(0x7f78fc0cc300 legacy=0x7f78fc0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.788 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f9d9b640 1 -- 172.21.15.93:0/2374128490 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0cac70 con 0x7f78fc0ca0a0 2023-11-04T01:41:15.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78fa59c640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 0x7f78fc0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ca0a0 0x7f78fc0cc920 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe5fe7329b27353 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.785+0000 7f78f959a640 1 -- 172.21.15.93:0/2374128490 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0031640 con 0x7f78fc0ca0a0 2023-11-04T01:41:15.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f78f959a640 1 -- 172.21.15.93:0/2374128490 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f00317a0 con 0x7f78fc0ca0a0 2023-11-04T01:41:15.789 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f78f959a640 1 -- 172.21.15.93:0/2374128490 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0031b30 con 0x7f78fc0ca0a0 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 -- 172.21.15.93:0/2374128490 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ca0a0 msgr2=0x7f78fc0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ca0a0 0x7f78fc0cc920 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 -- 172.21.15.93:0/2374128490 shutdown_connections 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ca0a0 0x7f78fc0cc920 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 --2- 172.21.15.93:0/2374128490 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc15e3f0 0x7f78fc0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 -- 172.21.15.93:0/2374128490 >> 172.21.15.93:0/2374128490 conn(0x7f78fc071820 msgr2=0x7f78fc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 -- 172.21.15.93:0/2374128490 shutdown_connections 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.786+0000 7f7900ba9640 1 -- 172.21.15.93:0/2374128490 wait complete. 2023-11-04T01:41:15.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.787+0000 7f7900ba9640 1 Processor -- start 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.787+0000 7f7900ba9640 1 -- start start 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc15e3f0 0x7f78fc0c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 0x7f78fc1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1512a0 con 0x7f78fc0cc300 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c8750 con 0x7f78fc15e3f0 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f7900ba9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c8a30 con 0x7f78fc0c8250 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37150/0 (socket says 172.21.15.93:37150) 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f78fa59c640 1 -- 172.21.15.93:0/1324325086 learned_addr learned my addr 172.21.15.93:0/1324325086 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc15e3f0 0x7f78fc0c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.788+0000 7f78fad9d640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 0x7f78fc1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 -- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 msgr2=0x7f78fc1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 0x7f78fc1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 -- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc15e3f0 msgr2=0x7f78fc0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc15e3f0 0x7f78fc0c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 -- 172.21.15.93:0/1324325086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00094d0 con 0x7f78fc0cc300 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fad9d640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 0x7f78fc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78fa59c640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00ce00 tx=0x7f78ec00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78eaffd640 1 -- 172.21.15.93:0/1324325086 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00f890 con 0x7f78fc0cc300 2023-11-04T01:41:15.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78eaffd640 1 -- 172.21.15.93:0/1324325086 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00f9f0 con 0x7f78fc0cc300 2023-11-04T01:41:15.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0c8d10 con 0x7f78fc0cc300 2023-11-04T01:41:15.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f78eaffd640 1 -- 172.21.15.93:0/1324325086 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00fdc0 con 0x7f78fc0cc300 2023-11-04T01:41:15.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.789+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0c92d0 con 0x7f78fc0cc300 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.790+0000 7f78eaffd640 1 -- 172.21.15.93:0/1324325086 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78ec00b040 con 0x7f78fc0cc300 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.791+0000 7f78eaffd640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 0x7f78dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.791+0000 7f78eaffd640 1 -- 172.21.15.93:0/1324325086 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f78ec08a770 con 0x7f78fc0cc300 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.791+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 0x7f78dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.791+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 0x7f78dc06d360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f78f0036000 tx=0x7f78f003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.792+0000 7f7903812740 1 Processor -- start 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.792+0000 7f7903812740 1 -- start start 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91486f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91483fc90 0x55a91486fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a914750740 con 0x55a91486c850 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9147b28d0 con 0x55a91486cc30 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9147affc0 con 0x55a91483fc90 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37160/0 (socket says 172.21.15.93:37160) 2023-11-04T01:41:15.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 -- 172.21.15.93:0/3986245788 learned_addr learned my addr 172.21.15.93:0/3986245788 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91486f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 -- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91483fc90 msgr2=0x55a91486fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91483fc90 0x55a91486fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 -- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 msgr2=0x55a91486f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91486f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 -- 172.21.15.93:0/3986245788 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a91476eca0 con 0x55a91486c850 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91486f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f78ec007fd0 tx=0x7f78ec00ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46f24bac7efb973 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78dbfff640 1 -- 172.21.15.93:0/3986245788 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec05ce60 con 0x55a91486c850 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78dbfff640 1 -- 172.21.15.93:0/3986245788 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0610a0 con 0x55a91486c850 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.793+0000 7f78dbfff640 1 -- 172.21.15.93:0/3986245788 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec055420 con 0x55a91486c850 2023-11-04T01:41:15.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 -- 172.21.15.93:0/3986245788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 msgr2=0x55a91483f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f78ec007fd0 tx=0x7f78ec00ae20 comp rx=0 tx=0).stop 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 -- 172.21.15.93:0/3986245788 shutdown_connections 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91483fc90 0x55a91486fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91486f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 --2- 172.21.15.93:0/3986245788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91483f750 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 -- 172.21.15.93:0/3986245788 >> 172.21.15.93:0/3986245788 conn(0x55a914841a60 msgr2=0x55a91488a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 -- 172.21.15.93:0/3986245788 shutdown_connections 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.794+0000 7f7903812740 1 -- 172.21.15.93:0/3986245788 wait complete. 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 -- start start 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 Processor -- start 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91483e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91483ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9147ab8b0 con 0x55a91486c850 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a914765c80 con 0x55a91486cc30 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.795+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a914765920 con 0x55a914884c10 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f7903812740 10 client.0 _ll_register_callbacks cb 0x55a9144bdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37176/0 (socket says 172.21.15.93:37176) 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 -- 172.21.15.93:0/3653077706 learned_addr learned my addr 172.21.15.93:0/3653077706 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91483e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fad9d640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91483ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 -- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 msgr2=0x55a91483ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91483ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 -- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 msgr2=0x55a91483e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91483e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 -- 172.21.15.93:0/3653077706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0c92d0 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fad9d640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91483ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f78ec088530 tx=0x7f78ec007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e88029a6ca83e51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec058200 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f78ec058360 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a914757bf0 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78ec060c10 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f7903812740 10 client.8079 fetch_fsmap learned FSMap version 80 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x55a9147a9f30 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.796+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a914757bf0 con 0x55a91486c850 2023-11-04T01:41:15.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f78ec016020 con 0x55a91486c850 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 10 client.8079 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 10 client.8079 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 20 client.8079 populate_metadata read hostname 'smithi093' 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914872040 0x55a91485be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 4 client.8079 mds_command: new command op to 7920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 --> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9147a4890 con 0x55a914872040 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914872040 0x55a91485be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914872040 0x55a91485be40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ea005f67d8ca8a server_cookie=d707df60af98a219 in_seq=0 out_seq=0 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.797+0000 7f78d97fa640 10 client.8079 ms_handle_connect on v2:172.21.15.93:6834/3572539978 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f78d97fa640 1 -- 172.21.15.93:0/3653077706 <== mds.0 v2:172.21.15.93:6834/3572539978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a9147a4890 con 0x55a914872040 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f78d97fa640 10 client.8079 handle_command_reply: tid=0 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 client.8079 shutdown 2023-11-04T01:41:15.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 msgr2=0x55a91485daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f78ec088530 tx=0x7f78ec007040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 shutdown_connections 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91483ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914872040 0x55a91485be40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486cc30 0x55a91483e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 --2- 172.21.15.93:0/3653077706 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486c850 0x55a91485daa0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f78d97fa640 0 client.8079 ms_handle_reset on v2:172.21.15.93:6834/3572539978 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 >> 172.21.15.93:0/3653077706 conn(0x55a91483fc90 msgr2=0x55a914843890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 shutdown_connections 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 1 -- 172.21.15.93:0/3653077706 wait complete. 2023-11-04T01:41:15.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.798+0000 7f7903812740 20 client.8079 trim_cache size 0 max 16384 2023-11-04T01:41:15.815 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.813+0000 7f7903812740 1 Processor -- start 2023-11-04T01:41:15.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.813+0000 7f7903812740 1 -- start start 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a91483e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91486cc30 0x55a914885750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a91472b280 con 0x55a914884c10 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a91485b400 con 0x55a91486c850 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9147777e0 con 0x55a91486cc30 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37182/0 (socket says 172.21.15.93:37182) 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 -- 172.21.15.93:0/1528027043 learned_addr learned my addr 172.21.15.93:0/1528027043 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fa59c640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a91483e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91486cc30 0x55a914885750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 -- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91486cc30 msgr2=0x55a914885750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91486cc30 0x55a914885750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 -- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 msgr2=0x55a91483e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a91483e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fad9d640 1 -- 172.21.15.93:0/1528027043 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a914747d10 con 0x55a914884c10 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.814+0000 7f78fa59c640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a91483e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f78fad9d640 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f78f4003c00 tx=0x7f78f40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e753980aa59b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f78e8ff9640 1 -- 172.21.15.93:0/1528027043 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4007020 con 0x55a914884c10 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f78e8ff9640 1 -- 172.21.15.93:0/1528027043 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400d040 con 0x55a914884c10 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f78e8ff9640 1 -- 172.21.15.93:0/1528027043 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4007400 con 0x55a914884c10 2023-11-04T01:41:15.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 -- 172.21.15.93:0/1528027043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 msgr2=0x55a9148590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f78f4003c00 tx=0x7f78f40040c0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 -- 172.21.15.93:0/1528027043 shutdown_connections 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a914884c10 0x55a9148590c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a91486cc30 0x55a914885750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 --2- 172.21.15.93:0/1528027043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a91483e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 -- 172.21.15.93:0/1528027043 >> 172.21.15.93:0/1528027043 conn(0x55a91483fc90 msgr2=0x55a914846810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 -- 172.21.15.93:0/1528027043 shutdown_connections 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.815+0000 7f7903812740 1 -- 172.21.15.93:0/1528027043 wait complete. 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.816+0000 7f7903812740 1 -- start start 2023-11-04T01:41:15.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.816+0000 7f7903812740 1 Processor -- start 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a9148f7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91488d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9148f7e70 con 0x55a91486cc30 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a914859f70 con 0x55a91486c850 2023-11-04T01:41:15.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a914880d80 con 0x55a914884c10 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f7903812740 10 client.0 _ll_register_callbacks cb 0x7f78ec007a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37184/0 (socket says 172.21.15.93:37184) 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 -- 172.21.15.93:0/3003658216 learned_addr learned my addr 172.21.15.93:0/3003658216 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a9148f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78fad9d640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91488d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 -- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 msgr2=0x55a91488d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91488d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 -- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 msgr2=0x55a9148f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a9148f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 -- 172.21.15.93:0/3003658216 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f4003860 con 0x55a91486cc30 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78fad9d640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91488d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78f9d9b640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ccc7b0eb630f4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.817+0000 7f78d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0049040 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78ec0610a0 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f78f003f070 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78f0051780 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 10 client.8085 fetch_fsmap learned FSMap version 80 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x55a91476d500 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0610a0 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f78f003a870 con 0x55a91486cc30 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 10 client.8085 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 10 client.8085 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 20 client.8085 populate_metadata read hostname 'smithi093' 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914859200 0x55a9148595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 4 client.8085 mds_command: new command op to 7920 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 --> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9147a45b0 con 0x55a914859200 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914859200 0x55a9148595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 10 client.8085 ms_handle_connect on v2:172.21.15.93:6834/3572539978 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78fa59c640 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914859200 0x55a9148595e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c258d786a3fb7838 server_cookie=e4295c9d1e5cd88e in_seq=0 out_seq=0 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 1 -- 172.21.15.93:0/3003658216 <== mds.0 v2:172.21.15.93:6834/3572539978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a9147a45b0 con 0x55a914859200 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f78d97fa640 10 client.8085 handle_command_reply: tid=0 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.818+0000 7f7903812740 1 client.8085 shutdown 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 msgr2=0x55a91488ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009870 tx=0x7f78f0004730 comp rx=0 tx=0).stop 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 shutdown_connections 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x55a914884c10 0x55a91488d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a91486cc30 0x55a91488ce70 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.93:6834/3572539978,v1:172.21.15.93:6836/3572539978] conn(0x55a914859200 0x55a9148595e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 --2- 172.21.15.93:0/3003658216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a91486c850 0x55a9148f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f78d97fa640 0 client.8085 ms_handle_reset on v2:172.21.15.93:6834/3572539978 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 >> 172.21.15.93:0/3003658216 conn(0x55a91483fc90 msgr2=0x55a91483ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 shutdown_connections 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 1 -- 172.21.15.93:0/3003658216 wait complete. 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7903812740 20 client.8085 trim_cache size 0 max 16384 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stdout: "cluster_fsid": "a91d0b76-a9fc-4383-b1e1-1b6875ba32e4", 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stdout: "whoami": 0, 2023-11-04T01:41:15.828 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 7920, 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "want_state": "up:active", 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "state": "up:active", 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs", 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "rank_uptime": 6.6875648109999997, 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "mdsmap_epoch": 80, 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout: "uptime": 31.816796922000002 2023-11-04T01:41:15.829 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 msgr2=0x7f78dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 0x7f78dc06d360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f78f0036000 tx=0x7f78f003c040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 msgr2=0x7f78fc150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00ce00 tx=0x7f78ec00a650 comp rx=0 tx=0).stop 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 shutdown_connections 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f78dc06aea0 0x7f78dc06d360 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.830 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f78fc0c8250 0x7f78fc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc15e3f0 0x7f78fc0c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 --2- 172.21.15.93:0/1324325086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0cc300 0x7f78fc150d60 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 >> 172.21.15.93:0/1324325086 conn(0x7f78fc071820 msgr2=0x7f78fc15d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 shutdown_connections 2023-11-04T01:41:15.831 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.819+0000 7f7900ba9640 1 -- 172.21.15.93:0/1324325086 wait complete. 2023-11-04T01:41:15.832 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:15.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.928+0000 7fea9e84b640 1 Processor -- start 2023-11-04T01:41:15.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.928+0000 7fea9e84b640 1 -- start start 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.929+0000 7fea9e84b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea9806b670 0x7fea980b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.929+0000 7fea9e84b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980cc040 con 0x7fea98070400 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.929+0000 7fea9e84b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980cc320 con 0x7fea9815cf80 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.929+0000 7fea9e84b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980ce830 con 0x7fea9806b670 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.929+0000 7fea977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea9806b670 0x7fea980b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea9806b670 0x7fea980b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37194/0 (socket says 172.21.15.93:37194) 2023-11-04T01:41:15.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 -- 172.21.15.93:0/3066672548 learned_addr learned my addr 172.21.15.93:0/3066672548 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea9cde8640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fea98070400 0x7fea980cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57768/0 (socket says 172.21.15.93:57768) 2023-11-04T01:41:15.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 -- 172.21.15.93:0/3066672548 >> v1:172.21.15.125:6789/0 conn(0x7fea9815cf80 legacy=0x7fea980cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 -- 172.21.15.93:0/3066672548 >> v1:172.21.15.93:6789/0 conn(0x7fea98070400 legacy=0x7fea980cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 -- 172.21.15.93:0/3066672548 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980cc600 con 0x7fea9806b670 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.930+0000 7fea977fe640 1 --2- 172.21.15.93:0/3066672548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9806b670 0x7fea980b25d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009870 tx=0x7fea8c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e357863000fb1535 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea96ffd640 1 -- 172.21.15.93:0/3066672548 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c030860 con 0x7fea9806b670 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea96ffd640 1 -- 172.21.15.93:0/3066672548 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c0309c0 con 0x7fea9806b670 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea96ffd640 1 -- 172.21.15.93:0/3066672548 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c030d50 con 0x7fea9806b670 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 -- 172.21.15.93:0/3066672548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9806b670 msgr2=0x7fea980b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 --2- 172.21.15.93:0/3066672548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9806b670 0x7fea980b25d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009870 tx=0x7fea8c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 -- 172.21.15.93:0/3066672548 shutdown_connections 2023-11-04T01:41:15.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 --2- 172.21.15.93:0/3066672548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9806b670 0x7fea980b25d0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 -- 172.21.15.93:0/3066672548 >> 172.21.15.93:0/3066672548 conn(0x7fea980d0b50 msgr2=0x7fea980d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 -- 172.21.15.93:0/3066672548 shutdown_connections 2023-11-04T01:41:15.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.931+0000 7fea9e84b640 1 -- 172.21.15.93:0/3066672548 wait complete. 2023-11-04T01:41:15.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.932+0000 7fea9e84b640 1 Processor -- start 2023-11-04T01:41:15.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 -- start start 2023-11-04T01:41:15.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea9806b670 0x7fea98157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 0x7fea980b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980b4c80 con 0x7fea9815cf80 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980b4070 con 0x7fea9806b670 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9e84b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea980b4350 con 0x7fea98070400 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9cde8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9cde8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37196/0 (socket says 172.21.15.93:37196) 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea9cde8640 1 -- 172.21.15.93:0/1354932547 learned_addr learned my addr 172.21.15.93:0/1354932547 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.933+0000 7fea97fff640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea9806b670 0x7fea98157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea977fe640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 0x7fea980b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 -- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 msgr2=0x7fea980b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 0x7fea980b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 -- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea9806b670 msgr2=0x7fea98157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea9806b670 0x7fea98157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 -- 172.21.15.93:0/1354932547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c0094d0 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea977fe640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 0x7fea980b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9cde8640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c730 tx=0x7fea9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000ce40 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000a640 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea980b4630 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000a9f0 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.934+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98157cb0 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.935+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea980b4df0 con 0x7fea9815cf80 2023-11-04T01:41:15.939 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.935+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea9000ab50 con 0x7fea9815cf80 2023-11-04T01:41:15.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.936+0000 7fea94ff9640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 0x7fea8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.936+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fea90089420 con 0x7fea9815cf80 2023-11-04T01:41:15.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.936+0000 7fea97fff640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 0x7fea8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.940 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.936+0000 7fea97fff640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 0x7fea8406d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fea9815c8e0 tx=0x7fea88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:15.940+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea90053e60 con 0x7fea9815cf80 2023-11-04T01:41:16.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.141+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea98074290 con 0x7fea9815cf80 2023-11-04T01:41:16.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.141+0000 7fea94ff9640 1 -- 172.21.15.93:0/1354932547 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fea90057480 con 0x7fea9815cf80 2023-11-04T01:41:16.143 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.144 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:12.145499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:16.144 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 80 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 msgr2=0x7fea8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 0x7fea8406d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fea9815c8e0 tx=0x7fea88009040 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 msgr2=0x7fea980b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c730 tx=0x7fea9000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 shutdown_connections 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea8406ae70 0x7fea8406d330 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea9815cf80 0x7fea980b5de0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea98070400 0x7fea980b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 --2- 172.21.15.93:0/1354932547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea9806b670 0x7fea98157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 >> 172.21.15.93:0/1354932547 conn(0x7fea980d0b50 msgr2=0x7fea980b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 shutdown_connections 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.143+0000 7fea9e84b640 1 -- 172.21.15.93:0/1354932547 wait complete. 2023-11-04T01:41:16.156 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:41:16.268 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:39:36.445011+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:01.677855+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:40:26.858287+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:40:52.096506+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:16.268 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:39:36.445011+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:01.677855+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:40:26.858287+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:40:52.096506+0000" } ] } 2023-11-04T01:41:16.269 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:16.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:16.272 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:16.319 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.320 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.321 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:16.322 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.93,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-11-04T01:41:16.323 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug trim objects = true 2023-11-04T01:41:16.324 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.325 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 20 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 20 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 10 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:16.326 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:16.327 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:16.328 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.329 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:41:16.330 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-04T01:41:16.331 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi093.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:16.332 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.333 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:16.334 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.335 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.93,172.21.15.125,[v2:172.21.15.125:3301,v1:172.21.15.125:6790]" 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = a91d0b76-a9fc-4383-b1e1-1b6875ba32e4 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:16.336 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug trim objects = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:16.337 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2023-11-04T01:41:16.338 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:41:16.339 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-11-04T01:41:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.341 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:16.342 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = "" 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-11-04T01:41:16.343 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-11-04T01:41:16.344 INFO:teuthology.orchestra.run.smithi125.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:16.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:16.346 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:41:16.391 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:41:16.392 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:16.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.489+0000 7fea51d97640 1 Processor -- start 2023-11-04T01:41:16.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.489+0000 7fea51d97640 1 -- start start 2023-11-04T01:41:16.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.489+0000 7fea51d97640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fea4c159e40 0x7fea4c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea51d97640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea4c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea51d97640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4c071500 con 0x7fea4c06fff0 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea51d97640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c15dae0 con 0x7fea4c159e40 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea51d97640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c070c60 con 0x7fea4c06bb60 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fea4c06fff0 0x7fea4c070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57772/0 (socket says 172.21.15.93:57772) 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4bfff640 1 -- 172.21.15.93:0/196513806 learned_addr learned my addr 172.21.15.93:0/196513806 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/196513806 >> v2:172.21.15.125:3300/0 conn(0x7fea4c159e40 0x7fea4c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4affd640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea4c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028914758 0 0) 0x7fea4c071500 con 0x7fea4c06fff0 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea34003520 con 0x7fea4c06fff0 2023-11-04T01:41:16.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 23490726 0 0) 0x7fea34003520 con 0x7fea4c06fff0 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 msgr2=0x7fea4c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea4c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 >> v2:172.21.15.125:3300/0 conn(0x7fea4c159e40 msgr2=0x7fea4c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 --2- 172.21.15.93:0/196513806 >> v2:172.21.15.125:3300/0 conn(0x7fea4c159e40 0x7fea4c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c070f40 con 0x7fea4c06fff0 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fea440019f0 con 0x7fea4c06fff0 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/196513806 >> v2:172.21.15.125:3300/0 conn(0x7fea4c159e40 0x7fea4c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 >> v1:172.21.15.93:6789/0 conn(0x7fea4c06fff0 legacy=0x7fea4c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea34003970 0x7fea34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea34004d00 0x7fea34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c15dae0 con 0x7fea34004d00 2023-11-04T01:41:16.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c070c60 con 0x7fea34003970 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3400b980 con 0x7fea4c06bb60 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4bfff640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea34004d00 0x7fea34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.490+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea34003970 0x7fea34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4affd640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 -- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 msgr2=0x7fea340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c06bb60 0x7fea340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 -- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea34003970 msgr2=0x7fea34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea34003970 0x7fea34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 -- 172.21.15.93:0/196513806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea34003520 con 0x7fea34004d00 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.491+0000 7fea4bfff640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea34004d00 0x7fea34005180 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a830 tx=0x7fea340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e3d0c605b068e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44034630 con 0x7fea34004d00 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4402f070 con 0x7fea34004d00 2023-11-04T01:41:16.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea4a7fc640 1 -- 172.21.15.93:0/196513806 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440349f0 con 0x7fea34004d00 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 -- 172.21.15.93:0/196513806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea34004d00 msgr2=0x7fea34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 --2- 172.21.15.93:0/196513806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea34004d00 0x7fea34005180 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a830 tx=0x7fea340057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea4bfff640 1 -- 172.21.15.93:0/196513806 reap_dead start 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 -- 172.21.15.93:0/196513806 shutdown_connections 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 -- 172.21.15.93:0/196513806 >> 172.21.15.93:0/196513806 conn(0x7fea4c0cb530 msgr2=0x7fea4c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 -- 172.21.15.93:0/196513806 shutdown_connections 2023-11-04T01:41:16.498 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.492+0000 7fea51d97640 1 -- 172.21.15.93:0/196513806 wait complete. 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.493+0000 7fea51d97640 1 Processor -- start 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.493+0000 7fea51d97640 1 -- start start 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c0ace00 0x7fea4c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0ad1e0 0x7fea4c0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c0c4e40 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c0c15b0 con 0x7fea4c0ace00 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea51d97640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c0c5810 con 0x7fea4c0ad1e0 2023-11-04T01:41:16.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37212/0 (socket says 172.21.15.93:37212) 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea4bfff640 1 -- 172.21.15.93:0/305692227 learned_addr learned my addr 172.21.15.93:0/305692227 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c0ace00 0x7fea4c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.494+0000 7fea4affd640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0ad1e0 0x7fea4c0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 -- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0ad1e0 msgr2=0x7fea4c0c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0ad1e0 0x7fea4c0c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 -- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c0ace00 msgr2=0x7fea4c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c0ace00 0x7fea4c0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 -- 172.21.15.93:0/305692227 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0c4510 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea4bfff640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a830 tx=0x7fea44001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44034840 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440349a0 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c0c47f0 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44034d10 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.495+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c0c2b00 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.496+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c0c2b00 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.496+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea44031030 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.497+0000 7fea33fff640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 0x7fea3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.497+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 0x7fea3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.497+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fea440abf30 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.497+0000 7fea4b7fe640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 0x7fea3806d360 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0093d0 tx=0x7fea3c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.501+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea44076a10 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.702+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea4c0c2b00 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.703+0000 7fea33fff640 1 -- 172.21.15.93:0/305692227 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fea44001fd0 con 0x7fea4c0c0bf0 2023-11-04T01:41:16.705 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:16.705 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:12.145499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:16.706 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 80 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 msgr2=0x7fea3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 0x7fea3806d360 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0093d0 tx=0x7fea3c009190 comp rx=0 tx=0).stop 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 msgr2=0x7fea4c0c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a830 tx=0x7fea44001d80 comp rx=0 tx=0).stop 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 shutdown_connections 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea3806aea0 0x7fea3806d360 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea4c0c0bf0 0x7fea4c0c1070 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fea4c0ad1e0 0x7fea4c0c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 --2- 172.21.15.93:0/305692227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea4c0ace00 0x7fea4c0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 >> 172.21.15.93:0/305692227 conn(0x7fea4c0cb530 msgr2=0x7fea4c15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 shutdown_connections 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.705+0000 7fea51d97640 1 -- 172.21.15.93:0/305692227 wait complete. 2023-11-04T01:41:16.718 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:41:16.830 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:40:52.096506+0000","name":"s16","metadata":{}}],"need_to_purge":{"17":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:41:16.830 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "17": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:40:52.096506+0000" } ] } 2023-11-04T01:41:16.831 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:16.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.930+0000 7fa646c4f640 1 Processor -- start 2023-11-04T01:41:16.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.930+0000 7fa646c4f640 1 -- start start 2023-11-04T01:41:16.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa646c4f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 0x7fa6400710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa646c4f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa64006c5f0 0x7fa640071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa646c4f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64006cc90 con 0x7fa6400ade00 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa646c4f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400b0c40 con 0x7fa64006c5f0 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa646c4f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa640071b50 con 0x7fa64006d9c0 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa64006c5f0 0x7fa640071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa64006c5f0 0x7fa640071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37224/0 (socket says 172.21.15.93:37224) 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 -- 172.21.15.93:0/2880542963 learned_addr learned my addr 172.21.15.93:0/2880542963 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa63ffff640 1 --2- 172.21.15.93:0/2880542963 >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 0x7fa6400710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 -- 172.21.15.93:0/2880542963 >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 msgr2=0x7fa6400710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.936 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 --2- 172.21.15.93:0/2880542963 >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 0x7fa6400710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 -- 172.21.15.93:0/2880542963 >> v1:172.21.15.125:6789/0 conn(0x7fa6400ade00 legacy=0x7fa6400b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa6451ec640 1 -- 172.21.15.93:0/2880542963 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400b0e60 con 0x7fa64006c5f0 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.931+0000 7fa63ffff640 1 --2- 172.21.15.93:0/2880542963 >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 0x7fa6400710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.932+0000 7fa6451ec640 1 --2- 172.21.15.93:0/2880542963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa64006c5f0 0x7fa640071610 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa6400c9080 tx=0x7fa63802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9d005ca695882a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.932+0000 7fa63f7fe640 1 -- 172.21.15.93:0/2880542963 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63802c960 con 0x7fa64006c5f0 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.932+0000 7fa63f7fe640 1 -- 172.21.15.93:0/2880542963 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63802cac0 con 0x7fa64006c5f0 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.932+0000 7fa63f7fe640 1 -- 172.21.15.93:0/2880542963 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63802ce50 con 0x7fa64006c5f0 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 -- 172.21.15.93:0/2880542963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa64006c5f0 msgr2=0x7fa640071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2880542963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa64006c5f0 0x7fa640071610 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa6400c9080 tx=0x7fa63802bdc0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 -- 172.21.15.93:0/2880542963 shutdown_connections 2023-11-04T01:41:16.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2880542963 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa64006c5f0 0x7fa640071610 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2880542963 >> v2:172.21.15.125:3300/0 conn(0x7fa64006d9c0 0x7fa6400710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 -- 172.21.15.93:0/2880542963 >> 172.21.15.93:0/2880542963 conn(0x7fa6400cb530 msgr2=0x7fa6400cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 -- 172.21.15.93:0/2880542963 shutdown_connections 2023-11-04T01:41:16.938 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.933+0000 7fa646c4f640 1 -- 172.21.15.93:0/2880542963 wait complete. 2023-11-04T01:41:16.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.934+0000 7fa646c4f640 1 Processor -- start 2023-11-04T01:41:16.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.934+0000 7fa646c4f640 1 -- start start 2023-11-04T01:41:16.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 0x7fa640158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.941 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa64006d9c0 0x7fa6400c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640158860 con 0x7fa6400ade00 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400c7fc0 con 0x7fa64006d9c0 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa646c4f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400c8990 con 0x7fa64006c5f0 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37228/0 (socket says 172.21.15.93:37228) 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 -- 172.21.15.93:0/2454659787 learned_addr learned my addr 172.21.15.93:0/2454659787 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6449eb640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 0x7fa640158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa63ffff640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa64006d9c0 0x7fa6400c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 -- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 msgr2=0x7fa640158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.942 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 0x7fa640158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 -- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa64006d9c0 msgr2=0x7fa6400c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa64006d9c0 0x7fa6400c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6451ec640 1 -- 172.21.15.93:0/2454659787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638009b30 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.935+0000 7fa6449eb640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 0x7fa640158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa6451ec640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa638036040 tx=0x7fa638004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63803e450 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63803e5d0 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63803e980 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400c70d0 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.936+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6400c7690 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.937+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6400c8150 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.937+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa63803eae0 con 0x7fa6400ade00 2023-11-04T01:41:16.943 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.937+0000 7fa63d7fa640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 0x7fa62c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.938+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fa6380acb60 con 0x7fa6400ade00 2023-11-04T01:41:16.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.938+0000 7fa6449eb640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 0x7fa62c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.938+0000 7fa6449eb640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 0x7fa62c06d330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa630006fd0 tx=0x7fa630008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.944 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:16.942+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6380774f0 con 0x7fa6400ade00 2023-11-04T01:41:17.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:17.177+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fa6400684b0 con 0x7fa6400ade00 2023-11-04T01:41:18.167 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.164+0000 7fa63d7fa640 1 -- 172.21.15.93:0/2454659787 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7920 v81) v1 ==== 112+0+0 (secure 0 0 0) 0x7fa6380430a0 con 0x7fa6400ade00 2023-11-04T01:41:18.167 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.7920 2023-11-04T01:41:18.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 msgr2=0x7fa62c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 0x7fa62c06d330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa630006fd0 tx=0x7fa630008040 comp rx=0 tx=0).stop 2023-11-04T01:41:18.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 msgr2=0x7fa64014ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa638036040 tx=0x7fa638004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 shutdown_connections 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa62c06ae70 0x7fa62c06d330 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6400ade00 0x7fa64014ade0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa64006d9c0 0x7fa6400c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 --2- 172.21.15.93:0/2454659787 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa64006c5f0 0x7fa640158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 >> 172.21.15.93:0/2454659787 conn(0x7fa6400cb530 msgr2=0x7fa64015d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 shutdown_connections 2023-11-04T01:41:18.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.167+0000 7fa646c4f640 1 -- 172.21.15.93:0/2454659787 wait complete. 2023-11-04T01:41:18.181 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:41:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.281+0000 7f6558105640 1 Processor -- start 2023-11-04T01:41:18.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.281+0000 7f6558105640 1 -- start start 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6558105640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f65500b0c40 0x7f655006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6558105640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6550071500 con 0x7f6550159e40 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6558105640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655015dae0 con 0x7f655006bb60 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6558105640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6550070c60 con 0x7f65500b0c40 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6555ea1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6550159e40 0x7f65500b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57774/0 (socket says 172.21.15.93:57774) 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6555ea1640 1 -- 172.21.15.93:0/3612953219 learned_addr learned my addr 172.21.15.93:0/3612953219 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:18.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641112619 0 0) 0x7f6550071500 con 0x7f6550159e40 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.282+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f653c003520 con 0x7f6550159e40 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 --2- 172.21.15.93:0/3612953219 >> v2:172.21.15.125:3300/0 conn(0x7f65500b0c40 0x7f655006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148163625 0 0) 0x7f653c003520 con 0x7f6550159e40 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 >> v2:172.21.15.125:3300/0 conn(0x7f65500b0c40 msgr2=0x7f655006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 --2- 172.21.15.93:0/3612953219 >> v2:172.21.15.125:3300/0 conn(0x7f65500b0c40 0x7f655006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 >> v1:172.21.15.125:6789/0 conn(0x7f655006bb60 legacy=0x7f65500cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550070f40 con 0x7f6550159e40 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f65480019f0 con 0x7f6550159e40 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 >> v1:172.21.15.93:6789/0 conn(0x7f6550159e40 legacy=0x7f65500b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f653c0052a0 0x7f653c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550070c60 con 0x7f653c0047c0 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c00c170 con 0x7f653c0052a0 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c00c330 con 0x7f653c003970 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f6555ea1640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65566a2640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f653c0052a0 0x7f653c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 -- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f653c003970 msgr2=0x7f653c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 -- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f653c0052a0 msgr2=0x7f653c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f653c0052a0 0x7f653c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65566a2640 1 -- 172.21.15.93:0/3612953219 reap_dead start 2023-11-04T01:41:18.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.283+0000 7f65556a0640 1 -- 172.21.15.93:0/3612953219 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c003520 con 0x7f653c0047c0 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f65556a0640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f654000ba00 tx=0x7f653c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8900e78890c01f08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540032620 con 0x7f653c0047c0 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540032780 con 0x7f653c0047c0 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6554e9f640 1 -- 172.21.15.93:0/3612953219 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540032b10 con 0x7f653c0047c0 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6558105640 1 -- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 msgr2=0x7f653c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6558105640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f654000ba00 tx=0x7f653c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6558105640 1 -- 172.21.15.93:0/3612953219 shutdown_connections 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6558105640 1 --2- 172.21.15.93:0/3612953219 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.284+0000 7f6558105640 1 -- 172.21.15.93:0/3612953219 >> 172.21.15.93:0/3612953219 conn(0x7f65500cb530 msgr2=0x7f65500cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.285+0000 7f6558105640 1 -- 172.21.15.93:0/3612953219 shutdown_connections 2023-11-04T01:41:18.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.285+0000 7f6558105640 1 -- 172.21.15.93:0/3612953219 wait complete. 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 Processor -- start 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 -- start start 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f655015cd50 0x7f65501f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6550157f90 0x7f6550158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501f2b00 con 0x7f653c0047c0 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550158960 con 0x7f655015cd50 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6558105640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65501ef000 con 0x7f6550157f90 2023-11-04T01:41:18.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6555ea1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.286+0000 7f6555ea1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37240/0 (socket says 172.21.15.93:37240) 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 -- 172.21.15.93:0/3108726107 learned_addr learned my addr 172.21.15.93:0/3108726107 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 -- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6550157f90 msgr2=0x7f6550158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6550157f90 0x7f6550158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 -- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f655015cd50 msgr2=0x7f65501f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f655015cd50 0x7f65501f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 -- 172.21.15.93:0/3108726107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65501ee6d0 con 0x7f653c0047c0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6555ea1640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6548007a90 tx=0x7f654800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548013420 con 0x7f653c0047c0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548013580 con 0x7f653c0047c0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548013930 con 0x7f653c0047c0 2023-11-04T01:41:18.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65501ee9b0 con 0x7f653c0047c0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.287+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655015d230 con 0x7f653c0047c0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.288+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65500684b0 con 0x7f653c0047c0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.289+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6548013a90 con 0x7f653c0047c0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.289+0000 7f65467fc640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 0x7f653406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.289+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f654808a4f0 con 0x7f653c0047c0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.289+0000 7f65556a0640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 0x7f653406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.289+0000 7f65556a0640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 0x7f653406d360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f653c004740 tx=0x7f6540032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.293+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6548054e80 con 0x7f653c0047c0 2023-11-04T01:41:18.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:18.528+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f65500c9750 con 0x7f653c0047c0 2023-11-04T01:41:19.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.174+0000 7f65467fc640 1 -- 172.21.15.93:0/3108726107 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.5750 v82) v1 ==== 112+0+0 (secure 0 0 0) 0x7f6548001990 con 0x7f653c0047c0 2023-11-04T01:41:19.176 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.5750 2023-11-04T01:41:19.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 msgr2=0x7f653406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 0x7f653406d360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f653c004740 tx=0x7f6540032000 comp rx=0 tx=0).stop 2023-11-04T01:41:19.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 msgr2=0x7f65501ebb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6548007a90 tx=0x7f654800e530 comp rx=0 tx=0).stop 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 shutdown_connections 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f653406aea0 0x7f653406d360 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6550157f90 0x7f6550158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f655015cd50 0x7f65501f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 --2- 172.21.15.93:0/3108726107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f653c0047c0 0x7f65501ebb50 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 >> 172.21.15.93:0/3108726107 conn(0x7f65500cb530 msgr2=0x7f655015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 shutdown_connections 2023-11-04T01:41:19.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.178+0000 7f6558105640 1 -- 172.21.15.93:0/3108726107 wait complete. 2023-11-04T01:41:19.193 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:41:19.312 INFO:teuthology.orchestra.run.smithi093.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:41:19.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:41:19.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:19.313 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:41:19.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:19.334 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f1d79daf640 time 2023-11-04T01:41:19.333798+0000 2023-11-04T01:41:19.334 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:19.335 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.335 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8596efaf] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:41:19.332+0000 7f1d79daf640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f1d79daf640 time 2023-11-04T01:41:19.333798+0000 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8596efaf] 2023-11-04T01:41:19.336 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1d79daf640 thread_name:MR_Finisher 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1d85054db0] 2023-11-04T01:41:19.337 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1d850a154c] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8596f009] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.338 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:41:19.333+0000 7f1d79daf640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1d79daf640 thread_name:MR_Finisher 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1d85054db0] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1d850a154c] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8596f009] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.339 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: -907> 2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:19.340 INFO:tasks.ceph.mds.c.smithi093.stderr: -905> 2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: -1> 2023-11-04T01:41:19.332+0000 7f1d79daf640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f1d79daf640 time 2023-11-04T01:41:19.333798+0000 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8596efaf] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.341 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 0> 2023-11-04T01:41:19.333+0000 7f1d79daf640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1d79daf640 thread_name:MR_Finisher 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1d85054db0] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1d850a154c] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8596f009] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.342 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.343 INFO:tasks.ceph.mds.c.smithi093.stderr: -907> 2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: -905> 2023-11-04T01:41:14.919+0000 7f1d7d5b6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: -1> 2023-11-04T01:41:19.332+0000 7f1d79daf640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f1d79daf640 time 2023-11-04T01:41:19.333798+0000 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1d8596efaf] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.344 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 0> 2023-11-04T01:41:19.333+0000 7f1d79daf640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: in thread 7f1d79daf640 thread_name:MR_Finisher 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1d85054db0] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1d850a154c] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 3: raise() 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 4: abort() 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1d8596f009] 2023-11-04T01:41:19.345 INFO:tasks.ceph.mds.c.smithi093.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f1d8596f16d] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x563a5055e9ce] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563a5058ebcc] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x563a50597b0c] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563a50597c63] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f1d85a164a5] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f1d8509f802] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f1d8503f450] 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:19.346 INFO:tasks.ceph.mds.c.smithi093.stderr: 2023-11-04T01:41:19.441 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:19.441 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:19.441 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.579+0000 7f08e1f2c640 1 Processor -- start 2023-11-04T01:41:19.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.579+0000 7f08e1f2c640 1 -- start start 2023-11-04T01:41:19.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08e1f2c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08dc15d100 0x7f08dc0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08e1f2c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0b32b0 con 0x7f08dc0d1be0 2023-11-04T01:41:19.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08e1f2c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0cee10 con 0x7f08dc15d4e0 2023-11-04T01:41:19.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08e1f2c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0b2980 con 0x7f08dc15d100 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08dbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f08dc0d1be0 0x7f08dc0b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57786/0 (socket says 172.21.15.93:57786) 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08dbfff640 1 -- 172.21.15.93:0/3738150160 learned_addr learned my addr 172.21.15.93:0/3738150160 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289854138 0 0) 0x7f08dc0b32b0 con 0x7f08dc0d1be0 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c8003520 con 0x7f08dc0d1be0 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08db7fe640 1 --2- 172.21.15.93:0/3738150160 >> v2:172.21.15.125:3300/0 conn(0x7f08dc15d100 0x7f08dc0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867841763 0 0) 0x7f08c8003520 con 0x7f08dc0d1be0 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 >> v2:172.21.15.125:3300/0 conn(0x7f08dc15d100 msgr2=0x7f08dc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 --2- 172.21.15.93:0/3738150160 >> v2:172.21.15.125:3300/0 conn(0x7f08dc15d100 0x7f08dc0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 >> v1:172.21.15.125:6789/0 conn(0x7f08dc15d4e0 legacy=0x7f08dc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0b2c60 con 0x7f08dc0d1be0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f08d40019f0 con 0x7f08dc0d1be0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 >> v1:172.21.15.93:6789/0 conn(0x7f08dc0d1be0 legacy=0x7f08dc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 0x7f08c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c80047c0 0x7f08c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c8005180 0x7f08c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0b2980 con 0x7f08c8003970 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c800c0d0 con 0x7f08c80047c0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c800c290 con 0x7f08c8005180 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08db7fe640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 0x7f08c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.580+0000 7f08d3fff640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c80047c0 0x7f08c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08dbfff640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c8005180 0x7f08c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 -- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c8005180 msgr2=0x7f08c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c8005180 0x7f08c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 -- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c80047c0 msgr2=0x7f08c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c80047c0 0x7f08c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 -- 172.21.15.93:0/3738150160 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8003520 con 0x7f08c8003970 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08dbfff640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08c8005180 0x7f08c800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08dbfff640 1 -- 172.21.15.93:0/3738150160 reap_dead start 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.581+0000 7f08db7fe640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 0x7f08c8003d90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00ba10 tx=0x7f08c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b40d0d90ba0a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc005b90 con 0x7f08c8003970 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc005cf0 con 0x7f08c8003970 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08daffd640 1 -- 172.21.15.93:0/3738150160 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc006270 con 0x7f08c8003970 2023-11-04T01:41:19.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 -- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 msgr2=0x7f08c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 0x7f08c8003d90 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00ba10 tx=0x7f08c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 -- 172.21.15.93:0/3738150160 shutdown_connections 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/3738150160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08c8003970 0x7f08c8003d90 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 -- 172.21.15.93:0/3738150160 >> 172.21.15.93:0/3738150160 conn(0x7f08dc0d2ef0 msgr2=0x7f08dc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 -- 172.21.15.93:0/3738150160 shutdown_connections 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.582+0000 7f08e1f2c640 1 -- 172.21.15.93:0/3738150160 wait complete. 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.583+0000 7f08e1f2c640 1 Processor -- start 2023-11-04T01:41:19.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.583+0000 7f08e1f2c640 1 -- start start 2023-11-04T01:41:19.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c8003970 0x7f08dc1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08dc1598f0 0x7f08dc0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0b66d0 con 0x7f08dc0b5d10 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc15eac0 con 0x7f08c8003970 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08e1f2c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc159700 con 0x7f08dc1598f0 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37266/0 (socket says 172.21.15.93:37266) 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 -- 172.21.15.93:0/679285671 learned_addr learned my addr 172.21.15.93:0/679285671 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08db7fe640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c8003970 0x7f08dc1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08d3fff640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08dc1598f0 0x7f08dc0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 -- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08dc1598f0 msgr2=0x7f08dc0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08dc1598f0 0x7f08dc0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 -- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c8003970 msgr2=0x7f08dc1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c8003970 0x7f08dc1591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.584+0000 7f08dbfff640 1 -- 172.21.15.93:0/679285671 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0ccc50 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08dbfff640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0d09f0 tx=0x7f08d400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400eb90 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400ecf0 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc0cba20 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4014650 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.585+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0cbfe0 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.586+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc15ec70 con 0x7f08dc0b5d10 2023-11-04T01:41:19.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.586+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08d40147b0 con 0x7f08dc0b5d10 2023-11-04T01:41:19.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.586+0000 7f08d8ff9640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.587+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7610+0+0 (secure 0 0 0) 0x7f08d4089a00 con 0x7f08dc0b5d10 2023-11-04T01:41:19.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.587+0000 7f08db7fe640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.587+0000 7f08db7fe640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 0x7f08bc06d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08cc036000 tx=0x7f08cc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.591+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08dc15ec70 con 0x7f08dc0b5d10 2023-11-04T01:41:19.629 INFO:tasks.ceph.mds.c.smithi093.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:19.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.795+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08dc15ec70 con 0x7f08dc0b5d10 2023-11-04T01:41:19.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.796+0000 7f08d8ff9640 1 -- 172.21.15.93:0/679285671 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f08dc15ec70 con 0x7f08dc0b5d10 2023-11-04T01:41:19.798 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:19.799 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:18.530638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:19.799 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 82 2023-11-04T01:41:19.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 msgr2=0x7f08bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 0x7f08bc06d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08cc036000 tx=0x7f08cc030000 comp rx=0 tx=0).stop 2023-11-04T01:41:19.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 msgr2=0x7f08dc0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0d09f0 tx=0x7f08d400e530 comp rx=0 tx=0).stop 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 shutdown_connections 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08dc0b5d10 0x7f08dc0b6190 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f08dc1598f0 0x7f08dc0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 --2- 172.21.15.93:0/679285671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08c8003970 0x7f08dc1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 >> 172.21.15.93:0/679285671 conn(0x7f08dc0d2ef0 msgr2=0x7f08dc06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 shutdown_connections 2023-11-04T01:41:19.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:19.798+0000 7f08e1f2c640 1 -- 172.21.15.93:0/679285671 wait complete. 2023-11-04T01:41:19.811 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:22.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:22.214 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:24.811 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:24.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.918+0000 7f7486ee0640 1 Processor -- start 2023-11-04T01:41:24.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.918+0000 7f7486ee0640 1 -- start start 2023-11-04T01:41:24.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f7486ee0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74800cc680 0x7f74800cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f7486ee0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74800cd720 con 0x7f74800addd0 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f7486ee0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74800ae1b0 con 0x7f748006c220 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f7486ee0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74800ccb10 con 0x7f74800cc680 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74800cc680 0x7f74800cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74800cc680 0x7f74800cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48366/0 (socket says 172.21.15.93:48366) 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 -- 172.21.15.93:0/1269663447 learned_addr learned my addr 172.21.15.93:0/1269663447 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f7484c7c640 1 --1- 172.21.15.93:0/1269663447 >> v1:172.21.15.93:6789/0 conn(0x7f74800addd0 0x7f748006bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:57406/0 (socket says 172.21.15.93:57406) 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 -- 172.21.15.93:0/1269663447 >> v1:172.21.15.125:6789/0 conn(0x7f748006c220 legacy=0x7f748006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 -- 172.21.15.93:0/1269663447 >> v1:172.21.15.93:6789/0 conn(0x7f74800addd0 legacy=0x7f748006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747ffff640 1 -- 172.21.15.93:0/1269663447 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74800ccdf0 con 0x7f74800cc680 2023-11-04T01:41:24.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.919+0000 7f747f7fe640 1 -- 172.21.15.93:0/1269663447 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595870992 0 0) 0x7f74800cd720 con 0x7f74800addd0 2023-11-04T01:41:24.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.920+0000 7f747ffff640 1 --2- 172.21.15.93:0/1269663447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74800cc680 0x7f74800cdbb0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f746c00bb00 tx=0x7f746c02df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3763c8e212a47371 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.920+0000 7f747f7fe640 1 -- 172.21.15.93:0/1269663447 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c02ece0 con 0x7f74800cc680 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.920+0000 7f747f7fe640 1 -- 172.21.15.93:0/1269663447 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c032070 con 0x7f74800cc680 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.920+0000 7f747f7fe640 1 -- 172.21.15.93:0/1269663447 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c038620 con 0x7f74800cc680 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 -- 172.21.15.93:0/1269663447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74800cc680 msgr2=0x7f74800cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 --2- 172.21.15.93:0/1269663447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74800cc680 0x7f74800cdbb0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f746c00bb00 tx=0x7f746c02df30 comp rx=0 tx=0).stop 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 -- 172.21.15.93:0/1269663447 shutdown_connections 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 --2- 172.21.15.93:0/1269663447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74800cc680 0x7f74800cdbb0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 -- 172.21.15.93:0/1269663447 >> 172.21.15.93:0/1269663447 conn(0x7f74800cb530 msgr2=0x7f74800cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 -- 172.21.15.93:0/1269663447 shutdown_connections 2023-11-04T01:41:24.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.921+0000 7f7486ee0640 1 -- 172.21.15.93:0/1269663447 wait complete. 2023-11-04T01:41:24.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.922+0000 7f7486ee0640 1 Processor -- start 2023-11-04T01:41:24.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.922+0000 7f7486ee0640 1 -- start start 2023-11-04T01:41:24.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74800addd0 0x7f748015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 0x7f74800c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7480159e20 con 0x7f748006c220 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748015c870 con 0x7f74800addd0 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7486ee0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74800c7280 con 0x7f748015c3c0 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48376/0 (socket says 172.21.15.93:48376) 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 -- 172.21.15.93:0/2944666051 learned_addr learned my addr 172.21.15.93:0/2944666051 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f747ffff640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74800addd0 0x7f748015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f748547d640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 0x7f74800c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 -- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 msgr2=0x7f74800c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 0x7f74800c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 -- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74800addd0 msgr2=0x7f748015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74800addd0 0x7f748015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 -- 172.21.15.93:0/2944666051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c00b760 con 0x7f748006c220 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f748547d640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 0x7f74800c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.923+0000 7f7484c7c640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f747400c4d0 tx=0x7f747400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.924+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740074e0 con 0x7f748006c220 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.924+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474007660 con 0x7f748006c220 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.924+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474004a20 con 0x7f748006c220 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.924+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74800c7560 con 0x7f748006c220 2023-11-04T01:41:24.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.924+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7480159a40 con 0x7f748006c220 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.925+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7480159f60 con 0x7f748006c220 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.925+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7474004b80 con 0x7f748006c220 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.925+0000 7f747d7fa640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 0x7f746406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.926+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7610+0+0 (secure 0 0 0) 0x7f7474088f20 con 0x7f748006c220 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.926+0000 7f747ffff640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 0x7f746406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.926+0000 7f747ffff640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 0x7f746406d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f746c039000 tx=0x7f746c034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.931 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:24.930+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7480159f60 con 0x7f748006c220 2023-11-04T01:41:25.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.134+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7480159f60 con 0x7f748006c220 2023-11-04T01:41:25.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.134+0000 7f747d7fa640 1 -- 172.21.15.93:0/2944666051 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7480159f60 con 0x7f748006c220 2023-11-04T01:41:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:25.137 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:18.530638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:25.137 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 82 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 msgr2=0x7f746406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 0x7f746406d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f746c039000 tx=0x7f746c034000 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 msgr2=0x7f7480152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f747400c4d0 tx=0x7f747400c990 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 shutdown_connections 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f746406ae70 0x7f746406d330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f748015c3c0 0x7f74800c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74800addd0 0x7f748015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 --2- 172.21.15.93:0/2944666051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f748006c220 0x7f7480152c60 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 >> 172.21.15.93:0/2944666051 conn(0x7f74800cb530 msgr2=0x7f74801553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 shutdown_connections 2023-11-04T01:41:25.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:25.136+0000 7f7486ee0640 1 -- 172.21.15.93:0/2944666051 wait complete. 2023-11-04T01:41:25.149 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:26.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:41:30.150 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:30.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 Processor -- start 2023-11-04T01:41:30.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 -- start start 2023-11-04T01:41:30.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd56815d4e0 0x7fd5680d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 0x7fd5680d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680b32b0 con 0x7fd56815d100 2023-11-04T01:41:30.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680cec20 con 0x7fd56815d4e0 2023-11-04T01:41:30.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd56ed24640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680cee10 con 0x7fd5680d3b60 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.259+0000 7fd567fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd56815d4e0 0x7fd5680d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd56815d4e0 0x7fd5680d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48380/0 (socket says 172.21.15.93:48380) 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 -- 172.21.15.93:0/4207263351 learned_addr learned my addr 172.21.15.93:0/4207263351 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd56d2c1640 1 --2- 172.21.15.93:0/4207263351 >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 0x7fd5680d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 -- 172.21.15.93:0/4207263351 >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 msgr2=0x7fd5680d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 --2- 172.21.15.93:0/4207263351 >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 0x7fd5680d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 -- 172.21.15.93:0/4207263351 >> v1:172.21.15.93:6789/0 conn(0x7fd56815d100 legacy=0x7fd5680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd5677fe640 1 -- 172.21.15.93:0/4207263351 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862675352 0 0) 0x7fd5680b32b0 con 0x7fd56815d100 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd567fff640 1 -- 172.21.15.93:0/4207263351 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680b4750 con 0x7fd56815d4e0 2023-11-04T01:41:30.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.260+0000 7fd56d2c1640 1 --2- 172.21.15.93:0/4207263351 >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 0x7fd5680d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd567fff640 1 --2- 172.21.15.93:0/4207263351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680d14d0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fd56808d6a0 tx=0x7fd55c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9961ab94510aff4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd5677fe640 1 -- 172.21.15.93:0/4207263351 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c030860 con 0x7fd56815d4e0 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd5677fe640 1 -- 172.21.15.93:0/4207263351 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c0309c0 con 0x7fd56815d4e0 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd5677fe640 1 -- 172.21.15.93:0/4207263351 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c030d50 con 0x7fd56815d4e0 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 -- 172.21.15.93:0/4207263351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 msgr2=0x7fd5680d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 --2- 172.21.15.93:0/4207263351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680d14d0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fd56808d6a0 tx=0x7fd55c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 -- 172.21.15.93:0/4207263351 shutdown_connections 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 --2- 172.21.15.93:0/4207263351 >> v2:172.21.15.125:3300/0 conn(0x7fd5680d3b60 0x7fd5680d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 --2- 172.21.15.93:0/4207263351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680d14d0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 -- 172.21.15.93:0/4207263351 >> 172.21.15.93:0/4207263351 conn(0x7fd5680d2ef0 msgr2=0x7fd5680d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 -- 172.21.15.93:0/4207263351 shutdown_connections 2023-11-04T01:41:30.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.261+0000 7fd56ed24640 1 -- 172.21.15.93:0/4207263351 wait complete. 2023-11-04T01:41:30.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.263+0000 7fd56ed24640 1 Processor -- start 2023-11-04T01:41:30.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.263+0000 7fd56ed24640 1 -- start start 2023-11-04T01:41:30.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.263+0000 7fd56ed24640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5680d3b60 0x7fd5680b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.263+0000 7fd56ed24640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56815d100 0x7fd5680b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.263+0000 7fd56ed24640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56ed24640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b61d0 con 0x7fd56815d4e0 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56ed24640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568152cf0 con 0x7fd56815d100 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56ed24640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568152a10 con 0x7fd5680d3b60 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48394/0 (socket says 172.21.15.93:48394) 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 -- 172.21.15.93:0/3393135042 learned_addr learned my addr 172.21.15.93:0/3393135042 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 -- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5680d3b60 msgr2=0x7fd5680b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5680d3b60 0x7fd5680b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 -- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56815d100 msgr2=0x7fd5680b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd567fff640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56815d100 0x7fd5680b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56815d100 0x7fd5680b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 -- 172.21.15.93:0/3393135042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0094d0 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56d2c1640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fd56000cef0 tx=0x7fd56000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000d840 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000d9c0 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680b5b10 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000dd70 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.264+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680b8860 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.265+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5680684b0 con 0x7fd56815d4e0 2023-11-04T01:41:30.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.266+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd56001e3b0 con 0x7fd56815d4e0 2023-11-04T01:41:30.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.266+0000 7fd5657fa640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 0x7fd55406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.266+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7566+0+0 (secure 0 0 0) 0x7fd56008a830 con 0x7fd56815d4e0 2023-11-04T01:41:30.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.266+0000 7fd56cac0640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 0x7fd55406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.267+0000 7fd56cac0640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 0x7fd55406d330 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd56806b6c0 tx=0x7fd558007880 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.270+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd560055260 con 0x7fd56815d4e0 2023-11-04T01:41:30.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.473+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5680b6310 con 0x7fd56815d4e0 2023-11-04T01:41:30.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.473+0000 7fd5657fa640 1 -- 172.21.15.93:0/3393135042 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fd5680b6310 con 0x7fd56815d4e0 2023-11-04T01:41:30.476 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:30.476 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:18.530638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:30.476 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 82 2023-11-04T01:41:30.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 msgr2=0x7fd55406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 0x7fd55406d330 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd56806b6c0 tx=0x7fd558007880 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 msgr2=0x7fd5680b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fd56000cef0 tx=0x7fd56000a710 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 shutdown_connections 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd55406ae70 0x7fd55406d330 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd56815d4e0 0x7fd5680b48e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd56815d100 0x7fd5680b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 --2- 172.21.15.93:0/3393135042 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd5680d3b60 0x7fd5680b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 >> 172.21.15.93:0/3393135042 conn(0x7fd5680d2ef0 msgr2=0x7fd5680cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 shutdown_connections 2023-11-04T01:41:30.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:30.475+0000 7fd56ed24640 1 -- 172.21.15.93:0/3393135042 wait complete. 2023-11-04T01:41:30.488 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:33.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:41:35.489 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:35.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.603+0000 7f7f45ec2640 1 Processor -- start 2023-11-04T01:41:35.605 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 -- start start 2023-11-04T01:41:35.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 0x7f7f400cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.606 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 0x7f7f400ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f400cd720 con 0x7f7f4006bb10 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f400ae1b0 con 0x7f7f400addd0 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.604+0000 7f7f45ec2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400ccb10 con 0x7f7f400cc680 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3ffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7f4006bb10 0x7f7f4006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43720/0 (socket says 172.21.15.93:43720) 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3ffff640 1 -- 172.21.15.93:0/1021409323 learned_addr learned my addr 172.21.15.93:0/1021409323 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3f7fe640 1 --2- 172.21.15.93:0/1021409323 >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 0x7f7f400cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f37fff640 1 --2- 172.21.15.93:0/1021409323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 0x7f7f400ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145914805 0 0) 0x7f7f400cd720 con 0x7f7f4006bb10 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c003520 con 0x7f7f4006bb10 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f37fff640 1 -- 172.21.15.93:0/1021409323 >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 msgr2=0x7f7f400cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f37fff640 1 --2- 172.21.15.93:0/1021409323 >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 0x7f7f400cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542871183 0 0) 0x7f7f2c003520 con 0x7f7f4006bb10 2023-11-04T01:41:35.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f37fff640 1 -- 172.21.15.93:0/1021409323 >> v1:172.21.15.93:6789/0 conn(0x7f7f4006bb10 legacy=0x7f7f4006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f37fff640 1 -- 172.21.15.93:0/1021409323 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400ccdf0 con 0x7f7f400cc680 2023-11-04T01:41:35.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.605+0000 7f7f3f7fe640 1 --2- 172.21.15.93:0/1021409323 >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 0x7f7f400cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:35.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.606+0000 7f7f37fff640 1 --2- 172.21.15.93:0/1021409323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 0x7f7f400ca2d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097a0 tx=0x7f7f2802d9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17928b4e4da5ca06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.606+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380019f0 con 0x7f7f400cc680 2023-11-04T01:41:35.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.606+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28033680 con 0x7f7f400cc680 2023-11-04T01:41:35.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.606+0000 7f7f3effd640 1 -- 172.21.15.93:0/1021409323 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28033a10 con 0x7f7f400cc680 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 -- 172.21.15.93:0/1021409323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 msgr2=0x7f7f400ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/1021409323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 0x7f7f400ca2d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097a0 tx=0x7f7f2802d9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 -- 172.21.15.93:0/1021409323 shutdown_connections 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/1021409323 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400cc680 0x7f7f400ca2d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/1021409323 >> v2:172.21.15.125:3300/0 conn(0x7f7f400addd0 0x7f7f400cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 -- 172.21.15.93:0/1021409323 >> 172.21.15.93:0/1021409323 conn(0x7f7f400cb530 msgr2=0x7f7f400cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 -- 172.21.15.93:0/1021409323 shutdown_connections 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.607+0000 7f7f45ec2640 1 -- 172.21.15.93:0/1021409323 wait complete. 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.608+0000 7f7f45ec2640 1 Processor -- start 2023-11-04T01:41:35.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.608+0000 7f7f45ec2640 1 -- start start 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4006bb10 0x7f7f40154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400addd0 0x7f7f4015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401efe10 con 0x7f7f4015bf70 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4015c4f0 con 0x7f7f4006bb10 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f45ec2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401ef750 con 0x7f7f400addd0 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40770/0 (socket says 172.21.15.93:40770) 2023-11-04T01:41:35.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 -- 172.21.15.93:0/3861128073 learned_addr learned my addr 172.21.15.93:0/3861128073 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3f7fe640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4006bb10 0x7f7f40154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 -- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400addd0 msgr2=0x7f7f4015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400addd0 0x7f7f4015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 -- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4006bb10 msgr2=0x7f7f40154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4006bb10 0x7f7f40154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 -- 172.21.15.93:0/3861128073 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3000a5a0 con 0x7f7f4015bf70 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3ffff640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001890 tx=0x7f7f3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.609+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38012400 con 0x7f7f4015bf70 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.610+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38012560 con 0x7f7f4015bf70 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.610+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f28009400 con 0x7f7f4015bf70 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.610+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38012910 con 0x7f7f4015bf70 2023-11-04T01:41:35.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.610+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f401ef300 con 0x7f7f4015bf70 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.611+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f401eff50 con 0x7f7f4015bf70 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.611+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f38012a70 con 0x7f7f4015bf70 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.611+0000 7f7f3cff9640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 0x7f7f2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.611+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f7f3808a680 con 0x7f7f4015bf70 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.612+0000 7f7f3f7fe640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 0x7f7f2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.612+0000 7f7f3f7fe640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 0x7f7f2006d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f400c55d0 tx=0x7f7f30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.617 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.616+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f401eff50 con 0x7f7f4015bf70 2023-11-04T01:41:35.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.815+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f401eff50 con 0x7f7f4015bf70 2023-11-04T01:41:35.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.816+0000 7f7f3cff9640 1 -- 172.21.15.93:0/3861128073 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f7f401eff50 con 0x7f7f4015bf70 2023-11-04T01:41:35.817 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:35.818 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:32.068892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:32.068892+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:35.818 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 83 2023-11-04T01:41:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 msgr2=0x7f7f2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 0x7f7f2006d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f400c55d0 tx=0x7f7f30008040 comp rx=0 tx=0).stop 2023-11-04T01:41:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 msgr2=0x7f7f40070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001890 tx=0x7f7f3800a430 comp rx=0 tx=0).stop 2023-11-04T01:41:35.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 shutdown_connections 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f2006ae70 0x7f7f2006d330 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f4015bf70 0x7f7f40070b00 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f400addd0 0x7f7f4015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 --2- 172.21.15.93:0/3861128073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f4006bb10 0x7f7f40154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 >> 172.21.15.93:0/3861128073 conn(0x7f7f400cb530 msgr2=0x7f7f400b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 shutdown_connections 2023-11-04T01:41:35.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:35.818+0000 7f7f45ec2640 1 -- 172.21.15.93:0/3861128073 wait complete. 2023-11-04T01:41:35.830 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:35.830 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:35.855 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:35.857 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:35.857 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:35.926 INFO:teuthology.orchestra.run.smithi093.stdout:1699062079.150866.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:35.928 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062079.150866.core'] 2023-11-04T01:41:35.928 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062079.150866.core, deleting it 2023-11-04T01:41:35.928 DEBUG:teuthology.orchestra.run.smithi093:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062079.150866.core 2023-11-04T01:41:35.997 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:36.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.136+0000 7f9eec0c2640 1 Processor -- start 2023-11-04T01:41:36.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.136+0000 7f9eec0c2640 1 -- start start 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eec0c2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ee40ceda0 0x7f9ee415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eec0c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eec0c2640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee415d9a0 con 0x7f9ee40cf180 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eec0c2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40b1df0 con 0x7f9ee40ceda0 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eec0c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40cfd20 con 0x7f9ee40b2210 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9ee965d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9ee965d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:32908/0 (socket says 172.21.15.93:32908) 2023-11-04T01:41:36.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9ee965d640 1 -- 172.21.15.93:0/836855404 learned_addr learned my addr 172.21.15.93:0/836855404 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9ee9e5e640 1 --2- 172.21.15.93:0/836855404 >> v2:172.21.15.125:3300/0 conn(0x7f9ee40ceda0 0x7f9ee415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.137+0000 7f9eea65f640 1 --1- 172.21.15.93:0/836855404 >> v1:172.21.15.125:6789/0 conn(0x7f9ee40cf180 0x7f9ee40cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:56704/0 (socket says 172.21.15.93:56704) 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.138+0000 7f9ee965d640 1 -- 172.21.15.93:0/836855404 >> v2:172.21.15.125:3300/0 conn(0x7f9ee40ceda0 msgr2=0x7f9ee415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.138+0000 7f9ee965d640 1 --2- 172.21.15.93:0/836855404 >> v2:172.21.15.125:3300/0 conn(0x7f9ee40ceda0 0x7f9ee415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.138+0000 7f9ee965d640 1 -- 172.21.15.93:0/836855404 >> v1:172.21.15.125:6789/0 conn(0x7f9ee40cf180 legacy=0x7f9ee40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.138+0000 7f9ee965d640 1 -- 172.21.15.93:0/836855404 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40b0150 con 0x7f9ee40b2210 2023-11-04T01:41:36.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.138+0000 7f9ee965d640 1 --2- 172.21.15.93:0/836855404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009870 tx=0x7f9ed402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d856308ca61475 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9ee8e5c640 1 -- 172.21.15.93:0/836855404 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4031640 con 0x7f9ee40b2210 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9ee8e5c640 1 -- 172.21.15.93:0/836855404 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40317a0 con 0x7f9ee40b2210 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9ee8e5c640 1 -- 172.21.15.93:0/836855404 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4031b30 con 0x7f9ee40b2210 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 -- 172.21.15.93:0/836855404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 msgr2=0x7f9ee415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/836855404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009870 tx=0x7f9ed402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 -- 172.21.15.93:0/836855404 shutdown_connections 2023-11-04T01:41:36.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/836855404 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40b2210 0x7f9ee415d460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/836855404 >> v2:172.21.15.125:3300/0 conn(0x7f9ee40ceda0 0x7f9ee415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 -- 172.21.15.93:0/836855404 >> 172.21.15.93:0/836855404 conn(0x7f9ee40d0c30 msgr2=0x7f9ee40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 -- 172.21.15.93:0/836855404 shutdown_connections 2023-11-04T01:41:36.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.139+0000 7f9eec0c2640 1 -- 172.21.15.93:0/836855404 wait complete. 2023-11-04T01:41:36.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.140+0000 7f9eec0c2640 1 Processor -- start 2023-11-04T01:41:36.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.140+0000 7f9eec0c2640 1 -- start start 2023-11-04T01:41:36.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40b2210 0x7f9ee40b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40ceda0 0x7f9ee40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40cc810 con 0x7f9ee40cf180 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c4b10 con 0x7f9ee40b2210 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eec0c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40cc530 con 0x7f9ee40ceda0 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eea65f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eea65f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40780/0 (socket says 172.21.15.93:40780) 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9eea65f640 1 -- 172.21.15.93:0/1414899786 learned_addr learned my addr 172.21.15.93:0/1414899786 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9ee9e5e640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40b2210 0x7f9ee40b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.141+0000 7f9ee965d640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40ceda0 0x7f9ee40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 -- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40ceda0 msgr2=0x7f9ee40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40ceda0 0x7f9ee40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 -- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40b2210 msgr2=0x7f9ee40b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40b2210 0x7f9ee40b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 -- 172.21.15.93:0/1414899786 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40094d0 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eea65f640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c730 tx=0x7f9edc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00ce40 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00a640 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40c4db0 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00a9f0 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.142+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40cc1b0 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.143+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee40c52d0 con 0x7f9ee40cf180 2023-11-04T01:41:36.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.143+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9edc00ab50 con 0x7f9ee40cf180 2023-11-04T01:41:36.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.143+0000 7f9eda7fc640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 0x7f9ec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.144+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f9edc089350 con 0x7f9ee40cf180 2023-11-04T01:41:36.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.144+0000 7f9ee9e5e640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 0x7f9ec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.144+0000 7f9ee9e5e640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 0x7f9ec806d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009b30 tx=0x7f9ee0009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.148+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9edc053e00 con 0x7f9ee40cf180 2023-11-04T01:41:36.350 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.349+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee40684b0 con 0x7f9ee40cf180 2023-11-04T01:41:36.351 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.350+0000 7f9eda7fc640 1 -- 172.21.15.93:0/1414899786 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f9edc057420 con 0x7f9ee40cf180 2023-11-04T01:41:36.351 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:36.351 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:32.068892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7920,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.93:6836/3572539978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3572539978},{"type":"v1","addr":"172.21.15.93:6836","nonce":3572539978}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:32.068892+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:36.352 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 83 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 msgr2=0x7f9ec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 0x7f9ec806d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009b30 tx=0x7f9ee0009110 comp rx=0 tx=0).stop 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 msgr2=0x7f9ee41f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c730 tx=0x7f9edc00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 shutdown_connections 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9ec806ae70 0x7f9ec806d330 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.354 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ee40cf180 0x7f9ee41f5fc0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9ee40ceda0 0x7f9ee40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 --2- 172.21.15.93:0/1414899786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40b2210 0x7f9ee40b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 >> 172.21.15.93:0/1414899786 conn(0x7f9ee40d0c30 msgr2=0x7f9ee406db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 shutdown_connections 2023-11-04T01:41:36.355 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.352+0000 7f9eec0c2640 1 -- 172.21.15.93:0/1414899786 wait complete. 2023-11-04T01:41:36.364 INFO:tasks.ceph.mds.b:Sent signal 9 2023-11-04T01:41:36.364 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:36.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:36.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 down 2023-11-04T01:41:36.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:36.533 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.532+0000 7f1045589640 1 Processor -- start 2023-11-04T01:41:36.534 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.532+0000 7f1045589640 1 -- start start 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f1045589640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10400cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f1045589640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10400b0150 con 0x7f10400ceda0 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f1045589640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10400b1170 con 0x7f104015d630 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f1045589640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b1df0 con 0x7f10400b2210 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f103effd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f10400ceda0 0x7f104015cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43730/0 (socket says 172.21.15.93:43730) 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f103effd640 1 -- 172.21.15.93:0/196255197 learned_addr learned my addr 172.21.15.93:0/196255197 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488515828 0 0) 0x7f10400b0150 con 0x7f10400ceda0 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f103e7fc640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10400cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.533+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1028003520 con 0x7f10400ceda0 2023-11-04T01:41:36.537 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250734629 0 0) 0x7f1028003520 con 0x7f10400ceda0 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 msgr2=0x7f10400cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10400cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 >> v1:172.21.15.125:6789/0 conn(0x7f104015d630 legacy=0x7f10400cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400b1450 con 0x7f10400ceda0 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f1030001b70 con 0x7f10400ceda0 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 >> v1:172.21.15.93:6789/0 conn(0x7f10400ceda0 legacy=0x7f104015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280039a0 0x7f1028003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1028004d00 0x7f1028005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b1df0 con 0x7f1028004d00 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102800bb40 con 0x7f10280039a0 2023-11-04T01:41:36.538 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102800bd00 con 0x7f10400b2210 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1028004d00 0x7f1028005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103e7fc640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103effd640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280039a0 0x7f1028003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 -- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 msgr2=0x7f10280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b2210 0x7f10280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 -- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280039a0 msgr2=0x7f1028003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10280039a0 0x7f1028003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.534+0000 7f103f7fe640 1 -- 172.21.15.93:0/196255197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028003520 con 0x7f1028004d00 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.535+0000 7f103f7fe640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1028004d00 0x7f1028005180 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f1038001750 tx=0x7f10280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6204d09acc52ae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.535+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380052d0 con 0x7f1028004d00 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.535+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103802e050 con 0x7f1028004d00 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.535+0000 7f103dffb640 1 -- 172.21.15.93:0/196255197 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380035f0 con 0x7f1028004d00 2023-11-04T01:41:36.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 -- 172.21.15.93:0/196255197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1028004d00 msgr2=0x7f1028005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 --2- 172.21.15.93:0/196255197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1028004d00 0x7f1028005180 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f1038001750 tx=0x7f10280057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f103f7fe640 1 -- 172.21.15.93:0/196255197 reap_dead start 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 -- 172.21.15.93:0/196255197 shutdown_connections 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 -- 172.21.15.93:0/196255197 >> 172.21.15.93:0/196255197 conn(0x7f10400d0c30 msgr2=0x7f10400d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 -- 172.21.15.93:0/196255197 shutdown_connections 2023-11-04T01:41:36.540 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.536+0000 7f1045589640 1 -- 172.21.15.93:0/196255197 wait complete. 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.537+0000 7f1045589640 1 Processor -- start 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.537+0000 7f1045589640 1 -- start start 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b5e80 0x7f10400b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 0x7f1040154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040157f00 con 0x7f10400cb720 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b67a0 con 0x7f10400b3f70 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10401554d0 con 0x7f10400b5e80 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40806/0 (socket says 172.21.15.93:40806) 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 -- 172.21.15.93:0/1253288873 learned_addr learned my addr 172.21.15.93:0/1253288873 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103e7fc640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 0x7f1040154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103effd640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b5e80 0x7f10400b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 -- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b5e80 msgr2=0x7f10400b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b5e80 0x7f10400b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 -- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 msgr2=0x7f1040154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 0x7f1040154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 -- 172.21.15.93:0/1253288873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040157840 con 0x7f10400cb720 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103e7fc640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 0x7f1040154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f103f7fe640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f1038005040 tx=0x7f1038001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038007a30 con 0x7f10400cb720 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10380067d0 con 0x7f10400cb720 2023-11-04T01:41:36.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1040157b20 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038006b80 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.538+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1040157460 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.539+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1040158040 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.540+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1038006ce0 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.540+0000 7f10277fe640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 0x7f102c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.540+0000 7f103effd640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 0x7f102c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.540+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f10380ab360 con 0x7f10400cb720 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.541+0000 7f103effd640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 0x7f102c06d360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1030001350 tx=0x7f1030009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.544+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1040158040 con 0x7f10400cb720 2023-11-04T01:41:36.565 INFO:tasks.ceph.mds.b.smithi125.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:41:36.781 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.780+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f1040158040 con 0x7f10400cb720 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.782+0000 7f10277fe640 1 -- 172.21.15.93:0/1253288873 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7920 v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1040158040 con 0x7f10400cb720 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 7920 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 msgr2=0x7f102c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 0x7f102c06d360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1030001350 tx=0x7f1030009040 comp rx=0 tx=0).stop 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 msgr2=0x7f1040158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f1038005040 tx=0x7f1038001120 comp rx=0 tx=0).stop 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 shutdown_connections 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f102c06aea0 0x7f102c06d360 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10400cb720 0x7f1040158320 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10400b3f70 0x7f1040154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 --2- 172.21.15.93:0/1253288873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10400b5e80 0x7f10400b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 >> 172.21.15.93:0/1253288873 conn(0x7f10400d0c30 msgr2=0x7f10400ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 shutdown_connections 2023-11-04T01:41:36.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.784+0000 7f1045589640 1 -- 172.21.15.93:0/1253288873 wait complete. 2023-11-04T01:41:36.812 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:36.812 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:36.812 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:36.813 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:36.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:36.813 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:41:36.813 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:36.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:36.816 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:36.816 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:36.890 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:41:36.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.915+0000 7f6d1054c640 1 Processor -- start 2023-11-04T01:41:36.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.915+0000 7f6d1054c640 1 -- start start 2023-11-04T01:41:36.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d1054c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d100 0x7f6d080ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d1054c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d0815d4e0 0x7f6d080d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d1054c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080b32b0 con 0x7f6d080d3b60 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d1054c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080cee10 con 0x7f6d0815d4e0 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d1054c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080b4750 con 0x7f6d0815d100 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d0dae7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d0815d4e0 0x7f6d080d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d0dae7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d0815d4e0 0x7f6d080d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40846/0 (socket says 172.21.15.93:40846) 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d0dae7640 1 -- 172.21.15.93:0/3175346488 learned_addr learned my addr 172.21.15.93:0/3175346488 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.916+0000 7f6d0e2e8640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d100 0x7f6d080ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0dae7640 1 -- 172.21.15.93:0/3175346488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d100 msgr2=0x7f6d080ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d100 0x7f6d080ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0dae7640 1 -- 172.21.15.93:0/3175346488 >> v1:172.21.15.125:6789/0 conn(0x7f6d080d3b60 legacy=0x7f6d080cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0dae7640 1 -- 172.21.15.93:0/3175346488 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080b2980 con 0x7f6d0815d4e0 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d0815d4e0 0x7f6d080d14d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009870 tx=0x7f6cfc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df52f0b80110e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.917+0000 7f6d0d2e6640 1 -- 172.21.15.93:0/3175346488 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc030840 con 0x7f6d0815d4e0 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d0d2e6640 1 -- 172.21.15.93:0/3175346488 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc0309a0 con 0x7f6d0815d4e0 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d0d2e6640 1 -- 172.21.15.93:0/3175346488 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc030d30 con 0x7f6d0815d4e0 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 -- 172.21.15.93:0/3175346488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d0815d4e0 msgr2=0x7f6d080d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d0815d4e0 0x7f6d080d14d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009870 tx=0x7f6cfc02b980 comp rx=0 tx=0).stop 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 -- 172.21.15.93:0/3175346488 shutdown_connections 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d0815d4e0 0x7f6d080d14d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3175346488 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d100 0x7f6d080ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 -- 172.21.15.93:0/3175346488 >> 172.21.15.93:0/3175346488 conn(0x7f6d080d2ef0 msgr2=0x7f6d080d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 -- 172.21.15.93:0/3175346488 shutdown_connections 2023-11-04T01:41:36.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.918+0000 7f6d1054c640 1 -- 172.21.15.93:0/3175346488 wait complete. 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.919+0000 7f6d1054c640 1 Processor -- start 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.919+0000 7f6d1054c640 1 -- start start 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 0x7f6d080ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 0x7f6d080cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08156240 con 0x7f6d080d3b60 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081f4140 con 0x7f6d0815d100 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d1054c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081f3130 con 0x7f6d0815d4e0 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:40860/0 (socket says 172.21.15.93:40860) 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 -- 172.21.15.93:0/3987597875 learned_addr learned my addr 172.21.15.93:0/3987597875 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0eae9640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 0x7f6d080cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 -- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 msgr2=0x7f6d080cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 0x7f6d080cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 0x7f6d080ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 -- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 msgr2=0x7f6d080ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 0x7f6d080ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0e2e8640 1 -- 172.21.15.93:0/3987597875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0094d0 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0eae9640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 0x7f6d080cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.920+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 0x7f6d080ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6d0e2e8640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04005990 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04005af0 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04005ea0 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d081f3380 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.921+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d081f3940 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.922+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d080684b0 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.922+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d040096a0 con 0x7f6d080d3b60 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.922+0000 7f6cfaffd640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.923+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f6d04089f30 con 0x7f6d080d3b60 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.923+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.923+0000 7f6d0dae7640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 0x7f6cec06d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc036000 tx=0x7f6cfc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:36.927+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d04054870 con 0x7f6d080d3b60 2023-11-04T01:41:37.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.130+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d080d2cd0 con 0x7f6d080d3b60 2023-11-04T01:41:37.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.131+0000 7f6cfaffd640 1 -- 172.21.15.93:0/3987597875 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f6d04057e90 con 0x7f6d080d3b60 2023-11-04T01:41:37.132 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:37.132 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:36.787678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:37.133 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 85 2023-11-04T01:41:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 msgr2=0x7f6cec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 0x7f6cec06d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc036000 tx=0x7f6cfc03b040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 msgr2=0x7f6d08155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.134 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 shutdown_connections 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d0815d4e0 0x7f6d080cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d0815d100 0x7f6d080ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 --2- 172.21.15.93:0/3987597875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d080d3b60 0x7f6d08155d00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 >> 172.21.15.93:0/3987597875 conn(0x7f6d080d2ef0 msgr2=0x7f6d080d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 shutdown_connections 2023-11-04T01:41:37.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:37.133+0000 7f6d1054c640 1 -- 172.21.15.93:0/3987597875 wait complete. 2023-11-04T01:41:37.145 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:39.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:41:39.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:41:42.145 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:42.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.259+0000 7f9990c75640 1 Processor -- start 2023-11-04T01:41:42.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.259+0000 7f9990c75640 1 -- start start 2023-11-04T01:41:42.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9990c75640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f998c0cc680 0x7f998c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9990c75640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f998c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9990c75640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0cd720 con 0x7f998c0addd0 2023-11-04T01:41:42.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9990c75640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0ae1b0 con 0x7f998c0cc680 2023-11-04T01:41:42.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9990c75640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0ccb10 con 0x7f998c06c220 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f998a59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f998c0addd0 0x7f998c06bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:36096/0 (socket says 172.21.15.93:36096) 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f998a59c640 1 -- 172.21.15.93:0/2906169777 learned_addr learned my addr 172.21.15.93:0/2906169777 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9983fff640 1 --2- 172.21.15.93:0/2906169777 >> v2:172.21.15.125:3300/0 conn(0x7f998c0cc680 0x7f998c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f998ad9d640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f998c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198167009 0 0) 0x7f998c0cd720 con 0x7f998c0addd0 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.260+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9978003520 con 0x7f998c0addd0 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4275891076 0 0) 0x7f9978003520 con 0x7f998c0addd0 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 msgr2=0x7f998c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f998c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 >> v2:172.21.15.125:3300/0 conn(0x7f998c0cc680 msgr2=0x7f998c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 --2- 172.21.15.93:0/2906169777 >> v2:172.21.15.125:3300/0 conn(0x7f998c0cc680 0x7f998c0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0ccdf0 con 0x7f998c0addd0 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f997c001670 con 0x7f998c0addd0 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 >> v1:172.21.15.93:6789/0 conn(0x7f998c0addd0 legacy=0x7f998c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9978003970 0x7f9978003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f99780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0ae1b0 con 0x7f9978004d00 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0ccb10 con 0x7f9978003970 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997800b980 con 0x7f998c06c220 2023-11-04T01:41:42.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998a59c640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9978003970 0x7f9978003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f9983fff640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f99780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 -- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 msgr2=0x7f99780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c06c220 0x7f99780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 -- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9978003970 msgr2=0x7f9978003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9978003970 0x7f9978003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.261+0000 7f998ad9d640 1 -- 172.21.15.93:0/2906169777 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978003520 con 0x7f9978004d00 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.262+0000 7f998ad9d640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9978004d00 0x7f9978005180 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9984009f90 tx=0x7f99780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94567e5aa3ab395c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.262+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998402cbc0 con 0x7f9978004d00 2023-11-04T01:41:42.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.262+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998400f040 con 0x7f9978004d00 2023-11-04T01:41:42.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.262+0000 7f9989d9b640 1 -- 172.21.15.93:0/2906169777 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984034440 con 0x7f9978004d00 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 -- 172.21.15.93:0/2906169777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9978004d00 msgr2=0x7f9978005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 --2- 172.21.15.93:0/2906169777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9978004d00 0x7f9978005180 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9984009f90 tx=0x7f99780057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f998ad9d640 1 -- 172.21.15.93:0/2906169777 reap_dead start 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 -- 172.21.15.93:0/2906169777 shutdown_connections 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 -- 172.21.15.93:0/2906169777 >> 172.21.15.93:0/2906169777 conn(0x7f998c0cb530 msgr2=0x7f998c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 -- 172.21.15.93:0/2906169777 shutdown_connections 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.263+0000 7f9990c75640 1 -- 172.21.15.93:0/2906169777 wait complete. 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.264+0000 7f9990c75640 1 Processor -- start 2023-11-04T01:41:42.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.264+0000 7f9990c75640 1 -- start start 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 0x7f998c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 0x7f998c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1f42c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1f45a0 con 0x7f998c0b41f0 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9990c75640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1f4880 con 0x7f998c0b3e10 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35468/0 (socket says 172.21.15.93:35468) 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 -- 172.21.15.93:0/3085368995 learned_addr learned my addr 172.21.15.93:0/3085368995 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f998a59c640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 0x7f998c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f998ad9d640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 0x7f998c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 -- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 msgr2=0x7f998c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 0x7f998c151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 -- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 msgr2=0x7f998c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 0x7f998c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f9983fff640 1 -- 172.21.15.93:0/3085368995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c1f4b60 con 0x7f998c1f3e00 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f998a59c640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 0x7f998c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.265+0000 7f998ad9d640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 0x7f998c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9983fff640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f9974011a70 tx=0x7f9974011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974009680 con 0x7f998c1f3e00 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400fb50 con 0x7f998c1f3e00 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c0c7050 con 0x7f998c1f3e00 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400fee0 con 0x7f998c1f3e00 2023-11-04T01:41:42.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.266+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c14fc50 con 0x7f998c1f3e00 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.267+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c0c72c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.267+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9974014440 con 0x7f998c1f3e00 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.268+0000 7f9982ffd640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 0x7f996c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.268+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f997408a6c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.268+0000 7f998a59c640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 0x7f996c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.268+0000 7f998a59c640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 0x7f996c06d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f997c004840 tx=0x7f997c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.272+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f998c0c72c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.475+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f998c0c72c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.478 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.476+0000 7f9982ffd640 1 -- 172.21.15.93:0/3085368995 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f998c0c72c0 con 0x7f998c1f3e00 2023-11-04T01:41:42.478 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:42.479 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:36.805166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:42.480 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 86 2023-11-04T01:41:42.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 msgr2=0x7f996c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 0x7f996c06d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f997c004840 tx=0x7f997c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 msgr2=0x7f998c0c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f9974011a70 tx=0x7f9974011f30 comp rx=0 tx=0).stop 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 shutdown_connections 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f996c06ae70 0x7f996c06d330 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f998c0b41f0 0x7f998c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f998c1f3e00 0x7f998c0c4550 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 --2- 172.21.15.93:0/3085368995 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f998c0b3e10 0x7f998c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.477+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 >> 172.21.15.93:0/3085368995 conn(0x7f998c0cb530 msgr2=0x7f998c070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.478+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 shutdown_connections 2023-11-04T01:41:42.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.478+0000 7f9990c75640 1 -- 172.21.15.93:0/3085368995 wait complete. 2023-11-04T01:41:42.489 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:42.490 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:42.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.588+0000 7fa2d314c640 1 Processor -- start 2023-11-04T01:41:42.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.588+0000 7fa2d314c640 1 -- start start 2023-11-04T01:41:42.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d314c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa2cc0ade00 0x7fa2cc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d314c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc06d9c0 0x7fa2cc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d314c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc06cc90 con 0x7fa2cc06c5f0 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d314c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0b0e60 con 0x7fa2cc0ade00 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d314c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc06cee0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa2cc0ade00 0x7fa2cc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa2cc0ade00 0x7fa2cc0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35470/0 (socket says 172.21.15.93:35470) 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 -- 172.21.15.93:0/3512795130 learned_addr learned my addr 172.21.15.93:0/3512795130 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 -- 172.21.15.93:0/3512795130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc06d9c0 msgr2=0x7fa2cc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 --2- 172.21.15.93:0/3512795130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc06d9c0 0x7fa2cc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 -- 172.21.15.93:0/3512795130 >> v1:172.21.15.125:6789/0 conn(0x7fa2cc06c5f0 legacy=0x7fa2cc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.589+0000 7fa2d0ee8640 1 -- 172.21.15.93:0/3512795130 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc06d1c0 con 0x7fa2cc0ade00 2023-11-04T01:41:42.592 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d0ee8640 1 --2- 172.21.15.93:0/3512795130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc0ade00 0x7fa2cc0b0530 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55177da99e5426e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2cb7fe640 1 -- 172.21.15.93:0/3512795130 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0031740 con 0x7fa2cc0ade00 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2cb7fe640 1 -- 172.21.15.93:0/3512795130 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00318a0 con 0x7fa2cc0ade00 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2cb7fe640 1 -- 172.21.15.93:0/3512795130 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0031c30 con 0x7fa2cc0ade00 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 -- 172.21.15.93:0/3512795130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc0ade00 msgr2=0x7fa2cc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 --2- 172.21.15.93:0/3512795130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc0ade00 0x7fa2cc0b0530 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002b7e0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 -- 172.21.15.93:0/3512795130 shutdown_connections 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 --2- 172.21.15.93:0/3512795130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc06d9c0 0x7fa2cc0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 --2- 172.21.15.93:0/3512795130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc0ade00 0x7fa2cc0b0530 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 -- 172.21.15.93:0/3512795130 >> 172.21.15.93:0/3512795130 conn(0x7fa2cc0cb530 msgr2=0x7fa2cc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 -- 172.21.15.93:0/3512795130 shutdown_connections 2023-11-04T01:41:42.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.590+0000 7fa2d314c640 1 -- 172.21.15.93:0/3512795130 wait complete. 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 Processor -- start 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 -- start start 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2cc06c5f0 0x7fa2cc153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 0x7fa2cc159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1f51b0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc154120 con 0x7fa2cc06c5f0 2023-11-04T01:41:42.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.592+0000 7fa2d314c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1f42c0 con 0x7fa2cc0ade00 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35472/0 (socket says 172.21.15.93:35472) 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 -- 172.21.15.93:0/2118218481 learned_addr learned my addr 172.21.15.93:0/2118218481 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2d0ee8640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2cc06c5f0 0x7fa2cc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2d16e9640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 0x7fa2cc159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 -- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 msgr2=0x7fa2cc159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 0x7fa2cc159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 -- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2cc06c5f0 msgr2=0x7fa2cc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2cc06c5f0 0x7fa2cc153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 -- 172.21.15.93:0/2118218481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00094d0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2d16e9640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 0x7fa2cc159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:42.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2cbfff640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800b410 tx=0x7fa2b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011830 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b8011990 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011d40 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc1f45a0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.593+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc1f4b60 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.594+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc1582b0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.595+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2b801a400 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.595+0000 7fa2c97fa640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 0x7fa2b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.595+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7fa2b8089d70 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.598 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.595+0000 7fa2d0ee8640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 0x7fa2b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.599 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.595+0000 7fa2d0ee8640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 0x7fa2b006d360 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0035000 tx=0x7fa2c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.600 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.599+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2b80546b0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.800+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2cc0684b0 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.800+0000 7fa2c97fa640 1 -- 172.21.15.93:0/2118218481 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fa2b8015090 con 0x7fa2cc06d9c0 2023-11-04T01:41:42.802 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:42.802 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:36.805166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:42.802 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 86 2023-11-04T01:41:42.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 msgr2=0x7fa2b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 0x7fa2b006d360 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0035000 tx=0x7fa2c0008030 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 msgr2=0x7fa2cc1599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800b410 tx=0x7fa2b800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 shutdown_connections 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa2b006aea0 0x7fa2b006d360 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2cc0ade00 0x7fa2cc159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2cc06d9c0 0x7fa2cc1599c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 --2- 172.21.15.93:0/2118218481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2cc06c5f0 0x7fa2cc153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 >> 172.21.15.93:0/2118218481 conn(0x7fa2cc0cb530 msgr2=0x7fa2cc0710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 shutdown_connections 2023-11-04T01:41:42.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.802+0000 7fa2d314c640 1 -- 172.21.15.93:0/2118218481 wait complete. 2023-11-04T01:41:42.814 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:41:42.814 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32469654083251953s 2023-11-04T01:41:42.815 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:42.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.913+0000 7fdcbcc10640 1 Processor -- start 2023-11-04T01:41:42.914 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.913+0000 7fdcbcc10640 1 -- start start 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcbcc10640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdcb8159e40 0x7fdcb80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcbcc10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb806bb60 0x7fdcb80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcbcc10640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb8071500 con 0x7fdcb806fff0 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcbcc10640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb815dae0 con 0x7fdcb8159e40 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcbcc10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8070c60 con 0x7fdcb806bb60 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb659c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdcb8159e40 0x7fdcb80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdcb806fff0 0x7fdcb8070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:36106/0 (socket says 172.21.15.93:36106) 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb6d9d640 1 -- 172.21.15.93:0/189176040 learned_addr learned my addr 172.21.15.93:0/189176040 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:42.916 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb659c640 1 -- 172.21.15.93:0/189176040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb806bb60 msgr2=0x7fdcb80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb659c640 1 --2- 172.21.15.93:0/189176040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb806bb60 0x7fdcb80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb659c640 1 -- 172.21.15.93:0/189176040 >> v1:172.21.15.93:6789/0 conn(0x7fdcb806fff0 legacy=0x7fdcb8070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.914+0000 7fdcb659c640 1 -- 172.21.15.93:0/189176040 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb8070f40 con 0x7fdcb8159e40 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcb659c640 1 --2- 172.21.15.93:0/189176040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb8159e40 0x7fdcb80b0530 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fdca80097a0 tx=0x7fdca802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ce291dd4a34d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcb5d9b640 1 -- 172.21.15.93:0/189176040 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca802e070 con 0x7fdcb8159e40 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcb5d9b640 1 -- 172.21.15.93:0/189176040 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca80315a0 con 0x7fdcb8159e40 2023-11-04T01:41:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcb5d9b640 1 -- 172.21.15.93:0/189176040 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8031930 con 0x7fdcb8159e40 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 -- 172.21.15.93:0/189176040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb8159e40 msgr2=0x7fdcb80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/189176040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb8159e40 0x7fdcb80b0530 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fdca80097a0 tx=0x7fdca802b840 comp rx=0 tx=0).stop 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 -- 172.21.15.93:0/189176040 shutdown_connections 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/189176040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb806bb60 0x7fdcb80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/189176040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb8159e40 0x7fdcb80b0530 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 -- 172.21.15.93:0/189176040 >> 172.21.15.93:0/189176040 conn(0x7fdcb80cb530 msgr2=0x7fdcb80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.918 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 -- 172.21.15.93:0/189176040 shutdown_connections 2023-11-04T01:41:42.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.915+0000 7fdcbcc10640 1 -- 172.21.15.93:0/189176040 wait complete. 2023-11-04T01:41:42.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 Processor -- start 2023-11-04T01:41:42.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 -- start start 2023-11-04T01:41:42.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcb806bb60 0x7fdcb80c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb8159e40 0x7fdcb80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8157940 con 0x7fdcb806fff0 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c74c0 con 0x7fdcb806bb60 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.917+0000 7fdcbcc10640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c77a0 con 0x7fdcb8159e40 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35488/0 (socket says 172.21.15.93:35488) 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 -- 172.21.15.93:0/4080595111 learned_addr learned my addr 172.21.15.93:0/4080595111 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcb6d9d640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb8159e40 0x7fdcb80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcb659c640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcb806bb60 0x7fdcb80c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 -- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb8159e40 msgr2=0x7fdcb80c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb8159e40 0x7fdcb80c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.922 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 -- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcb806bb60 msgr2=0x7fdcb80c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcb806bb60 0x7fdcb80c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 -- 172.21.15.93:0/4080595111 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009400 con 0x7fdcb806fff0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaffff640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fdca000b4a0 tx=0x7fdca000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0010610 con 0x7fdcb806fff0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0010770 con 0x7fdcb806fff0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb80c7a80 con 0x7fdcb806fff0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0010b20 con 0x7fdcb806fff0 2023-11-04T01:41:42.924 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.918+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb81575d0 con 0x7fdcb806fff0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.919+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb80c7320 con 0x7fdcb806fff0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.920+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdca0010c80 con 0x7fdcb806fff0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.920+0000 7fdcaeffd640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 0x7fdc9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.920+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7fdca00899a0 con 0x7fdcb806fff0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.920+0000 7fdcb659c640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 0x7fdc9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.920+0000 7fdcb659c640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 0x7fdc9806d330 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdca8036000 tx=0x7fdca803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.925 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:42.924+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcb80c7320 con 0x7fdcb806fff0 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.138+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcb80c7320 con 0x7fdcb806fff0 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.139+0000 7fdcaeffd640 1 -- 172.21.15.93:0/4080595111 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fdcb80c7320 con 0x7fdcb806fff0 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:36.805166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":5750},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5750":{"gid":5750,"name":"b","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.125:6835/1185165139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":1185165139},{"type":"v1","addr":"172.21.15.125:6835","nonce":1185165139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 86 2023-11-04T01:41:43.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 msgr2=0x7fdc9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 0x7fdc9806d330 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdca8036000 tx=0x7fdca803d040 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 msgr2=0x7fdcb80c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fdca000b4a0 tx=0x7fdca000b960 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 shutdown_connections 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdc9806ae70 0x7fdc9806d330 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdcb8159e40 0x7fdcb80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdcb806fff0 0x7fdcb80c3b50 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 --2- 172.21.15.93:0/4080595111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcb806bb60 0x7fdcb80c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 >> 172.21.15.93:0/4080595111 conn(0x7fdcb80cb530 msgr2=0x7fdcb815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 shutdown_connections 2023-11-04T01:41:43.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.141+0000 7fdcbcc10640 1 -- 172.21.15.93:0/4080595111 wait complete. 2023-11-04T01:41:43.153 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:41:43.273 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[{"version":19,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:41:19.329302+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:41:43.273 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:41:19.329302+0000" }, "version": 19 } ], "snaps": [] } 2023-11-04T01:41:43.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:41:43.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 Processor -- start 2023-11-04T01:41:43.375 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 -- start start 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 0x7f76640b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f766406bb60 0x7f76640b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 0x7f7664070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7664071500 con 0x7f766406bb60 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766415dae0 con 0x7f7664159e40 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.374+0000 7f7669fd7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76640709a0 con 0x7f766406fff0 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f766406bb60 0x7f76640b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f766406bb60 0x7f76640b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35500/0 (socket says 172.21.15.93:35500) 2023-11-04T01:41:43.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 -- 172.21.15.93:0/207845809 learned_addr learned my addr 172.21.15.93:0/207845809 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f76637fe640 1 --2- 172.21.15.93:0/207845809 >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 0x7f76640b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 -- 172.21.15.93:0/207845809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 msgr2=0x7f7664070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f7663fff640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 0x7f7664070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 0x7f7664070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 -- 172.21.15.93:0/207845809 >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 msgr2=0x7f76640b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 --2- 172.21.15.93:0/207845809 >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 0x7f76640b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f765affd640 1 -- 172.21.15.93:0/207845809 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664070c60 con 0x7f766406bb60 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f76637fe640 1 --2- 172.21.15.93:0/207845809 >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 0x7f76640b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.375+0000 7f7663fff640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 0x7f7664070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f765affd640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406bb60 0x7f76640b0a70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f76640ce7f0 tx=0x7f764c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557d9c277d38b835 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7662ffd640 1 -- 172.21.15.93:0/207845809 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0317d0 con 0x7f766406bb60 2023-11-04T01:41:43.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7662ffd640 1 -- 172.21.15.93:0/207845809 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c031930 con 0x7f766406bb60 2023-11-04T01:41:43.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7662ffd640 1 -- 172.21.15.93:0/207845809 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c031cc0 con 0x7f766406bb60 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 -- 172.21.15.93:0/207845809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406bb60 msgr2=0x7f76640b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406bb60 0x7f76640b0a70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f76640ce7f0 tx=0x7f764c02b870 comp rx=0 tx=0).stop 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 -- 172.21.15.93:0/207845809 shutdown_connections 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406bb60 0x7f76640b0a70 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 --2- 172.21.15.93:0/207845809 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f766406fff0 0x7f7664070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 --2- 172.21.15.93:0/207845809 >> v2:172.21.15.125:3300/0 conn(0x7f7664159e40 0x7f76640b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 -- 172.21.15.93:0/207845809 >> 172.21.15.93:0/207845809 conn(0x7f76640cb530 msgr2=0x7f76640cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 -- 172.21.15.93:0/207845809 shutdown_connections 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.376+0000 7f7669fd7640 1 -- 172.21.15.93:0/207845809 wait complete. 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.377+0000 7f7669fd7640 1 Processor -- start 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 -- start start 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766406bb60 0x7f766414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7664159e40 0x7f76640c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766414e410 con 0x7f766406fff0 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640c4580 con 0x7f766406bb60 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f7669fd7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76640c2fa0 con 0x7f7664159e40 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f765affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f765affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35514/0 (socket says 172.21.15.93:35514) 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.378+0000 7f765affd640 1 -- 172.21.15.93:0/1499600134 learned_addr learned my addr 172.21.15.93:0/1499600134 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:43.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f76637fe640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766406bb60 0x7f766414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7663fff640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7664159e40 0x7f76640c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 -- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7664159e40 msgr2=0x7f76640c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7664159e40 0x7f76640c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 -- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766406bb60 msgr2=0x7f766414ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766406bb60 0x7f766414ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 -- 172.21.15.93:0/1499600134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0094d0 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f765affd640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f764c000c00 tx=0x7f764c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0328f0 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c032a70 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76640c3280 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c032e20 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.379+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76640c3840 con 0x7f766406fff0 2023-11-04T01:41:43.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.380+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76640684b0 con 0x7f766406fff0 2023-11-04T01:41:43.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.381+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f764c030070 con 0x7f766406fff0 2023-11-04T01:41:43.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.381+0000 7f7660ff9640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 0x7f764806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.381+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f764c0ab8b0 con 0x7f766406fff0 2023-11-04T01:41:43.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.381+0000 7f76637fe640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 0x7f764806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.381+0000 7f76637fe640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 0x7f764806d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f765400ab60 tx=0x7f7654008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.385+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f764c0762a0 con 0x7f766406fff0 2023-11-04T01:41:43.619 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.617+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f76640c9750 con 0x7f766406fff0 2023-11-04T01:41:43.620 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.619+0000 7f7660ff9640 1 -- 172.21.15.93:0/1499600134 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 5750 v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f764c0798c0 con 0x7f766406fff0 2023-11-04T01:41:43.621 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 5750 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 msgr2=0x7f764806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 0x7f764806d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f765400ab60 tx=0x7f7654008040 comp rx=0 tx=0).stop 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 msgr2=0x7f76640c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f764c000c00 tx=0x7f764c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 shutdown_connections 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f764806ae70 0x7f764806d330 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7664159e40 0x7f76640c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f766406fff0 0x7f76640c4040 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 --2- 172.21.15.93:0/1499600134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766406bb60 0x7f766414ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.622+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 >> 172.21.15.93:0/1499600134 conn(0x7f76640cb530 msgr2=0x7f76640cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.623+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 shutdown_connections 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.623+0000 7f7669fd7640 1 -- 172.21.15.93:0/1499600134 wait complete. 2023-11-04T01:41:43.635 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:41:43.635 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:41:43.636 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:41:43.636 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:43.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:43.636 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:41:43.636 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:41:43.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:41:43.638 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:41:43.639 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:43.713 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:41:43.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.738+0000 7feaa9589640 1 Processor -- start 2023-11-04T01:41:43.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.738+0000 7feaa9589640 1 -- start start 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa9589640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feaa415d630 0x7feaa40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa9589640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40b0150 con 0x7feaa40b2210 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa9589640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40b1170 con 0x7feaa40ceda0 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa9589640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40b1df0 con 0x7feaa415d630 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feaa415d630 0x7feaa40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa27fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7feaa40b2210 0x7feaa40cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:36108/0 (socket says 172.21.15.93:36108) 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa27fc640 1 -- 172.21.15.93:0/3525917634 learned_addr learned my addr 172.21.15.93:0/3525917634 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feaa415d630 0x7feaa40cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35518/0 (socket says 172.21.15.93:35518) 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa37fe640 1 -- 172.21.15.93:0/3525917634 >> v1:172.21.15.125:6789/0 conn(0x7feaa40ceda0 legacy=0x7feaa415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa37fe640 1 -- 172.21.15.93:0/3525917634 >> v1:172.21.15.93:6789/0 conn(0x7feaa40b2210 legacy=0x7feaa40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.739+0000 7feaa37fe640 1 -- 172.21.15.93:0/3525917634 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40b1450 con 0x7feaa415d630 2023-11-04T01:41:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.740+0000 7feaa37fe640 1 --2- 172.21.15.93:0/3525917634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa40cf890 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0097a0 tx=0x7fea9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a75a35858a1de3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.740+0000 7feaa1ffb640 1 -- 172.21.15.93:0/3525917634 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c02e070 con 0x7feaa415d630 2023-11-04T01:41:43.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.740+0000 7feaa1ffb640 1 -- 172.21.15.93:0/3525917634 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c0315a0 con 0x7feaa415d630 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.740+0000 7feaa1ffb640 1 -- 172.21.15.93:0/3525917634 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c031930 con 0x7feaa415d630 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 -- 172.21.15.93:0/3525917634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 msgr2=0x7feaa40cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 --2- 172.21.15.93:0/3525917634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa40cf890 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0097a0 tx=0x7fea9c02b840 comp rx=0 tx=0).stop 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 -- 172.21.15.93:0/3525917634 shutdown_connections 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 --2- 172.21.15.93:0/3525917634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa40cf890 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 -- 172.21.15.93:0/3525917634 >> 172.21.15.93:0/3525917634 conn(0x7feaa40d0c30 msgr2=0x7feaa40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 -- 172.21.15.93:0/3525917634 shutdown_connections 2023-11-04T01:41:43.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.741+0000 7feaa9589640 1 -- 172.21.15.93:0/3525917634 wait complete. 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.742+0000 7feaa9589640 1 Processor -- start 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.742+0000 7feaa9589640 1 -- start start 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaa40b2210 0x7feaa40ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feaa40ceda0 0x7feaa4159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40ca450 con 0x7feaa415d630 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c97d0 con 0x7feaa40b2210 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa9589640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c9ab0 con 0x7feaa40ceda0 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35524/0 (socket says 172.21.15.93:35524) 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 -- 172.21.15.93:0/3350204850 learned_addr learned my addr 172.21.15.93:0/3350204850 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa27fc640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feaa40ceda0 0x7feaa4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa2ffd640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaa40b2210 0x7feaa40ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 -- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feaa40ceda0 msgr2=0x7feaa4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feaa40ceda0 0x7feaa4159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 -- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaa40b2210 msgr2=0x7feaa40ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaa40b2210 0x7feaa40ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.743+0000 7feaa37fe640 1 -- 172.21.15.93:0/3350204850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009400 con 0x7feaa415d630 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7feaa37fe640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fea9c034040 tx=0x7fea9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c032840 con 0x7feaa415d630 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c0329a0 con 0x7feaa415d630 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40c9d90 con 0x7feaa415d630 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c032d50 con 0x7feaa415d630 2023-11-04T01:41:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.744+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa40b47a0 con 0x7feaa415d630 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.745+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa40b4990 con 0x7feaa415d630 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.745+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea9c04d3f0 con 0x7feaa415d630 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.746+0000 7fea8b7fe640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 0x7fea9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.746+0000 7feaa2ffd640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 0x7fea9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.746+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fea9c0ab7f0 con 0x7feaa415d630 2023-11-04T01:41:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.746+0000 7feaa2ffd640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 0x7fea9006d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fea94001330 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.750+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feaa40b4990 con 0x7feaa415d630 2023-11-04T01:41:43.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.952+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaa40ca590 con 0x7feaa415d630 2023-11-04T01:41:43.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.953+0000 7fea8b7fe640 1 -- 172.21.15.93:0/3350204850 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4144 (secure 0 0 0) 0x7feaa40ca590 con 0x7feaa415d630 2023-11-04T01:41:43.954 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:43.954 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:43.623465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:replay","state_seq":1,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:43.955 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 88 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 msgr2=0x7fea9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 0x7fea9006d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fea94001330 tx=0x7fea94009040 comp rx=0 tx=0).stop 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 msgr2=0x7feaa415a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fea9c034040 tx=0x7fea9c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 shutdown_connections 2023-11-04T01:41:43.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fea9006ae70 0x7fea9006d330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feaa415d630 0x7feaa415a1d0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feaa40ceda0 0x7feaa4159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 --2- 172.21.15.93:0/3350204850 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feaa40b2210 0x7feaa40ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 >> 172.21.15.93:0/3350204850 conn(0x7feaa40d0c30 msgr2=0x7feaa40af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 shutdown_connections 2023-11-04T01:41:43.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:43.955+0000 7feaa9589640 1 -- 172.21.15.93:0/3350204850 wait complete. 2023-11-04T01:41:43.967 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:46.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:41:48.967 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:49.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.084+0000 7f4758661640 1 Processor -- start 2023-11-04T01:41:49.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.084+0000 7f4758661640 1 -- start start 2023-11-04T01:41:49.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.085+0000 7f4758661640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.085+0000 7f4758661640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f475006ca60 0x7f475006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.085+0000 7f4758661640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500cb5d0 con 0x7f47500b2160 2023-11-04T01:41:49.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.085+0000 7f4758661640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475006d430 con 0x7f475006ca60 2023-11-04T01:41:49.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.085+0000 7f4758661640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475006f3f0 con 0x7f475015b330 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f47563fd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4756bfe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f475006ca60 0x7f475006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f47563fd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:39264/0 (socket says 172.21.15.93:39264) 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4755bfc640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f47500b2160 0x7f475006ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:40770/0 (socket says 172.21.15.93:40770) 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f47563fd640 1 -- 172.21.15.93:0/339491148 learned_addr learned my addr 172.21.15.93:0/339491148 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4756bfe640 1 -- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 msgr2=0x7f47500cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4756bfe640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4756bfe640 1 -- 172.21.15.93:0/339491148 >> v1:172.21.15.125:6789/0 conn(0x7f47500b2160 legacy=0x7f475006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f4756bfe640 1 -- 172.21.15.93:0/339491148 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500c3490 con 0x7f475006ca60 2023-11-04T01:41:49.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.086+0000 7f47563fd640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.087+0000 7f4756bfe640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f475006cef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47480097a0 tx=0x7f474802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f787432bc81415 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.087+0000 7f47553fb640 1 -- 172.21.15.93:0/339491148 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748031830 con 0x7f475006ca60 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.087+0000 7f47553fb640 1 -- 172.21.15.93:0/339491148 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4748031990 con 0x7f475006ca60 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.087+0000 7f47553fb640 1 -- 172.21.15.93:0/339491148 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748031d20 con 0x7f475006ca60 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 -- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 msgr2=0x7f475006cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f475006cef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47480097a0 tx=0x7f474802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 -- 172.21.15.93:0/339491148 shutdown_connections 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f475006cef0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.090 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 --2- 172.21.15.93:0/339491148 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47500cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 -- 172.21.15.93:0/339491148 >> 172.21.15.93:0/339491148 conn(0x7f47500b1640 msgr2=0x7f47500b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 -- 172.21.15.93:0/339491148 shutdown_connections 2023-11-04T01:41:49.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.088+0000 7f4758661640 1 -- 172.21.15.93:0/339491148 wait complete. 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.089+0000 7f4758661640 1 Processor -- start 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.089+0000 7f4758661640 1 -- start start 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f47500c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47501442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750144800 con 0x7f47500b2160 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47500c9b00 con 0x7f475006ca60 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4758661640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47501560d0 con 0x7f475015b330 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4755bfc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4755bfc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35536/0 (socket says 172.21.15.93:35536) 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4755bfc640 1 -- 172.21.15.93:0/1139566987 learned_addr learned my addr 172.21.15.93:0/1139566987 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f4756bfe640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47501442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.090+0000 7f47563fd640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f47500c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 -- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 msgr2=0x7f47501442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47501442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 -- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 msgr2=0x7f47500c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f47500c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 -- 172.21.15.93:0/1139566987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009b30 con 0x7f47500b2160 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4755bfc640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f474000c3e0 tx=0x7f474000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400074e0 con 0x7f47500b2160 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740007640 con 0x7f47500b2160 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4748009400 con 0x7f47500b2160 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400049e0 con 0x7f47500b2160 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.091+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4750156690 con 0x7f47500b2160 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.092+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475006da20 con 0x7f47500b2160 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.092+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4740004b40 con 0x7f47500b2160 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.093+0000 7f4746ffd640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 0x7f473406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.093+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f4740089780 con 0x7f47500b2160 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.093+0000 7f47563fd640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 0x7f473406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.093+0000 7f47563fd640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 0x7f473406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f474c009320 tx=0x7f474c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.097+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4740053fe0 con 0x7f47500b2160 2023-11-04T01:41:49.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.299+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f475006dc50 con 0x7f47500b2160 2023-11-04T01:41:49.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.300+0000 7f4746ffd640 1 -- 172.21.15.93:0/1139566987 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f4740057600 con 0x7f47500b2160 2023-11-04T01:41:49.301 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:49.302 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:44.633847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:49.302 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 90 2023-11-04T01:41:49.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 msgr2=0x7f473406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 0x7f473406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f474c009320 tx=0x7f474c00b040 comp rx=0 tx=0).stop 2023-11-04T01:41:49.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 msgr2=0x7f47500c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f474000c3e0 tx=0x7f474000c8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 shutdown_connections 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f473406ae70 0x7f473406d330 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f475015b330 0x7f47501442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47500b2160 0x7f47500c6c20 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 --2- 172.21.15.93:0/1139566987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f475006ca60 0x7f47500c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 >> 172.21.15.93:0/1139566987 conn(0x7f47500b1640 msgr2=0x7f47500b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 shutdown_connections 2023-11-04T01:41:49.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.302+0000 7f4758661640 1 -- 172.21.15.93:0/1139566987 wait complete. 2023-11-04T01:41:49.314 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:49.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:49.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.413+0000 7f460074c640 1 Processor -- start 2023-11-04T01:41:49.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.413+0000 7f460074c640 1 -- start start 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f460074c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45f80b0c40 0x7f45f806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f460074c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f8071500 con 0x7f45f806bb60 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f460074c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f815dae0 con 0x7f45f8159e40 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f460074c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8070c60 con 0x7f45f80b0c40 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f45fece9640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f45f806bb60 0x7f45f80cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:36114/0 (socket says 172.21.15.93:36114) 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.414+0000 7f45fece9640 1 -- 172.21.15.93:0/3933161443 learned_addr learned my addr 172.21.15.93:0/3933161443 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874945226 0 0) 0x7f45f8071500 con 0x7f45f806bb60 2023-11-04T01:41:49.418 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e4003520 con 0x7f45f806bb60 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fdce7640 1 --2- 172.21.15.93:0/3933161443 >> v2:172.21.15.125:3300/0 conn(0x7f45f80b0c40 0x7f45f806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101420066 0 0) 0x7f45e4003520 con 0x7f45f806bb60 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 >> v2:172.21.15.125:3300/0 conn(0x7f45f80b0c40 msgr2=0x7f45f806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 --2- 172.21.15.93:0/3933161443 >> v2:172.21.15.125:3300/0 conn(0x7f45f80b0c40 0x7f45f806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 >> v1:172.21.15.125:6789/0 conn(0x7f45f8159e40 legacy=0x7f45f80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8070f40 con 0x7f45f806bb60 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f45f00019f0 con 0x7f45f806bb60 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 >> v1:172.21.15.93:6789/0 conn(0x7f45f806bb60 legacy=0x7f45f80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 0x7f45e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40047c0 0x7f45e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e40051d0 0x7f45e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8070c60 con 0x7f45e40039c0 2023-11-04T01:41:49.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e400c120 con 0x7f45e40047c0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e400c2e0 con 0x7f45e40051d0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 0x7f45e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fdce7640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40047c0 0x7f45e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fece9640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e40051d0 0x7f45e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 -- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e40051d0 msgr2=0x7f45e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45e40051d0 0x7f45e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 -- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40047c0 msgr2=0x7f45e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40047c0 0x7f45e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fe4e8640 1 -- 172.21.15.93:0/3933161443 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4003520 con 0x7f45e40039c0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.415+0000 7f45fece9640 1 -- 172.21.15.93:0/3933161443 reap_dead start 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.416+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 0x7f45e4003de0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001720 tx=0x7f45e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce44420a8dc079c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.416+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40052d0 con 0x7f45e40039c0 2023-11-04T01:41:49.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.416+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f402e050 con 0x7f45e40039c0 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.416+0000 7f45fd4e6640 1 -- 172.21.15.93:0/3933161443 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4003830 con 0x7f45e40039c0 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 -- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 msgr2=0x7f45e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 0x7f45e4003de0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001720 tx=0x7f45e40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 -- 172.21.15.93:0/3933161443 shutdown_connections 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 --2- 172.21.15.93:0/3933161443 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45e40039c0 0x7f45e4003de0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 -- 172.21.15.93:0/3933161443 >> 172.21.15.93:0/3933161443 conn(0x7f45f80cb530 msgr2=0x7f45f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 -- 172.21.15.93:0/3933161443 shutdown_connections 2023-11-04T01:41:49.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.417+0000 7f460074c640 1 -- 172.21.15.93:0/3933161443 wait complete. 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.418+0000 7f460074c640 1 Processor -- start 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.418+0000 7f460074c640 1 -- start start 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40039c0 0x7f45f8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 0x7f45f80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c5ea0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c6110 con 0x7f45e40039c0 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c63f0 con 0x7f45f80a9c40 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35564/0 (socket says 172.21.15.93:35564) 2023-11-04T01:41:49.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 -- 172.21.15.93:0/201561880 learned_addr learned my addr 172.21.15.93:0/201561880 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40039c0 0x7f45f8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fdce7640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 0x7f45f80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 -- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 msgr2=0x7f45f80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 0x7f45f80cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 -- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40039c0 msgr2=0x7f45f8156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40039c0 0x7f45f8156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 -- 172.21.15.93:0/201561880 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80c66d0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fdce7640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 0x7f45f80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45fece9640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ce990 tx=0x7f45f000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000eb90 con 0x7f45f80aa0c0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000ed10 con 0x7f45f80aa0c0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80c69b0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0013660 con 0x7f45f80aa0c0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.419+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f80c6ed0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.420+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f80684b0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.421+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45f00137c0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.421+0000 7f45eeffd640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 0x7f45dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.421+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f45f008a0f0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.421+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 0x7f45dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.422+0000 7f45fe4e8640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 0x7f45dc06d360 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45f4033000 tx=0x7f45f4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.426 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.425+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45f0058500 con 0x7f45f80aa0c0 2023-11-04T01:41:49.626 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.625+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45f80707e0 con 0x7f45f80aa0c0 2023-11-04T01:41:49.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.626+0000 7f45eeffd640 1 -- 172.21.15.93:0/201561880 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f45f0058090 con 0x7f45f80aa0c0 2023-11-04T01:41:49.627 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:49.627 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:44.633847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:49.627 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 90 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 msgr2=0x7f45dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 0x7f45dc06d360 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45f4033000 tx=0x7f45f4009030 comp rx=0 tx=0).stop 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 msgr2=0x7f45f80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ce990 tx=0x7f45f000e530 comp rx=0 tx=0).stop 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 shutdown_connections 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f45dc06aea0 0x7f45dc06d360 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45f80aa0c0 0x7f45f80ccbc0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f45f80a9c40 0x7f45f80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 --2- 172.21.15.93:0/201561880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45e40039c0 0x7f45f8156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 >> 172.21.15.93:0/201561880 conn(0x7f45f80cb530 msgr2=0x7f45f80cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 shutdown_connections 2023-11-04T01:41:49.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:49.628+0000 7f460074c640 1 -- 172.21.15.93:0/201561880 wait complete. 2023-11-04T01:41:49.640 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:41:50.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:50.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 Processor -- start 2023-11-04T01:41:50.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 -- start start 2023-11-04T01:41:50.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03cc15d100 0x7f03cc0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03cc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0b32b0 con 0x7f03cc0d3b60 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0cee10 con 0x7f03cc15d100 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.756+0000 7f03d1f16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b4750 con 0x7f03cc15d4e0 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03cbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f03cc0d3b60 0x7f03cc0cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:36126/0 (socket says 172.21.15.93:36126) 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03cbfff640 1 -- 172.21.15.93:0/4139791916 learned_addr learned my addr 172.21.15.93:0/4139791916 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03caffd640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03cc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/4139791916 >> v2:172.21.15.125:3300/0 conn(0x7f03cc15d100 0x7f03cc0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023662926 0 0) 0x7f03cc0b32b0 con 0x7f03cc0d3b60 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b8003520 con 0x7f03cc0d3b60 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904787937 0 0) 0x7f03b8003520 con 0x7f03cc0d3b60 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 msgr2=0x7f03cc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03cc0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 >> v2:172.21.15.125:3300/0 conn(0x7f03cc15d100 msgr2=0x7f03cc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 --2- 172.21.15.93:0/4139791916 >> v2:172.21.15.125:3300/0 conn(0x7f03cc15d100 0x7f03cc0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0b2980 con 0x7f03cc0d3b60 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f03c4001670 con 0x7f03cc0d3b60 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 >> v1:172.21.15.93:6789/0 conn(0x7f03cc0d3b60 legacy=0x7f03cc0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b8004d00 0x7f03b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0cee10 con 0x7f03b8003970 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b4750 con 0x7f03b8004d00 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b800b980 con 0x7f03cc15d4e0 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03caffd640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.761 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.757+0000 7f03cbfff640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b8004d00 0x7f03b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 -- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 msgr2=0x7f03b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc15d4e0 0x7f03b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 -- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b8004d00 msgr2=0x7f03b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03b8004d00 0x7f03b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 -- 172.21.15.93:0/4139791916 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8003520 con 0x7f03b8003970 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.758+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03b8003d90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00e170 tx=0x7f03b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ea57c7aea9bf5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc02cca0 con 0x7f03b8003970 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00f040 con 0x7f03b8003970 2023-11-04T01:41:50.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03ca7fc640 1 -- 172.21.15.93:0/4139791916 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc034440 con 0x7f03b8003970 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 -- 172.21.15.93:0/4139791916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 msgr2=0x7f03b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 --2- 172.21.15.93:0/4139791916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03b8003d90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00e170 tx=0x7f03b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03cbfff640 1 -- 172.21.15.93:0/4139791916 reap_dead start 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 -- 172.21.15.93:0/4139791916 shutdown_connections 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 -- 172.21.15.93:0/4139791916 >> 172.21.15.93:0/4139791916 conn(0x7f03cc0d2ef0 msgr2=0x7f03cc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 -- 172.21.15.93:0/4139791916 shutdown_connections 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.759+0000 7f03d1f16640 1 -- 172.21.15.93:0/4139791916 wait complete. 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.760+0000 7f03d1f16640 1 Processor -- start 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 -- start start 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 0x7f03cc0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03cc1f3800 0x7f03cc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc15f3a0 con 0x7f03b8003970 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc15f5d0 con 0x7f03cc1f3800 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03d1f16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc15f870 con 0x7f03cc0b1d90 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35584/0 (socket says 172.21.15.93:35584) 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.761+0000 7f03cb7fe640 1 -- 172.21.15.93:0/2620653063 learned_addr learned my addr 172.21.15.93:0/2620653063 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03caffd640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 0x7f03cc0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cbfff640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03cc1f3800 0x7f03cc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 -- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 msgr2=0x7f03cc0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 0x7f03cc0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 -- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03cc1f3800 msgr2=0x7f03cc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03cc1f3800 0x7f03cc0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 -- 172.21.15.93:0/2620653063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc15fb50 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03caffd640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 0x7f03cc0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03cb7fe640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f03bc02c640 tx=0x7f03bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc034e50 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc040450 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc15fe30 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc040800 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.762+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc160630 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.763+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc0684b0 con 0x7f03b8003970 2023-11-04T01:41:50.767 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.764+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03bc040960 con 0x7f03b8003970 2023-11-04T01:41:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.764+0000 7f03c3fff640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 0x7f03ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.764+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f03bc0ac630 con 0x7f03b8003970 2023-11-04T01:41:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.764+0000 7f03caffd640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 0x7f03ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.765+0000 7f03caffd640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 0x7f03ac06d360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f03cc15c8a0 tx=0x7f03b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.769+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03bc076f20 con 0x7f03b8003970 2023-11-04T01:41:50.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.969+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03cc15f9b0 con 0x7f03b8003970 2023-11-04T01:41:50.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.970+0000 7f03c3fff640 1 -- 172.21.15.93:0/2620653063 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f03cc15f9b0 con 0x7f03b8003970 2023-11-04T01:41:50.971 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:50.971 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:44.633847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:50.972 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 90 2023-11-04T01:41:50.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 msgr2=0x7f03ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 0x7f03ac06d360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f03cc15c8a0 tx=0x7f03b4008040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 msgr2=0x7f03cc0ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f03bc02c640 tx=0x7f03bc009750 comp rx=0 tx=0).stop 2023-11-04T01:41:50.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 shutdown_connections 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f03ac06aea0 0x7f03ac06d360 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03cc1f3800 0x7f03cc0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f03cc0b1d90 0x7f03cc0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 --2- 172.21.15.93:0/2620653063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03b8003970 0x7f03cc0ca070 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 >> 172.21.15.93:0/2620653063 conn(0x7f03cc0d2ef0 msgr2=0x7f03cc0cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 shutdown_connections 2023-11-04T01:41:50.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:50.972+0000 7f03d1f16640 1 -- 172.21.15.93:0/2620653063 wait complete. 2023-11-04T01:41:50.984 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:41:51.984 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:52.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.103+0000 7f09c6c34640 1 Processor -- start 2023-11-04T01:41:52.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.103+0000 7f09c6c34640 1 -- start start 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09c6c34640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09c015b330 0x7f09c00cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09c6c34640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00cb5d0 con 0x7f09c00b2160 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09c6c34640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c006f3f0 con 0x7f09c006ca60 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09c6c34640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00c3490 con 0x7f09c015b330 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f09c00b2160 0x7f09c006ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43236/0 (socket says 172.21.15.93:43236) 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bffff640 1 -- 172.21.15.93:0/3714373171 learned_addr learned my addr 172.21.15.93:0/3714373171 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625598887 0 0) 0x7f09c00cb5d0 con 0x7f09c00b2160 2023-11-04T01:41:52.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09c49d0640 1 --2- 172.21.15.93:0/3714373171 >> v2:172.21.15.125:3300/0 conn(0x7f09c015b330 0x7f09c00cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a8003520 con 0x7f09c00b2160 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609758241 0 0) 0x7f09a8003520 con 0x7f09c00b2160 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 >> v2:172.21.15.125:3300/0 conn(0x7f09c015b330 msgr2=0x7f09c00cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 --2- 172.21.15.93:0/3714373171 >> v2:172.21.15.125:3300/0 conn(0x7f09c015b330 0x7f09c00cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 >> v1:172.21.15.125:6789/0 conn(0x7f09c006ca60 legacy=0x7f09c00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00cbfa0 con 0x7f09c00b2160 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f09b4001670 con 0x7f09c00b2160 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 >> v1:172.21.15.93:6789/0 conn(0x7f09c00b2160 legacy=0x7f09c006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8003970 0x7f09a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a80047c0 0x7f09a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 0x7f09a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c3490 con 0x7f09a8005180 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a800c020 con 0x7f09a80047c0 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.104+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a800c1e0 con 0x7f09a8003970 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 0x7f09a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09bffff640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a80047c0 0x7f09a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c49d0640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8003970 0x7f09a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 -- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8003970 msgr2=0x7f09a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8003970 0x7f09a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 -- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a80047c0 msgr2=0x7f09a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09a80047c0 0x7f09a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.105+0000 7f09c51d1640 1 -- 172.21.15.93:0/3714373171 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8003520 con 0x7f09a8005180 2023-11-04T01:41:52.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c51d1640 1 -- 172.21.15.93:0/3714373171 reap_dead start 2023-11-04T01:41:52.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c51d1640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 0x7f09a800b980 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f09b0001750 tx=0x7f09a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46239b53fec830d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00052d0 con 0x7f09a8005180 2023-11-04T01:41:52.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b002e050 con 0x7f09a8005180 2023-11-04T01:41:52.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09bf7fe640 1 -- 172.21.15.93:0/3714373171 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0003830 con 0x7f09a8005180 2023-11-04T01:41:52.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 -- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 msgr2=0x7f09a800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 0x7f09a800b980 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f09b0001750 tx=0x7f09a80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 -- 172.21.15.93:0/3714373171 shutdown_connections 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 --2- 172.21.15.93:0/3714373171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09a8005180 0x7f09a800b980 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 -- 172.21.15.93:0/3714373171 >> 172.21.15.93:0/3714373171 conn(0x7f09c00b1640 msgr2=0x7f09c00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 -- 172.21.15.93:0/3714373171 shutdown_connections 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.106+0000 7f09c6c34640 1 -- 172.21.15.93:0/3714373171 wait complete. 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.108+0000 7f09c6c34640 1 Processor -- start 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.108+0000 7f09c6c34640 1 -- start start 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8005180 0x7f09c01f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01588a0 0x7f09c00b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0158d20 con 0x7f09c015ce20 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00b3650 con 0x7f09c01588a0 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00b3370 con 0x7f09a8005180 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39502/0 (socket says 172.21.15.93:39502) 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 -- 172.21.15.93:0/771432567 learned_addr learned my addr 172.21.15.93:0/771432567 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c49d0640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8005180 0x7f09c01f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c51d1640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01588a0 0x7f09c00b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 -- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8005180 msgr2=0x7f09c01f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8005180 0x7f09c01f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 -- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01588a0 msgr2=0x7f09c00b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01588a0 0x7f09c00b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 -- 172.21.15.93:0/771432567 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00b3dc0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bffff640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f09b4007290 tx=0x7f09b4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4004ea0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400f9c0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c00b40a0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400fd90 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.109+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c015d2a0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.110+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c006da20 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.111+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09b401d460 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.111+0000 7f09bd7fa640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.111+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f09b4089dc0 con 0x7f09c015ce20 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.111+0000 7f09c49d0640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.112+0000 7f09c49d0640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f09b8014450 tx=0x7f09b800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.116+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09b4054730 con 0x7f09c015ce20 2023-11-04T01:41:52.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.318+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09c00b45c0 con 0x7f09c015ce20 2023-11-04T01:41:52.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.319+0000 7f09bd7fa640 1 -- 172.21.15.93:0/771432567 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f09c00b45c0 con 0x7f09c015ce20 2023-11-04T01:41:52.320 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:52.321 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:44.633847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:52.321 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 90 2023-11-04T01:41:52.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 msgr2=0x7f09ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 0x7f09ac06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f09b8014450 tx=0x7f09b800b040 comp rx=0 tx=0).stop 2023-11-04T01:41:52.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 msgr2=0x7f09c0158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f09b4007290 tx=0x7f09b4007750 comp rx=0 tx=0).stop 2023-11-04T01:41:52.322 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 shutdown_connections 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f09ac06ae70 0x7f09ac06d330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09c01588a0 0x7f09c00b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09c015ce20 0x7f09c0158360 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 --2- 172.21.15.93:0/771432567 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f09a8005180 0x7f09c01f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 >> 172.21.15.93:0/771432567 conn(0x7f09c00b1640 msgr2=0x7f09c00b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 shutdown_connections 2023-11-04T01:41:52.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:52.321+0000 7f09c6c34640 1 -- 172.21.15.93:0/771432567 wait complete. 2023-11-04T01:41:52.333 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:41:52.350 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:52.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:53.335 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:53.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.443+0000 7f8a5e961640 1 Processor -- start 2023-11-04T01:41:53.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.443+0000 7f8a5e961640 1 -- start start 2023-11-04T01:41:53.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5e961640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a5806c5f0 0x7f8a58165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5e961640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5806cc90 con 0x7f8a580ade00 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5e961640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580b0e60 con 0x7f8a5806d9c0 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5e961640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580b0c40 con 0x7f8a5806c5f0 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a57fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8a580ade00 0x7f8a580b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43244/0 (socket says 172.21.15.93:43244) 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5cefe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a5806c5f0 0x7f8a58165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a57fff640 1 -- 172.21.15.93:0/880817619 learned_addr learned my addr 172.21.15.93:0/880817619 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.444+0000 7f8a5cefe640 1 -- 172.21.15.93:0/880817619 >> v1:172.21.15.125:6789/0 conn(0x7f8a5806d9c0 legacy=0x7f8a580710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a5cefe640 1 -- 172.21.15.93:0/880817619 >> v1:172.21.15.93:6789/0 conn(0x7f8a580ade00 legacy=0x7f8a580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a5cefe640 1 -- 172.21.15.93:0/880817619 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5806cee0 con 0x7f8a5806c5f0 2023-11-04T01:41:53.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a5cefe640 1 --2- 172.21.15.93:0/880817619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a5806c5f0 0x7f8a58165ce0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a5002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bca442be96cbb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a56ffd640 1 -- 172.21.15.93:0/880817619 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5002cbd0 con 0x7f8a5806c5f0 2023-11-04T01:41:53.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a56ffd640 1 -- 172.21.15.93:0/880817619 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5002cd30 con 0x7f8a5806c5f0 2023-11-04T01:41:53.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.445+0000 7f8a56ffd640 1 -- 172.21.15.93:0/880817619 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5002cea0 con 0x7f8a5806c5f0 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 -- 172.21.15.93:0/880817619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a5806c5f0 msgr2=0x7f8a58165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 --2- 172.21.15.93:0/880817619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a5806c5f0 0x7f8a58165ce0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a5002be20 comp rx=0 tx=0).stop 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 -- 172.21.15.93:0/880817619 shutdown_connections 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 --2- 172.21.15.93:0/880817619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a5806c5f0 0x7f8a58165ce0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 -- 172.21.15.93:0/880817619 >> 172.21.15.93:0/880817619 conn(0x7f8a580cb530 msgr2=0x7f8a580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 -- 172.21.15.93:0/880817619 shutdown_connections 2023-11-04T01:41:53.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.446+0000 7f8a5e961640 1 -- 172.21.15.93:0/880817619 wait complete. 2023-11-04T01:41:53.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.447+0000 7f8a5e961640 1 Processor -- start 2023-11-04T01:41:53.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.447+0000 7f8a5e961640 1 -- start start 2023-11-04T01:41:53.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 0x7f8a580c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a5806d9c0 0x7f8a580c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58156730 con 0x7f8a580ade00 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c71d0 con 0x7f8a5806d9c0 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5e961640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c73e0 con 0x7f8a5806c5f0 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5cefe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5cefe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39526/0 (socket says 172.21.15.93:39526) 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a5cefe640 1 -- 172.21.15.93:0/3885278867 learned_addr learned my addr 172.21.15.93:0/3885278867 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.448+0000 7f8a57fff640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 0x7f8a580c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a577fe640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a5806d9c0 0x7f8a580c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 -- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 msgr2=0x7f8a580c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 0x7f8a580c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 -- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a5806d9c0 msgr2=0x7f8a580c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a5806d9c0 0x7f8a580c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 -- 172.21.15.93:0/3885278867 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50009a70 con 0x7f8a580ade00 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a57fff640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 0x7f8a580c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5cefe640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5002cea0 con 0x7f8a580ade00 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50040450 con 0x7f8a580ade00 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580c76c0 con 0x7f8a580ade00 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a500407e0 con 0x7f8a580ade00 2023-11-04T01:41:53.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.449+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a580c7c80 con 0x7f8a580ade00 2023-11-04T01:41:53.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.450+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a580c7e70 con 0x7f8a580ade00 2023-11-04T01:41:53.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.451+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a50040940 con 0x7f8a580ade00 2023-11-04T01:41:53.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.451+0000 7f8a54ff9640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.451+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f8a500ac860 con 0x7f8a580ade00 2023-11-04T01:41:53.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.451+0000 7f8a57fff640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.451+0000 7f8a57fff640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8a48005880 tx=0x7f8a48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.455+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a500771e0 con 0x7f8a580ade00 2023-11-04T01:41:53.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.660+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a580684b0 con 0x7f8a580ade00 2023-11-04T01:41:53.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.660+0000 7f8a54ff9640 1 -- 172.21.15.93:0/3885278867 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8a5007a800 con 0x7f8a580ade00 2023-11-04T01:41:53.662 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:53.662 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:52.098305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:53.662 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 91 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 msgr2=0x7f8a4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8a48005880 tx=0x7f8a48009040 comp rx=0 tx=0).stop 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 msgr2=0x7f8a581446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009d90 tx=0x7f8a50004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 shutdown_connections 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8a4406ae70 0x7f8a4406d330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a580ade00 0x7f8a581446c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a5806d9c0 0x7f8a580c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 --2- 172.21.15.93:0/3885278867 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8a5806c5f0 0x7f8a580c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 >> 172.21.15.93:0/3885278867 conn(0x7f8a580cb530 msgr2=0x7f8a580b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 shutdown_connections 2023-11-04T01:41:53.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:53.662+0000 7f8a5e961640 1 -- 172.21.15.93:0/3885278867 wait complete. 2023-11-04T01:41:53.674 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:41:54.675 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:54.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.790+0000 7f6523c44640 1 Processor -- start 2023-11-04T01:41:54.791 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.790+0000 7f6523c44640 1 -- start start 2023-11-04T01:41:54.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f6523c44640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f651c0b0c40 0x7f651c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f6523c44640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c164e10 con 0x7f651c06d3d0 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f6523c44640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c1650b0 con 0x7f651c164a30 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f6523c44640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c165a50 con 0x7f651c0b0c40 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f65211df640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f651c0b0c40 0x7f651c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f65221e1640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f651c06d3d0 0x7f651c0cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43256/0 (socket says 172.21.15.93:43256) 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.791+0000 7f65221e1640 1 -- 172.21.15.93:0/1548648266 learned_addr learned my addr 172.21.15.93:0/1548648266 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.792+0000 7f65211df640 1 -- 172.21.15.93:0/1548648266 >> v1:172.21.15.125:6789/0 conn(0x7f651c164a30 legacy=0x7f651c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.792+0000 7f65211df640 1 -- 172.21.15.93:0/1548648266 >> v1:172.21.15.93:6789/0 conn(0x7f651c06d3d0 legacy=0x7f651c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.792+0000 7f65211df640 1 -- 172.21.15.93:0/1548648266 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c165390 con 0x7f651c0b0c40 2023-11-04T01:41:54.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f65211df640 1 --2- 172.21.15.93:0/1548648266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c0b0c40 0x7f651c06b9c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097a0 tx=0x7f650c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dcd4f5f4cfc61c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f65209de640 1 -- 172.21.15.93:0/1548648266 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c031830 con 0x7f651c0b0c40 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f65209de640 1 -- 172.21.15.93:0/1548648266 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c031990 con 0x7f651c0b0c40 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f65209de640 1 -- 172.21.15.93:0/1548648266 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c031d20 con 0x7f651c0b0c40 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 -- 172.21.15.93:0/1548648266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c0b0c40 msgr2=0x7f651c06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 --2- 172.21.15.93:0/1548648266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c0b0c40 0x7f651c06b9c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f650c0097a0 tx=0x7f650c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 -- 172.21.15.93:0/1548648266 shutdown_connections 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 --2- 172.21.15.93:0/1548648266 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c0b0c40 0x7f651c06b9c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 -- 172.21.15.93:0/1548648266 >> 172.21.15.93:0/1548648266 conn(0x7f651c0cb530 msgr2=0x7f651c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 -- 172.21.15.93:0/1548648266 shutdown_connections 2023-11-04T01:41:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.793+0000 7f6523c44640 1 -- 172.21.15.93:0/1548648266 wait complete. 2023-11-04T01:41:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 Processor -- start 2023-11-04T01:41:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 -- start start 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 0x7f651c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0b0c40 0x7f651c1f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0c3670 con 0x7f651c164a30 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0c3950 con 0x7f651c0b0c40 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.795+0000 7f6523c44640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0b2b50 con 0x7f651c06d3d0 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39554/0 (socket says 172.21.15.93:39554) 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 -- 172.21.15.93:0/948449689 learned_addr learned my addr 172.21.15.93:0/948449689 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65211df640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0b0c40 0x7f651c1f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65219e0640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 0x7f651c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 -- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 msgr2=0x7f651c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 0x7f651c0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 -- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0b0c40 msgr2=0x7f651c1f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0b0c40 0x7f651c1f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 -- 172.21.15.93:0/948449689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c009400 con 0x7f651c164a30 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65219e0640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 0x7f651c0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65221e1640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f651400ca80 tx=0x7f651400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651400ac30 con 0x7f651c164a30 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651400ad90 con 0x7f651c164a30 2023-11-04T01:41:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c0b2e30 con 0x7f651c164a30 2023-11-04T01:41:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514012600 con 0x7f651c164a30 2023-11-04T01:41:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.796+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c1f6ba0 con 0x7f651c164a30 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.797+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651c0b3020 con 0x7f651c164a30 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.798+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6514007070 con 0x7f651c164a30 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.798+0000 7f65127fc640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 0x7f650006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.798+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f6514089ae0 con 0x7f651c164a30 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.798+0000 7f65219e0640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 0x7f650006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.799+0000 7f65219e0640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 0x7f650006d360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6518007fd0 tx=0x7f6518009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:54.802+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65140544e0 con 0x7f651c164a30 2023-11-04T01:41:55.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.004+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f651c0684b0 con 0x7f651c164a30 2023-11-04T01:41:55.006 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.005+0000 7f65127fc640 1 -- 172.21.15.93:0/948449689 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f6514057b00 con 0x7f651c164a30 2023-11-04T01:41:55.006 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:53.090847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:55.006 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 92 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 msgr2=0x7f650006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 0x7f650006d360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6518007fd0 tx=0x7f6518009040 comp rx=0 tx=0).stop 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 msgr2=0x7f651c0c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f651400ca80 tx=0x7f651400cf40 comp rx=0 tx=0).stop 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 shutdown_connections 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f650006aea0 0x7f650006d360 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f651c164a30 0x7f651c0c2c20 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.008 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f651c0b0c40 0x7f651c1f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 --2- 172.21.15.93:0/948449689 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f651c06d3d0 0x7f651c0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.006+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 >> 172.21.15.93:0/948449689 conn(0x7f651c0cb530 msgr2=0x7f651c06bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.007+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 shutdown_connections 2023-11-04T01:41:55.009 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.007+0000 7f6523c44640 1 -- 172.21.15.93:0/948449689 wait complete. 2023-11-04T01:41:55.018 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:41:55.018 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.70465874671936s 2023-11-04T01:41:55.019 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 Processor -- start 2023-11-04T01:41:55.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 -- start start 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bd006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd015d4f0 con 0x7f6bd00b2100 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd006b9f0 con 0x7f6bd015d110 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.120+0000 7f6bd4bd0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00664f0 con 0x7f6bd00b3ca0 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bced9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6bd00b2100 0x7f6bd00b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43260/0 (socket says 172.21.15.93:43260) 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bced9d640 1 -- 172.21.15.93:0/2016241984 learned_addr learned my addr 172.21.15.93:0/2016241984 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bd006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768971631 0 0) 0x7f6bd015d4f0 con 0x7f6bd00b2100 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0003520 con 0x7f6bd00b2100 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506765010 0 0) 0x7f6bb0003520 con 0x7f6bd00b2100 2023-11-04T01:41:55.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 msgr2=0x7f6bd006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bd006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 >> v1:172.21.15.125:6789/0 conn(0x7f6bd015d110 legacy=0x7f6bd00ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd006c2e0 con 0x7f6bd00b2100 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6bc80019f0 con 0x7f6bd00b2100 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 >> v1:172.21.15.93:6789/0 conn(0x7f6bd00b2100 legacy=0x7f6bd00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb00039a0 0x7f6bb0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bb0004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bb0005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00664f0 con 0x7f6bb0004350 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb000b980 con 0x7f6bb00039a0 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb000bb40 con 0x7f6bd00b3ca0 2023-11-04T01:41:55.126 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bb0004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bce59c640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb00039a0 0x7f6bb0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.121+0000 7f6bced9d640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bb0005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 -- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 msgr2=0x7f6bb0005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00b3ca0 0x7f6bb0005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 -- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb00039a0 msgr2=0x7f6bb0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bb00039a0 0x7f6bb0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 -- 172.21.15.93:0/2016241984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0003520 con 0x7f6bb0004350 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bb0004820 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ac0 tx=0x7f6bb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de9dbcdd1155a7a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.122+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc002c6b0 con 0x7f6bb0004350 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc002c810 con 0x7f6bb0004350 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bcdd9b640 1 -- 172.21.15.93:0/2016241984 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc002cba0 con 0x7f6bb0004350 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/2016241984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 msgr2=0x7f6bb0004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.127 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/2016241984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bb0004820 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ac0 tx=0x7f6bb00057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bced9d640 1 -- 172.21.15.93:0/2016241984 reap_dead start 2023-11-04T01:41:55.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/2016241984 shutdown_connections 2023-11-04T01:41:55.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/2016241984 >> 172.21.15.93:0/2016241984 conn(0x7f6bd00cbd30 msgr2=0x7f6bd00cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/2016241984 shutdown_connections 2023-11-04T01:41:55.128 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.123+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/2016241984 wait complete. 2023-11-04T01:41:55.130 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 Processor -- start 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 -- start start 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0160090 0x7f6bd009aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00c9e80 0x7f6bd00ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00ca840 con 0x7f6bb0004350 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01f6560 con 0x7f6bd0160090 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bd4bd0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0160510 con 0x7f6bd00c9e80 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bce59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bce59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39558/0 (socket says 172.21.15.93:39558) 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bce59c640 1 -- 172.21.15.93:0/1404960639 learned_addr learned my addr 172.21.15.93:0/1404960639 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.125+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0160090 0x7f6bd009aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bced9d640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00c9e80 0x7f6bd00ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 -- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00c9e80 msgr2=0x7f6bd00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00c9e80 0x7f6bd00ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 -- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0160090 msgr2=0x7f6bd009aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0160090 0x7f6bd009aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 -- 172.21.15.93:0/1404960639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd009a0e0 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bce59c640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800f820 tx=0x7f6bb800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800fed0 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80052e0 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd01f5c30 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800d730 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.126+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd01f61f0 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.127+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd00684b0 con 0x7f6bb0004350 2023-11-04T01:41:55.132 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.127+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bb800d890 con 0x7f6bb0004350 2023-11-04T01:41:55.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.128+0000 7f6bc77fe640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 0x7f6bb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.128+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f6bb8089de0 con 0x7f6bb0004350 2023-11-04T01:41:55.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.128+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 0x7f6bb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.128+0000 7f6bc5d9b640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 0x7f6bb406d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ac0 tx=0x7f6bc0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.132+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bb8054660 con 0x7f6bb0004350 2023-11-04T01:41:55.147 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:55.147 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:55.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.330+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bd006af60 con 0x7f6bb0004350 2023-11-04T01:41:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.331+0000 7f6bc77fe640 1 -- 172.21.15.93:0/1404960639 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f6bb8057c80 con 0x7f6bb0004350 2023-11-04T01:41:55.333 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:53.090847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:55.333 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 92 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 msgr2=0x7f6bb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 0x7f6bb406d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ac0 tx=0x7f6bc0030000 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 msgr2=0x7f6bd0099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800f820 tx=0x7f6bb800fce0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 shutdown_connections 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6bb406ae70 0x7f6bb406d330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6bd00c9e80 0x7f6bd00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bd0160090 0x7f6bd009aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 --2- 172.21.15.93:0/1404960639 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb0004350 0x7f6bd0099a50 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 >> 172.21.15.93:0/1404960639 conn(0x7f6bd00cbd30 msgr2=0x7f6bd006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 shutdown_connections 2023-11-04T01:41:55.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.332+0000 7f6bd4bd0640 1 -- 172.21.15.93:0/1404960639 wait complete. 2023-11-04T01:41:55.345 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:55.470 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:41:55.470 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:55.470 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:55.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.567+0000 7fd84d56c640 1 Processor -- start 2023-11-04T01:41:55.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.567+0000 7fd84d56c640 1 -- start start 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd84d56c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd8480afda0 0x7fd8480cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd84d56c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 0x7fd8480ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd84d56c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480cf240 con 0x7fd84815b200 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd84d56c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480cdc20 con 0x7fd8480afda0 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd84d56c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480cde80 con 0x7fd8480cd7f0 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd8467fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd8480afda0 0x7fd8480cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd846ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd84815b200 0x7fd8480ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43266/0 (socket says 172.21.15.93:43266) 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd846ffd640 1 -- 172.21.15.93:0/4078947919 learned_addr learned my addr 172.21.15.93:0/4078947919 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.568+0000 7fd8467fc640 1 --2- 172.21.15.93:0/4078947919 >> v2:172.21.15.93:3300/0 conn(0x7fd8480afda0 0x7fd8480cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39564/0 (socket says 172.21.15.93:39564) 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8477fe640 1 --2- 172.21.15.93:0/4078947919 >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 0x7fd8480ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8467fc640 1 -- 172.21.15.93:0/4078947919 >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 msgr2=0x7fd8480ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8467fc640 1 --2- 172.21.15.93:0/4078947919 >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 0x7fd8480ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8467fc640 1 -- 172.21.15.93:0/4078947919 >> v1:172.21.15.93:6789/0 conn(0x7fd84815b200 legacy=0x7fd8480ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd845ffb640 1 -- 172.21.15.93:0/4078947919 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195657760 0 0) 0x7fd838001610 con 0x7fd84815b200 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8467fc640 1 -- 172.21.15.93:0/4078947919 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480cf670 con 0x7fd8480afda0 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8477fe640 1 --2- 172.21.15.93:0/4078947919 >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 0x7fd8480ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.569+0000 7fd8467fc640 1 --2- 172.21.15.93:0/4078947919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd8480cd2b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd8480711b0 tx=0x7fd83c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2824d0a6f16a71c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd845ffb640 1 -- 172.21.15.93:0/4078947919 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c02e070 con 0x7fd8480afda0 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd845ffb640 1 -- 172.21.15.93:0/4078947919 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0315a0 con 0x7fd8480afda0 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd845ffb640 1 -- 172.21.15.93:0/4078947919 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c031930 con 0x7fd8480afda0 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 -- 172.21.15.93:0/4078947919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 msgr2=0x7fd8480cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 --2- 172.21.15.93:0/4078947919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd8480cd2b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd8480711b0 tx=0x7fd83c02b840 comp rx=0 tx=0).stop 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 -- 172.21.15.93:0/4078947919 shutdown_connections 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 --2- 172.21.15.93:0/4078947919 >> v2:172.21.15.125:3300/0 conn(0x7fd8480cd7f0 0x7fd8480ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 --2- 172.21.15.93:0/4078947919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd8480cd2b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 -- 172.21.15.93:0/4078947919 >> 172.21.15.93:0/4078947919 conn(0x7fd8480d0c30 msgr2=0x7fd8480d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 -- 172.21.15.93:0/4078947919 shutdown_connections 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.570+0000 7fd84d56c640 1 -- 172.21.15.93:0/4078947919 wait complete. 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.571+0000 7fd84d56c640 1 Processor -- start 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.571+0000 7fd84d56c640 1 -- start start 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8480cd7f0 0x7fd84815e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 0x7fd8480ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c54a0 con 0x7fd8480afda0 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c5930 con 0x7fd8480cd7f0 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd84d56c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c4890 con 0x7fd84815b200 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39578/0 (socket says 172.21.15.93:39578) 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd846ffd640 1 -- 172.21.15.93:0/994435560 learned_addr learned my addr 172.21.15.93:0/994435560 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd8467fc640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8480cd7f0 0x7fd84815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.572+0000 7fd8477fe640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 0x7fd8480ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 -- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 msgr2=0x7fd8480ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 0x7fd8480ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 -- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8480cd7f0 msgr2=0x7fd84815e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8480cd7f0 0x7fd84815e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 -- 172.21.15.93:0/994435560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c009400 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd8477fe640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 0x7fd8480ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd846ffd640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c840 tx=0x7fd83800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800a640 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800a7a0 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800ab90 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c4b70 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.573+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480c5130 con 0x7fd8480afda0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.574+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480684b0 con 0x7fd8480afda0 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.574+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd83800acf0 con 0x7fd8480afda0 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.575+0000 7fd82f7fe640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.575+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7fd838089530 con 0x7fd8480afda0 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.575+0000 7fd8467fc640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.575+0000 7fd8467fc640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 0x7fd83406d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd83c036000 tx=0x7fd83c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.579+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd838053ef0 con 0x7fd8480afda0 2023-11-04T01:41:55.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.781+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8480cf240 con 0x7fd8480afda0 2023-11-04T01:41:55.783 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.781+0000 7fd82f7fe640 1 -- 172.21.15.93:0/994435560 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fd8480cf240 con 0x7fd8480afda0 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:53.090847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 92 2023-11-04T01:41:55.785 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 msgr2=0x7fd83406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 0x7fd83406d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd83c036000 tx=0x7fd83c03d040 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 msgr2=0x7fd84814e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c840 tx=0x7fd83800cd00 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 shutdown_connections 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd84815b200 0x7fd8480ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8480cd7f0 0x7fd84815e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 --2- 172.21.15.93:0/994435560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8480afda0 0x7fd84814e2c0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 >> 172.21.15.93:0/994435560 conn(0x7fd8480d0c30 msgr2=0x7fd8480d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 shutdown_connections 2023-11-04T01:41:55.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:55.783+0000 7fd84d56c640 1 -- 172.21.15.93:0/994435560 wait complete. 2023-11-04T01:41:55.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:41:55.915 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:55.915 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:41:55.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:55.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:55.915 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:41:55.943 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:41:55.943 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:55.998 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:56.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.136+0000 7f73ff7a5640 1 Processor -- start 2023-11-04T01:41:56.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.136+0000 7f73ff7a5640 1 -- start start 2023-11-04T01:41:56.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73ff7a5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73ff7a5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f73f8070700 0x7f73f80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73ff7a5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f8071500 con 0x7f73f806bb60 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73ff7a5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f815dae0 con 0x7f73f8070700 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73ff7a5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8070c60 con 0x7f73f8159e40 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:34932/0 (socket says 172.21.15.93:34932) 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 -- 172.21.15.93:0/1736530525 learned_addr learned my addr 172.21.15.93:0/1736530525 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fdd42640 1 --2- 172.21.15.93:0/1736530525 >> v2:172.21.15.125:3300/0 conn(0x7f73f8070700 0x7f73f80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 -- 172.21.15.93:0/1736530525 >> v2:172.21.15.125:3300/0 conn(0x7f73f8070700 msgr2=0x7f73f80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 --2- 172.21.15.93:0/1736530525 >> v2:172.21.15.125:3300/0 conn(0x7f73f8070700 0x7f73f80b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 -- 172.21.15.93:0/1736530525 >> v1:172.21.15.125:6789/0 conn(0x7f73f806bb60 legacy=0x7f73f806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.137+0000 7f73fd541640 1 -- 172.21.15.93:0/1736530525 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8070f40 con 0x7f73f8159e40 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.138+0000 7f73fd541640 1 --2- 172.21.15.93:0/1736530525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009870 tx=0x7f73f402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a9b25c3d52dfcaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.138+0000 7f73effff640 1 -- 172.21.15.93:0/1736530525 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4031640 con 0x7f73f8159e40 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.138+0000 7f73effff640 1 -- 172.21.15.93:0/1736530525 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f40317a0 con 0x7f73f8159e40 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.138+0000 7f73effff640 1 -- 172.21.15.93:0/1736530525 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4031b30 con 0x7f73f8159e40 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 -- 172.21.15.93:0/1736530525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 msgr2=0x7f73f80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/1736530525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009870 tx=0x7f73f402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 -- 172.21.15.93:0/1736530525 shutdown_connections 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/1736530525 >> v2:172.21.15.125:3300/0 conn(0x7f73f8070700 0x7f73f80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/1736530525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8159e40 0x7f73f80b0530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 -- 172.21.15.93:0/1736530525 >> 172.21.15.93:0/1736530525 conn(0x7f73f80cb530 msgr2=0x7f73f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 -- 172.21.15.93:0/1736530525 shutdown_connections 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.139+0000 7f73ff7a5640 1 -- 172.21.15.93:0/1736530525 wait complete. 2023-11-04T01:41:56.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.140+0000 7f73ff7a5640 1 Processor -- start 2023-11-04T01:41:56.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.140+0000 7f73ff7a5640 1 -- start start 2023-11-04T01:41:56.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73f806bb60 0x7f73f80aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8070700 0x7f73f81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8151f10 con 0x7f73f8159e40 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80af1c0 con 0x7f73f806bb60 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73ff7a5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80af4a0 con 0x7f73f8070700 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fd541640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73f806bb60 0x7f73f80aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39584/0 (socket says 172.21.15.93:39584) 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 -- 172.21.15.93:0/3387267267 learned_addr learned my addr 172.21.15.93:0/3387267267 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fcd40640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8070700 0x7f73f81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 -- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8070700 msgr2=0x7f73f81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8070700 0x7f73f81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 -- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73f806bb60 msgr2=0x7f73f80aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73f806bb60 0x7f73f80aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 -- 172.21.15.93:0/3387267267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40094d0 con 0x7f73f8159e40 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.141+0000 7f73fdd42640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f73f000efc0 tx=0x7f73f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.142+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0009ca0 con 0x7f73f8159e40 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.142+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000f040 con 0x7f73f8159e40 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.142+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80af780 con 0x7f73f8159e40 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.142+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00146c0 con 0x7f73f8159e40 2023-11-04T01:41:56.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.142+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80afd40 con 0x7f73f8159e40 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.143+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f80aff60 con 0x7f73f8159e40 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.143+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73f0014820 con 0x7f73f8159e40 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.143+0000 7f73edffb640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.144+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f73f008ac40 con 0x7f73f8159e40 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.144+0000 7f73fd541640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.144+0000 7f73fd541640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 0x7f73dc06d330 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f73f4036000 tx=0x7f73f403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.148+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73f0055570 con 0x7f73f8159e40 2023-11-04T01:41:56.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.314+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f80684b0 con 0x7f73f8159e40 2023-11-04T01:41:56.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.316+0000 7f73edffb640 1 -- 172.21.15.93:0/3387267267 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+23069 (secure 0 0 0) 0x7f73f0018070 con 0x7f73f8159e40 2023-11-04T01:41:56.318 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:41:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":109,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:41:55.095764+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.6","mappings":[{"from":0,"to":5}]},{"pgid":"17.9","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6836/3572539978":"2023-11-05T01:41:36.780916+0000","192.168.0.1:0/3671080369":"2023-11-04T02:41:51.893134+0000","172.21.15.93:6834/3572539978":"2023-11-05T01:41:36.780916+0000","172.21.15.125:6834/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.125:6832/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.93:6836/448915336":"2023-11-05T01:40:43.904647+0000","172.21.15.125:6835/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.125:6834/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6832/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.93:6836/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.125:6833/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6834/448915336":"2023-11-05T01:40:43.904647+0000","172.21.15.93:6834/2331318607":"2023-11-05T01:39:53.485629+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":5,"length":1}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 msgr2=0x7f73dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 0x7f73dc06d330 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f73f4036000 tx=0x7f73f403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 msgr2=0x7f73f80c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f73f000efc0 tx=0x7f73f000c490 comp rx=0 tx=0).stop 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 shutdown_connections 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73f8159e40 0x7f73f80c50d0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73f8070700 0x7f73f81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 --2- 172.21.15.93:0/3387267267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73f806bb60 0x7f73f80aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 >> 172.21.15.93:0/3387267267 conn(0x7f73f80cb530 msgr2=0x7f73f815dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 shutdown_connections 2023-11-04T01:41:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.318+0000 7f73ff7a5640 1 -- 172.21.15.93:0/3387267267 wait complete. 2023-11-04T01:41:56.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:10.941170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:11.841942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:56.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:56.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.431+0000 7f16bb16c640 1 Processor -- start 2023-11-04T01:41:56.434 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.431+0000 7f16bb16c640 1 -- start start 2023-11-04T01:41:56.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16bb16c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 0x7f16b40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16bb16c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b40b32b0 con 0x7f16b40d3b60 2023-11-04T01:41:56.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16bb16c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b40cee10 con 0x7f16b415d100 2023-11-04T01:41:56.435 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16bb16c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40cec20 con 0x7f16b415d4e0 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16b9709640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f16b40d3b60 0x7f16b40b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43276/0 (socket says 172.21.15.93:43276) 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.432+0000 7f16b9709640 1 -- 172.21.15.93:0/3363906410 learned_addr learned my addr 172.21.15.93:0/3363906410 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b3fff640 1 --2- 172.21.15.93:0/3363906410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 0x7f16b40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302125975 0 0) 0x7f16b40b32b0 con 0x7f16b40d3b60 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c003520 con 0x7f16b40d3b60 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991176097 0 0) 0x7f16b40cee10 con 0x7f16b415d100 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b40b32b0 con 0x7f16b415d100 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b3fff640 1 -- 172.21.15.93:0/3363906410 >> v1:172.21.15.125:6789/0 conn(0x7f16b415d100 legacy=0x7f16b40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b3fff640 1 -- 172.21.15.93:0/3363906410 >> v1:172.21.15.93:6789/0 conn(0x7f16b40d3b60 legacy=0x7f16b40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.433+0000 7f16b3fff640 1 -- 172.21.15.93:0/3363906410 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40b2980 con 0x7f16b415d4e0 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16b3fff640 1 --2- 172.21.15.93:0/3363906410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 0x7f16b40d14d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16a80097d0 tx=0x7f16a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03d65083c74fdde server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8031890 con 0x7f16b415d4e0 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a80319f0 con 0x7f16b415d4e0 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16b37fe640 1 -- 172.21.15.93:0/3363906410 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8031d80 con 0x7f16b415d4e0 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 -- 172.21.15.93:0/3363906410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 msgr2=0x7f16b40d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 --2- 172.21.15.93:0/3363906410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 0x7f16b40d14d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16a80097d0 tx=0x7f16a802b930 comp rx=0 tx=0).stop 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 -- 172.21.15.93:0/3363906410 shutdown_connections 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 --2- 172.21.15.93:0/3363906410 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d4e0 0x7f16b40d14d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 -- 172.21.15.93:0/3363906410 >> 172.21.15.93:0/3363906410 conn(0x7f16b40d2ef0 msgr2=0x7f16b40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 -- 172.21.15.93:0/3363906410 shutdown_connections 2023-11-04T01:41:56.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.434+0000 7f16bb16c640 1 -- 172.21.15.93:0/3363906410 wait complete. 2023-11-04T01:41:56.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 Processor -- start 2023-11-04T01:41:56.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 -- start start 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b40d3b60 0x7f16b41f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d100 0x7f16b40b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40b63a0 con 0x7f16b415d4e0 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40ca450 con 0x7f16b40d3b60 2023-11-04T01:41:56.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16bb16c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40b5a70 con 0x7f16b415d100 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.436+0000 7f16b9709640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39590/0 (socket says 172.21.15.93:39590) 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 -- 172.21.15.93:0/1517519231 learned_addr learned my addr 172.21.15.93:0/1517519231 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b8f08640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b40d3b60 0x7f16b41f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b3fff640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d100 0x7f16b40b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 -- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d100 msgr2=0x7f16b40b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d100 0x7f16b40b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 -- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b40d3b60 msgr2=0x7f16b41f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b40d3b60 0x7f16b41f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 -- 172.21.15.93:0/1517519231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8009400 con 0x7f16b415d4e0 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b9709640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00cb40 tx=0x7f16ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00aca0 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00ae00 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac012600 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b40b5d50 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.437+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b40b6830 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.438+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b40b6510 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.439+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16ac007070 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.439+0000 7f16b17fa640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 0x7f16a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.439+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f16ac089c60 con 0x7f16b415d4e0 2023-11-04T01:41:56.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.439+0000 7f16b8f08640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 0x7f16a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.440+0000 7f16b8f08640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 0x7f16a006d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16a4001230 tx=0x7f16a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.443+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16ac054620 con 0x7f16b415d4e0 2023-11-04T01:41:56.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.609+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16b40684b0 con 0x7f16b415d4e0 2023-11-04T01:41:56.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.610+0000 7f16b17fa640 1 -- 172.21.15.93:0/1517519231 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16ac017070 con 0x7f16b415d4e0 2023-11-04T01:41:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:41:56.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 msgr2=0x7f16a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 0x7f16a006d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16a4001230 tx=0x7f16a4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 msgr2=0x7f16b40b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00cb40 tx=0x7f16ac00a060 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 shutdown_connections 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16a006ae70 0x7f16a006d330 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b415d4e0 0x7f16b40b5000 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b415d100 0x7f16b40b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 --2- 172.21.15.93:0/1517519231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b40d3b60 0x7f16b41f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 >> 172.21.15.93:0/1517519231 conn(0x7f16b40d2ef0 msgr2=0x7f16b40d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 shutdown_connections 2023-11-04T01:41:56.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.612+0000 7f16bb16c640 1 -- 172.21.15.93:0/1517519231 wait complete. 2023-11-04T01:41:56.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:56.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.725+0000 7f9f783a9640 1 Processor -- start 2023-11-04T01:41:56.727 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.725+0000 7f9f783a9640 1 -- start start 2023-11-04T01:41:56.728 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f783a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700afda0 0x7f9f700cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f783a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9f700cd7f0 0x7f9f700ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f783a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700cf240 con 0x7f9f7015b200 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f783a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700cdc40 con 0x7f9f700cd7f0 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f783a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700cde80 con 0x7f9f700afda0 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9f700cd7f0 0x7f9f700ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9f700cd7f0 0x7f9f700ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39598/0 (socket says 172.21.15.93:39598) 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 -- 172.21.15.93:0/320411299 learned_addr learned my addr 172.21.15.93:0/320411299 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f75944640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700afda0 0x7f9f700cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 -- 172.21.15.93:0/320411299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700afda0 msgr2=0x7f9f700cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700afda0 0x7f9f700cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 -- 172.21.15.93:0/320411299 >> v1:172.21.15.125:6789/0 conn(0x7f9f7015b200 legacy=0x7f9f700ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.726+0000 7f9f76946640 1 -- 172.21.15.93:0/320411299 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700cf670 con 0x7f9f700cd7f0 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.727+0000 7f9f76946640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700cd7f0 0x7f9f700ae2b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009e50 tx=0x7f9f6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2da3c2f3fe52d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.727+0000 7f9f75143640 1 -- 172.21.15.93:0/320411299 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6802ca70 con 0x7f9f700cd7f0 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.727+0000 7f9f75143640 1 -- 172.21.15.93:0/320411299 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6802cbd0 con 0x7f9f700cd7f0 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.727+0000 7f9f75143640 1 -- 172.21.15.93:0/320411299 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f680343f0 con 0x7f9f700cd7f0 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 -- 172.21.15.93:0/320411299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700cd7f0 msgr2=0x7f9f700ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700cd7f0 0x7f9f700ae2b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009e50 tx=0x7f9f6802bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 -- 172.21.15.93:0/320411299 shutdown_connections 2023-11-04T01:41:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700cd7f0 0x7f9f700ae2b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 --2- 172.21.15.93:0/320411299 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700afda0 0x7f9f700cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 -- 172.21.15.93:0/320411299 >> 172.21.15.93:0/320411299 conn(0x7f9f700d0c30 msgr2=0x7f9f700d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 -- 172.21.15.93:0/320411299 shutdown_connections 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.728+0000 7f9f783a9640 1 -- 172.21.15.93:0/320411299 wait complete. 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.729+0000 7f9f783a9640 1 Processor -- start 2023-11-04T01:41:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.729+0000 7f9f783a9640 1 -- start start 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700cd7f0 0x7f9f700ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f7015b200 0x7f9f700b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700c4960 con 0x7f9f700afda0 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70156ff0 con 0x7f9f7015b200 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70158060 con 0x7f9f700cd7f0 2023-11-04T01:41:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39600/0 (socket says 172.21.15.93:39600) 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 -- 172.21.15.93:0/2801636136 learned_addr learned my addr 172.21.15.93:0/2801636136 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 -- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700cd7f0 msgr2=0x7f9f700ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700cd7f0 0x7f9f700ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 -- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f7015b200 msgr2=0x7f9f700b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f7015b200 0x7f9f700b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 -- 172.21.15.93:0/2801636136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f68009b30 con 0x7f9f700afda0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f76145640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c450 tx=0x7f9f6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0052d0 con 0x7f9f700afda0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c005450 con 0x7f9f700afda0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f70158340 con 0x7f9f700afda0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c003880 con 0x7f9f700afda0 2023-11-04T01:41:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.730+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f700cab50 con 0x7f9f700afda0 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.731+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f70158580 con 0x7f9f700afda0 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.732+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f6c0039e0 con 0x7f9f700afda0 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.732+0000 7f9f66ffd640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 0x7f9f5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.732+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f9f6c089790 con 0x7f9f700afda0 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.732+0000 7f9f75944640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 0x7f9f5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.732+0000 7f9f75944640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 0x7f9f5406d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f701f3c40 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.736+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f70158580 con 0x7f9f700afda0 2023-11-04T01:41:56.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.902+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f9f700cf240 con 0x7f9f700afda0 2023-11-04T01:41:56.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.903+0000 7f9f66ffd640 1 -- 172.21.15.93:0/2801636136 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v109) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9f700cf240 con 0x7f9f700afda0 2023-11-04T01:41:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:41:56.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 msgr2=0x7f9f5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 0x7f9f5406d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f701f3c40 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 msgr2=0x7f9f70156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c450 tx=0x7f9f6c00c910 comp rx=0 tx=0).stop 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 shutdown_connections 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f9f5406ae70 0x7f9f5406d330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f7015b200 0x7f9f700b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9f700cd7f0 0x7f9f700ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 --2- 172.21.15.93:0/2801636136 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f700afda0 0x7f9f70156ab0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 >> 172.21.15.93:0/2801636136 conn(0x7f9f700d0c30 msgr2=0x7f9f7015a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 shutdown_connections 2023-11-04T01:41:56.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:56.905+0000 7f9f783a9640 1 -- 172.21.15.93:0/2801636136 wait complete. 2023-11-04T01:41:56.917 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:41:57.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 Processor -- start 2023-11-04T01:41:57.020 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 -- start start 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67e8167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80b32b0 con 0x7f67e815d100 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80cee10 con 0x7f67e815d4e0 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.018+0000 7f67ed4c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80cec20 con 0x7f67e80d1be0 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f67e815d100 0x7f67e80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43284/0 (socket says 172.21.15.93:43284) 2023-11-04T01:41:57.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 -- 172.21.15.93:0/2016097004 learned_addr learned my addr 172.21.15.93:0/2016097004 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113562461 0 0) 0x7f67e80b32b0 con 0x7f67e815d100 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e77fe640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67e8167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d4003520 con 0x7f67e815d100 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652836131 0 0) 0x7f67d4003520 con 0x7f67e815d100 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 msgr2=0x7f67e8167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67e8167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 >> v1:172.21.15.125:6789/0 conn(0x7f67e815d4e0 legacy=0x7f67e80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80b4750 con 0x7f67e815d100 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f67d80017f0 con 0x7f67e815d100 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 >> v1:172.21.15.93:6789/0 conn(0x7f67e815d100 legacy=0x7f67e80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67d40039a0 0x7f67d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40047c0 0x7f67d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400bab0 con 0x7f67d40039a0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400bc20 con 0x7f67d40047c0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400bde0 con 0x7f67e80d1be0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67d40039a0 0x7f67d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67de7fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40047c0 0x7f67d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e77fe640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 -- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 msgr2=0x7f67d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80d1be0 0x7f67d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 -- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40047c0 msgr2=0x7f67d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40047c0 0x7f67d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67e6ffd640 1 -- 172.21.15.93:0/2016097004 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4003520 con 0x7f67d40039a0 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.019+0000 7f67de7fc640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40047c0 0x7f67d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.020+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67d40039a0 0x7f67d4003dc0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c190 tx=0x7f67d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6436e4da8efba5b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.020+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8007270 con 0x7f67d40039a0 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.020+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80073f0 con 0x7f67d40039a0 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.020+0000 7f67e67fc640 1 -- 172.21.15.93:0/2016097004 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d802c8a0 con 0x7f67d40039a0 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2016097004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67d40039a0 msgr2=0x7f67d4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2016097004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67d40039a0 0x7f67d4003dc0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f67d800c190 tx=0x7f67d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67e77fe640 1 -- 172.21.15.93:0/2016097004 reap_dead start 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2016097004 shutdown_connections 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2016097004 >> 172.21.15.93:0/2016097004 conn(0x7f67e80d2ef0 msgr2=0x7f67e80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2016097004 shutdown_connections 2023-11-04T01:41:57.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.021+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2016097004 wait complete. 2023-11-04T01:41:57.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.022+0000 7f67ed4c9640 1 Processor -- start 2023-11-04T01:41:57.028 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.022+0000 7f67ed4c9640 1 -- start start 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40039a0 0x7f67e8152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80cc450 0x7f67e80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80ca260 con 0x7f67e80ca960 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e8152d80 con 0x7f67d40039a0 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67ed4c9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e815eed0 con 0x7f67e80cc450 2023-11-04T01:41:57.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39622/0 (socket says 172.21.15.93:39622) 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 -- 172.21.15.93:0/2184087999 learned_addr learned my addr 172.21.15.93:0/2184087999 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 -- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80cc450 msgr2=0x7f67e80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80cc450 0x7f67e80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 -- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40039a0 msgr2=0x7f67e8152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40039a0 0x7f67e8152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 -- 172.21.15.93:0/2184087999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e815f170 con 0x7f67e80ca960 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67de7fc640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f67d000e5a0 tx=0x7f67d000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00052e0 con 0x7f67e80ca960 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.024+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e815f450 con 0x7f67e80ca960 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.023+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0005440 con 0x7f67e80ca960 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.024+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0003830 con 0x7f67e80ca960 2023-11-04T01:41:57.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.024+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e815fa10 con 0x7f67e80ca960 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.025+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e8067f00 con 0x7f67e80ca960 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.025+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67d0003990 con 0x7f67e80ca960 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.025+0000 7f67dffff640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 0x7f67c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.025+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f67d0089c20 con 0x7f67e80ca960 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.025+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 0x7f67c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.026+0000 7f67e6ffd640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 0x7f67c806d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d8007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.030+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67d00544a0 con 0x7f67e80ca960 2023-11-04T01:41:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.198+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f67e80684b0 con 0x7f67e80ca960 2023-11-04T01:41:57.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.199+0000 7f67dffff640 1 -- 172.21.15.93:0/2184087999 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v109) v1 ==== 103+0+11 (secure 0 0 0) 0x7f67d0057ac0 con 0x7f67e80ca960 2023-11-04T01:41:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 msgr2=0x7f67c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 0x7f67c806d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d8007000 comp rx=0 tx=0).stop 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 msgr2=0x7f67e815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f67d000e5a0 tx=0x7f67d000ea60 comp rx=0 tx=0).stop 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 shutdown_connections 2023-11-04T01:41:57.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f67c806ae70 0x7f67c806d330 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f67e80cc450 0x7f67e80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67e80ca960 0x7f67e815e990 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 --2- 172.21.15.93:0/2184087999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67d40039a0 0x7f67e8152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.200+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 >> 172.21.15.93:0/2184087999 conn(0x7f67e80d2ef0 msgr2=0x7f67e80cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.201+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 shutdown_connections 2023-11-04T01:41:57.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.201+0000 7f67ed4c9640 1 -- 172.21.15.93:0/2184087999 wait complete. 2023-11-04T01:41:57.214 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:41:57.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.313+0000 7f1d3847c640 1 Processor -- start 2023-11-04T01:41:57.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.313+0000 7f1d3847c640 1 -- start start 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d3847c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d3015d100 0x7f1d300ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d3847c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1d300d1be0 0x7f1d300b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d3847c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300b32b0 con 0x7f1d3015d4e0 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d3847c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300cee10 con 0x7f1d300d1be0 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d3847c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300b2980 con 0x7f1d3015d100 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d36a19640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1d300d1be0 0x7f1d300b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d35a17640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1d3015d4e0 0x7f1d300d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43288/0 (socket says 172.21.15.93:43288) 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.314+0000 7f1d35a17640 1 -- 172.21.15.93:0/527775958 learned_addr learned my addr 172.21.15.93:0/527775958 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36218640 1 --2- 172.21.15.93:0/527775958 >> v2:172.21.15.125:3300/0 conn(0x7f1d3015d100 0x7f1d300ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36a19640 1 -- 172.21.15.93:0/527775958 >> v2:172.21.15.125:3300/0 conn(0x7f1d3015d100 msgr2=0x7f1d300ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36a19640 1 --2- 172.21.15.93:0/527775958 >> v2:172.21.15.125:3300/0 conn(0x7f1d3015d100 0x7f1d300ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36a19640 1 -- 172.21.15.93:0/527775958 >> v1:172.21.15.93:6789/0 conn(0x7f1d3015d4e0 legacy=0x7f1d300d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36a19640 1 -- 172.21.15.93:0/527775958 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300b2c60 con 0x7f1d300d1be0 2023-11-04T01:41:57.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d35216640 1 -- 172.21.15.93:0/527775958 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809078133 0 0) 0x7f1d300b32b0 con 0x7f1d3015d4e0 2023-11-04T01:41:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.315+0000 7f1d36a19640 1 --2- 172.21.15.93:0/527775958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d300b3740 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1d300d09f0 tx=0x7f1d2802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd8be16b5ef8586 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d35216640 1 -- 172.21.15.93:0/527775958 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2802cc80 con 0x7f1d300d1be0 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d35216640 1 -- 172.21.15.93:0/527775958 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2802cde0 con 0x7f1d300d1be0 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d35216640 1 -- 172.21.15.93:0/527775958 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28034660 con 0x7f1d300d1be0 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 -- 172.21.15.93:0/527775958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 msgr2=0x7f1d300b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 --2- 172.21.15.93:0/527775958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d300b3740 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1d300d09f0 tx=0x7f1d2802bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 -- 172.21.15.93:0/527775958 shutdown_connections 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 --2- 172.21.15.93:0/527775958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d300b3740 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 --2- 172.21.15.93:0/527775958 >> v2:172.21.15.125:3300/0 conn(0x7f1d3015d100 0x7f1d300ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 -- 172.21.15.93:0/527775958 >> 172.21.15.93:0/527775958 conn(0x7f1d300d2ef0 msgr2=0x7f1d300d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 -- 172.21.15.93:0/527775958 shutdown_connections 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.316+0000 7f1d3847c640 1 -- 172.21.15.93:0/527775958 wait complete. 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.317+0000 7f1d3847c640 1 Processor -- start 2023-11-04T01:41:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.317+0000 7f1d3847c640 1 -- start start 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 0x7f1d301f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d3015d4e0 0x7f1d3006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301f3730 con 0x7f1d300d1be0 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300b5b10 con 0x7f1d3015d100 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d3847c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300b5df0 con 0x7f1d3015d4e0 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39650/0 (socket says 172.21.15.93:39650) 2023-11-04T01:41:57.323 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 -- 172.21.15.93:0/2224314181 learned_addr learned my addr 172.21.15.93:0/2224314181 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d35a17640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 0x7f1d301f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36a19640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d3015d4e0 0x7f1d3006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 -- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d3015d4e0 msgr2=0x7f1d3006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d3015d4e0 0x7f1d3006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 -- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 msgr2=0x7f1d301f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 0x7f1d301f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.318+0000 7f1d36218640 1 -- 172.21.15.93:0/2224314181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009a70 con 0x7f1d300d1be0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d35a17640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 0x7f1d301f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d36218640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d800 tx=0x7f1d2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000b6c0 con 0x7f1d300d1be0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000b820 con 0x7f1d300d1be0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d300b60d0 con 0x7f1d300d1be0 2023-11-04T01:41:57.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000bbd0 con 0x7f1d300d1be0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.319+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301f3d00 con 0x7f1d300d1be0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.320+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d301f3ec0 con 0x7f1d300d1be0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.320+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d2000bd30 con 0x7f1d300d1be0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.320+0000 7f1d26ffd640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 0x7f1d1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.320+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f1d2008a340 con 0x7f1d300d1be0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.320+0000 7f1d35a17640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 0x7f1d1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.325 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.321+0000 7f1d35a17640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 0x7f1d1406d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d3006bf40 tx=0x7f1d2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.327 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.325+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d20054c50 con 0x7f1d300d1be0 2023-11-04T01:41:57.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.490+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f1d300684b0 con 0x7f1d300d1be0 2023-11-04T01:41:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.491+0000 7f1d26ffd640 1 -- 172.21.15.93:0/2224314181 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v109) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1d20058270 con 0x7f1d300d1be0 2023-11-04T01:41:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 msgr2=0x7f1d1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 0x7f1d1406d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d3006bf40 tx=0x7f1d2c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 msgr2=0x7f1d3015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d800 tx=0x7f1d2000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 shutdown_connections 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1d1406ae70 0x7f1d1406d330 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1d3015d4e0 0x7f1d3006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3015d100 0x7f1d301f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.492+0000 7f1d3847c640 1 --2- 172.21.15.93:0/2224314181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1d300d1be0 0x7f1d3015a820 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.493+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 >> 172.21.15.93:0/2224314181 conn(0x7f1d300d2ef0 msgr2=0x7f1d300b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.493+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 shutdown_connections 2023-11-04T01:41:57.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.493+0000 7f1d3847c640 1 -- 172.21.15.93:0/2224314181 wait complete. 2023-11-04T01:41:57.505 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:57.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.605+0000 7f2ae281a640 1 Processor -- start 2023-11-04T01:41:57.607 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.605+0000 7f2ae281a640 1 -- start start 2023-11-04T01:41:57.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae281a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2adc070700 0x7f2adc164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae281a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc071500 con 0x7f2adc0b0c40 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae281a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc15dae0 con 0x7f2adc159e40 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae281a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc070c60 con 0x7f2adc070700 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae0db7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2adc070700 0x7f2adc164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2adb7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2adc0b0c40 0x7f2adc06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43292/0 (socket says 172.21.15.93:43292) 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2adb7fe640 1 -- 172.21.15.93:0/2670739711 learned_addr learned my addr 172.21.15.93:0/2670739711 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae0db7640 1 -- 172.21.15.93:0/2670739711 >> v1:172.21.15.125:6789/0 conn(0x7f2adc159e40 legacy=0x7f2adc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae0db7640 1 -- 172.21.15.93:0/2670739711 >> v1:172.21.15.93:6789/0 conn(0x7f2adc0b0c40 legacy=0x7f2adc06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2adaffd640 1 -- 172.21.15.93:0/2670739711 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150244597 0 0) 0x7f2adc071500 con 0x7f2adc0b0c40 2023-11-04T01:41:57.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.606+0000 7f2ae0db7640 1 -- 172.21.15.93:0/2670739711 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc070f40 con 0x7f2adc070700 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.607+0000 7f2ae0db7640 1 --2- 172.21.15.93:0/2670739711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc070700 0x7f2adc164b60 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d90 tx=0x7f2ad402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f8950b6c2159af server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.607+0000 7f2adaffd640 1 -- 172.21.15.93:0/2670739711 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad402cc60 con 0x7f2adc070700 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.607+0000 7f2adaffd640 1 -- 172.21.15.93:0/2670739711 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad402cdc0 con 0x7f2adc070700 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.607+0000 7f2adaffd640 1 -- 172.21.15.93:0/2670739711 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4034660 con 0x7f2adc070700 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 -- 172.21.15.93:0/2670739711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc070700 msgr2=0x7f2adc164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 --2- 172.21.15.93:0/2670739711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc070700 0x7f2adc164b60 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d90 tx=0x7f2ad402beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 -- 172.21.15.93:0/2670739711 shutdown_connections 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 --2- 172.21.15.93:0/2670739711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc070700 0x7f2adc164b60 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 -- 172.21.15.93:0/2670739711 >> 172.21.15.93:0/2670739711 conn(0x7f2adc0cb530 msgr2=0x7f2adc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 -- 172.21.15.93:0/2670739711 shutdown_connections 2023-11-04T01:41:57.611 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.608+0000 7f2ae281a640 1 -- 172.21.15.93:0/2670739711 wait complete. 2023-11-04T01:41:57.612 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.609+0000 7f2ae281a640 1 Processor -- start 2023-11-04T01:41:57.613 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.609+0000 7f2ae281a640 1 -- start start 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2adc070700 0x7f2adc15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2adc0b0c40 0x7f2adc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0c5b80 con 0x7f2adc159e40 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0c5e60 con 0x7f2adc070700 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15cad0 con 0x7f2adc0b0c40 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39658/0 (socket says 172.21.15.93:39658) 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 -- 172.21.15.93:0/538482428 learned_addr learned my addr 172.21.15.93:0/538482428 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2adbfff640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2adc070700 0x7f2adc15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2adb7fe640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2adc0b0c40 0x7f2adc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.614 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 -- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2adc0b0c40 msgr2=0x7f2adc0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2adc0b0c40 0x7f2adc0acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 -- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2adc070700 msgr2=0x7f2adc15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2adc070700 0x7f2adc15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 -- 172.21.15.93:0/538482428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009a70 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae0db7640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d90 tx=0x7f2ad4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4040450 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40405d0 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc15cdb0 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4040980 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.610+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc15c790 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.611+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc0c5fd0 con 0x7f2adc159e40 2023-11-04T01:41:57.615 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.612+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ad4040ae0 con 0x7f2adc159e40 2023-11-04T01:41:57.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.612+0000 7f2ad8ff9640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 0x7f2ac806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.612+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f2ad40ac290 con 0x7f2adc159e40 2023-11-04T01:41:57.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.612+0000 7f2adbfff640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 0x7f2ac806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.616 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.612+0000 7f2adbfff640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 0x7f2ac806d360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c8b80 tx=0x7f2acc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.618 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.616+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ad4076c60 con 0x7f2adc159e40 2023-11-04T01:41:57.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.782+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2adc0684b0 con 0x7f2adc159e40 2023-11-04T01:41:57.784 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.782+0000 7f2ad8ff9640 1 -- 172.21.15.93:0/538482428 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ad407a280 con 0x7f2adc159e40 2023-11-04T01:41:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:41:57.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 msgr2=0x7f2ac806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 0x7f2ac806d360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c8b80 tx=0x7f2acc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:57.786 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 msgr2=0x7f2adc0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d90 tx=0x7f2ad4004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 shutdown_connections 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ac806aea0 0x7f2ac806d360 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2adc159e40 0x7f2adc0c3610 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2adc0b0c40 0x7f2adc0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 --2- 172.21.15.93:0/538482428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2adc070700 0x7f2adc15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 >> 172.21.15.93:0/538482428 conn(0x7f2adc0cb530 msgr2=0x7f2adc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 shutdown_connections 2023-11-04T01:41:57.787 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.784+0000 7f2ae281a640 1 -- 172.21.15.93:0/538482428 wait complete. 2023-11-04T01:41:57.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:57.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.896+0000 7f62a3cec640 1 Processor -- start 2023-11-04T01:41:57.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 -- start start 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f629c15d100 0x7f629c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 0x7f629c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0b32b0 con 0x7f629c15d100 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0cee10 con 0x7f629c15d4e0 2023-11-04T01:41:57.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a3cec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0b2980 con 0x7f629c0d3b60 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a1a88640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f629c15d100 0x7f629c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.897+0000 7f62a1a88640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f629c15d100 0x7f629c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39668/0 (socket says 172.21.15.93:39668) 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 -- 172.21.15.93:0/1227253477 learned_addr learned my addr 172.21.15.93:0/1227253477 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a2289640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1287640 1 --2- 172.21.15.93:0/1227253477 >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 0x7f629c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 -- 172.21.15.93:0/1227253477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 msgr2=0x7f629c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 -- 172.21.15.93:0/1227253477 >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 msgr2=0x7f629c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 --2- 172.21.15.93:0/1227253477 >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 0x7f629c0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 -- 172.21.15.93:0/1227253477 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0b2c60 con 0x7f629c15d100 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1287640 1 --2- 172.21.15.93:0/1227253477 >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 0x7f629c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:57.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a2289640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.898+0000 7f62a1a88640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0ce510 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f629c160da0 tx=0x7f629802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28576b73e5421836 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a0a86640 1 -- 172.21.15.93:0/1227253477 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629802cac0 con 0x7f629c15d100 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a0a86640 1 -- 172.21.15.93:0/1227253477 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629802cc20 con 0x7f629c15d100 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a0a86640 1 -- 172.21.15.93:0/1227253477 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980343f0 con 0x7f629c15d100 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 -- 172.21.15.93:0/1227253477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 msgr2=0x7f629c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0ce510 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f629c160da0 tx=0x7f629802bf20 comp rx=0 tx=0).stop 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 -- 172.21.15.93:0/1227253477 shutdown_connections 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 --2- 172.21.15.93:0/1227253477 >> v2:172.21.15.125:3300/0 conn(0x7f629c15d4e0 0x7f629c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 --2- 172.21.15.93:0/1227253477 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0ce510 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 -- 172.21.15.93:0/1227253477 >> 172.21.15.93:0/1227253477 conn(0x7f629c0d2ef0 msgr2=0x7f629c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 -- 172.21.15.93:0/1227253477 shutdown_connections 2023-11-04T01:41:57.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.899+0000 7f62a3cec640 1 -- 172.21.15.93:0/1227253477 wait complete. 2023-11-04T01:41:57.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.900+0000 7f62a3cec640 1 Processor -- start 2023-11-04T01:41:57.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.900+0000 7f62a3cec640 1 -- start start 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f629c15d4e0 0x7f629c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0caa40 con 0x7f629c15d100 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0cacf0 con 0x7f629c15d4e0 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a3cec640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0cafd0 con 0x7f629c0d3b60 2023-11-04T01:41:57.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a1287640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a1287640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39680/0 (socket says 172.21.15.93:39680) 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a1287640 1 -- 172.21.15.93:0/2941897707 learned_addr learned my addr 172.21.15.93:0/2941897707 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.901+0000 7f62a1a88640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 -- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 msgr2=0x7f629c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c15b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a2289640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f629c15d4e0 0x7f629c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 -- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f629c15d4e0 msgr2=0x7f629c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f629c15d4e0 0x7f629c0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 -- 172.21.15.93:0/2941897707 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009b30 con 0x7f629c15d100 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a1287640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e810 tx=0x7f628c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c004030 con 0x7f629c15d100 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c004190 con 0x7f629c15d100 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c0b5b10 con 0x7f629c15d100 2023-11-04T01:41:57.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c004520 con 0x7f629c15d100 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.902+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c0b60d0 con 0x7f629c15d100 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.903+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c0b1c20 con 0x7f629c15d100 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.903+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f628c00c6d0 con 0x7f629c15d100 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.904+0000 7f62927fc640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 0x7f628006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.904+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f628c089990 con 0x7f629c15d100 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.904+0000 7f62a1a88640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 0x7f628006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.904+0000 7f62a1a88640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 0x7f628006d360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6298035000 tx=0x7f6298030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:57.908+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f628c054210 con 0x7f629c15d100 2023-11-04T01:41:58.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.074+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f629c0684b0 con 0x7f629c15d100 2023-11-04T01:41:58.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.074+0000 7f62927fc640 1 -- 172.21.15.93:0/2941897707 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7f628c0200a0 con 0x7f629c15d100 2023-11-04T01:41:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 msgr2=0x7f628006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 0x7f628006d360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6298035000 tx=0x7f6298030000 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 msgr2=0x7f629c0c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e810 tx=0x7f628c00ecd0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 shutdown_connections 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f628006aea0 0x7f628006d360 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f629c15d4e0 0x7f629c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f629c15d100 0x7f629c0c9fc0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 --2- 172.21.15.93:0/2941897707 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f629c0d3b60 0x7f629c15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 >> 172.21.15.93:0/2941897707 conn(0x7f629c0d2ef0 msgr2=0x7f629c0b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 shutdown_connections 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.076+0000 7f62a3cec640 1 -- 172.21.15.93:0/2941897707 wait complete. 2023-11-04T01:41:58.089 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:58.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.188+0000 7f5f27fff640 1 Processor -- start 2023-11-04T01:41:58.190 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.188+0000 7f5f27fff640 1 -- start start 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f27fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f2815ae80 0x7f5f2806b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f27fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5f280b0a20 0x7f5f280cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f27fff640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2806bd00 con 0x7f5f280ce410 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f27fff640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2815c270 con 0x7f5f2815ae80 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f27fff640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f280ade50 con 0x7f5f280b0a20 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f2815ae80 0x7f5f2806b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f2815ae80 0x7f5f2806b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39682/0 (socket says 172.21.15.93:39682) 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 -- 172.21.15.93:0/3940262135 learned_addr learned my addr 172.21.15.93:0/3940262135 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 -- 172.21.15.93:0/3940262135 >> v2:172.21.15.125:3300/0 conn(0x7f5f280b0a20 msgr2=0x7f5f280cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 --2- 172.21.15.93:0/3940262135 >> v2:172.21.15.125:3300/0 conn(0x7f5f280b0a20 0x7f5f280cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 -- 172.21.15.93:0/3940262135 >> v1:172.21.15.125:6789/0 conn(0x7f5f280ce410 legacy=0x7f5f280b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.189+0000 7f5f26ffd640 1 -- 172.21.15.93:0/3940262135 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280cf6c0 con 0x7f5f2815ae80 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f26ffd640 1 --2- 172.21.15.93:0/3940262135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f2806b7c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f5f280cf0e0 tx=0x7f5f2002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60b8e480928c0bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f25ffb640 1 -- 172.21.15.93:0/3940262135 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2002cb20 con 0x7f5f2815ae80 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f25ffb640 1 -- 172.21.15.93:0/3940262135 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2002cc80 con 0x7f5f2815ae80 2023-11-04T01:41:58.193 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f25ffb640 1 -- 172.21.15.93:0/3940262135 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200343f0 con 0x7f5f2815ae80 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 -- 172.21.15.93:0/3940262135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 msgr2=0x7f5f2806b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 --2- 172.21.15.93:0/3940262135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f2806b7c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f5f280cf0e0 tx=0x7f5f2002bf80 comp rx=0 tx=0).stop 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 -- 172.21.15.93:0/3940262135 shutdown_connections 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 --2- 172.21.15.93:0/3940262135 >> v2:172.21.15.125:3300/0 conn(0x7f5f280b0a20 0x7f5f280cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 --2- 172.21.15.93:0/3940262135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f2806b7c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.190+0000 7f5f27fff640 1 -- 172.21.15.93:0/3940262135 >> 172.21.15.93:0/3940262135 conn(0x7f5f2806a730 msgr2=0x7f5f280ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.191+0000 7f5f27fff640 1 -- 172.21.15.93:0/3940262135 shutdown_connections 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.191+0000 7f5f27fff640 1 -- 172.21.15.93:0/3940262135 wait complete. 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.192+0000 7f5f27fff640 1 Processor -- start 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.192+0000 7f5f27fff640 1 -- start start 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280b0a20 0x7f5f280c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f280ce410 0x7f5f280b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c2850 con 0x7f5f2815ae80 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c4a90 con 0x7f5f280ce410 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c41d0 con 0x7f5f280b0a20 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39696/0 (socket says 172.21.15.93:39696) 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 -- 172.21.15.93:0/2109474572 learned_addr learned my addr 172.21.15.93:0/2109474572 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f26ffd640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280b0a20 0x7f5f280c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f267fc640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f280ce410 0x7f5f280b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 -- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280b0a20 msgr2=0x7f5f280c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280b0a20 0x7f5f280c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 -- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f280ce410 msgr2=0x7f5f280b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f280ce410 0x7f5f280b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 -- 172.21.15.93:0/2109474572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20009b30 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f277fe640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800b450 tx=0x7f5f1800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18011890 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f180119f0 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18011da0 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.193+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f280c4440 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.194+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f280c2a60 con 0x7f5f2815ae80 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.194+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f28067c70 con 0x7f5f2815ae80 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.195+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f1801a400 con 0x7f5f2815ae80 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.195+0000 7f5f0f7fe640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 0x7f5f1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.195+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f5f1808a160 con 0x7f5f2815ae80 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.195+0000 7f5f26ffd640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 0x7f5f1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.196+0000 7f5f26ffd640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 0x7f5f1406d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5f20035000 tx=0x7f5f20030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.200+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f180549e0 con 0x7f5f2815ae80 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.377+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f280742c0 con 0x7f5f2815ae80 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.378+0000 7f5f0f7fe640 1 -- 172.21.15.93:0/2109474572 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v109) v1 ==== 81+0+791 (secure 0 0 0) 0x7f5f18015020 con 0x7f5f2815ae80 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3671080369 2023-11-04T02:41:51.893134+0000 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:41:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:listed 13 entries 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 msgr2=0x7f5f1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 0x7f5f1406d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5f20035000 tx=0x7f5f20030000 comp rx=0 tx=0).stop 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 msgr2=0x7f5f280c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800b450 tx=0x7f5f1800b910 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 shutdown_connections 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5f1406ae70 0x7f5f1406d330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f2815ae80 0x7f5f280c2310 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f280ce410 0x7f5f280b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 --2- 172.21.15.93:0/2109474572 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5f280b0a20 0x7f5f280c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 >> 172.21.15.93:0/2109474572 conn(0x7f5f2806a730 msgr2=0x7f5f2815a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 shutdown_connections 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.380+0000 7f5f27fff640 1 -- 172.21.15.93:0/2109474572 wait complete. 2023-11-04T01:41:58.392 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:41:58.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.392 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s22’: Software caused connection abort 2023-11-04T01:41:58.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:41:58.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.420 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:41:58.475 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:41:58.475 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:58.530 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:58.530 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:41:58.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.667+0000 7fe35235a640 1 Processor -- start 2023-11-04T01:41:58.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.667+0000 7fe35235a640 1 -- start start 2023-11-04T01:41:58.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe35235a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe34c0ade00 0x7fe34c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe35235a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c06cc90 con 0x7fe34c06c5f0 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe35235a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c0b0e60 con 0x7fe34c06d9c0 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe35235a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c06cee0 con 0x7fe34c0ade00 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe34bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe34c0ade00 0x7fe34c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe3508f7640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe34c06c5f0 0x7fe34c0cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43296/0 (socket says 172.21.15.93:43296) 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe3508f7640 1 -- 172.21.15.93:0/830934950 learned_addr learned my addr 172.21.15.93:0/830934950 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe34bfff640 1 -- 172.21.15.93:0/830934950 >> v1:172.21.15.125:6789/0 conn(0x7fe34c06d9c0 legacy=0x7fe34c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe34bfff640 1 -- 172.21.15.93:0/830934950 >> v1:172.21.15.93:6789/0 conn(0x7fe34c06c5f0 legacy=0x7fe34c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.668+0000 7fe34bfff640 1 -- 172.21.15.93:0/830934950 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c06d1c0 con 0x7fe34c0ade00 2023-11-04T01:41:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.669+0000 7fe34bfff640 1 --2- 172.21.15.93:0/830934950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0b0530 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32900c305416a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.669+0000 7fe34affd640 1 -- 172.21.15.93:0/830934950 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02f050 con 0x7fe34c0ade00 2023-11-04T01:41:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.669+0000 7fe34affd640 1 -- 172.21.15.93:0/830934950 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c031700 con 0x7fe34c0ade00 2023-11-04T01:41:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.669+0000 7fe34affd640 1 -- 172.21.15.93:0/830934950 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c031a90 con 0x7fe34c0ade00 2023-11-04T01:41:58.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 -- 172.21.15.93:0/830934950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 msgr2=0x7fe34c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 --2- 172.21.15.93:0/830934950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0b0530 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0097a0 tx=0x7fe33c02b7a0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 -- 172.21.15.93:0/830934950 shutdown_connections 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 --2- 172.21.15.93:0/830934950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0b0530 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 -- 172.21.15.93:0/830934950 >> 172.21.15.93:0/830934950 conn(0x7fe34c0cb530 msgr2=0x7fe34c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 -- 172.21.15.93:0/830934950 shutdown_connections 2023-11-04T01:41:58.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.670+0000 7fe35235a640 1 -- 172.21.15.93:0/830934950 wait complete. 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.671+0000 7fe35235a640 1 Processor -- start 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.671+0000 7fe35235a640 1 -- start start 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe34c06c5f0 0x7fe34c0c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 0x7fe34c0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1f3490 con 0x7fe34c0ade00 2023-11-04T01:41:58.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0cace0 con 0x7fe34c06d9c0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0caa00 con 0x7fe34c06c5f0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39720/0 (socket says 172.21.15.93:39720) 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 -- 172.21.15.93:0/84587921 learned_addr learned my addr 172.21.15.93:0/84587921 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe34b7fe640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 0x7fe34c0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 -- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe34c06c5f0 msgr2=0x7fe34c0c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe34bfff640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe34c06c5f0 0x7fe34c0c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe34c06c5f0 0x7fe34c0c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 -- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 msgr2=0x7fe34c0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 0x7fe34c0ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 -- 172.21.15.93:0/84587921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009400 con 0x7fe34c0ade00 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe34b7fe640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 0x7fe34c0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe3508f7640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fe34400ca80 tx=0x7fe34400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400ac30 con 0x7fe34c0ade00 2023-11-04T01:41:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34400ad90 con 0x7fe34c0ade00 2023-11-04T01:41:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c1f2e40 con 0x7fe34c0ade00 2023-11-04T01:41:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344012600 con 0x7fe34c0ade00 2023-11-04T01:41:58.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.672+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c15b100 con 0x7fe34c0ade00 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.673+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c1f2ca0 con 0x7fe34c0ade00 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.674+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe344007070 con 0x7fe34c0ade00 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.674+0000 7fe348ff9640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 0x7fe33806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.674+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7fe344089ce0 con 0x7fe34c0ade00 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.674+0000 7fe34bfff640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 0x7fe33806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.675+0000 7fe34bfff640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 0x7fe33806d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe33c035000 tx=0x7fe33c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.678+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe34c1f2ca0 con 0x7fe34c0ade00 2023-11-04T01:41:58.882 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.880+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe34c1f2ca0 con 0x7fe34c0ade00 2023-11-04T01:41:58.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.881+0000 7fe348ff9640 1 -- 172.21.15.93:0/84587921 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe34c1f2ca0 con 0x7fe34c0ade00 2023-11-04T01:41:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 msgr2=0x7fe33806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 0x7fe33806d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe33c035000 tx=0x7fe33c008030 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 msgr2=0x7fe34c0c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fe34400ca80 tx=0x7fe34400cf40 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 shutdown_connections 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe33806ae70 0x7fe33806d330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c0ade00 0x7fe34c0c7320 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe34c06d9c0 0x7fe34c0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 --2- 172.21.15.93:0/84587921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe34c06c5f0 0x7fe34c0c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.882+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 >> 172.21.15.93:0/84587921 conn(0x7fe34c0cb530 msgr2=0x7fe34c0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.883+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 shutdown_connections 2023-11-04T01:41:58.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:41:58.883+0000 7fe35235a640 1 -- 172.21.15.93:0/84587921 wait complete. 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:41:58.895 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:41:58.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:41:58.896 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:58.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.896 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:41:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41481sec preferred_lft 41481sec 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:58.912 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:58.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.914 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:41:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:41:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.978 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:41:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:41:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:41:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:41:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:41:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:41:59.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:41:59.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:59.128 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:41:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:41:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:41:59.143 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:59.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:59.143 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:41:59.210 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:41:59.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:59.210 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:59.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:59.265 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:59.319 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:41:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:41:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:59.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:59.378 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:41:59.430 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:41:59.430 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:41:59.473 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:59.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:41:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:41:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:41:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:59.490 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:59.491 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:59.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:59.491 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:41:59.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:41:59.559+0000 7fc500f75480 -1 init, newargv = 0x560937a5aa50 newargc=15 2023-11-04T01:41:59.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[153802]: starting ceph client 2023-11-04T01:41:59.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[153802]: starting fuse 2023-11-04T01:42:00.644 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:42:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:00.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:00.667 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:42:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:42:00.725 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:42:00.725 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:00.725 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:42:00.725 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:42:00.726 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:00.727 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:42:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.153802.asok 2023-11-04T01:42:00.860 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:00.868 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.153802.asok 2023-11-04T01:42:00.868 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:00.868 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.153802.asok status 2023-11-04T01:42:00.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:42:01.037 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "153802", 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:01.038 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 8319, 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 8319 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3505063928 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:42:01.039 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 3505063928 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.8319 192.168.0.1:0/3505063928", 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/3505063928", 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 92, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 109, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:42:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:42:01.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:01.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:01.052 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:01.052 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:01.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:01.110 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:42:01.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:01.117 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:01.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:01.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:01.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:01.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:01.182 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:42:01.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.279+0000 7f6d8c24b640 1 Processor -- start 2023-11-04T01:42:01.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.280+0000 7f6d8c24b640 1 -- start start 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8c24b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d8406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8c24b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d840b3ca0 0x7f6d840ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8c24b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8415d4f0 con 0x7f6d840ad3b0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8c24b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840664f0 con 0x7f6d840b3ca0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8c24b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8406b9f0 con 0x7f6d8415d110 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8a7e8640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6d840ad3b0 0x7f6d840b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43300/0 (socket says 172.21.15.93:43300) 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/1137368900 learned_addr learned my addr 172.21.15.93:0/1137368900 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816421466 0 0) 0x7f6d8415d4f0 con 0x7f6d840ad3b0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d70003520 con 0x7f6d840ad3b0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d897e6640 1 --2- 172.21.15.93:0/1137368900 >> v2:172.21.15.125:3300/0 conn(0x7f6d840b3ca0 0x7f6d840ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d8406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532712110 0 0) 0x7f6d70003520 con 0x7f6d840ad3b0 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 msgr2=0x7f6d8406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d8406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 >> v2:172.21.15.125:3300/0 conn(0x7f6d840b3ca0 msgr2=0x7f6d840ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 --2- 172.21.15.93:0/1137368900 >> v2:172.21.15.125:3300/0 conn(0x7f6d840b3ca0 0x7f6d840ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8406c2e0 con 0x7f6d840ad3b0 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f6d7c0019f0 con 0x7f6d840ad3b0 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 >> v1:172.21.15.93:6789/0 conn(0x7f6d840ad3b0 legacy=0x7f6d840b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d70003ef0 0x7f6d700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d70004d00 0x7f6d70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840664f0 con 0x7f6d70004d00 2023-11-04T01:42:01.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8406b9f0 con 0x7f6d70003ef0 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.281+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7000b980 con 0x7f6d8415d110 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d70004d00 0x7f6d70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d897e6640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d70003ef0 0x7f6d700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 msgr2=0x7f6d70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d8415d110 0x7f6d70003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d70003ef0 msgr2=0x7f6d700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d70003ef0 0x7f6d700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/1137368900 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70003520 con 0x7f6d70004d00 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.282+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d70004d00 0x7f6d70005180 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6d840ad7e0 tx=0x7f6d700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a7aaf2d8f21c22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c034630 con 0x7f6d70004d00 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c02f070 con 0x7f6d70004d00 2023-11-04T01:42:01.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d88fe5640 1 -- 172.21.15.93:0/1137368900 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0349d0 con 0x7f6d70004d00 2023-11-04T01:42:01.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 -- 172.21.15.93:0/1137368900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d70004d00 msgr2=0x7f6d70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/1137368900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d70004d00 0x7f6d70005180 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6d840ad7e0 tx=0x7f6d700057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/1137368900 reap_dead start 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 -- 172.21.15.93:0/1137368900 shutdown_connections 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 -- 172.21.15.93:0/1137368900 >> 172.21.15.93:0/1137368900 conn(0x7f6d840cbd30 msgr2=0x7f6d840cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 -- 172.21.15.93:0/1137368900 shutdown_connections 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.283+0000 7f6d8c24b640 1 -- 172.21.15.93:0/1137368900 wait complete. 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.284+0000 7f6d8c24b640 1 Processor -- start 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.284+0000 7f6d8c24b640 1 -- start start 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 0x7f6d841f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 0x7f6d840c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c69d0 con 0x7f6d840c8850 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841f6aa0 con 0x7f6d8415a4d0 2023-11-04T01:42:01.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8c24b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b0fd0 con 0x7f6d70004d00 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39744/0 (socket says 172.21.15.93:39744) 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/2874756107 learned_addr learned my addr 172.21.15.93:0/2874756107 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 0x7f6d841f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d897e6640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 0x7f6d840c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 msgr2=0x7f6d841f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 0x7f6d841f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 msgr2=0x7f6d840c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 0x7f6d840c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/2874756107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840b0450 con 0x7f6d840c8850 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 0x7f6d841f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.285+0000 7f6d897e6640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 0x7f6d840c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f80 tx=0x7f6d7c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d7a7fc640 1 -- 172.21.15.93:0/2874756107 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c002000 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d7a7fc640 1 -- 172.21.15.93:0/2874756107 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c034640 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d840b0730 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d7a7fc640 1 -- 172.21.15.93:0/2874756107 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0349b0 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.286+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d840b0cf0 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.287+0000 7f6d7a7fc640 1 -- 172.21.15.93:0/2874756107 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d7c031030 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.287+0000 7f6d7a7fc640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 0x7f6d6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.288+0000 7f6d7a7fc640 1 -- 172.21.15.93:0/2874756107 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f6d7c0ac3a0 con 0x7f6d840c8850 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.288+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 0x7f6d6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.288+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 0x7f6d6806d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009aa0 tx=0x7f6d74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.289+0000 7f6d8eddc740 1 Processor -- start 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.289+0000 7f6d8eddc740 1 -- start start 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.289+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252fc88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.289+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f986d0 0x559252fc5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.289+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252f0bd70 con 0x559252f9c040 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252f09460 con 0x559252fc84c0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x559252f04d50 con 0x559252f986d0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39746/0 (socket says 172.21.15.93:39746) 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/519325103 learned_addr learned my addr 172.21.15.93:0/519325103 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252fc88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d897e6640 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f986d0 0x559252fc5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f986d0 msgr2=0x559252fc5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f986d0 0x559252fc5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 msgr2=0x559252fc88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252fc88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/519325103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559252ec7e30 con 0x559252f9c040 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0827d0 tx=0x7f6d7c07a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7caa3bb925fb489 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d677fe640 1 -- 172.21.15.93:0/519325103 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c078b40 con 0x559252f9c040 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d677fe640 1 -- 172.21.15.93:0/519325103 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c078da0 con 0x559252f9c040 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.290+0000 7f6d677fe640 1 -- 172.21.15.93:0/519325103 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0ac0c0 con 0x559252f9c040 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- 172.21.15.93:0/519325103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 msgr2=0x559252fc5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0827d0 tx=0x7f6d7c07a490 comp rx=0 tx=0).stop 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- 172.21.15.93:0/519325103 shutdown_connections 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559252fc5c70 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f986d0 0x559252fc5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/519325103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252fc88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- 172.21.15.93:0/519325103 >> 172.21.15.93:0/519325103 conn(0x559252f9a9e0 msgr2=0x559252fe32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- 172.21.15.93:0/519325103 shutdown_connections 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- 172.21.15.93:0/519325103 wait complete. 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 -- start start 2023-11-04T01:42:01.301 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.291+0000 7f6d8eddc740 1 Processor -- start 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 0x559252fc8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fc84c0 0x559252faf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252ebeee0 con 0x559252fafd00 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252ebeb80 con 0x559252f9c040 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x559252e843a0 con 0x559252fc84c0 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8eddc740 10 client.0 _ll_register_callbacks cb 0x559252e888b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.292+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39748/0 (socket says 172.21.15.93:39748) 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/4194925982 learned_addr learned my addr 172.21.15.93:0/4194925982 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 0x559252fc8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d897e6640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fc84c0 0x559252faf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.302 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fc84c0 msgr2=0x559252faf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fc84c0 0x559252faf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 msgr2=0x559252fc8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 0x559252fc8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 -- 172.21.15.93:0/4194925982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d840b0cf0 con 0x559252fafd00 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 0x559252fc8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c07b2b0 tx=0x7f6d7c001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b984bd870d5da982 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c086070 con 0x559252fafd00 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f6d7c032e20 con 0x559252fafd00 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559252efdd30 con 0x559252fafd00 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7c0ac0c0 con 0x559252fafd00 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 10 client.8331 fetch_fsmap learned FSMap version 92 2023-11-04T01:42:01.303 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x559252f033d0 con 0x559252fafd00 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559252efdd30 con 0x559252fafd00 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 92) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6d7c089020 con 0x559252fafd00 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 10 client.8331 fetch_fsmap finished waiting for FSMap version 92 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 10 client.8331 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 20 client.8331 populate_metadata read hostname 'smithi093' 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fb2260 0x559252fca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 4 client.8331 mds_command: new command op to 6814 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.293+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 --> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559252efda50 con 0x559252fb2260 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.294+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fb2260 0x559252fca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.294+0000 7f6d64ff9640 10 client.8331 ms_handle_connect on v2:172.21.15.125:6832/2466276650 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.294+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fb2260 0x559252fca460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82dbf7ce639bf5e server_cookie=8199a45f9588b296 in_seq=0 out_seq=0 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d64ff9640 1 -- 172.21.15.93:0/4194925982 <== mds.0 v2:172.21.15.125:6832/2466276650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559252efda50 con 0x559252fb2260 2023-11-04T01:42:01.304 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d64ff9640 10 client.8331 handle_command_reply: tid=0 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 client.8331 shutdown 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 msgr2=0x559252fcb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c07b2b0 tx=0x7f6d7c001b20 comp rx=0 tx=0).stop 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 shutdown_connections 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fb2260 0x559252fca460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252fcb4e0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d64ff9640 0 client.8331 ms_handle_reset on v2:172.21.15.125:6832/2466276650 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fc84c0 0x559252faf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/4194925982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252f9c040 0x559252fc8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 >> 172.21.15.93:0/4194925982 conn(0x559252f986d0 msgr2=0x559252fcc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 shutdown_connections 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 1 -- 172.21.15.93:0/4194925982 wait complete. 2023-11-04T01:42:01.305 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.295+0000 7f6d8eddc740 20 client.8331 trim_cache size 0 max 16384 2023-11-04T01:42:01.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.308+0000 7f6d8eddc740 1 Processor -- start 2023-11-04T01:42:01.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.308+0000 7f6d8eddc740 1 -- start start 2023-11-04T01:42:01.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f9c040 0x559252fe5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252ff2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592530073c0 con 0x559252fafd00 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252fe5040 con 0x559252fc84c0 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x559252f0bcd0 con 0x559252f9c040 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39750/0 (socket says 172.21.15.93:39750) 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 -- 172.21.15.93:0/2461364780 learned_addr learned my addr 172.21.15.93:0/2461364780 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 -- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f9c040 msgr2=0x559252fe5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f9c040 0x559252fe5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 -- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 msgr2=0x559252ff2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252ff2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 -- 172.21.15.93:0/2461364780 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559252ea0ea0 con 0x559252fafd00 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.309+0000 7f6d897e6640 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009bf0 tx=0x7f6d80009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8eabfeaf41d35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.313 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d67fff640 1 -- 172.21.15.93:0/2461364780 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80017e70 con 0x559252fafd00 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d67fff640 1 -- 172.21.15.93:0/2461364780 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80004030 con 0x559252fafd00 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d67fff640 1 -- 172.21.15.93:0/2461364780 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800043c0 con 0x559252fafd00 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 -- 172.21.15.93:0/2461364780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 msgr2=0x559252ff25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009bf0 tx=0x7f6d80009190 comp rx=0 tx=0).stop 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 -- 172.21.15.93:0/2461364780 shutdown_connections 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x559252ff2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252fafd00 0x559252ff25f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/2461364780 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252f9c040 0x559252fe5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 -- 172.21.15.93:0/2461364780 >> 172.21.15.93:0/2461364780 conn(0x559252f986d0 msgr2=0x559252faf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 -- 172.21.15.93:0/2461364780 shutdown_connections 2023-11-04T01:42:01.314 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.310+0000 7f6d8eddc740 1 -- 172.21.15.93:0/2461364780 wait complete. 2023-11-04T01:42:01.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.311+0000 7f6d8eddc740 1 -- start start 2023-11-04T01:42:01.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.311+0000 7f6d8eddc740 1 Processor -- start 2023-11-04T01:42:01.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fafd00 0x559252fcc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x55925304d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925304e490 con 0x559252f9c040 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559252fcbc50 con 0x559252fc84c0 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x559252ff2fa0 con 0x559252fafd00 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 10 client.0 _ll_register_callbacks cb 0x7f6d7c07a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39758/0 (socket says 172.21.15.93:39758) 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 -- 172.21.15.93:0/209970530 learned_addr learned my addr 172.21.15.93:0/209970530 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d897e6640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fafd00 0x559252fcc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x55925304d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 -- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fafd00 msgr2=0x559252fcc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fafd00 0x559252fcc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.318 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 -- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 msgr2=0x55925304d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x55925304d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 -- 172.21.15.93:0/209970530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800098d0 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8a7e8640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x55925304d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d89fe7640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x559252fb0670 tx=0x7f6d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72b245be6164f42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7402a040 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d7c078da0 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f6d74025610 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d74038030 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 10 client.8337 fetch_fsmap learned FSMap version 92 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.312+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x559252ec6690 con 0x559252f9c040 2023-11-04T01:42:01.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c078da0 con 0x559252f9c040 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 92) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6d740257d0 con 0x559252f9c040 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 10 client.8337 fetch_fsmap finished waiting for FSMap version 92 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 10 client.8337 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 20 client.8337 populate_metadata read hostname 'smithi093' 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fda8f0 0x55925304df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 4 client.8337 mds_command: new command op to 6814 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 --> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559252c057e0 con 0x559252fda8f0 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d897e6640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fda8f0 0x55925304df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d64ff9640 10 client.8337 ms_handle_connect on v2:172.21.15.125:6832/2466276650 2023-11-04T01:42:01.320 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.313+0000 7f6d897e6640 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fda8f0 0x55925304df00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76690e89fcd09398 server_cookie=ac8735340f51bb31 in_seq=0 out_seq=0 2023-11-04T01:42:01.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.327+0000 7f6d64ff9640 1 -- 172.21.15.93:0/209970530 <== mds.0 v2:172.21.15.125:6832/2466276650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559252c057e0 con 0x559252fda8f0 2023-11-04T01:42:01.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.327+0000 7f6d64ff9640 10 client.8337 handle_command_reply: tid=0 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.327+0000 7f6d8eddc740 1 client.8337 shutdown 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 msgr2=0x559253036f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x559252fb0670 tx=0x7f6d74004730 comp rx=0 tx=0).stop 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 shutdown_connections 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:6832/2466276650,v1:172.21.15.125:6834/2466276650] conn(0x559252fda8f0 0x55925304df00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559252fc84c0 0x55925304d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x559252fafd00 0x559252fcc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d64ff9640 0 client.8337 ms_handle_reset on v2:172.21.15.125:6832/2466276650 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 --2- 172.21.15.93:0/209970530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559252f9c040 0x559253036f50 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 >> 172.21.15.93:0/209970530 conn(0x559252f986d0 msgr2=0x559252f93e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 shutdown_connections 2023-11-04T01:42:01.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 1 -- 172.21.15.93:0/209970530 wait complete. 2023-11-04T01:42:01.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8eddc740 20 client.8337 trim_cache size 0 max 16384 2023-11-04T01:42:01.332 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:42:01.332 INFO:teuthology.orchestra.run.smithi093.stdout: "message": "", 2023-11-04T01:42:01.332 INFO:teuthology.orchestra.run.smithi093.stdout: "return_code": 0 2023-11-04T01:42:01.332 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:42:01.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 msgr2=0x7f6d6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 0x7f6d6806d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009aa0 tx=0x7f6d74008040 comp rx=0 tx=0).stop 2023-11-04T01:42:01.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 msgr2=0x7f6d840c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f80 tx=0x7f6d7c001360 comp rx=0 tx=0).stop 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 shutdown_connections 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d6806ae70 0x7f6d6806d330 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d840c8850 0x7f6d840c8cd0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8415a4d0 0x7f6d840c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 --2- 172.21.15.93:0/2874756107 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d70004d00 0x7f6d841f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 >> 172.21.15.93:0/2874756107 conn(0x7f6d840cbd30 msgr2=0x7f6d840ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 shutdown_connections 2023-11-04T01:42:01.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.328+0000 7f6d8c24b640 1 -- 172.21.15.93:0/2874756107 wait complete. 2023-11-04T01:42:01.341 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:42:01.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:01.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.438+0000 7f8d689d7640 1 Processor -- start 2023-11-04T01:42:01.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.438+0000 7f8d689d7640 1 -- start start 2023-11-04T01:42:01.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d689d7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6415d100 0x7f8d640ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d689d7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 0x7f8d640d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d689d7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d640b32b0 con 0x7f8d640d3b60 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d689d7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d640cee10 con 0x7f8d6415d100 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d689d7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d640b4750 con 0x7f8d6415d4e0 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.439+0000 7f8d6259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6415d100 0x7f8d640ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8d6415d100 0x7f8d640ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49456/0 (socket says 172.21.15.93:49456) 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 -- 172.21.15.93:0/569402383 learned_addr learned my addr 172.21.15.93:0/569402383 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 -- 172.21.15.93:0/569402383 >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 msgr2=0x7f8d640d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d5bfff640 1 --2- 172.21.15.93:0/569402383 >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 0x7f8d640d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 --2- 172.21.15.93:0/569402383 >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 0x7f8d640d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 -- 172.21.15.93:0/569402383 >> v1:172.21.15.125:6789/0 conn(0x7f8d640d3b60 legacy=0x7f8d640cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 -- 172.21.15.93:0/569402383 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640b2980 con 0x7f8d6415d100 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d5bfff640 1 --2- 172.21.15.93:0/569402383 >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 0x7f8d640d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.440+0000 7f8d6259c640 1 --2- 172.21.15.93:0/569402383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d100 0x7f8d640ce510 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8d64160da0 tx=0x7f8d5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a5cabffab0a688 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d61d9b640 1 -- 172.21.15.93:0/569402383 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54004230 con 0x7f8d6415d100 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d61d9b640 1 -- 172.21.15.93:0/569402383 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54004390 con 0x7f8d6415d100 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d61d9b640 1 -- 172.21.15.93:0/569402383 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54003810 con 0x7f8d6415d100 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 -- 172.21.15.93:0/569402383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d100 msgr2=0x7f8d640ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 --2- 172.21.15.93:0/569402383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d100 0x7f8d640ce510 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8d64160da0 tx=0x7f8d5402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 -- 172.21.15.93:0/569402383 shutdown_connections 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 --2- 172.21.15.93:0/569402383 >> v2:172.21.15.125:3300/0 conn(0x7f8d6415d4e0 0x7f8d640d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 --2- 172.21.15.93:0/569402383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d100 0x7f8d640ce510 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 -- 172.21.15.93:0/569402383 >> 172.21.15.93:0/569402383 conn(0x7f8d640d2ef0 msgr2=0x7f8d640d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 -- 172.21.15.93:0/569402383 shutdown_connections 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.441+0000 7f8d689d7640 1 -- 172.21.15.93:0/569402383 wait complete. 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 Processor -- start 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 -- start start 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d640d3b60 0x7f8d6415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6415d100 0x7f8d641f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641f30b0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641f70b0 con 0x7f8d640d3b60 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d689d7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641f3b40 con 0x7f8d6415d100 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d62d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d62d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49466/0 (socket says 172.21.15.93:49466) 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d62d9d640 1 -- 172.21.15.93:0/665138806 learned_addr learned my addr 172.21.15.93:0/665138806 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d6259c640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d640d3b60 0x7f8d6415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.443+0000 7f8d5bfff640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6415d100 0x7f8d641f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 -- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6415d100 msgr2=0x7f8d641f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6415d100 0x7f8d641f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 -- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d640d3b60 msgr2=0x7f8d6415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d640d3b60 0x7f8d6415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 -- 172.21.15.93:0/665138806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d54009460 con 0x7f8d6415d4e0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d62d9d640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b970 tx=0x7f8d5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00cb40 con 0x7f8d6415d4e0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c00cca0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d641f32a0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c014680 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.444+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d641f3860 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.445+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d640684b0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.445+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d5c01d3b0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.446+0000 7f8d5affd640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 0x7f8d4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.446+0000 7f8d6259c640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 0x7f8d4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.446+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f8d5c089bc0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.446+0000 7f8d6259c640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 0x7f8d4406d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d54035000 tx=0x7f8d54008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.450+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d5c0544f0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.656 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.654+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d640d2cd0 con 0x7f8d6415d4e0 2023-11-04T01:42:01.657 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.655+0000 7f8d5affd640 1 -- 172.21.15.93:0/665138806 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8d5c057b10 con 0x7f8d6415d4e0 2023-11-04T01:42:01.657 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:01.657 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:41:53.090847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:01.657 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 92 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 msgr2=0x7f8d4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 0x7f8d4406d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d54035000 tx=0x7f8d54008030 comp rx=0 tx=0).stop 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 msgr2=0x7f8d641f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b970 tx=0x7f8d5c00be30 comp rx=0 tx=0).stop 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 shutdown_connections 2023-11-04T01:42:01.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8d4406ae70 0x7f8d4406d330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d6415d4e0 0x7f8d641f6b70 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8d6415d100 0x7f8d641f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 --2- 172.21.15.93:0/665138806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d640d3b60 0x7f8d6415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 >> 172.21.15.93:0/665138806 conn(0x7f8d640d2ef0 msgr2=0x7f8d640d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 shutdown_connections 2023-11-04T01:42:01.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.657+0000 7f8d689d7640 1 -- 172.21.15.93:0/665138806 wait complete. 2023-11-04T01:42:01.670 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:42:01.793 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:01.794 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:01.794 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:42:01.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.894+0000 7f601fe4b640 1 Processor -- start 2023-11-04T01:42:01.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.894+0000 7f601fe4b640 1 -- start start 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6018159e40 0x7f60180b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 0x7f60180b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f601806fff0 0x7f6018070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6018071500 con 0x7f601806fff0 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601815dae0 con 0x7f601806bb60 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601fe4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180709c0 con 0x7f6018159e40 2023-11-04T01:42:01.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f601806fff0 0x7f6018070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f601806fff0 0x7f6018070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49468/0 (socket says 172.21.15.93:49468) 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 -- 172.21.15.93:0/1433891675 learned_addr learned my addr 172.21.15.93:0/1433891675 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601d3e6640 1 --2- 172.21.15.93:0/1433891675 >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 0x7f60180b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601dbe7640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6018159e40 0x7f60180b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 -- 172.21.15.93:0/1433891675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6018159e40 msgr2=0x7f60180b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6018159e40 0x7f60180b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 -- 172.21.15.93:0/1433891675 >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 msgr2=0x7f60180b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 --2- 172.21.15.93:0/1433891675 >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 0x7f60180b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601e3e8640 1 -- 172.21.15.93:0/1433891675 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018070c60 con 0x7f601806fff0 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.895+0000 7f601d3e6640 1 --2- 172.21.15.93:0/1433891675 >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 0x7f60180b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.896+0000 7f601e3e8640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806fff0 0x7f6018070480 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f60180ce820 tx=0x7f601002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270771781737e005 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.899 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.896+0000 7f601cbe5640 1 -- 172.21.15.93:0/1433891675 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601002c9e0 con 0x7f601806fff0 2023-11-04T01:42:01.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.896+0000 7f601cbe5640 1 -- 172.21.15.93:0/1433891675 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601002cb40 con 0x7f601806fff0 2023-11-04T01:42:01.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.896+0000 7f601cbe5640 1 -- 172.21.15.93:0/1433891675 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100343f0 con 0x7f601806fff0 2023-11-04T01:42:01.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 -- 172.21.15.93:0/1433891675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806fff0 msgr2=0x7f6018070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806fff0 0x7f6018070480 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f60180ce820 tx=0x7f601002be40 comp rx=0 tx=0).stop 2023-11-04T01:42:01.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 -- 172.21.15.93:0/1433891675 shutdown_connections 2023-11-04T01:42:01.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806fff0 0x7f6018070480 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1433891675 >> v2:172.21.15.125:3300/0 conn(0x7f601806bb60 0x7f60180b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1433891675 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6018159e40 0x7f60180b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 -- 172.21.15.93:0/1433891675 >> 172.21.15.93:0/1433891675 conn(0x7f60180cb530 msgr2=0x7f60180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 -- 172.21.15.93:0/1433891675 shutdown_connections 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.897+0000 7f601fe4b640 1 -- 172.21.15.93:0/1433891675 wait complete. 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.898+0000 7f601fe4b640 1 Processor -- start 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.898+0000 7f601fe4b640 1 -- start start 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f601806fff0 0x7f60180c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 0x7f60180acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180c8bd0 con 0x7f601806bb60 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60181f36f0 con 0x7f6018159e40 2023-11-04T01:42:01.903 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60181f2b70 con 0x7f601806fff0 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49478/0 (socket says 172.21.15.93:49478) 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 -- 172.21.15.93:0/1652472194 learned_addr learned my addr 172.21.15.93:0/1652472194 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 -- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f601806fff0 msgr2=0x7f60180c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601d3e6640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f601806fff0 0x7f60180c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601e3e8640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 0x7f60180acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f601806fff0 0x7f60180c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 -- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 msgr2=0x7f60180acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 0x7f60180acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 -- 172.21.15.93:0/1652472194 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009b30 con 0x7f601806bb60 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601e3e8640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 0x7f60180acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601dbe7640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f601400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004220 con 0x7f601806bb60 2023-11-04T01:42:01.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014004380 con 0x7f601806bb60 2023-11-04T01:42:01.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60181f2e50 con 0x7f601806bb60 2023-11-04T01:42:01.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014007840 con 0x7f601806bb60 2023-11-04T01:42:01.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.899+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60181f3410 con 0x7f601806bb60 2023-11-04T01:42:01.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.900+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60180684b0 con 0x7f601806bb60 2023-11-04T01:42:01.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.901+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6014007bb0 con 0x7f601806bb60 2023-11-04T01:42:01.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.901+0000 7f600e7fc640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 0x7f5ffc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.901+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7793+0+0 (secure 0 0 0) 0x7f6014089d40 con 0x7f601806bb60 2023-11-04T01:42:01.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.901+0000 7f601d3e6640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 0x7f5ffc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.901+0000 7f601d3e6640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 0x7f5ffc06d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60180c8f90 tx=0x7f6008008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:01.905+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60140545c0 con 0x7f601806bb60 2023-11-04T01:42:02.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:42:02.136+0000 7f78ea7fc640 -1 client.7542 I was blocklisted at osd epoch 110 2023-11-04T01:42:02.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[148217]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:02.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:02.142+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f60180c9750 con 0x7f601806bb60 2023-11-04T01:42:02.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:42:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:03.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.134+0000 7f600e7fc640 1 -- 172.21.15.93:0/1652472194 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6814 v93) v1 ==== 112+0+0 (secure 0 0 0) 0x7f6014087e60 con 0x7f601806bb60 2023-11-04T01:42:03.137 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.6814 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 msgr2=0x7f5ffc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 0x7f5ffc06d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60180c8f90 tx=0x7f6008008040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 msgr2=0x7f60180ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f601400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 shutdown_connections 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5ffc06ae70 0x7f5ffc06d330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6018159e40 0x7f60180acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f601806fff0 0x7f60180c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 --2- 172.21.15.93:0/1652472194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f601806bb60 0x7f60180ae930 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 >> 172.21.15.93:0/1652472194 conn(0x7f60180cb530 msgr2=0x7f60180cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 shutdown_connections 2023-11-04T01:42:03.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.138+0000 7f601fe4b640 1 -- 172.21.15.93:0/1652472194 wait complete. 2023-11-04T01:42:03.152 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.258+0000 7f235f590640 1 Processor -- start 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.258+0000 7f235f590640 1 -- start start 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235f590640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f235806d9c0 0x7f23580710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235f590640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f235806c5f0 0x7f2358071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235f590640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235806cc90 con 0x7f23580ade00 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235f590640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580b0c40 con 0x7f235806c5f0 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235f590640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358071b50 con 0x7f235806d9c0 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f235806c5f0 0x7f2358071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f235806c5f0 0x7f2358071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49486/0 (socket says 172.21.15.93:49486) 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 -- 172.21.15.93:0/2105515389 learned_addr learned my addr 172.21.15.93:0/2105515389 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 -- 172.21.15.93:0/2105515389 >> v2:172.21.15.125:3300/0 conn(0x7f235806d9c0 msgr2=0x7f23580710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 --2- 172.21.15.93:0/2105515389 >> v2:172.21.15.125:3300/0 conn(0x7f235806d9c0 0x7f23580710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 -- 172.21.15.93:0/2105515389 >> v1:172.21.15.125:6789/0 conn(0x7f23580ade00 legacy=0x7f23580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.259+0000 7f235db2d640 1 -- 172.21.15.93:0/2105515389 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580b0e60 con 0x7f235806c5f0 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f235db2d640 1 --2- 172.21.15.93:0/2105515389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f235806c5f0 0x7f2358071610 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f23580c9080 tx=0x7f235002bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f3f0e476c8e8bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f234ffff640 1 -- 172.21.15.93:0/2105515389 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235002c980 con 0x7f235806c5f0 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f234ffff640 1 -- 172.21.15.93:0/2105515389 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235002cae0 con 0x7f235806c5f0 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f234ffff640 1 -- 172.21.15.93:0/2105515389 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235002ce70 con 0x7f235806c5f0 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f235f590640 1 -- 172.21.15.93:0/2105515389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f235806c5f0 msgr2=0x7f2358071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f235f590640 1 --2- 172.21.15.93:0/2105515389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f235806c5f0 0x7f2358071610 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f23580c9080 tx=0x7f235002bde0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.260+0000 7f235f590640 1 -- 172.21.15.93:0/2105515389 shutdown_connections 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.261+0000 7f235f590640 1 --2- 172.21.15.93:0/2105515389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f235806c5f0 0x7f2358071610 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.261+0000 7f235f590640 1 --2- 172.21.15.93:0/2105515389 >> v2:172.21.15.125:3300/0 conn(0x7f235806d9c0 0x7f23580710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.261+0000 7f235f590640 1 -- 172.21.15.93:0/2105515389 >> 172.21.15.93:0/2105515389 conn(0x7f23580cb530 msgr2=0x7f23580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.261+0000 7f235f590640 1 -- 172.21.15.93:0/2105515389 shutdown_connections 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.261+0000 7f235f590640 1 -- 172.21.15.93:0/2105515389 wait complete. 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 Processor -- start 2023-11-04T01:42:03.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 -- start start 2023-11-04T01:42:03.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 0x7f23580c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f235806d9c0 0x7f235815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c7360 con 0x7f23580ade00 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.262+0000 7f235f590640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c7640 con 0x7f235806c5f0 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235f590640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c7920 con 0x7f235806d9c0 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49498/0 (socket says 172.21.15.93:49498) 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 -- 172.21.15.93:0/1198007878 learned_addr learned my addr 172.21.15.93:0/1198007878 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235d32c640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 0x7f23580c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235cb2b640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f235806d9c0 0x7f235815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 -- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f235806d9c0 msgr2=0x7f235815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f235806d9c0 0x7f235815adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 -- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 msgr2=0x7f23580c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 0x7f23580c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 -- 172.21.15.93:0/1198007878 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009b30 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235d32c640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 0x7f23580c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235db2d640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f235002be20 tx=0x7f2350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500079f0 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2350007b70 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580c7c00 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.263+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235003e450 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.264+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23580c8940 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.264+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23580684b0 con 0x7f23580ade00 2023-11-04T01:42:03.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.265+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f235003e5b0 con 0x7f23580ade00 2023-11-04T01:42:03.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.265+0000 7f234dffb640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 0x7f233c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.265+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7f23500ac740 con 0x7f23580ade00 2023-11-04T01:42:03.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.265+0000 7f235d32c640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 0x7f233c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.266+0000 7f235d32c640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 0x7f233c06d360 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f235400a810 tx=0x7f2354008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.270+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2350076f50 con 0x7f23580ade00 2023-11-04T01:42:03.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:03.502+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f23580cddc0 con 0x7f23580ade00 2023-11-04T01:42:04.144 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.141+0000 7f234dffb640 1 -- 172.21.15.93:0/1198007878 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8157 v94) v1 ==== 112+0+0 (secure 0 0 0) 0x7f235007a570 con 0x7f23580ade00 2023-11-04T01:42:04.144 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.8157 2023-11-04T01:42:04.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 msgr2=0x7f233c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 0x7f233c06d360 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f235400a810 tx=0x7f2354008040 comp rx=0 tx=0).stop 2023-11-04T01:42:04.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 msgr2=0x7f23580c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f235002be20 tx=0x7f2350004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:04.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 shutdown_connections 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f233c06aea0 0x7f233c06d360 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f23580ade00 0x7f23580c8400 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f235806d9c0 0x7f235815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 --2- 172.21.15.93:0/1198007878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f235806c5f0 0x7f23580c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 >> 172.21.15.93:0/1198007878 conn(0x7f23580cb530 msgr2=0x7f23580b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 shutdown_connections 2023-11-04T01:42:04.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.144+0000 7f235f590640 1 -- 172.21.15.93:0/1198007878 wait complete. 2023-11-04T01:42:04.158 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:42:04.284 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:42:04.285 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:42:04.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:04.285 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:42:04.288 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:42:04.310 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1222dd8640 time 2023-11-04T01:42:04.309675+0000 2023-11-04T01:42:04.310 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:04.310 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.310 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f122896efaf] 2023-11-04T01:42:04.310 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1222dd8640 time 2023-11-04T01:42:04.309675+0000 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:04.311 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f122896efaf] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.312 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.313 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.313 INFO:tasks.ceph.mds.d.smithi125.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:42:04.313 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f1222dd8640 thread_name:ms_dispatch 2023-11-04T01:42:04.313 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.313 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1228054db0] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f12280a154c] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f122896f009] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.314 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f1222dd8640 thread_name:ms_dispatch 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1228054db0] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f12280a154c] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f122896f009] 2023-11-04T01:42:04.315 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:04.316 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.317 INFO:tasks.ceph.mds.d.smithi125.stderr: -1018> 2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:04.317 INFO:tasks.ceph.mds.d.smithi125.stderr: -1016> 2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1222dd8640 time 2023-11-04T01:42:04.309675+0000 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f122896efaf] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.318 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f1222dd8640 thread_name:ms_dispatch 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1228054db0] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f12280a154c] 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:42:04.319 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f122896f009] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:04.320 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr: -1018> 2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr: -1016> 2023-11-04T01:41:55.145+0000 7f12205d3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr: -1> 2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f1222dd8640 time 2023-11-04T01:42:04.309675+0000 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.321 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f122896efaf] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.322 INFO:tasks.ceph.mds.d.smithi125.stderr: 0> 2023-11-04T01:42:04.309+0000 7f1222dd8640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: in thread 7f1222dd8640 thread_name:ms_dispatch 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1228054db0] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f12280a154c] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 3: raise() 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 4: abort() 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f122896f009] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f122896f16d] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55cb4039f187] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55cb4012e0a9] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55cb40130b2b] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cb4013101c] 2023-11-04T01:42:04.323 INFO:tasks.ceph.mds.d.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55cb4011a325] 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f1228b5ff9a] 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f1228bf1741] 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f122809f802] 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f122803f450] 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:04.324 INFO:tasks.ceph.mds.d.smithi125.stderr: 2023-11-04T01:42:04.418 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:42:04.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:42:04.419 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:04.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 Processor -- start 2023-11-04T01:42:04.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 -- start start 2023-11-04T01:42:04.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0b32b0 con 0x7ffb8c15d100 2023-11-04T01:42:04.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0cee10 con 0x7ffb8c0d3b60 2023-11-04T01:42:04.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.517+0000 7ffb92807640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cec20 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffb8c15d100 0x7ffb8c0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46356/0 (socket says 172.21.15.93:46356) 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8bfff640 1 -- 172.21.15.93:0/1931591478 learned_addr learned my addr 172.21.15.93:0/1931591478 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/1931591478 >> v1:172.21.15.125:6789/0 conn(0x7ffb8c0d3b60 legacy=0x7ffb8c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/1931591478 >> v1:172.21.15.93:6789/0 conn(0x7ffb8c15d100 legacy=0x7ffb8c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/1931591478 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0b2980 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.518+0000 7ffb8affd640 1 -- 172.21.15.93:0/1931591478 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283390597 0 0) 0x7ffb8c0b32b0 con 0x7ffb8c15d100 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb8b7fe640 1 --2- 172.21.15.93:0/1931591478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097a0 tx=0x7ffb7c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b0a7bd52e7d7e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb8affd640 1 -- 172.21.15.93:0/1931591478 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c031830 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb8affd640 1 -- 172.21.15.93:0/1931591478 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c031990 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb8affd640 1 -- 172.21.15.93:0/1931591478 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c031d20 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 -- 172.21.15.93:0/1931591478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d4e0 msgr2=0x7ffb8c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 --2- 172.21.15.93:0/1931591478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097a0 tx=0x7ffb7c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 -- 172.21.15.93:0/1931591478 shutdown_connections 2023-11-04T01:42:04.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 --2- 172.21.15.93:0/1931591478 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 -- 172.21.15.93:0/1931591478 >> 172.21.15.93:0/1931591478 conn(0x7ffb8c0d2ef0 msgr2=0x7ffb8c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 -- 172.21.15.93:0/1931591478 shutdown_connections 2023-11-04T01:42:04.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.519+0000 7ffb92807640 1 -- 172.21.15.93:0/1931591478 wait complete. 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.520+0000 7ffb92807640 1 Processor -- start 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 -- start start 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0ca810 con 0x7ffb8c15d100 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0caaf0 con 0x7ffb8c0d3b60 2023-11-04T01:42:04.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb92807640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cadd0 con 0x7ffb8c15d4e0 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49508/0 (socket says 172.21.15.93:49508) 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/2851353871 learned_addr learned my addr 172.21.15.93:0/2851353871 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb8bfff640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.521+0000 7ffb90da4640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb8c15d4e0 msgr2=0x7ffb8c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 msgr2=0x7ffb8c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 -- 172.21.15.93:0/2851353871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009400 con 0x7ffb8c15d100 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8bfff640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:04.526 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb8b7fe640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c034040 tx=0x7ffb7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c03ba70 con 0x7ffb8c15d100 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c03bbf0 con 0x7ffb8c15d100 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c0cb0b0 con 0x7ffb8c15d100 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0453f0 con 0x7ffb8c15d100 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.522+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c0ca500 con 0x7ffb8c15d100 2023-11-04T01:42:04.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.523+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c0cb5d0 con 0x7ffb8c15d100 2023-11-04T01:42:04.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.523+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb7c04e450 con 0x7ffb8c15d100 2023-11-04T01:42:04.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.524+0000 7ffb88ff9640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.524+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7ffb7c0ac180 con 0x7ffb8c15d100 2023-11-04T01:42:04.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.524+0000 7ffb8bfff640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.528 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.524+0000 7ffb8bfff640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 0x7ffb7806d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffb800010e0 tx=0x7ffb80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.530 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.528+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb8c0cb5d0 con 0x7ffb8c15d100 2023-11-04T01:42:04.676 INFO:tasks.ceph.mds.d.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:42:04.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.730+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb8c0cb5d0 con 0x7ffb8c15d100 2023-11-04T01:42:04.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.731+0000 7ffb88ff9640 1 -- 172.21.15.93:0/2851353871 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ffb8c0cb5d0 con 0x7ffb8c15d100 2023-11-04T01:42:04.734 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:04.734 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:03.504135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:04.735 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 94 2023-11-04T01:42:04.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.732+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 msgr2=0x7ffb7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.732+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 0x7ffb7806d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffb800010e0 tx=0x7ffb80009040 comp rx=0 tx=0).stop 2023-11-04T01:42:04.735 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.732+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 msgr2=0x7ffb8c0cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.732+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c034040 tx=0x7ffb7c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 shutdown_connections 2023-11-04T01:42:04.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.736 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0cc970 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 --2- 172.21.15.93:0/2851353871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 >> 172.21.15.93:0/2851353871 conn(0x7ffb8c0d2ef0 msgr2=0x7ffb8c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 shutdown_connections 2023-11-04T01:42:04.737 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:04.733+0000 7ffb92807640 1 -- 172.21.15.93:0/2851353871 wait complete. 2023-11-04T01:42:04.746 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:06.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:42:09.747 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.863+0000 7fa2abde7640 1 Processor -- start 2023-11-04T01:42:09.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.863+0000 7fa2abde7640 1 -- start start 2023-11-04T01:42:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2abde7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa2a4159e40 0x7fa2a40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2abde7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a4071500 con 0x7fa2a4070700 2023-11-04T01:42:09.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2abde7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a415dae0 con 0x7fa2a406bb60 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2abde7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a4070c60 con 0x7fa2a4159e40 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2a9b83640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa2a4159e40 0x7fa2a40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2aa384640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa2a4070700 0x7fa2a40cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46368/0 (socket says 172.21.15.93:46368) 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2aa384640 1 -- 172.21.15.93:0/1000715495 learned_addr learned my addr 172.21.15.93:0/1000715495 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2a9b83640 1 -- 172.21.15.93:0/1000715495 >> v1:172.21.15.125:6789/0 conn(0x7fa2a406bb60 legacy=0x7fa2a406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2a9b83640 1 -- 172.21.15.93:0/1000715495 >> v1:172.21.15.93:6789/0 conn(0x7fa2a4070700 legacy=0x7fa2a40cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2a9b83640 1 -- 172.21.15.93:0/1000715495 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4070f40 con 0x7fa2a4159e40 2023-11-04T01:42:09.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.864+0000 7fa2a8b81640 1 -- 172.21.15.93:0/1000715495 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005839828 0 0) 0x7fa2a4071500 con 0x7fa2a4070700 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.865+0000 7fa2a9b83640 1 --2- 172.21.15.93:0/1000715495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4159e40 0x7fa2a40b0530 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa2940097a0 tx=0x7fa29402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f79b6210165506 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.865+0000 7fa2a8b81640 1 -- 172.21.15.93:0/1000715495 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29402e070 con 0x7fa2a4159e40 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.865+0000 7fa2a8b81640 1 -- 172.21.15.93:0/1000715495 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2940315a0 con 0x7fa2a4159e40 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.865+0000 7fa2a8b81640 1 -- 172.21.15.93:0/1000715495 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294031930 con 0x7fa2a4159e40 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 -- 172.21.15.93:0/1000715495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4159e40 msgr2=0x7fa2a40b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 --2- 172.21.15.93:0/1000715495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4159e40 0x7fa2a40b0530 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa2940097a0 tx=0x7fa29402b840 comp rx=0 tx=0).stop 2023-11-04T01:42:09.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 -- 172.21.15.93:0/1000715495 shutdown_connections 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 --2- 172.21.15.93:0/1000715495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4159e40 0x7fa2a40b0530 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 -- 172.21.15.93:0/1000715495 >> 172.21.15.93:0/1000715495 conn(0x7fa2a40cb530 msgr2=0x7fa2a40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 -- 172.21.15.93:0/1000715495 shutdown_connections 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.866+0000 7fa2abde7640 1 -- 172.21.15.93:0/1000715495 wait complete. 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.867+0000 7fa2abde7640 1 Processor -- start 2023-11-04T01:42:09.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.867+0000 7fa2abde7640 1 -- start start 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 0x7fa2a41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 0x7fa2a40a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40a9f40 con 0x7fa2a4070700 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40c5c20 con 0x7fa2a406bb60 2023-11-04T01:42:09.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2abde7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4158820 con 0x7fa2a4159e40 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49522/0 (socket says 172.21.15.93:49522) 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 -- 172.21.15.93:0/578600486 learned_addr learned my addr 172.21.15.93:0/578600486 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2aa384640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 0x7fa2a40a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9b83640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 0x7fa2a41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 -- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 msgr2=0x7fa2a40a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 0x7fa2a40a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 -- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 msgr2=0x7fa2a41582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 0x7fa2a41582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9382640 1 -- 172.21.15.93:0/578600486 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009400 con 0x7fa2a4070700 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2aa384640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 0x7fa2a40a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:09.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.868+0000 7fa2a9b83640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 0x7fa2a41582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa2a9382640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c450 tx=0x7fa2a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00052d0 con 0x7fa2a4070700 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a0005430 con 0x7fa2a4070700 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a40ac5a0 con 0x7fa2a4070700 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0012870 con 0x7fa2a4070700 2023-11-04T01:42:09.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.869+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a40acb60 con 0x7fa2a4070700 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.870+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a40684b0 con 0x7fa2a4070700 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.870+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2a00129d0 con 0x7fa2a4070700 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.871+0000 7fa29a7fc640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 0x7fa28806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.871+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7fa2a0089940 con 0x7fa2a4070700 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.871+0000 7fa2a9b83640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 0x7fa28806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.871+0000 7fa2a9b83640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 0x7fa28806d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa294036000 tx=0x7fa294008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:09.875+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2a00541e0 con 0x7fa2a4070700 2023-11-04T01:42:10.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.078+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a40c9750 con 0x7fa2a4070700 2023-11-04T01:42:10.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.079+0000 7fa29a7fc640 1 -- 172.21.15.93:0/578600486 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fa2a0057800 con 0x7fa2a4070700 2023-11-04T01:42:10.081 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:10.081 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:03.504135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:10.081 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 94 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 msgr2=0x7fa28806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 0x7fa28806d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa294036000 tx=0x7fa294008030 comp rx=0 tx=0).stop 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 msgr2=0x7fa2a415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c450 tx=0x7fa2a000c910 comp rx=0 tx=0).stop 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 shutdown_connections 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa28806ae70 0x7fa28806d330 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa2a4159e40 0x7fa2a40a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa2a4070700 0x7fa2a415ca60 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.083 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 --2- 172.21.15.93:0/578600486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2a406bb60 0x7fa2a41582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.080+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 >> 172.21.15.93:0/578600486 conn(0x7fa2a40cb530 msgr2=0x7fa2a406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.081+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 shutdown_connections 2023-11-04T01:42:10.084 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:10.081+0000 7fa2abde7640 1 -- 172.21.15.93:0/578600486 wait complete. 2023-11-04T01:42:10.093 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:13.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:42:15.094 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:15.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 Processor -- start 2023-11-04T01:42:15.208 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 -- start start 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5be00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00b32b0 con 0x7f5be015d100 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00cee10 con 0x7f5be00d3b60 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.206+0000 7f5be5b25640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00cec20 con 0x7f5be015d4e0 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bdf7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5be015d100 0x7f5be00ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45382/0 (socket says 172.21.15.93:45382) 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bdf7fe640 1 -- 172.21.15.93:0/239331067 learned_addr learned my addr 172.21.15.93:0/239331067 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5be00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501720662 0 0) 0x7f5be00b32b0 con 0x7f5be015d100 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc8003520 con 0x7f5be015d100 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 177962912 0 0) 0x7f5bc8003520 con 0x7f5be015d100 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 msgr2=0x7f5be00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5be00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 >> v1:172.21.15.125:6789/0 conn(0x7f5be00d3b60 legacy=0x7f5be00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00b2980 con 0x7f5be015d100 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5bd00017f0 con 0x7f5be015d100 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 >> v1:172.21.15.93:6789/0 conn(0x7f5be015d100 legacy=0x7f5be00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5bc80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bc8003f20 0x7f5bc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8004d00 0x7f5bc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800ba30 con 0x7f5bc8003f20 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800bba0 con 0x7f5bc8004d00 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800bd60 con 0x7f5be015d4e0 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.207+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bc8003f20 0x7f5bc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdf7fe640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5bc80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdffff640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8004d00 0x7f5bc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 -- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 msgr2=0x7f5bc80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5bc80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 -- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8004d00 msgr2=0x7f5bc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8004d00 0x7f5bc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 -- 172.21.15.93:0/239331067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc8003520 con 0x7f5bc8003f20 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdf7fe640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be015d4e0 0x7f5bc80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.208+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bc8003f20 0x7f5bc80047c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009ac0 tx=0x7f5bc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a1e1d9f95e8e40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd402c6b0 con 0x7f5bc8003f20 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd402c810 con 0x7f5bc8003f20 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5bde7fc640 1 -- 172.21.15.93:0/239331067 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd402cba0 con 0x7f5bc8003f20 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 -- 172.21.15.93:0/239331067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bc8003f20 msgr2=0x7f5bc80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 --2- 172.21.15.93:0/239331067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bc8003f20 0x7f5bc80047c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009ac0 tx=0x7f5bc80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5bdffff640 1 -- 172.21.15.93:0/239331067 reap_dead start 2023-11-04T01:42:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 -- 172.21.15.93:0/239331067 shutdown_connections 2023-11-04T01:42:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 -- 172.21.15.93:0/239331067 >> 172.21.15.93:0/239331067 conn(0x7f5be00d2ef0 msgr2=0x7f5be00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 -- 172.21.15.93:0/239331067 shutdown_connections 2023-11-04T01:42:15.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.209+0000 7f5be5b25640 1 -- 172.21.15.93:0/239331067 wait complete. 2023-11-04T01:42:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.210+0000 7f5be5b25640 1 Processor -- start 2023-11-04T01:42:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 -- start start 2023-11-04T01:42:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8003f20 0x7f5be00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be014fef0 0x7f5be01f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00cb640 con 0x7f5be014fa70 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00caa70 con 0x7f5bc8003f20 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5be5b25640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00cad10 con 0x7f5be014fef0 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46314/0 (socket says 172.21.15.93:46314) 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5bdeffd640 1 -- 172.21.15.93:0/3083277279 learned_addr learned my addr 172.21.15.93:0/3083277279 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.211+0000 7f5bdffff640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be014fef0 0x7f5be01f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdf7fe640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8003f20 0x7f5be00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 -- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be014fef0 msgr2=0x7f5be01f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be014fef0 0x7f5be01f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 -- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8003f20 msgr2=0x7f5be00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8003f20 0x7f5be00cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 -- 172.21.15.93:0/3083277279 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00caff0 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bdeffd640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5bd402c250 tx=0x7f5bd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4003810 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4003970 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00cb640 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4003ce0 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.212+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be00ccd60 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.213+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be00cb7d0 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.214+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bd4047450 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.214+0000 7f5bc7fff640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 0x7f5bcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.214+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7f5bd40ac000 con 0x7f5be014fa70 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.214+0000 7f5bdf7fe640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 0x7f5bcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.214+0000 7f5bdf7fe640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 0x7f5bcc06d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0001e10 tx=0x7f5bd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.218+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5bd40769e0 con 0x7f5be014fa70 2023-11-04T01:42:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.419+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be00684b0 con 0x7f5be014fa70 2023-11-04T01:42:15.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.419+0000 7f5bc7fff640 1 -- 172.21.15.93:0/3083277279 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f5bd40044e0 con 0x7f5be014fa70 2023-11-04T01:42:15.422 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:15.422 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:03.504135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:15.422 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 94 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 msgr2=0x7f5bcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 0x7f5bcc06d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0001e10 tx=0x7f5bd0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 msgr2=0x7f5be01f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5bd402c250 tx=0x7f5bd4004730 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 shutdown_connections 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5bcc06ae70 0x7f5bcc06d330 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5be014fef0 0x7f5be01f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5be014fa70 0x7f5be01f6210 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 --2- 172.21.15.93:0/3083277279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5bc8003f20 0x7f5be00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 >> 172.21.15.93:0/3083277279 conn(0x7f5be00d2ef0 msgr2=0x7f5be00cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 shutdown_connections 2023-11-04T01:42:15.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:15.421+0000 7f5be5b25640 1 -- 172.21.15.93:0/3083277279 wait complete. 2023-11-04T01:42:15.434 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:19.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-04T01:42:20.436 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:20.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.547+0000 7f8e7b3f5640 1 Processor -- start 2023-11-04T01:42:20.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.547+0000 7f8e7b3f5640 1 -- start start 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e7b3f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e74159e40 0x7f8e740b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e7b3f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8e7406bb60 0x7f8e740b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e7b3f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e74071500 con 0x7f8e7406fff0 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e7b3f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7415dae0 con 0x7f8e7406bb60 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e7b3f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74070c60 con 0x7f8e74159e40 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e78990640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8e7406bb60 0x7f8e740b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e79992640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8e7406fff0 0x7f8e74070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45392/0 (socket says 172.21.15.93:45392) 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e79992640 1 -- 172.21.15.93:0/929488097 learned_addr learned my addr 172.21.15.93:0/929488097 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.548+0000 7f8e79191640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e74159e40 0x7f8e740b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e78990640 1 -- 172.21.15.93:0/929488097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e74159e40 msgr2=0x7f8e740b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e78990640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e74159e40 0x7f8e740b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e78990640 1 -- 172.21.15.93:0/929488097 >> v1:172.21.15.93:6789/0 conn(0x7f8e7406fff0 legacy=0x7f8e74070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e78990640 1 -- 172.21.15.93:0/929488097 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74070f40 con 0x7f8e7406bb60 2023-11-04T01:42:20.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e6bfff640 1 -- 172.21.15.93:0/929488097 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444493302 0 0) 0x7f8e74071500 con 0x7f8e7406fff0 2023-11-04T01:42:20.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.549+0000 7f8e78990640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e740b0a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f8e640097a0 tx=0x7f8e6402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881f5c50655037f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e6bfff640 1 -- 172.21.15.93:0/929488097 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6402e070 con 0x7f8e7406bb60 2023-11-04T01:42:20.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e6bfff640 1 -- 172.21.15.93:0/929488097 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e640315a0 con 0x7f8e7406bb60 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e6bfff640 1 -- 172.21.15.93:0/929488097 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64031930 con 0x7f8e7406bb60 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/929488097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 msgr2=0x7f8e740b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e740b0a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f8e640097a0 tx=0x7f8e6402b840 comp rx=0 tx=0).stop 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/929488097 shutdown_connections 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e740b0a70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/929488097 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e74159e40 0x7f8e740b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/929488097 >> 172.21.15.93:0/929488097 conn(0x7f8e740cb530 msgr2=0x7f8e740cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/929488097 shutdown_connections 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.550+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/929488097 wait complete. 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.551+0000 7f8e7b3f5640 1 Processor -- start 2023-11-04T01:42:20.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.551+0000 7f8e7b3f5640 1 -- start start 2023-11-04T01:42:20.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e7406fff0 0x7f8e740a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 0x7f8e740a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7414b1f0 con 0x7f8e7406bb60 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7414e5e0 con 0x7f8e74159e40 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e7b3f5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7415bfb0 con 0x7f8e7406fff0 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e79191640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e79191640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46334/0 (socket says 172.21.15.93:46334) 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e79191640 1 -- 172.21.15.93:0/965467739 learned_addr learned my addr 172.21.15.93:0/965467739 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e78990640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e7406fff0 0x7f8e740a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.552+0000 7f8e79992640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 0x7f8e740a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 -- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e7406fff0 msgr2=0x7f8e740a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e7406fff0 0x7f8e740a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 -- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 msgr2=0x7f8e740a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 0x7f8e740a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 -- 172.21.15.93:0/965467739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64009400 con 0x7f8e7406bb60 2023-11-04T01:42:20.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79992640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 0x7f8e740a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e79191640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009f20 tx=0x7f8e7000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700094f0 con 0x7f8e7406bb60 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7000c940 con 0x7f8e7406bb60 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7415c290 con 0x7f8e7406bb60 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000ccf0 con 0x7f8e7406bb60 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.553+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7415c850 con 0x7f8e7406bb60 2023-11-04T01:42:20.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.554+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e740684b0 con 0x7f8e7406bb60 2023-11-04T01:42:20.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.555+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e70011450 con 0x7f8e7406bb60 2023-11-04T01:42:20.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.555+0000 7f8e69ffb640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 0x7f8e5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.555+0000 7f8e78990640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 0x7f8e5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.555+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7f8e7008bb00 con 0x7f8e7406bb60 2023-11-04T01:42:20.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.556+0000 7f8e78990640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 0x7f8e5806d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e64036000 tx=0x7f8e6403e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.560+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e70056450 con 0x7f8e7406bb60 2023-11-04T01:42:20.762 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.760+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e740c9750 con 0x7f8e7406bb60 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.761+0000 7f8e69ffb640 1 -- 172.21.15.93:0/965467739 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f8e7001e020 con 0x7f8e7406bb60 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:17.078836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:17.078835+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 95 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 msgr2=0x7f8e5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 0x7f8e5806d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e64036000 tx=0x7f8e6403e040 comp rx=0 tx=0).stop 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 msgr2=0x7f8e74147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009f20 tx=0x7f8e7000ed00 comp rx=0 tx=0).stop 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 shutdown_connections 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8e5806ae70 0x7f8e5806d330 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e74159e40 0x7f8e740a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8e7406fff0 0x7f8e740a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 --2- 172.21.15.93:0/965467739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8e7406bb60 0x7f8e74147a90 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 >> 172.21.15.93:0/965467739 conn(0x7f8e740cb530 msgr2=0x7f8e740cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 shutdown_connections 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:20.763+0000 7f8e7b3f5640 1 -- 172.21.15.93:0/965467739 wait complete. 2023-11-04T01:42:20.775 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:42:20.776 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:42:20.806 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:42:20.808 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:42:20.808 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:42:20.882 INFO:teuthology.orchestra.run.smithi125.stdout:1699062124.96111.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:42:20.884 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062124.96111.core'] 2023-11-04T01:42:20.884 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062124.96111.core, deleting it 2023-11-04T01:42:20.884 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062124.96111.core 2023-11-04T01:42:20.956 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:21.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.053+0000 7efc08ae5640 1 Processor -- start 2023-11-04T01:42:21.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.053+0000 7efc08ae5640 1 -- start start 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc08ae5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 0x7efc040ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc08ae5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc0406a0d0 0x7efc0406a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc08ae5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc040b25a0 con 0x7efc0415d4e0 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc08ae5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc040cab60 con 0x7efc0406a0d0 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc08ae5640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc040b2300 con 0x7efc040ca1a0 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc02d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc0406a0d0 0x7efc0406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc0259c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7efc0415d4e0 0x7efc040ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45402/0 (socket says 172.21.15.93:45402) 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc0259c640 1 -- 172.21.15.93:0/2569123859 learned_addr learned my addr 172.21.15.93:0/2569123859 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:21.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efbfbfff640 1 --2- 172.21.15.93:0/2569123859 >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 0x7efc040ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc02d9d640 1 -- 172.21.15.93:0/2569123859 >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 msgr2=0x7efc040ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc02d9d640 1 --2- 172.21.15.93:0/2569123859 >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 0x7efc040ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc02d9d640 1 -- 172.21.15.93:0/2569123859 >> v1:172.21.15.93:6789/0 conn(0x7efc0415d4e0 legacy=0x7efc040ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efc02d9d640 1 -- 172.21.15.93:0/2569123859 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0415d8c0 con 0x7efc0406a0d0 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.054+0000 7efbfbfff640 1 --2- 172.21.15.93:0/2569123859 >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 0x7efc040ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc02d9d640 1 --2- 172.21.15.93:0/2569123859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0406a0d0 0x7efc0406a560 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7efc04073ab0 tx=0x7efbfc02bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83cf2daf1e70e7a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc01d9b640 1 -- 172.21.15.93:0/2569123859 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc02c9a0 con 0x7efc0406a0d0 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc01d9b640 1 -- 172.21.15.93:0/2569123859 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc02cb00 con 0x7efc0406a0d0 2023-11-04T01:42:21.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc01d9b640 1 -- 172.21.15.93:0/2569123859 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc02ce90 con 0x7efc0406a0d0 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 -- 172.21.15.93:0/2569123859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0406a0d0 msgr2=0x7efc0406a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2569123859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0406a0d0 0x7efc0406a560 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7efc04073ab0 tx=0x7efbfc02bc70 comp rx=0 tx=0).stop 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 -- 172.21.15.93:0/2569123859 shutdown_connections 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2569123859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0406a0d0 0x7efc0406a560 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2569123859 >> v2:172.21.15.125:3300/0 conn(0x7efc040ca1a0 0x7efc040ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.061 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 -- 172.21.15.93:0/2569123859 >> 172.21.15.93:0/2569123859 conn(0x7efc040b1640 msgr2=0x7efc040b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 -- 172.21.15.93:0/2569123859 shutdown_connections 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.055+0000 7efc08ae5640 1 -- 172.21.15.93:0/2569123859 wait complete. 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 Processor -- start 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 -- start start 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc0406a0d0 0x7efc04155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc040ca1a0 0x7efc04156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04155e80 con 0x7efc0415d4e0 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04156a40 con 0x7efc0406a0d0 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.057+0000 7efc08ae5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc04156c90 con 0x7efc040ca1a0 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.062 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46356/0 (socket says 172.21.15.93:46356) 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 -- 172.21.15.93:0/2086980765 learned_addr learned my addr 172.21.15.93:0/2086980765 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc0259c640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc0406a0d0 0x7efc04155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efbfbfff640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc040ca1a0 0x7efc04156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 -- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc040ca1a0 msgr2=0x7efc04156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc040ca1a0 0x7efc04156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 -- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc0406a0d0 msgr2=0x7efc04155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc0406a0d0 0x7efc04155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 -- 172.21.15.93:0/2086980765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc009a70 con 0x7efc0415d4e0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc02d9d640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009e80 tx=0x7efbfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc040650 con 0x7efc0415d4e0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc0407d0 con 0x7efc0415d4e0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc04156f70 con 0x7efc0415d4e0 2023-11-04T01:42:21.063 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc040b80 con 0x7efc0415d4e0 2023-11-04T01:42:21.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.058+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc04157530 con 0x7efc0415d4e0 2023-11-04T01:42:21.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.059+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc04157750 con 0x7efc0415d4e0 2023-11-04T01:42:21.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.060+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efbfc040ce0 con 0x7efc0415d4e0 2023-11-04T01:42:21.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.060+0000 7efbfaffd640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 0x7efbe406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.064 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.060+0000 7efc0259c640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 0x7efbe406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.060+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7efbfc0acb20 con 0x7efc0415d4e0 2023-11-04T01:42:21.065 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.061+0000 7efc0259c640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 0x7efbe406d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efbf4000f60 tx=0x7efbf4007e00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.066 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.064+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efbfc077620 con 0x7efc0415d4e0 2023-11-04T01:42:21.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.269+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc040684b0 con 0x7efc0415d4e0 2023-11-04T01:42:21.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.270+0000 7efbfaffd640 1 -- 172.21.15.93:0/2086980765 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4986 (secure 0 0 0) 0x7efbfc07ac40 con 0x7efc0415d4e0 2023-11-04T01:42:21.272 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:21.272 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:17.078836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6814,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"d","rank":0,"incarnation":85,"state":"up:active","state_seq":13,"addr":"172.21.15.125:6834/2466276650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2466276650},{"type":"v1","addr":"172.21.15.125:6834","nonce":2466276650}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:17.078835+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:21.273 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 95 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 msgr2=0x7efbe406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 0x7efbe406d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efbf4000f60 tx=0x7efbf4007e00 comp rx=0 tx=0).stop 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 msgr2=0x7efc040c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009e80 tx=0x7efbfc004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 shutdown_connections 2023-11-04T01:42:21.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efbe406ae70 0x7efbe406d330 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc0415d4e0 0x7efc040c3680 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efc040ca1a0 0x7efc04156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 --2- 172.21.15.93:0/2086980765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc0406a0d0 0x7efc04155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 >> 172.21.15.93:0/2086980765 conn(0x7efc040b1640 msgr2=0x7efc04072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 shutdown_connections 2023-11-04T01:42:21.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.272+0000 7efc08ae5640 1 -- 172.21.15.93:0/2086980765 wait complete. 2023-11-04T01:42:21.285 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:42:21.285 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:21.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 down 2023-11-04T01:42:21.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:42:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.450+0000 7fdee5a56640 1 Processor -- start 2023-11-04T01:42:21.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.450+0000 7fdee5a56640 1 -- start start 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d100 0x7fdee00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdee015d4e0 0x7fdee00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdee00d3b60 0x7fdee00d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00b32b0 con 0x7fdee015d4e0 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00cee10 con 0x7fdee00d3b60 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdee5a56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00b2980 con 0x7fdee015d100 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdede7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdee015d4e0 0x7fdee00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdede7fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdee015d4e0 0x7fdee00d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57598/0 (socket says 172.21.15.93:57598) 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.451+0000 7fdede7fc640 1 -- 172.21.15.93:0/1393766444 learned_addr learned my addr 172.21.15.93:0/1393766444 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdedf7fe640 1 --2- 172.21.15.93:0/1393766444 >> v2:172.21.15.125:3300/0 conn(0x7fdee00d3b60 0x7fdee00d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdedeffd640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d100 0x7fdee00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 -- 172.21.15.93:0/1393766444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d100 msgr2=0x7fdee00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d100 0x7fdee00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 -- 172.21.15.93:0/1393766444 >> v2:172.21.15.125:3300/0 conn(0x7fdee00d3b60 msgr2=0x7fdee00d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 --2- 172.21.15.93:0/1393766444 >> v2:172.21.15.125:3300/0 conn(0x7fdee00d3b60 0x7fdee00d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 -- 172.21.15.93:0/1393766444 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00b2c60 con 0x7fdee015d4e0 2023-11-04T01:42:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.452+0000 7fdede7fc640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee015d4e0 0x7fdee00d14d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b27a0 tx=0x7fded402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf73c78836be2f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdeddffb640 1 -- 172.21.15.93:0/1393766444 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4031870 con 0x7fdee015d4e0 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdeddffb640 1 -- 172.21.15.93:0/1393766444 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40319d0 con 0x7fdee015d4e0 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdeddffb640 1 -- 172.21.15.93:0/1393766444 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4031d60 con 0x7fdee015d4e0 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 -- 172.21.15.93:0/1393766444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee015d4e0 msgr2=0x7fdee00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee015d4e0 0x7fdee00d14d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b27a0 tx=0x7fded402b910 comp rx=0 tx=0).stop 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 -- 172.21.15.93:0/1393766444 shutdown_connections 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee015d4e0 0x7fdee00d14d0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 --2- 172.21.15.93:0/1393766444 >> v2:172.21.15.125:3300/0 conn(0x7fdee00d3b60 0x7fdee00d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 --2- 172.21.15.93:0/1393766444 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d100 0x7fdee00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 -- 172.21.15.93:0/1393766444 >> 172.21.15.93:0/1393766444 conn(0x7fdee00d2ef0 msgr2=0x7fdee00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 -- 172.21.15.93:0/1393766444 shutdown_connections 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.453+0000 7fdee5a56640 1 -- 172.21.15.93:0/1393766444 wait complete. 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.454+0000 7fdee5a56640 1 Processor -- start 2023-11-04T01:42:21.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.454+0000 7fdee5a56640 1 -- start start 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 0x7fdee0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d4e0 0x7fdee00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee009f3d0 con 0x7fdee00d3b60 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee009e330 con 0x7fdee015d100 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdee5a56640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee009e610 con 0x7fdee015d4e0 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57600/0 (socket says 172.21.15.93:57600) 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 -- 172.21.15.93:0/3637855512 learned_addr learned my addr 172.21.15.93:0/3637855512 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedf7fe640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d4e0 0x7fdee00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdede7fc640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 0x7fdee0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 -- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d4e0 msgr2=0x7fdee00cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d4e0 0x7fdee00cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 -- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 msgr2=0x7fdee0151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 0x7fdee0151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.455+0000 7fdedeffd640 1 -- 172.21.15.93:0/3637855512 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40094d0 con 0x7fdee00d3b60 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdede7fc640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 0x7fdee0151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdedeffd640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fc0 tx=0x7fded000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014620 con 0x7fdee00d3b60 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0014780 con 0x7fdee00d3b60 2023-11-04T01:42:21.461 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee009e8f0 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014b30 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.456+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee009eeb0 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.457+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee009f040 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.457+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fded0014c90 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.458+0000 7fdec7fff640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 0x7fdecc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.458+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7765+0+0 (secure 0 0 0) 0x7fded008a970 con 0x7fdee00d3b60 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.458+0000 7fdede7fc640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 0x7fdecc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.462 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.458+0000 7fdede7fc640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 0x7fdecc06d360 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fded4036000 tx=0x7fded403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.462+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fded0055100 con 0x7fdee00d3b60 2023-11-04T01:42:21.486 INFO:tasks.ceph.mds.c.smithi093.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:42:21.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.694+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fdee00684b0 con 0x7fdee00d3b60 2023-11-04T01:42:21.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.696+0000 7fdec7fff640 1 -- 172.21.15.93:0/3637855512 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6814 v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7fded0058720 con 0x7fdee00d3b60 2023-11-04T01:42:21.698 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 6814 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.698+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 msgr2=0x7fdecc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.698+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 0x7fdecc06d360 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fded4036000 tx=0x7fded403c040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.698+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 msgr2=0x7fdee009da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.698+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fc0 tx=0x7fded000e570 comp rx=0 tx=0).stop 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 shutdown_connections 2023-11-04T01:42:21.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdecc06aea0 0x7fdecc06d360 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdee015d4e0 0x7fdee00cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdee015d100 0x7fdee0151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 --2- 172.21.15.93:0/3637855512 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee00d3b60 0x7fdee009da30 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 >> 172.21.15.93:0/3637855512 conn(0x7fdee00d2ef0 msgr2=0x7fdee00d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 shutdown_connections 2023-11-04T01:42:21.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.699+0000 7fdee5a56640 1 -- 172.21.15.93:0/3637855512 wait complete. 2023-11-04T01:42:21.714 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:21.714 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:42:21.714 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:42:21.714 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:21.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:21.715 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:42:21.715 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:42:21.715 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:21.717 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:21.717 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:21.801 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:42:21.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.815+0000 7fd2b76d4640 1 Processor -- start 2023-11-04T01:42:21.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.815+0000 7fd2b76d4640 1 -- start start 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b76d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 0x7fd2b00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b76d4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2b015d4e0 0x7fd2b00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b76d4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00b32b0 con 0x7fd2b00d3b60 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b76d4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00cee10 con 0x7fd2b015d4e0 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b76d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00b4750 con 0x7fd2b015d100 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b5470640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 0x7fd2b00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b4c6f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2b015d4e0 0x7fd2b00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b5c71640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd2b00d3b60 0x7fd2b00cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:50752/0 (socket says 172.21.15.93:50752) 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.816+0000 7fd2b5c71640 1 -- 172.21.15.93:0/3237000584 learned_addr learned my addr 172.21.15.93:0/3237000584 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2a7fff640 1 -- 172.21.15.93:0/3237000584 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062760782 0 0) 0x7fd2b00b32b0 con 0x7fd2b00d3b60 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2a7fff640 1 -- 172.21.15.93:0/3237000584 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29c003520 con 0x7fd2b00d3b60 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2b4c6f640 1 -- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 msgr2=0x7fd2b00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2b4c6f640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 0x7fd2b00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2b4c6f640 1 -- 172.21.15.93:0/3237000584 >> v1:172.21.15.125:6789/0 conn(0x7fd2b00d3b60 legacy=0x7fd2b00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2b4c6f640 1 -- 172.21.15.93:0/3237000584 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00b2980 con 0x7fd2b015d4e0 2023-11-04T01:42:21.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.817+0000 7fd2b5470640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 0x7fd2b00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:21.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b4c6f640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d4e0 0x7fd2b00d14d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00097a0 tx=0x7fd2a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580841bd2c085a2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2a7fff640 1 -- 172.21.15.93:0/3237000584 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0031830 con 0x7fd2b015d4e0 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2a7fff640 1 -- 172.21.15.93:0/3237000584 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0031990 con 0x7fd2b015d4e0 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2a7fff640 1 -- 172.21.15.93:0/3237000584 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0031d20 con 0x7fd2b015d4e0 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 -- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d4e0 msgr2=0x7fd2b00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d4e0 0x7fd2b00d14d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00097a0 tx=0x7fd2a002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 -- 172.21.15.93:0/3237000584 shutdown_connections 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d4e0 0x7fd2b00d14d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/3237000584 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b015d100 0x7fd2b00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 -- 172.21.15.93:0/3237000584 >> 172.21.15.93:0/3237000584 conn(0x7fd2b00d2ef0 msgr2=0x7fd2b00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 -- 172.21.15.93:0/3237000584 shutdown_connections 2023-11-04T01:42:21.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.818+0000 7fd2b76d4640 1 -- 172.21.15.93:0/3237000584 wait complete. 2023-11-04T01:42:21.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.819+0000 7fd2b76d4640 1 Processor -- start 2023-11-04T01:42:21.823 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.819+0000 7fd2b76d4640 1 -- start start 2023-11-04T01:42:21.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b00d3b60 0x7fd2b015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d100 0x7fd2b00c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.824 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b015aee0 con 0x7fd2b015d4e0 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01f2a30 con 0x7fd2b015d100 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b76d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b015e7d0 con 0x7fd2b00d3b60 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b5c71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b5c71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57602/0 (socket says 172.21.15.93:57602) 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b5470640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b00d3b60 0x7fd2b015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b4c6f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d100 0x7fd2b00c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.820+0000 7fd2b5c71640 1 -- 172.21.15.93:0/4095621063 learned_addr learned my addr 172.21.15.93:0/4095621063 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 -- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b00d3b60 msgr2=0x7fd2b015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b00d3b60 0x7fd2b015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 -- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d100 msgr2=0x7fd2b00c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d100 0x7fd2b00c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.825 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 -- 172.21.15.93:0/4095621063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009a70 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b5c71640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c390 tx=0x7fd2a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8005ce0 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8005e40 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8007310 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0009400 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.821+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b015e210 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.822+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b00684b0 con 0x7fd2b015d4e0 2023-11-04T01:42:21.826 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.822+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2a8007470 con 0x7fd2b015d4e0 2023-11-04T01:42:21.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.823+0000 7fd2a5ffb640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 0x7fd29406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.823+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7823+0+0 (secure 0 0 0) 0x7fd2a8089330 con 0x7fd2b015d4e0 2023-11-04T01:42:21.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.823+0000 7fd2b5470640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 0x7fd29406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.827 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.823+0000 7fd2b5470640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 0x7fd29406d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac011520 tx=0x7fd2ac00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.829 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:21.828+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2a8053ce0 con 0x7fd2b015d4e0 2023-11-04T01:42:22.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.027+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2b00d20c0 con 0x7fd2b015d4e0 2023-11-04T01:42:22.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.027+0000 7fd2a5ffb640 1 -- 172.21.15.93:0/4095621063 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4143 (secure 0 0 0) 0x7fd2a8017090 con 0x7fd2b015d4e0 2023-11-04T01:42:22.030 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:22.030 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:21.703476+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:22.030 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 97 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 msgr2=0x7fd29406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 0x7fd29406d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac011520 tx=0x7fd2ac00b040 comp rx=0 tx=0).stop 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 msgr2=0x7fd2b01f24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c390 tx=0x7fd2a800c850 comp rx=0 tx=0).stop 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 shutdown_connections 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd29406ae70 0x7fd29406d330 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2b015d4e0 0x7fd2b01f24f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2b015d100 0x7fd2b00c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 --2- 172.21.15.93:0/4095621063 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd2b00d3b60 0x7fd2b015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 >> 172.21.15.93:0/4095621063 conn(0x7fd2b00d2ef0 msgr2=0x7fd2b00d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 shutdown_connections 2023-11-04T01:42:22.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:22.030+0000 7fd2b76d4640 1 -- 172.21.15.93:0/4095621063 wait complete. 2023-11-04T01:42:22.042 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:22.481 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:22.484 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:26.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:42:26.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:42:27.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 Processor -- start 2023-11-04T01:42:27.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 -- start start 2023-11-04T01:42:27.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d100 0x7f39800ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39800d1be0 0x7f39800b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800b32b0 con 0x7f398015d4e0 2023-11-04T01:42:27.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800cee10 con 0x7f39800d1be0 2023-11-04T01:42:27.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.153+0000 7f39865a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800b2980 con 0x7f398015d100 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f3984b46640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39800d1be0 0x7f39800b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f397f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f398015d4e0 0x7f39800d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42022/0 (socket says 172.21.15.93:42022) 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f397f7fe640 1 -- 172.21.15.93:0/1914085068 learned_addr learned my addr 172.21.15.93:0/1914085068 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f397ffff640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d100 0x7f39800ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f3984b46640 1 -- 172.21.15.93:0/1914085068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d100 msgr2=0x7f39800ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f3984b46640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d100 0x7f39800ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f3984b46640 1 -- 172.21.15.93:0/1914085068 >> v1:172.21.15.93:6789/0 conn(0x7f398015d4e0 legacy=0x7f39800d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.154+0000 7f3984b46640 1 -- 172.21.15.93:0/1914085068 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800b2c60 con 0x7f39800d1be0 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f3984b46640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800b3740 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f3978009dc0 tx=0x7f397802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a8d276e6838985 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f397effd640 1 -- 172.21.15.93:0/1914085068 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397802cc40 con 0x7f39800d1be0 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f397effd640 1 -- 172.21.15.93:0/1914085068 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397802cda0 con 0x7f39800d1be0 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f397effd640 1 -- 172.21.15.93:0/1914085068 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978034660 con 0x7f39800d1be0 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 -- 172.21.15.93:0/1914085068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 msgr2=0x7f39800b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800b3740 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f3978009dc0 tx=0x7f397802be90 comp rx=0 tx=0).stop 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 -- 172.21.15.93:0/1914085068 shutdown_connections 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800b3740 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 --2- 172.21.15.93:0/1914085068 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d100 0x7f39800ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 -- 172.21.15.93:0/1914085068 >> 172.21.15.93:0/1914085068 conn(0x7f39800d2ef0 msgr2=0x7f39800d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 -- 172.21.15.93:0/1914085068 shutdown_connections 2023-11-04T01:42:27.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.155+0000 7f39865a9640 1 -- 172.21.15.93:0/1914085068 wait complete. 2023-11-04T01:42:27.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 Processor -- start 2023-11-04T01:42:27.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 -- start start 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 0x7f39800b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d4e0 0x7f398015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800c9fc0 con 0x7f39800d1be0 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800b5ff0 con 0x7f398015d100 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.157+0000 7f39865a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800ca260 con 0x7f398015d4e0 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57630/0 (socket says 172.21.15.93:57630) 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 -- 172.21.15.93:0/3269697819 learned_addr learned my addr 172.21.15.93:0/3269697819 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f3984b46640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d4e0 0x7f398015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397f7fe640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 0x7f39800b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 -- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d4e0 msgr2=0x7f398015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d4e0 0x7f398015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 -- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 msgr2=0x7f39800b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 0x7f39800b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 -- 172.21.15.93:0/3269697819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009a70 con 0x7f39800d1be0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397f7fe640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 0x7f39800b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397ffff640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f397000d800 tx=0x7f397000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000b6c0 con 0x7f39800d1be0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000b820 con 0x7f39800d1be0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39800ca540 con 0x7f39800d1be0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000bbd0 con 0x7f39800d1be0 2023-11-04T01:42:27.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.158+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39800b8c50 con 0x7f39800d1be0 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.159+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800b8e10 con 0x7f39800d1be0 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.160+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f397000bd30 con 0x7f39800d1be0 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.160+0000 7f397cff9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.160+0000 7f397f7fe640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.160+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f397008a2c0 con 0x7f39800d1be0 2023-11-04T01:42:27.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.161+0000 7f397f7fe640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39800ce970 tx=0x7f3974009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.164+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3970054b30 con 0x7f39800d1be0 2023-11-04T01:42:27.367 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.366+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39800684b0 con 0x7f39800d1be0 2023-11-04T01:42:27.368 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.366+0000 7f397cff9640 1 -- 172.21.15.93:0/3269697819 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f3970058150 con 0x7f39800d1be0 2023-11-04T01:42:27.368 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:27.368 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:21.720759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:27.368 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 98 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 msgr2=0x7f396c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39800ce970 tx=0x7f3974009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 msgr2=0x7f39800cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f397000d800 tx=0x7f397000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 shutdown_connections 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f398015d4e0 0x7f398015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f398015d100 0x7f39800b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.370 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 --2- 172.21.15.93:0/3269697819 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39800d1be0 0x7f39800cad40 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 >> 172.21.15.93:0/3269697819 conn(0x7f39800d2ef0 msgr2=0x7f39800b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 shutdown_connections 2023-11-04T01:42:27.371 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.368+0000 7f39865a9640 1 -- 172.21.15.93:0/3269697819 wait complete. 2023-11-04T01:42:27.380 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:27.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.479+0000 7fa50375e640 1 Processor -- start 2023-11-04T01:42:27.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.480+0000 7fa50375e640 1 -- start start 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.480+0000 7fa50375e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.480+0000 7fa50375e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0b32b0 con 0x7fa4fc15d100 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.480+0000 7fa50375e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0cee10 con 0x7fa4fc0d3b60 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.480+0000 7fa50375e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cec20 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57636/0 (socket says 172.21.15.93:57636) 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa5014fa640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa4fc15d100 0x7fa4fc0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42028/0 (socket says 172.21.15.93:42028) 2023-11-04T01:42:27.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 -- 172.21.15.93:0/691011999 learned_addr learned my addr 172.21.15.93:0/691011999 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:27.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 -- 172.21.15.93:0/691011999 >> v1:172.21.15.125:6789/0 conn(0x7fa4fc0d3b60 legacy=0x7fa4fc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 -- 172.21.15.93:0/691011999 >> v1:172.21.15.93:6789/0 conn(0x7fa4fc15d100 legacy=0x7fa4fc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa4f3fff640 1 -- 172.21.15.93:0/691011999 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458877875 0 0) 0x7fa4fc0b32b0 con 0x7fa4fc15d100 2023-11-04T01:42:27.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.481+0000 7fa500cf9640 1 -- 172.21.15.93:0/691011999 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0b2980 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa500cf9640 1 --2- 172.21.15.93:0/691011999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009870 tx=0x7fa4f802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de47458b3933f151 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa4f3fff640 1 -- 172.21.15.93:0/691011999 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f802f840 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa4f3fff640 1 -- 172.21.15.93:0/691011999 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f802f9a0 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa4f3fff640 1 -- 172.21.15.93:0/691011999 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f802fd30 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 -- 172.21.15.93:0/691011999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d4e0 msgr2=0x7fa4fc0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 --2- 172.21.15.93:0/691011999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009870 tx=0x7fa4f802ba20 comp rx=0 tx=0).stop 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 -- 172.21.15.93:0/691011999 shutdown_connections 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 --2- 172.21.15.93:0/691011999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc0d14d0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.484 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 -- 172.21.15.93:0/691011999 >> 172.21.15.93:0/691011999 conn(0x7fa4fc0d2ef0 msgr2=0x7fa4fc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 -- 172.21.15.93:0/691011999 shutdown_connections 2023-11-04T01:42:27.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.482+0000 7fa50375e640 1 -- 172.21.15.93:0/691011999 wait complete. 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 Processor -- start 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 -- start start 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 0x7fa4fc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc15e2c0 con 0x7fa4fc15d100 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc15d990 con 0x7fa4fc15d4e0 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa50375e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cc0e0 con 0x7fa4fc0d3b60 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa500cf9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.487 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa500cf9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57644/0 (socket says 172.21.15.93:57644) 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.484+0000 7fa500cf9640 1 -- 172.21.15.93:0/1312965158 learned_addr learned my addr 172.21.15.93:0/1312965158 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa5014fa640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 0x7fa4fc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa501cfb640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 -- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 msgr2=0x7fa4fc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 0x7fa4fc152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 -- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 msgr2=0x7fa4fc152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 -- 172.21.15.93:0/1312965158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094d0 con 0x7fa4fc15d100 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa501cfb640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa5014fa640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 0x7fa4fc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa500cf9640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009870 tx=0x7fa4f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f803b040 con 0x7fa4fc15d100 2023-11-04T01:42:27.488 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8037d50 con 0x7fa4fc15d100 2023-11-04T01:42:27.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc15dc00 con 0x7fa4fc15d100 2023-11-04T01:42:27.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8004270 con 0x7fa4fc15d100 2023-11-04T01:42:27.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.485+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc152950 con 0x7fa4fc15d100 2023-11-04T01:42:27.489 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.486+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc0b25f0 con 0x7fa4fc15d100 2023-11-04T01:42:27.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.487+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4f80043d0 con 0x7fa4fc15d100 2023-11-04T01:42:27.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.487+0000 7fa4f1ffb640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 0x7fa4e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.487+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7823+0+0 (secure 0 0 0) 0x7fa4f80acd80 con 0x7fa4fc15d100 2023-11-04T01:42:27.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.487+0000 7fa5014fa640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 0x7fa4e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.490 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.488+0000 7fa5014fa640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 0x7fa4e006d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0012a0 tx=0x7fa4ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.491+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4f8077680 con 0x7fa4fc15d100 2023-11-04T01:42:27.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.694+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4fc0684b0 con 0x7fa4fc15d100 2023-11-04T01:42:27.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.695+0000 7fa4f1ffb640 1 -- 172.21.15.93:0/1312965158 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fa4f807aca0 con 0x7fa4fc15d100 2023-11-04T01:42:27.696 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:27.697 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:21.720759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:27.697 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 98 2023-11-04T01:42:27.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 msgr2=0x7fa4e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 0x7fa4e006d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0012a0 tx=0x7fa4ec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 msgr2=0x7fa4fc0cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009870 tx=0x7fa4f80046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 shutdown_connections 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fa4e006ae70 0x7fa4e006d330 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4fc15d4e0 0x7fa4fc152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4fc15d100 0x7fa4fc0cbba0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 --2- 172.21.15.93:0/1312965158 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fa4fc0d3b60 0x7fa4fc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 >> 172.21.15.93:0/1312965158 conn(0x7fa4fc0d2ef0 msgr2=0x7fa4fc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 shutdown_connections 2023-11-04T01:42:27.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.697+0000 7fa50375e640 1 -- 172.21.15.93:0/1312965158 wait complete. 2023-11-04T01:42:27.709 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:42:27.709 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32839393615722656s 2023-11-04T01:42:27.709 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 Processor -- start 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 -- start start 2023-11-04T01:42:27.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f006415d100 0x7f00640ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 0x7f00640b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640b32b0 con 0x7f006415d4e0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640cee10 con 0x7f006415d100 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.808+0000 7f006adcc640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640b2980 con 0x7f00640d1be0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0068b68640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f006415d100 0x7f00640ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0063fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f006415d4e0 0x7f00640d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42030/0 (socket says 172.21.15.93:42030) 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0063fff640 1 -- 172.21.15.93:0/851597214 learned_addr learned my addr 172.21.15.93:0/851597214 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f00637fe640 1 -- 172.21.15.93:0/851597214 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759453405 0 0) 0x7f00640b32b0 con 0x7f006415d4e0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f00637fe640 1 -- 172.21.15.93:0/851597214 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0050003520 con 0x7f006415d4e0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0069369640 1 --2- 172.21.15.93:0/851597214 >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 0x7f00640b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0068b68640 1 -- 172.21.15.93:0/851597214 >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 msgr2=0x7f00640b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0068b68640 1 --2- 172.21.15.93:0/851597214 >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 0x7f00640b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0068b68640 1 -- 172.21.15.93:0/851597214 >> v1:172.21.15.93:6789/0 conn(0x7f006415d4e0 legacy=0x7f00640d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0068b68640 1 -- 172.21.15.93:0/851597214 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640b2c60 con 0x7f006415d100 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.809+0000 7f0069369640 1 --2- 172.21.15.93:0/851597214 >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 0x7f00640b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f0068b68640 1 --2- 172.21.15.93:0/851597214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f00640ce510 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f006408d6a0 tx=0x7f005c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca7a66d92a0c4d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f00637fe640 1 -- 172.21.15.93:0/851597214 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c02ccb0 con 0x7f006415d100 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f00637fe640 1 -- 172.21.15.93:0/851597214 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c02ce10 con 0x7f006415d100 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f00637fe640 1 -- 172.21.15.93:0/851597214 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c034640 con 0x7f006415d100 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 -- 172.21.15.93:0/851597214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 msgr2=0x7f00640ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 --2- 172.21.15.93:0/851597214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f00640ce510 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f006408d6a0 tx=0x7f005c02bf00 comp rx=0 tx=0).stop 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 -- 172.21.15.93:0/851597214 shutdown_connections 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 --2- 172.21.15.93:0/851597214 >> v2:172.21.15.125:3300/0 conn(0x7f00640d1be0 0x7f00640b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 --2- 172.21.15.93:0/851597214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f00640ce510 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 -- 172.21.15.93:0/851597214 >> 172.21.15.93:0/851597214 conn(0x7f00640d2ef0 msgr2=0x7f00640d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 -- 172.21.15.93:0/851597214 shutdown_connections 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.810+0000 7f006adcc640 1 -- 172.21.15.93:0/851597214 wait complete. 2023-11-04T01:42:27.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.811+0000 7f006adcc640 1 Processor -- start 2023-11-04T01:42:27.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 -- start start 2023-11-04T01:42:27.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 0x7f0064160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f006415d4e0 0x7f00640b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415fc40 con 0x7f006415d100 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641f2770 con 0x7f00640d1be0 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f006adcc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006415efc0 con 0x7f006415d4e0 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f0063fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.812+0000 7f0063fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57670/0 (socket says 172.21.15.93:57670) 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 -- 172.21.15.93:0/3621490987 learned_addr learned my addr 172.21.15.93:0/3621490987 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0068b68640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 0x7f0064160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0069369640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f006415d4e0 0x7f00640b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 -- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f006415d4e0 msgr2=0x7f00640b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f006415d4e0 0x7f00640b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.817 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 -- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 msgr2=0x7f0064160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 0x7f0064160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 -- 172.21.15.93:0/3621490987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009a70 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0068b68640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 0x7f0064160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f0063fff640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c400 tx=0x7f004c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c005ce0 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c005e60 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006415f2a0 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0072f0 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.813+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006415f860 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.814+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640684b0 con 0x7f006415d100 2023-11-04T01:42:27.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.814+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f004c007450 con 0x7f006415d100 2023-11-04T01:42:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.815+0000 7f00617fa640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 0x7f004406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.815+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f004c089440 con 0x7f006415d100 2023-11-04T01:42:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.815+0000 7f0068b68640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 0x7f004406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.815+0000 7f0068b68640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 0x7f004406d330 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f005c036000 tx=0x7f005c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:27.819+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f004c053d40 con 0x7f006415d100 2023-11-04T01:42:28.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.020+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f006415bdc0 con 0x7f006415d100 2023-11-04T01:42:28.021 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.020+0000 7f00617fa640 1 -- 172.21.15.93:0/3621490987 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f004c017020 con 0x7f006415d100 2023-11-04T01:42:28.022 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:28.022 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:21.720759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":8157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8157":{"gid":8157,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.93:6836/2025150673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2025150673},{"type":"v1","addr":"172.21.15.93:6836","nonce":2025150673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:28.022 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 98 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 msgr2=0x7f004406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 0x7f004406d330 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f005c036000 tx=0x7f005c030000 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 msgr2=0x7f0064157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c400 tx=0x7f004c00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 shutdown_connections 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f004406ae70 0x7f004406d330 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f006415d4e0 0x7f00640b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f006415d100 0x7f0064157d60 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 --2- 172.21.15.93:0/3621490987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00640d1be0 0x7f0064160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 >> 172.21.15.93:0/3621490987 conn(0x7f00640d2ef0 msgr2=0x7f00640b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.022+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 shutdown_connections 2023-11-04T01:42:28.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.023+0000 7f006adcc640 1 -- 172.21.15.93:0/3621490987 wait complete. 2023-11-04T01:42:28.035 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:42:28.158 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":22,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:42:28.158 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" }, "version": 22 } ], "snaps": [] } 2023-11-04T01:42:28.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:42:28.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.258+0000 7f8b3934c640 1 Processor -- start 2023-11-04T01:42:28.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.258+0000 7f8b3934c640 1 -- start start 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b3934c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3415b200 0x7f8b340ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b3934c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b340cd9c0 0x7f8b340ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b3934c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b340cde80 con 0x7f8b340afda0 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b3934c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b340cf670 con 0x7f8b340cd9c0 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b3934c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340cf950 con 0x7f8b3415b200 2023-11-04T01:42:28.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b337fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b340cd9c0 0x7f8b340ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b337fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b340cd9c0 0x7f8b340ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57678/0 (socket says 172.21.15.93:57678) 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.259+0000 7f8b337fe640 1 -- 172.21.15.93:0/1319050922 learned_addr learned my addr 172.21.15.93:0/1319050922 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b32ffd640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3415b200 0x7f8b340ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b337fe640 1 -- 172.21.15.93:0/1319050922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3415b200 msgr2=0x7f8b340ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b337fe640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3415b200 0x7f8b340ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b337fe640 1 -- 172.21.15.93:0/1319050922 >> v1:172.21.15.125:6789/0 conn(0x7f8b340afda0 legacy=0x7f8b340cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b337fe640 1 -- 172.21.15.93:0/1319050922 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340ce120 con 0x7f8b340cd9c0 2023-11-04T01:42:28.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.260+0000 7f8b337fe640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b340cd9c0 0x7f8b340ae2b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ef1ba2f045c4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b31ffb640 1 -- 172.21.15.93:0/1319050922 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0317c0 con 0x7f8b340cd9c0 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b31ffb640 1 -- 172.21.15.93:0/1319050922 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c031920 con 0x7f8b340cd9c0 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b31ffb640 1 -- 172.21.15.93:0/1319050922 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c031cb0 con 0x7f8b340cd9c0 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 -- 172.21.15.93:0/1319050922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b340cd9c0 msgr2=0x7f8b340ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b340cd9c0 0x7f8b340ae2b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c02b860 comp rx=0 tx=0).stop 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 -- 172.21.15.93:0/1319050922 shutdown_connections 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b340cd9c0 0x7f8b340ae2b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 --2- 172.21.15.93:0/1319050922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b3415b200 0x7f8b340ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 -- 172.21.15.93:0/1319050922 >> 172.21.15.93:0/1319050922 conn(0x7f8b340d0c30 msgr2=0x7f8b340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 -- 172.21.15.93:0/1319050922 shutdown_connections 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.261+0000 7f8b3934c640 1 -- 172.21.15.93:0/1319050922 wait complete. 2023-11-04T01:42:28.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.262+0000 7f8b3934c640 1 Processor -- start 2023-11-04T01:42:28.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.262+0000 7f8b3934c640 1 -- start start 2023-11-04T01:42:28.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b340afda0 0x7f8b341563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b340cd9c0 0x7f8b34156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34158d40 con 0x7f8b3415b200 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b341568f0 con 0x7f8b340afda0 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b3934c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34157010 con 0x7f8b340cd9c0 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b337fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b337fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57688/0 (socket says 172.21.15.93:57688) 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b337fe640 1 -- 172.21.15.93:0/2954580403 learned_addr learned my addr 172.21.15.93:0/2954580403 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b327fc640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b340cd9c0 0x7f8b34156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.263+0000 7f8b32ffd640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b340afda0 0x7f8b341563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 -- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b340cd9c0 msgr2=0x7f8b34156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b340cd9c0 0x7f8b34156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 -- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b340afda0 msgr2=0x7f8b341563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b340afda0 0x7f8b341563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 -- 172.21.15.93:0/2954580403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0094d0 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b337fe640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c032860 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c0329e0 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34158a60 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c032d90 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.264+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b341e41d0 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.265+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3406f170 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.265+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b2c04e450 con 0x7f8b3415b200 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.266+0000 7f8b1b7fe640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 0x7f8b2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.266+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f8b2c0abea0 con 0x7f8b3415b200 2023-11-04T01:42:28.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.266+0000 7f8b32ffd640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 0x7f8b2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.266+0000 7f8b32ffd640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 0x7f8b2006d330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b24003b80 tx=0x7f8b24009880 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.270+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b2c0768f0 con 0x7f8b3415b200 2023-11-04T01:42:28.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.502+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f8b340684b0 con 0x7f8b3415b200 2023-11-04T01:42:28.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.504+0000 7f8b1b7fe640 1 -- 172.21.15.93:0/2954580403 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8157 v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8b2c079f10 con 0x7f8b3415b200 2023-11-04T01:42:28.506 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 8157 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.507+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 msgr2=0x7f8b2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.507+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 0x7f8b2006d330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b24003b80 tx=0x7f8b24009880 comp rx=0 tx=0).stop 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.507+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 msgr2=0x7f8b341e5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.507+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009870 tx=0x7f8b2c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 shutdown_connections 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8b2006ae70 0x7f8b2006d330 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b3415b200 0x7f8b341e5070 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8b340cd9c0 0x7f8b34156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 --2- 172.21.15.93:0/2954580403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b340afda0 0x7f8b341563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 >> 172.21.15.93:0/2954580403 conn(0x7f8b340d0c30 msgr2=0x7f8b340b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 shutdown_connections 2023-11-04T01:42:28.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.508+0000 7f8b3934c640 1 -- 172.21.15.93:0/2954580403 wait complete. 2023-11-04T01:42:28.521 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:28.521 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:28.521 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:28.521 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:28.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:28.522 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:42:28.522 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:28.522 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:28.524 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:28.524 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:28.600 INFO:tasks.ceph.mds.c.smithi093.stdout:starting mds.c at 2023-11-04T01:42:28.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 Processor -- start 2023-11-04T01:42:28.625 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 -- start start 2023-11-04T01:42:28.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16d00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d015d590 con 0x7f16d00b4940 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00b5260 con 0x7f16d015d1b0 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.624+0000 7f16d6389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ce6c0 con 0x7f16d00b4dd0 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16cf7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f16d00b4940 0x7f16d00b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:42050/0 (socket says 172.21.15.93:42050) 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16cf7fe640 1 -- 172.21.15.93:0/1225924429 learned_addr learned my addr 172.21.15.93:0/1225924429 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792720452 0 0) 0x7f16c4001110 con 0x7f16d00b4940 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b8003520 con 0x7f16d00b4940 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16d4926640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16d00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4275206286 0 0) 0x7f16b8003520 con 0x7f16d00b4940 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 msgr2=0x7f16d00b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16d00b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 >> v1:172.21.15.125:6789/0 conn(0x7f16d015d1b0 legacy=0x7f16d00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00d1a50 con 0x7f16d00b4940 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f16c4001800 con 0x7f16d00b4940 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 >> v1:172.21.15.93:6789/0 conn(0x7f16d00b4940 legacy=0x7f16d00b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b80039a0 0x7f16b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b8004d00 0x7f16b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ce6c0 con 0x7f16b8004d00 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800ba30 con 0x7f16b80039a0 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bbf0 con 0x7f16d00b4dd0 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16d4926640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b8004d00 0x7f16b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16cffff640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b80039a0 0x7f16b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.625+0000 7f16cf7fe640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 -- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 msgr2=0x7f16b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16d00b4dd0 0x7f16b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 -- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b80039a0 msgr2=0x7f16b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16b80039a0 0x7f16b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 -- 172.21.15.93:0/1225924429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8003520 con 0x7f16b8004d00 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16d4926640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b8004d00 0x7f16b8005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009f90 tx=0x7f16b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ce89fa744fcb60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c802cbd0 con 0x7f16b8004d00 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800f040 con 0x7f16b8004d00 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.626+0000 7f16ceffd640 1 -- 172.21.15.93:0/1225924429 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8034440 con 0x7f16b8004d00 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 -- 172.21.15.93:0/1225924429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b8004d00 msgr2=0x7f16b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 --2- 172.21.15.93:0/1225924429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16b8004d00 0x7f16b8005180 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009f90 tx=0x7f16b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d4926640 1 -- 172.21.15.93:0/1225924429 reap_dead start 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 -- 172.21.15.93:0/1225924429 shutdown_connections 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 -- 172.21.15.93:0/1225924429 >> 172.21.15.93:0/1225924429 conn(0x7f16d00cf940 msgr2=0x7f16d00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 -- 172.21.15.93:0/1225924429 shutdown_connections 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.627+0000 7f16d6389640 1 -- 172.21.15.93:0/1225924429 wait complete. 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.628+0000 7f16d6389640 1 Processor -- start 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.628+0000 7f16d6389640 1 -- start start 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 0x7f16d00c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 0x7f16d00b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d014e950 con 0x7f16d015d730 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00c8000 con 0x7f16d00cab40 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d6389640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00cb390 con 0x7f16b8004d00 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:57716/0 (socket says 172.21.15.93:57716) 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 -- 172.21.15.93:0/253011303 learned_addr learned my addr 172.21.15.93:0/253011303 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cffff640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 0x7f16d00c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d4926640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 0x7f16d00b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 -- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 msgr2=0x7f16d00c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 0x7f16d00c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 -- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 msgr2=0x7f16d00b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 0x7f16d00b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cf7fe640 1 -- 172.21.15.93:0/253011303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00cb670 con 0x7f16d015d730 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16cffff640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 0x7f16d00c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.629+0000 7f16d4926640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 0x7f16d00b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16cf7fe640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f16c4001930 tx=0x7f16c40077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400f9c0 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400fb60 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00c8250 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40133f0 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.630+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d00cafc0 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.631+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d00cb150 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.631+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16c4013550 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.632+0000 7f16ccff9640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 0x7f16bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.632+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f16c4089f90 con 0x7f16d015d730 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.632+0000 7f16cffff640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 0x7f16bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.632+0000 7f16cffff640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 0x7f16bc06d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16c00035f0 tx=0x7f16c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.636+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16c40bcca0 con 0x7f16d015d730 2023-11-04T01:42:28.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.836+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16d00c8770 con 0x7f16d015d730 2023-11-04T01:42:28.837 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.836+0000 7f16ccff9640 1 -- 172.21.15.93:0/253011303 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4148 (secure 0 0 0) 0x7f16d00c8770 con 0x7f16d015d730 2023-11-04T01:42:28.838 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:28.838 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:28.508412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:28.838 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 100 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 msgr2=0x7f16bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 0x7f16bc06d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16c00035f0 tx=0x7f16c0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 msgr2=0x7f16d014e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f16c4001930 tx=0x7f16c40077a0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 shutdown_connections 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16bc06aea0 0x7f16bc06d360 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16d00cab40 0x7f16d00b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16d015d730 0x7f16d014e410 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 --2- 172.21.15.93:0/253011303 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f16b8004d00 0x7f16d00c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 >> 172.21.15.93:0/253011303 conn(0x7f16d00cf940 msgr2=0x7f16d00b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.840 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 shutdown_connections 2023-11-04T01:42:28.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:28.838+0000 7f16d6389640 1 -- 172.21.15.93:0/253011303 wait complete. 2023-11-04T01:42:28.850 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:33.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:42:33.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:33.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.963+0000 7f1a6607c640 1 Processor -- start 2023-11-04T01:42:33.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.963+0000 7f1a6607c640 1 -- start start 2023-11-04T01:42:33.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a600ade00 0x7f1a600b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a6006d9c0 0x7f1a600710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006c5f0 0x7f1a60071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6006cc90 con 0x7f1a6006d9c0 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a60071b50 con 0x7f1a600ade00 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a6607c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600b0e60 con 0x7f1a6006c5f0 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a6006d9c0 0x7f1a600710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a6006d9c0 0x7f1a600710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58276/0 (socket says 172.21.15.93:58276) 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 -- 172.21.15.93:0/2584998184 learned_addr learned my addr 172.21.15.93:0/2584998184 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/2584998184 >> v2:172.21.15.125:3300/0 conn(0x7f1a600ade00 0x7f1a600b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5ffff640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006c5f0 0x7f1a60071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 -- 172.21.15.93:0/2584998184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006c5f0 msgr2=0x7f1a60071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006c5f0 0x7f1a60071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 -- 172.21.15.93:0/2584998184 >> v2:172.21.15.125:3300/0 conn(0x7f1a600ade00 msgr2=0x7f1a600b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2584998184 >> v2:172.21.15.125:3300/0 conn(0x7f1a600ade00 0x7f1a600b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.964+0000 7f1a5effd640 1 -- 172.21.15.93:0/2584998184 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6006cee0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.965+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a600710d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1a600cb430 tx=0x7f1a5002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164c9b6fa5af5541 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.965+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/2584998184 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50031750 con 0x7f1a6006d9c0 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.965+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/2584998184 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a500318b0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.965+0000 7f1a5e7fc640 1 -- 172.21.15.93:0/2584998184 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50031c40 con 0x7f1a6006d9c0 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 -- 172.21.15.93:0/2584998184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 msgr2=0x7f1a600710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a600710d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1a600cb430 tx=0x7f1a5002b7f0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 -- 172.21.15.93:0/2584998184 shutdown_connections 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a600710d0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2584998184 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a6006c5f0 0x7f1a60071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2584998184 >> v2:172.21.15.125:3300/0 conn(0x7f1a600ade00 0x7f1a600b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 -- 172.21.15.93:0/2584998184 >> 172.21.15.93:0/2584998184 conn(0x7f1a600cb530 msgr2=0x7f1a600cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 -- 172.21.15.93:0/2584998184 shutdown_connections 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.966+0000 7f1a6607c640 1 -- 172.21.15.93:0/2584998184 wait complete. 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.967+0000 7f1a6607c640 1 Processor -- start 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.967+0000 7f1a6607c640 1 -- start start 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a6006c5f0 0x7f1a6014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600ade00 0x7f1a600c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60150af0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6014fee0 con 0x7f1a6006c5f0 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a6607c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601501c0 con 0x7f1a600ade00 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58290/0 (socket says 172.21.15.93:58290) 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 -- 172.21.15.93:0/2922330020 learned_addr learned my addr 172.21.15.93:0/2922330020 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5ffff640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600ade00 0x7f1a600c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a6006c5f0 0x7f1a6014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 -- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600ade00 msgr2=0x7f1a600c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600ade00 0x7f1a600c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 -- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a6006c5f0 msgr2=0x7f1a6014ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a6006c5f0 0x7f1a6014ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 -- 172.21.15.93:0/2922330020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500094d0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.968+0000 7f1a5effd640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1a50000c00 tx=0x7f1a500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.969+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50033c80 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.969+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50033e00 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.969+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a601504a0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.969+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5003c640 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.969+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a601514c0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.970+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a600684b0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.970+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a5003a040 con 0x7f1a6006d9c0 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.970+0000 7f1a47fff640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.971+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f1a500ab8e0 con 0x7f1a6006d9c0 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.971+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.971+0000 7f1a5f7fe640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1a60156080 tx=0x7f1a54008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:33.975+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a50076350 con 0x7f1a6006d9c0 2023-11-04T01:42:34.176 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.175+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a600cddc0 con 0x7f1a6006d9c0 2023-11-04T01:42:34.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.175+0000 7f1a47fff640 1 -- 172.21.15.93:0/2922330020 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4945 (secure 0 0 0) 0x7f1a50079970 con 0x7f1a6006d9c0 2023-11-04T01:42:34.177 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:34.177 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:29.518541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:34.177 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 102 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 msgr2=0x7f1a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1a60156080 tx=0x7f1a54008040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 msgr2=0x7f1a60150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1a50000c00 tx=0x7f1a500046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 shutdown_connections 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1a4c06ae70 0x7f1a4c06d330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1a600ade00 0x7f1a600c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a6006d9c0 0x7f1a60150f80 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 --2- 172.21.15.93:0/2922330020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a6006c5f0 0x7f1a6014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 >> 172.21.15.93:0/2922330020 conn(0x7f1a600cb530 msgr2=0x7f1a600ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 shutdown_connections 2023-11-04T01:42:34.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.177+0000 7f1a6607c640 1 -- 172.21.15.93:0/2922330020 wait complete. 2023-11-04T01:42:34.189 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:34.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.287+0000 7fb6c13b6640 1 Processor -- start 2023-11-04T01:42:34.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.287+0000 7fb6c13b6640 1 -- start start 2023-11-04T01:42:34.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6c13b6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb6bc0ade00 0x7fb6bc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6c13b6640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6bc06d9c0 0x7fb6bc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6c13b6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc06cc90 con 0x7fb6bc06c5f0 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6c13b6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0b0e60 con 0x7fb6bc0ade00 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6c13b6640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc06cee0 con 0x7fb6bc06d9c0 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6baffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb6bc0ade00 0x7fb6bc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6bb7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb6bc06c5f0 0x7fb6bc15e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46160/0 (socket says 172.21.15.93:46160) 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6bb7fe640 1 -- 172.21.15.93:0/3233735504 learned_addr learned my addr 172.21.15.93:0/3233735504 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6baffd640 1 -- 172.21.15.93:0/3233735504 >> v2:172.21.15.125:3300/0 conn(0x7fb6bc06d9c0 msgr2=0x7fb6bc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6baffd640 1 --2- 172.21.15.93:0/3233735504 >> v2:172.21.15.125:3300/0 conn(0x7fb6bc06d9c0 0x7fb6bc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6baffd640 1 -- 172.21.15.93:0/3233735504 >> v1:172.21.15.93:6789/0 conn(0x7fb6bc06c5f0 legacy=0x7fb6bc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6baffd640 1 -- 172.21.15.93:0/3233735504 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc06d1c0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.290 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.288+0000 7fb6b9ffb640 1 -- 172.21.15.93:0/3233735504 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926183172 0 0) 0x7fb6bc06cc90 con 0x7fb6bc06c5f0 2023-11-04T01:42:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.289+0000 7fb6baffd640 1 --2- 172.21.15.93:0/3233735504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc0b0530 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0c9080 tx=0x7fb6b002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fe3aaefd874c7b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.289+0000 7fb6b9ffb640 1 -- 172.21.15.93:0/3233735504 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0031740 con 0x7fb6bc0ade00 2023-11-04T01:42:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.289+0000 7fb6b9ffb640 1 -- 172.21.15.93:0/3233735504 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b00318a0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.289+0000 7fb6b9ffb640 1 -- 172.21.15.93:0/3233735504 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0031c30 con 0x7fb6bc0ade00 2023-11-04T01:42:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 -- 172.21.15.93:0/3233735504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 msgr2=0x7fb6bc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/3233735504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc0b0530 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0c9080 tx=0x7fb6b002b7e0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 -- 172.21.15.93:0/3233735504 shutdown_connections 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/3233735504 >> v2:172.21.15.125:3300/0 conn(0x7fb6bc06d9c0 0x7fb6bc0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/3233735504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc0b0530 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 -- 172.21.15.93:0/3233735504 >> 172.21.15.93:0/3233735504 conn(0x7fb6bc0cb530 msgr2=0x7fb6bc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 -- 172.21.15.93:0/3233735504 shutdown_connections 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.290+0000 7fb6c13b6640 1 -- 172.21.15.93:0/3233735504 wait complete. 2023-11-04T01:42:34.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.291+0000 7fb6c13b6640 1 Processor -- start 2023-11-04T01:42:34.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.291+0000 7fb6c13b6640 1 -- start start 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6bc06c5f0 0x7fb6bc1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6bc06d9c0 0x7fb6bc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc15abf0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc159d40 con 0x7fb6bc06c5f0 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6c13b6640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc159fe0 con 0x7fb6bc06d9c0 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58306/0 (socket says 172.21.15.93:58306) 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 -- 172.21.15.93:0/2896086962 learned_addr learned my addr 172.21.15.93:0/2896086962 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 -- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6bc06d9c0 msgr2=0x7fb6bc157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6bc06d9c0 0x7fb6bc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 -- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6bc06c5f0 msgr2=0x7fb6bc1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6bc06c5f0 0x7fb6bc1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 -- 172.21.15.93:0/2896086962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b0009400 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.292+0000 7fb6bb7fe640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c780 tx=0x7fb6b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.293+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400ce90 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.293+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b400a640 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.293+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc15a2c0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.293+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400a9d0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.293+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc15a880 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.294+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc0684b0 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.294+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6b400ab30 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.294+0000 7fb6a37fe640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 0x7fb6a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.294+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7909+0+0 (secure 0 0 0) 0x7fb6b4089480 con 0x7fb6bc0ade00 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.294+0000 7fb6baffd640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 0x7fb6a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.295+0000 7fb6baffd640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 0x7fb6a806d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0035000 tx=0x7fb6b0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.298+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6b4053c10 con 0x7fb6bc0ade00 2023-11-04T01:42:34.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.503+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6bc15ad30 con 0x7fb6bc0ade00 2023-11-04T01:42:34.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.503+0000 7fb6a37fe640 1 -- 172.21.15.93:0/2896086962 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4945 (secure 0 0 0) 0x7fb6b4018090 con 0x7fb6bc0ade00 2023-11-04T01:42:34.504 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:34.505 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:29.518541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:34.505 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 102 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 msgr2=0x7fb6a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 0x7fb6a806d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0035000 tx=0x7fb6b0030000 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 msgr2=0x7fb6bc158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c780 tx=0x7fb6b400cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 shutdown_connections 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb6a806ae70 0x7fb6a806d330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb6bc0ade00 0x7fb6bc158410 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb6bc06d9c0 0x7fb6bc157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 --2- 172.21.15.93:0/2896086962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6bc06c5f0 0x7fb6bc1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 >> 172.21.15.93:0/2896086962 conn(0x7fb6bc0cb530 msgr2=0x7fb6bc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 shutdown_connections 2023-11-04T01:42:34.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:34.505+0000 7fb6c13b6640 1 -- 172.21.15.93:0/2896086962 wait complete. 2023-11-04T01:42:34.517 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:35.518 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:35.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.628+0000 7f18b250c640 1 Processor -- start 2023-11-04T01:42:35.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.628+0000 7f18b250c640 1 -- start start 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.628+0000 7f18b250c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18ac15d4e0 0x7f18ac0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18b250c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0b32b0 con 0x7f18ac15d100 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18b250c640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0cee10 con 0x7f18ac0d3b60 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18b250c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0cec20 con 0x7f18ac15d4e0 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18abfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f18ac15d100 0x7f18ac0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46176/0 (socket says 172.21.15.93:46176) 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18abfff640 1 -- 172.21.15.93:0/3426298782 learned_addr learned my addr 172.21.15.93:0/3426298782 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477914967 0 0) 0x7f18ac0b32b0 con 0x7f18ac15d100 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1894003520 con 0x7f18ac15d100 2023-11-04T01:42:35.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3426298782 >> v2:172.21.15.125:3300/0 conn(0x7f18ac15d4e0 0x7f18ac0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618842353 0 0) 0x7f1894003520 con 0x7f18ac15d100 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 >> v2:172.21.15.125:3300/0 conn(0x7f18ac15d4e0 msgr2=0x7f18ac0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 --2- 172.21.15.93:0/3426298782 >> v2:172.21.15.125:3300/0 conn(0x7f18ac15d4e0 0x7f18ac0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 >> v1:172.21.15.125:6789/0 conn(0x7f18ac0d3b60 legacy=0x7f18ac0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0b2980 con 0x7f18ac15d100 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f189c0017f0 con 0x7f18ac15d100 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 >> v1:172.21.15.93:6789/0 conn(0x7f18ac15d100 legacy=0x7f18ac0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 0x7f1894003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18940047c0 0x7f1894004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1894005180 0x7f189400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189400c050 con 0x7f18940039c0 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189400c1c0 con 0x7f18940047c0 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189400c380 con 0x7f1894005180 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.629+0000 7f18abfff640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 0x7f1894003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18940047c0 0x7f1894004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18b0aa9640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1894005180 0x7f189400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 -- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1894005180 msgr2=0x7f189400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1894005180 0x7f189400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 -- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18940047c0 msgr2=0x7f1894004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18940047c0 0x7f1894004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 -- 172.21.15.93:0/3426298782 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894003520 con 0x7f18940039c0 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18940047c0 0x7f1894004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18b0aa9640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1894005180 0x7f189400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18b0aa9640 1 -- 172.21.15.93:0/3426298782 reap_dead start 2023-11-04T01:42:35.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.630+0000 7f18abfff640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 0x7f1894003de0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f189c007fb0 tx=0x7f18940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401dea30577d8a3d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c007270 con 0x7f18940039c0 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c0073f0 con 0x7f18940039c0 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18aaffd640 1 -- 172.21.15.93:0/3426298782 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c02c7c0 con 0x7f18940039c0 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 -- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 msgr2=0x7f1894003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 0x7f1894003de0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f189c007fb0 tx=0x7f18940057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 -- 172.21.15.93:0/3426298782 shutdown_connections 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 --2- 172.21.15.93:0/3426298782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18940039c0 0x7f1894003de0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 -- 172.21.15.93:0/3426298782 >> 172.21.15.93:0/3426298782 conn(0x7f18ac0d2ef0 msgr2=0x7f18ac0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.637 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 -- 172.21.15.93:0/3426298782 shutdown_connections 2023-11-04T01:42:35.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.631+0000 7f18b250c640 1 -- 172.21.15.93:0/3426298782 wait complete. 2023-11-04T01:42:35.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.632+0000 7f18b250c640 1 Processor -- start 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 -- start start 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18940039c0 0x7f18ac152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 0x7f18ac0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15d940 con 0x7f18ac0b4b50 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0b5510 con 0x7f18ac0b7cd0 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b250c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0b8690 con 0x7f18940039c0 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18ab7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18ab7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58330/0 (socket says 172.21.15.93:58330) 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18ab7fe640 1 -- 172.21.15.93:0/3812814448 learned_addr learned my addr 172.21.15.93:0/3812814448 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18abfff640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18940039c0 0x7f18ac152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.633+0000 7f18b0aa9640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 0x7f18ac0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 -- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18940039c0 msgr2=0x7f18ac152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18940039c0 0x7f18ac152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 -- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 msgr2=0x7f18ac0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 0x7f18ac0b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 -- 172.21.15.93:0/3812814448 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac152790 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18b0aa9640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 0x7f18ac0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18ab7fe640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f18a0011660 tx=0x7f18a0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a000f9c0 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a000fb20 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a000fed0 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac15db50 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.634+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac15e110 con 0x7f18ac0b4b50 2023-11-04T01:42:35.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.635+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac0684b0 con 0x7f18ac0b4b50 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.635+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18a0015460 con 0x7f18ac0b4b50 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.636+0000 7f18a8ff9640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.636+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f18a008a680 con 0x7f18ac0b4b50 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.636+0000 7f18abfff640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.636+0000 7f18abfff640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 0x7f189806d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f189c034000 tx=0x7f189c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.640+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18a0054e90 con 0x7f18ac0b4b50 2023-11-04T01:42:35.841 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.840+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18ac0d2cd0 con 0x7f18ac0b4b50 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.841+0000 7f18a8ff9640 1 -- 172.21.15.93:0/3812814448 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4945 (secure 0 0 0) 0x7f18a0022090 con 0x7f18ac0b4b50 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:29.518541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 102 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.842+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 msgr2=0x7f189806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.842+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 0x7f189806d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f189c034000 tx=0x7f189c007000 comp rx=0 tx=0).stop 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.842+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 msgr2=0x7f18ac0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.842+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f18a0011660 tx=0x7f18a0011b20 comp rx=0 tx=0).stop 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.842+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 shutdown_connections 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f189806ae70 0x7f189806d330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18ac0b7cd0 0x7f18ac0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18ac0b4b50 0x7f18ac0b4fd0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 --2- 172.21.15.93:0/3812814448 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18940039c0 0x7f18ac152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 >> 172.21.15.93:0/3812814448 conn(0x7f18ac0d2ef0 msgr2=0x7f18ac0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 shutdown_connections 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:35.843+0000 7f18b250c640 1 -- 172.21.15.93:0/3812814448 wait complete. 2023-11-04T01:42:35.854 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:36.855 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.962+0000 7f6260ce0640 1 Processor -- start 2023-11-04T01:42:36.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.962+0000 7f6260ce0640 1 -- start start 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6260ce0640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 0x7f625c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6260ce0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f625c06bb60 0x7f625c070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6260ce0640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c071500 con 0x7f625c159e40 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6260ce0640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c070a70 con 0x7f625c06bb60 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6260ce0640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c15dae0 con 0x7f625c0b0c40 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f625c06bb60 0x7f625c070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f625c06bb60 0x7f625c070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58340/0 (socket says 172.21.15.93:58340) 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 -- 172.21.15.93:0/898888951 learned_addr learned my addr 172.21.15.93:0/898888951 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6259d9b640 1 --2- 172.21.15.93:0/898888951 >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 0x7f625c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 -- 172.21.15.93:0/898888951 >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 msgr2=0x7f625c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 --2- 172.21.15.93:0/898888951 >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 0x7f625c06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 -- 172.21.15.93:0/898888951 >> v1:172.21.15.125:6789/0 conn(0x7f625c159e40 legacy=0x7f625c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f625ad9d640 1 -- 172.21.15.93:0/898888951 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c070c60 con 0x7f625c06bb60 2023-11-04T01:42:36.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.963+0000 7f6259d9b640 1 --2- 172.21.15.93:0/898888951 >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 0x7f625c06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.964+0000 7f625ad9d640 1 --2- 172.21.15.93:0/898888951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c070530 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f625c06fdc0 tx=0x7f625402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483e37ec389b3eeb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.964+0000 7f625959a640 1 -- 172.21.15.93:0/898888951 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540317e0 con 0x7f625c06bb60 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.964+0000 7f625959a640 1 -- 172.21.15.93:0/898888951 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254031940 con 0x7f625c06bb60 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.964+0000 7f625959a640 1 -- 172.21.15.93:0/898888951 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254031cd0 con 0x7f625c06bb60 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 -- 172.21.15.93:0/898888951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 msgr2=0x7f625c070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 --2- 172.21.15.93:0/898888951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c070530 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f625c06fdc0 tx=0x7f625402b880 comp rx=0 tx=0).stop 2023-11-04T01:42:36.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 -- 172.21.15.93:0/898888951 shutdown_connections 2023-11-04T01:42:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 --2- 172.21.15.93:0/898888951 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c070530 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 --2- 172.21.15.93:0/898888951 >> v2:172.21.15.125:3300/0 conn(0x7f625c0b0c40 0x7f625c06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 -- 172.21.15.93:0/898888951 >> 172.21.15.93:0/898888951 conn(0x7f625c0cb530 msgr2=0x7f625c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 -- 172.21.15.93:0/898888951 shutdown_connections 2023-11-04T01:42:36.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.965+0000 7f6260ce0640 1 -- 172.21.15.93:0/898888951 wait complete. 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.966+0000 7f6260ce0640 1 Processor -- start 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.966+0000 7f6260ce0640 1 -- start start 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f625c0b0c40 0x7f625c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 0x7f625c0c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c15c740 con 0x7f625c06bb60 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1551a0 con 0x7f625c159e40 2023-11-04T01:42:36.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f6260ce0640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c154ec0 con 0x7f625c0b0c40 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58344/0 (socket says 172.21.15.93:58344) 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 -- 172.21.15.93:0/1845624600 learned_addr learned my addr 172.21.15.93:0/1845624600 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 -- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f625c0b0c40 msgr2=0x7f625c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f625c0b0c40 0x7f625c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 -- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 msgr2=0x7f625c0c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625ad9d640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 0x7f625c0c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.967+0000 7f625a59c640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 0x7f625c0c1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f625a59c640 1 -- 172.21.15.93:0/1845624600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540094d0 con 0x7f625c06bb60 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f625ad9d640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 0x7f625c0c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f625a59c640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f624c00ba50 tx=0x7f624c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00cbe0 con 0x7f625c06bb60 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00cd80 con 0x7f625c06bb60 2023-11-04T01:42:36.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c0c5d20 con 0x7f625c06bb60 2023-11-04T01:42:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c014680 con 0x7f625c06bb60 2023-11-04T01:42:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.968+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c0c62e0 con 0x7f625c06bb60 2023-11-04T01:42:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.969+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c0c64d0 con 0x7f625c06bb60 2023-11-04T01:42:36.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.969+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f624c0147e0 con 0x7f625c06bb60 2023-11-04T01:42:36.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.970+0000 7f624affd640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 0x7f623c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.970+0000 7f6259d9b640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 0x7f623c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.970+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f624c089c30 con 0x7f625c06bb60 2023-11-04T01:42:36.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.970+0000 7f6259d9b640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 0x7f623c06d360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:36.974+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f624c054580 con 0x7f625c06bb60 2023-11-04T01:42:37.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.182+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f625c06f940 con 0x7f625c06bb60 2023-11-04T01:42:37.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.183+0000 7f624affd640 1 -- 172.21.15.93:0/1845624600 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4945 (secure 0 0 0) 0x7f624c019070 con 0x7f625c06bb60 2023-11-04T01:42:37.184 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:37.185 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:29.518541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:37.185 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 102 2023-11-04T01:42:37.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 msgr2=0x7f623c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 0x7f623c06d360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250008040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 msgr2=0x7f625c1547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f624c00ba50 tx=0x7f624c00bf10 comp rx=0 tx=0).stop 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 shutdown_connections 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f623c06aea0 0x7f623c06d360 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f625c159e40 0x7f625c0c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f625c0b0c40 0x7f625c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 --2- 172.21.15.93:0/1845624600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f625c06bb60 0x7f625c1547c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 >> 172.21.15.93:0/1845624600 conn(0x7f625c0cb530 msgr2=0x7f625c0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 shutdown_connections 2023-11-04T01:42:37.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:37.185+0000 7f6260ce0640 1 -- 172.21.15.93:0/1845624600 wait complete. 2023-11-04T01:42:37.197 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:38.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:38.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.306+0000 7fd8b4a26640 1 Processor -- start 2023-11-04T01:42:38.307 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.306+0000 7fd8b4a26640 1 -- start start 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8b4a26640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8b4a26640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd8b00cf890 0x7fd8b015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8b4a26640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b015d9a0 con 0x7fd8b00b2210 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8b4a26640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00b1df0 con 0x7fd8b00cf890 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8b4a26640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00cfd20 con 0x7fd8b00ceda0 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd8b00cf890 0x7fd8b015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd8b00cf890 0x7fd8b015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58350/0 (socket says 172.21.15.93:58350) 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 -- 172.21.15.93:0/2356344575 learned_addr learned my addr 172.21.15.93:0/2356344575 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8ae59c640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.309 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 -- 172.21.15.93:0/2356344575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 msgr2=0x7fd8b015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 -- 172.21.15.93:0/2356344575 >> v1:172.21.15.125:6789/0 conn(0x7fd8b00b2210 legacy=0x7fd8b00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.307+0000 7fd8aed9d640 1 -- 172.21.15.93:0/2356344575 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00b0150 con 0x7fd8b00cf890 2023-11-04T01:42:38.310 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.308+0000 7fd8aed9d640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00cf890 0x7fd8b015d460 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009e50 tx=0x7fd8a802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffefc0ef2b0c2c65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.308+0000 7fd8add9b640 1 -- 172.21.15.93:0/2356344575 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a802c9e0 con 0x7fd8b00cf890 2023-11-04T01:42:38.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.308+0000 7fd8add9b640 1 -- 172.21.15.93:0/2356344575 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a802cb40 con 0x7fd8b00cf890 2023-11-04T01:42:38.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.308+0000 7fd8add9b640 1 -- 172.21.15.93:0/2356344575 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80343f0 con 0x7fd8b00cf890 2023-11-04T01:42:38.311 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 -- 172.21.15.93:0/2356344575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00cf890 msgr2=0x7fd8b015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00cf890 0x7fd8b015d460 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009e50 tx=0x7fd8a802be40 comp rx=0 tx=0).stop 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 -- 172.21.15.93:0/2356344575 shutdown_connections 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00cf890 0x7fd8b015d460 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/2356344575 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 -- 172.21.15.93:0/2356344575 >> 172.21.15.93:0/2356344575 conn(0x7fd8b00d0c30 msgr2=0x7fd8b00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 -- 172.21.15.93:0/2356344575 shutdown_connections 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.309+0000 7fd8b4a26640 1 -- 172.21.15.93:0/2356344575 wait complete. 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.310+0000 7fd8b4a26640 1 Processor -- start 2023-11-04T01:42:38.312 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.310+0000 7fd8b4a26640 1 -- start start 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b0159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b00cf890 0x7fd8b00ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c86b0 con 0x7fd8b00b2210 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b009e400 con 0x7fd8b00cf890 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8b4a26640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b009e6e0 con 0x7fd8b00ceda0 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58352/0 (socket says 172.21.15.93:58352) 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 -- 172.21.15.93:0/1970732264 learned_addr learned my addr 172.21.15.93:0/1970732264 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:38.315 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 -- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 msgr2=0x7fd8b0159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b0159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 -- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b00cf890 msgr2=0x7fd8b00ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8aed9d640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b00cf890 0x7fd8b00ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b00cf890 0x7fd8b00ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.311+0000 7fd8ae59c640 1 -- 172.21.15.93:0/1970732264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009b30 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8ae59c640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000d7d0 tx=0x7fd8a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00096c0 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0009820 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b00c8950 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0009bd0 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.312+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b00c8cc0 con 0x7fd8b00b2210 2023-11-04T01:42:38.316 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.313+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b00d04a0 con 0x7fd8b00b2210 2023-11-04T01:42:38.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.313+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8a0009d30 con 0x7fd8b00b2210 2023-11-04T01:42:38.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.314+0000 7fd8a77fe640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.314+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fd8a008a730 con 0x7fd8b00b2210 2023-11-04T01:42:38.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.314+0000 7fd8a5d9b640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.314+0000 7fd8a5d9b640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 0x7fd89006d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd898006fd0 tx=0x7fd898006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.319 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.318+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8a0054f20 con 0x7fd8b00b2210 2023-11-04T01:42:38.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.517+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8b00684b0 con 0x7fd8b00b2210 2023-11-04T01:42:38.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.518+0000 7fd8a77fe640 1 -- 172.21.15.93:0/1970732264 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4939 (secure 0 0 0) 0x7fd8a0058540 con 0x7fd8b00b2210 2023-11-04T01:42:38.519 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:37.102878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:38.520 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 103 2023-11-04T01:42:38.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 msgr2=0x7fd89006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 0x7fd89006d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd898006fd0 tx=0x7fd898006bc0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 msgr2=0x7fd8b01e78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000d7d0 tx=0x7fd8a000dc90 comp rx=0 tx=0).stop 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 shutdown_connections 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd8b00cf890 0x7fd8b00ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd8b00ceda0 0x7fd8b0159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 --2- 172.21.15.93:0/1970732264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd8b00b2210 0x7fd8b01e78d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 >> 172.21.15.93:0/1970732264 conn(0x7fd8b00d0c30 msgr2=0x7fd8b00cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 shutdown_connections 2023-11-04T01:42:38.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:38.520+0000 7fd8b4a26640 1 -- 172.21.15.93:0/1970732264 wait complete. 2023-11-04T01:42:38.532 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:42:39.533 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:39.640 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:39.640 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:39.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.640+0000 7f7b5c189640 1 Processor -- start 2023-11-04T01:42:39.642 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.640+0000 7f7b5c189640 1 -- start start 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5c189640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 0x7f7b540b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5c189640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7b5406d9c0 0x7f7b540710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5c189640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5406cc90 con 0x7f7b5406c5f0 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5c189640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540b0e60 con 0x7f7b5406d9c0 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5c189640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5406cee0 con 0x7f7b540ade00 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b59724640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7b5406d9c0 0x7f7b540710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5a726640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7b5406c5f0 0x7f7b5415e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46180/0 (socket says 172.21.15.93:46180) 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.641+0000 7f7b5a726640 1 -- 172.21.15.93:0/2967226816 learned_addr learned my addr 172.21.15.93:0/2967226816 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59f25640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 0x7f7b540b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59724640 1 -- 172.21.15.93:0/2967226816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 msgr2=0x7f7b540b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59724640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 0x7f7b540b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59724640 1 -- 172.21.15.93:0/2967226816 >> v1:172.21.15.93:6789/0 conn(0x7f7b5406c5f0 legacy=0x7f7b5415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59724640 1 -- 172.21.15.93:0/2967226816 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5406d1c0 con 0x7f7b5406d9c0 2023-11-04T01:42:39.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59f25640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 0x7f7b540b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b59724640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540710d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f7b440097a0 tx=0x7f7b4402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fe33774fd31a62 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.642+0000 7f7b58f23640 1 -- 172.21.15.93:0/2967226816 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4402f050 con 0x7f7b5406d9c0 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b58f23640 1 -- 172.21.15.93:0/2967226816 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44031700 con 0x7f7b5406d9c0 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b58f23640 1 -- 172.21.15.93:0/2967226816 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44031a90 con 0x7f7b5406d9c0 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 -- 172.21.15.93:0/2967226816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 msgr2=0x7f7b540710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540710d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f7b440097a0 tx=0x7f7b4402b7a0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 -- 172.21.15.93:0/2967226816 shutdown_connections 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540710d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 --2- 172.21.15.93:0/2967226816 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b540ade00 0x7f7b540b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 -- 172.21.15.93:0/2967226816 >> 172.21.15.93:0/2967226816 conn(0x7f7b540cb530 msgr2=0x7f7b540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 -- 172.21.15.93:0/2967226816 shutdown_connections 2023-11-04T01:42:39.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.643+0000 7f7b5c189640 1 -- 172.21.15.93:0/2967226816 wait complete. 2023-11-04T01:42:39.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.644+0000 7f7b5c189640 1 Processor -- start 2023-11-04T01:42:39.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.644+0000 7f7b5c189640 1 -- start start 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5406c5f0 0x7f7b541e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 0x7f7b540c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541e4ad0 con 0x7f7b5406d9c0 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541e3e50 con 0x7f7b540ade00 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5c189640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541e4130 con 0x7f7b5406c5f0 2023-11-04T01:42:39.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58382/0 (socket says 172.21.15.93:58382) 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 -- 172.21.15.93:0/4284965909 learned_addr learned my addr 172.21.15.93:0/4284965909 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 -- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5406c5f0 msgr2=0x7f7b541e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5a726640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 0x7f7b540c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59f25640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5406c5f0 0x7f7b541e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5406c5f0 0x7f7b541e3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 -- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 msgr2=0x7f7b540c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 0x7f7b540c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b59724640 1 -- 172.21.15.93:0/4284965909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009400 con 0x7f7b5406d9c0 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.645+0000 7f7b5a726640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 0x7f7b540c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b59724640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7b44036040 tx=0x7f7b440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44033a30 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44033bb0 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b541e4410 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4403c400 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.646+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b541e3b40 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.647+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b541e4c10 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.647+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b4403a040 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.648+0000 7f7b4a7fc640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.648+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f7b440ab2a0 con 0x7f7b5406d9c0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.648+0000 7f7b59f25640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.648+0000 7f7b59f25640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 0x7f7b3806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7b541f3f20 tx=0x7f7b50008450 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.652+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b541e4c10 con 0x7f7b5406d9c0 2023-11-04T01:42:39.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.852+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b541e4c10 con 0x7f7b5406d9c0 2023-11-04T01:42:39.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.852+0000 7f7b4a7fc640 1 -- 172.21.15.93:0/4284965909 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4939 (secure 0 0 0) 0x7f7b541e4c10 con 0x7f7b5406d9c0 2023-11-04T01:42:39.854 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:39.854 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:38.106253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:39.854 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 104 2023-11-04T01:42:39.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 msgr2=0x7f7b3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.855 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 0x7f7b3806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7b541f3f20 tx=0x7f7b50008450 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 msgr2=0x7f7b540c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7b44036040 tx=0x7f7b440046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 shutdown_connections 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b540ade00 0x7f7b540c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b5406d9c0 0x7f7b540c45d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 --2- 172.21.15.93:0/4284965909 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b5406c5f0 0x7f7b541e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 >> 172.21.15.93:0/4284965909 conn(0x7f7b540cb530 msgr2=0x7f7b540c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 shutdown_connections 2023-11-04T01:42:39.856 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.854+0000 7f7b5c189640 1 -- 172.21.15.93:0/4284965909 wait complete. 2023-11-04T01:42:39.866 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:42:39.866 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.676416397094727s 2023-11-04T01:42:39.866 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:39.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.964+0000 7fecbf1fc640 1 Processor -- start 2023-11-04T01:42:39.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.964+0000 7fecbf1fc640 1 -- start start 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbf1fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb815d4e0 0x7fecb80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbf1fc640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fecb80d3b60 0x7fecb80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbf1fc640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80b32b0 con 0x7fecb815d100 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbf1fc640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80cec20 con 0x7fecb80d3b60 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbf1fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80cee10 con 0x7fecb815d4e0 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbd799640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fecb80d3b60 0x7fecb80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbcf98640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fecb815d100 0x7fecb80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46182/0 (socket says 172.21.15.93:46182) 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.965+0000 7fecbcf98640 1 -- 172.21.15.93:0/2872000989 learned_addr learned my addr 172.21.15.93:0/2872000989 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecaffff640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb815d4e0 0x7fecb80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecbd799640 1 -- 172.21.15.93:0/2872000989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb815d4e0 msgr2=0x7fecb80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecbd799640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb815d4e0 0x7fecb80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecbd799640 1 -- 172.21.15.93:0/2872000989 >> v1:172.21.15.93:6789/0 conn(0x7fecb815d100 legacy=0x7fecb80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecbd799640 1 -- 172.21.15.93:0/2872000989 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80b4750 con 0x7fecb80d3b60 2023-11-04T01:42:39.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecaf7fe640 1 -- 172.21.15.93:0/2872000989 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267524490 0 0) 0x7fecb80b32b0 con 0x7fecb815d100 2023-11-04T01:42:39.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.966+0000 7fecbd799640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb80d3b60 0x7fecb80d1a10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ee411d103472a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecaf7fe640 1 -- 172.21.15.93:0/2872000989 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb002cc50 con 0x7fecb80d3b60 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecaf7fe640 1 -- 172.21.15.93:0/2872000989 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb002cdb0 con 0x7fecb80d3b60 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecaf7fe640 1 -- 172.21.15.93:0/2872000989 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0034660 con 0x7fecb80d3b60 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 -- 172.21.15.93:0/2872000989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb80d3b60 msgr2=0x7fecb80d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb80d3b60 0x7fecb80d1a10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb002bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 -- 172.21.15.93:0/2872000989 shutdown_connections 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb80d3b60 0x7fecb80d1a10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/2872000989 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb815d4e0 0x7fecb80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 -- 172.21.15.93:0/2872000989 >> 172.21.15.93:0/2872000989 conn(0x7fecb80d2ef0 msgr2=0x7fecb80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 -- 172.21.15.93:0/2872000989 shutdown_connections 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.967+0000 7fecbf1fc640 1 -- 172.21.15.93:0/2872000989 wait complete. 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.968+0000 7fecbf1fc640 1 Processor -- start 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.968+0000 7fecbf1fc640 1 -- start start 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb80d3b60 0x7fecb81f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb815d100 0x7fecb8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8156190 con 0x7fecb815d4e0 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb815eed0 con 0x7fecb815d100 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbf1fc640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8152c30 con 0x7fecb80d3b60 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbd799640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbd799640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58394/0 (socket says 172.21.15.93:58394) 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbd799640 1 -- 172.21.15.93:0/223697246 learned_addr learned my addr 172.21.15.93:0/223697246 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbcf98640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb80d3b60 0x7fecb81f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbd799640 1 -- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb80d3b60 msgr2=0x7fecb81f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecaffff640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb815d100 0x7fecb8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.969+0000 7fecbd799640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb80d3b60 0x7fecb81f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbd799640 1 -- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb815d100 msgr2=0x7fecb8155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbd799640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb815d100 0x7fecb8155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbd799640 1 -- 172.21.15.93:0/223697246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0009a70 con 0x7fecb815d4e0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbd799640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0040650 con 0x7fecb815d4e0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb00407d0 con 0x7fecb815d4e0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb81f0660 con 0x7fecb815d4e0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0040b80 con 0x7fecb815d4e0 2023-11-04T01:42:39.974 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.970+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb8155eb0 con 0x7fecb815d4e0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.971+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb80684b0 con 0x7fecb815d4e0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.971+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecb0040ce0 con 0x7fecb815d4e0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.972+0000 7fecad7fa640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 0x7feca406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.972+0000 7fecbcf98640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 0x7feca406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.972+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fecb00acc60 con 0x7fecb815d4e0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.972+0000 7fecbcf98640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 0x7feca406d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fecb40010e0 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.977 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:39.976+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fecb0077600 con 0x7fecb815d4e0 2023-11-04T01:42:40.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.178+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecb80d2cd0 con 0x7fecb815d4e0 2023-11-04T01:42:40.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.178+0000 7fecad7fa640 1 -- 172.21.15.93:0/223697246 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4939 (secure 0 0 0) 0x7fecb0044090 con 0x7fecb815d4e0 2023-11-04T01:42:40.179 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:40.180 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:38.106253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:40.180 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 104 2023-11-04T01:42:40.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 msgr2=0x7feca406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 0x7feca406d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fecb40010e0 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 msgr2=0x7fecb8155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb0004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 shutdown_connections 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feca406ae70 0x7feca406d330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb815d4e0 0x7fecb8155590 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecb815d100 0x7fecb8155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 --2- 172.21.15.93:0/223697246 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fecb80d3b60 0x7fecb81f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 >> 172.21.15.93:0/223697246 conn(0x7fecb80d2ef0 msgr2=0x7fecb80b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 shutdown_connections 2023-11-04T01:42:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.180+0000 7fecbf1fc640 1 -- 172.21.15.93:0/223697246 wait complete. 2023-11-04T01:42:40.192 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:42:40.314 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:40.315 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" } ] } 2023-11-04T01:42:40.315 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:42:40.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:40.414 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.413+0000 7f2ef5b16640 1 Processor -- start 2023-11-04T01:42:40.415 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.413+0000 7f2ef5b16640 1 -- start start 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2ef5b16640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2ef0070700 0x7f2ef0164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2ef5b16640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef0071500 con 0x7f2ef0159e40 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2ef5b16640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef015dae0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2ef5b16640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef0070c60 con 0x7f2ef0070700 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eeffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2ef0070700 0x7f2ef0164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.416 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eef7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2ef0159e40 0x7f2ef00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46190/0 (socket says 172.21.15.93:46190) 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eef7fe640 1 -- 172.21.15.93:0/2726369249 learned_addr learned my addr 172.21.15.93:0/2726369249 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eeffff640 1 -- 172.21.15.93:0/2726369249 >> v1:172.21.15.125:6789/0 conn(0x7f2ef00b0c40 legacy=0x7f2ef006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eeffff640 1 -- 172.21.15.93:0/2726369249 >> v1:172.21.15.93:6789/0 conn(0x7f2ef0159e40 legacy=0x7f2ef00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eeffff640 1 -- 172.21.15.93:0/2726369249 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0070f40 con 0x7f2ef0070700 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.414+0000 7f2eee7fc640 1 -- 172.21.15.93:0/2726369249 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605709682 0 0) 0x7f2ef0071500 con 0x7f2ef0159e40 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.415+0000 7f2eeffff640 1 --2- 172.21.15.93:0/2726369249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef0070700 0x7f2ef0164b60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dca952ba71ea57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.415+0000 7f2eee7fc640 1 -- 172.21.15.93:0/2726369249 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee802cbd0 con 0x7f2ef0070700 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.415+0000 7f2eee7fc640 1 -- 172.21.15.93:0/2726369249 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee802cd30 con 0x7f2ef0070700 2023-11-04T01:42:40.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.415+0000 7f2eee7fc640 1 -- 172.21.15.93:0/2726369249 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee802cea0 con 0x7f2ef0070700 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 -- 172.21.15.93:0/2726369249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef0070700 msgr2=0x7f2ef0164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/2726369249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef0070700 0x7f2ef0164b60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009d90 tx=0x7f2ee802be20 comp rx=0 tx=0).stop 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 -- 172.21.15.93:0/2726369249 shutdown_connections 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/2726369249 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef0070700 0x7f2ef0164b60 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 -- 172.21.15.93:0/2726369249 >> 172.21.15.93:0/2726369249 conn(0x7f2ef00cb530 msgr2=0x7f2ef00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 -- 172.21.15.93:0/2726369249 shutdown_connections 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.416+0000 7f2ef5b16640 1 -- 172.21.15.93:0/2726369249 wait complete. 2023-11-04T01:42:40.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.417+0000 7f2ef5b16640 1 Processor -- start 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.417+0000 7f2ef5b16640 1 -- start start 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 0x7f2ef00afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 0x7f2ef00ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c7d50 con 0x7f2ef00b0c40 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c8030 con 0x7f2ef0070700 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c8310 con 0x7f2ef0159e40 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58418/0 (socket says 172.21.15.93:58418) 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 -- 172.21.15.93:0/504231873 learned_addr learned my addr 172.21.15.93:0/504231873 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eef7fe640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 0x7f2ef00afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeffff640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 0x7f2ef00ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.421 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 -- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 msgr2=0x7f2ef00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 0x7f2ef00ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 -- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 msgr2=0x7f2ef00afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 0x7f2ef00afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 -- 172.21.15.93:0/504231873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009a70 con 0x7f2ef00b0c40 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eef7fe640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 0x7f2ef00afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeffff640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 0x7f2ef00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2eeeffd640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800c430 tx=0x7f2ed800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011790 con 0x7f2ef00b0c40 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80118f0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011ce0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef00c85f0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.422 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.418+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef00cf620 con 0x7f2ef00b0c40 2023-11-04T01:42:40.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.419+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef00684b0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.420+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ed801c460 con 0x7f2ef00b0c40 2023-11-04T01:42:40.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.420+0000 7f2ee7fff640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.423 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.420+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f2ed8089de0 con 0x7f2ef00b0c40 2023-11-04T01:42:40.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.420+0000 7f2eef7fe640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.424 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.421+0000 7f2eef7fe640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 0x7f2ed006d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000f60 tx=0x7f2ee0007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.425 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.424+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ed8054660 con 0x7f2ef00b0c40 2023-11-04T01:42:40.628 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.627+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef00c9e80 con 0x7f2ef00b0c40 2023-11-04T01:42:40.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.628+0000 7f2ee7fff640 1 -- 172.21.15.93:0/504231873 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4939 (secure 0 0 0) 0x7f2ed8057c80 con 0x7f2ef00b0c40 2023-11-04T01:42:40.629 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:40.629 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:38.106253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:40.630 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 104 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 msgr2=0x7f2ed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 0x7f2ed006d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000f60 tx=0x7f2ee0007ca0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 msgr2=0x7f2ef00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800c430 tx=0x7f2ed800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 shutdown_connections 2023-11-04T01:42:40.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2ed006ae70 0x7f2ed006d330 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2ef0159e40 0x7f2ef00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef00b0c40 0x7f2ef00cc660 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 --2- 172.21.15.93:0/504231873 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ef0070700 0x7f2ef00afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 >> 172.21.15.93:0/504231873 conn(0x7f2ef00cb530 msgr2=0x7f2ef006fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 shutdown_connections 2023-11-04T01:42:40.632 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.630+0000 7f2ef5b16640 1 -- 172.21.15.93:0/504231873 wait complete. 2023-11-04T01:42:40.642 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:42:40.759 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:40.760 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" } ] } 2023-11-04T01:42:40.760 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:40.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:40.760 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:42:40.787 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:42:40.788 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:40.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:40.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.981+0000 7f3da7f0f640 1 Processor -- start 2023-11-04T01:42:40.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.981+0000 7f3da7f0f640 1 -- start start 2023-11-04T01:42:40.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da7f0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da0159e40 0x7f3da00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da7f0f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3da006bb60 0x7f3da00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da7f0f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da0071500 con 0x7f3da006fff0 2023-11-04T01:42:40.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da7f0f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da015dae0 con 0x7f3da006bb60 2023-11-04T01:42:40.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da7f0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0070c60 con 0x7f3da0159e40 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da54aa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3da006bb60 0x7f3da00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da5cab640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da0159e40 0x7f3da00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da54aa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3da006bb60 0x7f3da00b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:56440/0 (socket says 172.21.15.93:56440) 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da54aa640 1 -- 172.21.15.93:0/2059705154 learned_addr learned my addr 172.21.15.93:0/2059705154 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.982+0000 7f3da64ac640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3da006fff0 0x7f3da0070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:34436/0 (socket says 172.21.15.93:34436) 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.983+0000 7f3da54aa640 1 -- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da0159e40 msgr2=0x7f3da00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.983+0000 7f3da54aa640 1 --2- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da0159e40 0x7f3da00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.983+0000 7f3da54aa640 1 -- 172.21.15.93:0/2059705154 >> v1:172.21.15.125:6789/0 conn(0x7f3da006fff0 legacy=0x7f3da0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.983+0000 7f3da54aa640 1 -- 172.21.15.93:0/2059705154 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0070f40 con 0x7f3da006bb60 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.983+0000 7f3da54aa640 1 --2- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da006bb60 0x7f3da00b0a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009870 tx=0x7f3d9002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7895cad1824be95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da4ca9640 1 -- 172.21.15.93:0/2059705154 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90031640 con 0x7f3da006bb60 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da4ca9640 1 -- 172.21.15.93:0/2059705154 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d900317a0 con 0x7f3da006bb60 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da4ca9640 1 -- 172.21.15.93:0/2059705154 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90031b30 con 0x7f3da006bb60 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da006bb60 msgr2=0x7f3da00b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da006bb60 0x7f3da00b0a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009870 tx=0x7f3d9002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2059705154 shutdown_connections 2023-11-04T01:42:40.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da006bb60 0x7f3da00b0a70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2059705154 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da0159e40 0x7f3da00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2059705154 >> 172.21.15.93:0/2059705154 conn(0x7f3da00cb530 msgr2=0x7f3da00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2059705154 shutdown_connections 2023-11-04T01:42:40.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.984+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2059705154 wait complete. 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.985+0000 7f3da7f0f640 1 Processor -- start 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.985+0000 7f3da7f0f640 1 -- start start 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da006fff0 0x7f3da01efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da0159e40 0x7f3da00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da014a5c0 con 0x7f3da006bb60 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01499d0 con 0x7f3da0159e40 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da7f0f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0149c20 con 0x7f3da006fff0 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da5cab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da5cab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58426/0 (socket says 172.21.15.93:58426) 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da5cab640 1 -- 172.21.15.93:0/2680327103 learned_addr learned my addr 172.21.15.93:0/2680327103 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:40.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da54aa640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da006fff0 0x7f3da01efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.986+0000 7f3da64ac640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da0159e40 0x7f3da00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 -- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da006fff0 msgr2=0x7f3da01efdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da006fff0 0x7f3da01efdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 -- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da0159e40 msgr2=0x7f3da00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da0159e40 0x7f3da00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 -- 172.21.15.93:0/2680327103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900094d0 con 0x7f3da006bb60 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da5cab640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00e8a0 tx=0x7f3d9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0094f0 con 0x7f3da006bb60 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00c940 con 0x7f3da006bb60 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0149f00 con 0x7f3da006bb60 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00ccf0 con 0x7f3da006bb60 2023-11-04T01:42:40.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.987+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00ace10 con 0x7f3da006bb60 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.988+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00684b0 con 0x7f3da006bb60 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.989+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d9c013470 con 0x7f3da006bb60 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.989+0000 7f3d967fc640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 0x7f3d8406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.989+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f3d9c08a2a0 con 0x7f3da006bb60 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.989+0000 7f3da54aa640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 0x7f3d8406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.989+0000 7f3da54aa640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 0x7f3d8406d360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3d90036000 tx=0x7f3d9003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:40.993+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d9c054ac0 con 0x7f3da006bb60 2023-11-04T01:42:41.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.161+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3da00711f0 con 0x7f3da006bb60 2023-11-04T01:42:41.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.162+0000 7f3d967fc640 1 -- 172.21.15.93:0/2680327103 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+23303 (secure 0 0 0) 0x7f3d9c0580e0 con 0x7f3da006bb60 2023-11-04T01:42:41.164 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:41.164 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":113,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:42:37.091959+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.6","mappings":[{"from":0,"to":5}]},{"pgid":"17.9","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6836/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6834/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.125:6832/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.93:6834/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.125:6833/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6834/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6832/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6834/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6835/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6836/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.93:6836/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3505063928":"2023-11-04T02:42:36.804546+0000","172.21.15.125:6832/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.125:6834/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.93:6834/3572539978":"2023-11-05T01:41:36.780916+0000","172.21.15.93:6834/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3671080369":"2023-11-04T02:41:51.893134+0000","172.21.15.93:6836/3572539978":"2023-11-05T01:41:36.780916+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:41.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 msgr2=0x7f3d8406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 0x7f3d8406d360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3d90036000 tx=0x7f3d9003c040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 msgr2=0x7f3da00c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00e8a0 tx=0x7f3d9c00ed60 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 shutdown_connections 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3d8406aea0 0x7f3d8406d360 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3da0159e40 0x7f3da00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3da006fff0 0x7f3da01efdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 --2- 172.21.15.93:0/2680327103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3da006bb60 0x7f3da00c39e0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 >> 172.21.15.93:0/2680327103 conn(0x7f3da00cb530 msgr2=0x7f3da00adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 shutdown_connections 2023-11-04T01:42:41.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.164+0000 7f3da7f0f640 1 -- 172.21.15.93:0/2680327103 wait complete. 2023-11-04T01:42:41.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:10.941170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:11.841942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:41.177 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:41.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.276+0000 7feba084b640 1 Processor -- start 2023-11-04T01:42:41.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.276+0000 7feba084b640 1 -- start start 2023-11-04T01:42:41.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feba084b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feb9c06d9c0 0x7feb9c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feba084b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feba084b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c06cc90 con 0x7feb9c0ade00 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feba084b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0b0c40 con 0x7feb9c06d9c0 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feba084b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c071b50 con 0x7feb9c06c5f0 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feb99d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feb9c06d9c0 0x7feb9c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feb9a59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7feb9c0ade00 0x7feb9c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:46202/0 (socket says 172.21.15.93:46202) 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.277+0000 7feb9a59c640 1 -- 172.21.15.93:0/1277130942 learned_addr learned my addr 172.21.15.93:0/1277130942 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb9ad9d640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb99d9b640 1 -- 172.21.15.93:0/1277130942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 msgr2=0x7feb9c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb99d9b640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb9959a640 1 -- 172.21.15.93:0/1277130942 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898245623 0 0) 0x7feb9c06cc90 con 0x7feb9c0ade00 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb99d9b640 1 -- 172.21.15.93:0/1277130942 >> v1:172.21.15.93:6789/0 conn(0x7feb9c0ade00 legacy=0x7feb9c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb99d9b640 1 -- 172.21.15.93:0/1277130942 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0b0e60 con 0x7feb9c06d9c0 2023-11-04T01:42:41.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.278+0000 7feb99d9b640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0710d0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7feb900097a0 tx=0x7feb9002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e251eb195abc41 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feb9959a640 1 -- 172.21.15.93:0/1277130942 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9002f050 con 0x7feb9c06d9c0 2023-11-04T01:42:41.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feb9959a640 1 -- 172.21.15.93:0/1277130942 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90031700 con 0x7feb9c06d9c0 2023-11-04T01:42:41.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feb9959a640 1 -- 172.21.15.93:0/1277130942 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90031a90 con 0x7feb9c06d9c0 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 -- 172.21.15.93:0/1277130942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 msgr2=0x7feb9c0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0710d0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7feb900097a0 tx=0x7feb9002b7a0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 -- 172.21.15.93:0/1277130942 shutdown_connections 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 --2- 172.21.15.93:0/1277130942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0710d0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 -- 172.21.15.93:0/1277130942 >> 172.21.15.93:0/1277130942 conn(0x7feb9c0cb530 msgr2=0x7feb9c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 -- 172.21.15.93:0/1277130942 shutdown_connections 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.279+0000 7feba084b640 1 -- 172.21.15.93:0/1277130942 wait complete. 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.280+0000 7feba084b640 1 Processor -- start 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 -- start start 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb9c0ade00 0x7feb9c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c3610 con 0x7feb9c06d9c0 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c8660 con 0x7feb9c0ade00 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feba084b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c8940 con 0x7feb9c06c5f0 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feb99d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feb99d9b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:58438/0 (socket says 172.21.15.93:58438) 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feb99d9b640 1 -- 172.21.15.93:0/977682616 learned_addr learned my addr 172.21.15.93:0/977682616 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feb9ad9d640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb9c0ade00 0x7feb9c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.281+0000 7feb9a59c640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 -- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 msgr2=0x7feb9c0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c0c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 -- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb9c0ade00 msgr2=0x7feb9c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb9c0ade00 0x7feb9c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 -- 172.21.15.93:0/977682616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009400 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb99d9b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90004230 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90004390 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0c38d0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90033bd0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.282+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0c4610 con 0x7feb9c06d9c0 2023-11-04T01:42:41.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.283+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c0c3df0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.283+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb90033d30 con 0x7feb9c06d9c0 2023-11-04T01:42:41.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.284+0000 7feb8affd640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 0x7feb7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.284+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7feb900abe50 con 0x7feb9c06d9c0 2023-11-04T01:42:41.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.284+0000 7feb9a59c640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 0x7feb7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.284+0000 7feb9a59c640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 0x7feb7c06d360 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0012e0 tx=0x7feb8c001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.288+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb9c0c3df0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.453+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb9c0c3df0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.454+0000 7feb8affd640 1 -- 172.21.15.93:0/977682616 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb9c0c3df0 con 0x7feb9c06d9c0 2023-11-04T01:42:41.455 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:42:41.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 msgr2=0x7feb7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 0x7feb7c06d360 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0012e0 tx=0x7feb8c001630 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 msgr2=0x7feb9c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7feb90000c00 tx=0x7feb900046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 shutdown_connections 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7feb7c06aea0 0x7feb7c06d360 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb9c0ade00 0x7feb9c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb9c06d9c0 0x7feb9c0c5bf0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 --2- 172.21.15.93:0/977682616 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7feb9c06c5f0 0x7feb9c0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 >> 172.21.15.93:0/977682616 conn(0x7feb9c0cb530 msgr2=0x7feb9c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 shutdown_connections 2023-11-04T01:42:41.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.456+0000 7feba084b640 1 -- 172.21.15.93:0/977682616 wait complete. 2023-11-04T01:42:41.467 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:41.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.570+0000 7f7b29d6c640 1 Processor -- start 2023-11-04T01:42:41.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.570+0000 7f7b29d6c640 1 -- start start 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b29d6c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7b2415d100 0x7f7b240ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b29d6c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7b2415d4e0 0x7f7b240d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b29d6c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240b32b0 con 0x7f7b240d3b60 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b29d6c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240cee10 con 0x7f7b2415d4e0 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b29d6c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240b4750 con 0x7f7b2415d100 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b22ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7b2415d4e0 0x7f7b240d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b23fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7b240d3b60 0x7f7b240cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40680/0 (socket says 172.21.15.93:40680) 2023-11-04T01:42:41.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b23fff640 1 -- 172.21.15.93:0/1586870994 learned_addr learned my addr 172.21.15.93:0/1586870994 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.571+0000 7f7b237fe640 1 --2- 172.21.15.93:0/1586870994 >> v2:172.21.15.125:3300/0 conn(0x7f7b2415d100 0x7f7b240ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b22ffd640 1 -- 172.21.15.93:0/1586870994 >> v2:172.21.15.125:3300/0 conn(0x7f7b2415d100 msgr2=0x7f7b240ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b22ffd640 1 --2- 172.21.15.93:0/1586870994 >> v2:172.21.15.125:3300/0 conn(0x7f7b2415d100 0x7f7b240ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b22ffd640 1 -- 172.21.15.93:0/1586870994 >> v1:172.21.15.93:6789/0 conn(0x7f7b240d3b60 legacy=0x7f7b240cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b227fc640 1 -- 172.21.15.93:0/1586870994 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365917028 0 0) 0x7f7b240b32b0 con 0x7f7b240d3b60 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b22ffd640 1 -- 172.21.15.93:0/1586870994 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240b2980 con 0x7f7b2415d4e0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b22ffd640 1 --2- 172.21.15.93:0/1586870994 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b2415d4e0 0x7f7b240d14d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7b240d09f0 tx=0x7f7b1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ea6cd169ae204 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b227fc640 1 -- 172.21.15.93:0/1586870994 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18031830 con 0x7f7b2415d4e0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b227fc640 1 -- 172.21.15.93:0/1586870994 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18031990 con 0x7f7b2415d4e0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.572+0000 7f7b227fc640 1 -- 172.21.15.93:0/1586870994 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18031d20 con 0x7f7b2415d4e0 2023-11-04T01:42:41.580 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 -- 172.21.15.93:0/1586870994 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b2415d4e0 msgr2=0x7f7b240d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/1586870994 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b2415d4e0 0x7f7b240d14d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7b240d09f0 tx=0x7f7b1802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 -- 172.21.15.93:0/1586870994 shutdown_connections 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/1586870994 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b2415d4e0 0x7f7b240d14d0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/1586870994 >> v2:172.21.15.125:3300/0 conn(0x7f7b2415d100 0x7f7b240ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 -- 172.21.15.93:0/1586870994 >> 172.21.15.93:0/1586870994 conn(0x7f7b240d2ef0 msgr2=0x7f7b240d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 -- 172.21.15.93:0/1586870994 shutdown_connections 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.573+0000 7f7b29d6c640 1 -- 172.21.15.93:0/1586870994 wait complete. 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.574+0000 7f7b29d6c640 1 Processor -- start 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.574+0000 7f7b29d6c640 1 -- start start 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b2415d100 0x7f7b240cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 0x7f7b240b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241519b0 con 0x7f7b240d3b60 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cce10 con 0x7f7b2415d100 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b29d6c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cb5a0 con 0x7f7b2415d4e0 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b237fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b237fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55388/0 (socket says 172.21.15.93:55388) 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b237fe640 1 -- 172.21.15.93:0/268109316 learned_addr learned my addr 172.21.15.93:0/268109316 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b22ffd640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b2415d100 0x7f7b240cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b23fff640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 0x7f7b240b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b237fe640 1 -- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 msgr2=0x7f7b240b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.575+0000 7f7b237fe640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 0x7f7b240b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b237fe640 1 -- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b2415d100 msgr2=0x7f7b240cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b237fe640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b2415d100 0x7f7b240cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b237fe640 1 -- 172.21.15.93:0/268109316 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009400 con 0x7f7b240d3b60 2023-11-04T01:42:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b23fff640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 0x7f7b240b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b237fe640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e870 tx=0x7f7b1400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140095c0 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400c8e0 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240c9fc0 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400cc50 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.576+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b240ca580 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.577+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b240684b0 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.577+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b14013470 con 0x7f7b240d3b60 2023-11-04T01:42:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.578+0000 7f7b0bfff640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 0x7f7b1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.578+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f7b1408a570 con 0x7f7b240d3b60 2023-11-04T01:42:41.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.578+0000 7f7b22ffd640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 0x7f7b1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.578+0000 7f7b22ffd640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 0x7f7b1006d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7b18036000 tx=0x7f7b1803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.585 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.582+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b14054c50 con 0x7f7b240d3b60 2023-11-04T01:42:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.747+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f7b240d2cd0 con 0x7f7b240d3b60 2023-11-04T01:42:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.748+0000 7f7b0bfff640 1 -- 172.21.15.93:0/268109316 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v113) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b14017020 con 0x7f7b240d3b60 2023-11-04T01:42:41.749 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 msgr2=0x7f7b1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 0x7f7b1006d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7b18036000 tx=0x7f7b1803c040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 msgr2=0x7f7b24151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e870 tx=0x7f7b1400ed30 comp rx=0 tx=0).stop 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 shutdown_connections 2023-11-04T01:42:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7b1006ae70 0x7f7b1006d330 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7b2415d4e0 0x7f7b240b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b2415d100 0x7f7b240cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 --2- 172.21.15.93:0/268109316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b240d3b60 0x7f7b24151470 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 >> 172.21.15.93:0/268109316 conn(0x7f7b240d2ef0 msgr2=0x7f7b240d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 shutdown_connections 2023-11-04T01:42:41.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.750+0000 7f7b29d6c640 1 -- 172.21.15.93:0/268109316 wait complete. 2023-11-04T01:42:41.762 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:41.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.863+0000 7f5fe742d640 1 Processor -- start 2023-11-04T01:42:41.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.863+0000 7f5fe742d640 1 -- start start 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe742d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe00b0c40 0x7f5fe006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe742d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5fe006bb60 0x7f5fe0070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe742d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe0071500 con 0x7f5fe0159e40 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe742d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe0070a70 con 0x7f5fe006bb60 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe742d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015dae0 con 0x7f5fe00b0c40 2023-11-04T01:42:41.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe59ca640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5fe006bb60 0x7f5fe0070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe51c9640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5fe0159e40 0x7f5fe00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40688/0 (socket says 172.21.15.93:40688) 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe51c9640 1 -- 172.21.15.93:0/41266157 learned_addr learned my addr 172.21.15.93:0/41266157 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe49c8640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe00b0c40 0x7f5fe006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe59ca640 1 -- 172.21.15.93:0/41266157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe00b0c40 msgr2=0x7f5fe006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe59ca640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe00b0c40 0x7f5fe006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe59ca640 1 -- 172.21.15.93:0/41266157 >> v1:172.21.15.93:6789/0 conn(0x7f5fe0159e40 legacy=0x7f5fe00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fd7fff640 1 -- 172.21.15.93:0/41266157 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407459193 0 0) 0x7f5fe0071500 con 0x7f5fe0159e40 2023-11-04T01:42:41.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.864+0000 7f5fe59ca640 1 -- 172.21.15.93:0/41266157 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0070c60 con 0x7f5fe006bb60 2023-11-04T01:42:41.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.865+0000 7f5fe59ca640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe006bb60 0x7f5fe0070530 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b903afb0ddfb2722 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.867 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.865+0000 7f5fd7fff640 1 -- 172.21.15.93:0/41266157 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd802cbc0 con 0x7f5fe006bb60 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.865+0000 7f5fd7fff640 1 -- 172.21.15.93:0/41266157 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd802cd20 con 0x7f5fe006bb60 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.865+0000 7f5fd7fff640 1 -- 172.21.15.93:0/41266157 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8034660 con 0x7f5fe006bb60 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 -- 172.21.15.93:0/41266157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe006bb60 msgr2=0x7f5fe0070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe006bb60 0x7f5fe0070530 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802be10 comp rx=0 tx=0).stop 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 -- 172.21.15.93:0/41266157 shutdown_connections 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe006bb60 0x7f5fe0070530 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 --2- 172.21.15.93:0/41266157 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe00b0c40 0x7f5fe006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 -- 172.21.15.93:0/41266157 >> 172.21.15.93:0/41266157 conn(0x7f5fe00cb530 msgr2=0x7f5fe00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 -- 172.21.15.93:0/41266157 shutdown_connections 2023-11-04T01:42:41.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.866+0000 7f5fe742d640 1 -- 172.21.15.93:0/41266157 wait complete. 2023-11-04T01:42:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.867+0000 7f5fe742d640 1 Processor -- start 2023-11-04T01:42:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.867+0000 7f5fe742d640 1 -- start start 2023-11-04T01:42:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.867+0000 7f5fe742d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 0x7f5fe00c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 0x7f5fe01553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0156510 con 0x7f5fe0159e40 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c4150 con 0x7f5fe00b0c40 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c43f0 con 0x7f5fe006bb60 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55398/0 (socket says 172.21.15.93:55398) 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 -- 172.21.15.93:0/70580580 learned_addr learned my addr 172.21.15.93:0/70580580 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe51c9640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 0x7f5fe00c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe49c8640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 0x7f5fe01553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 -- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 msgr2=0x7f5fe00c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 0x7f5fe00c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 -- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 msgr2=0x7f5fe01553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 0x7f5fe01553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 -- 172.21.15.93:0/70580580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009a70 con 0x7f5fe0159e40 2023-11-04T01:42:41.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe51c9640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 0x7f5fe00c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe49c8640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 0x7f5fe01553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe59ca640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8040650 con 0x7f5fe0159e40 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd802ce90 con 0x7f5fe0159e40 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00c46d0 con 0x7f5fe0159e40 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8040a10 con 0x7f5fe0159e40 2023-11-04T01:42:41.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.868+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe00c4c90 con 0x7f5fe0159e40 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.870+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe00684b0 con 0x7f5fe0159e40 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.870+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fd8040b70 con 0x7f5fe0159e40 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.870+0000 7f5fd5ffb640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 0x7f5fc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.870+0000 7f5fe51c9640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 0x7f5fc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.870+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f5fd80accb0 con 0x7f5fe0159e40 2023-11-04T01:42:41.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.871+0000 7f5fe51c9640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 0x7f5fc406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000f60 tx=0x7f5fdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:41.874+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fd80775c0 con 0x7f5fe0159e40 2023-11-04T01:42:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.040+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f5fe00c9750 con 0x7f5fe0159e40 2023-11-04T01:42:42.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.040+0000 7f5fd5ffb640 1 -- 172.21.15.93:0/70580580 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v113) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5fd8044020 con 0x7f5fe0159e40 2023-11-04T01:42:42.041 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:42:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 msgr2=0x7f5fc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 0x7f5fc406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000f60 tx=0x7f5fdc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 msgr2=0x7f5fe015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd8004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 shutdown_connections 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5fc406ae70 0x7f5fc406d330 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe0159e40 0x7f5fe015c940 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fe00b0c40 0x7f5fe01553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 --2- 172.21.15.93:0/70580580 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5fe006bb60 0x7f5fe00c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 >> 172.21.15.93:0/70580580 conn(0x7f5fe00cb530 msgr2=0x7f5fe015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 shutdown_connections 2023-11-04T01:42:42.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.042+0000 7f5fe742d640 1 -- 172.21.15.93:0/70580580 wait complete. 2023-11-04T01:42:42.054 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.155+0000 7f07bd844640 1 Processor -- start 2023-11-04T01:42:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.155+0000 7f07bd844640 1 -- start start 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07bd844640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f07b815d4e0 0x7f07b80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07bd844640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b80b32b0 con 0x7f07b80d3b60 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07bd844640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b80cee10 con 0x7f07b815d100 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07bd844640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80cec20 con 0x7f07b815d4e0 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07b77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f07b80d3b60 0x7f07b80b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40696/0 (socket says 172.21.15.93:40696) 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.156+0000 7f07b77fe640 1 -- 172.21.15.93:0/926126356 learned_addr learned my addr 172.21.15.93:0/926126356 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:42.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b67fc640 1 --2- 172.21.15.93:0/926126356 >> v2:172.21.15.125:3300/0 conn(0x7f07b815d4e0 0x7f07b80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b5ffb640 1 -- 172.21.15.93:0/926126356 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770134563 0 0) 0x7f07b80b32b0 con 0x7f07b80d3b60 2023-11-04T01:42:42.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b5ffb640 1 -- 172.21.15.93:0/926126356 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a0003520 con 0x7f07b80d3b60 2023-11-04T01:42:42.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b67fc640 1 -- 172.21.15.93:0/926126356 >> v1:172.21.15.125:6789/0 conn(0x7f07b815d100 legacy=0x7f07b80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b67fc640 1 -- 172.21.15.93:0/926126356 >> v1:172.21.15.93:6789/0 conn(0x7f07b80d3b60 legacy=0x7f07b80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.157+0000 7f07b67fc640 1 -- 172.21.15.93:0/926126356 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b80b2980 con 0x7f07b815d4e0 2023-11-04T01:42:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07b67fc640 1 --2- 172.21.15.93:0/926126356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b815d4e0 0x7f07b80d14d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0097a0 tx=0x7f07ac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c526b895d1aee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07b5ffb640 1 -- 172.21.15.93:0/926126356 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac030610 con 0x7f07b815d4e0 2023-11-04T01:42:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07b5ffb640 1 -- 172.21.15.93:0/926126356 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac030770 con 0x7f07b815d4e0 2023-11-04T01:42:42.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07b5ffb640 1 -- 172.21.15.93:0/926126356 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac030ae0 con 0x7f07b815d4e0 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 -- 172.21.15.93:0/926126356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b815d4e0 msgr2=0x7f07b80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 --2- 172.21.15.93:0/926126356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b815d4e0 0x7f07b80d14d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0097a0 tx=0x7f07ac02b960 comp rx=0 tx=0).stop 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 -- 172.21.15.93:0/926126356 shutdown_connections 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 --2- 172.21.15.93:0/926126356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b815d4e0 0x7f07b80d14d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 -- 172.21.15.93:0/926126356 >> 172.21.15.93:0/926126356 conn(0x7f07b80d2ef0 msgr2=0x7f07b80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 -- 172.21.15.93:0/926126356 shutdown_connections 2023-11-04T01:42:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.158+0000 7f07bd844640 1 -- 172.21.15.93:0/926126356 wait complete. 2023-11-04T01:42:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 Processor -- start 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 -- start start 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80d3b60 0x7f07b8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 0x7f07b80a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80b8da0 con 0x7f07b815d4e0 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80b7fe0 con 0x7f07b80d3b60 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07bd844640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80b82c0 con 0x7f07b815d100 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07b77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07b77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55402/0 (socket says 172.21.15.93:55402) 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.160+0000 7f07b77fe640 1 -- 172.21.15.93:0/3952798921 learned_addr learned my addr 172.21.15.93:0/3952798921 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80d3b60 0x7f07b8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b67fc640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 0x7f07b80a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 -- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 msgr2=0x7f07b80a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 0x7f07b80a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 -- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80d3b60 msgr2=0x7f07b8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80d3b60 0x7f07b8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 -- 172.21.15.93:0/3952798921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac009400 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b67fc640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 0x7f07b80a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07b77fe640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c430 tx=0x7f07b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0005ce0 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0005e40 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0007310 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b80b85a0 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.161+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b80b7c90 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.162+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b80b8ac0 con 0x7f07b815d4e0 2023-11-04T01:42:42.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.162+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07b0007470 con 0x7f07b815d4e0 2023-11-04T01:42:42.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.163+0000 7f079ffff640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.163+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.163+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f07b0089440 con 0x7f07b815d4e0 2023-11-04T01:42:42.166 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.163+0000 7f07b6ffd640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001ec0 tx=0x7f07a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.167+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07b80b8ac0 con 0x7f07b815d4e0 2023-11-04T01:42:42.333 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.332+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f07b80b8ac0 con 0x7f07b815d4e0 2023-11-04T01:42:42.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.332+0000 7f079ffff640 1 -- 172.21.15.93:0/3952798921 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v113) v1 ==== 107+0+11 (secure 0 0 0) 0x7f07b80b8ac0 con 0x7f07b815d4e0 2023-11-04T01:42:42.334 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 msgr2=0x7f07a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001ec0 tx=0x7f07a8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 msgr2=0x7f07b80a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c430 tx=0x7f07b000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 shutdown_connections 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f07a406ae70 0x7f07a406d330 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b815d4e0 0x7f07b80a07d0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f07b815d100 0x7f07b80a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 --2- 172.21.15.93:0/3952798921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07b80d3b60 0x7f07b8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 >> 172.21.15.93:0/3952798921 conn(0x7f07b80d2ef0 msgr2=0x7f07b80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 shutdown_connections 2023-11-04T01:42:42.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.334+0000 7f07bd844640 1 -- 172.21.15.93:0/3952798921 wait complete. 2023-11-04T01:42:42.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:42.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.447+0000 7efccc7e2640 1 Processor -- start 2023-11-04T01:42:42.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.447+0000 7efccc7e2640 1 -- start start 2023-11-04T01:42:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcc415d4e0 0x7efcc40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcc40d3b60 0x7efcc40d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40b32b0 con 0x7efcc40d3b60 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40cee10 con 0x7efcc415d4e0 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccc7e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40b2980 con 0x7efcc415d100 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccad7f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcc40d3b60 0x7efcc40d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccad7f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcc40d3b60 0x7efcc40d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55416/0 (socket says 172.21.15.93:55416) 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.448+0000 7efccad7f640 1 -- 172.21.15.93:0/3278731921 learned_addr learned my addr 172.21.15.93:0/3278731921 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efcca57e640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efcc9d7d640 1 --2- 172.21.15.93:0/3278731921 >> v2:172.21.15.125:3300/0 conn(0x7efcc415d4e0 0x7efcc40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 -- 172.21.15.93:0/3278731921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 msgr2=0x7efcc40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 -- 172.21.15.93:0/3278731921 >> v2:172.21.15.125:3300/0 conn(0x7efcc415d4e0 msgr2=0x7efcc40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 --2- 172.21.15.93:0/3278731921 >> v2:172.21.15.125:3300/0 conn(0x7efcc415d4e0 0x7efcc40d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 -- 172.21.15.93:0/3278731921 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40b2c60 con 0x7efcc40d3b60 2023-11-04T01:42:42.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efcca57e640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.449+0000 7efccad7f640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc40d1a10 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7efcc408bf20 tx=0x7efcbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce44315a84faf7ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efcc957c640 1 -- 172.21.15.93:0/3278731921 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc031870 con 0x7efcc40d3b60 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efcc957c640 1 -- 172.21.15.93:0/3278731921 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc0319d0 con 0x7efcc40d3b60 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efcc957c640 1 -- 172.21.15.93:0/3278731921 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc031d60 con 0x7efcc40d3b60 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 -- 172.21.15.93:0/3278731921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 msgr2=0x7efcc40d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc40d1a10 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7efcc408bf20 tx=0x7efcbc02b910 comp rx=0 tx=0).stop 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 -- 172.21.15.93:0/3278731921 shutdown_connections 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc40d1a10 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 --2- 172.21.15.93:0/3278731921 >> v2:172.21.15.125:3300/0 conn(0x7efcc415d4e0 0x7efcc40d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 --2- 172.21.15.93:0/3278731921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 -- 172.21.15.93:0/3278731921 >> 172.21.15.93:0/3278731921 conn(0x7efcc40d2ef0 msgr2=0x7efcc40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 -- 172.21.15.93:0/3278731921 shutdown_connections 2023-11-04T01:42:42.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.450+0000 7efccc7e2640 1 -- 172.21.15.93:0/3278731921 wait complete. 2023-11-04T01:42:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.451+0000 7efccc7e2640 1 Processor -- start 2023-11-04T01:42:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.451+0000 7efccc7e2640 1 -- start start 2023-11-04T01:42:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc41f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc415d4e0 0x7efcc415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc409faa0 con 0x7efcc40d3b60 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc41f6e70 con 0x7efcc415d4e0 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efccc7e2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc409ebd0 con 0x7efcc415d100 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55428/0 (socket says 172.21.15.93:55428) 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 -- 172.21.15.93:0/577904987 learned_addr learned my addr 172.21.15.93:0/577904987 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 -- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 msgr2=0x7efcc41f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc41f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 -- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc415d4e0 msgr2=0x7efcc415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc415d4e0 0x7efcc415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.452+0000 7efcca57e640 1 -- 172.21.15.93:0/577904987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0094d0 con 0x7efcc40d3b60 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efcca57e640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009fc0 tx=0x7efcc000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.456 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0003b90 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000f040 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc409ee20 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0004030 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.453+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc409f3e0 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.454+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcc0004190 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.454+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc409fbe0 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.454+0000 7efcbaffd640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 0x7efca806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.454+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7efcc008a1b0 con 0x7efcc40d3b60 2023-11-04T01:42:42.457 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.454+0000 7efcc9d7d640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 0x7efca806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.455+0000 7efcc9d7d640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 0x7efca806d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efcb4006e80 tx=0x7efcb4006dd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.460 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.459+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcc0054a50 con 0x7efcc40d3b60 2023-11-04T01:42:42.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:42:42.570+0000 7fc4e67fc640 -1 client.8319 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:42:42.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.626+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcc40684b0 con 0x7efcc40d3b60 2023-11-04T01:42:42.627 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.626+0000 7efcbaffd640 1 -- 172.21.15.93:0/577904987 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcc001a0a0 con 0x7efcc40d3b60 2023-11-04T01:42:42.627 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:42:42.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 msgr2=0x7efca806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 0x7efca806d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efcb4006e80 tx=0x7efcb4006dd0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.629 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 msgr2=0x7efcc4157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009fc0 tx=0x7efcc000d560 comp rx=0 tx=0).stop 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 shutdown_connections 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efca806ae70 0x7efca806d330 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc415d4e0 0x7efcc415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcc415d100 0x7efcc41f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 --2- 172.21.15.93:0/577904987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcc40d3b60 0x7efcc4157d60 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 >> 172.21.15.93:0/577904987 conn(0x7efcc40d2ef0 msgr2=0x7efcc415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 shutdown_connections 2023-11-04T01:42:42.630 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.628+0000 7efccc7e2640 1 -- 172.21.15.93:0/577904987 wait complete. 2023-11-04T01:42:42.640 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:42.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 Processor -- start 2023-11-04T01:42:42.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 -- start start 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80b0c40 0x7fdbf806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbf806bb60 0x7fdbf8070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf8071500 con 0x7fdbf8159e40 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf8070a70 con 0x7fdbf806bb60 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.740+0000 7fdbff044640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815dae0 con 0x7fdbf80b0c40 2023-11-04T01:42:42.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfcde0640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdbf8159e40 0x7fdbf80b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40704/0 (socket says 172.21.15.93:40704) 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfcde0640 1 -- 172.21.15.93:0/1157359807 learned_addr learned my addr 172.21.15.93:0/1157359807 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80b0c40 0x7fdbf806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> v2:172.21.15.125:3300/0 conn(0x7fdbf806bb60 0x7fdbf8070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734057393 0 0) 0x7fdbf8071500 con 0x7fdbf8159e40 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe8003520 con 0x7fdbf8159e40 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832486914 0 0) 0x7fdbe8003520 con 0x7fdbf8159e40 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80b0c40 msgr2=0x7fdbf806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80b0c40 0x7fdbf806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 >> v2:172.21.15.125:3300/0 conn(0x7fdbf806bb60 msgr2=0x7fdbf8070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 --2- 172.21.15.93:0/1157359807 >> v2:172.21.15.125:3300/0 conn(0x7fdbf806bb60 0x7fdbf8070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8070c60 con 0x7fdbf8159e40 2023-11-04T01:42:42.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fdbec001670 con 0x7fdbf8159e40 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 >> v1:172.21.15.93:6789/0 conn(0x7fdbf8159e40 legacy=0x7fdbf80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe8003970 0x7fdbe8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8004360 0x7fdbe8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbe8004f50 0x7fdbe800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815dae0 con 0x7fdbe8004f50 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe800bec0 con 0x7fdbe8004360 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe800c030 con 0x7fdbe8003970 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80b0c40 0x7fdbf806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> v2:172.21.15.125:3300/0 conn(0x7fdbf806bb60 0x7fdbf8070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbe8004f50 0x7fdbe800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbfcde0640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe8003970 0x7fdbe8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.741+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8004360 0x7fdbe8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 -- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe8003970 msgr2=0x7fdbe8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbe8003970 0x7fdbe8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 -- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8004360 msgr2=0x7fdbe8004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe8004360 0x7fdbe8004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 -- 172.21.15.93:0/1157359807 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8003520 con 0x7fdbe8004f50 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbe8004f50 0x7fdbe800b980 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000e350 tx=0x7fdbe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3b0157eebecc19 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf002cdd0 con 0x7fdbe8004f50 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf000f040 con 0x7fdbe8004f50 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.742+0000 7fdbf77fe640 1 -- 172.21.15.93:0/1157359807 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0003b90 con 0x7fdbe8004f50 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 -- 172.21.15.93:0/1157359807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbe8004f50 msgr2=0x7fdbe800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 --2- 172.21.15.93:0/1157359807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbe8004f50 0x7fdbe800b980 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000e350 tx=0x7fdbe80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbfd5e1640 1 -- 172.21.15.93:0/1157359807 reap_dead start 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 -- 172.21.15.93:0/1157359807 shutdown_connections 2023-11-04T01:42:42.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 -- 172.21.15.93:0/1157359807 >> 172.21.15.93:0/1157359807 conn(0x7fdbf80cb530 msgr2=0x7fdbf80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 -- 172.21.15.93:0/1157359807 shutdown_connections 2023-11-04T01:42:42.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.743+0000 7fdbff044640 1 -- 172.21.15.93:0/1157359807 wait complete. 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.744+0000 7fdbff044640 1 Processor -- start 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.744+0000 7fdbff044640 1 -- start start 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 0x7fdbf81f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80ac8d0 0x7fdbf80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf81f2ee0 con 0x7fdbf80c1c50 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80ad290 con 0x7fdbf81f60c0 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbff044640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf81f6880 con 0x7fdbf80ac8d0 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55458/0 (socket says 172.21.15.93:55458) 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 -- 172.21.15.93:0/2904698898 learned_addr learned my addr 172.21.15.93:0/2904698898 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 0x7fdbf81f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 -- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80ac8d0 msgr2=0x7fdbf80acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfd5e1640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80ac8d0 0x7fdbf80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80ac8d0 0x7fdbf80acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 -- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 msgr2=0x7fdbf81f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 0x7fdbf81f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbfcde0640 1 -- 172.21.15.93:0/2904698898 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf81f6b60 con 0x7fdbf80c1c50 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.745+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 0x7fdbf81f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbfcde0640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007290 tx=0x7fdbec007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00f960 con 0x7fdbf80c1c50 2023-11-04T01:42:42.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00fac0 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00fe70 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf81f6e40 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.746+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf81f6540 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.747+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf81f3150 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.747+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbec01d460 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.748+0000 7fdbf57fa640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 0x7fdbdc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.748+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fdbec08a090 con 0x7fdbf80c1c50 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.748+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 0x7fdbdc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.748+0000 7fdbf7fff640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 0x7fdbdc06d360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8158940 tx=0x7fdbe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.752+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbec054880 con 0x7fdbf80c1c50 2023-11-04T01:42:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.916+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbf80684b0 con 0x7fdbf80c1c50 2023-11-04T01:42:42.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.916+0000 7fdbf57fa640 1 -- 172.21.15.93:0/2904698898 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbec057ea0 con 0x7fdbf80c1c50 2023-11-04T01:42:42.918 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:42:42.919 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 msgr2=0x7fdbdc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 0x7fdbdc06d360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8158940 tx=0x7fdbe4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 msgr2=0x7fdbf815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007290 tx=0x7fdbec007750 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 shutdown_connections 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fdbdc06aea0 0x7fdbdc06d360 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fdbf80ac8d0 0x7fdbf80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf81f60c0 0x7fdbf81f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 --2- 172.21.15.93:0/2904698898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdbf80c1c50 0x7fdbf815b020 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 >> 172.21.15.93:0/2904698898 conn(0x7fdbf80cb530 msgr2=0x7fdbf80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 shutdown_connections 2023-11-04T01:42:42.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:42.918+0000 7fdbff044640 1 -- 172.21.15.93:0/2904698898 wait complete. 2023-11-04T01:42:42.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.028+0000 7f7357ac2640 1 Processor -- start 2023-11-04T01:42:43.030 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.028+0000 7f7357ac2640 1 -- start start 2023-11-04T01:42:43.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f7357ac2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73500ade00 0x7f73500b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f7357ac2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 0x7f73500cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f7357ac2640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735006cc90 con 0x7f735006d9c0 2023-11-04T01:42:43.031 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f7357ac2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73500b0e60 con 0x7f73500ade00 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f7357ac2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735006cee0 con 0x7f735006c5f0 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73500ade00 0x7f73500b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f73500ade00 0x7f73500b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55464/0 (socket says 172.21.15.93:55464) 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735505d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f735006d9c0 0x7f73500710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40710/0 (socket says 172.21.15.93:40710) 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 -- 172.21.15.93:0/682283093 learned_addr learned my addr 172.21.15.93:0/682283093 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735605f640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 0x7f73500cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 -- 172.21.15.93:0/682283093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 msgr2=0x7f73500cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 0x7f73500cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735485c640 1 -- 172.21.15.93:0/682283093 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214466761 0 0) 0x7f735006cc90 con 0x7f735006d9c0 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 -- 172.21.15.93:0/682283093 >> v1:172.21.15.93:6789/0 conn(0x7f735006d9c0 legacy=0x7f73500710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735585e640 1 -- 172.21.15.93:0/682283093 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735006d1c0 con 0x7f73500ade00 2023-11-04T01:42:43.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.029+0000 7f735605f640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 0x7f73500cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f735585e640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73500ade00 0x7f73500b0530 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f734c009870 tx=0x7f734c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a6df1f5e6bac7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f735485c640 1 -- 172.21.15.93:0/682283093 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0317e0 con 0x7f73500ade00 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f735485c640 1 -- 172.21.15.93:0/682283093 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c031940 con 0x7f73500ade00 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f735485c640 1 -- 172.21.15.93:0/682283093 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c031cd0 con 0x7f73500ade00 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f7357ac2640 1 -- 172.21.15.93:0/682283093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73500ade00 msgr2=0x7f73500b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.030+0000 7f7357ac2640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73500ade00 0x7f73500b0530 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f734c009870 tx=0x7f734c02b880 comp rx=0 tx=0).stop 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 -- 172.21.15.93:0/682283093 shutdown_connections 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f735006c5f0 0x7f73500cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 --2- 172.21.15.93:0/682283093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73500ade00 0x7f73500b0530 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 -- 172.21.15.93:0/682283093 >> 172.21.15.93:0/682283093 conn(0x7f73500cb530 msgr2=0x7f73500cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 -- 172.21.15.93:0/682283093 shutdown_connections 2023-11-04T01:42:43.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.031+0000 7f7357ac2640 1 -- 172.21.15.93:0/682283093 wait complete. 2023-11-04T01:42:43.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.032+0000 7f7357ac2640 1 Processor -- start 2023-11-04T01:42:43.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.032+0000 7f7357ac2640 1 -- start start 2023-11-04T01:42:43.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.032+0000 7f7357ac2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735006c5f0 0x7f7350152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.032+0000 7f7357ac2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73500ade00 0x7f73500ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73500c26f0 con 0x7f735006d9c0 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73500c29d0 con 0x7f735006c5f0 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73500c2cb0 con 0x7f73500ade00 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55466/0 (socket says 172.21.15.93:55466) 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 -- 172.21.15.93:0/2153561627 learned_addr learned my addr 172.21.15.93:0/2153561627 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735585e640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735006c5f0 0x7f7350152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735605f640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73500ade00 0x7f73500ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 -- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73500ade00 msgr2=0x7f73500ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73500ade00 0x7f73500ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 -- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735006c5f0 msgr2=0x7f7350152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.038 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735006c5f0 0x7f7350152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 -- 172.21.15.93:0/2153561627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0094d0 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f735505d640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f734000c410 tx=0x7f7340001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400074e0 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340007660 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340004a20 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73500c2f90 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.033+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73500ca940 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.034+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73500c34b0 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.035+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7340004b80 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.035+0000 7f73467fc640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 0x7f733406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.035+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f7340089bc0 con 0x7f735006d9c0 2023-11-04T01:42:43.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.035+0000 7f735585e640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 0x7f733406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.035+0000 7f735585e640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 0x7f733406d360 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f734c036000 tx=0x7f734c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.039+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73500c34b0 con 0x7f735006d9c0 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.220+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73500c34b0 con 0x7f735006d9c0 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.221+0000 7f73467fc640 1 -- 172.21.15.93:0/2153561627 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v113) v1 ==== 81+0+1094 (secure 0 0 0) 0x7f73500c34b0 con 0x7f735006d9c0 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:42:43.223 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3505063928 2023-11-04T02:42:36.804546+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:42:43.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:42:43.225 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3671080369 2023-11-04T02:41:51.893134+0000 2023-11-04T01:42:43.225 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:listed 18 entries 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 msgr2=0x7f733406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 0x7f733406d360 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f734c036000 tx=0x7f734c008030 comp rx=0 tx=0).stop 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 msgr2=0x7f73500c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f734000c410 tx=0x7f7340001e70 comp rx=0 tx=0).stop 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 shutdown_connections 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f733406aea0 0x7f733406d360 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f73500ade00 0x7f73500ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.226 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f735006d9c0 0x7f73500c3790 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 --2- 172.21.15.93:0/2153561627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f735006c5f0 0x7f7350152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.222+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 >> 172.21.15.93:0/2153561627 conn(0x7f73500cb530 msgr2=0x7f73500cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.223+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 shutdown_connections 2023-11-04T01:42:43.227 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.223+0000 7f7357ac2640 1 -- 172.21.15.93:0/2153561627 wait complete. 2023-11-04T01:42:43.235 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:42:43.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.235 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:43.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[153802]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:43.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:42:43.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.262 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:43.318 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:42:43.318 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:43.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:43.373 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:43.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.510+0000 7f34c7490640 1 Processor -- start 2023-11-04T01:42:43.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.510+0000 7f34c7490640 1 -- start start 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f34c0159e40 0x7f34c00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34c006bb60 0x7f34c00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006fff0 0x7f34c0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c0071500 con 0x7f34c006bb60 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c015dae0 con 0x7f34c0159e40 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c7490640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00709a0 con 0x7f34c006fff0 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34c006bb60 0x7f34c00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f34c006bb60 0x7f34c00b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55472/0 (socket says 172.21.15.93:55472) 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 -- 172.21.15.93:0/2808792827 learned_addr learned my addr 172.21.15.93:0/2808792827 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:43.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c522c640 1 --2- 172.21.15.93:0/2808792827 >> v2:172.21.15.125:3300/0 conn(0x7f34c0159e40 0x7f34c00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c5a2d640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006fff0 0x7f34c0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 -- 172.21.15.93:0/2808792827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006fff0 msgr2=0x7f34c0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006fff0 0x7f34c0070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 -- 172.21.15.93:0/2808792827 >> v2:172.21.15.125:3300/0 conn(0x7f34c0159e40 msgr2=0x7f34c00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 --2- 172.21.15.93:0/2808792827 >> v2:172.21.15.125:3300/0 conn(0x7f34c0159e40 0x7f34c00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.511+0000 7f34c4a2b640 1 -- 172.21.15.93:0/2808792827 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0070c60 con 0x7f34c006bb60 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c4a2b640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c006bb60 0x7f34c00b0a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f34c00ce7f0 tx=0x7f34b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d508b5950a0bfe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34b7fff640 1 -- 172.21.15.93:0/2808792827 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00317e0 con 0x7f34c006bb60 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34b7fff640 1 -- 172.21.15.93:0/2808792827 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0031940 con 0x7f34c006bb60 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34b7fff640 1 -- 172.21.15.93:0/2808792827 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0031cd0 con 0x7f34c006bb60 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 -- 172.21.15.93:0/2808792827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c006bb60 msgr2=0x7f34c00b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c006bb60 0x7f34c00b0a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f34c00ce7f0 tx=0x7f34b002b880 comp rx=0 tx=0).stop 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 -- 172.21.15.93:0/2808792827 shutdown_connections 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c006bb60 0x7f34c00b0a70 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 --2- 172.21.15.93:0/2808792827 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006fff0 0x7f34c0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 --2- 172.21.15.93:0/2808792827 >> v2:172.21.15.125:3300/0 conn(0x7f34c0159e40 0x7f34c00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.512+0000 7f34c7490640 1 -- 172.21.15.93:0/2808792827 >> 172.21.15.93:0/2808792827 conn(0x7f34c00cb530 msgr2=0x7f34c00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.513+0000 7f34c7490640 1 -- 172.21.15.93:0/2808792827 shutdown_connections 2023-11-04T01:42:43.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.513+0000 7f34c7490640 1 -- 172.21.15.93:0/2808792827 wait complete. 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 Processor -- start 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 -- start start 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006bb60 0x7f34c00cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c006fff0 0x7f34c00c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0151eb0 con 0x7f34c0159e40 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c01516a0 con 0x7f34c006fff0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c7490640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00cefa0 con 0x7f34c006bb60 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.514+0000 7f34c5a2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55476/0 (socket says 172.21.15.93:55476) 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 -- 172.21.15.93:0/4008379776 learned_addr learned my addr 172.21.15.93:0/4008379776 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c522c640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006bb60 0x7f34c00cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c4a2b640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c006fff0 0x7f34c00c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 -- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006bb60 msgr2=0x7f34c00cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006bb60 0x7f34c00cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 -- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c006fff0 msgr2=0x7f34c00c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c006fff0 0x7f34c00c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 -- 172.21.15.93:0/4008379776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00094d0 con 0x7f34c0159e40 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c5a2d640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f34b8007d20 tx=0x7f34b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8014420 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80145a0 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c00c4860 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8014950 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.515+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c0151bd0 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.516+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c00684b0 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.516+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34b8014ab0 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.517+0000 7f34b5ffb640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 0x7f34a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.517+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f34b808a7b0 con 0x7f34c0159e40 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.517+0000 7f34c522c640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 0x7f34a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.517+0000 7f34c522c640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 0x7f34a406d330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.521+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34b8054fa0 con 0x7f34c0159e40 2023-11-04T01:42:43.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:42:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:43.729 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.727+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34c00cf0e0 con 0x7f34c0159e40 2023-11-04T01:42:43.730 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.728+0000 7f34b5ffb640 1 -- 172.21.15.93:0/4008379776 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7f34b80585c0 con 0x7f34c0159e40 2023-11-04T01:42:43.730 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 msgr2=0x7f34a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 0x7f34a406d330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 msgr2=0x7f34c0150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f34b8007d20 tx=0x7f34b800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 shutdown_connections 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f34a406ae70 0x7f34a406d330 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34c0159e40 0x7f34c0150d10 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c006fff0 0x7f34c00c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 --2- 172.21.15.93:0/4008379776 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f34c006bb60 0x7f34c00cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 >> 172.21.15.93:0/4008379776 conn(0x7f34c00cb530 msgr2=0x7f34c00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 shutdown_connections 2023-11-04T01:42:43.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:43.729+0000 7f34c7490640 1 -- 172.21.15.93:0/4008379776 wait complete. 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:43.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:43.743 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:43.743 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:43.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.743 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.758 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41436sec preferred_lft 41436sec 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.759 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.761 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:43.823 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.825 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:42:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:42:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:43.880 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:43.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:43.881 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:42:43.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.975 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:42:43.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:43.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:43.990 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:43.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.990 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:42:44.056 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:44.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:44.057 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:44.111 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:44.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:44.112 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:44.166 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:44.222 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:42:44.222 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:42:44.222 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:42:44.222 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:42:44.223 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.224 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.225 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.225 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:42:44.277 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:44.277 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:44.319 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:42:44.334 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:42:44.335 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.337 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:42:44.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:42:44.406+0000 7f848b963480 -1 init, newargv = 0x557a36397f80 newargc=15 2023-11-04T01:42:44.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[155792]: starting ceph client 2023-11-04T01:42:44.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[155792]: starting fuse 2023-11-04T01:42:45.489 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:45.509 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:42:45.509 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:42:45.509 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:42:45.509 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:42:45.509 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:42:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:45.511 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:42:45.512 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:42:45.512 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:45.512 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:45.512 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:45.513 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:45.513 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:42:45.513 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.513 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.513 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.514 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.514 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.515 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:42:45.567 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:42:45.567 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:42:45.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:45.567 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:42:45.567 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:42:45.567 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:42:45.700 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.155792.asok 2023-11-04T01:42:45.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:45.713 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.155792.asok 2023-11-04T01:42:45.713 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:45.713 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.155792.asok status 2023-11-04T01:42:45.816 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "155792", 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:42:45.887 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 8586, 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 8586 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:45.888 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2573507659 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 2573507659 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.8586 192.168.0.1:0/2573507659", 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/2573507659", 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 104, 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 113, 2023-11-04T01:42:45.889 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:45.890 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:42:45.890 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:42:45.890 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:42:45.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:45.901 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:45.901 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:45.901 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:45.959 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:42:45.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:45.966 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:45.966 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:46.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:46.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:46.031 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:42:46.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.131+0000 7fc501290640 1 Processor -- start 2023-11-04T01:42:46.133 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.131+0000 7fc501290640 1 -- start start 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc501290640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc501290640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4fc09cc90 0x7fc4fc0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc501290640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0ad6c0 con 0x7fc4fc15e8e0 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc501290640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc15c350 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc501290640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0abf40 con 0x7fc4fc09cc90 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55492/0 (socket says 172.21.15.93:55492) 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 -- 172.21.15.93:0/3128060337 learned_addr learned my addr 172.21.15.93:0/3128060337 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/3128060337 >> v2:172.21.15.125:3300/0 conn(0x7fc4fc09cc90 0x7fc4fc0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 -- 172.21.15.93:0/3128060337 >> v2:172.21.15.125:3300/0 conn(0x7fc4fc09cc90 msgr2=0x7fc4fc0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 --2- 172.21.15.93:0/3128060337 >> v2:172.21.15.125:3300/0 conn(0x7fc4fc09cc90 0x7fc4fc0b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 -- 172.21.15.93:0/3128060337 >> v1:172.21.15.125:6789/0 conn(0x7fc4fc15e8e0 legacy=0x7fc4fc15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.132+0000 7fc4faffd640 1 -- 172.21.15.93:0/3128060337 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0b1650 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.136 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.133+0000 7fc4faffd640 1 --2- 172.21.15.93:0/3128060337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc06ffa0 tx=0x7fc4f402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6d57219f32ab3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.133+0000 7fc4f9ffb640 1 -- 172.21.15.93:0/3128060337 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f402cad0 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.133+0000 7fc4f9ffb640 1 -- 172.21.15.93:0/3128060337 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f402cc30 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.137 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.133+0000 7fc4f9ffb640 1 -- 172.21.15.93:0/3128060337 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40343f0 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 -- 172.21.15.93:0/3128060337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc0b0d30 msgr2=0x7fc4fc15bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 --2- 172.21.15.93:0/3128060337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc06ffa0 tx=0x7fc4f402bf30 comp rx=0 tx=0).stop 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 -- 172.21.15.93:0/3128060337 shutdown_connections 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 --2- 172.21.15.93:0/3128060337 >> v2:172.21.15.125:3300/0 conn(0x7fc4fc09cc90 0x7fc4fc0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 --2- 172.21.15.93:0/3128060337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc15bd70 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 -- 172.21.15.93:0/3128060337 >> 172.21.15.93:0/3128060337 conn(0x7fc4fc0cbd30 msgr2=0x7fc4fc0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 -- 172.21.15.93:0/3128060337 shutdown_connections 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.134+0000 7fc501290640 1 -- 172.21.15.93:0/3128060337 wait complete. 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.135+0000 7fc501290640 1 Processor -- start 2023-11-04T01:42:46.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.135+0000 7fc501290640 1 -- start start 2023-11-04T01:42:46.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4fc15e8e0 0x7fc4fc09b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1f0630 con 0x7fc4fc09cc90 2023-11-04T01:42:46.140 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc158b90 con 0x7fc4fc0b0d30 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc501290640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b38e0 con 0x7fc4fc15e8e0 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55502/0 (socket says 172.21.15.93:55502) 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 -- 172.21.15.93:0/2299955231 learned_addr learned my addr 172.21.15.93:0/2299955231 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4fc15e8e0 0x7fc4fc09b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 -- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4fc15e8e0 msgr2=0x7fc4fc09b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4fc15e8e0 0x7fc4fc09b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 -- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4fc0b0d30 msgr2=0x7fc4fc0b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc0b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.141 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.136+0000 7fc4faffd640 1 -- 172.21.15.93:0/2299955231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4009b30 con 0x7fc4fc09cc90 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000f80 tx=0x7fc4f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc4f37fe640 1 -- 172.21.15.93:0/2299955231 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4009510 con 0x7fc4fc09cc90 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc4f37fe640 1 -- 172.21.15.93:0/2299955231 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f403e450 con 0x7fc4fc09cc90 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc158de0 con 0x7fc4fc09cc90 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc4f37fe640 1 -- 172.21.15.93:0/2299955231 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f403e800 con 0x7fc4fc09cc90 2023-11-04T01:42:46.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.137+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc1593a0 con 0x7fc4fc09cc90 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.139+0000 7fc4f37fe640 1 -- 172.21.15.93:0/2299955231 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4f403e960 con 0x7fc4fc09cc90 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.139+0000 7fc4f37fe640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 0x7fc4dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.139+0000 7fc4f37fe640 1 -- 172.21.15.93:0/2299955231 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc4f40acbb0 con 0x7fc4fc09cc90 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.139+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 0x7fc4dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.139+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 0x7fc4dc06d330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc1f3c30 tx=0x7fc4e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.140+0000 7fc503e21740 1 Processor -- start 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.140+0000 7fc503e21740 1 -- start start 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x5581008fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cb6d0 0x5581008f8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810083ed70 con 0x5581008cf040 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810083c460 con 0x5581008cb6d0 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x558100837d50 con 0x5581008fb4c0 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55510/0 (socket says 172.21.15.93:55510) 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 -- 172.21.15.93:0/3914694010 learned_addr learned my addr 172.21.15.93:0/3914694010 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 -- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 msgr2=0x5581008fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x5581008fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 -- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cb6d0 msgr2=0x5581008f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cb6d0 0x5581008f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 -- 172.21.15.93:0/3914694010 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581007fae30 con 0x5581008cf040 2023-11-04T01:42:46.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec001570 tx=0x7fc4ec001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc8d02f5296db43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4f0ff9640 1 -- 172.21.15.93:0/3914694010 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0050d0 con 0x5581008cf040 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4f0ff9640 1 -- 172.21.15.93:0/3914694010 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec005230 con 0x5581008cf040 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.141+0000 7fc4f0ff9640 1 -- 172.21.15.93:0/3914694010 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00e740 con 0x5581008cf040 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 -- 172.21.15.93:0/3914694010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 msgr2=0x5581008f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec001570 tx=0x7fc4ec001a30 comp rx=0 tx=0).stop 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 -- 172.21.15.93:0/3914694010 shutdown_connections 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008cf040 0x5581008f8c70 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cb6d0 0x5581008f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.147 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 --2- 172.21.15.93:0/3914694010 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x5581008fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 -- 172.21.15.93:0/3914694010 >> 172.21.15.93:0/3914694010 conn(0x5581008cd9e0 msgr2=0x5581009162d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 -- 172.21.15.93:0/3914694010 shutdown_connections 2023-11-04T01:42:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.142+0000 7fc503e21740 1 -- 172.21.15.93:0/3914694010 wait complete. 2023-11-04T01:42:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 -- start start 2023-11-04T01:42:46.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 Processor -- start 2023-11-04T01:42:46.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x5581008f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 0x55810091b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581007f1ee0 con 0x5581008fb4c0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581007f1b80 con 0x5581008ee1c0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.143+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581007b73a0 con 0x5581008cf040 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc503e21740 10 client.0 _ll_register_callbacks cb 0x5581007bb8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55518/0 (socket says 172.21.15.93:55518) 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/2978424098 learned_addr learned my addr 172.21.15.93:0/2978424098 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 0x55810091b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x5581008f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 msgr2=0x5581008f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x5581008f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 msgr2=0x55810091b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 0x55810091b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/2978424098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec00f040 con 0x5581008fb4c0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 0x55810091b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4006fd0 tx=0x7fc4e4007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b5abc8dd6cf207 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4003e20 con 0x5581008fb4c0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558100830d30 con 0x5581008fb4c0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc4e4016480 con 0x5581008fb4c0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4e4016640 con 0x5581008fb4c0 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc503e21740 10 client.8598 fetch_fsmap learned FSMap version 104 2023-11-04T01:42:46.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x5581008363d0 con 0x5581008fb4c0 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.144+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558100830d30 con 0x5581008fb4c0 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 104) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc4e40167a0 con 0x5581008fb4c0 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 10 client.8598 fetch_fsmap finished waiting for FSMap version 104 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 10 client.8598 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 20 client.8598 populate_metadata read hostname 'smithi093' 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f2430 0x5581008f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 4 client.8598 mds_command: new command op to 6164 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 --> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558100830a50 con 0x5581008f2430 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f2430 0x5581008f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc4d9ffb640 10 client.8598 ms_handle_connect on v2:172.21.15.125:6833/3282724716 2023-11-04T01:42:46.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.145+0000 7fc4faffd640 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f2430 0x5581008f4ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8c00fceefc8fc0 server_cookie=3c44cf80a216d34 in_seq=0 out_seq=0 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/2978424098 <== mds.0 v2:172.21.15.125:6833/3282724716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558100830a50 con 0x5581008f2430 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc4d9ffb640 10 client.8598 handle_command_reply: tid=0 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 client.8598 shutdown 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 msgr2=0x5581008ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4006fd0 tx=0x7fc4e4007770 comp rx=0 tx=0).stop 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 shutdown_connections 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008ee1c0 0x55810091b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008fb4c0 0x5581008ff490 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f2430 0x5581008f4ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 --2- 172.21.15.93:0/2978424098 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x5581008f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc4d9ffb640 0 client.8598 ms_handle_reset on v2:172.21.15.125:6833/3282724716 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 >> 172.21.15.93:0/2978424098 conn(0x5581008cb6d0 msgr2=0x5581008cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 shutdown_connections 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 1 -- 172.21.15.93:0/2978424098 wait complete. 2023-11-04T01:42:46.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.146+0000 7fc503e21740 20 client.8598 trim_cache size 0 max 16384 2023-11-04T01:42:46.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.159+0000 7fc503e21740 1 Processor -- start 2023-11-04T01:42:46.161 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.159+0000 7fc503e21740 1 -- start start 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cf040 0x55810091b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x558100925b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55810091b010 con 0x5581008ee1c0 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581008fbb40 con 0x5581008cf040 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581008cc530 con 0x5581008fb4c0 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55522/0 (socket says 172.21.15.93:55522) 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/4012919773 learned_addr learned my addr 172.21.15.93:0/4012919773 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 msgr2=0x558100925b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x558100925b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cf040 msgr2=0x55810091b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cf040 0x55810091b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/4012919773 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581007d3ea0 con 0x5581008ee1c0 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007fd0 tx=0x7fc4e401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b40448783a5e5be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4f17fa640 1 -- 172.21.15.93:0/4012919773 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4006dd0 con 0x5581008ee1c0 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4f17fa640 1 -- 172.21.15.93:0/4012919773 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4003e20 con 0x5581008ee1c0 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.160+0000 7fc4f17fa640 1 -- 172.21.15.93:0/4012919773 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4016d30 con 0x5581008ee1c0 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- 172.21.15.93:0/4012919773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 msgr2=0x5581009255d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007fd0 tx=0x7fc4e401b000 comp rx=0 tx=0).stop 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- 172.21.15.93:0/4012919773 shutdown_connections 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008fb4c0 0x558100925b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581009255d0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 --2- 172.21.15.93:0/4012919773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008cf040 0x55810091b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- 172.21.15.93:0/4012919773 >> 172.21.15.93:0/4012919773 conn(0x5581008cb6d0 msgr2=0x5581008c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- 172.21.15.93:0/4012919773 shutdown_connections 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- 172.21.15.93:0/4012919773 wait complete. 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 -- start start 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.161+0000 7fc503e21740 1 Processor -- start 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x558100980e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008fb4c0 0x558100915cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581008f4e30 con 0x5581008ee1c0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100925450 con 0x5581008fb4c0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581009256a0 con 0x5581008cf040 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc503e21740 10 client.0 _ll_register_callbacks cb 0x7fc4ec007e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55532/0 (socket says 172.21.15.93:55532) 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/1618491080 learned_addr learned my addr 172.21.15.93:0/1618491080 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4faffd640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x558100980e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fb7fe640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008fb4c0 0x558100915cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 msgr2=0x558100980e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x558100980e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.172 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008fb4c0 msgr2=0x558100915cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008fb4c0 0x558100915cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4fa7fc640 1 -- 172.21.15.93:0/1618491080 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581008363d0 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.162+0000 7fc4faffd640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x558100980e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4fa7fc640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc4e402f000 tx=0x7fc4e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abe02ea766b345e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4006dd0 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc4e400f040 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4ec005230 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4e4016880 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 10 client.8604 fetch_fsmap learned FSMap version 104 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x5581007f9690 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e404d080 con 0x5581008ee1c0 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 104) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc4e4038680 con 0x5581008ee1c0 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 10 client.8604 fetch_fsmap finished waiting for FSMap version 104 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 10 client.8604 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 20 client.8604 populate_metadata read hostname 'smithi093' 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f4690 0x5581009161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 4 client.8604 mds_command: new command op to 6164 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 --> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5581005387e0 con 0x5581008f4690 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.163+0000 7fc4faffd640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f4690 0x5581009161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.164+0000 7fc4d9ffb640 10 client.8604 ms_handle_connect on v2:172.21.15.125:6833/3282724716 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.164+0000 7fc4faffd640 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f4690 0x5581009161f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e34984b2d22b6e5f server_cookie=8d9856166218c2ca in_seq=0 out_seq=0 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.174+0000 7fc4d9ffb640 1 -- 172.21.15.93:0/1618491080 <== mds.0 v2:172.21.15.125:6833/3282724716 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5581005387e0 con 0x5581008f4690 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.174+0000 7fc4d9ffb640 10 client.8604 handle_command_reply: tid=0 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.174+0000 7fc503e21740 1 client.8604 shutdown 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 msgr2=0x5581008d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc4e402f000 tx=0x7fc4e4016000 comp rx=0 tx=0).stop 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 shutdown_connections 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5581008fb4c0 0x558100915cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5581008ee1c0 0x5581008d17e0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:6833/3282724716,v1:172.21.15.125:6835/3282724716] conn(0x5581008f4690 0x5581009161f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 --2- 172.21.15.93:0/1618491080 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x5581008cf040 0x558100980e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc4d9ffb640 0 client.8604 ms_handle_reset on v2:172.21.15.125:6833/3282724716 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 >> 172.21.15.93:0/1618491080 conn(0x5581008cb6d0 msgr2=0x5581008cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 shutdown_connections 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 1 -- 172.21.15.93:0/1618491080 wait complete. 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc503e21740 20 client.8604 trim_cache size 0 max 16384 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stdout: "message": "", 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stdout: "return_code": 0 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 msgr2=0x7fc4dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 0x7fc4dc06d330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc1f3c30 tx=0x7fc4e4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 msgr2=0x7fc4fc150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000f80 tx=0x7fc4f4004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 shutdown_connections 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc4dc06ae70 0x7fc4dc06d330 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc4fc15e8e0 0x7fc4fc09b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4fc0b0d30 0x7fc4fc0b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 --2- 172.21.15.93:0/2299955231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4fc09cc90 0x7fc4fc150e80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 >> 172.21.15.93:0/2299955231 conn(0x7fc4fc0cbd30 msgr2=0x7fc4fc06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 shutdown_connections 2023-11-04T01:42:46.181 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.175+0000 7fc501290640 1 -- 172.21.15.93:0/2299955231 wait complete. 2023-11-04T01:42:46.188 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:42:46.188 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:46.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.285+0000 7f7977689640 1 Processor -- start 2023-11-04T01:42:46.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.285+0000 7f7977689640 1 -- start start 2023-11-04T01:42:46.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7977689640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 0x7f79700cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7977689640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f797006c220 0x7f79700ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7977689640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700cd720 con 0x7f79700addd0 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7977689640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700ae1b0 con 0x7f797006c220 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7977689640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700ccb10 con 0x7f79700cc680 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f797006c220 0x7f79700ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f797006c220 0x7f79700ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55538/0 (socket says 172.21.15.93:55538) 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 -- 172.21.15.93:0/2142544229 learned_addr learned my addr 172.21.15.93:0/2142544229 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7974c24640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 0x7f79700cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 -- 172.21.15.93:0/2142544229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 msgr2=0x7f79700cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 0x7f79700cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 -- 172.21.15.93:0/2142544229 >> v1:172.21.15.125:6789/0 conn(0x7f79700addd0 legacy=0x7f797006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7975c26640 1 -- 172.21.15.93:0/2142544229 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700ccdf0 con 0x7f797006c220 2023-11-04T01:42:46.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.286+0000 7f7974c24640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 0x7f79700cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.287+0000 7f7975c26640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700ca2d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f796800af60 tx=0x7f796802cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f744742b8155b4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.287+0000 7f7967fff640 1 -- 172.21.15.93:0/2142544229 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802d970 con 0x7f797006c220 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.287+0000 7f7967fff640 1 -- 172.21.15.93:0/2142544229 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796802dad0 con 0x7f797006c220 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.287+0000 7f7967fff640 1 -- 172.21.15.93:0/2142544229 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802de60 con 0x7f797006c220 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.287+0000 7f7977689640 1 -- 172.21.15.93:0/2142544229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 msgr2=0x7f79700ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700ca2d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f796800af60 tx=0x7f796802cfd0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 -- 172.21.15.93:0/2142544229 shutdown_connections 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700ca2d0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 --2- 172.21.15.93:0/2142544229 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79700cc680 0x7f79700cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 -- 172.21.15.93:0/2142544229 >> 172.21.15.93:0/2142544229 conn(0x7f79700cb530 msgr2=0x7f79700cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 -- 172.21.15.93:0/2142544229 shutdown_connections 2023-11-04T01:42:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.288+0000 7f7977689640 1 -- 172.21.15.93:0/2142544229 wait complete. 2023-11-04T01:42:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.289+0000 7f7977689640 1 Processor -- start 2023-11-04T01:42:46.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.289+0000 7f7977689640 1 -- start start 2023-11-04T01:42:46.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.289+0000 7f7977689640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79700addd0 0x7f7970148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79701f1940 0x7f79701f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79701f2310 con 0x7f797006c220 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700c6d80 con 0x7f79700addd0 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7970149530 con 0x7f79701f1940 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55540/0 (socket says 172.21.15.93:55540) 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 -- 172.21.15.93:0/1915940984 learned_addr learned my addr 172.21.15.93:0/1915940984 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 -- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79701f1940 msgr2=0x7f79701f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79701f1940 0x7f79701f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 -- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79700addd0 msgr2=0x7f7970148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79700addd0 0x7f7970148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 -- 172.21.15.93:0/1915940984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796800ac40 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7975425640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c430 tx=0x7f796c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c011790 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0118f0 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c011ca0 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79700c4ec0 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.290+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700c72b0 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.291+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79700684b0 con 0x7f797006c220 2023-11-04T01:42:46.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.292+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f796c01c460 con 0x7f797006c220 2023-11-04T01:42:46.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.292+0000 7f7965ffb640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 0x7f795406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.292+0000 7f7974c24640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 0x7f795406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.292+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f796c089d30 con 0x7f797006c220 2023-11-04T01:42:46.296 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.292+0000 7f7974c24640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 0x7f795406d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.296+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f796c0545b0 con 0x7f797006c220 2023-11-04T01:42:46.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.498+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79700b4a30 con 0x7f797006c220 2023-11-04T01:42:46.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.498+0000 7f7965ffb640 1 -- 172.21.15.93:0/1915940984 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4939 (secure 0 0 0) 0x7f796c057bd0 con 0x7f797006c220 2023-11-04T01:42:46.500 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:46.501 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:38.106253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:46.501 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 104 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 msgr2=0x7f795406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 0x7f795406d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960008040 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 msgr2=0x7f79700c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c430 tx=0x7f796c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 shutdown_connections 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f795406aea0 0x7f795406d360 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f79701f1940 0x7f79701f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79700addd0 0x7f7970148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 --2- 172.21.15.93:0/1915940984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f797006c220 0x7f79700c6730 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 >> 172.21.15.93:0/1915940984 conn(0x7f79700cb530 msgr2=0x7f797006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 shutdown_connections 2023-11-04T01:42:46.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.500+0000 7f7977689640 1 -- 172.21.15.93:0/1915940984 wait complete. 2023-11-04T01:42:46.513 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:42:46.637 INFO:teuthology.orchestra.run.smithi125.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:46.637 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" } ] } 2023-11-04T01:42:46.637 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:42:46.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.737+0000 7fcefe044640 1 Processor -- start 2023-11-04T01:42:46.739 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.737+0000 7fcefe044640 1 -- start start 2023-11-04T01:42:46.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcefe044640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 0x7fcef806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcefe044640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcef806bb60 0x7fcef8070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcefe044640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef8071500 con 0x7fcef8159e40 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcefe044640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef8070a70 con 0x7fcef806bb60 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcefe044640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815dae0 con 0x7fcef80b0c40 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcef806bb60 0x7fcef8070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef77fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcef8159e40 0x7fcef80b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40726/0 (socket says 172.21.15.93:40726) 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcef806bb60 0x7fcef8070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55544/0 (socket says 172.21.15.93:55544) 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef77fe640 1 -- 172.21.15.93:0/737954748 learned_addr learned my addr 172.21.15.93:0/737954748 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 -- 172.21.15.93:0/737954748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 msgr2=0x7fcef806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef6ffd640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 0x7fcef806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef67fc640 1 -- 172.21.15.93:0/737954748 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908474431 0 0) 0x7fcef8071500 con 0x7fcef8159e40 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 0x7fcef806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 -- 172.21.15.93:0/737954748 >> v1:172.21.15.93:6789/0 conn(0x7fcef8159e40 legacy=0x7fcef80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.741 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef7fff640 1 -- 172.21.15.93:0/737954748 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8070c60 con 0x7fcef806bb60 2023-11-04T01:42:46.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.738+0000 7fcef6ffd640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 0x7fcef806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcef7fff640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef806bb60 0x7fcef8070530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd905f7aecc0f25 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcef67fc640 1 -- 172.21.15.93:0/737954748 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002cbc0 con 0x7fcef806bb60 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcef67fc640 1 -- 172.21.15.93:0/737954748 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef002cd20 con 0x7fcef806bb60 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcef67fc640 1 -- 172.21.15.93:0/737954748 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0034660 con 0x7fcef806bb60 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcefe044640 1 -- 172.21.15.93:0/737954748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef806bb60 msgr2=0x7fcef8070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.739+0000 7fcefe044640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef806bb60 0x7fcef8070530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002be10 comp rx=0 tx=0).stop 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 -- 172.21.15.93:0/737954748 shutdown_connections 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef806bb60 0x7fcef8070530 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 --2- 172.21.15.93:0/737954748 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef80b0c40 0x7fcef806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 -- 172.21.15.93:0/737954748 >> 172.21.15.93:0/737954748 conn(0x7fcef80cb530 msgr2=0x7fcef80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 -- 172.21.15.93:0/737954748 shutdown_connections 2023-11-04T01:42:46.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.740+0000 7fcefe044640 1 -- 172.21.15.93:0/737954748 wait complete. 2023-11-04T01:42:46.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.741+0000 7fcefe044640 1 Processor -- start 2023-11-04T01:42:46.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.741+0000 7fcefe044640 1 -- start start 2023-11-04T01:42:46.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.741+0000 7fcefe044640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef806bb60 0x7fcef8147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.741+0000 7fcefe044640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.741+0000 7fcefe044640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 0x7fcef806c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcefe044640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815aa10 con 0x7fcef80b0c40 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcefe044640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815c010 con 0x7fcef8159e40 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcefe044640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815a3c0 con 0x7fcef806bb60 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55546/0 (socket says 172.21.15.93:55546) 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 -- 172.21.15.93:0/1704704130 learned_addr learned my addr 172.21.15.93:0/1704704130 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef7fff640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 0x7fcef806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef77fe640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef806bb60 0x7fcef8147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 -- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef806bb60 msgr2=0x7fcef8147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef806bb60 0x7fcef8147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.746 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 -- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 msgr2=0x7fcef806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 0x7fcef806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 -- 172.21.15.93:0/1704704130 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009a70 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef7fff640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 0x7fcef806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcef6ffd640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c7f0 tx=0x7fcee800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8007a30 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8007b90 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800ce40 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef815a6a0 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.742+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef80af970 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.743+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef815a220 con 0x7fcef80b0c40 2023-11-04T01:42:46.747 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.744+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcee80113f0 con 0x7fcef80b0c40 2023-11-04T01:42:46.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.744+0000 7fcedffff640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 0x7fcee406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.744+0000 7fcef77fe640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 0x7fcee406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.744+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fcee808a040 con 0x7fcef80b0c40 2023-11-04T01:42:46.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.745+0000 7fcef77fe640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 0x7fcee406d360 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fceec000f60 tx=0x7fceec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.748+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcef815a220 con 0x7fcef80b0c40 2023-11-04T01:42:46.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:46.981+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fcef815a220 con 0x7fcef80b0c40 2023-11-04T01:42:47.135 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.133+0000 7fcedffff640 1 -- 172.21.15.93:0/1704704130 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6164 v105) v1 ==== 112+0+0 (secure 0 0 0) 0x7fcef815a220 con 0x7fcef80b0c40 2023-11-04T01:42:47.136 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.6164 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 msgr2=0x7fcee406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 0x7fcee406d360 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fceec000f60 tx=0x7fceec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 msgr2=0x7fcef815aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c7f0 tx=0x7fcee800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 shutdown_connections 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcee406aea0 0x7fcee406d360 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.138 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcef8159e40 0x7fcef806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcef80b0c40 0x7fcef815aea0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 --2- 172.21.15.93:0/1704704130 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcef806bb60 0x7fcef8147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.135+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 >> 172.21.15.93:0/1704704130 conn(0x7fcef80cb530 msgr2=0x7fcef80ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.136+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 shutdown_connections 2023-11-04T01:42:47.139 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.136+0000 7fcefe044640 1 -- 172.21.15.93:0/1704704130 wait complete. 2023-11-04T01:42:47.149 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:42:47.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.247+0000 7f9449368640 1 Processor -- start 2023-11-04T01:42:47.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.247+0000 7f9449368640 1 -- start start 2023-11-04T01:42:47.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9449368640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9444159e40 0x7f94440b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9449368640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9444071500 con 0x7f9444070700 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9449368640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944415dae0 con 0x7f944406bb60 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9449368640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9444070c60 con 0x7f9444159e40 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9442ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9444159e40 0x7f94440b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f94437fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f9444070700 0x7f94440cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40738/0 (socket says 172.21.15.93:40738) 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9442ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9444159e40 0x7f94440b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55548/0 (socket says 172.21.15.93:55548) 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f94437fe640 1 -- 172.21.15.93:0/2322740605 learned_addr learned my addr 172.21.15.93:0/2322740605 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9442ffd640 1 -- 172.21.15.93:0/2322740605 >> v1:172.21.15.125:6789/0 conn(0x7f944406bb60 legacy=0x7f944406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9442ffd640 1 -- 172.21.15.93:0/2322740605 >> v1:172.21.15.93:6789/0 conn(0x7f9444070700 legacy=0x7f94440cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9442ffd640 1 -- 172.21.15.93:0/2322740605 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444070f40 con 0x7f9444159e40 2023-11-04T01:42:47.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.248+0000 7f9441ffb640 1 -- 172.21.15.93:0/2322740605 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158064942 0 0) 0x7f9444071500 con 0x7f9444070700 2023-11-04T01:42:47.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.249+0000 7f9442ffd640 1 --2- 172.21.15.93:0/2322740605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444159e40 0x7f94440b0530 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9434009d90 tx=0x7f943402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feed860d3c859d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.249+0000 7f9441ffb640 1 -- 172.21.15.93:0/2322740605 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943402cb40 con 0x7f9444159e40 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.249+0000 7f9441ffb640 1 -- 172.21.15.93:0/2322740605 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943402cca0 con 0x7f9444159e40 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.249+0000 7f9441ffb640 1 -- 172.21.15.93:0/2322740605 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434034660 con 0x7f9444159e40 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 -- 172.21.15.93:0/2322740605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444159e40 msgr2=0x7f94440b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 --2- 172.21.15.93:0/2322740605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444159e40 0x7f94440b0530 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9434009d90 tx=0x7f943402bd90 comp rx=0 tx=0).stop 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 -- 172.21.15.93:0/2322740605 shutdown_connections 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 --2- 172.21.15.93:0/2322740605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444159e40 0x7f94440b0530 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 -- 172.21.15.93:0/2322740605 >> 172.21.15.93:0/2322740605 conn(0x7f94440cb530 msgr2=0x7f94440cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 -- 172.21.15.93:0/2322740605 shutdown_connections 2023-11-04T01:42:47.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.250+0000 7f9449368640 1 -- 172.21.15.93:0/2322740605 wait complete. 2023-11-04T01:42:47.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.251+0000 7f9449368640 1 Processor -- start 2023-11-04T01:42:47.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.251+0000 7f9449368640 1 -- start start 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 0x7f94440ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9444159e40 0x7f944415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441f1790 con 0x7f9444070700 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440c5d20 con 0x7f944406bb60 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9449368640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440c6000 con 0x7f9444159e40 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55552/0 (socket says 172.21.15.93:55552) 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 -- 172.21.15.93:0/1943156726 learned_addr learned my addr 172.21.15.93:0/1943156726 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9442ffd640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 0x7f94440ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94437fe640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9444159e40 0x7f944415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 -- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9444159e40 msgr2=0x7f944415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9444159e40 0x7f944415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 -- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 msgr2=0x7f94440ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 0x7f94440ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f94427fc640 1 -- 172.21.15.93:0/1943156726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009a70 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.252+0000 7f9442ffd640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 0x7f94440ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f94427fc640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f943800c430 tx=0x7f943800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011790 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380118f0 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440c62e0 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011ce0 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.253+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94441f1e80 con 0x7f9444070700 2023-11-04T01:42:47.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.254+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94440684b0 con 0x7f9444070700 2023-11-04T01:42:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.254+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f943801c460 con 0x7f9444070700 2023-11-04T01:42:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.254+0000 7f942b7fe640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 0x7f943006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.254+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f9438089dd0 con 0x7f9444070700 2023-11-04T01:42:47.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.255+0000 7f9442ffd640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 0x7f943006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.255+0000 7f9442ffd640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 0x7f943006d360 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f9434030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.259+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9438054650 con 0x7f9444070700 2023-11-04T01:42:47.492 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:47.490+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f94440c9750 con 0x7f9444070700 2023-11-04T01:42:48.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.149+0000 7f942b7fe640 1 -- 172.21.15.93:0/1943156726 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.6272 v106) v1 ==== 112+0+0 (secure 0 0 0) 0x7f943808b020 con 0x7f9444070700 2023-11-04T01:42:48.151 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.6272 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 msgr2=0x7f943006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 0x7f943006d360 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f9434030000 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 msgr2=0x7f94441f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f943800c430 tx=0x7f943800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 shutdown_connections 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f943006aea0 0x7f943006d360 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f9444159e40 0x7f944415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9444070700 0x7f94441f1940 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 --2- 172.21.15.93:0/1943156726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f944406bb60 0x7f94440ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 >> 172.21.15.93:0/1943156726 conn(0x7f94440cb530 msgr2=0x7f9444159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 shutdown_connections 2023-11-04T01:42:48.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.151+0000 7f9449368640 1 -- 172.21.15.93:0/1943156726 wait complete. 2023-11-04T01:42:48.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:42:48.286 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:42:48.287 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:42:48.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.287 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:42:48.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:42:48.417 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:42:48.417 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:42:48.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.514+0000 7ff437dce640 1 Processor -- start 2023-11-04T01:42:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.514+0000 7ff437dce640 1 -- start start 2023-11-04T01:42:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff437dce640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4300cc680 0x7ff4300cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff437dce640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300cd720 con 0x7ff4300addd0 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff437dce640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300ae1b0 con 0x7ff43006c220 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff437dce640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300ccb10 con 0x7ff4300cc680 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4300cc680 0x7ff4300cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4300cc680 0x7ff4300cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55566/0 (socket says 172.21.15.93:55566) 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435b6a640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff4300addd0 0x7ff43006bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40742/0 (socket says 172.21.15.93:40742) 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 -- 172.21.15.93:0/2074897837 learned_addr learned my addr 172.21.15.93:0/2074897837 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 -- 172.21.15.93:0/2074897837 >> v1:172.21.15.125:6789/0 conn(0x7ff43006c220 legacy=0x7ff43006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 -- 172.21.15.93:0/2074897837 >> v1:172.21.15.93:6789/0 conn(0x7ff4300addd0 legacy=0x7ff43006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.515+0000 7ff435369640 1 -- 172.21.15.93:0/2074897837 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300ccdf0 con 0x7ff4300cc680 2023-11-04T01:42:48.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.516+0000 7ff435369640 1 --2- 172.21.15.93:0/2074897837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4300cc680 0x7ff4300cdbb0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff42000aa10 tx=0x7ff42002ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833569d7429bef47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.516+0000 7ff434b68640 1 -- 172.21.15.93:0/2074897837 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002dc10 con 0x7ff4300cc680 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.516+0000 7ff434b68640 1 -- 172.21.15.93:0/2074897837 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42002dd70 con 0x7ff4300cc680 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.516+0000 7ff434b68640 1 -- 172.21.15.93:0/2074897837 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420035660 con 0x7ff4300cc680 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 -- 172.21.15.93:0/2074897837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4300cc680 msgr2=0x7ff4300cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 --2- 172.21.15.93:0/2074897837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4300cc680 0x7ff4300cdbb0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff42000aa10 tx=0x7ff42002ce60 comp rx=0 tx=0).stop 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 -- 172.21.15.93:0/2074897837 shutdown_connections 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 --2- 172.21.15.93:0/2074897837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4300cc680 0x7ff4300cdbb0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 -- 172.21.15.93:0/2074897837 >> 172.21.15.93:0/2074897837 conn(0x7ff4300cb530 msgr2=0x7ff4300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 -- 172.21.15.93:0/2074897837 shutdown_connections 2023-11-04T01:42:48.520 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.517+0000 7ff437dce640 1 -- 172.21.15.93:0/2074897837 wait complete. 2023-11-04T01:42:48.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.518+0000 7ff437dce640 1 Processor -- start 2023-11-04T01:42:48.522 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.518+0000 7ff437dce640 1 -- start start 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 0x7ff430151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 0x7ff4301e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301f1210 con 0x7ff4301e2930 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301e2de0 con 0x7ff4300addd0 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff437dce640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff430152530 con 0x7ff43006c220 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:55582/0 (socket says 172.21.15.93:55582) 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 -- 172.21.15.93:0/245952604 learned_addr learned my addr 172.21.15.93:0/245952604 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff435369640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 0x7ff4301e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff435b6a640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 0x7ff430151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 -- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 msgr2=0x7ff430151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 0x7ff430151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.523 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 -- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 msgr2=0x7ff4301e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 0x7ff4301e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 -- 172.21.15.93:0/245952604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42000a670 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff435369640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 0x7ff4301e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff435b6a640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 0x7ff430151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff43636b640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c700 tx=0x7ff42800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.519+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800a9f0 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.520+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800ab50 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.520+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800ce10 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.520+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43015bdb0 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.520+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43015c370 con 0x7ff4301e2930 2023-11-04T01:42:48.524 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.520+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4301f1350 con 0x7ff4301e2930 2023-11-04T01:42:48.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.521+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4280050d0 con 0x7ff4301e2930 2023-11-04T01:42:48.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.521+0000 7ff4267fc640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 0x7ff41406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.521+0000 7ff435b6a640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 0x7ff41406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.521+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7ff428089a10 con 0x7ff4301e2930 2023-11-04T01:42:48.525 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.522+0000 7ff435b6a640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 0x7ff41406d360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.527 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.526+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4301f1350 con 0x7ff4301e2930 2023-11-04T01:42:48.719 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fce5b716640 time 2023-11-04T01:42:48.718735+0000 2023-11-04T01:42:48.719 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce6736efaf] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.720 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7fce5b716640 thread_name:MR_Finisher 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:42:48.718+0000 7fce5b716640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fce5b716640 time 2023-11-04T01:42:48.718735+0000 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce6736efaf] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.721 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fce66a54db0] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fce66aa154c] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce6736f009] 2023-11-04T01:42:48.722 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:42:48.718+0000 7fce5b716640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7fce5b716640 thread_name:MR_Finisher 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fce66a54db0] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fce66aa154c] 2023-11-04T01:42:48.723 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce6736f009] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.724 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: -861> 2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: -859> 2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: -1> 2023-11-04T01:42:48.718+0000 7fce5b716640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fce5b716640 time 2023-11-04T01:42:48.718735+0000 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce6736efaf] 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.725 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 0> 2023-11-04T01:42:48.718+0000 7fce5b716640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7fce5b716640 thread_name:MR_Finisher 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.726 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fce66a54db0] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fce66aa154c] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce6736f009] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.727 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: -864> 2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: -862> 2023-11-04T01:42:39.638+0000 7fce5ef1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr: -4> 2023-11-04T01:42:48.718+0000 7fce5b716640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fce5b716640 time 2023-11-04T01:42:48.718735+0000 2023-11-04T01:42:48.728 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce6736efaf] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: -3> 2023-11-04T01:42:48.718+0000 7fce5b716640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.729 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7fce5b716640 thread_name:MR_Finisher 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fce66a54db0] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fce66aa154c] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce6736f009] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fce6736f16d] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c70cae721b] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c70cb16bcc] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c70cb1fb0c] 2023-11-04T01:42:48.730 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c70cb1fc63] 2023-11-04T01:42:48.731 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fce674164a5] 2023-11-04T01:42:48.731 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fce66a9f802] 2023-11-04T01:42:48.731 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fce66a3f450] 2023-11-04T01:42:48.731 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.731 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:42:48.731 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.727+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4301f1350 con 0x7ff4301e2930 2023-11-04T01:42:48.732 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.727+0000 7ff4267fc640 1 -- 172.21.15.93:0/245952604 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4939 (secure 0 0 0) 0x7ff4301f1350 con 0x7ff4301e2930 2023-11-04T01:42:48.732 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:48.732 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:47.492502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 106 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.729+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 msgr2=0x7ff41406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.729+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 0x7ff41406d360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c007d40 comp rx=0 tx=0).stop 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 msgr2=0x7ff43015b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c700 tx=0x7ff42800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 shutdown_connections 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff41406aea0 0x7ff41406d360 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.733 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4301e2930 0x7ff43015b010 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4300addd0 0x7ff4301e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 --2- 172.21.15.93:0/245952604 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff43006c220 0x7ff430151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 >> 172.21.15.93:0/245952604 conn(0x7ff4300cb530 msgr2=0x7ff4300715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 shutdown_connections 2023-11-04T01:42:48.734 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:48.730+0000 7ff437dce640 1 -- 172.21.15.93:0/245952604 wait complete. 2023-11-04T01:42:48.742 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:48.985 INFO:tasks.ceph.mds.b.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:42:52.628 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:52.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:53.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:42:53.744 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:53.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.859+0000 7fbaca4a9640 1 Processor -- start 2023-11-04T01:42:53.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.859+0000 7fbaca4a9640 1 -- start start 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbaca4a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbac415d110 0x7fbac406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbaca4a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac415d4f0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbaca4a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac406b9f0 con 0x7fbac40b2100 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbaca4a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40664f0 con 0x7fbac415d110 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbac37fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbac40b3ca0 0x7fbac40ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56802/0 (socket says 172.21.15.93:56802) 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbac37fe640 1 -- 172.21.15.93:0/3560507993 learned_addr learned my addr 172.21.15.93:0/3560507993 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbac3fff640 1 --2- 172.21.15.93:0/3560507993 >> v2:172.21.15.125:3300/0 conn(0x7fbac415d110 0x7fbac406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.860+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037618710 0 0) 0x7fbac415d4f0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.861+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaac003520 con 0x7fbac40b3ca0 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.861+0000 7fbac3fff640 1 -- 172.21.15.93:0/3560507993 >> v1:172.21.15.125:6789/0 conn(0x7fbac40b2100 legacy=0x7fbac40b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.861+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266067722 0 0) 0x7fbaac003520 con 0x7fbac40b3ca0 2023-11-04T01:42:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.861+0000 7fbac3fff640 1 -- 172.21.15.93:0/3560507993 >> v1:172.21.15.93:6789/0 conn(0x7fbac40b3ca0 legacy=0x7fbac40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.861+0000 7fbac3fff640 1 -- 172.21.15.93:0/3560507993 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac406c2e0 con 0x7fbac415d110 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbac3fff640 1 --2- 172.21.15.93:0/3560507993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac415d110 0x7fbac406b2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009790 tx=0x7fbab402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db4c153752ff989 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab402f050 con 0x7fbac415d110 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4031500 con 0x7fbac415d110 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbac2ffd640 1 -- 172.21.15.93:0/3560507993 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8001670 con 0x7fbac415d110 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 -- 172.21.15.93:0/3560507993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac415d110 msgr2=0x7fbac406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/3560507993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac415d110 0x7fbac406b2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009790 tx=0x7fbab402b820 comp rx=0 tx=0).stop 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 -- 172.21.15.93:0/3560507993 shutdown_connections 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/3560507993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac415d110 0x7fbac406b2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 -- 172.21.15.93:0/3560507993 >> 172.21.15.93:0/3560507993 conn(0x7fbac40cbd30 msgr2=0x7fbac40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 -- 172.21.15.93:0/3560507993 shutdown_connections 2023-11-04T01:42:53.865 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.862+0000 7fbaca4a9640 1 -- 172.21.15.93:0/3560507993 wait complete. 2023-11-04T01:42:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.864+0000 7fbaca4a9640 1 Processor -- start 2023-11-04T01:42:53.866 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.864+0000 7fbaca4a9640 1 -- start start 2023-11-04T01:42:53.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac40b2100 0x7fbac409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbac415d110 0x7fbac406a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40cfae0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40cd170 con 0x7fbac40b2100 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbaca4a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40cf240 con 0x7fbac415d110 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37610/0 (socket says 172.21.15.93:37610) 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 -- 172.21.15.93:0/1969452041 learned_addr learned my addr 172.21.15.93:0/1969452041 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac3fff640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac40b2100 0x7fbac409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac8a46640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbac415d110 0x7fbac406a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 -- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbac415d110 msgr2=0x7fbac406a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbac415d110 0x7fbac406a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 -- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac40b2100 msgr2=0x7fbac409c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac40b2100 0x7fbac409c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 -- 172.21.15.93:0/1969452041 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40093a0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac37fe640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c750 tx=0x7fbab800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.865+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005ad0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.866+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8005c30 con 0x7fbac40b3ca0 2023-11-04T01:42:53.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.866+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac40cf520 con 0x7fbac40b3ca0 2023-11-04T01:42:53.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.866+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8007070 con 0x7fbac40b3ca0 2023-11-04T01:42:53.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.866+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac406a7f0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.867+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac406aa10 con 0x7fbac40b3ca0 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.867+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbab80071d0 con 0x7fbac40b3ca0 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.868+0000 7fbac0ff9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 0x7fbab006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.868+0000 7fbac3fff640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 0x7fbab006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.868+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fbab8089560 con 0x7fbac40b3ca0 2023-11-04T01:42:53.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.868+0000 7fbac3fff640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 0x7fbab006d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbab4035000 tx=0x7fbab4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:53.872+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbab8053d50 con 0x7fbac40b3ca0 2023-11-04T01:42:54.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.075+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbac40684b0 con 0x7fbac40b3ca0 2023-11-04T01:42:54.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.075+0000 7fbac0ff9640 1 -- 172.21.15.93:0/1969452041 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4939 (secure 0 0 0) 0x7fbab8057370 con 0x7fbac40b3ca0 2023-11-04T01:42:54.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:47.492502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:54.078 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 106 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 msgr2=0x7fbab006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 0x7fbab006d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbab4035000 tx=0x7fbab4008030 comp rx=0 tx=0).stop 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 msgr2=0x7fbac40ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c750 tx=0x7fbab800cc10 comp rx=0 tx=0).stop 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 shutdown_connections 2023-11-04T01:42:54.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbab006ae70 0x7fbab006d330 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbac415d110 0x7fbac406a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbac40b3ca0 0x7fbac40ccc30 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 --2- 172.21.15.93:0/1969452041 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbac40b2100 0x7fbac409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 >> 172.21.15.93:0/1969452041 conn(0x7fbac40cbd30 msgr2=0x7fbac415ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 shutdown_connections 2023-11-04T01:42:54.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:54.078+0000 7fbaca4a9640 1 -- 172.21.15.93:0/1969452041 wait complete. 2023-11-04T01:42:54.091 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:59.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.199+0000 7f51248a9640 1 Processor -- start 2023-11-04T01:42:59.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.199+0000 7f51248a9640 1 -- start start 2023-11-04T01:42:59.204 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.200+0000 7f51248a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5120159e40 0x7f51200b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.200+0000 7f51248a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5120071500 con 0x7f512006bb60 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.200+0000 7f51248a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512015dae0 con 0x7f5120070700 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.200+0000 7f51248a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5120070c60 con 0x7f5120159e40 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511dd9b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f512006bb60 0x7f512006fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:56812/0 (socket says 172.21.15.93:56812) 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511dd9b640 1 -- 172.21.15.93:0/3244077290 learned_addr learned my addr 172.21.15.93:0/3244077290 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511e59c640 1 --2- 172.21.15.93:0/3244077290 >> v2:172.21.15.125:3300/0 conn(0x7f5120159e40 0x7f51200b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011954695 0 0) 0x7f5120071500 con 0x7f512006bb60 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003420 con 0x7f512006bb60 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4081519161 0 0) 0x7f5108003420 con 0x7f512006bb60 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 >> v2:172.21.15.125:3300/0 conn(0x7f5120159e40 msgr2=0x7f51200b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 --2- 172.21.15.93:0/3244077290 >> v2:172.21.15.125:3300/0 conn(0x7f5120159e40 0x7f51200b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 >> v1:172.21.15.125:6789/0 conn(0x7f5120070700 legacy=0x7f51200cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120070f40 con 0x7f512006bb60 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5110001670 con 0x7f512006bb60 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 >> v1:172.21.15.93:6789/0 conn(0x7f512006bb60 legacy=0x7f512006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5108004a50 0x7f5108004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5108003660 0x7f5108003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f510800ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5120070c60 con 0x7f510800db60 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108010570 con 0x7f5108003660 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5108010730 con 0x7f5108004a50 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511ed9d640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f510800ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511dd9b640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5108003660 0x7f5108003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.201+0000 7f511e59c640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5108004a50 0x7f5108004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 -- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5108004a50 msgr2=0x7f5108004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5108004a50 0x7f5108004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 -- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5108003660 msgr2=0x7f5108003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5108003660 0x7f5108003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 -- 172.21.15.93:0/3244077290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108003420 con 0x7f510800db60 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 -- 172.21.15.93:0/3244077290 reap_dead start 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.202+0000 7f511ed9d640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f510800ff50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f5118001e50 tx=0x7f51080046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c633fd6565b549fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118003b70 con 0x7f510800db60 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118003d10 con 0x7f510800db60 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f511d59a640 1 -- 172.21.15.93:0/3244077290 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118005310 con 0x7f510800db60 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 -- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 msgr2=0x7f510800ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f510800ff50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f5118001e50 tx=0x7f51080046e0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 -- 172.21.15.93:0/3244077290 shutdown_connections 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 --2- 172.21.15.93:0/3244077290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f510800ff50 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 -- 172.21.15.93:0/3244077290 >> 172.21.15.93:0/3244077290 conn(0x7f51200cb530 msgr2=0x7f51200cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 -- 172.21.15.93:0/3244077290 shutdown_connections 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.203+0000 7f51248a9640 1 -- 172.21.15.93:0/3244077290 wait complete. 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 Processor -- start 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 -- start start 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512015af60 0x7f5120157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512015c860 0x7f512015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512015bd30 con 0x7f510800db60 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512015d220 con 0x7f512015af60 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f51248a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512015b490 con 0x7f512015c860 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f511e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f511e59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:37620/0 (socket says 172.21.15.93:37620) 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.205+0000 7f511e59c640 1 -- 172.21.15.93:0/1961981775 learned_addr learned my addr 172.21.15.93:0/1961981775 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511ed9d640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512015c860 0x7f512015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511dd9b640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512015af60 0x7f5120157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 -- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512015c860 msgr2=0x7f512015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512015c860 0x7f512015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 -- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512015af60 msgr2=0x7f5120157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512015af60 0x7f5120157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 -- 172.21.15.93:0/1961981775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512015b770 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f511e59c640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f51140118e0 tx=0x7f5114011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400fa90 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511400fbf0 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114014440 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512015ba50 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.206+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51201564e0 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.207+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51200c3e80 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.208+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51140145a0 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.208+0000 7f510effd640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 0x7f510006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.208+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f511408a680 con 0x7f510800db60 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.208+0000 7f511dd9b640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 0x7f510006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.208+0000 7f511dd9b640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 0x7f510006d360 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5120158710 tx=0x7f5110009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.212+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5114054f00 con 0x7f510800db60 2023-11-04T01:42:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.414+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51200684b0 con 0x7f510800db60 2023-11-04T01:42:59.417 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.415+0000 7f510effd640 1 -- 172.21.15.93:0/1961981775 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4939 (secure 0 0 0) 0x7f5114058520 con 0x7f510800db60 2023-11-04T01:42:59.417 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:42:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:42:47.492502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:59.418 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 106 2023-11-04T01:42:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 msgr2=0x7f510006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 0x7f510006d360 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5120158710 tx=0x7f5110009040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.419 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 msgr2=0x7f5120155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f51140118e0 tx=0x7f5114011da0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 shutdown_connections 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f510006aea0 0x7f510006d360 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f512015c860 0x7f512015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f512015af60 0x7f5120157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 --2- 172.21.15.93:0/1961981775 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f510800db60 0x7f5120155fa0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 >> 172.21.15.93:0/1961981775 conn(0x7f51200cb530 msgr2=0x7f51200cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 shutdown_connections 2023-11-04T01:42:59.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:42:59.417+0000 7f51248a9640 1 -- 172.21.15.93:0/1961981775 wait complete. 2023-11-04T01:42:59.430 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:59.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:43:04.431 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.538+0000 7fb47eea9640 1 Processor -- start 2023-11-04T01:43:04.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.538+0000 7fb47eea9640 1 -- start start 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.539+0000 7fb47eea9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.539+0000 7fb47eea9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb4780ced90 0x7fb4780ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.539+0000 7fb47eea9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780b25a0 con 0x7fb4780ca6e0 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.539+0000 7fb47eea9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780cab70 con 0x7fb4780ced90 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.539+0000 7fb47eea9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780b2300 con 0x7fb47815d4e0 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb4780ced90 0x7fb4780ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb47cc45640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb47d446640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb4780ca6e0 0x7fb478160fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:54138/0 (socket says 172.21.15.93:54138) 2023-11-04T01:43:04.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb47cc45640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:38180/0 (socket says 172.21.15.93:38180) 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb4780ced90 0x7fb4780ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:38960/0 (socket says 172.21.15.93:38960) 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb47d446640 1 -- 172.21.15.93:0/237988078 learned_addr learned my addr 172.21.15.93:0/237988078 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 -- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 msgr2=0x7fb4780ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 -- 172.21.15.93:0/237988078 >> v1:172.21.15.125:6789/0 conn(0x7fb4780ca6e0 legacy=0x7fb478160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb477fff640 1 -- 172.21.15.93:0/237988078 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47815d8c0 con 0x7fb4780ced90 2023-11-04T01:43:04.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.540+0000 7fb47cc45640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.541+0000 7fb477fff640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4780ca1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0097a0 tx=0x7fb46c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd3424ec604e5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.541+0000 7fb4777fe640 1 -- 172.21.15.93:0/237988078 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c031830 con 0x7fb4780ced90 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.541+0000 7fb4777fe640 1 -- 172.21.15.93:0/237988078 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c031990 con 0x7fb4780ced90 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.541+0000 7fb4777fe640 1 -- 172.21.15.93:0/237988078 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c031d20 con 0x7fb4780ced90 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 -- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 msgr2=0x7fb4780ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.544 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4780ca1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0097a0 tx=0x7fb46c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 -- 172.21.15.93:0/237988078 shutdown_connections 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4780ca1a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 --2- 172.21.15.93:0/237988078 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb47815d4e0 0x7fb4780ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 -- 172.21.15.93:0/237988078 >> 172.21.15.93:0/237988078 conn(0x7fb4780b1640 msgr2=0x7fb4780b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 -- 172.21.15.93:0/237988078 shutdown_connections 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.542+0000 7fb47eea9640 1 -- 172.21.15.93:0/237988078 wait complete. 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.543+0000 7fb47eea9640 1 Processor -- start 2023-11-04T01:43:04.545 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.543+0000 7fb47eea9640 1 -- start start 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4780ca6e0 0x7fb47806df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4781f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47806cee0 con 0x7fb47815d4e0 2023-11-04T01:43:04.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47806d1c0 con 0x7fb4780ced90 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47eea9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47806d4a0 con 0x7fb4780ca6e0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45836/0 (socket says 172.21.15.93:45836) 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 -- 172.21.15.93:0/1288836744 learned_addr learned my addr 172.21.15.93:0/1288836744 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb477fff640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4781f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47cc45640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4780ca6e0 0x7fb47806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 -- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4780ca6e0 msgr2=0x7fb47806df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4780ca6e0 0x7fb47806df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 -- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 msgr2=0x7fb4781f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4781f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.544+0000 7fb47d446640 1 -- 172.21.15.93:0/1288836744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009400 con 0x7fb47815d4e0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb47d446640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fb47000cbc0 tx=0x7fb47000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000ad40 con 0x7fb47815d4e0 2023-11-04T01:43:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470012400 con 0x7fb47815d4e0 2023-11-04T01:43:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c009400 con 0x7fb47815d4e0 2023-11-04T01:43:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000aea0 con 0x7fb47815d4e0 2023-11-04T01:43:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.545+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47806da60 con 0x7fb47815d4e0 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.546+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47806dc50 con 0x7fb47815d4e0 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.546+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb470007070 con 0x7fb47815d4e0 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.547+0000 7fb4757fa640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.547+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fb470089db0 con 0x7fb47815d4e0 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.547+0000 7fb47cc45640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.548+0000 7fb47cc45640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb468009c30 tx=0x7fb468009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.552+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb470054650 con 0x7fb47815d4e0 2023-11-04T01:43:04.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.754+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4780684b0 con 0x7fb47815d4e0 2023-11-04T01:43:04.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.754+0000 7fb4757fa640 1 -- 172.21.15.93:0/1288836744 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4987 (secure 0 0 0) 0x7fb470017070 con 0x7fb47815d4e0 2023-11-04T01:43:04.757 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:04.757 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:02.087422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:02.087422+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:04.757 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 107 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 msgr2=0x7fb46406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb468009c30 tx=0x7fb468009190 comp rx=0 tx=0).stop 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 msgr2=0x7fb4781f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fb47000cbc0 tx=0x7fb47000a430 comp rx=0 tx=0).stop 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 shutdown_connections 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb47815d4e0 0x7fb4781f4be0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4780ced90 0x7fb4781f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 --2- 172.21.15.93:0/1288836744 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fb4780ca6e0 0x7fb47806df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 >> 172.21.15.93:0/1288836744 conn(0x7fb4780b1640 msgr2=0x7fb4781551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 shutdown_connections 2023-11-04T01:43:04.760 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:04.757+0000 7fb47eea9640 1 -- 172.21.15.93:0/1288836744 wait complete. 2023-11-04T01:43:04.770 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:43:04.770 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:43:04.800 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:43:04.801 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:43:04.801 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:43:04.874 INFO:teuthology.orchestra.run.smithi125.stdout:1699062168.96230.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:43:04.876 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062168.96230.core'] 2023-11-04T01:43:04.877 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062168.96230.core, deleting it 2023-11-04T01:43:04.877 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062168.96230.core 2023-11-04T01:43:04.950 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:05.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.046+0000 7f8fa1cb4640 1 Processor -- start 2023-11-04T01:43:05.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8fa1cb4640 1 -- start start 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8fa1cb4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8f9c15d100 0x7f8f9c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8fa1cb4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0b32b0 con 0x7f8f9c15d4e0 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8fa1cb4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0cee10 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8fa1cb4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b2980 con 0x7f8f9c15d100 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8f9b7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8f9c15d100 0x7f8f9c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.047+0000 7f8f9affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8f9c15d4e0 0x7f8f9c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:54008/0 (socket says 172.21.15.93:54008) 2023-11-04T01:43:05.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.048+0000 7f8f9affd640 1 -- 172.21.15.93:0/3656236018 learned_addr learned my addr 172.21.15.93:0/3656236018 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:05.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.048+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/3656236018 >> v1:172.21.15.125:6789/0 conn(0x7f8f9c0d1be0 legacy=0x7f8f9c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.048+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/3656236018 >> v1:172.21.15.93:6789/0 conn(0x7f8f9c15d4e0 legacy=0x7f8f9c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.048+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/3656236018 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0b2c60 con 0x7f8f9c15d100 2023-11-04T01:43:05.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.048+0000 7f8f9b7fe640 1 --2- 172.21.15.93:0/3656236018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c15d100 0x7f8f9c0ce510 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009790 tx=0x7f8f8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b496b56554d50b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8f9a7fc640 1 -- 172.21.15.93:0/3656236018 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c031830 con 0x7f8f9c15d100 2023-11-04T01:43:05.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8f9a7fc640 1 -- 172.21.15.93:0/3656236018 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c031990 con 0x7f8f9c15d100 2023-11-04T01:43:05.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8f9a7fc640 1 -- 172.21.15.93:0/3656236018 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c031d20 con 0x7f8f9c15d100 2023-11-04T01:43:05.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/3656236018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c15d100 msgr2=0x7f8f9c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/3656236018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c15d100 0x7f8f9c0ce510 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009790 tx=0x7f8f8c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/3656236018 shutdown_connections 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/3656236018 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c15d100 0x7f8f9c0ce510 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/3656236018 >> 172.21.15.93:0/3656236018 conn(0x7f8f9c0d2ef0 msgr2=0x7f8f9c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/3656236018 shutdown_connections 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.049+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/3656236018 wait complete. 2023-11-04T01:43:05.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.050+0000 7f8fa1cb4640 1 Processor -- start 2023-11-04T01:43:05.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 -- start start 2023-11-04T01:43:05.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 0x7f8f9c0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f9c15d4e0 0x7f8f9c09e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0cbe70 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c15c780 con 0x7f8f9c15d4e0 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8fa1cb4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0cb1f0 con 0x7f8f9c15d100 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45858/0 (socket says 172.21.15.93:45858) 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/766936704 learned_addr learned my addr 172.21.15.93:0/766936704 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8f9bfff640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f9c15d4e0 0x7f8f9c09e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.051+0000 7f8f9affd640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 0x7f8f9c0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 msgr2=0x7f8f9c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 0x7f8f9c0ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f9c15d4e0 msgr2=0x7f8f9c09e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f9c15d4e0 0x7f8f9c09e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 -- 172.21.15.93:0/766936704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c0093a0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9affd640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 0x7f8f9c0ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f9b7fe640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c02bee0 tx=0x7f8f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c03ba70 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c03bbd0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0453f0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c0cb4d0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.052+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c0cba90 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.053+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c0684b0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.054+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f8c045550 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.054+0000 7f8f83fff640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.054+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f8f8c0ac220 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.054+0000 7f8f9affd640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.054+0000 7f8f9affd640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0d3c60 tx=0x7f8f90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.060 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.058+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f8c076be0 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.257+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f9c0b4d00 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.258+0000 7f8f83fff640 1 -- 172.21.15.93:0/766936704 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4987 (secure 0 0 0) 0x7f8f8c07a200 con 0x7f8f9c0d1be0 2023-11-04T01:43:05.260 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:05.260 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:02.087422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6164,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6164":{"gid":6164,"name":"b","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.125:6835/3282724716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6833","nonce":3282724716},{"type":"v1","addr":"172.21.15.125:6835","nonce":3282724716}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:02.087422+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:05.260 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 107 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.259+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 msgr2=0x7f8f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0d3c60 tx=0x7f8f90009040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 msgr2=0x7f8f9c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c02bee0 tx=0x7f8f8c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 shutdown_connections 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f9c15d4e0 0x7f8f9c09e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f8f9c15d100 0x7f8f9c0ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 --2- 172.21.15.93:0/766936704 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f9c0d1be0 0x7f8f9c153260 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 >> 172.21.15.93:0/766936704 conn(0x7f8f9c0d2ef0 msgr2=0x7f8f9c0b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 shutdown_connections 2023-11-04T01:43:05.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.260+0000 7f8fa1cb4640 1 -- 172.21.15.93:0/766936704 wait complete. 2023-11-04T01:43:05.272 INFO:tasks.ceph.mds.d:Sent signal 9 2023-11-04T01:43:05.273 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:05.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:05.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 down 2023-11-04T01:43:05.300 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:43:05.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 Processor -- start 2023-11-04T01:43:05.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 -- start start 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff7380ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff73815d4e0 0x7ff7380d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7380d3b60 0x7ff7380d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380b32b0 con 0x7ff7380d3b60 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380cee10 con 0x7ff73815d4e0 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73ef16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b2980 con 0x7ff73815d100 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.439+0000 7ff73d4b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7380d3b60 0x7ff7380d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7380d3b60 0x7ff7380d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45866/0 (socket says 172.21.15.93:45866) 2023-11-04T01:43:05.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 -- 172.21.15.93:0/2961369979 learned_addr learned my addr 172.21.15.93:0/2961369979 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 -- 172.21.15.93:0/2961369979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 msgr2=0x7ff7380ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/2961369979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff7380ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 -- 172.21.15.93:0/2961369979 >> v2:172.21.15.125:3300/0 conn(0x7ff73815d4e0 msgr2=0x7ff7380d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff737fff640 1 --2- 172.21.15.93:0/2961369979 >> v2:172.21.15.125:3300/0 conn(0x7ff73815d4e0 0x7ff7380d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/2961369979 >> v2:172.21.15.125:3300/0 conn(0x7ff73815d4e0 0x7ff7380d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 -- 172.21.15.93:0/2961369979 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380b2c60 con 0x7ff7380d3b60 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.440+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/2961369979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7380d3b60 0x7ff7380d1a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff73808bf20 tx=0x7ff73002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b2d1471ccb903f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff7377fe640 1 -- 172.21.15.93:0/2961369979 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73002ca70 con 0x7ff7380d3b60 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff7377fe640 1 -- 172.21.15.93:0/2961369979 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73002cbd0 con 0x7ff7380d3b60 2023-11-04T01:43:05.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff7377fe640 1 -- 172.21.15.93:0/2961369979 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300343f0 con 0x7ff7380d3b60 2023-11-04T01:43:05.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 -- 172.21.15.93:0/2961369979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7380d3b60 msgr2=0x7ff7380d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 --2- 172.21.15.93:0/2961369979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7380d3b60 0x7ff7380d1a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff73808bf20 tx=0x7ff73002bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 -- 172.21.15.93:0/2961369979 shutdown_connections 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 --2- 172.21.15.93:0/2961369979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7380d3b60 0x7ff7380d1a10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 --2- 172.21.15.93:0/2961369979 >> v2:172.21.15.125:3300/0 conn(0x7ff73815d4e0 0x7ff7380d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 --2- 172.21.15.93:0/2961369979 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff7380ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 -- 172.21.15.93:0/2961369979 >> 172.21.15.93:0/2961369979 conn(0x7ff7380d2ef0 msgr2=0x7ff7380d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 -- 172.21.15.93:0/2961369979 shutdown_connections 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.441+0000 7ff73ef16640 1 -- 172.21.15.93:0/2961369979 wait complete. 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.442+0000 7ff73ef16640 1 Processor -- start 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.442+0000 7ff73ef16640 1 -- start start 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 0x7ff73809d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff73809fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814c0b0 con 0x7ff73815d4e0 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814c390 con 0x7ff7380d3b60 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ef16640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814c670 con 0x7ff73815d100 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73d4b3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73d4b3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45870/0 (socket says 172.21.15.93:45870) 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73d4b3640 1 -- 172.21.15.93:0/163533467 learned_addr learned my addr 172.21.15.93:0/163533467 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff737fff640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff73809fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.443+0000 7ff73ccb2640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 0x7ff73809d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 -- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 msgr2=0x7ff73809fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff73809fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 -- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 msgr2=0x7ff73809d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 0x7ff73809d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 -- 172.21.15.93:0/163533467 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009b30 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73ccb2640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 0x7ff73809d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff737fff640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff73809fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73d4b3640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff730036040 tx=0x7ff730004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73003e450 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73003e5d0 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73814c950 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73003e980 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.444+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73814d150 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.445+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73814ce70 con 0x7ff73815d4e0 2023-11-04T01:43:05.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.445+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff73003eae0 con 0x7ff73815d4e0 2023-11-04T01:43:05.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.445+0000 7ff7357fa640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.446+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7952+0+0 (secure 0 0 0) 0x7ff7300ace40 con 0x7ff73815d4e0 2023-11-04T01:43:05.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.446+0000 7ff73ccb2640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.446+0000 7ff73ccb2640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 0x7ff71c06d330 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff72c006fd0 tx=0x7ff72c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.450+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff73814ce70 con 0x7ff73815d4e0 2023-11-04T01:43:05.474 INFO:tasks.ceph.mds.d.smithi125.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:43:05.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.687+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7ff73814ce70 con 0x7ff73815d4e0 2023-11-04T01:43:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.689+0000 7ff7357fa640 1 -- 172.21.15.93:0/163533467 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6164 v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff73814ce70 con 0x7ff73815d4e0 2023-11-04T01:43:05.691 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 6164 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.691+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 msgr2=0x7ff71c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 0x7ff71c06d330 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff72c006fd0 tx=0x7ff72c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 msgr2=0x7ff7380a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff730036040 tx=0x7ff730004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 shutdown_connections 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff73815d4e0 0x7ff7380a0320 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff73815d100 0x7ff73809fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 --2- 172.21.15.93:0/163533467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7380d3b60 0x7ff73809d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 >> 172.21.15.93:0/163533467 conn(0x7ff7380d2ef0 msgr2=0x7ff7380b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 shutdown_connections 2023-11-04T01:43:05.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.692+0000 7ff73ef16640 1 -- 172.21.15.93:0/163533467 wait complete. 2023-11-04T01:43:05.707 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:43:05.707 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:43:05.707 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:43:05.707 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:05.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:05.707 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:43:05.708 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:43:05.708 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:43:05.710 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:43:05.711 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:05.789 INFO:tasks.ceph.mds.b.smithi125.stdout:starting mds.b at 2023-11-04T01:43:05.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.807+0000 7f4204ec9640 1 Processor -- start 2023-11-04T01:43:05.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.807+0000 7f4204ec9640 1 -- start start 2023-11-04T01:43:05.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.808+0000 7f4204ec9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42000b2210 0x7f42000cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.808+0000 7f4204ec9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f420015d630 0x7f42000cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.808+0000 7f4204ec9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000b0150 con 0x7f42000ceda0 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.808+0000 7f4204ec9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42000b1df0 con 0x7f42000b2210 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.808+0000 7f4204ec9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000b1170 con 0x7f420015d630 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fed9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f420015d630 0x7f42000cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fe59c640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f42000ceda0 0x7f420015cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:54150/0 (socket says 172.21.15.93:54150) 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fe59c640 1 -- 172.21.15.93:0/1709934984 learned_addr learned my addr 172.21.15.93:0/1709934984 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/1709934984 >> v2:172.21.15.125:3300/0 conn(0x7f42000b2210 0x7f42000cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fd59a640 1 -- 172.21.15.93:0/1709934984 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067132173 0 0) 0x7f42000b0150 con 0x7f42000ceda0 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fd59a640 1 -- 172.21.15.93:0/1709934984 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e8003520 con 0x7f42000ceda0 2023-11-04T01:43:05.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fdd9b640 1 -- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f420015d630 msgr2=0x7f42000cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f420015d630 0x7f42000cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fdd9b640 1 -- 172.21.15.93:0/1709934984 >> v1:172.21.15.125:6789/0 conn(0x7f42000ceda0 legacy=0x7f420015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.809+0000 7f41fdd9b640 1 -- 172.21.15.93:0/1709934984 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000b1450 con 0x7f42000b2210 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42000b2210 0x7f42000cf180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6afc931bac4b4e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f41fd59a640 1 -- 172.21.15.93:0/1709934984 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f402cbc0 con 0x7f42000b2210 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f41fd59a640 1 -- 172.21.15.93:0/1709934984 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f402cd20 con 0x7f42000b2210 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f41fd59a640 1 -- 172.21.15.93:0/1709934984 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4034660 con 0x7f42000b2210 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 -- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42000b2210 msgr2=0x7f42000cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.818 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 --2- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42000b2210 0x7f42000cf180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f402be10 comp rx=0 tx=0).stop 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 -- 172.21.15.93:0/1709934984 shutdown_connections 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 --2- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f420015d630 0x7f42000cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 --2- 172.21.15.93:0/1709934984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42000b2210 0x7f42000cf180 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 -- 172.21.15.93:0/1709934984 >> 172.21.15.93:0/1709934984 conn(0x7f42000d0c30 msgr2=0x7f42000d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.810+0000 7f4204ec9640 1 -- 172.21.15.93:0/1709934984 shutdown_connections 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.811+0000 7f4204ec9640 1 -- 172.21.15.93:0/1709934984 wait complete. 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 Processor -- start 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 -- start start 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 0x7f42000b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f420015d630 0x7f42000b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.819 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000cc620 con 0x7f42000b2210 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000b6270 con 0x7f420015d630 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.812+0000 7f4204ec9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000b6550 con 0x7f42000ceda0 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45872/0 (socket says 172.21.15.93:45872) 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 -- 172.21.15.93:0/3640005829 learned_addr learned my addr 172.21.15.93:0/3640005829 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 0x7f42000b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fed9d640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f420015d630 0x7f42000b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 -- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 msgr2=0x7f42000b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 0x7f42000b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.820 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 -- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f420015d630 msgr2=0x7f42000b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f420015d630 0x7f42000b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 -- 172.21.15.93:0/3640005829 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009a70 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 0x7f42000b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41fe59c640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f41f80058d0 tx=0x7f41f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8005d30 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8005e90 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000cc870 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8007310 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.813+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42001f27b0 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.814+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000ccd90 con 0x7f42000b2210 2023-11-04T01:43:05.821 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.815+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f8007470 con 0x7f42000b2210 2023-11-04T01:43:05.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.815+0000 7f41eeffd640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.815+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f41f8089590 con 0x7f42000b2210 2023-11-04T01:43:05.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.815+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.815+0000 7f41fdd9b640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 0x7f41e006d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f41f4036000 tx=0x7f41f4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.822 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:05.819+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42000ccd90 con 0x7f42000b2210 2023-11-04T01:43:06.022 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.020+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42000ccd90 con 0x7f42000b2210 2023-11-04T01:43:06.023 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.020+0000 7f41eeffd640 1 -- 172.21.15.93:0/3640005829 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4144 (secure 0 0 0) 0x7f41f8017020 con 0x7f42000b2210 2023-11-04T01:43:06.023 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:06.023 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:05.696967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:06.023 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 109 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 msgr2=0x7f41e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 0x7f41e006d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f41f4036000 tx=0x7f41f4030000 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 msgr2=0x7f42001f2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f41f80058d0 tx=0x7f41f800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 shutdown_connections 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f420015d630 0x7f42000b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42000ceda0 0x7f42000b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 --2- 172.21.15.93:0/3640005829 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42000b2210 0x7f42001f2270 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 >> 172.21.15.93:0/3640005829 conn(0x7f42000d0c30 msgr2=0x7f42000ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.025 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 shutdown_connections 2023-11-04T01:43:06.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:06.022+0000 7f4204ec9640 1 -- 172.21.15.93:0/3640005829 wait complete. 2023-11-04T01:43:06.035 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:06.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:43:06.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:43:11.036 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:11.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 Processor -- start 2023-11-04T01:43:11.148 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 -- start start 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc96815d100 0x7fc9680ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc96815d4e0 0x7fc9680d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9680d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680b32b0 con 0x7fc96815d100 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680cee10 con 0x7fc96815d4e0 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.147+0000 7fc96d6c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680b2980 con 0x7fc9680d3b60 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc96815d100 0x7fc9680ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc96815d100 0x7fc9680ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45882/0 (socket says 172.21.15.93:45882) 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 -- 172.21.15.93:0/2280289553 learned_addr learned my addr 172.21.15.93:0/2280289553 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc9677fe640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9680d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 -- 172.21.15.93:0/2280289553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 msgr2=0x7fc9680d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc9667fc640 1 --2- 172.21.15.93:0/2280289553 >> v2:172.21.15.125:3300/0 conn(0x7fc96815d4e0 0x7fc9680d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9680d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 -- 172.21.15.93:0/2280289553 >> v2:172.21.15.125:3300/0 conn(0x7fc96815d4e0 msgr2=0x7fc9680d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 --2- 172.21.15.93:0/2280289553 >> v2:172.21.15.125:3300/0 conn(0x7fc96815d4e0 0x7fc9680d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.148+0000 7fc966ffd640 1 -- 172.21.15.93:0/2280289553 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680b2c60 con 0x7fc96815d100 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc966ffd640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d100 0x7fc9680ce510 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc968160da0 tx=0x7fc96002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa1e80c7ec58e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc965ffb640 1 -- 172.21.15.93:0/2280289553 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960004230 con 0x7fc96815d100 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc965ffb640 1 -- 172.21.15.93:0/2280289553 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960004390 con 0x7fc96815d100 2023-11-04T01:43:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc965ffb640 1 -- 172.21.15.93:0/2280289553 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960003810 con 0x7fc96815d100 2023-11-04T01:43:11.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 -- 172.21.15.93:0/2280289553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d100 msgr2=0x7fc9680ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d100 0x7fc9680ce510 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc968160da0 tx=0x7fc96002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 -- 172.21.15.93:0/2280289553 shutdown_connections 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9680d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/2280289553 >> v2:172.21.15.125:3300/0 conn(0x7fc96815d4e0 0x7fc9680d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/2280289553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d100 0x7fc9680ce510 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 -- 172.21.15.93:0/2280289553 >> 172.21.15.93:0/2280289553 conn(0x7fc9680d2ef0 msgr2=0x7fc9680d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 -- 172.21.15.93:0/2280289553 shutdown_connections 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.149+0000 7fc96d6c2640 1 -- 172.21.15.93:0/2280289553 wait complete. 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 Processor -- start 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 -- start start 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9681f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96815d100 0x7fc96806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680cc040 con 0x7fc96815d4e0 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680b6740 con 0x7fc96815d100 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.151+0000 7fc96d6c2640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680b6a20 con 0x7fc9680d3b60 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:45890/0 (socket says 172.21.15.93:45890) 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 -- 172.21.15.93:0/173677213 learned_addr learned my addr 172.21.15.93:0/173677213 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc966ffd640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9681f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9667fc640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96815d100 0x7fc96806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 -- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 msgr2=0x7fc9681f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9681f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 -- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96815d100 msgr2=0x7fc96806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96815d100 0x7fc96806b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 -- 172.21.15.93:0/173677213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009460 con 0x7fc96815d4e0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc9677fe640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c4a0 tx=0x7fc95800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004220 con 0x7fc96815d4e0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958004380 con 0x7fc96815d4e0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9680b6d00 con 0x7fc96815d4e0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958003830 con 0x7fc96815d4e0 2023-11-04T01:43:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.152+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96806b620 con 0x7fc96815d4e0 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.153+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9680b6f20 con 0x7fc96815d4e0 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.154+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc958003990 con 0x7fc96815d4e0 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.154+0000 7fc94f7fe640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.154+0000 7fc966ffd640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.154+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7fc958089b80 con 0x7fc96815d4e0 2023-11-04T01:43:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.155+0000 7fc966ffd640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc960035000 tx=0x7fc960008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.158+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc958054310 con 0x7fc96815d4e0 2023-11-04T01:43:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.359+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9680684b0 con 0x7fc96815d4e0 2023-11-04T01:43:11.360 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.359+0000 7fc94f7fe640 1 -- 172.21.15.93:0/173677213 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4938 (secure 0 0 0) 0x7fc958015020 con 0x7fc96815d4e0 2023-11-04T01:43:11.361 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:11.361 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6380,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:05.708257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:11.361 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 110 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 msgr2=0x7fc95406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc960035000 tx=0x7fc960008030 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 msgr2=0x7fc9680cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c4a0 tx=0x7fc95800c960 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 shutdown_connections 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc96815d4e0 0x7fc9680cb4e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc96815d100 0x7fc96806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 --2- 172.21.15.93:0/173677213 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc9680d3b60 0x7fc9681f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 >> 172.21.15.93:0/173677213 conn(0x7fc9680d2ef0 msgr2=0x7fc9680b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.363 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 shutdown_connections 2023-11-04T01:43:11.364 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.361+0000 7fc96d6c2640 1 -- 172.21.15.93:0/173677213 wait complete. 2023-11-04T01:43:11.373 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:11.373 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:11.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.471+0000 7f44cd597640 1 Processor -- start 2023-11-04T01:43:11.472 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.471+0000 7f44cd597640 1 -- start start 2023-11-04T01:43:11.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44cd597640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f44c806d9c0 0x7f44c80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44cd597640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 0x7f44c8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.473 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44cd597640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c806cc90 con 0x7f44c80ade00 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44cd597640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c80b0c40 con 0x7f44c806d9c0 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44cd597640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8071b50 con 0x7f44c806c5f0 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f44c806d9c0 0x7f44c80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44c6ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f44c80ade00 0x7f44c80b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55712/0 (socket says 172.21.15.93:55712) 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f44c806d9c0 0x7f44c80710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42740/0 (socket says 172.21.15.93:42740) 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44c6ffd640 1 -- 172.21.15.93:0/3319364611 learned_addr learned my addr 172.21.15.93:0/3319364611 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44c77fe640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 0x7f44c8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 -- 172.21.15.93:0/3319364611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 msgr2=0x7f44c8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 0x7f44c8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 -- 172.21.15.93:0/3319364611 >> v1:172.21.15.93:6789/0 conn(0x7f44c80ade00 legacy=0x7f44c80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44bffff640 1 -- 172.21.15.93:0/3319364611 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80b0e60 con 0x7f44c806d9c0 2023-11-04T01:43:11.474 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44c67fc640 1 -- 172.21.15.93:0/3319364611 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421586631 0 0) 0x7f44c806cc90 con 0x7f44c80ade00 2023-11-04T01:43:11.475 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.472+0000 7f44c77fe640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 0x7f44c8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44bffff640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c806d9c0 0x7f44c80710d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f44b00097a0 tx=0x7f44b002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720cba457b32626 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44c67fc640 1 -- 172.21.15.93:0/3319364611 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b002f050 con 0x7f44c806d9c0 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44c67fc640 1 -- 172.21.15.93:0/3319364611 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0031700 con 0x7f44c806d9c0 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44c67fc640 1 -- 172.21.15.93:0/3319364611 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0031a90 con 0x7f44c806d9c0 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44cd597640 1 -- 172.21.15.93:0/3319364611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c806d9c0 msgr2=0x7f44c80710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.473+0000 7f44cd597640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c806d9c0 0x7f44c80710d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f44b00097a0 tx=0x7f44b002b7a0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 -- 172.21.15.93:0/3319364611 shutdown_connections 2023-11-04T01:43:11.476 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806c5f0 0x7f44c8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 --2- 172.21.15.93:0/3319364611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c806d9c0 0x7f44c80710d0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 -- 172.21.15.93:0/3319364611 >> 172.21.15.93:0/3319364611 conn(0x7f44c80cb530 msgr2=0x7f44c80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 -- 172.21.15.93:0/3319364611 shutdown_connections 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.474+0000 7f44cd597640 1 -- 172.21.15.93:0/3319364611 wait complete. 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 Processor -- start 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 -- start start 2023-11-04T01:43:11.479 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 0x7f44c80ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 0x7f44c80c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c78a0 con 0x7f44c80ade00 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81f0ae0 con 0x7f44c806c5f0 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.475+0000 7f44cd597640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c6c20 con 0x7f44c806d9c0 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42750/0 (socket says 172.21.15.93:42750) 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 -- 172.21.15.93:0/2813595006 learned_addr learned my addr 172.21.15.93:0/2813595006 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44bffff640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 0x7f44c80c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c6ffd640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 0x7f44c80ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 -- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 msgr2=0x7f44c80c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.480 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 0x7f44c80c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 -- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 msgr2=0x7f44c80ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 0x7f44c80ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 -- 172.21.15.93:0/2813595006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009400 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c6ffd640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 0x7f44c80ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44bffff640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 0x7f44c80c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44c77fe640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f44c000cd50 tx=0x7f44c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000f680 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c000f800 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c80c6f00 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000fbb0 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.476+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c80c74c0 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.477+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c80c79e0 con 0x7f44c80ade00 2023-11-04T01:43:11.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.478+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44c000b040 con 0x7f44c80ade00 2023-11-04T01:43:11.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.478+0000 7f44bf7fe640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 0x7f44a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.478+0000 7f44c6ffd640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 0x7f44a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.478+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f44c008a8b0 con 0x7f44c80ade00 2023-11-04T01:43:11.482 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.479+0000 7f44c6ffd640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 0x7f44a806d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f60 tx=0x7f44b8007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.482+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44c80c79e0 con 0x7f44c80ade00 2023-11-04T01:43:11.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.682+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44c80c79e0 con 0x7f44c80ade00 2023-11-04T01:43:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.683+0000 7f44bf7fe640 1 -- 172.21.15.93:0/2813595006 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f44c80c79e0 con 0x7f44c80ade00 2023-11-04T01:43:11.684 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:11.684 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6380,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:05.708257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:11.684 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 110 2023-11-04T01:43:11.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 msgr2=0x7f44a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 0x7f44a806d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f60 tx=0x7f44b8007ca0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 msgr2=0x7f44c80c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f44c000cd50 tx=0x7f44c000a650 comp rx=0 tx=0).stop 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 shutdown_connections 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44a806ae70 0x7f44a806d330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44c80ade00 0x7f44c80c6580 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.684+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f44c806d9c0 0x7f44c80c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.685+0000 7f44cd597640 1 --2- 172.21.15.93:0/2813595006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f44c806c5f0 0x7f44c80ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.685+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 >> 172.21.15.93:0/2813595006 conn(0x7f44c80cb530 msgr2=0x7f44c80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.685+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 shutdown_connections 2023-11-04T01:43:11.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.685+0000 7f44cd597640 1 -- 172.21.15.93:0/2813595006 wait complete. 2023-11-04T01:43:11.696 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:43:11.696 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32317113876342773s 2023-11-04T01:43:11.697 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:11.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.794+0000 7f41d734c640 1 Processor -- start 2023-11-04T01:43:11.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.794+0000 7f41d734c640 1 -- start start 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d734c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f41d00b0c40 0x7f41d006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d734c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f41d006bb60 0x7f41d0070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d734c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d0071500 con 0x7f41d0159e40 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d734c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d0070a70 con 0x7f41d006bb60 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d734c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d015dae0 con 0x7f41d00b0c40 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d58e9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f41d006bb60 0x7f41d0070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d50e8640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f41d0159e40 0x7f41d00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55720/0 (socket says 172.21.15.93:55720) 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.795+0000 7f41d50e8640 1 -- 172.21.15.93:0/1053432194 learned_addr learned my addr 172.21.15.93:0/1053432194 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d58e9640 1 -- 172.21.15.93:0/1053432194 >> v2:172.21.15.125:3300/0 conn(0x7f41d00b0c40 msgr2=0x7f41d006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d48e7640 1 --2- 172.21.15.93:0/1053432194 >> v2:172.21.15.125:3300/0 conn(0x7f41d00b0c40 0x7f41d006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41c7fff640 1 -- 172.21.15.93:0/1053432194 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831266162 0 0) 0x7f41d0071500 con 0x7f41d0159e40 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d58e9640 1 --2- 172.21.15.93:0/1053432194 >> v2:172.21.15.125:3300/0 conn(0x7f41d00b0c40 0x7f41d006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d58e9640 1 -- 172.21.15.93:0/1053432194 >> v1:172.21.15.93:6789/0 conn(0x7f41d0159e40 legacy=0x7f41d00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d58e9640 1 -- 172.21.15.93:0/1053432194 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0070c60 con 0x7f41d006bb60 2023-11-04T01:43:11.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41d58e9640 1 --2- 172.21.15.93:0/1053432194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0070530 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f41d006fdc0 tx=0x7f41c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f9c0724faf257 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41c7fff640 1 -- 172.21.15.93:0/1053432194 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c802e070 con 0x7f41d006bb60 2023-11-04T01:43:11.799 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41c7fff640 1 -- 172.21.15.93:0/1053432194 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80315a0 con 0x7f41d006bb60 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.796+0000 7f41c7fff640 1 -- 172.21.15.93:0/1053432194 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8031930 con 0x7f41d006bb60 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 -- 172.21.15.93:0/1053432194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 msgr2=0x7f41d0070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 --2- 172.21.15.93:0/1053432194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0070530 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f41d006fdc0 tx=0x7f41c802b840 comp rx=0 tx=0).stop 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 -- 172.21.15.93:0/1053432194 shutdown_connections 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 --2- 172.21.15.93:0/1053432194 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0070530 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 --2- 172.21.15.93:0/1053432194 >> v2:172.21.15.125:3300/0 conn(0x7f41d00b0c40 0x7f41d006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 -- 172.21.15.93:0/1053432194 >> 172.21.15.93:0/1053432194 conn(0x7f41d00cb530 msgr2=0x7f41d00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 -- 172.21.15.93:0/1053432194 shutdown_connections 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.797+0000 7f41d734c640 1 -- 172.21.15.93:0/1053432194 wait complete. 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.798+0000 7f41d734c640 1 Processor -- start 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.798+0000 7f41d734c640 1 -- start start 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41d00b0c40 0x7f41d00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41d0159e40 0x7f41d00c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d015bbb0 con 0x7f41d006bb60 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d015b2e0 con 0x7f41d0159e40 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d734c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d0152da0 con 0x7f41d00b0c40 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42780/0 (socket says 172.21.15.93:42780) 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 -- 172.21.15.93:0/1770297077 learned_addr learned my addr 172.21.15.93:0/1770297077 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 -- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41d00b0c40 msgr2=0x7f41d00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41d00b0c40 0x7f41d00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 -- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41d0159e40 msgr2=0x7f41d00c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41d0159e40 0x7f41d00c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 -- 172.21.15.93:0/1770297077 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009400 con 0x7f41d006bb60 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41d50e8640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c890 tx=0x7f41cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.799+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00a640 con 0x7f41d006bb60 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.800+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00a7c0 con 0x7f41d006bb60 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.800+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d00cd400 con 0x7f41d006bb60 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.800+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00ab70 con 0x7f41d006bb60 2023-11-04T01:43:11.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.800+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d015b7d0 con 0x7f41d006bb60 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.801+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00684b0 con 0x7f41d006bb60 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.801+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41cc00acd0 con 0x7f41d006bb60 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.801+0000 7f41c5ffb640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 0x7f41b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.801+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f41cc0894c0 con 0x7f41d006bb60 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.801+0000 7f41d48e7640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 0x7f41b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.802+0000 7f41d48e7640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 0x7f41b406d330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006fd0 tx=0x7f41c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:11.805+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41cc053c50 con 0x7f41d006bb60 2023-11-04T01:43:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.006+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41d00c9750 con 0x7f41d006bb60 2023-11-04T01:43:12.007 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.006+0000 7f41c5ffb640 1 -- 172.21.15.93:0/1770297077 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f41cc018020 con 0x7f41d006bb60 2023-11-04T01:43:12.008 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:12.008 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6380,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:05.708257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:12.008 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 110 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 msgr2=0x7f41b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 0x7f41b406d330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006fd0 tx=0x7f41c0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 msgr2=0x7f41d0152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c890 tx=0x7f41cc00cd50 comp rx=0 tx=0).stop 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 shutdown_connections 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f41b406ae70 0x7f41b406d330 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41d0159e40 0x7f41d00c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f41d00b0c40 0x7f41d00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.010 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 --2- 172.21.15.93:0/1770297077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f41d006bb60 0x7f41d0152860 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 >> 172.21.15.93:0/1770297077 conn(0x7f41d00cb530 msgr2=0x7f41d00ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 shutdown_connections 2023-11-04T01:43:12.011 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.008+0000 7f41d734c640 1 -- 172.21.15.93:0/1770297077 wait complete. 2023-11-04T01:43:12.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:12.134 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.307387+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:12.134 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:42:48.307387+0000" } ] } 2023-11-04T01:43:12.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:12.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.232+0000 7f2c18f65640 1 Processor -- start 2023-11-04T01:43:12.234 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.232+0000 7f2c18f65640 1 -- start start 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c18f65640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c140ade00 0x7f2c140b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c18f65640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c1406c5f0 0x7f2c140cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c18f65640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1406cc90 con 0x7f2c1406d9c0 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c18f65640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c140b0e60 con 0x7f2c140ade00 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c18f65640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1406cee0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c1259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c140ade00 0x7f2c140b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c0bfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f2c1406d9c0 0x7f2c140710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55730/0 (socket says 172.21.15.93:55730) 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c1259c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c140ade00 0x7f2c140b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42786/0 (socket says 172.21.15.93:42786) 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c0bfff640 1 -- 172.21.15.93:0/1278469701 learned_addr learned my addr 172.21.15.93:0/1278469701 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c12d9d640 1 --2- 172.21.15.93:0/1278469701 >> v2:172.21.15.125:3300/0 conn(0x7f2c1406c5f0 0x7f2c140cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c1259c640 1 -- 172.21.15.93:0/1278469701 >> v2:172.21.15.125:3300/0 conn(0x7f2c1406c5f0 msgr2=0x7f2c140cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.236 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c1259c640 1 --2- 172.21.15.93:0/1278469701 >> v2:172.21.15.125:3300/0 conn(0x7f2c1406c5f0 0x7f2c140cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.233+0000 7f2c1259c640 1 -- 172.21.15.93:0/1278469701 >> v1:172.21.15.93:6789/0 conn(0x7f2c1406d9c0 legacy=0x7f2c140710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.234+0000 7f2c1259c640 1 -- 172.21.15.93:0/1278469701 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1406d1c0 con 0x7f2c140ade00 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.234+0000 7f2c1259c640 1 --2- 172.21.15.93:0/1278469701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c140ade00 0x7f2c140b0530 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2c140b44f0 tx=0x7f2c0402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4fae9501606b5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.234+0000 7f2c11d9b640 1 -- 172.21.15.93:0/1278469701 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04031710 con 0x7f2c140ade00 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.234+0000 7f2c11d9b640 1 -- 172.21.15.93:0/1278469701 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0402f050 con 0x7f2c140ade00 2023-11-04T01:43:12.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.234+0000 7f2c11d9b640 1 -- 172.21.15.93:0/1278469701 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04031a90 con 0x7f2c140ade00 2023-11-04T01:43:12.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 -- 172.21.15.93:0/1278469701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c140ade00 msgr2=0x7f2c140b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 --2- 172.21.15.93:0/1278469701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c140ade00 0x7f2c140b0530 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2c140b44f0 tx=0x7f2c0402b7b0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 -- 172.21.15.93:0/1278469701 shutdown_connections 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 --2- 172.21.15.93:0/1278469701 >> v2:172.21.15.125:3300/0 conn(0x7f2c1406c5f0 0x7f2c140cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 --2- 172.21.15.93:0/1278469701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c140ade00 0x7f2c140b0530 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 -- 172.21.15.93:0/1278469701 >> 172.21.15.93:0/1278469701 conn(0x7f2c140cb530 msgr2=0x7f2c140cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 -- 172.21.15.93:0/1278469701 shutdown_connections 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.235+0000 7f2c18f65640 1 -- 172.21.15.93:0/1278469701 wait complete. 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.236+0000 7f2c18f65640 1 Processor -- start 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.236+0000 7f2c18f65640 1 -- start start 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c1406d9c0 0x7f2c14154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c140ade00 0x7f2c140af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14147050 con 0x7f2c1406c5f0 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141f2b90 con 0x7f2c140ade00 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c18f65640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14146a90 con 0x7f2c1406d9c0 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42802/0 (socket says 172.21.15.93:42802) 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 -- 172.21.15.93:0/3355800075 learned_addr learned my addr 172.21.15.93:0/3355800075 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 -- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c1406d9c0 msgr2=0x7f2c14154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c1406d9c0 0x7f2c14154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 -- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c140ade00 msgr2=0x7f2c140af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c140ade00 0x7f2c140af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.237+0000 7f2c1259c640 1 -- 172.21.15.93:0/3355800075 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04009400 con 0x7f2c1406c5f0 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c1259c640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000c00 tx=0x7f2c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04033910 con 0x7f2c1406c5f0 2023-11-04T01:43:12.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c04033a70 con 0x7f2c1406c5f0 2023-11-04T01:43:12.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04033e20 con 0x7f2c1406c5f0 2023-11-04T01:43:12.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c14146d70 con 0x7f2c1406c5f0 2023-11-04T01:43:12.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.238+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c140c9660 con 0x7f2c1406c5f0 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.239+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c140c91e0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.239+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c0403a040 con 0x7f2c1406c5f0 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.240+0000 7f2c0affd640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 0x7f2bf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.240+0000 7f2c0bfff640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 0x7f2bf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.240+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f2c040ab8b0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.240+0000 7f2c0bfff640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 0x7f2bf406d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2c140cacb0 tx=0x7f2bfc007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.244+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c140c91e0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.444+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c140c91e0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.445+0000 7f2c0affd640 1 -- 172.21.15.93:0/3355800075 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f2c140c91e0 con 0x7f2c1406c5f0 2023-11-04T01:43:12.446 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:12.446 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6380,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:05.708257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6272":{"gid":6272,"name":"d","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6834/769984368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":769984368},{"type":"v1","addr":"172.21.15.125:6834","nonce":769984368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:12.447 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 110 2023-11-04T01:43:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 msgr2=0x7f2bf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 0x7f2bf406d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2c140cacb0 tx=0x7f2bfc007a40 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 msgr2=0x7f2c140c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000c00 tx=0x7f2c040046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 shutdown_connections 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2bf406ae70 0x7f2bf406d330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c140ade00 0x7f2c140af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c1406d9c0 0x7f2c14154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 --2- 172.21.15.93:0/3355800075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c1406c5f0 0x7f2c140c5070 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 >> 172.21.15.93:0/3355800075 conn(0x7f2c140cb530 msgr2=0x7f2c14143180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 shutdown_connections 2023-11-04T01:43:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.447+0000 7f2c18f65640 1 -- 172.21.15.93:0/3355800075 wait complete. 2023-11-04T01:43:12.459 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:12.573 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:04.305281+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.307387+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:12.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:04.305281+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:42:48.307387+0000" } ] } 2023-11-04T01:43:12.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:43:12.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.673+0000 7f56c0f78640 1 Processor -- start 2023-11-04T01:43:12.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.673+0000 7f56c0f78640 1 -- start start 2023-11-04T01:43:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56c0f78640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56c0f78640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56bc0caba0 0x7f56bc0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56c0f78640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56bc0ca5c0 con 0x7f56bc0cc400 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56c0f78640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc06c140 con 0x7f56bc0caba0 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56c0f78640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0cb0f0 con 0x7f56bc0cda40 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56bc0caba0 0x7f56bc0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56bc0caba0 0x7f56bc0c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42818/0 (socket says 172.21.15.93:42818) 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 -- 172.21.15.93:0/4004187203 learned_addr learned my addr 172.21.15.93:0/4004187203 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56ba59c640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 -- 172.21.15.93:0/4004187203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 msgr2=0x7f56bc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 -- 172.21.15.93:0/4004187203 >> v1:172.21.15.125:6789/0 conn(0x7f56bc0cc400 legacy=0x7f56bc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56bad9d640 1 -- 172.21.15.93:0/4004187203 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc06c560 con 0x7f56bc0caba0 2023-11-04T01:43:12.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.674+0000 7f56ba59c640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.675+0000 7f56bad9d640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc0c9bc0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009e50 tx=0x7f56ac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a751bbad30d819 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.675+0000 7f56b959a640 1 -- 172.21.15.93:0/4004187203 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac02c9e0 con 0x7f56bc0caba0 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.675+0000 7f56b959a640 1 -- 172.21.15.93:0/4004187203 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac02cb40 con 0x7f56bc0caba0 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.675+0000 7f56b959a640 1 -- 172.21.15.93:0/4004187203 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0343f0 con 0x7f56bc0caba0 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 -- 172.21.15.93:0/4004187203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 msgr2=0x7f56bc0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc0c9bc0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009e50 tx=0x7f56ac02be40 comp rx=0 tx=0).stop 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 -- 172.21.15.93:0/4004187203 shutdown_connections 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc0c9bc0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 --2- 172.21.15.93:0/4004187203 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 -- 172.21.15.93:0/4004187203 >> 172.21.15.93:0/4004187203 conn(0x7f56bc0cb8e0 msgr2=0x7f56bc0cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 -- 172.21.15.93:0/4004187203 shutdown_connections 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.676+0000 7f56c0f78640 1 -- 172.21.15.93:0/4004187203 wait complete. 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.677+0000 7f56c0f78640 1 Processor -- start 2023-11-04T01:43:12.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.677+0000 7f56c0f78640 1 -- start start 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56bc0cc400 0x7f56bc0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc1e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc144d50 con 0x7f56bc0caba0 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc147f60 con 0x7f56bc0cc400 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56c0f78640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1f6530 con 0x7f56bc0cda40 2023-11-04T01:43:12.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42820/0 (socket says 172.21.15.93:42820) 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 -- 172.21.15.93:0/2401771451 learned_addr learned my addr 172.21.15.93:0/2401771451 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56bad9d640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc1e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56b9d9b640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56bc0cc400 0x7f56bc0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 -- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 msgr2=0x7f56bc1e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc1e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 -- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56bc0cc400 msgr2=0x7f56bc0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56bc0cc400 0x7f56bc0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.678+0000 7f56ba59c640 1 -- 172.21.15.93:0/2401771451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac009b30 con 0x7f56bc0caba0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56ba59c640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c7f0 tx=0x7f56b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4007a30 con 0x7f56bc0caba0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b4007b90 con 0x7f56bc0caba0 2023-11-04T01:43:12.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400ce40 con 0x7f56bc0caba0 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc1f6810 con 0x7f56bc0caba0 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.679+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc1f6dd0 con 0x7f56bc0caba0 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.680+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0cec60 con 0x7f56bc0caba0 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.680+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56b40113f0 con 0x7f56bc0caba0 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.680+0000 7f56aaffd640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.681+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f56b408a090 con 0x7f56bc0caba0 2023-11-04T01:43:12.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.681+0000 7f56b9d9b640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.681+0000 7f56b9d9b640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 0x7f569c06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56b0006fd0 tx=0x7f56b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.685+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56b40548b0 con 0x7f56bc0caba0 2023-11-04T01:43:12.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.920+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f56bc0684b0 con 0x7f56bc0caba0 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.922+0000 7f56aaffd640 1 -- 172.21.15.93:0/2401771451 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 6272 v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56b401f090 con 0x7f56bc0caba0 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi093.stderr:failed mds gid 6272 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 msgr2=0x7f569c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 0x7f569c06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56b0006fd0 tx=0x7f56b0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 msgr2=0x7f56bc144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c7f0 tx=0x7f56b400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 shutdown_connections 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f569c06ae70 0x7f569c06d330 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f56bc0cda40 0x7f56bc1e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56bc0cc400 0x7f56bc0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 --2- 172.21.15.93:0/2401771451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56bc0caba0 0x7f56bc144810 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 >> 172.21.15.93:0/2401771451 conn(0x7f56bc0cb8e0 msgr2=0x7f56bc15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 shutdown_connections 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:12.925+0000 7f56c0f78640 1 -- 172.21.15.93:0/2401771451 wait complete. 2023-11-04T01:43:12.938 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:43:12.939 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:43:12.939 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:43:12.939 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:12.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:12.939 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:43:12.940 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:43:12.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:43:12.942 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:43:12.943 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:12.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:43:13.022 INFO:tasks.ceph.mds.d.smithi125.stdout:starting mds.d at 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.041+0000 7f5a4654c640 1 Processor -- start 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.041+0000 7f5a4654c640 1 -- start start 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a4654c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a400cda40 0x7f5a400cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a4654c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a400caba0 0x7f5a400c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a4654c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400ca5c0 con 0x7f5a400cc400 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a4654c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4006c140 con 0x7f5a400cda40 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a4654c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cb0f0 con 0x7f5a400caba0 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a400cda40 0x7f5a400cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5a400cc400 0x7f5a400c94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55740/0 (socket says 172.21.15.93:55740) 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5a400cda40 0x7f5a400cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42832/0 (socket says 172.21.15.93:42832) 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 -- 172.21.15.93:0/2345158889 learned_addr learned my addr 172.21.15.93:0/2345158889 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a44ae9640 1 --2- 172.21.15.93:0/2345158889 >> v2:172.21.15.125:3300/0 conn(0x7f5a400caba0 0x7f5a400c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 -- 172.21.15.93:0/2345158889 >> v2:172.21.15.125:3300/0 conn(0x7f5a400caba0 msgr2=0x7f5a400c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/2345158889 >> v2:172.21.15.125:3300/0 conn(0x7f5a400caba0 0x7f5a400c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 -- 172.21.15.93:0/2345158889 >> v1:172.21.15.93:6789/0 conn(0x7f5a400cc400 legacy=0x7f5a400c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3ffff640 1 -- 172.21.15.93:0/2345158889 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4006c560 con 0x7f5a400cda40 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.042+0000 7f5a3effd640 1 -- 172.21.15.93:0/2345158889 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838575897 0 0) 0x7f5a400ca5c0 con 0x7f5a400cc400 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.043+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/2345158889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cda40 0x7f5a400cde20 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f5a4006bbc0 tx=0x7f5a3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a6778efd4f7164 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.043+0000 7f5a3effd640 1 -- 172.21.15.93:0/2345158889 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30031870 con 0x7f5a400cda40 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.043+0000 7f5a3effd640 1 -- 172.21.15.93:0/2345158889 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300319d0 con 0x7f5a400cda40 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.043+0000 7f5a3effd640 1 -- 172.21.15.93:0/2345158889 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30031d60 con 0x7f5a400cda40 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 -- 172.21.15.93:0/2345158889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cda40 msgr2=0x7f5a400cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 --2- 172.21.15.93:0/2345158889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cda40 0x7f5a400cde20 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f5a4006bbc0 tx=0x7f5a3002b910 comp rx=0 tx=0).stop 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 -- 172.21.15.93:0/2345158889 shutdown_connections 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 --2- 172.21.15.93:0/2345158889 >> v2:172.21.15.125:3300/0 conn(0x7f5a400caba0 0x7f5a400c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 --2- 172.21.15.93:0/2345158889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cda40 0x7f5a400cde20 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 -- 172.21.15.93:0/2345158889 >> 172.21.15.93:0/2345158889 conn(0x7f5a400cb8e0 msgr2=0x7f5a400cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 -- 172.21.15.93:0/2345158889 shutdown_connections 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.044+0000 7f5a4654c640 1 -- 172.21.15.93:0/2345158889 wait complete. 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.045+0000 7f5a4654c640 1 Processor -- start 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.045+0000 7f5a4654c640 1 -- start start 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 0x7f5a401e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a400cda40 0x7f5a400adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400acb00 con 0x7f5a400cc400 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400ae510 con 0x7f5a400caba0 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a4654c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401e4df0 con 0x7f5a400cda40 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42842/0 (socket says 172.21.15.93:42842) 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 -- 172.21.15.93:0/3408725137 learned_addr learned my addr 172.21.15.93:0/3408725137 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 0x7f5a401e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a44ae9640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a400cda40 0x7f5a400adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 -- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a400cda40 msgr2=0x7f5a400adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a400cda40 0x7f5a400adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 -- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 msgr2=0x7f5a401e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 0x7f5a401e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 -- 172.21.15.93:0/3408725137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300094d0 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 0x7f5a401e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3f7fe640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c410 tx=0x7f5a3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340074e0 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.046+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34007660 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.047+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a401e50d0 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.047+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34004a20 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.047+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400acf90 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.047+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400cec60 con 0x7f5a400cc400 2023-11-04T01:43:13.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.048+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a34004b80 con 0x7f5a400cc400 2023-11-04T01:43:13.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.048+0000 7f5a3cff9640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 0x7f5a2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.048+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5a34089d40 con 0x7f5a400cc400 2023-11-04T01:43:13.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.048+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 0x7f5a2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.049+0000 7f5a3ffff640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 0x7f5a2c06d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5a30036000 tx=0x7f5a3003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.053 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.052+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a34057f10 con 0x7f5a400cc400 2023-11-04T01:43:13.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.252+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a400b4e70 con 0x7f5a400cc400 2023-11-04T01:43:13.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.252+0000 7f5a3cff9640 1 -- 172.21.15.93:0/3408725137 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4146 (secure 0 0 0) 0x7f5a34057aa0 con 0x7f5a400cc400 2023-11-04T01:43:13.253 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:13.254 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:12.925426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:replay","state_seq":1,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:13.254 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 112 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 msgr2=0x7f5a2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 0x7f5a2c06d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5a30036000 tx=0x7f5a3003c040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 msgr2=0x7f5a401e47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c410 tx=0x7f5a3400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 shutdown_connections 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f5a2c06ae70 0x7f5a2c06d330 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5a400cda40 0x7f5a400adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5a400cc400 0x7f5a401e47a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 --2- 172.21.15.93:0/3408725137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a400caba0 0x7f5a401e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 >> 172.21.15.93:0/3408725137 conn(0x7f5a400cb8e0 msgr2=0x7f5a400c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 shutdown_connections 2023-11-04T01:43:13.257 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:13.254+0000 7f5a4654c640 1 -- 172.21.15.93:0/3408725137 wait complete. 2023-11-04T01:43:13.266 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:18.266 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:18.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.376+0000 7ffbaca90640 1 Processor -- start 2023-11-04T01:43:18.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.377+0000 7ffbaca90640 1 -- start start 2023-11-04T01:43:18.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.377+0000 7ffbaca90640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffba815d100 0x7ffba80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.377+0000 7ffbaca90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffba80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffbaca90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80b32b0 con 0x7ffba80d3b60 2023-11-04T01:43:18.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffbaca90640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80cee10 con 0x7ffba815d100 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffbaca90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b4750 con 0x7ffba815d4e0 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba6d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffba80d3b60 0x7ffba80cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55746/0 (socket says 172.21.15.93:55746) 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba6d9d640 1 -- 172.21.15.93:0/1507328116 learned_addr learned my addr 172.21.15.93:0/1507328116 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba5d9b640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffba80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba659c640 1 --2- 172.21.15.93:0/1507328116 >> v2:172.21.15.125:3300/0 conn(0x7ffba815d100 0x7ffba80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387300275 0 0) 0x7ffba80b32b0 con 0x7ffba80d3b60 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb90003520 con 0x7ffba80d3b60 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715464073 0 0) 0x7ffb90003520 con 0x7ffba80d3b60 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 msgr2=0x7ffba80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffba80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 >> v2:172.21.15.125:3300/0 conn(0x7ffba815d100 msgr2=0x7ffba80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 --2- 172.21.15.93:0/1507328116 >> v2:172.21.15.125:3300/0 conn(0x7ffba815d100 0x7ffba80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80b2980 con 0x7ffba80d3b60 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7ffb98001670 con 0x7ffba80d3b60 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 >> v1:172.21.15.93:6789/0 conn(0x7ffba80d3b60 legacy=0x7ffba80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffb90003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003ef0 0x7ffb900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cee10 con 0x7ffb90004d00 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b4750 con 0x7ffb90003ef0 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9000b980 con 0x7ffba815d4e0 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.378+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba659c640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffb90003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba5d9b640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003ef0 0x7ffb900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 -- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 msgr2=0x7ffb90003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffba815d4e0 0x7ffb90003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 -- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003ef0 msgr2=0x7ffb900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003ef0 0x7ffb900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 -- 172.21.15.93:0/1507328116 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90003520 con 0x7ffb90004d00 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba5d9b640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb90003ef0 0x7ffb900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.379+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c290 tx=0x7ffb900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1360739bf50a949f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98005ad0 con 0x7ffb90004d00 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98005c30 con 0x7ffb90004d00 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffba559a640 1 -- 172.21.15.93:0/1507328116 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9802c8c0 con 0x7ffb90004d00 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 -- 172.21.15.93:0/1507328116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 msgr2=0x7ffb90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 --2- 172.21.15.93:0/1507328116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffb90004d00 0x7ffb90005180 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c290 tx=0x7ffb900057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffba6d9d640 1 -- 172.21.15.93:0/1507328116 reap_dead start 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 -- 172.21.15.93:0/1507328116 shutdown_connections 2023-11-04T01:43:18.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 -- 172.21.15.93:0/1507328116 >> 172.21.15.93:0/1507328116 conn(0x7ffba80d2ef0 msgr2=0x7ffba80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 -- 172.21.15.93:0/1507328116 shutdown_connections 2023-11-04T01:43:18.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.380+0000 7ffbaca90640 1 -- 172.21.15.93:0/1507328116 wait complete. 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 Processor -- start 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 -- start start 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba8152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 0x7ffba8154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cc740 con 0x7ffba80cbd80 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80cca20 con 0x7ffba81f2d20 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffbaca90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80ccd00 con 0x7ffb90004d00 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffba6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffba6d9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42860/0 (socket says 172.21.15.93:42860) 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.382+0000 7ffba6d9d640 1 -- 172.21.15.93:0/2646992169 learned_addr learned my addr 172.21.15.93:0/2646992169 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba659c640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba8152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba5d9b640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 0x7ffba8154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 -- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 msgr2=0x7ffba8152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba8152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 -- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 msgr2=0x7ffba8154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 0x7ffba8154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 -- 172.21.15.93:0/2646992169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80c9fc0 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba659c640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba8152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba5d9b640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 0x7ffba8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffba6d9d640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c3b0 tx=0x7ffb98001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9803c040 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9802ccf0 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980072b0 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba80ca2a0 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.383+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80cc200 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.384+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba80cc880 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.385+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb98032070 con 0x7ffba80cbd80 2023-11-04T01:43:18.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.385+0000 7ffb96ffd640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 0x7ffb8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.385+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ffb980ab090 con 0x7ffba80cbd80 2023-11-04T01:43:18.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.385+0000 7ffba659c640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 0x7ffb8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.386+0000 7ffba659c640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 0x7ffb8806d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009b20 tx=0x7ffba0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.389+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffba80cc880 con 0x7ffba80cbd80 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.592+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffba80cc880 con 0x7ffba80cbd80 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.593+0000 7ffb96ffd640 1 -- 172.21.15.93:0/2646992169 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4946 (secure 0 0 0) 0x7ffba80cc880 con 0x7ffba80cbd80 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:13.934419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 114 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.594+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 msgr2=0x7ffb8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.594+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 0x7ffb8806d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009b20 tx=0x7ffba0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.594+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 msgr2=0x7ffba815bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.594+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c3b0 tx=0x7ffb98001a00 comp rx=0 tx=0).stop 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 shutdown_connections 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ffb8806ae70 0x7ffb8806d330 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffba80cbd80 0x7ffba815bb10 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffba81f2d20 0x7ffba8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 --2- 172.21.15.93:0/2646992169 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffb90004d00 0x7ffba8152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 >> 172.21.15.93:0/2646992169 conn(0x7ffba80d2ef0 msgr2=0x7ffba806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 shutdown_connections 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.595+0000 7ffbaca90640 1 -- 172.21.15.93:0/2646992169 wait complete. 2023-11-04T01:43:18.606 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:18.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.704+0000 7f42e326f640 1 Processor -- start 2023-11-04T01:43:18.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.704+0000 7f42e326f640 1 -- start start 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e326f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f42dc0b1440 0x7f42dc06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e326f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42dc06b740 0x7f42dc066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e326f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0ad6a0 con 0x7f42dc15ade0 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e326f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0acaf0 con 0x7f42dc0b1440 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e326f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0acdd0 con 0x7f42dc06b740 2023-11-04T01:43:18.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e100b640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f42dc15ade0 0x7f42dc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55748/0 (socket says 172.21.15.93:55748) 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e080a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f42dc0b1440 0x7f42dc06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e100b640 1 -- 172.21.15.93:0/1714607376 learned_addr learned my addr 172.21.15.93:0/1714607376 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e180c640 1 --2- 172.21.15.93:0/1714607376 >> v2:172.21.15.125:3300/0 conn(0x7f42dc06b740 0x7f42dc066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e080a640 1 -- 172.21.15.93:0/1714607376 >> v2:172.21.15.125:3300/0 conn(0x7f42dc06b740 msgr2=0x7f42dc066010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e080a640 1 --2- 172.21.15.93:0/1714607376 >> v2:172.21.15.125:3300/0 conn(0x7f42dc06b740 0x7f42dc066010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e080a640 1 -- 172.21.15.93:0/1714607376 >> v1:172.21.15.93:6789/0 conn(0x7f42dc15ade0 legacy=0x7f42dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42e080a640 1 -- 172.21.15.93:0/1714607376 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0ad0e0 con 0x7f42dc0b1440 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.705+0000 7f42d3fff640 1 -- 172.21.15.93:0/1714607376 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628183514 0 0) 0x7f42dc0ad6a0 con 0x7f42dc15ade0 2023-11-04T01:43:18.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.706+0000 7f42e080a640 1 --2- 172.21.15.93:0/1714607376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc0b1440 0x7f42dc06c520 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0c2830 tx=0x7f42cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134decedf4c49c40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.706+0000 7f42d3fff640 1 -- 172.21.15.93:0/1714607376 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc02e070 con 0x7f42dc0b1440 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.706+0000 7f42d3fff640 1 -- 172.21.15.93:0/1714607376 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0315a0 con 0x7f42dc0b1440 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.706+0000 7f42d3fff640 1 -- 172.21.15.93:0/1714607376 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc031930 con 0x7f42dc0b1440 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 -- 172.21.15.93:0/1714607376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc0b1440 msgr2=0x7f42dc06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 --2- 172.21.15.93:0/1714607376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc0b1440 0x7f42dc06c520 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0c2830 tx=0x7f42cc02b840 comp rx=0 tx=0).stop 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 -- 172.21.15.93:0/1714607376 shutdown_connections 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 --2- 172.21.15.93:0/1714607376 >> v2:172.21.15.125:3300/0 conn(0x7f42dc06b740 0x7f42dc066010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 --2- 172.21.15.93:0/1714607376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc0b1440 0x7f42dc06c520 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 -- 172.21.15.93:0/1714607376 >> 172.21.15.93:0/1714607376 conn(0x7f42dc0cbd30 msgr2=0x7f42dc0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 -- 172.21.15.93:0/1714607376 shutdown_connections 2023-11-04T01:43:18.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.707+0000 7f42e326f640 1 -- 172.21.15.93:0/1714607376 wait complete. 2023-11-04T01:43:18.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.708+0000 7f42e326f640 1 Processor -- start 2023-11-04T01:43:18.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.708+0000 7f42e326f640 1 -- start start 2023-11-04T01:43:18.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42dc06b740 0x7f42dc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 0x7f42dc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0af730 con 0x7f42dc15ade0 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc153910 con 0x7f42dc0b1440 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0aed90 con 0x7f42dc06b740 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42882/0 (socket says 172.21.15.93:42882) 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 -- 172.21.15.93:0/958595149 learned_addr learned my addr 172.21.15.93:0/958595149 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e080a640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 0x7f42dc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e100b640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42dc06b740 0x7f42dc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 -- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42dc06b740 msgr2=0x7f42dc1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.714 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42dc06b740 0x7f42dc1533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 -- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 msgr2=0x7f42dc15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 0x7f42dc15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 -- 172.21.15.93:0/958595149 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009400 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e080a640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 0x7f42dc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e180c640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f42d400d800 tx=0x7f42d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400b6c0 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d400b840 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400bbf0 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.709+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc0af070 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.710+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc0b37a0 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.711+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc0af870 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.711+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42d400bd50 con 0x7f42dc15ade0 2023-11-04T01:43:18.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.711+0000 7f42d1ffb640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 0x7f42c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.711+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f42d408a4c0 con 0x7f42dc15ade0 2023-11-04T01:43:18.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.711+0000 7f42e100b640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 0x7f42c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.712+0000 7f42e100b640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 0x7f42c006d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f42d8001460 tx=0x7f42d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.715+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42dc0af870 con 0x7f42dc15ade0 2023-11-04T01:43:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.916+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42dc0af870 con 0x7f42dc15ade0 2023-11-04T01:43:18.917 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.916+0000 7f42d1ffb640 1 -- 172.21.15.93:0/958595149 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f42dc0af870 con 0x7f42dc15ade0 2023-11-04T01:43:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:18.918 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:13.934419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:18.918 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 114 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 msgr2=0x7f42c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 0x7f42c006d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f42d8001460 tx=0x7f42d8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 msgr2=0x7f42dc15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f42d400d800 tx=0x7f42d400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 shutdown_connections 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f42c006ae70 0x7f42c006d330 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42dc15ade0 0x7f42dc15b880 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc0b1440 0x7f42dc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 --2- 172.21.15.93:0/958595149 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f42dc06b740 0x7f42dc1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 >> 172.21.15.93:0/958595149 conn(0x7f42dc0cbd30 msgr2=0x7f42dc1583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 shutdown_connections 2023-11-04T01:43:18.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:18.918+0000 7f42e326f640 1 -- 172.21.15.93:0/958595149 wait complete. 2023-11-04T01:43:18.931 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:19.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:43:19.931 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:20.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.038+0000 7f758ef97640 1 Processor -- start 2023-11-04T01:43:20.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.038+0000 7f758ef97640 1 -- start start 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758ef97640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f758815d100 0x7f75880ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758ef97640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f758815d4e0 0x7f75880d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758ef97640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880b32b0 con 0x7f75880d3b60 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758ef97640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880cee10 con 0x7f758815d4e0 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758ef97640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880b4750 con 0x7f758815d100 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f7587fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f758815d4e0 0x7f75880d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758d534640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f75880d3b60 0x7f75880cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55758/0 (socket says 172.21.15.93:55758) 2023-11-04T01:43:20.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f7587fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f758815d4e0 0x7f75880d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42896/0 (socket says 172.21.15.93:42896) 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.039+0000 7f758d534640 1 -- 172.21.15.93:0/3646810151 learned_addr learned my addr 172.21.15.93:0/3646810151 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f758cd33640 1 --2- 172.21.15.93:0/3646810151 >> v2:172.21.15.125:3300/0 conn(0x7f758815d100 0x7f75880ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f7587fff640 1 -- 172.21.15.93:0/3646810151 >> v2:172.21.15.125:3300/0 conn(0x7f758815d100 msgr2=0x7f75880ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f7587fff640 1 --2- 172.21.15.93:0/3646810151 >> v2:172.21.15.125:3300/0 conn(0x7f758815d100 0x7f75880ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f7587fff640 1 -- 172.21.15.93:0/3646810151 >> v1:172.21.15.93:6789/0 conn(0x7f75880d3b60 legacy=0x7f75880cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f75877fe640 1 -- 172.21.15.93:0/3646810151 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174377667 0 0) 0x7f75880b32b0 con 0x7f75880d3b60 2023-11-04T01:43:20.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.040+0000 7f7587fff640 1 -- 172.21.15.93:0/3646810151 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880b2980 con 0x7f758815d4e0 2023-11-04T01:43:20.043 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f7587fff640 1 --2- 172.21.15.93:0/3646810151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d4e0 0x7f75880d14d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f75880d09f0 tx=0x7f757c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6c79f243c62daf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f75877fe640 1 -- 172.21.15.93:0/3646810151 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c031830 con 0x7f758815d4e0 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f75877fe640 1 -- 172.21.15.93:0/3646810151 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c031990 con 0x7f758815d4e0 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f75877fe640 1 -- 172.21.15.93:0/3646810151 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c031d20 con 0x7f758815d4e0 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 -- 172.21.15.93:0/3646810151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d4e0 msgr2=0x7f75880d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 --2- 172.21.15.93:0/3646810151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d4e0 0x7f75880d14d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f75880d09f0 tx=0x7f757c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 -- 172.21.15.93:0/3646810151 shutdown_connections 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 --2- 172.21.15.93:0/3646810151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d4e0 0x7f75880d14d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 --2- 172.21.15.93:0/3646810151 >> v2:172.21.15.125:3300/0 conn(0x7f758815d100 0x7f75880ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 -- 172.21.15.93:0/3646810151 >> 172.21.15.93:0/3646810151 conn(0x7f75880d2ef0 msgr2=0x7f75880d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 -- 172.21.15.93:0/3646810151 shutdown_connections 2023-11-04T01:43:20.044 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.041+0000 7f758ef97640 1 -- 172.21.15.93:0/3646810151 wait complete. 2023-11-04T01:43:20.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.042+0000 7f758ef97640 1 Processor -- start 2023-11-04T01:43:20.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.042+0000 7f758ef97640 1 -- start start 2023-11-04T01:43:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75880d3b60 0x7f7588159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 0x7f75880b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758815f6a0 con 0x7f758815d100 2023-11-04T01:43:20.047 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758815f980 con 0x7f75880d3b60 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f758ef97640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758815fc60 con 0x7f758815d4e0 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f7587fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f7587fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42906/0 (socket says 172.21.15.93:42906) 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.043+0000 7f7587fff640 1 -- 172.21.15.93:0/1806539536 learned_addr learned my addr 172.21.15.93:0/1806539536 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f758cd33640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75880d3b60 0x7f7588159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f758d534640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 0x7f75880b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 -- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 msgr2=0x7f75880b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 0x7f75880b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 -- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75880d3b60 msgr2=0x7f7588159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75880d3b60 0x7f7588159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 -- 172.21.15.93:0/1806539536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009400 con 0x7f758815d100 2023-11-04T01:43:20.048 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f758d534640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 0x7f75880b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f7587fff640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f757c009890 tx=0x7f757c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0317d0 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c03ba70 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758815ff40 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c03be20 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.044+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7588159550 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.045+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75880684b0 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.046+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f757c0453f0 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.046+0000 7f75857fa640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 0x7f757406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.046+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f757c0ac230 con 0x7f758815d100 2023-11-04T01:43:20.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.046+0000 7f758cd33640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 0x7f757406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.047+0000 7f758cd33640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 0x7f757406d330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7578005f80 tx=0x7f7578008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.050+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f757c076b40 con 0x7f758815d100 2023-11-04T01:43:20.255 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.254+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75880d2cd0 con 0x7f758815d100 2023-11-04T01:43:20.256 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.255+0000 7f75857fa640 1 -- 172.21.15.93:0/1806539536 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f757c035090 con 0x7f758815d100 2023-11-04T01:43:20.256 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:20.256 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:13.934419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:20.256 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 114 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 msgr2=0x7f757406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 0x7f757406d330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7578005f80 tx=0x7f7578008040 comp rx=0 tx=0).stop 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 msgr2=0x7f75880a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f757c009890 tx=0x7f757c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 shutdown_connections 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f757406ae70 0x7f757406d330 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f758815d4e0 0x7f75880b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f758815d100 0x7f75880a0540 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 --2- 172.21.15.93:0/1806539536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75880d3b60 0x7f7588159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 >> 172.21.15.93:0/1806539536 conn(0x7f75880d2ef0 msgr2=0x7f75880cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 shutdown_connections 2023-11-04T01:43:20.259 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:20.257+0000 7f758ef97640 1 -- 172.21.15.93:0/1806539536 wait complete. 2023-11-04T01:43:20.268 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:21.269 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:21.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.377+0000 7fe70930f640 1 Processor -- start 2023-11-04T01:43:21.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.378+0000 7fe70930f640 1 -- start start 2023-11-04T01:43:21.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.378+0000 7fe70930f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7040ca620 0x7fe70406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.378+0000 7fe70930f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b25a0 con 0x7fe7040ca1a0 2023-11-04T01:43:21.381 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.378+0000 7fe70930f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b2300 con 0x7fe70415d4e0 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.378+0000 7fe70930f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70415d8c0 con 0x7fe7040ca620 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe6fbfff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe7040ca1a0 0x7fe70406a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55766/0 (socket says 172.21.15.93:55766) 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe6fbfff640 1 -- 172.21.15.93:0/326510031 learned_addr learned my addr 172.21.15.93:0/326510031 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244686717 0 0) 0x7fe7040b25a0 con 0x7fe7040ca1a0 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7037fe640 1 --2- 172.21.15.93:0/326510031 >> v2:172.21.15.125:3300/0 conn(0x7fe7040ca620 0x7fe70406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003520 con 0x7fe7040ca1a0 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283991895 0 0) 0x7fe6f0003520 con 0x7fe7040ca1a0 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 >> v2:172.21.15.125:3300/0 conn(0x7fe7040ca620 msgr2=0x7fe70406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.382 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 --2- 172.21.15.93:0/326510031 >> v2:172.21.15.125:3300/0 conn(0x7fe7040ca620 0x7fe70406a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 >> v1:172.21.15.125:6789/0 conn(0x7fe70415d4e0 legacy=0x7fe7040ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040caab0 con 0x7fe7040ca1a0 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fe6ec001670 con 0x7fe7040ca1a0 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 >> v1:172.21.15.93:6789/0 conn(0x7fe7040ca1a0 legacy=0x7fe70406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 0x7fe6f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6f00047c0 0x7fe6f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f00052a0 0x7fe6f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415d8c0 con 0x7fe6f0003970 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c170 con 0x7fe6f00052a0 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c330 con 0x7fe6f00047c0 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7037fe640 1 --2- 172.21.15.93:0/326510031 >> v2:172.21.15.125:3300/0 conn(0x7fe7040ca620 0x7fe70406a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:21.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe702ffd640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 0x7fe6f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe7037fe640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f00052a0 0x7fe6f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.379+0000 7fe6fbfff640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6f00047c0 0x7fe6f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 -- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6f00047c0 msgr2=0x7fe6f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe6f00047c0 0x7fe6f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 -- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f00052a0 msgr2=0x7fe6f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f00052a0 0x7fe6f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe7037fe640 1 -- 172.21.15.93:0/326510031 reap_dead start 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 -- 172.21.15.93:0/326510031 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0003520 con 0x7fe6f0003970 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe702ffd640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 0x7fe6f0003d90 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4001720 tx=0x7fe6f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748a80670fbf928f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40052d0 con 0x7fe6f0003970 2023-11-04T01:43:21.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f402e050 con 0x7fe6f0003970 2023-11-04T01:43:21.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.380+0000 7fe7027fc640 1 -- 172.21.15.93:0/326510031 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4003830 con 0x7fe6f0003970 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 -- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 msgr2=0x7fe6f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 0x7fe6f0003d90 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4001720 tx=0x7fe6f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 -- 172.21.15.93:0/326510031 shutdown_connections 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 --2- 172.21.15.93:0/326510031 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f0003970 0x7fe6f0003d90 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 -- 172.21.15.93:0/326510031 >> 172.21.15.93:0/326510031 conn(0x7fe7040b1640 msgr2=0x7fe7040b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 -- 172.21.15.93:0/326510031 shutdown_connections 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.381+0000 7fe70930f640 1 -- 172.21.15.93:0/326510031 wait complete. 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.382+0000 7fe70930f640 1 Processor -- start 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.382+0000 7fe70930f640 1 -- start start 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 0x7fe7040c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 0x7fe70406def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70406e430 con 0x7fe7040c93c0 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040c3680 con 0x7fe6f0003970 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe70930f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040c4200 con 0x7fe70406da70 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:42924/0 (socket says 172.21.15.93:42924) 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 -- 172.21.15.93:0/38120290 learned_addr learned my addr 172.21.15.93:0/38120290 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe702ffd640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 0x7fe7040c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe7037fe640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 0x7fe70406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 -- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 msgr2=0x7fe70406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 0x7fe70406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 -- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 msgr2=0x7fe7040c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 0x7fe7040c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe6fbfff640 1 -- 172.21.15.93:0/38120290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040c38d0 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe7037fe640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 0x7fe70406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.383+0000 7fe702ffd640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 0x7fe7040c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe6fbfff640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00e7e0 tx=0x7fe6ec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00c870 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec00c9f0 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00cda0 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040c3bb0 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.384+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040c9840 con 0x7fe7040c93c0 2023-11-04T01:43:21.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.385+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040684b0 con 0x7fe7040c93c0 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.385+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6ec01d460 con 0x7fe7040c93c0 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.386+0000 7fe6fb7fe640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 0x7fe6e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.386+0000 7fe702ffd640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 0x7fe6e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.386+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fe6ec089ea0 con 0x7fe7040c93c0 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.386+0000 7fe702ffd640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 0x7fe6e406d360 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4033000 tx=0x7fe6f4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.390+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6ec0545b0 con 0x7fe7040c93c0 2023-11-04T01:43:21.593 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.592+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe70415e180 con 0x7fe7040c93c0 2023-11-04T01:43:21.594 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.593+0000 7fe6fb7fe640 1 -- 172.21.15.93:0/38120290 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4946 (secure 0 0 0) 0x7fe6ec057bd0 con 0x7fe7040c93c0 2023-11-04T01:43:21.594 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:21.594 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:13.934419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 114 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 msgr2=0x7fe6e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 0x7fe6e406d360 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4033000 tx=0x7fe6f4009030 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 msgr2=0x7fe704153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00e7e0 tx=0x7fe6ec00eca0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 shutdown_connections 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fe6e406aea0 0x7fe6e406d360 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fe70406da70 0x7fe70406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7040c93c0 0x7fe704153120 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 --2- 172.21.15.93:0/38120290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6f0003970 0x7fe7040c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 >> 172.21.15.93:0/38120290 conn(0x7fe7040b1640 msgr2=0x7fe7040ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 shutdown_connections 2023-11-04T01:43:21.597 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:21.595+0000 7fe70930f640 1 -- 172.21.15.93:0/38120290 wait complete. 2023-11-04T01:43:21.607 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:22.607 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:22.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:22.703 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:22.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.712+0000 7f90a1ed4640 1 Processor -- start 2023-11-04T01:43:22.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.712+0000 7f90a1ed4640 1 -- start start 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f90a1ed4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f909c15b200 0x7f909c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f90a1ed4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0cde80 con 0x7f909c0afda0 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f90a1ed4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0cf670 con 0x7f909c0cd9c0 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f90a1ed4640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0cf950 con 0x7f909c15b200 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f909affd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f909c0afda0 0x7f909c0cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33224/0 (socket says 172.21.15.93:33224) 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f909affd640 1 -- 172.21.15.93:0/1590475880 learned_addr learned my addr 172.21.15.93:0/1590475880 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.713+0000 7f909b7fe640 1 --2- 172.21.15.93:0/1590475880 >> v2:172.21.15.125:3300/0 conn(0x7f909c15b200 0x7f909c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.714+0000 7f909a7fc640 1 -- 172.21.15.93:0/1590475880 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783994085 0 0) 0x7f909c0cde80 con 0x7f909c0afda0 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.714+0000 7f909a7fc640 1 -- 172.21.15.93:0/1590475880 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9084003520 con 0x7f909c0afda0 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.714+0000 7f909b7fe640 1 -- 172.21.15.93:0/1590475880 >> v1:172.21.15.125:6789/0 conn(0x7f909c0cd9c0 legacy=0x7f909c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.714+0000 7f909b7fe640 1 -- 172.21.15.93:0/1590475880 >> v1:172.21.15.93:6789/0 conn(0x7f909c0afda0 legacy=0x7f909c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.714+0000 7f909b7fe640 1 -- 172.21.15.93:0/1590475880 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0ce120 con 0x7f909c15b200 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f909b7fe640 1 --2- 172.21.15.93:0/1590475880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c15b200 0x7f909c0ceb30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f908c009790 tx=0x7f908c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e12a4757bbe6ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f909a7fc640 1 -- 172.21.15.93:0/1590475880 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c031830 con 0x7f909c15b200 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f909a7fc640 1 -- 172.21.15.93:0/1590475880 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c031990 con 0x7f909c15b200 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f909a7fc640 1 -- 172.21.15.93:0/1590475880 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c031d20 con 0x7f909c15b200 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f90a1ed4640 1 -- 172.21.15.93:0/1590475880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c15b200 msgr2=0x7f909c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/1590475880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c15b200 0x7f909c0ceb30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f908c009790 tx=0x7f908c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f90a1ed4640 1 -- 172.21.15.93:0/1590475880 shutdown_connections 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.715+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/1590475880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c15b200 0x7f909c0ceb30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.716+0000 7f90a1ed4640 1 -- 172.21.15.93:0/1590475880 >> 172.21.15.93:0/1590475880 conn(0x7f909c0d0c30 msgr2=0x7f909c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.716+0000 7f90a1ed4640 1 -- 172.21.15.93:0/1590475880 shutdown_connections 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.716+0000 7f90a1ed4640 1 -- 172.21.15.93:0/1590475880 wait complete. 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.717+0000 7f90a1ed4640 1 Processor -- start 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.717+0000 7f90a1ed4640 1 -- start start 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c0cd9c0 0x7f909c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f909c15b200 0x7f909c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0caf70 con 0x7f909c0afda0 2023-11-04T01:43:22.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c14ab80 con 0x7f909c0cd9c0 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0c70a0 con 0x7f909c15b200 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35144/0 (socket says 172.21.15.93:35144) 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 -- 172.21.15.93:0/2662060162 learned_addr learned my addr 172.21.15.93:0/2662060162 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909affd640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c0cd9c0 0x7f909c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909bfff640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f909c15b200 0x7f909c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 -- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f909c15b200 msgr2=0x7f909c14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f909c15b200 0x7f909c14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 -- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c0cd9c0 msgr2=0x7f909c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c0cd9c0 0x7f909c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 -- 172.21.15.93:0/2662060162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0093a0 con 0x7f909c0afda0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f909b7fe640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f908c02bee0 tx=0x7f908c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c03a6f0 con 0x7f909c0afda0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c03a870 con 0x7f909c0afda0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0c7370 con 0x7f909c0afda0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c03ac20 con 0x7f909c0afda0 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.718+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c1f6290 con 0x7f909c0afda0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.720+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0684b0 con 0x7f909c0afda0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.720+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f908c04c3b0 con 0x7f909c0afda0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.720+0000 7f9083fff640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 0x7f908806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.721+0000 7f909affd640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 0x7f908806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.720+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f908c0abb20 con 0x7f909c0afda0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.721+0000 7f909affd640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 0x7f908806d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f909c1f61f0 tx=0x7f9090007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.725+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f908c0762e0 con 0x7f909c0afda0 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.928+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f909c0aeba0 con 0x7f909c0afda0 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.929+0000 7f9083fff640 1 -- 172.21.15.93:0/2662060162 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f908c048090 con 0x7f909c0afda0 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:21.146000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 115 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 msgr2=0x7f908806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 0x7f908806d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f909c1f61f0 tx=0x7f9090007d30 comp rx=0 tx=0).stop 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 msgr2=0x7f909c1f6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f908c02bee0 tx=0x7f908c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 shutdown_connections 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f908806ae70 0x7f908806d330 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f909c15b200 0x7f909c14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f909c0cd9c0 0x7f909c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 --2- 172.21.15.93:0/2662060162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f909c0afda0 0x7f909c1f6d70 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.930+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 >> 172.21.15.93:0/2662060162 conn(0x7f909c0d0c30 msgr2=0x7f909c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.931+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 shutdown_connections 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:22.931+0000 7f90a1ed4640 1 -- 172.21.15.93:0/2662060162 wait complete. 2023-11-04T01:43:22.942 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:43:23.943 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:24.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.044+0000 7f3ddfd97640 1 Processor -- start 2023-11-04T01:43:24.045 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.044+0000 7f3ddfd97640 1 -- start start 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddfd97640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dd80cc680 0x7f3dd80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddfd97640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80cd720 con 0x7f3dd806c220 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddfd97640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80ae1b0 con 0x7f3dd80addd0 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddfd97640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80ccb10 con 0x7f3dd80cc680 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3dde334640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3dd806c220 0x7f3dd806f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33234/0 (socket says 172.21.15.93:33234) 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3dde334640 1 -- 172.21.15.93:0/4193094228 learned_addr learned my addr 172.21.15.93:0/4193094228 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddd332640 1 --2- 172.21.15.93:0/4193094228 >> v2:172.21.15.125:3300/0 conn(0x7f3dd80cc680 0x7f3dd80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584820426 0 0) 0x7f3dd80cd720 con 0x7f3dd806c220 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc4004630 con 0x7f3dd806c220 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300097475 0 0) 0x7f3dc4004630 con 0x7f3dd806c220 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 >> v2:172.21.15.125:3300/0 conn(0x7f3dd80cc680 msgr2=0x7f3dd80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.049 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 --2- 172.21.15.93:0/4193094228 >> v2:172.21.15.125:3300/0 conn(0x7f3dd80cc680 0x7f3dd80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 >> v1:172.21.15.125:6789/0 conn(0x7f3dd80addd0 legacy=0x7f3dd806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80ccdf0 con 0x7f3dd806c220 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f3dd00019f0 con 0x7f3dd806c220 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 >> v1:172.21.15.93:6789/0 conn(0x7f3dd806c220 legacy=0x7f3dd806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc4004a80 0x7f3dc4004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 0x7f3dc4005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dc4006290 0x7f3dc400ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80ccb10 con 0x7f3dc40058d0 2023-11-04T01:43:24.050 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400d130 con 0x7f3dc4004a80 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400d2f0 con 0x7f3dc4006290 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3ddd332640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 0x7f3dc4005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.045+0000 7f3dddb33640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc4004a80 0x7f3dc4004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3dde334640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dc4006290 0x7f3dc400ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 -- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dc4006290 msgr2=0x7f3dc400ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dc4006290 0x7f3dc400ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 -- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc4004a80 msgr2=0x7f3dc4004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc4004a80 0x7f3dc4004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 -- 172.21.15.93:0/4193094228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4004630 con 0x7f3dc40058d0 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3dde334640 1 -- 172.21.15.93:0/4193094228 reap_dead start 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.046+0000 7f3ddd332640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 0x7f3dc4005d50 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009ac0 tx=0x7f3dc4006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12a6b16cb122a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.051 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc802c6d0 con 0x7f3dc40058d0 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802c830 con 0x7f3dc40058d0 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddcb31640 1 -- 172.21.15.93:0/4193094228 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc802cbc0 con 0x7f3dc40058d0 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 -- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 msgr2=0x7f3dc4005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 0x7f3dc4005d50 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009ac0 tx=0x7f3dc4006900 comp rx=0 tx=0).stop 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 -- 172.21.15.93:0/4193094228 shutdown_connections 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/4193094228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dc40058d0 0x7f3dc4005d50 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 -- 172.21.15.93:0/4193094228 >> 172.21.15.93:0/4193094228 conn(0x7f3dd80cb530 msgr2=0x7f3dd80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 -- 172.21.15.93:0/4193094228 shutdown_connections 2023-11-04T01:43:24.052 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.047+0000 7f3ddfd97640 1 -- 172.21.15.93:0/4193094228 wait complete. 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.048+0000 7f3ddfd97640 1 Processor -- start 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.048+0000 7f3ddfd97640 1 -- start start 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40058d0 0x7f3dd8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dd8155810 0x7f3dd81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c7b00 con 0x7f3dd8155c90 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81f6590 con 0x7f3dc40058d0 2023-11-04T01:43:24.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3ddfd97640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81f6870 con 0x7f3dd8155810 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35168/0 (socket says 172.21.15.93:35168) 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 -- 172.21.15.93:0/2308137447 learned_addr learned my addr 172.21.15.93:0/2308137447 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 -- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dd8155810 msgr2=0x7f3dd81565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dd8155810 0x7f3dd81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 -- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40058d0 msgr2=0x7f3dd8154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40058d0 0x7f3dd8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 -- 172.21.15.93:0/2308137447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd81f6b50 con 0x7f3dd8155c90 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.049+0000 7f3dde334640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3dd815cf60 tx=0x7f3dd000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0007ae0 con 0x7f3dd8155c90 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000ee20 con 0x7f3dd8155c90 2023-11-04T01:43:24.056 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81f6e30 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0013660 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd81f61f0 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.050+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80c7c40 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.051+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dd00137c0 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.051+0000 7f3dce7fc640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.051+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f3dd008a430 con 0x7f3dd8155c90 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.052+0000 7f3dddb33640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.052+0000 7f3dddb33640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 0x7f3dbc06d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.057 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.056+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3dd0054b40 con 0x7f3dd8155c90 2023-11-04T01:43:24.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.259+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd80684b0 con 0x7f3dd8155c90 2023-11-04T01:43:24.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.259+0000 7f3dce7fc640 1 -- 172.21.15.93:0/2308137447 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f3dd0058160 con 0x7f3dd8155c90 2023-11-04T01:43:24.261 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:24.261 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:22.149315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:24.261 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 116 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 msgr2=0x7f3dbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 0x7f3dbc06d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 msgr2=0x7f3dd8153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3dd815cf60 tx=0x7f3dd000e530 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 shutdown_connections 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3dd8155c90 0x7f3dd8153d50 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f3dd8155810 0x7f3dd81565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 --2- 172.21.15.93:0/2308137447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40058d0 0x7f3dd8154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 >> 172.21.15.93:0/2308137447 conn(0x7f3dd80cb530 msgr2=0x7f3dd80afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.263 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 shutdown_connections 2023-11-04T01:43:24.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.261+0000 7f3ddfd97640 1 -- 172.21.15.93:0/2308137447 wait complete. 2023-11-04T01:43:24.273 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:43:24.273 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.666627883911133s 2023-11-04T01:43:24.273 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:24.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:24.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:43:24.300 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:43:24.300 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:24.356 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:24.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.494+0000 7f2c43997640 1 Processor -- start 2023-11-04T01:43:24.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.494+0000 7f2c43997640 1 -- start start 2023-11-04T01:43:24.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c3c159e40 0x7f2c3c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2c3c06bb60 0x7f2c3c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c06fff0 0x7f2c3c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c071500 con 0x7f2c3c159e40 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c15dae0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c43997640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0709a0 con 0x7f2c3c06fff0 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c3c159e40 0x7f2c3c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2c3c159e40 0x7f2c3c0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35176/0 (socket says 172.21.15.93:35176) 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 -- 172.21.15.93:0/2367393513 learned_addr learned my addr 172.21.15.93:0/2367393513 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 -- 172.21.15.93:0/2367393513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c06fff0 msgr2=0x7f2c3c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 --2- 172.21.15.93:0/2367393513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c06fff0 0x7f2c3c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 -- 172.21.15.93:0/2367393513 >> v2:172.21.15.125:3300/0 conn(0x7f2c3c06bb60 msgr2=0x7f2c3c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 --2- 172.21.15.93:0/2367393513 >> v2:172.21.15.125:3300/0 conn(0x7f2c3c06bb60 0x7f2c3c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.495+0000 7f2c41733640 1 -- 172.21.15.93:0/2367393513 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c070c60 con 0x7f2c3c159e40 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c41733640 1 --2- 172.21.15.93:0/2367393513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c159e40 0x7f2c3c0b0530 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06fdc0 tx=0x7f2c3802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2daa4a395770d01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c33fff640 1 -- 172.21.15.93:0/2367393513 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380317e0 con 0x7f2c3c159e40 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c33fff640 1 -- 172.21.15.93:0/2367393513 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38031940 con 0x7f2c3c159e40 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c33fff640 1 -- 172.21.15.93:0/2367393513 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38031cd0 con 0x7f2c3c159e40 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 -- 172.21.15.93:0/2367393513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c159e40 msgr2=0x7f2c3c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 --2- 172.21.15.93:0/2367393513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c159e40 0x7f2c3c0b0530 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06fdc0 tx=0x7f2c3802b880 comp rx=0 tx=0).stop 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 -- 172.21.15.93:0/2367393513 shutdown_connections 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 --2- 172.21.15.93:0/2367393513 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c06fff0 0x7f2c3c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 --2- 172.21.15.93:0/2367393513 >> v2:172.21.15.125:3300/0 conn(0x7f2c3c06bb60 0x7f2c3c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 --2- 172.21.15.93:0/2367393513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c159e40 0x7f2c3c0b0530 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.496+0000 7f2c43997640 1 -- 172.21.15.93:0/2367393513 >> 172.21.15.93:0/2367393513 conn(0x7f2c3c0cb530 msgr2=0x7f2c3c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.499 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.497+0000 7f2c43997640 1 -- 172.21.15.93:0/2367393513 shutdown_connections 2023-11-04T01:43:24.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.497+0000 7f2c43997640 1 -- 172.21.15.93:0/2367393513 wait complete. 2023-11-04T01:43:24.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 Processor -- start 2023-11-04T01:43:24.500 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 -- start start 2023-11-04T01:43:24.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 0x7f2c3c14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c159e40 0x7f2c3c0c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0cd240 con 0x7f2c3c06bb60 2023-11-04T01:43:24.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c1f3450 con 0x7f2c3c06fff0 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c43997640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0cd490 con 0x7f2c3c159e40 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c41733640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c41733640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35192/0 (socket says 172.21.15.93:35192) 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.498+0000 7f2c41733640 1 -- 172.21.15.93:0/3477129611 learned_addr learned my addr 172.21.15.93:0/3477129611 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c40f32640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 0x7f2c3c14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41f34640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c159e40 0x7f2c3c0c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 -- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c159e40 msgr2=0x7f2c3c0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c159e40 0x7f2c3c0c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 -- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 msgr2=0x7f2c3c14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 0x7f2c3c14ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 -- 172.21.15.93:0/3477129611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380094d0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c40f32640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 0x7f2c3c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.503 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c41733640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2c3802b8c0 tx=0x7f2c380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38032940 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38032aa0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c0cd770 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38032e50 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.499+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0cdd30 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.500+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c0684b0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.501+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c3804e450 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.501+0000 7f2c31ffb640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 0x7f2c2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.501+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f2c380ac200 con 0x7f2c3c06bb60 2023-11-04T01:43:24.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.501+0000 7f2c40f32640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 0x7f2c2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.505 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.502+0000 7f2c40f32640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 0x7f2c2006d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c14d740 tx=0x7f2c2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.506 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.505+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c380769c0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.522 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:43:24.522+0000 7fb9cb3c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:24.522 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:43:24.522+0000 7fb9cb3c1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:24.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.674+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c3c0c9750 con 0x7f2c3c06bb60 2023-11-04T01:43:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.675+0000 7f2c31ffb640 1 -- 172.21.15.93:0/3477129611 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23626 (secure 0 0 0) 0x7f2c38079fe0 con 0x7f2c3c06bb60 2023-11-04T01:43:24.677 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:24.677 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":116,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:43:21.135203+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.6","mappings":[{"from":0,"to":5}]},{"pgid":"17.9","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2573507659":"2023-11-04T02:43:20.792492+0000","172.21.15.125:6834/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6832/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6833/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6834/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.125:6832/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.93:6834/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.125:6833/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6834/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6832/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6834/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6835/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6836/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.93:6836/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3505063928":"2023-11-04T02:42:36.804546+0000","172.21.15.125:6832/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.125:6834/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.93:6834/3572539978":"2023-11-05T01:41:36.780916+0000","172.21.15.93:6834/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3671080369":"2023-11-04T02:41:51.893134+0000","172.21.15.125:6835/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/3572539978":"2023-11-05T01:41:36.780916+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 msgr2=0x7f2c2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 0x7f2c2006d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c14d740 tx=0x7f2c2c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:24.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 msgr2=0x7f2c3c1f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2c3802b8c0 tx=0x7f2c380046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 shutdown_connections 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2c2006ae70 0x7f2c2006d330 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2c3c159e40 0x7f2c3c0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c3c06fff0 0x7f2c3c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 --2- 172.21.15.93:0/3477129611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c3c06bb60 0x7f2c3c1f2f10 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 >> 172.21.15.93:0/3477129611 conn(0x7f2c3c0cb530 msgr2=0x7f2c3c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 shutdown_connections 2023-11-04T01:43:24.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.678+0000 7f2c43997640 1 -- 172.21.15.93:0/3477129611 wait complete. 2023-11-04T01:43:24.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:10.941170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:11.841942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:24.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:24.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.791+0000 7f4515378640 1 Processor -- start 2023-11-04T01:43:24.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.791+0000 7f4515378640 1 -- start start 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f4515378640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f451015d100 0x7f45100ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f4515378640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 0x7f45100b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f4515378640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100b32b0 con 0x7f451015d4e0 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f4515378640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100cee10 con 0x7f451015d100 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f4515378640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b2980 con 0x7f45100d1be0 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f451015d100 0x7f45100ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f451015d100 0x7f45100ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35196/0 (socket says 172.21.15.93:35196) 2023-11-04T01:43:24.794 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450e7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f451015d4e0 0x7f45100d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33238/0 (socket says 172.21.15.93:33238) 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450e7fc640 1 -- 172.21.15.93:0/2260522220 learned_addr learned my addr 172.21.15.93:0/2260522220 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450f7fe640 1 --2- 172.21.15.93:0/2260522220 >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 0x7f45100b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 -- 172.21.15.93:0/2260522220 >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 msgr2=0x7f45100b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 --2- 172.21.15.93:0/2260522220 >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 0x7f45100b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 -- 172.21.15.93:0/2260522220 >> v1:172.21.15.93:6789/0 conn(0x7f451015d4e0 legacy=0x7f45100d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450effd640 1 -- 172.21.15.93:0/2260522220 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100b2c60 con 0x7f451015d100 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450dffb640 1 -- 172.21.15.93:0/2260522220 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402870936 0 0) 0x7f45100b32b0 con 0x7f451015d4e0 2023-11-04T01:43:24.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.792+0000 7f450f7fe640 1 --2- 172.21.15.93:0/2260522220 >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 0x7f45100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.793+0000 7f450effd640 1 --2- 172.21.15.93:0/2260522220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d100 0x7f45100ce510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f451008d6a0 tx=0x7f450002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c9cbaff193bc0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.793+0000 7f450dffb640 1 -- 172.21.15.93:0/2260522220 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450002ccb0 con 0x7f451015d100 2023-11-04T01:43:24.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.793+0000 7f450dffb640 1 -- 172.21.15.93:0/2260522220 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450002ce10 con 0x7f451015d100 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.793+0000 7f450dffb640 1 -- 172.21.15.93:0/2260522220 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500034660 con 0x7f451015d100 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 -- 172.21.15.93:0/2260522220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d100 msgr2=0x7f45100ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 --2- 172.21.15.93:0/2260522220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d100 0x7f45100ce510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f451008d6a0 tx=0x7f450002bf00 comp rx=0 tx=0).stop 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 -- 172.21.15.93:0/2260522220 shutdown_connections 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 --2- 172.21.15.93:0/2260522220 >> v2:172.21.15.125:3300/0 conn(0x7f45100d1be0 0x7f45100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 --2- 172.21.15.93:0/2260522220 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d100 0x7f45100ce510 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 -- 172.21.15.93:0/2260522220 >> 172.21.15.93:0/2260522220 conn(0x7f45100d2ef0 msgr2=0x7f45100d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 -- 172.21.15.93:0/2260522220 shutdown_connections 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.794+0000 7f4515378640 1 -- 172.21.15.93:0/2260522220 wait complete. 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.795+0000 7f4515378640 1 Processor -- start 2023-11-04T01:43:24.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.795+0000 7f4515378640 1 -- start start 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45100d1be0 0x7f45100b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f451015d100 0x7f451015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ca580 con 0x7f451015d4e0 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ca860 con 0x7f45100d1be0 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f4515378640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100cab40 con 0x7f451015d100 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35202/0 (socket says 172.21.15.93:35202) 2023-11-04T01:43:24.800 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 -- 172.21.15.93:0/1752515369 learned_addr learned my addr 172.21.15.93:0/1752515369 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450effd640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45100d1be0 0x7f45100b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450e7fc640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f451015d100 0x7f451015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 -- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f451015d100 msgr2=0x7f451015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f451015d100 0x7f451015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 -- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45100d1be0 msgr2=0x7f45100b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45100d1be0 0x7f45100b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.796+0000 7f450f7fe640 1 -- 172.21.15.93:0/1752515369 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009a70 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f450f7fe640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f450800c7c0 tx=0x7f450800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508004230 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508004390 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45100cae20 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508007860 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.797+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451015abf0 con 0x7f451015d4e0 2023-11-04T01:43:24.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.798+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100cd9c0 con 0x7f451015d4e0 2023-11-04T01:43:24.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.798+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45080079c0 con 0x7f451015d4e0 2023-11-04T01:43:24.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.799+0000 7f44f77fe640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 0x7f44fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.799+0000 7f450effd640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 0x7f44fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.799+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f450808a170 con 0x7f451015d4e0 2023-11-04T01:43:24.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.799+0000 7f450effd640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 0x7f44fc06d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4500036000 tx=0x7f4500030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.803+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4508054a80 con 0x7f451015d4e0 2023-11-04T01:43:24.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.968+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45100684b0 con 0x7f451015d4e0 2023-11-04T01:43:24.969 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.968+0000 7f44f77fe640 1 -- 172.21.15.93:0/1752515369 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45080150a0 con 0x7f451015d4e0 2023-11-04T01:43:24.969 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:43:24.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 msgr2=0x7f44fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 0x7f44fc06d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4500036000 tx=0x7f4500030000 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 msgr2=0x7f45100b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f450800c7c0 tx=0x7f450800cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 shutdown_connections 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f44fc06ae70 0x7f44fc06d330 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f451015d4e0 0x7f45100b4dd0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f451015d100 0x7f451015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 --2- 172.21.15.93:0/1752515369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45100d1be0 0x7f45100b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 >> 172.21.15.93:0/1752515369 conn(0x7f45100d2ef0 msgr2=0x7f451015c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 shutdown_connections 2023-11-04T01:43:24.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:24.970+0000 7f4515378640 1 -- 172.21.15.93:0/1752515369 wait complete. 2023-11-04T01:43:24.982 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:25.085 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.084+0000 7f6d9ad90640 1 Processor -- start 2023-11-04T01:43:25.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.084+0000 7f6d9ad90640 1 -- start start 2023-11-04T01:43:25.086 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9ad90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d9415d4e0 0x7f6d940ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9ad90640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d940ca8b0 0x7f6d9406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9ad90640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940b25a0 con 0x7f6d940ced90 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9ad90640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940b2300 con 0x7f6d940ca8b0 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9ad90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9415d8c0 con 0x7f6d9415d4e0 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9932d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d940ca8b0 0x7f6d9406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d93fff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6d940ced90 0x7f6d940ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33246/0 (socket says 172.21.15.93:33246) 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d93fff640 1 -- 172.21.15.93:0/4180178394 learned_addr learned my addr 172.21.15.93:0/4180178394 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9932d640 1 -- 172.21.15.93:0/4180178394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d9415d4e0 msgr2=0x7f6d940ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9932d640 1 --2- 172.21.15.93:0/4180178394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d9415d4e0 0x7f6d940ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9932d640 1 -- 172.21.15.93:0/4180178394 >> v1:172.21.15.93:6789/0 conn(0x7f6d940ced90 legacy=0x7f6d940ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.087 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.085+0000 7f6d9932d640 1 -- 172.21.15.93:0/4180178394 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9415e5f0 con 0x7f6d940ca8b0 2023-11-04T01:43:25.088 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.086+0000 7f6d9932d640 1 --2- 172.21.15.93:0/4180178394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d9406a0d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009d90 tx=0x7f6d8c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1588d1783cbd8e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.086+0000 7f6d937fe640 1 -- 172.21.15.93:0/4180178394 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c02cc50 con 0x7f6d940ca8b0 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.086+0000 7f6d937fe640 1 -- 172.21.15.93:0/4180178394 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c02cdb0 con 0x7f6d940ca8b0 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.086+0000 7f6d937fe640 1 -- 172.21.15.93:0/4180178394 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c034660 con 0x7f6d940ca8b0 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 -- 172.21.15.93:0/4180178394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 msgr2=0x7f6d9406a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/4180178394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d9406a0d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009d90 tx=0x7f6d8c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 -- 172.21.15.93:0/4180178394 shutdown_connections 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/4180178394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d9406a0d0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/4180178394 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d9415d4e0 0x7f6d940ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 -- 172.21.15.93:0/4180178394 >> 172.21.15.93:0/4180178394 conn(0x7f6d940b1640 msgr2=0x7f6d940b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 -- 172.21.15.93:0/4180178394 shutdown_connections 2023-11-04T01:43:25.089 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.087+0000 7f6d9ad90640 1 -- 172.21.15.93:0/4180178394 wait complete. 2023-11-04T01:43:25.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.088+0000 7f6d9ad90640 1 Processor -- start 2023-11-04T01:43:25.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.088+0000 7f6d9ad90640 1 -- start start 2023-11-04T01:43:25.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940ced90 0x7f6d940b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.091 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d9415d4e0 0x7f6d94146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c5590 con 0x7f6d940ca8b0 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940b51a0 con 0x7f6d9415d4e0 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d9ad90640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940b2cb0 con 0x7f6d940ced90 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35224/0 (socket says 172.21.15.93:35224) 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 -- 172.21.15.93:0/1974456614 learned_addr learned my addr 172.21.15.93:0/1974456614 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 -- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940ced90 msgr2=0x7f6d940b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940ced90 0x7f6d940b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 -- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d9415d4e0 msgr2=0x7f6d94146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d9415d4e0 0x7f6d94146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 -- 172.21.15.93:0/1974456614 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009a70 con 0x7f6d940ca8b0 2023-11-04T01:43:25.092 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d98b2c640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b410 tx=0x7f6d8800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011830 con 0x7f6d940ca8b0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.089+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880119b0 con 0x7f6d940ca8b0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.090+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011d60 con 0x7f6d940ca8b0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.090+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940b5440 con 0x7f6d940ca8b0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.090+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940c4ed0 con 0x7f6d940ca8b0 2023-11-04T01:43:25.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.090+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d940684b0 con 0x7f6d940ca8b0 2023-11-04T01:43:25.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.091+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d8801a400 con 0x7f6d940ca8b0 2023-11-04T01:43:25.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.091+0000 7f6d917fa640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 0x7f6d7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.091+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f6d8808a130 con 0x7f6d940ca8b0 2023-11-04T01:43:25.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.091+0000 7f6d93fff640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 0x7f6d7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.092+0000 7f6d93fff640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 0x7f6d7806d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6d94070e00 tx=0x7f6d80007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.095+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d88054840 con 0x7f6d940ca8b0 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.260+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f6d94066700 con 0x7f6d940ca8b0 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.261+0000 7f6d917fa640 1 -- 172.21.15.93:0/1974456614 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6d88015020 con 0x7f6d940ca8b0 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 msgr2=0x7f6d7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 0x7f6d7806d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6d94070e00 tx=0x7f6d80007a40 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 msgr2=0x7f6d94145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b410 tx=0x7f6d8800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 shutdown_connections 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f6d7806ae70 0x7f6d7806d330 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.262+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d9415d4e0 0x7f6d94146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.263+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f6d940ced90 0x7f6d940b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.263+0000 7f6d9ad90640 1 --2- 172.21.15.93:0/1974456614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d940ca8b0 0x7f6d94145ae0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.263+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 >> 172.21.15.93:0/1974456614 conn(0x7f6d940b1640 msgr2=0x7f6d94158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.263+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 shutdown_connections 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.263+0000 7f6d9ad90640 1 -- 172.21.15.93:0/1974456614 wait complete. 2023-11-04T01:43:25.274 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.375+0000 7ff3de826640 1 Processor -- start 2023-11-04T01:43:25.377 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.375+0000 7ff3de826640 1 -- start start 2023-11-04T01:43:25.378 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff3d815d100 0x7ff3d80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff3d815d4e0 0x7ff3d80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d80d3b60 0x7ff3d80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d80b32b0 con 0x7ff3d815d100 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d80cee10 con 0x7ff3d815d4e0 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3de826640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d80b2980 con 0x7ff3d80d3b60 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3d7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff3d815d100 0x7ff3d80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3d7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff3d815d100 0x7ff3d80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35236/0 (socket says 172.21.15.93:35236) 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.376+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1313026022 learned_addr learned my addr 172.21.15.93:0/1313026022 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d77fe640 1 --2- 172.21.15.93:0/1313026022 >> v2:172.21.15.125:3300/0 conn(0x7ff3d815d4e0 0x7ff3d80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3dcdc3640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d80d3b60 0x7ff3d80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.379 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1313026022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d80d3b60 msgr2=0x7ff3d80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d80d3b60 0x7ff3d80d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1313026022 >> v2:172.21.15.125:3300/0 conn(0x7ff3d815d4e0 msgr2=0x7ff3d80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1313026022 >> v2:172.21.15.125:3300/0 conn(0x7ff3d815d4e0 0x7ff3d80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1313026022 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d80b2c60 con 0x7ff3d815d100 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.377+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d815d100 0x7ff3d80ce510 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8160da0 tx=0x7ff3cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58edf6997a35f03 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3d6ffd640 1 -- 172.21.15.93:0/1313026022 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004230 con 0x7ff3d815d100 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3d6ffd640 1 -- 172.21.15.93:0/1313026022 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc004390 con 0x7ff3d815d100 2023-11-04T01:43:25.380 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3d6ffd640 1 -- 172.21.15.93:0/1313026022 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc003810 con 0x7ff3d815d100 2023-11-04T01:43:25.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 -- 172.21.15.93:0/1313026022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d815d100 msgr2=0x7ff3d80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d815d100 0x7ff3d80ce510 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8160da0 tx=0x7ff3cc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.383 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 -- 172.21.15.93:0/1313026022 shutdown_connections 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d80d3b60 0x7ff3d80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 --2- 172.21.15.93:0/1313026022 >> v2:172.21.15.125:3300/0 conn(0x7ff3d815d4e0 0x7ff3d80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 --2- 172.21.15.93:0/1313026022 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d815d100 0x7ff3d80ce510 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 -- 172.21.15.93:0/1313026022 >> 172.21.15.93:0/1313026022 conn(0x7ff3d80d2ef0 msgr2=0x7ff3d80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 -- 172.21.15.93:0/1313026022 shutdown_connections 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.378+0000 7ff3de826640 1 -- 172.21.15.93:0/1313026022 wait complete. 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.379+0000 7ff3de826640 1 Processor -- start 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 -- start start 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.384 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 0x7ff3d80b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3d815d4e0 0x7ff3d80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d80ca4b0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d80b6ed0 con 0x7ff3d815d4e0 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3de826640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d80b71b0 con 0x7ff3d815d100 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3d7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3d7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35248/0 (socket says 172.21.15.93:35248) 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1820463908 learned_addr learned my addr 172.21.15.93:0/1820463908 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3d77fe640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 0x7ff3d80b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.380+0000 7ff3dcdc3640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3d815d4e0 0x7ff3d80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 msgr2=0x7ff3d80b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 0x7ff3d80b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.385 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3d815d4e0 msgr2=0x7ff3d80cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3d815d4e0 0x7ff3d80cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 -- 172.21.15.93:0/1820463908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009460 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d77fe640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 0x7ff3d80b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d7fff640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc003c40 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc03f070 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d80ca140 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004500 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.381+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d80b69c0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.382+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d80c9fa0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.386 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.382+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3cc041030 con 0x7ff3d80d3b60 2023-11-04T01:43:25.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.383+0000 7ff3d4ff9640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 0x7ff3c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.383+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ff3cc0ac2b0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.383+0000 7ff3d77fe640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 0x7ff3c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.383+0000 7ff3d77fe640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 0x7ff3c406d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80b1e40 tx=0x7ff3c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.387+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3d80c9fa0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.552+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff3d80c9fa0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.552+0000 7ff3d4ff9640 1 -- 172.21.15.93:0/1820463908 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff3d80c9fa0 con 0x7ff3d80d3b60 2023-11-04T01:43:25.554 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 msgr2=0x7ff3c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 0x7ff3c406d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80b1e40 tx=0x7ff3c8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 msgr2=0x7ff3d815c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 shutdown_connections 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff3c406ae70 0x7ff3c406d330 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3d815d4e0 0x7ff3d80cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ff3d815d100 0x7ff3d80b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 --2- 172.21.15.93:0/1820463908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3d80d3b60 0x7ff3d815c500 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.554+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 >> 172.21.15.93:0/1820463908 conn(0x7ff3d80d2ef0 msgr2=0x7ff3d80b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.555+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 shutdown_connections 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.555+0000 7ff3de826640 1 -- 172.21.15.93:0/1820463908 wait complete. 2023-11-04T01:43:25.566 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:25.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.667+0000 7f2a54000640 1 Processor -- start 2023-11-04T01:43:25.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.668+0000 7f2a54000640 1 -- start start 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.668+0000 7f2a54000640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2a4c15d100 0x7f2a4c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.668+0000 7f2a54000640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a4c15d4e0 0x7f2a4c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.668+0000 7f2a54000640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c0b32b0 con 0x7f2a4c0d3b60 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.668+0000 7f2a54000640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0cee10 con 0x7f2a4c15d100 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a54000640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b4750 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2a4c15d100 0x7f2a4c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2a4c15d100 0x7f2a4c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35256/0 (socket says 172.21.15.93:35256) 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 -- 172.21.15.93:0/2957331335 learned_addr learned my addr 172.21.15.93:0/2957331335 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a5259d640 1 --1- 172.21.15.93:0/2957331335 >> v1:172.21.15.93:6789/0 conn(0x7f2a4c0d3b60 0x7f2a4c0cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33256/0 (socket says 172.21.15.93:33256) 2023-11-04T01:43:25.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a5159b640 1 --2- 172.21.15.93:0/2957331335 >> v2:172.21.15.125:3300/0 conn(0x7f2a4c15d4e0 0x7f2a4c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 -- 172.21.15.93:0/2957331335 >> v2:172.21.15.125:3300/0 conn(0x7f2a4c15d4e0 msgr2=0x7f2a4c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2957331335 >> v2:172.21.15.125:3300/0 conn(0x7f2a4c15d4e0 0x7f2a4c0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a50d9a640 1 -- 172.21.15.93:0/2957331335 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279586301 0 0) 0x7f2a4c0b32b0 con 0x7f2a4c0d3b60 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 -- 172.21.15.93:0/2957331335 >> v1:172.21.15.93:6789/0 conn(0x7f2a4c0d3b60 legacy=0x7f2a4c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.669+0000 7f2a51d9c640 1 -- 172.21.15.93:0/2957331335 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0b2980 con 0x7f2a4c15d100 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2957331335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d100 0x7f2a4c0ce510 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c160da0 tx=0x7f2a4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2494020e4fd66add server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a50d9a640 1 -- 172.21.15.93:0/2957331335 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48004230 con 0x7f2a4c15d100 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a50d9a640 1 -- 172.21.15.93:0/2957331335 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48004390 con 0x7f2a4c15d100 2023-11-04T01:43:25.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a50d9a640 1 -- 172.21.15.93:0/2957331335 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48030840 con 0x7f2a4c15d100 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 -- 172.21.15.93:0/2957331335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d100 msgr2=0x7f2a4c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 --2- 172.21.15.93:0/2957331335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d100 0x7f2a4c0ce510 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c160da0 tx=0x7f2a4802b980 comp rx=0 tx=0).stop 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 -- 172.21.15.93:0/2957331335 shutdown_connections 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 --2- 172.21.15.93:0/2957331335 >> v2:172.21.15.125:3300/0 conn(0x7f2a4c15d4e0 0x7f2a4c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 --2- 172.21.15.93:0/2957331335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d100 0x7f2a4c0ce510 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 -- 172.21.15.93:0/2957331335 >> 172.21.15.93:0/2957331335 conn(0x7f2a4c0d2ef0 msgr2=0x7f2a4c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 -- 172.21.15.93:0/2957331335 shutdown_connections 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.670+0000 7f2a54000640 1 -- 172.21.15.93:0/2957331335 wait complete. 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 Processor -- start 2023-11-04T01:43:25.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 -- start start 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 0x7f2a4c1602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a4c15d100 0x7f2a4c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c152a50 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b69c0 con 0x7f2a4c0d3b60 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.672+0000 7f2a54000640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c15dd10 con 0x7f2a4c15d100 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35264/0 (socket says 172.21.15.93:35264) 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 -- 172.21.15.93:0/2786987050 learned_addr learned my addr 172.21.15.93:0/2786987050 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 0x7f2a4c1602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5159b640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a4c15d100 0x7f2a4c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 -- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a4c15d100 msgr2=0x7f2a4c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a4c15d100 0x7f2a4c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 -- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 msgr2=0x7f2a4c1602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 0x7f2a4c1602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 -- 172.21.15.93:0/2786987050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009460 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 0x7f2a4c1602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a5259d640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c780 tx=0x7f2a4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400ce90 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400a640 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c15d9e0 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400a9d0 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.673+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0b6eb0 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.674+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c0d11e0 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.675+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a4400ab30 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.675+0000 7f2a427fc640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.675+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f2a44089370 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.675+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.675+0000 7f2a51d9c640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 0x7f2a3006d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2a48035000 tx=0x7f2a48008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.679+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a44053b10 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.847+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f2a4c0684b0 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.847+0000 7f2a427fc640 1 -- 172.21.15.93:0/2786987050 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2a44018020 con 0x7f2a4c15d4e0 2023-11-04T01:43:25.849 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:25.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 msgr2=0x7f2a3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 0x7f2a3006d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2a48035000 tx=0x7f2a48008030 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 msgr2=0x7f2a4c0b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c780 tx=0x7f2a4400cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 shutdown_connections 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a4c15d4e0 0x7f2a4c0b6480 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f2a4c15d100 0x7f2a4c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 --2- 172.21.15.93:0/2786987050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a4c0d3b60 0x7f2a4c1602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 >> 172.21.15.93:0/2786987050 conn(0x7f2a4c0d2ef0 msgr2=0x7f2a4c15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 shutdown_connections 2023-11-04T01:43:25.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.849+0000 7f2a54000640 1 -- 172.21.15.93:0/2786987050 wait complete. 2023-11-04T01:43:25.861 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:25.963 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.962+0000 7f62ca01a640 1 Processor -- start 2023-11-04T01:43:25.964 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.962+0000 7f62ca01a640 1 -- start start 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62ca01a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 0x7f62c40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62ca01a640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c406c5f0 0x7f62c40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62ca01a640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c406cc90 con 0x7f62c406d9c0 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62ca01a640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40b0e60 con 0x7f62c406c5f0 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62ca01a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c406cee0 con 0x7f62c40ade00 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 0x7f62c40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c406c5f0 0x7f62c40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62c2ffd640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f62c406d9c0 0x7f62c40710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:49098/0 (socket says 172.21.15.93:49098) 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62c2ffd640 1 -- 172.21.15.93:0/3403651086 learned_addr learned my addr 172.21.15.93:0/3403651086 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.963+0000 7f62c37fe640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 0x7f62c40b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:40402/0 (socket says 172.21.15.93:40402) 2023-11-04T01:43:25.965 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c3fff640 1 -- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 msgr2=0x7f62c40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c3fff640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 0x7f62c40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c3fff640 1 -- 172.21.15.93:0/3403651086 >> v1:172.21.15.125:6789/0 conn(0x7f62c406d9c0 legacy=0x7f62c40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c3fff640 1 -- 172.21.15.93:0/3403651086 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c406d1c0 con 0x7f62c406c5f0 2023-11-04T01:43:25.966 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c27fc640 1 -- 172.21.15.93:0/3403651086 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217332195 0 0) 0x7f62c406cc90 con 0x7f62c406d9c0 2023-11-04T01:43:25.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.964+0000 7f62c3fff640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c40cc680 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623bde0387eba485 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62c27fc640 1 -- 172.21.15.93:0/3403651086 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc02cb30 con 0x7f62c406c5f0 2023-11-04T01:43:25.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62c27fc640 1 -- 172.21.15.93:0/3403651086 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc02cc90 con 0x7f62c406c5f0 2023-11-04T01:43:25.967 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62c27fc640 1 -- 172.21.15.93:0/3403651086 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc034440 con 0x7f62c406c5f0 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 -- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 msgr2=0x7f62c40cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c40cc680 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc02bd80 comp rx=0 tx=0).stop 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 -- 172.21.15.93:0/3403651086 shutdown_connections 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c40cc680 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 --2- 172.21.15.93:0/3403651086 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c40ade00 0x7f62c40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 -- 172.21.15.93:0/3403651086 >> 172.21.15.93:0/3403651086 conn(0x7f62c40cb530 msgr2=0x7f62c40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 -- 172.21.15.93:0/3403651086 shutdown_connections 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.965+0000 7f62ca01a640 1 -- 172.21.15.93:0/3403651086 wait complete. 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.966+0000 7f62ca01a640 1 Processor -- start 2023-11-04T01:43:25.968 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.966+0000 7f62ca01a640 1 -- start start 2023-11-04T01:43:25.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c406d9c0 0x7f62c41474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.970 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c415a960 con 0x7f62c40ade00 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4144750 con 0x7f62c406c5f0 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62ca01a640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4159a40 con 0x7f62c406d9c0 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35270/0 (socket says 172.21.15.93:35270) 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62c37fe640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62c3fff640 1 -- 172.21.15.93:0/4027556670 learned_addr learned my addr 172.21.15.93:0/4027556670 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.967+0000 7f62c2ffd640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c406d9c0 0x7f62c41474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 -- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c406d9c0 msgr2=0x7f62c41474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c406d9c0 0x7f62c41474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 -- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 msgr2=0x7f62c415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.971 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 -- 172.21.15.93:0/4027556670 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009a70 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62c3fff640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc009450 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc040450 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41479f0 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc040800 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.968+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4159d90 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.969+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c415aaa0 con 0x7f62c40ade00 2023-11-04T01:43:25.972 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.969+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62bc040960 con 0x7f62c40ade00 2023-11-04T01:43:25.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.970+0000 7f62abfff640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 0x7f62b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.970+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f62bc0ac930 con 0x7f62c40ade00 2023-11-04T01:43:25.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.970+0000 7f62c37fe640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 0x7f62b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.973 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.970+0000 7f62c37fe640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 0x7f62b006d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009b40 tx=0x7f62b4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.975 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:25.974+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62bc077180 con 0x7f62c40ade00 2023-11-04T01:43:26.142 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.141+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62c40684b0 con 0x7f62c40ade00 2023-11-04T01:43:26.143 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.142+0000 7f62abfff640 1 -- 172.21.15.93:0/4027556670 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62bc07a7a0 con 0x7f62c40ade00 2023-11-04T01:43:26.143 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 msgr2=0x7f62b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 0x7f62b006d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009b40 tx=0x7f62b4009190 comp rx=0 tx=0).stop 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 msgr2=0x7f62c4156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 shutdown_connections 2023-11-04T01:43:26.145 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f62b006ae70 0x7f62b006d330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62c40ade00 0x7f62c4156d60 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f62c406d9c0 0x7f62c41474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 --2- 172.21.15.93:0/4027556670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c406c5f0 0x7f62c415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 >> 172.21.15.93:0/4027556670 conn(0x7f62c40cb530 msgr2=0x7f62c40710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 shutdown_connections 2023-11-04T01:43:26.146 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.144+0000 7f62ca01a640 1 -- 172.21.15.93:0/4027556670 wait complete. 2023-11-04T01:43:26.156 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 Processor -- start 2023-11-04T01:43:26.258 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 -- start start 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 0x7f80c80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c806bb60 0x7f80c80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f80c806fff0 0x7f80c8070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c8071500 con 0x7f80c806fff0 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c815dae0 con 0x7f80c8159e40 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.257+0000 7f80cf1a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80709c0 con 0x7f80c806bb60 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f80c806fff0 0x7f80c8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.260 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f80c806fff0 0x7f80c8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35276/0 (socket says 172.21.15.93:35276) 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 -- 172.21.15.93:0/3393547389 learned_addr learned my addr 172.21.15.93:0/3393547389 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80ccf45640 1 --2- 172.21.15.93:0/3393547389 >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 0x7f80c80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 -- 172.21.15.93:0/3393547389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c806bb60 msgr2=0x7f80c80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80c7fff640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c806bb60 0x7f80c80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c806bb60 0x7f80c80b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 -- 172.21.15.93:0/3393547389 >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 msgr2=0x7f80c80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 --2- 172.21.15.93:0/3393547389 >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 0x7f80c80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80cd746640 1 -- 172.21.15.93:0/3393547389 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8070c60 con 0x7f80c806fff0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.258+0000 7f80ccf45640 1 --2- 172.21.15.93:0/3393547389 >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 0x7f80c80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cd746640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806fff0 0x7f80c8070480 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ce7f0 tx=0x7f80c002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530d1282b2417d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80c77fe640 1 -- 172.21.15.93:0/3393547389 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c002c9e0 con 0x7f80c806fff0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80c77fe640 1 -- 172.21.15.93:0/3393547389 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c002cb40 con 0x7f80c806fff0 2023-11-04T01:43:26.261 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80c77fe640 1 -- 172.21.15.93:0/3393547389 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00343f0 con 0x7f80c806fff0 2023-11-04T01:43:26.265 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 -- 172.21.15.93:0/3393547389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806fff0 msgr2=0x7f80c8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806fff0 0x7f80c8070480 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ce7f0 tx=0x7f80c002be40 comp rx=0 tx=0).stop 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 -- 172.21.15.93:0/3393547389 shutdown_connections 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806fff0 0x7f80c8070480 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/3393547389 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c806bb60 0x7f80c80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/3393547389 >> v2:172.21.15.125:3300/0 conn(0x7f80c8159e40 0x7f80c80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 -- 172.21.15.93:0/3393547389 >> 172.21.15.93:0/3393547389 conn(0x7f80c80cb530 msgr2=0x7f80c80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 -- 172.21.15.93:0/3393547389 shutdown_connections 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.259+0000 7f80cf1a9640 1 -- 172.21.15.93:0/3393547389 wait complete. 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 Processor -- start 2023-11-04T01:43:26.266 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 -- start start 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80c806fff0 0x7f80c81f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c8159e40 0x7f80c80aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81ee400 con 0x7f80c806bb60 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80a9370 con 0x7f80c806fff0 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.261+0000 7f80cf1a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80a9800 con 0x7f80c8159e40 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35282/0 (socket says 172.21.15.93:35282) 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 -- 172.21.15.93:0/2062059983 learned_addr learned my addr 172.21.15.93:0/2062059983 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80c7fff640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80c806fff0 0x7f80c81f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80cd746640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c8159e40 0x7f80c80aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.267 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 -- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c8159e40 msgr2=0x7f80c80aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c8159e40 0x7f80c80aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 -- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80c806fff0 msgr2=0x7f80c81f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80c806fff0 0x7f80c81f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 -- 172.21.15.93:0/2062059983 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009b30 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80ccf45640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c820 tx=0x7f80bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc007a30 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc007b90 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c81f18e0 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00ce10 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.262+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c80a8760 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.263+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c80684b0 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.264+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80bc0113f0 con 0x7f80c806bb60 2023-11-04T01:43:26.268 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.264+0000 7f80c57fa640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 0x7f80ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.264+0000 7f80c7fff640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 0x7f80ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.264+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f80bc08a0a0 con 0x7f80c806bb60 2023-11-04T01:43:26.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.264+0000 7f80c7fff640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 0x7f80ac06d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f80c80aa190 tx=0x7f80b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.269 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.268+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80bc0547b0 con 0x7f80c806bb60 2023-11-04T01:43:26.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.434+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80c80c9750 con 0x7f80c806bb60 2023-11-04T01:43:26.436 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.435+0000 7f80c57fa640 1 -- 172.21.15.93:0/2062059983 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80bc01f0a0 con 0x7f80c806bb60 2023-11-04T01:43:26.436 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:43:26.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 msgr2=0x7f80ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 0x7f80ac06d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f80c80aa190 tx=0x7f80b4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 msgr2=0x7f80c81edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.438 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c820 tx=0x7f80bc00cce0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 shutdown_connections 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f80ac06ae70 0x7f80ac06d330 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f80c8159e40 0x7f80c80aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80c806fff0 0x7f80c81f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 --2- 172.21.15.93:0/2062059983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80c806bb60 0x7f80c81edec0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 >> 172.21.15.93:0/2062059983 conn(0x7f80c80cb530 msgr2=0x7f80c80cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 shutdown_connections 2023-11-04T01:43:26.439 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.437+0000 7f80cf1a9640 1 -- 172.21.15.93:0/2062059983 wait complete. 2023-11-04T01:43:26.449 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.548+0000 7f513d264640 1 Processor -- start 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.548+0000 7f513d264640 1 -- start start 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f513d264640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f513d264640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 0x7f51380ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f513d264640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380cde80 con 0x7f51380afda0 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f513d264640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380cf670 con 0x7f513815b200 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f513d264640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380cf950 con 0x7f51380cd9c0 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f5136ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51377fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 0x7f51380ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f5136ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.93:45618/0 (socket says 172.21.15.93:45618) 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f512ffff640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51380afda0 0x7f51380cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:49100/0 (socket says 172.21.15.93:49100) 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f5136ffd640 1 -- 172.21.15.93:0/4062321569 learned_addr learned my addr 172.21.15.93:0/4062321569 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51377fe640 1 -- 172.21.15.93:0/4062321569 >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 msgr2=0x7f51380ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51377fe640 1 --2- 172.21.15.93:0/4062321569 >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51377fe640 1 -- 172.21.15.93:0/4062321569 >> v1:172.21.15.125:6789/0 conn(0x7f51380afda0 legacy=0x7f51380cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51377fe640 1 -- 172.21.15.93:0/4062321569 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380ce120 con 0x7f51380cd9c0 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.549+0000 7f51367fc640 1 -- 172.21.15.93:0/4062321569 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205124920 0 0) 0x7f51380cde80 con 0x7f51380afda0 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.550+0000 7f5136ffd640 1 --2- 172.21.15.93:0/4062321569 >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.550+0000 7f51377fe640 1 --2- 172.21.15.93:0/4062321569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 0x7f51380ae2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5130009d90 tx=0x7f513002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfa14bdfee766081 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.550+0000 7f51367fc640 1 -- 172.21.15.93:0/4062321569 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513002cbc0 con 0x7f51380cd9c0 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f51367fc640 1 -- 172.21.15.93:0/4062321569 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513002cd20 con 0x7f51380cd9c0 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f51367fc640 1 -- 172.21.15.93:0/4062321569 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130034660 con 0x7f51380cd9c0 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 -- 172.21.15.93:0/4062321569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 msgr2=0x7f51380ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 --2- 172.21.15.93:0/4062321569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 0x7f51380ae2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5130009d90 tx=0x7f513002be10 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 -- 172.21.15.93:0/4062321569 shutdown_connections 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 --2- 172.21.15.93:0/4062321569 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f51380cd9c0 0x7f51380ae2b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 --2- 172.21.15.93:0/4062321569 >> v2:172.21.15.125:3300/0 conn(0x7f513815b200 0x7f51380ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 -- 172.21.15.93:0/4062321569 >> 172.21.15.93:0/4062321569 conn(0x7f51380d0c30 msgr2=0x7f51380d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 -- 172.21.15.93:0/4062321569 shutdown_connections 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.551+0000 7f513d264640 1 -- 172.21.15.93:0/4062321569 wait complete. 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.552+0000 7f513d264640 1 Processor -- start 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.552+0000 7f513d264640 1 -- start start 2023-11-04T01:43:26.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 0x7f51380b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 0x7f51380b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380c7af0 con 0x7f51380afda0 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380c4ed0 con 0x7f51380cd9c0 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f513d264640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f1710 con 0x7f513815b200 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35298/0 (socket says 172.21.15.93:35298) 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 -- 172.21.15.93:0/4111127128 learned_addr learned my addr 172.21.15.93:0/4111127128 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f51377fe640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 0x7f51380b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f512ffff640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 0x7f51380b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 -- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 msgr2=0x7f51380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 0x7f51380b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 -- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 msgr2=0x7f51380b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 0x7f51380b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 -- 172.21.15.93:0/4111127128 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128009460 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f512ffff640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 0x7f51380b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f51377fe640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 0x7f51380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.553+0000 7f5136ffd640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f512800ea10 tx=0x7f512800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.554+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800ca00 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.554+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800cb60 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.554+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130009a70 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.554+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800ced0 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.554+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51380c45a0 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.555+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51380684b0 con 0x7f51380afda0 2023-11-04T01:43:26.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.555+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5128005990 con 0x7f51380afda0 2023-11-04T01:43:26.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.555+0000 7f512f7fe640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 0x7f511806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.555+0000 7f512ffff640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 0x7f511806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.556+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f512808a3e0 con 0x7f51380afda0 2023-11-04T01:43:26.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.556+0000 7f512ffff640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 0x7f511806d330 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f51381ee330 tx=0x7f5120009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.560+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5128054af0 con 0x7f51380afda0 2023-11-04T01:43:26.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.738+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f51380b67f0 con 0x7f51380afda0 2023-11-04T01:43:26.740 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.739+0000 7f512f7fe640 1 -- 172.21.15.93:0/4111127128 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f5128020020 con 0x7f51380afda0 2023-11-04T01:43:26.740 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/2573507659 2023-11-04T02:43:20.792492+0000 2023-11-04T01:43:26.740 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:26.741 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3505063928 2023-11-04T02:42:36.804546+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3671080369 2023-11-04T02:41:51.893134+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:26.742 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:26.743 INFO:teuthology.orchestra.run.smithi093.stderr:listed 23 entries 2023-11-04T01:43:26.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.740+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 msgr2=0x7f511806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.743 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.740+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 0x7f511806d330 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f51381ee330 tx=0x7f5120009040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.740+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 msgr2=0x7f513814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.740+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f512800ea10 tx=0x7f512800eed0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 shutdown_connections 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f511806ae70 0x7f511806d330 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f513815b200 0x7f51380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51380cd9c0 0x7f51380b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 --2- 172.21.15.93:0/4111127128 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51380afda0 0x7f513814c080 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 >> 172.21.15.93:0/4111127128 conn(0x7f51380d0c30 msgr2=0x7f51380b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 shutdown_connections 2023-11-04T01:43:26.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:26.741+0000 7f513d264640 1 -- 172.21.15.93:0/4111127128 wait complete. 2023-11-04T01:43:26.752 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:43:26.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:26.752 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:26.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[155792]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:26.780 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:43:26.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:26.780 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:26.835 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:43:26.835 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:26.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:26.890 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:27.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.028+0000 7f597a1a9640 1 Processor -- start 2023-11-04T01:43:27.029 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.028+0000 7f597a1a9640 1 -- start start 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f597a1a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f59740b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f597a1a9640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5974070700 0x7f59740b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f597a1a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5974071500 con 0x7f597406bb60 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f597a1a9640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597415dae0 con 0x7f5974070700 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f597a1a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974070c60 con 0x7f5974159e40 2023-11-04T01:43:27.033 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f5972ffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f597406bb60 0x7f597406fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33270/0 (socket says 172.21.15.93:33270) 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f5972ffd640 1 -- 172.21.15.93:0/3437793960 learned_addr learned my addr 172.21.15.93:0/3437793960 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135938770 0 0) 0x7f5974071500 con 0x7f597406bb60 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c003520 con 0x7f597406bb60 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f5973fff640 1 --2- 172.21.15.93:0/3437793960 >> v2:172.21.15.125:3300/0 conn(0x7f5974070700 0x7f59740b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59737fe640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f59740b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819634592 0 0) 0x7f595c003520 con 0x7f597406bb60 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 msgr2=0x7f59740b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f59740b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 >> v2:172.21.15.125:3300/0 conn(0x7f5974070700 msgr2=0x7f59740b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 --2- 172.21.15.93:0/3437793960 >> v2:172.21.15.125:3300/0 conn(0x7f5974070700 0x7f59740b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974070f40 con 0x7f597406bb60 2023-11-04T01:43:27.034 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5968001670 con 0x7f597406bb60 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 >> v1:172.21.15.93:6789/0 conn(0x7f597406bb60 legacy=0x7f597406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.029+0000 7f59727fc640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f595c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59727fc640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f595c003fa0 0x7f595c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59727fc640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d00 0x7f595c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415dae0 con 0x7f595c003fa0 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974070c60 con 0x7f595c004d00 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c00bb40 con 0x7f5974159e40 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f595c003fa0 0x7f595c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f59737fe640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f595c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5973fff640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d00 0x7f595c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 -- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 msgr2=0x7f595c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.035 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974159e40 0x7f595c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 -- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d00 msgr2=0x7f595c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d00 0x7f595c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.030+0000 7f5972ffd640 1 -- 172.21.15.93:0/3437793960 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c003520 con 0x7f595c003fa0 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f5972ffd640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f595c003fa0 0x7f595c0047c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f596800c290 tx=0x7f595c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b4556b0dd7d070 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968005ad0 con 0x7f595c003fa0 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968005c30 con 0x7f595c003fa0 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f59727fc640 1 -- 172.21.15.93:0/3437793960 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596802c8d0 con 0x7f595c003fa0 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 -- 172.21.15.93:0/3437793960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f595c003fa0 msgr2=0x7f595c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 --2- 172.21.15.93:0/3437793960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f595c003fa0 0x7f595c0047c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f596800c290 tx=0x7f595c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f5973fff640 1 -- 172.21.15.93:0/3437793960 reap_dead start 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 -- 172.21.15.93:0/3437793960 shutdown_connections 2023-11-04T01:43:27.036 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 -- 172.21.15.93:0/3437793960 >> 172.21.15.93:0/3437793960 conn(0x7f59740cb530 msgr2=0x7f59740cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 -- 172.21.15.93:0/3437793960 shutdown_connections 2023-11-04T01:43:27.037 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.031+0000 7f597a1a9640 1 -- 172.21.15.93:0/3437793960 wait complete. 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.032+0000 7f597a1a9640 1 Processor -- start 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 -- start start 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c003fa0 0x7f597415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974151830 0x7f5974151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.039 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741521f0 con 0x7f597415a570 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415cbf0 con 0x7f595c003fa0 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f597a1a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59741515a0 con 0x7f5974151830 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.033+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35310/0 (socket says 172.21.15.93:35310) 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 -- 172.21.15.93:0/1114808600 learned_addr learned my addr 172.21.15.93:0/1114808600 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 -- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974151830 msgr2=0x7f5974151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974151830 0x7f5974151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f59737fe640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c003fa0 0x7f597415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 -- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c003fa0 msgr2=0x7f597415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c003fa0 0x7f597415b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 -- 172.21.15.93:0/1114808600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597415d080 con 0x7f597415a570 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f5972ffd640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f596800c290 tx=0x7f5968000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.040 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596803c040 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968005e90 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597415bfe0 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680074d0 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.034+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597415c5a0 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.035+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59740684b0 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.035+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5968032070 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.036+0000 7f595bfff640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 0x7f596006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.036+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f59680ab6d0 con 0x7f597415a570 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.036+0000 7f59737fe640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 0x7f596006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.041 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.036+0000 7f59737fe640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 0x7f596006d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5964006fd0 tx=0x7f5964008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.042 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.040+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5968075e70 con 0x7f597415a570 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.243+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59740add20 con 0x7f597415a570 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.244+0000 7f595bfff640 1 -- 172.21.15.93:0/1114808600 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v116) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5968079490 con 0x7f597415a570 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi093.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.245+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 msgr2=0x7f596006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.245+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 0x7f596006d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5964006fd0 tx=0x7f5964008040 comp rx=0 tx=0).stop 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 msgr2=0x7f597414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f596800c290 tx=0x7f5968000fe0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 shutdown_connections 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f596006ae70 0x7f596006d330 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5974151830 0x7f5974151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f597415a570 0x7f597414b5f0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 --2- 172.21.15.93:0/1114808600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c003fa0 0x7f597415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 >> 172.21.15.93:0/1114808600 conn(0x7f59740cb530 msgr2=0x7f597406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 shutdown_connections 2023-11-04T01:43:27.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:27.246+0000 7f597a1a9640 1 -- 172.21.15.93:0/1114808600 wait complete. 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:27.257 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:27.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:27.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:27.258 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:27.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.258 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:27.273 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 41393sec preferred_lft 41393sec 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:27.274 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b037:14ff:fed2:2a04/64 scope link 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether f6:ed:44:74:10:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::f4ed:44ff:fe74:1094/64 scope link 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:9c:ae:1e:13:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::849c:aeff:fe1e:13aa/64 scope link 2023-11-04T01:43:27.275 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:27.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.276 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:27.338 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-04T01:43:27.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.340 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-04T01:43:27.395 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-04T01:43:27.395 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:27.395 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:43:27.395 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:43:27.395 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:27.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:43:27.396 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-04T01:43:27.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:43:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:27.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:43:27.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:27.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:27.529 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:27.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.529 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-04T01:43:27.595 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:27.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:27.596 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:27.650 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:27.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:27.651 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:27.705 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.762 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.763 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.763 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:43:27.815 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:27.815 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:27.858 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:43:27.873 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:43:27.874 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.875 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.876 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:43:27.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:43:27.945+0000 7f6c24a4c480 -1 init, newargv = 0x564bf876a9d0 newargc=15 2023-11-04T01:43:27.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[157767]: starting ceph client 2023-11-04T01:43:27.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:ceph-fuse[157767]: starting fuse 2023-11-04T01:43:29.030 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:29.049 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-04T01:43:29.050 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/selinux 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:29.051 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:29.052 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-04T01:43:29.107 INFO:teuthology.orchestra.run.smithi093.stdout:43 2023-11-04T01:43:29.107 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:29.108 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:29.109 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:29.110 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:43:29.234 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.0.157767.asok 2023-11-04T01:43:29.237 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.244 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.157767.asok 2023-11-04T01:43:29.244 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:29.244 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.157767.asok status 2023-11-04T01:43:29.343 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "0", 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "157767", 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 8835, 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 8835 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 1318491286 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 1318491286 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.8835 192.168.0.1:0/1318491286", 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/1318491286", 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 116, 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 116, 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:43:29.420 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:29.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:29.428 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.485 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.486 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-04T01:43:29.486 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.493 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:29.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.558 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:43:29.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.657+0000 7f97a829b640 1 Processor -- start 2023-11-04T01:43:29.659 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.658+0000 7f97a829b640 1 -- start start 2023-11-04T01:43:29.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.658+0000 7f97a829b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f97a0167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.658+0000 7f97a829b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00b32b0 con 0x7f97a015d100 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.658+0000 7f97a829b640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00cee10 con 0x7f97a015d4e0 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.658+0000 7f97a829b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00cec20 con 0x7f97a00d1be0 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a6037640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f97a015d100 0x7f97a00ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33284/0 (socket says 172.21.15.93:33284) 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a6037640 1 -- 172.21.15.93:0/2803384432 learned_addr learned my addr 172.21.15.93:0/2803384432 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672679416 0 0) 0x7f97a00b32b0 con 0x7f97a015d100 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f978c003520 con 0x7f97a015d100 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a6838640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f97a0167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2632690880 0 0) 0x7f978c003520 con 0x7f97a015d100 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 msgr2=0x7f97a0167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f97a0167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 >> v1:172.21.15.125:6789/0 conn(0x7f97a015d4e0 legacy=0x7f97a00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00b4750 con 0x7f97a015d100 2023-11-04T01:43:29.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f97900017f0 con 0x7f97a015d100 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 >> v1:172.21.15.93:6789/0 conn(0x7f97a015d100 legacy=0x7f97a00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f978c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c003f20 0x7f978c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f978c004d00 0x7f978c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00ba30 con 0x7f978c004d00 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bba0 con 0x7f978c003f20 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bd60 con 0x7f97a00d1be0 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a6838640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f978c004d00 0x7f978c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a6037640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f978c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.659+0000 7f97a5836640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c003f20 0x7f978c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 -- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 msgr2=0x7f978c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f978c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 -- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c003f20 msgr2=0x7f978c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c003f20 0x7f978c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 -- 172.21.15.93:0/2803384432 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c003520 con 0x7f978c004d00 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a5836640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c003f20 0x7f978c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6037640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00d1be0 0x7f978c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a6838640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f978c004d00 0x7f978c005180 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f97a008c730 tx=0x7f978c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577be988b253fcf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979802cb90 con 0x7f978c004d00 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800f040 con 0x7f978c004d00 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.660+0000 7f97a5035640 1 -- 172.21.15.93:0/2803384432 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798034440 con 0x7f978c004d00 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 -- 172.21.15.93:0/2803384432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f978c004d00 msgr2=0x7f978c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 --2- 172.21.15.93:0/2803384432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f978c004d00 0x7f978c005180 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f97a008c730 tx=0x7f978c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a6838640 1 -- 172.21.15.93:0/2803384432 reap_dead start 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 -- 172.21.15.93:0/2803384432 shutdown_connections 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 -- 172.21.15.93:0/2803384432 >> 172.21.15.93:0/2803384432 conn(0x7f97a00d2ef0 msgr2=0x7f97a00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 -- 172.21.15.93:0/2803384432 shutdown_connections 2023-11-04T01:43:29.666 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.661+0000 7f97a829b640 1 -- 172.21.15.93:0/2803384432 wait complete. 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.662+0000 7f97a829b640 1 Processor -- start 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.662+0000 7f97a829b640 1 -- start start 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 0x7f97a01f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 0x7f97a00b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a015f700 con 0x7f97a01e6b30 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a01e74f0 con 0x7f978c004d00 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a829b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00b8840 con 0x7f97a00ccab0 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35328/0 (socket says 172.21.15.93:35328) 2023-11-04T01:43:29.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 -- 172.21.15.93:0/3149691875 learned_addr learned my addr 172.21.15.93:0/3149691875 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6037640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 0x7f97a01f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 -- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 msgr2=0x7f97a00b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a5836640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 0x7f97a00b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 0x7f97a00b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 -- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 msgr2=0x7f97a01f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 0x7f97a01f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 -- 172.21.15.93:0/3149691875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a01f7030 con 0x7f97a01e6b30 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6037640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 0x7f97a01f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a5836640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 0x7f97a00b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.663+0000 7f97a6838640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9798037040 tx=0x7f9798009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.664+0000 7f9796ffd640 1 -- 172.21.15.93:0/3149691875 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798043070 con 0x7f97a01e6b30 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.664+0000 7f9796ffd640 1 -- 172.21.15.93:0/3149691875 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979802ce30 con 0x7f97a01e6b30 2023-11-04T01:43:29.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.664+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a01f64b0 con 0x7f97a01e6b30 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.664+0000 7f9796ffd640 1 -- 172.21.15.93:0/3149691875 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798034cd0 con 0x7f97a01e6b30 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.664+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a01f6a70 con 0x7f97a01e6b30 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.665+0000 7f9796ffd640 1 -- 172.21.15.93:0/3149691875 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f979803e440 con 0x7f97a01e6b30 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.665+0000 7f9796ffd640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 0x7f978406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.666+0000 7f9796ffd640 1 -- 172.21.15.93:0/3149691875 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f97980ab500 con 0x7f97a01e6b30 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.666+0000 7f97a6037640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 0x7f978406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.666+0000 7f97a6037640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 0x7f978406d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9790006950 tx=0x7f9790001680 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.667+0000 7f97aae30740 1 Processor -- start 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.667+0000 7f97aae30740 1 -- start start 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e129a24c0 0x556e129a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e12976040 0x556e1299fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e128e5d70 con 0x556e129726d0 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e128e3460 con 0x556e12976040 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e128ded50 con 0x556e129a24c0 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35330/0 (socket says 172.21.15.93:35330) 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 -- 172.21.15.93:0/3192607745 learned_addr learned my addr 172.21.15.93:0/3192607745 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 -- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e129a24c0 msgr2=0x556e129a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a6838640 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e12976040 0x556e1299fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a6037640 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e129a24c0 0x556e129a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e129a24c0 0x556e129a28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 -- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e12976040 msgr2=0x556e1299fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e12976040 0x556e1299fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 -- 172.21.15.93:0/3192607745 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e128a1e30 con 0x556e129726d0 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f97a5836640 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f979c001640 tx=0x7f979c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d73b04476a4c3a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f9783fff640 1 -- 172.21.15.93:0/3192607745 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c001d50 con 0x556e129726d0 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f9783fff640 1 -- 172.21.15.93:0/3192607745 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00d050 con 0x556e129726d0 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.668+0000 7f9783fff640 1 -- 172.21.15.93:0/3192607745 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00f7b0 con 0x556e129726d0 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 -- 172.21.15.93:0/3192607745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 msgr2=0x556e1299f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f979c001640 tx=0x7f979c001b00 comp rx=0 tx=0).stop 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 -- 172.21.15.93:0/3192607745 shutdown_connections 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e12976040 0x556e1299fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129726d0 0x556e1299f730 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 --2- 172.21.15.93:0/3192607745 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e129a24c0 0x556e129a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 -- 172.21.15.93:0/3192607745 >> 172.21.15.93:0/3192607745 conn(0x556e129749e0 msgr2=0x556e129bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 -- 172.21.15.93:0/3192607745 shutdown_connections 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.669+0000 7f97aae30740 1 -- 172.21.15.93:0/3192607745 wait complete. 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.670+0000 7f97aae30740 1 -- start start 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.670+0000 7f97aae30740 1 Processor -- start 2023-11-04T01:43:29.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e1299c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e1299cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e12898ee0 con 0x556e129a33b0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e12898b80 con 0x556e129a24c0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e1285e3a0 con 0x556e12976040 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 10 client.0 _ll_register_callbacks cb 0x556e128628b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35342/0 (socket says 172.21.15.93:35342) 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 -- 172.21.15.93:0/3682879810 learned_addr learned my addr 172.21.15.93:0/3682879810 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6037640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e1299c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a5836640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e1299cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 -- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 msgr2=0x556e1299c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e1299c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 -- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 msgr2=0x556e1299cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e1299cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 -- 172.21.15.93:0/3682879810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a00cee10 con 0x556e129a33b0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6037640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e1299c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a5836640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e1299cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97a6838640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f979802c530 tx=0x7f979807a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bc1386285b8b9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97817fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798081c60 con 0x556e129a33b0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f9798009c10 con 0x556e129a33b0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e128d7d30 con 0x556e129a33b0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9798079bc0 con 0x556e129a33b0 2023-11-04T01:43:29.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 10 client.8847 fetch_fsmap learned FSMap version 116 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.671+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x556e128dd3d0 con 0x556e129a33b0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e128d7d30 con 0x556e129a33b0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 116) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9798078e50 con 0x556e129a33b0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 10 client.8847 fetch_fsmap finished waiting for FSMap version 116 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 10 client.8847 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 20 client.8847 populate_metadata read hostname 'smithi093' 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a5a60 0x556e129a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 4 client.8847 mds_command: new command op to 8451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 --> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e128d7a50 con 0x556e129a5a60 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97a6037640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a5a60 0x556e129a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97817fa640 10 client.8847 ms_handle_connect on v2:172.21.15.93:6834/3641686617 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.672+0000 7f97a6037640 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a5a60 0x556e129a5e40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1e35a462320edd server_cookie=7e4643a5f4ef49c1 in_seq=0 out_seq=0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97817fa640 1 -- 172.21.15.93:0/3682879810 <== mds.0 v2:172.21.15.93:6834/3641686617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556e128d7a50 con 0x556e129a5a60 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97817fa640 10 client.8847 handle_command_reply: tid=0 2023-11-04T01:43:29.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 client.8847 shutdown 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 msgr2=0x556e129a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f979802c530 tx=0x7f979807a060 comp rx=0 tx=0).stop 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 shutdown_connections 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129a3830 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e1299cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a5a60 0x556e129a5e40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 --2- 172.21.15.93:0/3682879810 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e1299c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97817fa640 0 client.8847 ms_handle_reset on v2:172.21.15.93:6834/3641686617 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 >> 172.21.15.93:0/3682879810 conn(0x556e129726d0 msgr2=0x556e129784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 shutdown_connections 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 1 -- 172.21.15.93:0/3682879810 wait complete. 2023-11-04T01:43:29.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.673+0000 7f97aae30740 20 client.8847 trim_cache size 0 max 16384 2023-11-04T01:43:29.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.686+0000 7f97aae30740 1 Processor -- start 2023-11-04T01:43:29.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.686+0000 7f97aae30740 1 -- start start 2023-11-04T01:43:29.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12972bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a33b0 0x556e129d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e129bec60 con 0x556e129a24c0 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e12995e00 con 0x556e129a33b0 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e12974440 con 0x556e12976040 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35354/0 (socket says 172.21.15.93:35354) 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 -- 172.21.15.93:0/276970021 learned_addr learned my addr 172.21.15.93:0/276970021 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a6037640 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12972bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a6838640 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a33b0 0x556e129d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 -- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 msgr2=0x556e12972bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12972bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 -- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a33b0 msgr2=0x556e129d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a33b0 0x556e129d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 -- 172.21.15.93:0/276970021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e12974030 con 0x556e129a24c0 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f97a5836640 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f979c007fd0 tx=0x7f979c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bade86a3e33ba447 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f9794dff640 1 -- 172.21.15.93:0/276970021 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c007040 con 0x556e129a24c0 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f9794dff640 1 -- 172.21.15.93:0/276970021 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c0071c0 con 0x556e129a24c0 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.687+0000 7f9794dff640 1 -- 172.21.15.93:0/276970021 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c007570 con 0x556e129a24c0 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- 172.21.15.93:0/276970021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 msgr2=0x556e129a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f979c007fd0 tx=0x7f979c00a000 comp rx=0 tx=0).stop 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- 172.21.15.93:0/276970021 shutdown_connections 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a33b0 0x556e129d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a24c0 0x556e129a4790 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 --2- 172.21.15.93:0/276970021 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12972bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- 172.21.15.93:0/276970021 >> 172.21.15.93:0/276970021 conn(0x556e129726d0 msgr2=0x556e129a5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- 172.21.15.93:0/276970021 shutdown_connections 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- 172.21.15.93:0/276970021 wait complete. 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 -- start start 2023-11-04T01:43:29.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.688+0000 7f97aae30740 1 Processor -- start 2023-11-04T01:43:29.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12977280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e129777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1299c770 con 0x556e129a33b0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e129a3a60 con 0x556e129a24c0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e12a29bc0 con 0x556e12976040 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97aae30740 10 client.0 _ll_register_callbacks cb 0x7f979c007dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97a6838640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35358/0 (socket says 172.21.15.93:35358) 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.689+0000 7f97a6838640 1 -- 172.21.15.93:0/17580180 learned_addr learned my addr 172.21.15.93:0/17580180 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6037640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12977280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a5836640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e129777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 -- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 msgr2=0x556e12977280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12977280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 -- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 msgr2=0x556e129777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e129777c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 -- 172.21.15.93:0/17580180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e128a1e30 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6838640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f979802c600 tx=0x7f97980a8ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46211bb636c17324 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798081c60 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mon.0 v2:172.21.15.93:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f97980a8050 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f979c00d050 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9798078e50 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 10 client.8853 fetch_fsmap learned FSMap version 116 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x556e1287aea0 con 0x556e129a33b0 2023-11-04T01:43:29.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mon.0 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00d050 con 0x556e129a33b0 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mon.0 v2:172.21.15.93:3300/0 5 ==== fsmap(e 116) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f97980981c0 con 0x556e129a33b0 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 10 client.8853 fetch_fsmap finished waiting for FSMap version 116 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 10 client.8853 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 20 client.8853 populate_metadata read hostname 'smithi093' 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a3c00 0x556e129bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 4 client.8853 mds_command: new command op to 8451 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 --> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556e125df7e0 con 0x556e129a3c00 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.690+0000 7f97a6037640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a3c00 0x556e129bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.691+0000 7f97817fa640 10 client.8853 ms_handle_connect on v2:172.21.15.93:6834/3641686617 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.691+0000 7f97a6037640 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a3c00 0x556e129bf3e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e48c8f067dd567f3 server_cookie=ebe1f585cff80d2e in_seq=0 out_seq=0 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.697+0000 7f97817fa640 1 -- 172.21.15.93:0/17580180 <== mds.0 v2:172.21.15.93:6834/3641686617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556e125df7e0 con 0x556e129a3c00 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.697+0000 7f97817fa640 10 client.8853 handle_command_reply: tid=0 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.697+0000 7f97aae30740 1 client.8853 shutdown 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 msgr2=0x556e129beea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f979802c600 tx=0x7f97980a8ff0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 shutdown_connections 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556e129a33b0 0x556e129beea0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e129a24c0 0x556e129777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.93:6834/3641686617,v1:172.21.15.93:6836/3641686617] conn(0x556e129a3c00 0x556e129bf3e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 --2- 172.21.15.93:0/17580180 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x556e12976040 0x556e12977280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 >> 172.21.15.93:0/17580180 conn(0x556e129726d0 msgr2=0x556e129cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97817fa640 0 client.8853 ms_handle_reset on v2:172.21.15.93:6834/3641686617 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 shutdown_connections 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 1 -- 172.21.15.93:0/17580180 wait complete. 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97aae30740 20 client.8853 trim_cache size 0 max 16384 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stdout: "message": "", 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi093.stdout: "return_code": 0 2023-11-04T01:43:29.701 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-04T01:43:29.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 msgr2=0x7f978406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 0x7f978406d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9790006950 tx=0x7f9790001680 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 msgr2=0x7f97a01e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9798037040 tx=0x7f9798009750 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 shutdown_connections 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f978406ae70 0x7f978406d330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f97a01e6b30 0x7f97a01e6fb0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f97a00ccab0 0x7f97a00b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 --2- 172.21.15.93:0/3149691875 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f978c004d00 0x7f97a01f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 >> 172.21.15.93:0/3149691875 conn(0x7f97a00d2ef0 msgr2=0x7f97a00b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.698+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 shutdown_connections 2023-11-04T01:43:29.702 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.699+0000 7f97a829b640 1 -- 172.21.15.93:0/3149691875 wait complete. 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:29.710 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:43:29.746 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:43:29.746 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:29.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.885+0000 7f7f9e02b640 1 Processor -- start 2023-11-04T01:43:29.886 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.885+0000 7f7f9e02b640 1 -- start start 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f981605b0 0x7f7f980ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 0x7f7f980cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980b0f00 con 0x7f7f981605b0 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980c9100 con 0x7f7f9806b950 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f9e02b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980ae230 con 0x7f7f980b0530 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f981605b0 0x7f7f980ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f981605b0 0x7f7f980ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35372/0 (socket says 172.21.15.93:35372) 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 -- 172.21.15.93:0/1776939686 learned_addr learned my addr 172.21.15.93:0/1776939686 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f97fff640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1776939686 >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 0x7f7f980cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 -- 172.21.15.93:0/1776939686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 msgr2=0x7f7f980b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 -- 172.21.15.93:0/1776939686 >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 msgr2=0x7f7f980cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1776939686 >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 0x7f7f980cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f977fe640 1 -- 172.21.15.93:0/1776939686 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980aceb0 con 0x7f7f981605b0 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f97fff640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.886+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1776939686 >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 0x7f7f980cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f981605b0 0x7f7f980ac8d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f7f980ae4e0 tx=0x7f7f8c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976179372336d75e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f967fc640 1 -- 172.21.15.93:0/1776939686 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0317d0 con 0x7f7f981605b0 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f967fc640 1 -- 172.21.15.93:0/1776939686 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c031930 con 0x7f7f981605b0 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f967fc640 1 -- 172.21.15.93:0/1776939686 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c031cc0 con 0x7f7f981605b0 2023-11-04T01:43:29.890 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1776939686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f981605b0 msgr2=0x7f7f980ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f981605b0 0x7f7f980ac8d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f7f980ae4e0 tx=0x7f7f8c02b870 comp rx=0 tx=0).stop 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1776939686 shutdown_connections 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1776939686 >> v2:172.21.15.125:3300/0 conn(0x7f7f9806b950 0x7f7f980cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1776939686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f981605b0 0x7f7f980ac8d0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1776939686 >> 172.21.15.93:0/1776939686 conn(0x7f7f980cb530 msgr2=0x7f7f980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1776939686 shutdown_connections 2023-11-04T01:43:29.891 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.887+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1776939686 wait complete. 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 Processor -- start 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 -- start start 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f981605b0 0x7f7f980b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980b2d00 con 0x7f7f9806b950 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c3920 con 0x7f7f981605b0 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.889+0000 7f7f9e02b640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981523c0 con 0x7f7f980b0530 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35388/0 (socket says 172.21.15.93:35388) 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 -- 172.21.15.93:0/1442967110 learned_addr learned my addr 172.21.15.93:0/1442967110 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f97fff640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f981605b0 0x7f7f980b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 -- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 msgr2=0x7f7f980c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 -- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f981605b0 msgr2=0x7f7f980b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f981605b0 0x7f7f980b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 -- 172.21.15.93:0/1442967110 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0094d0 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f977fe640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097c0 tx=0x7f7f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c032870 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c0329d0 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c032d60 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980b2f30 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.890+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980b34f0 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.891+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980684b0 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.891+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f8c030070 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.892+0000 7f7f7ffff640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 0x7f7f8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.892+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f7f8c0abac0 con 0x7f7f9806b950 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.892+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 0x7f7f8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.892+0000 7f7f96ffd640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 0x7f7f8406d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7f98152070 tx=0x7f7f88008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:29.896+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f8c076280 con 0x7f7f9806b950 2023-11-04T01:43:30.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.096+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f980c8bb0 con 0x7f7f9806b950 2023-11-04T01:43:30.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.097+0000 7f7f7ffff640 1 -- 172.21.15.93:0/1442967110 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f7f8c0abe60 con 0x7f7f9806b950 2023-11-04T01:43:30.098 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:30.099 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:22.149315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:30.099 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 116 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 msgr2=0x7f7f8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 0x7f7f8406d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7f98152070 tx=0x7f7f88008040 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 msgr2=0x7f7f980c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0097c0 tx=0x7f7f8c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 shutdown_connections 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f8406ae70 0x7f7f8406d330 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f981605b0 0x7f7f980b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f980b0530 0x7f7f980c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 --2- 172.21.15.93:0/1442967110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f9806b950 0x7f7f980c3f80 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 >> 172.21.15.93:0/1442967110 conn(0x7f7f980cb530 msgr2=0x7f7f980c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 shutdown_connections 2023-11-04T01:43:30.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.099+0000 7f7f9e02b640 1 -- 172.21.15.93:0/1442967110 wait complete. 2023-11-04T01:43:30.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:30.225 INFO:teuthology.orchestra.run.smithi093.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.307387+0000","name":"s26","metadata":{}}],"need_to_purge":{"17":[11,13]},"pending_update":[],"pending_destroy":[{"version":28,"removed_snap":12,"seq":14}]} 2023-11-04T01:43:30.225 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "17": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 28 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:42:48.307387+0000" } ] } 2023-11-04T01:43:30.226 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:30.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.323+0000 7f25a3fe7640 1 Processor -- start 2023-11-04T01:43:30.324 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.323+0000 7f25a3fe7640 1 -- start start 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a3fe7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f259c0b0c40 0x7f259c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a3fe7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f259c070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a3fe7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c071500 con 0x7f259c159e40 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a3fe7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c070a70 con 0x7f259c0b0c40 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a3fe7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c15dae0 con 0x7f259c06bb60 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a1d83640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f259c159e40 0x7f259c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33288/0 (socket says 172.21.15.93:33288) 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a1d83640 1 -- 172.21.15.93:0/1148033056 learned_addr learned my addr 172.21.15.93:0/1148033056 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398365508 0 0) 0x7f259c071500 con 0x7f259c159e40 2023-11-04T01:43:30.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2588003520 con 0x7f259c159e40 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a2584640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f259c070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a1582640 1 --2- 172.21.15.93:0/1148033056 >> v2:172.21.15.125:3300/0 conn(0x7f259c0b0c40 0x7f259c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3395306965 0 0) 0x7f2588003520 con 0x7f259c159e40 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 msgr2=0x7f259c070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f259c070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 >> v2:172.21.15.125:3300/0 conn(0x7f259c0b0c40 msgr2=0x7f259c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 --2- 172.21.15.93:0/1148033056 >> v2:172.21.15.125:3300/0 conn(0x7f259c0b0c40 0x7f259c06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c070c60 con 0x7f259c159e40 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.324+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f2590001670 con 0x7f259c159e40 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 >> v1:172.21.15.93:6789/0 conn(0x7f259c159e40 legacy=0x7f259c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f2588003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25880047c0 0x7f2588004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.329 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f2588005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c15dae0 con 0x7f2588003970 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258800b980 con 0x7f25880047c0 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258800bac0 con 0x7f259c06bb60 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f2588003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1582640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25880047c0 0x7f2588004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a2584640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f2588005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 -- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 msgr2=0x7f2588005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c06bb60 0x7f2588005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 -- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25880047c0 msgr2=0x7f2588004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25880047c0 0x7f2588004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1d83640 1 -- 172.21.15.93:0/1148033056 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588003520 con 0x7f2588003970 2023-11-04T01:43:30.330 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.325+0000 7f25a1582640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25880047c0 0x7f2588004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a1d83640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f2588003d90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f259000c2c0 tx=0x7f25880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e500f623b3e70f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590005ad0 con 0x7f2588003970 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590005c30 con 0x7f2588003970 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a0d81640 1 -- 172.21.15.93:0/1148033056 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259002c8b0 con 0x7f2588003970 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 -- 172.21.15.93:0/1148033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 msgr2=0x7f2588003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/1148033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f2588003d90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f259000c2c0 tx=0x7f25880057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a2584640 1 -- 172.21.15.93:0/1148033056 reap_dead start 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 -- 172.21.15.93:0/1148033056 shutdown_connections 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 -- 172.21.15.93:0/1148033056 >> 172.21.15.93:0/1148033056 conn(0x7f259c0cb530 msgr2=0x7f259c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 -- 172.21.15.93:0/1148033056 shutdown_connections 2023-11-04T01:43:30.331 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.326+0000 7f25a3fe7640 1 -- 172.21.15.93:0/1148033056 wait complete. 2023-11-04T01:43:30.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 Processor -- start 2023-11-04T01:43:30.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 -- start start 2023-11-04T01:43:30.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f259c0cf150 0x7f259c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.334 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c0ac8a0 0x7f259c0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0cf5b0 con 0x7f2588003970 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1f0b10 con 0x7f259c0cf150 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a3fe7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0a8830 con 0x7f259c0ac8a0 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a1d83640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a1d83640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35396/0 (socket says 172.21.15.93:35396) 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a1d83640 1 -- 172.21.15.93:0/3234897950 learned_addr learned my addr 172.21.15.93:0/3234897950 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a1582640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f259c0cf150 0x7f259c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.328+0000 7f25a2584640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c0ac8a0 0x7f259c0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 -- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c0ac8a0 msgr2=0x7f259c0acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c0ac8a0 0x7f259c0acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 -- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f259c0cf150 msgr2=0x7f259c14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.335 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f259c0cf150 0x7f259c14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 -- 172.21.15.93:0/3234897950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c156390 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a1d83640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f259000c3e0 tx=0x7f2590000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259002dd50 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590007070 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c14d350 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590007420 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.329+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c0aaf90 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.330+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c0684b0 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.330+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2590032070 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.331+0000 7f258e7fc640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 0x7f258006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.331+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f259003c040 con 0x7f2588003970 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.331+0000 7f25a1582640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 0x7f258006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.336 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.331+0000 7f25a1582640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 0x7f258006d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f259c070b00 tx=0x7f2598008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.337 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.335+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2590076180 con 0x7f2588003970 2023-11-04T01:43:30.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.537+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f259c0c9340 con 0x7f2588003970 2023-11-04T01:43:30.539 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.537+0000 7f258e7fc640 1 -- 172.21.15.93:0/3234897950 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f25900797a0 con 0x7f2588003970 2023-11-04T01:43:30.540 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:30.540 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:22.149315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:30.540 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 116 2023-11-04T01:43:30.541 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 msgr2=0x7f258006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 0x7f258006d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f259c070b00 tx=0x7f2598008040 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 msgr2=0x7f259c0aa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f259000c3e0 tx=0x7f2590000fe0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 shutdown_connections 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f258006ae70 0x7f258006d330 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f259c0ac8a0 0x7f259c0acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f259c0cf150 0x7f259c14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 --2- 172.21.15.93:0/3234897950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2588003970 0x7f259c0aa6d0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.542 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 >> 172.21.15.93:0/3234897950 conn(0x7f259c0cb530 msgr2=0x7f259c0caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 shutdown_connections 2023-11-04T01:43:30.543 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.539+0000 7f25a3fe7640 1 -- 172.21.15.93:0/3234897950 wait complete. 2023-11-04T01:43:30.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:43:30.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.651+0000 7fcd50a1f640 1 Processor -- start 2023-11-04T01:43:30.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.651+0000 7fcd50a1f640 1 -- start start 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd50a1f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 0x7fcd4c164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd50a1f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c071500 con 0x7fcd4c159e40 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd50a1f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c15dae0 con 0x7fcd4c0b0c40 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd50a1f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c070c60 con 0x7fcd4c070700 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd4a59c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fcd4c159e40 0x7fcd4c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:33290/0 (socket says 172.21.15.93:33290) 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd4a59c640 1 -- 172.21.15.93:0/1317223525 learned_addr learned my addr 172.21.15.93:0/1317223525 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:30.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.652+0000 7fcd4ad9d640 1 --2- 172.21.15.93:0/1317223525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 0x7fcd4c164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356564251 0 0) 0x7fcd4c071500 con 0x7fcd4c159e40 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd34003520 con 0x7fcd4c159e40 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430433744 0 0) 0x7fcd4c15dae0 con 0x7fcd4c0b0c40 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd4c071500 con 0x7fcd4c0b0c40 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216428733 0 0) 0x7fcd34003520 con 0x7fcd4c159e40 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/1317223525 >> v1:172.21.15.125:6789/0 conn(0x7fcd4c0b0c40 legacy=0x7fcd4c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/1317223525 >> v1:172.21.15.93:6789/0 conn(0x7fcd4c159e40 legacy=0x7fcd4c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.653+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/1317223525 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c070f40 con 0x7fcd4c070700 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd4ad9d640 1 --2- 172.21.15.93:0/1317223525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 0x7fcd4c164b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097d0 tx=0x7fcd4402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5689c52a03b8db81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0019f0 con 0x7fcd4c070700 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4402e050 con 0x7fcd4c070700 2023-11-04T01:43:30.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd4959a640 1 -- 172.21.15.93:0/1317223525 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44030730 con 0x7fcd4c070700 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 -- 172.21.15.93:0/1317223525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 msgr2=0x7fcd4c164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/1317223525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 0x7fcd4c164b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097d0 tx=0x7fcd4402b770 comp rx=0 tx=0).stop 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 -- 172.21.15.93:0/1317223525 shutdown_connections 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/1317223525 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c070700 0x7fcd4c164b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 -- 172.21.15.93:0/1317223525 >> 172.21.15.93:0/1317223525 conn(0x7fcd4c0cb530 msgr2=0x7fcd4c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 -- 172.21.15.93:0/1317223525 shutdown_connections 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.654+0000 7fcd50a1f640 1 -- 172.21.15.93:0/1317223525 wait complete. 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 Processor -- start 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 -- start start 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 0x7fcd4c15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 0x7fcd4c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c15afd0 con 0x7fcd4c159e40 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c15b2b0 con 0x7fcd4c070700 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.656+0000 7fcd50a1f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c15b590 con 0x7fcd4c0b0c40 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:35406/0 (socket says 172.21.15.93:35406) 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/3171555197 learned_addr learned my addr 172.21.15.93:0/3171555197 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd49d9b640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 0x7fcd4c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4a59c640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 0x7fcd4c15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 msgr2=0x7fcd4c0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 0x7fcd4c0aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 msgr2=0x7fcd4c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 0x7fcd4c15cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.663 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 -- 172.21.15.93:0/3171555197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009400 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd49d9b640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 0x7fcd4c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4a59c640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 0x7fcd4c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd4ad9d640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009720 tx=0x7fcd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004230 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44004390 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44003850 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c15b870 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.657+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c15ac30 con 0x7fcd4c159e40 2023-11-04T01:43:30.664 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.658+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c0684b0 con 0x7fcd4c159e40 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.659+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd44039040 con 0x7fcd4c159e40 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.659+0000 7fcd3affd640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 0x7fcd2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.659+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fcd440ab4a0 con 0x7fcd4c159e40 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.659+0000 7fcd4a59c640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 0x7fcd2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.659+0000 7fcd4a59c640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 0x7fcd2c06d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0012e0 tx=0x7fcd3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.665 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.663+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd44075cd0 con 0x7fcd4c159e40 2023-11-04T01:43:30.896 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:30.894+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fcd4c0c9750 con 0x7fcd4c159e40 2023-11-04T01:43:31.175 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.173+0000 7fcd3affd640 1 -- 172.21.15.93:0/3171555197 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.6380 v117) v1 ==== 112+0+0 (secure 0 0 0) 0x7fcd44037020 con 0x7fcd4c159e40 2023-11-04T01:43:31.175 INFO:teuthology.orchestra.run.smithi093.stderr:freezing mds.6380 2023-11-04T01:43:31.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 msgr2=0x7fcd2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.177 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 0x7fcd2c06d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0012e0 tx=0x7fcd3c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 msgr2=0x7fcd4c0c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009720 tx=0x7fcd440046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 shutdown_connections 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fcd2c06ae70 0x7fcd2c06d330 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4c159e40 0x7fcd4c0c25c0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fcd4c0b0c40 0x7fcd4c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 --2- 172.21.15.93:0/3171555197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd4c070700 0x7fcd4c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 >> 172.21.15.93:0/3171555197 conn(0x7fcd4c0cb530 msgr2=0x7fcd4c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 shutdown_connections 2023-11-04T01:43:31.178 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.175+0000 7fcd50a1f640 1 -- 172.21.15.93:0/3171555197 wait complete. 2023-11-04T01:43:31.188 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:43:31.311 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:43:31.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:43:31.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:31.311 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:43:31.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f472d21a640 time 2023-11-04T01:43:31.329622+0000 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4732d6efaf] 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.330 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:43:31.329+0000 7f472d21a640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f472d21a640 time 2023-11-04T01:43:31.329622+0000 2023-11-04T01:43:31.331 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4732d6efaf] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.332 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7f472d21a640 thread_name:ms_dispatch 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4732454db0] 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f47324a154c] 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4732d6f009] 2023-11-04T01:43:31.333 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr:2023-11-04T01:43:31.329+0000 7f472d21a640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7f472d21a640 thread_name:ms_dispatch 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.334 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4732454db0] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f47324a154c] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4732d6f009] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.335 INFO:tasks.ceph.mds.b.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.336 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:31.336 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.337 INFO:tasks.ceph.mds.b.smithi125.stderr: -1> 2023-11-04T01:43:31.329+0000 7f472d21a640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f472d21a640 time 2023-11-04T01:43:31.329622+0000 2023-11-04T01:43:31.337 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:43:31.337 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.337 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4732d6efaf] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.338 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 0> 2023-11-04T01:43:31.329+0000 7f472d21a640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7f472d21a640 thread_name:ms_dispatch 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4732454db0] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f47324a154c] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4732d6f009] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.339 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:31.340 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.341 INFO:tasks.ceph.mds.b.smithi125.stderr: -1> 2023-11-04T01:43:31.329+0000 7f472d21a640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f472d21a640 time 2023-11-04T01:43:31.329622+0000 2023-11-04T01:43:31.341 INFO:tasks.ceph.mds.b.smithi125.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:43:31.341 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.341 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4732d6efaf] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.342 INFO:tasks.ceph.mds.b.smithi125.stderr: 0> 2023-11-04T01:43:31.329+0000 7f472d21a640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: in thread 7f472d21a640 thread_name:ms_dispatch 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4732454db0] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f47324a154c] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 3: raise() 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 4: abort() 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4732d6f009] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4732d6f16d] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x555a982f91b7] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x555a98086d15] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x555a98088b2b] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a9808901c] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555a98072325] 2023-11-04T01:43:31.343 INFO:tasks.ceph.mds.b.smithi125.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4732f5ff9a] 2023-11-04T01:43:31.344 INFO:tasks.ceph.mds.b.smithi125.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4732ff1741] 2023-11-04T01:43:31.344 INFO:tasks.ceph.mds.b.smithi125.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f473249f802] 2023-11-04T01:43:31.344 INFO:tasks.ceph.mds.b.smithi125.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f473243f450] 2023-11-04T01:43:31.344 INFO:tasks.ceph.mds.b.smithi125.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:31.344 INFO:tasks.ceph.mds.b.smithi125.stderr: 2023-11-04T01:43:31.461 INFO:teuthology.orchestra.run.smithi093.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:43:31.461 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:43:31.461 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.558+0000 7ffa1686f640 1 Processor -- start 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.558+0000 7ffa1686f640 1 -- start start 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa1686f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffa1015d100 0x7ffa100ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa1686f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffa100d1be0 0x7ffa100b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa1686f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa100b32b0 con 0x7ffa1015d4e0 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa1686f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa100cee10 con 0x7ffa1015d100 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa1686f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa100b2980 con 0x7ffa100d1be0 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa0ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffa1015d100 0x7ffa100ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa0ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffa1015d100 0x7ffa100ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:53970/0 (socket says 172.21.15.93:53970) 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa0ffff640 1 -- 172.21.15.93:0/2189813839 learned_addr learned my addr 172.21.15.93:0/2189813839 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.559+0000 7ffa0f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ffa1015d4e0 0x7ffa100d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41588/0 (socket says 172.21.15.93:41588) 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa14e0c640 1 --2- 172.21.15.93:0/2189813839 >> v2:172.21.15.125:3300/0 conn(0x7ffa100d1be0 0x7ffa100b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0ffff640 1 -- 172.21.15.93:0/2189813839 >> v2:172.21.15.125:3300/0 conn(0x7ffa100d1be0 msgr2=0x7ffa100b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0ffff640 1 --2- 172.21.15.93:0/2189813839 >> v2:172.21.15.125:3300/0 conn(0x7ffa100d1be0 0x7ffa100b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0ffff640 1 -- 172.21.15.93:0/2189813839 >> v1:172.21.15.93:6789/0 conn(0x7ffa1015d4e0 legacy=0x7ffa100d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0ffff640 1 -- 172.21.15.93:0/2189813839 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100b2c60 con 0x7ffa1015d100 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0effd640 1 -- 172.21.15.93:0/2189813839 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56502866 0 0) 0x7ffa100b32b0 con 0x7ffa1015d4e0 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0ffff640 1 --2- 172.21.15.93:0/2189813839 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100ce510 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ffa1008d6a0 tx=0x7ffa0002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549619a3c283b2c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.560+0000 7ffa0effd640 1 -- 172.21.15.93:0/2189813839 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00004230 con 0x7ffa1015d100 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa0effd640 1 -- 172.21.15.93:0/2189813839 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00004390 con 0x7ffa1015d100 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa0effd640 1 -- 172.21.15.93:0/2189813839 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00030840 con 0x7ffa1015d100 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 -- 172.21.15.93:0/2189813839 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 msgr2=0x7ffa100ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2189813839 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100ce510 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ffa1008d6a0 tx=0x7ffa0002b980 comp rx=0 tx=0).stop 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 -- 172.21.15.93:0/2189813839 shutdown_connections 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2189813839 >> v2:172.21.15.125:3300/0 conn(0x7ffa100d1be0 0x7ffa100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2189813839 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100ce510 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 -- 172.21.15.93:0/2189813839 >> 172.21.15.93:0/2189813839 conn(0x7ffa100d2ef0 msgr2=0x7ffa100d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 -- 172.21.15.93:0/2189813839 shutdown_connections 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.561+0000 7ffa1686f640 1 -- 172.21.15.93:0/2189813839 wait complete. 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.562+0000 7ffa1686f640 1 Processor -- start 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.562+0000 7ffa1686f640 1 -- start start 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa100d1be0 0x7ffa100c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1015d4e0 0x7ffa100b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b0d40 con 0x7ffa1015d100 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b0150 con 0x7ffa100d1be0 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa1686f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b03a0 con 0x7ffa1015d4e0 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:53976/0 (socket says 172.21.15.93:53976) 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa0f7fe640 1 -- 172.21.15.93:0/2693724651 learned_addr learned my addr 172.21.15.93:0/2693724651 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa0ffff640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa100d1be0 0x7ffa100c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.563+0000 7ffa14e0c640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1015d4e0 0x7ffa100b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 -- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1015d4e0 msgr2=0x7ffa100b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1015d4e0 0x7ffa100b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 -- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa100d1be0 msgr2=0x7ffa100c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa100d1be0 0x7ffa100c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 -- 172.21.15.93:0/2693724651 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00009460 con 0x7ffa1015d100 2023-11-04T01:43:31.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0f7fe640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c4b0 tx=0x7ffa0400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040074e0 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04007660 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa100b0680 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004a20 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.564+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa100c99d0 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.565+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa100b0e80 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.565+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa04004b80 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.566+0000 7ffa0cff9640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 0x7ff9fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.566+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ffa04089050 con 0x7ffa1015d100 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.566+0000 7ffa0ffff640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 0x7ff9fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.571 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.566+0000 7ffa0ffff640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 0x7ff9fc06d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ffa00035000 tx=0x7ffa00008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.570+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa100b0e80 con 0x7ffa1015d100 2023-11-04T01:43:31.604 INFO:tasks.ceph.mds.b.smithi125.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:43:31.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.771+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa100b0e80 con 0x7ffa1015d100 2023-11-04T01:43:31.773 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.771+0000 7ffa0cff9640 1 -- 172.21.15.93:0/2693724651 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7ffa100b0e80 con 0x7ffa1015d100 2023-11-04T01:43:31.774 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:31.774 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:30.896195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:31.774 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 117 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 msgr2=0x7ff9fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 0x7ff9fc06d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ffa00035000 tx=0x7ffa00008030 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 msgr2=0x7ffa100b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c4b0 tx=0x7ffa0400c970 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 shutdown_connections 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7ff9fc06ae70 0x7ff9fc06d330 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7ffa1015d4e0 0x7ffa100b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa1015d100 0x7ffa100b6100 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 --2- 172.21.15.93:0/2693724651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa100d1be0 0x7ffa100c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 >> 172.21.15.93:0/2693724651 conn(0x7ffa100d2ef0 msgr2=0x7ffa100b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.776 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 shutdown_connections 2023-11-04T01:43:31.777 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:31.773+0000 7ffa1686f640 1 -- 172.21.15.93:0/2693724651 wait complete. 2023-11-04T01:43:31.786 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:33.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:43:36.787 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:36.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.896+0000 7fefd576c640 1 Processor -- start 2023-11-04T01:43:36.898 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.896+0000 7fefd576c640 1 -- start start 2023-11-04T01:43:36.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefd576c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fefd015d100 0x7fefd00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefd576c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 0x7fefd00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.900 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefd576c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd00b32b0 con 0x7fefd00d3b60 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefd576c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00cee10 con 0x7fefd015d100 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefd576c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00b4750 con 0x7fefd015d4e0 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fefd015d100 0x7fefd00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fefd015d100 0x7fefd00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:53988/0 (socket says 172.21.15.93:53988) 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 -- 172.21.15.93:0/719752039 learned_addr learned my addr 172.21.15.93:0/719752039 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefcf7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fefd00d3b60 0x7fefd00cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:41604/0 (socket says 172.21.15.93:41604) 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefce7fc640 1 --2- 172.21.15.93:0/719752039 >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 0x7fefd00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 -- 172.21.15.93:0/719752039 >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 msgr2=0x7fefd00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 --2- 172.21.15.93:0/719752039 >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 0x7fefd00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefcdffb640 1 -- 172.21.15.93:0/719752039 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854612083 0 0) 0x7fefd00b32b0 con 0x7fefd00d3b60 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 -- 172.21.15.93:0/719752039 >> v1:172.21.15.93:6789/0 conn(0x7fefd00d3b60 legacy=0x7fefd00cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefceffd640 1 -- 172.21.15.93:0/719752039 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00b2980 con 0x7fefd015d100 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.897+0000 7fefce7fc640 1 --2- 172.21.15.93:0/719752039 >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 0x7fefd00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.898+0000 7fefceffd640 1 --2- 172.21.15.93:0/719752039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd015d100 0x7fefd00ce510 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fefd0160da0 tx=0x7fefc002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83edc975d0d5af55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.898+0000 7fefcdffb640 1 -- 172.21.15.93:0/719752039 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0004230 con 0x7fefd015d100 2023-11-04T01:43:36.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.898+0000 7fefcdffb640 1 -- 172.21.15.93:0/719752039 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc0004390 con 0x7fefd015d100 2023-11-04T01:43:36.902 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.898+0000 7fefcdffb640 1 -- 172.21.15.93:0/719752039 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0030840 con 0x7fefd015d100 2023-11-04T01:43:36.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 -- 172.21.15.93:0/719752039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd015d100 msgr2=0x7fefd00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 --2- 172.21.15.93:0/719752039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd015d100 0x7fefd00ce510 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fefd0160da0 tx=0x7fefc002b980 comp rx=0 tx=0).stop 2023-11-04T01:43:36.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 -- 172.21.15.93:0/719752039 shutdown_connections 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 --2- 172.21.15.93:0/719752039 >> v2:172.21.15.125:3300/0 conn(0x7fefd015d4e0 0x7fefd00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 --2- 172.21.15.93:0/719752039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd015d100 0x7fefd00ce510 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 -- 172.21.15.93:0/719752039 >> 172.21.15.93:0/719752039 conn(0x7fefd00d2ef0 msgr2=0x7fefd00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 -- 172.21.15.93:0/719752039 shutdown_connections 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.899+0000 7fefd576c640 1 -- 172.21.15.93:0/719752039 wait complete. 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.900+0000 7fefd576c640 1 Processor -- start 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.900+0000 7fefd576c640 1 -- start start 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fefd00d3b60 0x7fefd015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 0x7fefd00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00b6e30 con 0x7fefd00b7e30 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00b7ca0 con 0x7fefd015d4e0 2023-11-04T01:43:36.905 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefd576c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015ba30 con 0x7fefd00d3b60 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:53998/0 (socket says 172.21.15.93:53998) 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 -- 172.21.15.93:0/1660163557 learned_addr learned my addr 172.21.15.93:0/1660163557 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefceffd640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fefd00d3b60 0x7fefd015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefce7fc640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 0x7fefd00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 -- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fefd00d3b60 msgr2=0x7fefd015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fefd00d3b60 0x7fefd015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 -- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 msgr2=0x7fefd00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 0x7fefd00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefcf7fe640 1 -- 172.21.15.93:0/1660163557 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc0009460 con 0x7fefd00b7e30 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.901+0000 7fefce7fc640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 0x7fefd00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:36.906 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefcf7fe640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c700 tx=0x7fefc800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800ce10 con 0x7fefd00b7e30 2023-11-04T01:43:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800a640 con 0x7fefd00b7e30 2023-11-04T01:43:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd00ca160 con 0x7fefd00b7e30 2023-11-04T01:43:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800aa30 con 0x7fefd00b7e30 2023-11-04T01:43:36.907 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.902+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd00ca720 con 0x7fefd00b7e30 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.903+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd00684b0 con 0x7fefd00b7e30 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.903+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefc800ab90 con 0x7fefd00b7e30 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.904+0000 7fefb77fe640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 0x7fefbc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.904+0000 7fefceffd640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 0x7fefbc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.904+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8223+0+0 (secure 0 0 0) 0x7fefc80895c0 con 0x7fefd00b7e30 2023-11-04T01:43:36.908 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.904+0000 7fefceffd640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 0x7fefbc06d360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fefc0035000 tx=0x7fefc0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.910 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:36.908+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefc8053d90 con 0x7fefd00b7e30 2023-11-04T01:43:37.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.110+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd00d2cd0 con 0x7fefd00b7e30 2023-11-04T01:43:37.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.110+0000 7fefb77fe640 1 -- 172.21.15.93:0/1660163557 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7fefc8018020 con 0x7fefd00b7e30 2023-11-04T01:43:37.112 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:37.113 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:30.896195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:37.113 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 117 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 msgr2=0x7fefbc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 0x7fefbc06d360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fefc0035000 tx=0x7fefc0008030 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 msgr2=0x7fefd00cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c700 tx=0x7fefc800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 shutdown_connections 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fefbc06aea0 0x7fefbc06d360 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefd00b7e30 0x7fefd00cfa90 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd015d4e0 0x7fefd00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 --2- 172.21.15.93:0/1660163557 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fefd00d3b60 0x7fefd015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 >> 172.21.15.93:0/1660163557 conn(0x7fefd00d2ef0 msgr2=0x7fefd00b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 shutdown_connections 2023-11-04T01:43:37.116 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:37.112+0000 7fefd576c640 1 -- 172.21.15.93:0/1660163557 wait complete. 2023-11-04T01:43:37.125 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:39.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:43:42.126 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:42.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.236+0000 7f10b810f640 1 Processor -- start 2023-11-04T01:43:42.238 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.236+0000 7f10b810f640 1 -- start start 2023-11-04T01:43:42.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b810f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 0x7f10b00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b810f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 0x7f10b00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b810f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b0071500 con 0x7f10b006fff0 2023-11-04T01:43:42.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b810f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b015dae0 con 0x7f10b0159e40 2023-11-04T01:43:42.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b810f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0070c60 con 0x7f10b006bb60 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b56aa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 0x7f10b00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b5eab640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 0x7f10b00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b66ac640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f10b006fff0 0x7f10b0070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:35646/0 (socket says 172.21.15.93:35646) 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b66ac640 1 -- 172.21.15.93:0/806774487 learned_addr learned my addr 172.21.15.93:0/806774487 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b56aa640 1 -- 172.21.15.93:0/806774487 >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 msgr2=0x7f10b00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b56aa640 1 --2- 172.21.15.93:0/806774487 >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 0x7f10b00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b56aa640 1 -- 172.21.15.93:0/806774487 >> v1:172.21.15.125:6789/0 conn(0x7f10b006fff0 legacy=0x7f10b0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b56aa640 1 -- 172.21.15.93:0/806774487 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b0070f40 con 0x7f10b006bb60 2023-11-04T01:43:42.240 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.237+0000 7f10b5eab640 1 --2- 172.21.15.93:0/806774487 >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 0x7f10b00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.238+0000 7f10b56aa640 1 --2- 172.21.15.93:0/806774487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 0x7f10b00b0a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097a0 tx=0x7f10a002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d90647a8f50f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.238+0000 7f10b4ea9640 1 -- 172.21.15.93:0/806774487 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a002e070 con 0x7f10b006bb60 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.238+0000 7f10b4ea9640 1 -- 172.21.15.93:0/806774487 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00315a0 con 0x7f10b006bb60 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.238+0000 7f10b4ea9640 1 -- 172.21.15.93:0/806774487 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0031930 con 0x7f10b006bb60 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 -- 172.21.15.93:0/806774487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 msgr2=0x7f10b00b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 --2- 172.21.15.93:0/806774487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 0x7f10b00b0a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097a0 tx=0x7f10a002b840 comp rx=0 tx=0).stop 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 -- 172.21.15.93:0/806774487 shutdown_connections 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 --2- 172.21.15.93:0/806774487 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b006bb60 0x7f10b00b0a70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 --2- 172.21.15.93:0/806774487 >> v2:172.21.15.125:3300/0 conn(0x7f10b0159e40 0x7f10b00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 -- 172.21.15.93:0/806774487 >> 172.21.15.93:0/806774487 conn(0x7f10b00cb530 msgr2=0x7f10b00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 -- 172.21.15.93:0/806774487 shutdown_connections 2023-11-04T01:43:42.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.239+0000 7f10b810f640 1 -- 172.21.15.93:0/806774487 wait complete. 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.240+0000 7f10b810f640 1 Processor -- start 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.240+0000 7f10b810f640 1 -- start start 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10b006fff0 0x7f10b0154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b0159e40 0x7f10b0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00c7930 con 0x7f10b006bb60 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00c3840 con 0x7f10b006fff0 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b810f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0154e20 con 0x7f10b0159e40 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b5eab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b5eab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39526/0 (socket says 172.21.15.93:39526) 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b5eab640 1 -- 172.21.15.93:0/2565961023 learned_addr learned my addr 172.21.15.93:0/2565961023 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:42.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b66ac640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b0159e40 0x7f10b0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.241+0000 7f10b56aa640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10b006fff0 0x7f10b0154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 -- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b0159e40 msgr2=0x7f10b0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b0159e40 0x7f10b0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 -- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10b006fff0 msgr2=0x7f10b0154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10b006fff0 0x7f10b0154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 -- 172.21.15.93:0/2565961023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009400 con 0x7f10b006bb60 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b5eab640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e960 tx=0x7f10a800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800ca00 con 0x7f10b006bb60 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800cb60 con 0x7f10b006bb60 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a0009400 con 0x7f10b006bb60 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800ced0 con 0x7f10b006bb60 2023-11-04T01:43:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.242+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b00c7650 con 0x7f10b006bb60 2023-11-04T01:43:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.243+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b00c3610 con 0x7f10b006bb60 2023-11-04T01:43:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.243+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10a8013470 con 0x7f10b006bb60 2023-11-04T01:43:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.244+0000 7f10a67fc640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 0x7f109406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.244+0000 7f10b56aa640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 0x7f109406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.244+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f10a808a190 con 0x7f10b006bb60 2023-11-04T01:43:42.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.244+0000 7f10b56aa640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 0x7f109406d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f10a0036000 tx=0x7f10a003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.248+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10b00c3610 con 0x7f10b006bb60 2023-11-04T01:43:42.454 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.452+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10b00684b0 con 0x7f10b006bb60 2023-11-04T01:43:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.453+0000 7f10a67fc640 1 -- 172.21.15.93:0/2565961023 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f10a8017090 con 0x7f10b006bb60 2023-11-04T01:43:42.455 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:42.455 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:30.896195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:42.455 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 117 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 msgr2=0x7f109406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 0x7f109406d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f10a0036000 tx=0x7f10a003d040 comp rx=0 tx=0).stop 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 msgr2=0x7f10b01548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e960 tx=0x7f10a800ee20 comp rx=0 tx=0).stop 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 shutdown_connections 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f109406ae70 0x7f109406d330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f10b0159e40 0x7f10b0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10b006fff0 0x7f10b0154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.458 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 --2- 172.21.15.93:0/2565961023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10b006bb60 0x7f10b01548e0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 >> 172.21.15.93:0/2565961023 conn(0x7f10b00cb530 msgr2=0x7f10b00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 shutdown_connections 2023-11-04T01:43:42.459 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:42.455+0000 7f10b810f640 1 -- 172.21.15.93:0/2565961023 wait complete. 2023-11-04T01:43:42.468 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:46.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:43:47.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.577+0000 7efcbda64640 1 Processor -- start 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.577+0000 7efcbda64640 1 -- start start 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcbda64640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 0x7efcb80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcbda64640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcb806bb60 0x7efcb80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcbda64640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb8071500 con 0x7efcb806fff0 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcbda64640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb815dae0 con 0x7efcb806bb60 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcbda64640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb8070c60 con 0x7efcb8159e40 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcb806bb60 0x7efcb80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efcb806bb60 0x7efcb80b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39534/0 (socket says 172.21.15.93:39534) 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 -- 172.21.15.93:0/792235392 learned_addr learned my addr 172.21.15.93:0/792235392 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb77fe640 1 --2- 172.21.15.93:0/792235392 >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 0x7efcb80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 -- 172.21.15.93:0/792235392 >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 msgr2=0x7efcb80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 --2- 172.21.15.93:0/792235392 >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 0x7efcb80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 -- 172.21.15.93:0/792235392 >> v1:172.21.15.125:6789/0 conn(0x7efcb806fff0 legacy=0x7efcb8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb6ffd640 1 -- 172.21.15.93:0/792235392 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8070f40 con 0x7efcb806bb60 2023-11-04T01:43:47.582 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.578+0000 7efcb77fe640 1 --2- 172.21.15.93:0/792235392 >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 0x7efcb80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.579+0000 7efcb6ffd640 1 --2- 172.21.15.93:0/792235392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806bb60 0x7efcb80b0a70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ce7f0 tx=0x7efca002dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda61ed6b3d9aec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.579+0000 7efcb67fc640 1 -- 172.21.15.93:0/792235392 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca002ed70 con 0x7efcb806bb60 2023-11-04T01:43:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.579+0000 7efcb67fc640 1 -- 172.21.15.93:0/792235392 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0036440 con 0x7efcb806bb60 2023-11-04T01:43:47.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.579+0000 7efcb67fc640 1 -- 172.21.15.93:0/792235392 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00367d0 con 0x7efcb806bb60 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 -- 172.21.15.93:0/792235392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806bb60 msgr2=0x7efcb80b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 --2- 172.21.15.93:0/792235392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806bb60 0x7efcb80b0a70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ce7f0 tx=0x7efca002dfc0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 -- 172.21.15.93:0/792235392 shutdown_connections 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 --2- 172.21.15.93:0/792235392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806bb60 0x7efcb80b0a70 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 --2- 172.21.15.93:0/792235392 >> v2:172.21.15.125:3300/0 conn(0x7efcb8159e40 0x7efcb80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 -- 172.21.15.93:0/792235392 >> 172.21.15.93:0/792235392 conn(0x7efcb80cb530 msgr2=0x7efcb80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 -- 172.21.15.93:0/792235392 shutdown_connections 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.580+0000 7efcbda64640 1 -- 172.21.15.93:0/792235392 wait complete. 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.581+0000 7efcbda64640 1 Processor -- start 2023-11-04T01:43:47.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.581+0000 7efcbda64640 1 -- start start 2023-11-04T01:43:47.586 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcb806bb60 0x7efcb8149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcb8159e40 0x7efcb8148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80c5950 con 0x7efcb806fff0 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80c2ba0 con 0x7efcb8159e40 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcbda64640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb815b730 con 0x7efcb806bb60 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39536/0 (socket says 172.21.15.93:39536) 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 -- 172.21.15.93:0/2394997908 learned_addr learned my addr 172.21.15.93:0/2394997908 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb77fe640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcb806bb60 0x7efcb8149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb7fff640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcb8159e40 0x7efcb8148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 -- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcb806bb60 msgr2=0x7efcb8149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcb806bb60 0x7efcb8149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 -- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcb8159e40 msgr2=0x7efcb8148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcb8159e40 0x7efcb8148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 -- 172.21.15.93:0/2394997908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca000b770 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.582+0000 7efcb6ffd640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7efca002e000 tx=0x7efca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.583+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca003f840 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.583+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca003f9e0 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.583+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb815ba10 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.583+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca003fd90 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.583+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb815bfd0 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.584+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb80684b0 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.584+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efca003d040 con 0x7efcb806fff0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.584+0000 7efcaffff640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 0x7efc9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.584+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7efca00aebc0 con 0x7efcb806fff0 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.585+0000 7efcb77fe640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 0x7efc9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.585+0000 7efcb77fe640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 0x7efc9806d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efca800a950 tx=0x7efca8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.589+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efca00791d0 con 0x7efcb806fff0 2023-11-04T01:43:47.792 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.790+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcb80c9750 con 0x7efcb806fff0 2023-11-04T01:43:47.793 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.790+0000 7efcaffff640 1 -- 172.21.15.93:0/2394997908 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4988 (secure 0 0 0) 0x7efca003b020 con 0x7efcb806fff0 2023-11-04T01:43:47.793 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:47.793 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1117471166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":1117471166},{"type":"v1","addr":"172.21.15.93:6837","nonce":1117471166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/2831506911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":2831506911},{"type":"v1","addr":"172.21.15.125:6835","nonce":2831506911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:12.877413+0000","modified":"2023-11-04T01:43:47.096771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8451,"mds_1":6380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6380":{"gid":6380,"name":"b","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.125:6833/770196477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":770196477},{"type":"v1","addr":"172.21.15.125:6833","nonce":770196477}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:47.096771+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8451":{"gid":8451,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.93:6836/3641686617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3641686617},{"type":"v1","addr":"172.21.15.93:6836","nonce":3641686617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:47.793 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 118 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 msgr2=0x7efc9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 0x7efc9806d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efca800a950 tx=0x7efca8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 msgr2=0x7efcb80c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7efca002e000 tx=0x7efca00046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 shutdown_connections 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efc9806ae70 0x7efc9806d330 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcb8159e40 0x7efcb8148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efcb806fff0 0x7efcb80c50e0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 --2- 172.21.15.93:0/2394997908 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efcb806bb60 0x7efcb8149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.792+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 >> 172.21.15.93:0/2394997908 conn(0x7efcb80cb530 msgr2=0x7efcb80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.793+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 shutdown_connections 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:47.793+0000 7efcbda64640 1 -- 172.21.15.93:0/2394997908 wait complete. 2023-11-04T01:43:47.805 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:43:47.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:43:47.836 INFO:teuthology.orchestra.run.smithi125.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:43:47.837 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:43:47.838 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:43:47.912 INFO:teuthology.orchestra.run.smithi125.stdout:1699062211.96685.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:43:47.913 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062211.96685.core'] 2023-11-04T01:43:47.914 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062211.96685.core, deleting it 2023-11-04T01:43:47.914 DEBUG:teuthology.orchestra.run.smithi125:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062211.96685.core 2023-11-04T01:43:47.986 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:43:47.986 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:47.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:47.986 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 down 2023-11-04T01:43:48.014 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:43:48.014 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:43:48.014 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:48.073 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:48.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:43:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:48.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.209+0000 7efd7f7b7640 1 Processor -- start 2023-11-04T01:43:48.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.209+0000 7efd7f7b7640 1 -- start start 2023-11-04T01:43:48.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.210+0000 7efd7f7b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.210+0000 7efd7f7b7640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 0x7efd780d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.210+0000 7efd7f7b7640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780b32b0 con 0x7efd7815d100 2023-11-04T01:43:48.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.210+0000 7efd7f7b7640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780cec20 con 0x7efd780d3b60 2023-11-04T01:43:48.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.210+0000 7efd7f7b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780cee10 con 0x7efd7815d4e0 2023-11-04T01:43:48.213 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7dd54640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 0x7efd780d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3301/0 says I am v2:172.21.15.93:36712/0 (socket says 172.21.15.93:36712) 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7d553640 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efd7815d100 0x7efd780ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.93:35662/0 (socket says 172.21.15.93:35662) 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 -- 172.21.15.93:0/465767545 learned_addr learned my addr 172.21.15.93:0/465767545 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 -- 172.21.15.93:0/465767545 >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 msgr2=0x7efd780d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 --2- 172.21.15.93:0/465767545 >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 0x7efd780d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 -- 172.21.15.93:0/465767545 >> v1:172.21.15.125:6789/0 conn(0x7efd7815d100 legacy=0x7efd780ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7cd52640 1 -- 172.21.15.93:0/465767545 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780b4750 con 0x7efd7815d4e0 2023-11-04T01:43:48.214 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.211+0000 7efd7dd54640 1 --2- 172.21.15.93:0/465767545 >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 0x7efd780d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:48.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.212+0000 7efd7cd52640 1 --2- 172.21.15.93:0/465767545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5205cf9faeedfd56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.212+0000 7efd6ffff640 1 -- 172.21.15.93:0/465767545 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68030840 con 0x7efd7815d4e0 2023-11-04T01:43:48.215 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.212+0000 7efd6ffff640 1 -- 172.21.15.93:0/465767545 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680309a0 con 0x7efd7815d4e0 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.212+0000 7efd6ffff640 1 -- 172.21.15.93:0/465767545 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68030d30 con 0x7efd7815d4e0 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 -- 172.21.15.93:0/465767545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 msgr2=0x7efd780d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/465767545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802b980 comp rx=0 tx=0).stop 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 -- 172.21.15.93:0/465767545 shutdown_connections 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/465767545 >> v2:172.21.15.125:3300/0 conn(0x7efd780d3b60 0x7efd780d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/465767545 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd7815d4e0 0x7efd780d14d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 -- 172.21.15.93:0/465767545 >> 172.21.15.93:0/465767545 conn(0x7efd780d2ef0 msgr2=0x7efd780d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 -- 172.21.15.93:0/465767545 shutdown_connections 2023-11-04T01:43:48.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.213+0000 7efd7f7b7640 1 -- 172.21.15.93:0/465767545 wait complete. 2023-11-04T01:43:48.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.214+0000 7efd7f7b7640 1 Processor -- start 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.214+0000 7efd7f7b7640 1 -- start start 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd780d3b60 0x7efd780b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7815d4e0 0x7efd781531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b7300 con 0x7efd7815d100 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b6680 con 0x7efd7815d4e0 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b6960 con 0x7efd780d3b60 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39548/0 (socket says 172.21.15.93:39548) 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 -- 172.21.15.93:0/2854521447 learned_addr learned my addr 172.21.15.93:0/2854521447 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:48.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7d553640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd780d3b60 0x7efd780b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7dd54640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7815d4e0 0x7efd781531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 -- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd780d3b60 msgr2=0x7efd780b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd780d3b60 0x7efd780b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 -- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7815d4e0 msgr2=0x7efd781531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7815d4e0 0x7efd781531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 -- 172.21.15.93:0/2854521447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009400 con 0x7efd7815d100 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7cd52640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7efd68000c00 tx=0x7efd68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68039a90 con 0x7efd7815d100 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68039bf0 con 0x7efd7815d100 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68043410 con 0x7efd7815d100 2023-11-04T01:43:48.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.215+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680094d0 con 0x7efd7815d100 2023-11-04T01:43:48.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.216+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780b6f20 con 0x7efd7815d100 2023-11-04T01:43:48.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.217+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780b7440 con 0x7efd7815d100 2023-11-04T01:43:48.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.217+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd6802f390 con 0x7efd7815d100 2023-11-04T01:43:48.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.217+0000 7efd6dffb640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 0x7efd5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.217+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7efd680ac1e0 con 0x7efd7815d100 2023-11-04T01:43:48.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.218+0000 7efd7d553640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 0x7efd5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.218+0000 7efd7d553640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 0x7efd5c06d330 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd74001330 tx=0x7efd74005bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.222+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd780b7440 con 0x7efd7815d100 2023-11-04T01:43:48.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.389+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd780b7440 con 0x7efd7815d100 2023-11-04T01:43:48.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.391+0000 7efd6dffb640 1 -- 172.21.15.93:0/2854521447 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+23672 (secure 0 0 0) 0x7efd780b7440 con 0x7efd7815d100 2023-11-04T01:43:48.393 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:48.394 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":118,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:43:42.095637+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.6","mappings":[{"from":0,"to":5}]},{"pgid":"17.9","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2573507659":"2023-11-04T02:43:20.792492+0000","172.21.15.125:6834/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6832/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6833/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6834/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.125:6832/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.93:6834/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.125:6833/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6834/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6832/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6834/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6835/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6836/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.93:6836/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3505063928":"2023-11-04T02:42:36.804546+0000","172.21.15.125:6832/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.125:6834/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.93:6834/3572539978":"2023-11-05T01:41:36.780916+0000","172.21.15.93:6834/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3671080369":"2023-11-04T02:41:51.893134+0000","172.21.15.125:6835/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/3572539978":"2023-11-05T01:41:36.780916+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:48.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 msgr2=0x7efd5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 0x7efd5c06d330 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd74001330 tx=0x7efd74005bc0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 msgr2=0x7efd780b8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7efd68000c00 tx=0x7efd68004730 comp rx=0 tx=0).stop 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 shutdown_connections 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7efd5c06ae70 0x7efd5c06d330 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7815d4e0 0x7efd781531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efd7815d100 0x7efd780b8130 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 --2- 172.21.15.93:0/2854521447 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7efd780d3b60 0x7efd780b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 >> 172.21.15.93:0/2854521447 conn(0x7efd780d2ef0 msgr2=0x7efd780cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 shutdown_connections 2023-11-04T01:43:48.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.393+0000 7efd7f7b7640 1 -- 172.21.15.93:0/2854521447 wait complete. 2023-11-04T01:43:48.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:10.941170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:11.841942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:48.407 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:48.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.506+0000 7f1c98301640 1 Processor -- start 2023-11-04T01:43:48.508 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.506+0000 7f1c98301640 1 -- start start 2023-11-04T01:43:48.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c98301640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c90159e40 0x7f1c900b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c98301640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c9006bb60 0x7f1c900b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c98301640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c90071500 con 0x7f1c9006fff0 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c98301640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9015dae0 con 0x7f1c90159e40 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c98301640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c90070c60 con 0x7f1c9006bb60 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c90159e40 0x7f1c900b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c90159e40 0x7f1c900b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39562/0 (socket says 172.21.15.93:39562) 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 -- 172.21.15.93:0/1130255177 learned_addr learned my addr 172.21.15.93:0/1130255177 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9689e640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1c9006fff0 0x7f1c90070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55428/0 (socket says 172.21.15.93:55428) 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 -- 172.21.15.93:0/1130255177 >> v2:172.21.15.125:3300/0 conn(0x7f1c9006bb60 msgr2=0x7f1c900b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 --2- 172.21.15.93:0/1130255177 >> v2:172.21.15.125:3300/0 conn(0x7f1c9006bb60 0x7f1c900b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 -- 172.21.15.93:0/1130255177 >> v1:172.21.15.93:6789/0 conn(0x7f1c9006fff0 legacy=0x7f1c90070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9609d640 1 -- 172.21.15.93:0/1130255177 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90070f40 con 0x7f1c90159e40 2023-11-04T01:43:48.511 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.507+0000 7f1c9509b640 1 -- 172.21.15.93:0/1130255177 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095821760 0 0) 0x7f1c90071500 con 0x7f1c9006fff0 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.508+0000 7f1c9609d640 1 --2- 172.21.15.93:0/1130255177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900b0530 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f1c9006fdc0 tx=0x7f1c8c02e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806581008e5cdae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.508+0000 7f1c9509b640 1 -- 172.21.15.93:0/1130255177 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c02ee00 con 0x7f1c90159e40 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.508+0000 7f1c9509b640 1 -- 172.21.15.93:0/1130255177 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c036440 con 0x7f1c90159e40 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.508+0000 7f1c9509b640 1 -- 172.21.15.93:0/1130255177 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0367d0 con 0x7f1c90159e40 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 -- 172.21.15.93:0/1130255177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 msgr2=0x7f1c900b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 --2- 172.21.15.93:0/1130255177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900b0530 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f1c9006fdc0 tx=0x7f1c8c02e050 comp rx=0 tx=0).stop 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 -- 172.21.15.93:0/1130255177 shutdown_connections 2023-11-04T01:43:48.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 --2- 172.21.15.93:0/1130255177 >> v2:172.21.15.125:3300/0 conn(0x7f1c9006bb60 0x7f1c900b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 --2- 172.21.15.93:0/1130255177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900b0530 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 -- 172.21.15.93:0/1130255177 >> 172.21.15.93:0/1130255177 conn(0x7f1c900cb530 msgr2=0x7f1c900cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 -- 172.21.15.93:0/1130255177 shutdown_connections 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.509+0000 7f1c98301640 1 -- 172.21.15.93:0/1130255177 wait complete. 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.510+0000 7f1c98301640 1 Processor -- start 2023-11-04T01:43:48.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.510+0000 7f1c98301640 1 -- start start 2023-11-04T01:43:48.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9006bb60 0x7f1c9014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c9006fff0 0x7f1c900c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.515 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c3fb0 con 0x7f1c90159e40 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c4290 con 0x7f1c9006bb60 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c98301640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c4570 con 0x7f1c9006fff0 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39568/0 (socket says 172.21.15.93:39568) 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 -- 172.21.15.93:0/1387397658 learned_addr learned my addr 172.21.15.93:0/1387397658 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9609d640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9006bb60 0x7f1c9014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9589c640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c9006fff0 0x7f1c900c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 -- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c9006fff0 msgr2=0x7f1c900c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c9006fff0 0x7f1c900c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 -- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9006bb60 msgr2=0x7f1c9014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9006bb60 0x7f1c9014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.516 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 -- 172.21.15.93:0/1387397658 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c00b770 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c9689e640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c7e0 tx=0x7f1c8800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.511+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800a640 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.512+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8800a7c0 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.512+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c900c4850 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.512+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800ab70 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.512+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9014d090 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.513+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c900c4d70 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.513+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c8800acd0 con 0x7f1c90159e40 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.513+0000 7f1c86ffd640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 0x7f1c7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.513+0000 7f1c9609d640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 0x7f1c7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.513+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f1c88089640 con 0x7f1c90159e40 2023-11-04T01:43:48.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.514+0000 7f1c9609d640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 0x7f1c7406d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c038000 tx=0x7f1c8c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.518+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c900c4d70 con 0x7f1c90159e40 2023-11-04T01:43:48.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.684+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c900c4d70 con 0x7f1c90159e40 2023-11-04T01:43:48.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.685+0000 7f1c86ffd640 1 -- 172.21.15.93:0/1387397658 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c900c4d70 con 0x7f1c90159e40 2023-11-04T01:43:48.687 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.686+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 msgr2=0x7f1c7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.686+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 0x7f1c7406d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c038000 tx=0x7f1c8c032000 comp rx=0 tx=0).stop 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 msgr2=0x7f1c900cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c7e0 tx=0x7f1c8800cca0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 shutdown_connections 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f1c7406ae70 0x7f1c7406d330 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c90159e40 0x7f1c900cda10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f1c9006fff0 0x7f1c900c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 --2- 172.21.15.93:0/1387397658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c9006bb60 0x7f1c9014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 >> 172.21.15.93:0/1387397658 conn(0x7f1c900cb530 msgr2=0x7f1c9006c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 shutdown_connections 2023-11-04T01:43:48.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.687+0000 7f1c98301640 1 -- 172.21.15.93:0/1387397658 wait complete. 2023-11-04T01:43:48.699 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:48.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.799+0000 7fbbe1494640 1 Processor -- start 2023-11-04T01:43:48.802 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.799+0000 7fbbe1494640 1 -- start start 2023-11-04T01:43:48.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbe1494640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbdc167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbe1494640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0b32b0 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbe1494640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0cee10 con 0x7fbbdc15d100 2023-11-04T01:43:48.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbe1494640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0cec20 con 0x7fbbdc0d1be0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbda7fc640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbbdc15d4e0 0x7fbbdc0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55430/0 (socket says 172.21.15.93:55430) 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.800+0000 7fbbda7fc640 1 -- 172.21.15.93:0/1389648511 learned_addr learned my addr 172.21.15.93:0/1389648511 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbdc167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006453425 0 0) 0x7fbbdc0b32b0 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc4003520 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945844646 0 0) 0x7fbbc4003520 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 msgr2=0x7fbbdc167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbdc167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 >> v1:172.21.15.125:6789/0 conn(0x7fbbdc15d100 legacy=0x7fbbdc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0b4750 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7fbbd0001670 con 0x7fbbdc15d4e0 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 >> v1:172.21.15.93:6789/0 conn(0x7fbbdc15d4e0 legacy=0x7fbbdc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbc40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.805 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbc4003ee0 0x7fbbc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400b9b0 con 0x7fbbc4004d00 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400bb20 con 0x7fbbc4003ee0 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400bce0 con 0x7fbbdc0d1be0 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdaffd640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbc40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbda7fc640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbc4003ee0 0x7fbbc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 -- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 msgr2=0x7fbbc40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc0d1be0 0x7fbbc40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 -- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbc4003ee0 msgr2=0x7fbbc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbc4003ee0 0x7fbbc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.801+0000 7fbbdb7fe640 1 -- 172.21.15.93:0/1389648511 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4003520 con 0x7fbbc4004d00 2023-11-04T01:43:48.806 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.802+0000 7fbbdb7fe640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc08c730 tx=0x7fbbc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8298cb19701ad1ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.802+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd402c660 con 0x7fbbc4004d00 2023-11-04T01:43:48.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.802+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd402c7c0 con 0x7fbbc4004d00 2023-11-04T01:43:48.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.802+0000 7fbbd9ffb640 1 -- 172.21.15.93:0/1389648511 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd402cb50 con 0x7fbbc4004d00 2023-11-04T01:43:48.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 -- 172.21.15.93:0/1389648511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbc4004d00 msgr2=0x7fbbc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 --2- 172.21.15.93:0/1389648511 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc08c730 tx=0x7fbbc40057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbdb7fe640 1 -- 172.21.15.93:0/1389648511 reap_dead start 2023-11-04T01:43:48.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 -- 172.21.15.93:0/1389648511 shutdown_connections 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 -- 172.21.15.93:0/1389648511 >> 172.21.15.93:0/1389648511 conn(0x7fbbdc0d2ef0 msgr2=0x7fbbdc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 -- 172.21.15.93:0/1389648511 shutdown_connections 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.803+0000 7fbbe1494640 1 -- 172.21.15.93:0/1389648511 wait complete. 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.804+0000 7fbbe1494640 1 Processor -- start 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.804+0000 7fbbe1494640 1 -- start start 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc1596a0 0x7fbbdc15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbdc15e810 0x7fbbdc15f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc15ec90 con 0x7fbbdc0c9900 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0cbd90 con 0x7fbbdc15e810 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0cc070 con 0x7fbbdc1596a0 2023-11-04T01:43:48.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39592/0 (socket says 172.21.15.93:39592) 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 -- 172.21.15.93:0/3490062958 learned_addr learned my addr 172.21.15.93:0/3490062958 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 -- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc1596a0 msgr2=0x7fbbdc15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc1596a0 0x7fbbdc15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 -- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbdc15e810 msgr2=0x7fbbdc15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbdc15e810 0x7fbbdc15f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 -- 172.21.15.93:0/3490062958 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0cc350 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbda7fc640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00072c0 tx=0x7fbbd0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000f920 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000faa0 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.805+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0cc630 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.806+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000fe50 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.806+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc0cba20 con 0x7fbbdc0c9900 2023-11-04T01:43:48.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.806+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc0684b0 con 0x7fbbdc0c9900 2023-11-04T01:43:48.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.807+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbd001d460 con 0x7fbbdc0c9900 2023-11-04T01:43:48.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.807+0000 7fbbc37fe640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 0x7fbbc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.807+0000 7fbbdaffd640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 0x7fbbc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.807+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fbbd008a270 con 0x7fbbdc0c9900 2023-11-04T01:43:48.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.808+0000 7fbbdaffd640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 0x7fbbc806d330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc002050 tx=0x7fbbcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.812+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbbd0054940 con 0x7fbbdc0c9900 2023-11-04T01:43:48.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.978+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fbbdc0d2cd0 con 0x7fbbdc0c9900 2023-11-04T01:43:48.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.978+0000 7fbbc37fe640 1 -- 172.21.15.93:0/3490062958 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v118) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbd0057f60 con 0x7fbbdc0c9900 2023-11-04T01:43:48.981 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.980+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 msgr2=0x7fbbc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.980+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 0x7fbbc806d330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc002050 tx=0x7fbbcc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.980+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 msgr2=0x7fbbdc15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.980+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00072c0 tx=0x7fbbd0007780 comp rx=0 tx=0).stop 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 shutdown_connections 2023-11-04T01:43:48.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fbbc806ae70 0x7fbbc806d330 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbdc15e810 0x7fbbdc15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbdc0c9900 0x7fbbdc15e2d0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 --2- 172.21.15.93:0/3490062958 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fbbdc1596a0 0x7fbbdc15dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 >> 172.21.15.93:0/3490062958 conn(0x7fbbdc0d2ef0 msgr2=0x7fbbdc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 shutdown_connections 2023-11-04T01:43:48.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:48.981+0000 7fbbe1494640 1 -- 172.21.15.93:0/3490062958 wait complete. 2023-11-04T01:43:48.993 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:49.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.095+0000 7f7f7c916640 1 Processor -- start 2023-11-04T01:43:49.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.095+0000 7f7f7c916640 1 -- start start 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7c916640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f7806c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7c916640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f7806b740 0x7f7f78066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7c916640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780ad6a0 con 0x7f7f7815ade0 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7c916640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f780acaf0 con 0x7f7f7806b740 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7c916640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780acdd0 con 0x7f7f780b1440 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f7806b740 0x7f7f78066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7659c640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7f7815ade0 0x7f7f780b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55432/0 (socket says 172.21.15.93:55432) 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7f7806b740 0x7f7f78066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39600/0 (socket says 172.21.15.93:39600) 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7659c640 1 -- 172.21.15.93:0/1276649434 learned_addr learned my addr 172.21.15.93:0/1276649434 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f75d9b640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f7806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 -- 172.21.15.93:0/1276649434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 msgr2=0x7f7f7806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f7806c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 -- 172.21.15.93:0/1276649434 >> v1:172.21.15.93:6789/0 conn(0x7f7f7815ade0 legacy=0x7f7f780b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f76d9d640 1 -- 172.21.15.93:0/1276649434 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780ad0e0 con 0x7f7f7806b740 2023-11-04T01:43:49.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.096+0000 7f7f7559a640 1 -- 172.21.15.93:0/1276649434 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216871834 0 0) 0x7f7f780ad6a0 con 0x7f7f7815ade0 2023-11-04T01:43:49.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.097+0000 7f7f76d9d640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f78066010 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7f700097a0 tx=0x7f7f7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73756dee7738284 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.097+0000 7f7f7559a640 1 -- 172.21.15.93:0/1276649434 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7002e070 con 0x7f7f7806b740 2023-11-04T01:43:49.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.097+0000 7f7f7559a640 1 -- 172.21.15.93:0/1276649434 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700315a0 con 0x7f7f7806b740 2023-11-04T01:43:49.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.097+0000 7f7f7559a640 1 -- 172.21.15.93:0/1276649434 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70031930 con 0x7f7f7806b740 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 -- 172.21.15.93:0/1276649434 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 msgr2=0x7f7f78066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f78066010 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7f700097a0 tx=0x7f7f7002b840 comp rx=0 tx=0).stop 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 -- 172.21.15.93:0/1276649434 shutdown_connections 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f78066010 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 --2- 172.21.15.93:0/1276649434 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f7806c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 -- 172.21.15.93:0/1276649434 >> 172.21.15.93:0/1276649434 conn(0x7f7f780cbd30 msgr2=0x7f7f780cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 -- 172.21.15.93:0/1276649434 shutdown_connections 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.098+0000 7f7f7c916640 1 -- 172.21.15.93:0/1276649434 wait complete. 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.099+0000 7f7f7c916640 1 Processor -- start 2023-11-04T01:43:49.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.099+0000 7f7f7c916640 1 -- start start 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f780aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 0x7f7f780718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780b1f50 con 0x7f7f7806b740 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780b21c0 con 0x7f7f7815ade0 2023-11-04T01:43:49.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7c916640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780b24a0 con 0x7f7f780b1440 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39606/0 (socket says 172.21.15.93:39606) 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 -- 172.21.15.93:0/326571040 learned_addr learned my addr 172.21.15.93:0/326571040 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f76d9d640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 0x7f7f780718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f75d9b640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f780aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 -- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 msgr2=0x7f7f780aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f780aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 -- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 msgr2=0x7f7f780718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 0x7f7f780718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f7659c640 1 -- 172.21.15.93:0/326571040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009400 con 0x7f7f7806b740 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f75d9b640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f780aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.100+0000 7f7f76d9d640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 0x7f7f780718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f7659c640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c7a0 tx=0x7f7f6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800a640 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800a7a0 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780b2780 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800abd0 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.101+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f781f6c50 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.102+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f78066600 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.102+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f6800ad30 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.103+0000 7f7f66ffd640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 0x7f7f5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.103+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f7f680898e0 con 0x7f7f7806b740 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.103+0000 7f7f75d9b640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 0x7f7f5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.107 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.103+0000 7f7f75d9b640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 0x7f7f5806d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7f780cb730 tx=0x7f7f6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.107+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f68054010 con 0x7f7f7806b740 2023-11-04T01:43:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.272+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f7f780684b0 con 0x7f7f7806b740 2023-11-04T01:43:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.272+0000 7f7f66ffd640 1 -- 172.21.15.93:0/326571040 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v118) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7f68017070 con 0x7f7f7806b740 2023-11-04T01:43:49.275 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:49.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 msgr2=0x7f7f5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 0x7f7f5806d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7f780cb730 tx=0x7f7f6c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 msgr2=0x7f7f780cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c7a0 tx=0x7f7f6800cc60 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 shutdown_connections 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7f5806ae70 0x7f7f5806d330 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f7815ade0 0x7f7f780718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7f780b1440 0x7f7f780aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 --2- 172.21.15.93:0/326571040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f7806b740 0x7f7f780cea10 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 >> 172.21.15.93:0/326571040 conn(0x7f7f780cbd30 msgr2=0x7f7f7806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 shutdown_connections 2023-11-04T01:43:49.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.274+0000 7f7f7c916640 1 -- 172.21.15.93:0/326571040 wait complete. 2023-11-04T01:43:49.287 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.386+0000 7f5089e6f640 1 Processor -- start 2023-11-04T01:43:49.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.386+0000 7f5089e6f640 1 -- start start 2023-11-04T01:43:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f5089e6f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f50840b2210 0x7f50840cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f5089e6f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840b0150 con 0x7f50840ceda0 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f5089e6f640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840b1170 con 0x7f508415d630 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f5089e6f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840b1df0 con 0x7f50840b2210 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f50837fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f50840ceda0 0x7f508415cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55440/0 (socket says 172.21.15.93:55440) 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.387+0000 7f50837fe640 1 -- 172.21.15.93:0/832646011 learned_addr learned my addr 172.21.15.93:0/832646011 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f507affd640 1 --2- 172.21.15.93:0/832646011 >> v2:172.21.15.125:3300/0 conn(0x7f50840b2210 0x7f50840cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380479795 0 0) 0x7f50840b0150 con 0x7f50840ceda0 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5070003520 con 0x7f50840ceda0 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597816107 0 0) 0x7f5070003520 con 0x7f50840ceda0 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 >> v2:172.21.15.125:3300/0 conn(0x7f50840b2210 msgr2=0x7f50840cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 --2- 172.21.15.93:0/832646011 >> v2:172.21.15.125:3300/0 conn(0x7f50840b2210 0x7f50840cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 >> v1:172.21.15.125:6789/0 conn(0x7f508415d630 legacy=0x7f50840cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840b1450 con 0x7f50840ceda0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f5074001810 con 0x7f50840ceda0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 >> v1:172.21.15.93:6789/0 conn(0x7f50840ceda0 legacy=0x7f508415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070003970 0x7f5070003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50700047c0 0x7f5070004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 0x7f507000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840b1df0 con 0x7f5070005180 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507000c0d0 con 0x7f5070003970 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507000c290 con 0x7f50700047c0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 0x7f507000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f50837fe640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070003970 0x7f5070003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f507affd640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50700047c0 0x7f5070004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 -- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50700047c0 msgr2=0x7f5070004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50700047c0 0x7f5070004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 -- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070003970 msgr2=0x7f5070003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070003970 0x7f5070003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f5083fff640 1 -- 172.21.15.93:0/832646011 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070003520 con 0x7f5070005180 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f50837fe640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070003970 0x7f5070003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.388+0000 7f507affd640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f50700047c0 0x7f5070004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.389+0000 7f5083fff640 1 -- 172.21.15.93:0/832646011 reap_dead start 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.389+0000 7f5083fff640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 0x7f507000b980 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f507c001f60 tx=0x7f50700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c64e6a7b7487d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.389+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c02d6f0 con 0x7f5070005180 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.389+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c02d850 con 0x7f5070005180 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.389+0000 7f5082ffd640 1 -- 172.21.15.93:0/832646011 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c02dc00 con 0x7f5070005180 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 -- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 msgr2=0x7f507000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 0x7f507000b980 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f507c001f60 tx=0x7f50700057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 -- 172.21.15.93:0/832646011 shutdown_connections 2023-11-04T01:43:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 --2- 172.21.15.93:0/832646011 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5070005180 0x7f507000b980 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 -- 172.21.15.93:0/832646011 >> 172.21.15.93:0/832646011 conn(0x7f50840d0c30 msgr2=0x7f50840d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 -- 172.21.15.93:0/832646011 shutdown_connections 2023-11-04T01:43:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.390+0000 7f5089e6f640 1 -- 172.21.15.93:0/832646011 wait complete. 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.391+0000 7f5089e6f640 1 Processor -- start 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.391+0000 7f5089e6f640 1 -- start start 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070005180 0x7f5084157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5084158480 0x7f50840c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840c6000 con 0x7f50840cb260 2023-11-04T01:43:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084158230 con 0x7f5070005180 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840c5760 con 0x7f5084158480 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39622/0 (socket says 172.21.15.93:39622) 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 -- 172.21.15.93:0/2598477162 learned_addr learned my addr 172.21.15.93:0/2598477162 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 -- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5084158480 msgr2=0x7f50840c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5084158480 0x7f50840c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 -- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070005180 msgr2=0x7f5084157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070005180 0x7f5084157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 -- 172.21.15.93:0/2598477162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840c5a40 con 0x7f50840cb260 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f507affd640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f506c0108b0 tx=0x7f506c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00eb60 con 0x7f50840cb260 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c00ecc0 con 0x7f50840cb260 2023-11-04T01:43:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840c5d20 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.392+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c01c400 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.393+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840cb940 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.393+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50840684b0 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.394+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f506c01c560 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.394+0000 7f5080ff9640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 0x7f506406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.394+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f506c08a6d0 con 0x7f50840cb260 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.394+0000 7f50837fe640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 0x7f506406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.395+0000 7f50837fe640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 0x7f506406d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5074001190 tx=0x7f5074009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.399+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f506c054e20 con 0x7f50840cb260 2023-11-04T01:43:49.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.567+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f50840d0490 con 0x7f50840cb260 2023-11-04T01:43:49.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.567+0000 7f5080ff9640 1 -- 172.21.15.93:0/2598477162 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v118) v1 ==== 107+0+11 (secure 0 0 0) 0x7f506c058440 con 0x7f50840cb260 2023-11-04T01:43:49.570 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 msgr2=0x7f506406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 0x7f506406d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5074001190 tx=0x7f5074009040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 msgr2=0x7f50840c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f506c0108b0 tx=0x7f506c010d70 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 shutdown_connections 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f506406ae70 0x7f506406d330 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f5084158480 0x7f50840c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50840cb260 0x7f50840c6770 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 --2- 172.21.15.93:0/2598477162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5070005180 0x7f5084157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.572 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 >> 172.21.15.93:0/2598477162 conn(0x7f50840d0c30 msgr2=0x7f508406f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 shutdown_connections 2023-11-04T01:43:49.573 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.569+0000 7f5089e6f640 1 -- 172.21.15.93:0/2598477162 wait complete. 2023-11-04T01:43:49.582 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:49.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.681+0000 7f4b9420e640 1 Processor -- start 2023-11-04T01:43:49.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.682+0000 7f4b9420e640 1 -- start start 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.682+0000 7f4b9420e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b8c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.682+0000 7f4b9420e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c15d4f0 con 0x7f4b8c15d110 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.682+0000 7f4b9420e640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c06b9f0 con 0x7f4b8c0b2100 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.682+0000 7f4b9420e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0664f0 con 0x7f4b8c0b3ca0 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b91faa640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4b8c15d110 0x7f4b8c0ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55450/0 (socket says 172.21.15.93:55450) 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b91faa640 1 -- 172.21.15.93:0/425475397 learned_addr learned my addr 172.21.15.93:0/425475397 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b917a9640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b8c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242066258 0 0) 0x7f4b8c15d4f0 con 0x7f4b8c15d110 2023-11-04T01:43:49.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003520 con 0x7f4b8c15d110 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098696889 0 0) 0x7f4b78003520 con 0x7f4b8c15d110 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 msgr2=0x7f4b8c06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b8c06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 >> v1:172.21.15.125:6789/0 conn(0x7f4b8c0b2100 legacy=0x7f4b8c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c06c2e0 con 0x7f4b8c15d110 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f4b880017f0 con 0x7f4b8c15d110 2023-11-04T01:43:49.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 >> v1:172.21.15.93:6789/0 conn(0x7f4b8c15d110 legacy=0x7f4b8c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b78004d00 0x7f4b78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0664f0 con 0x7f4b78003f20 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800ba60 con 0x7f4b78004d00 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800bc20 con 0x7f4b8c0b3ca0 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b917a9640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.683+0000 7f4b91faa640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b927ab640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b78004d00 0x7f4b78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 -- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 msgr2=0x7f4b780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 -- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b78004d00 msgr2=0x7f4b78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b78004d00 0x7f4b78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 -- 172.21.15.93:0/425475397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78003520 con 0x7f4b78003f20 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b91faa640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c0b3ca0 0x7f4b780039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b917a9640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b780047c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009ac0 tx=0x7f4b780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bba8d079a184ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c02c6b0 con 0x7f4b78003f20 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c02c810 con 0x7f4b78003f20 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.684+0000 7f4b90fa8640 1 -- 172.21.15.93:0/425475397 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c02cba0 con 0x7f4b78003f20 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 -- 172.21.15.93:0/425475397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 msgr2=0x7f4b780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 --2- 172.21.15.93:0/425475397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b780047c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009ac0 tx=0x7f4b780057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b927ab640 1 -- 172.21.15.93:0/425475397 reap_dead start 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 -- 172.21.15.93:0/425475397 shutdown_connections 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 -- 172.21.15.93:0/425475397 >> 172.21.15.93:0/425475397 conn(0x7f4b8c0cbd30 msgr2=0x7f4b8c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 -- 172.21.15.93:0/425475397 shutdown_connections 2023-11-04T01:43:49.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.685+0000 7f4b9420e640 1 -- 172.21.15.93:0/425475397 wait complete. 2023-11-04T01:43:49.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.686+0000 7f4b9420e640 1 Processor -- start 2023-11-04T01:43:49.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.686+0000 7f4b9420e640 1 -- start start 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 0x7f4b8c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 0x7f4b8c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c150ca0 con 0x7f4b78003f20 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c09a590 con 0x7f4b8c0b0030 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b9420e640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c09a830 con 0x7f4b8c159890 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39632/0 (socket says 172.21.15.93:39632) 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 -- 172.21.15.93:0/3560996185 learned_addr learned my addr 172.21.15.93:0/3560996185 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b927ab640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 0x7f4b8c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b917a9640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 0x7f4b8c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 -- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 msgr2=0x7f4b8c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 0x7f4b8c150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 -- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 msgr2=0x7f4b8c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 0x7f4b8c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 -- 172.21.15.93:0/3560996185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c09ab10 con 0x7f4b78003f20 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b927ab640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 0x7f4b8c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b917a9640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 0x7f4b8c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.687+0000 7f4b91faa640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4b88001920 tx=0x7f4b8800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.688+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880072e0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.688+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88007440 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.688+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880057a0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.688+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c09adf0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.688+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c0b04b0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.689+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c0684b0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.689+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b88005900 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.689+0000 7f4b827fc640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 0x7f4b7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.689+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f4b8808a0a0 con 0x7f4b78003f20 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.689+0000 7f4b917a9640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 0x7f4b7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.690+0000 7f4b917a9640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 0x7f4b7006d360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c036000 tx=0x7f4b7c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.694+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b880547d0 con 0x7f4b78003f20 2023-11-04T01:43:49.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.858+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b8c0b3090 con 0x7f4b78003f20 2023-11-04T01:43:49.861 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.859+0000 7f4b827fc640 1 -- 172.21.15.93:0/3560996185 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b8801a310 con 0x7f4b78003f20 2023-11-04T01:43:49.861 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:49.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 msgr2=0x7f4b7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 0x7f4b7006d360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c036000 tx=0x7f4b7c030000 comp rx=0 tx=0).stop 2023-11-04T01:43:49.863 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 msgr2=0x7f4b8c09b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4b88001920 tx=0x7f4b8800ec80 comp rx=0 tx=0).stop 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 shutdown_connections 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f4b7006aea0 0x7f4b7006d360 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4b8c0b0030 0x7f4b8c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f4b8c159890 0x7f4b8c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 --2- 172.21.15.93:0/3560996185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b78003f20 0x7f4b8c09b5f0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 >> 172.21.15.93:0/3560996185 conn(0x7f4b8c0cbd30 msgr2=0x7f4b8c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 shutdown_connections 2023-11-04T01:43:49.864 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.861+0000 7f4b9420e640 1 -- 172.21.15.93:0/3560996185 wait complete. 2023-11-04T01:43:49.874 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:49.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.973+0000 7fc033ab4640 1 Processor -- start 2023-11-04T01:43:49.976 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc033ab4640 1 -- start start 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc033ab4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc02c15d100 0x7fc02c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc033ab4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0b32b0 con 0x7fc02c15d4e0 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc033ab4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0cee10 con 0x7fc02c0d1be0 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc033ab4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c0b2980 con 0x7fc02c15d100 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.974+0000 7fc031850640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc02c15d100 0x7fc02c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc03104f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc02c15d4e0 0x7fc02c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55452/0 (socket says 172.21.15.93:55452) 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc03104f640 1 -- 172.21.15.93:0/3968491853 learned_addr learned my addr 172.21.15.93:0/3968491853 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc031850640 1 -- 172.21.15.93:0/3968491853 >> v1:172.21.15.125:6789/0 conn(0x7fc02c0d1be0 legacy=0x7fc02c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc031850640 1 -- 172.21.15.93:0/3968491853 >> v1:172.21.15.93:6789/0 conn(0x7fc02c15d4e0 legacy=0x7fc02c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc031850640 1 -- 172.21.15.93:0/3968491853 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0b2c60 con 0x7fc02c15d100 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.975+0000 7fc03084e640 1 -- 172.21.15.93:0/3968491853 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375310143 0 0) 0x7fc02c0b32b0 con 0x7fc02c15d4e0 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc031850640 1 --2- 172.21.15.93:0/3968491853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c0ce510 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fc024009de0 tx=0x7fc02402bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71817fee13e78178 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc03084e640 1 -- 172.21.15.93:0/3968491853 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02402ccb0 con 0x7fc02c15d100 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc03084e640 1 -- 172.21.15.93:0/3968491853 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02402ce10 con 0x7fc02c15d100 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc03084e640 1 -- 172.21.15.93:0/3968491853 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024034660 con 0x7fc02c15d100 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 -- 172.21.15.93:0/3968491853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 msgr2=0x7fc02c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 --2- 172.21.15.93:0/3968491853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c0ce510 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fc024009de0 tx=0x7fc02402bf00 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 -- 172.21.15.93:0/3968491853 shutdown_connections 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 --2- 172.21.15.93:0/3968491853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c0ce510 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 -- 172.21.15.93:0/3968491853 >> 172.21.15.93:0/3968491853 conn(0x7fc02c0d2ef0 msgr2=0x7fc02c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 -- 172.21.15.93:0/3968491853 shutdown_connections 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.976+0000 7fc033ab4640 1 -- 172.21.15.93:0/3968491853 wait complete. 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.977+0000 7fc033ab4640 1 Processor -- start 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.977+0000 7fc033ab4640 1 -- start start 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 0x7fc02c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 0x7fc02c1f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c151920 con 0x7fc02c15d100 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c1f3cd0 con 0x7fc02c15d4e0 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc033ab4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0b8790 con 0x7fc02c0d1be0 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc03104f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc03104f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39660/0 (socket says 172.21.15.93:39660) 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc03104f640 1 -- 172.21.15.93:0/1986835091 learned_addr learned my addr 172.21.15.93:0/1986835091 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc032051640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 0x7fc02c1f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc031850640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 0x7fc02c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc03104f640 1 -- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 msgr2=0x7fc02c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.978+0000 7fc03104f640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 0x7fc02c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc03104f640 1 -- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 msgr2=0x7fc02c1f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc03104f640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 0x7fc02c1f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc03104f640 1 -- 172.21.15.93:0/1986835091 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009a70 con 0x7fc02c15d100 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc031850640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 0x7fc02c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc032051640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 0x7fc02c1f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc03104f640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c3c0 tx=0x7fc01c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0074e0 con 0x7fc02c15d100 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c007640 con 0x7fc02c15d100 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c004a20 con 0x7fc02c15d100 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c06ad20 con 0x7fc02c15d100 2023-11-04T01:43:49.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.979+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c06b2e0 con 0x7fc02c15d100 2023-11-04T01:43:49.985 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.980+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c0684b0 con 0x7fc02c15d100 2023-11-04T01:43:49.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.980+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc01c004b80 con 0x7fc02c15d100 2023-11-04T01:43:49.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.981+0000 7fc0227fc640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 0x7fc01006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.981+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fc01c089dc0 con 0x7fc02c15d100 2023-11-04T01:43:49.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.981+0000 7fc031850640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 0x7fc01006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.986 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.981+0000 7fc031850640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 0x7fc01006d330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc024036000 tx=0x7fc024030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:49.985+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc01c0544f0 con 0x7fc02c15d100 2023-11-04T01:43:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.159+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc02c0d2cd0 con 0x7fc02c15d100 2023-11-04T01:43:50.162 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.160+0000 7fc0227fc640 1 -- 172.21.15.93:0/1986835091 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc01c057b10 con 0x7fc02c15d100 2023-11-04T01:43:50.162 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:43:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 msgr2=0x7fc01006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 0x7fc01006d330 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc024036000 tx=0x7fc024030000 comp rx=0 tx=0).stop 2023-11-04T01:43:50.164 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 msgr2=0x7fc02c1513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c3c0 tx=0x7fc01c00c880 comp rx=0 tx=0).stop 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 shutdown_connections 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fc01006ae70 0x7fc01006d330 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c15d4e0 0x7fc02c1f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc02c15d100 0x7fc02c1513e0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 --2- 172.21.15.93:0/1986835091 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fc02c0d1be0 0x7fc02c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 >> 172.21.15.93:0/1986835091 conn(0x7fc02c0d2ef0 msgr2=0x7fc02c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 shutdown_connections 2023-11-04T01:43:50.165 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.162+0000 7fc033ab4640 1 -- 172.21.15.93:0/1986835091 wait complete. 2023-11-04T01:43:50.175 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:50.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.272+0000 7f7ea8565640 1 Processor -- start 2023-11-04T01:43:50.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.272+0000 7f7ea8565640 1 -- start start 2023-11-04T01:43:50.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea8565640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ea015b200 0x7f7ea00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea8565640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00cde80 con 0x7f7ea00afda0 2023-11-04T01:43:50.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea8565640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00cf670 con 0x7f7ea00cd9c0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea8565640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea00cf950 con 0x7f7ea015b200 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea5b00640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7ea00afda0 0x7f7ea00cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55460/0 (socket says 172.21.15.93:55460) 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.273+0000 7f7ea5b00640 1 -- 172.21.15.93:0/3167205224 learned_addr learned my addr 172.21.15.93:0/3167205224 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754517553 0 0) 0x7f7ea00cde80 con 0x7f7ea00afda0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8c003520 con 0x7f7ea00afda0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6301640 1 --2- 172.21.15.93:0/3167205224 >> v2:172.21.15.125:3300/0 conn(0x7f7ea015b200 0x7f7ea00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069460026 0 0) 0x7f7e8c003520 con 0x7f7ea00afda0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 >> v2:172.21.15.125:3300/0 conn(0x7f7ea015b200 msgr2=0x7f7ea00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 --2- 172.21.15.93:0/3167205224 >> v2:172.21.15.125:3300/0 conn(0x7f7ea015b200 0x7f7ea00ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 >> v1:172.21.15.125:6789/0 conn(0x7f7ea00cd9c0 legacy=0x7f7ea00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00ce120 con 0x7f7ea00afda0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4025296813 0 0) 0x7f7e90001670 con 0x7f7ea00afda0 2023-11-04T01:43:50.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 >> v1:172.21.15.93:6789/0 conn(0x7f7ea00afda0 legacy=0x7f7ea00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e8c003970 0x7f7e8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e8c0047c0 0x7f7e8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7e8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00cf950 con 0x7f7e8c0052a0 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c00c170 con 0x7f7e8c0047c0 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c00c330 con 0x7f7e8c003970 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7e8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea5b00640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e8c0047c0 0x7f7e8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6301640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e8c003970 0x7f7e8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 -- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e8c003970 msgr2=0x7f7e8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7e8c003970 0x7f7e8c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 -- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e8c0047c0 msgr2=0x7f7e8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e8c0047c0 0x7f7e8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea6b02640 1 -- 172.21.15.93:0/3167205224 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c003520 con 0x7f7e8c0052a0 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.274+0000 7f7ea5b00640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e8c0047c0 0x7f7e8c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.275+0000 7f7ea6b02640 1 -- 172.21.15.93:0/3167205224 reap_dead start 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.275+0000 7f7ea6b02640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7e8c00b980 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001720 tx=0x7f7e8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b80b461ef9635f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.275+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980052d0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.275+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9802e050 con 0x7f7e8c0052a0 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.275+0000 7f7ea52ff640 1 -- 172.21.15.93:0/3167205224 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980035f0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 -- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 msgr2=0x7f7e8c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7e8c00b980 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001720 tx=0x7f7e8c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 -- 172.21.15.93:0/3167205224 shutdown_connections 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 --2- 172.21.15.93:0/3167205224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7e8c00b980 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 -- 172.21.15.93:0/3167205224 >> 172.21.15.93:0/3167205224 conn(0x7f7ea00d0c30 msgr2=0x7f7ea00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 -- 172.21.15.93:0/3167205224 shutdown_connections 2023-11-04T01:43:50.282 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.276+0000 7f7ea8565640 1 -- 172.21.15.93:0/3167205224 wait complete. 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.277+0000 7f7ea8565640 1 Processor -- start 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.277+0000 7f7ea8565640 1 -- start start 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea00c4740 0x7f7ea01f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea015b8e0 0x7f7ea00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0156960 con 0x7f7e8c0052a0 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0155db0 con 0x7f7ea00c4740 2023-11-04T01:43:50.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00c5100 con 0x7f7ea015b8e0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39682/0 (socket says 172.21.15.93:39682) 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 -- 172.21.15.93:0/1441065733 learned_addr learned my addr 172.21.15.93:0/1441065733 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6b02640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea015b8e0 0x7f7ea00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea5b00640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea00c4740 0x7f7ea01f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 -- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea015b8e0 msgr2=0x7f7ea00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea015b8e0 0x7f7ea00c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 -- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea00c4740 msgr2=0x7f7ea01f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea00c4740 0x7f7ea01f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 -- 172.21.15.93:0/1441065733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0155fc0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea6301640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c004710 tx=0x7f7e9c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c007e10 con 0x7f7e8c0052a0 2023-11-04T01:43:50.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00f050 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea01562a0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0137a0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.278+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea01f0b40 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.279+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea0156bd0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.280+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e9c013900 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.280+0000 7f7e96ffd640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 0x7f7e8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.280+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f7e9c08a970 con 0x7f7e8c0052a0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.280+0000 7f7ea5b00640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 0x7f7e8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.281+0000 7f7ea5b00640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 0x7f7e8406d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000ff0 tx=0x7f7e90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.284+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e9c0550a0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.461+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ea00684b0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.464 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.462+0000 7f7e96ffd640 1 -- 172.21.15.93:0/1441065733 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v118) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f7e9c0586c0 con 0x7f7e8c0052a0 2023-11-04T01:43:50.464 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/2573507659 2023-11-04T02:43:20.792492+0000 2023-11-04T01:43:50.464 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:50.464 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:50.465 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3505063928 2023-11-04T02:42:36.804546+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3671080369 2023-11-04T02:41:51.893134+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:50.466 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:listed 23 entries 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 msgr2=0x7f7e8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 0x7f7e8406d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000ff0 tx=0x7f7e90009040 comp rx=0 tx=0).stop 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 msgr2=0x7f7ea015e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c004710 tx=0x7f7e9c007700 comp rx=0 tx=0).stop 2023-11-04T01:43:50.467 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 shutdown_connections 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f7e8406ae70 0x7f7e8406d330 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7ea015b8e0 0x7f7ea00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ea00c4740 0x7f7ea01f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 --2- 172.21.15.93:0/1441065733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e8c0052a0 0x7f7ea015e410 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 >> 172.21.15.93:0/1441065733 conn(0x7f7ea00d0c30 msgr2=0x7f7ea006e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 shutdown_connections 2023-11-04T01:43:50.468 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.464+0000 7f7ea8565640 1 -- 172.21.15.93:0/1441065733 wait complete. 2023-11-04T01:43:50.477 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:43:50.477 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:50.491 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.629+0000 7f92941a9640 1 Processor -- start 2023-11-04T01:43:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.629+0000 7f92941a9640 1 -- start start 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f92941a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f92941a9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c06cc90 con 0x7f928c0ade00 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f92941a9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0b0e60 con 0x7f928c06c5f0 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f92941a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0b0c40 con 0x7f928c06d9c0 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291f45640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f928c0ade00 0x7f928c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55466/0 (socket says 172.21.15.93:55466) 2023-11-04T01:43:50.633 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291f45640 1 -- 172.21.15.93:0/3642333921 learned_addr learned my addr 172.21.15.93:0/3642333921 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291744640 1 --2- 172.21.15.93:0/3642333921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362295883 0 0) 0x7f928c06cc90 con 0x7f928c0ade00 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9278003520 con 0x7f928c0ade00 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.1 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534401103 0 0) 0x7f928c0b0e60 con 0x7f928c06c5f0 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f928c06cc90 con 0x7f928c06c5f0 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291744640 1 -- 172.21.15.93:0/3642333921 >> v1:172.21.15.125:6789/0 conn(0x7f928c06c5f0 legacy=0x7f928c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.0 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416860848 0 0) 0x7f9278003520 con 0x7f928c0ade00 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291744640 1 -- 172.21.15.93:0/3642333921 >> v1:172.21.15.93:6789/0 conn(0x7f928c0ade00 legacy=0x7f928c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.634 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.630+0000 7f9291744640 1 -- 172.21.15.93:0/3642333921 --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c06cee0 con 0x7f928c06d9c0 2023-11-04T01:43:50.635 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.631+0000 7f9291744640 1 --2- 172.21.15.93:0/3642333921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0710d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f927c0097d0 tx=0x7f927c02b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=293e363441b8f4a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.631+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.2 v2:172.21.15.125:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288001670 con 0x7f928c06d9c0 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.2 v2:172.21.15.125:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c02e050 con 0x7f928c06d9c0 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f9290f43640 1 -- 172.21.15.93:0/3642333921 <== mon.2 v2:172.21.15.125:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c030710 con 0x7f928c06d9c0 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 -- 172.21.15.93:0/3642333921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 msgr2=0x7f928c0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 --2- 172.21.15.93:0/3642333921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0710d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f927c0097d0 tx=0x7f927c02b6e0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 -- 172.21.15.93:0/3642333921 shutdown_connections 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 --2- 172.21.15.93:0/3642333921 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0710d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 -- 172.21.15.93:0/3642333921 >> 172.21.15.93:0/3642333921 conn(0x7f928c0cb530 msgr2=0x7f928c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 -- 172.21.15.93:0/3642333921 shutdown_connections 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.632+0000 7f92941a9640 1 -- 172.21.15.93:0/3642333921 wait complete. 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.633+0000 7f92941a9640 1 Processor -- start 2023-11-04T01:43:50.636 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.633+0000 7f92941a9640 1 -- start start 2023-11-04T01:43:50.638 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f928c06c5f0 0x7f928c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0c84a0 con 0x7f928c0ade00 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0c36a0 con 0x7f928c06c5f0 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f92941a9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0c3980 con 0x7f928c06d9c0 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39694/0 (socket says 172.21.15.93:39694) 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 -- 172.21.15.93:0/1400777250 learned_addr learned my addr 172.21.15.93:0/1400777250 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9291f45640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f928c06c5f0 0x7f928c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9291744640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 -- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 msgr2=0x7f928c0a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.639 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 -- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f928c06c5f0 msgr2=0x7f928c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f928c06c5f0 0x7f928c151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.634+0000 7f9292746640 1 -- 172.21.15.93:0/1400777250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009400 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f9292746640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f928400c6e0 tx=0x7f928400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284003b70 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284003cd0 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c0c3c60 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840052d0 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.635+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0aa830 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.636+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c0c3ea0 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.636+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9284005430 con 0x7f928c0ade00 2023-11-04T01:43:50.640 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.637+0000 7f92827fc640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.637+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f9284089e10 con 0x7f928c0ade00 2023-11-04T01:43:50.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.637+0000 7f9291f45640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.641 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.637+0000 7f9291f45640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 0x7f927006d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f92880011e0 tx=0x7f9288009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.641+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f928c0c3ea0 con 0x7f928c0ade00 2023-11-04T01:43:50.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.807+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928c0c3ea0 con 0x7f928c0ade00 2023-11-04T01:43:50.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.809+0000 7f92827fc640 1 -- 172.21.15.93:0/1400777250 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+23672 (secure 0 0 0) 0x7f928c0c3ea0 con 0x7f928c0ade00 2023-11-04T01:43:50.811 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-04T01:43:50.811 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":118,"fsid":"a91d0b76-a9fc-4383-b1e1-1b6875ba32e4","created":"2023-11-04T01:35:27.261508+0000","modified":"2023-11-04T01:43:42.095637+0000","last_up_change":"2023-11-04T01:35:38.415939+0000","last_in_change":"2023-11-04T01:35:29.509599+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:35:39.366267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:20.802313+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:19.808592+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:20.363506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:10.941170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:11.841942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"63817301-aed9-4ea9-a7df-508da2bde793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6809","nonce":3068021929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6811","nonce":3068021929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6815","nonce":3068021929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":3068021929},{"type":"v1","addr":"172.21.15.93:6813","nonce":3068021929}]},"public_addr":"172.21.15.93:6809/3068021929","cluster_addr":"172.21.15.93:6811/3068021929","heartbeat_back_addr":"172.21.15.93:6815/3068021929","heartbeat_front_addr":"172.21.15.93:6813/3068021929","state":["exists","up"]},{"osd":1,"uuid":"ffae6dfb-7bfe-405e-8c01-747a63e544c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6801","nonce":2623679104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6803","nonce":2623679104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6807","nonce":2623679104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":2623679104},{"type":"v1","addr":"172.21.15.93:6805","nonce":2623679104}]},"public_addr":"172.21.15.93:6801/2623679104","cluster_addr":"172.21.15.93:6803/2623679104","heartbeat_back_addr":"172.21.15.93:6807/2623679104","heartbeat_front_addr":"172.21.15.93:6805/2623679104","state":["exists","up"]},{"osd":2,"uuid":"399b004b-5df2-4fe3-92f3-db3965c8c8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6817","nonce":3080870995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6819","nonce":3080870995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6823","nonce":3080870995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":3080870995},{"type":"v1","addr":"172.21.15.93:6821","nonce":3080870995}]},"public_addr":"172.21.15.93:6817/3080870995","cluster_addr":"172.21.15.93:6819/3080870995","heartbeat_back_addr":"172.21.15.93:6823/3080870995","heartbeat_front_addr":"172.21.15.93:6821/3080870995","state":["exists","up"]},{"osd":3,"uuid":"2a2e65c1-4164-4158-bc9a-109001ede685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6825","nonce":4011119730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6827","nonce":4011119730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6831","nonce":4011119730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":4011119730},{"type":"v1","addr":"172.21.15.93:6829","nonce":4011119730}]},"public_addr":"172.21.15.93:6825/4011119730","cluster_addr":"172.21.15.93:6827/4011119730","heartbeat_back_addr":"172.21.15.93:6831/4011119730","heartbeat_front_addr":"172.21.15.93:6829/4011119730","state":["exists","up"]},{"osd":4,"uuid":"91bebbf7-e2ad-42f0-b9fc-6d6f4566803a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6801","nonce":3102287272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6803","nonce":3102287272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6810","nonce":3102287272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3102287272},{"type":"v1","addr":"172.21.15.125:6806","nonce":3102287272}]},"public_addr":"172.21.15.125:6801/3102287272","cluster_addr":"172.21.15.125:6803/3102287272","heartbeat_back_addr":"172.21.15.125:6810/3102287272","heartbeat_front_addr":"172.21.15.125:6806/3102287272","state":["exists","up"]},{"osd":5,"uuid":"f4abe089-5616-4c4e-bf2b-c9514a0ed20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6807","nonce":2630302118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6811","nonce":2630302118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6815","nonce":2630302118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":2630302118},{"type":"v1","addr":"172.21.15.125:6813","nonce":2630302118}]},"public_addr":"172.21.15.125:6807/2630302118","cluster_addr":"172.21.15.125:6811/2630302118","heartbeat_back_addr":"172.21.15.125:6815/2630302118","heartbeat_front_addr":"172.21.15.125:6813/2630302118","state":["exists","up"]},{"osd":6,"uuid":"dc032167-826d-4ac0-bc13-72d87a93f915","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6817","nonce":4082567317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6819","nonce":4082567317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6823","nonce":4082567317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4082567317},{"type":"v1","addr":"172.21.15.125:6821","nonce":4082567317}]},"public_addr":"172.21.15.125:6817/4082567317","cluster_addr":"172.21.15.125:6819/4082567317","heartbeat_back_addr":"172.21.15.125:6823/4082567317","heartbeat_front_addr":"172.21.15.125:6821/4082567317","state":["exists","up"]},{"osd":7,"uuid":"1b77cc47-cb40-47b4-aa7e-fdf668b39977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6825","nonce":2987748688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6827","nonce":2987748688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6831","nonce":2987748688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":2987748688},{"type":"v1","addr":"172.21.15.125:6829","nonce":2987748688}]},"public_addr":"172.21.15.125:6825/2987748688","cluster_addr":"172.21.15.125:6827/2987748688","heartbeat_back_addr":"172.21.15.125:6831/2987748688","heartbeat_front_addr":"172.21.15.125:6829/2987748688","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.664230+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.609993+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.691664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.656401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.723348+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.636833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.743521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:35:34.759758+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.6","mappings":[{"from":0,"to":5}]},{"pgid":"17.9","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2573507659":"2023-11-04T02:43:20.792492+0000","172.21.15.125:6834/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6832/769984368":"2023-11-05T01:43:12.921244+0000","172.21.15.125:6833/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6834/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.125:6832/2466276650":"2023-11-05T01:42:21.696641+0000","172.21.15.93:6834/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.125:6833/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6834/2025150673":"2023-11-05T01:42:28.503726+0000","172.21.15.125:6832/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6834/596691451":"2023-11-05T01:40:18.670910+0000","172.21.15.125:6835/1185165139":"2023-11-05T01:41:43.618643+0000","172.21.15.93:6836/2331318607":"2023-11-05T01:39:53.485629+0000","172.21.15.93:6836/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3505063928":"2023-11-04T02:42:36.804546+0000","172.21.15.125:6832/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.125:6834/4131141051":"2023-11-05T01:41:09.121113+0000","172.21.15.93:6834/3572539978":"2023-11-05T01:41:36.780916+0000","172.21.15.93:6834/448915336":"2023-11-05T01:40:43.904647+0000","192.168.0.1:0/3671080369":"2023-11-04T02:41:51.893134+0000","172.21.15.125:6835/3282724716":"2023-11-05T01:43:05.689518+0000","172.21.15.93:6836/3572539978":"2023-11-05T01:41:36.780916+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.810+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 msgr2=0x7f927006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.810+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 0x7f927006d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f92880011e0 tx=0x7f9288009040 comp rx=0 tx=0).stop 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.810+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 msgr2=0x7f928c0a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.810+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f928400c6e0 tx=0x7f928400cba0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 shutdown_connections 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f927006ae70 0x7f927006d330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ade00 0x7f928c0a8a00 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.813 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f928c06d9c0 0x7f928c0a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 --2- 172.21.15.93:0/1400777250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f928c06c5f0 0x7f928c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 >> 172.21.15.93:0/1400777250 conn(0x7f928c0cb530 msgr2=0x7f928c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 shutdown_connections 2023-11-04T01:43:50.814 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.811+0000 7f92941a9640 1 -- 172.21.15.93:0/1400777250 wait complete. 2023-11-04T01:43:50.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:35:39.366267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:20.802313+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:19.808592+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:20.363506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:10.941170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:11.841942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:50.824 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:50.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.924+0000 7f01ee6d4640 1 Processor -- start 2023-11-04T01:43:50.926 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.924+0000 7f01ee6d4640 1 -- start start 2023-11-04T01:43:50.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01ee6d4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e80ade00 0x7f01e80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.927 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01ee6d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01ee6d4640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806cc90 con 0x7f01e806d9c0 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01ee6d4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e80b0e60 con 0x7f01e80ade00 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01ee6d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e806cee0 con 0x7f01e806c5f0 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e80ade00 0x7f01e80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e80ade00 0x7f01e80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39702/0 (socket says 172.21.15.93:39702) 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 -- 172.21.15.93:0/2209220824 learned_addr learned my addr 172.21.15.93:0/2209220824 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 -- 172.21.15.93:0/2209220824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 msgr2=0x7f01e80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 --2- 172.21.15.93:0/2209220824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 -- 172.21.15.93:0/2209220824 >> v1:172.21.15.125:6789/0 conn(0x7f01e806d9c0 legacy=0x7f01e80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.928 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.925+0000 7f01e7fff640 1 -- 172.21.15.93:0/2209220824 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e806d1c0 con 0x7f01e80ade00 2023-11-04T01:43:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.926+0000 7f01e7fff640 1 --2- 172.21.15.93:0/2209220824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e80b0530 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009870 tx=0x7f01dc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81c7b17cb3ba6fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.926+0000 7f01e6ffd640 1 -- 172.21.15.93:0/2209220824 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc031740 con 0x7f01e80ade00 2023-11-04T01:43:50.929 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.926+0000 7f01e6ffd640 1 -- 172.21.15.93:0/2209220824 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0318a0 con 0x7f01e80ade00 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.926+0000 7f01e6ffd640 1 -- 172.21.15.93:0/2209220824 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc031c30 con 0x7f01e80ade00 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 -- 172.21.15.93:0/2209220824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 msgr2=0x7f01e80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/2209220824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e80b0530 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009870 tx=0x7f01dc02b7e0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 -- 172.21.15.93:0/2209220824 shutdown_connections 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/2209220824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/2209220824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e80b0530 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 -- 172.21.15.93:0/2209220824 >> 172.21.15.93:0/2209220824 conn(0x7f01e80cb530 msgr2=0x7f01e80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 -- 172.21.15.93:0/2209220824 shutdown_connections 2023-11-04T01:43:50.930 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.927+0000 7f01ee6d4640 1 -- 172.21.15.93:0/2209220824 wait complete. 2023-11-04T01:43:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.928+0000 7f01ee6d4640 1 Processor -- start 2023-11-04T01:43:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.928+0000 7f01ee6d4640 1 -- start start 2023-11-04T01:43:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.932 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e806d9c0 0x7f01e81edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80c5530 con 0x7f01e80ade00 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8154db0 con 0x7f01e806d9c0 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8157950 con 0x7f01e806c5f0 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39718/0 (socket says 172.21.15.93:39718) 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 -- 172.21.15.93:0/492331117 learned_addr learned my addr 172.21.15.93:0/492331117 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01e77fe640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e806d9c0 0x7f01e81edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01e7fff640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 -- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 msgr2=0x7f01e80c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80c4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 -- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e806d9c0 msgr2=0x7f01e81edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e806d9c0 0x7f01e81edb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.933 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 -- 172.21.15.93:0/492331117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0094d0 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ecc71640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b970 tx=0x7f01e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000cb40 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000ccc0 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e8157020 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0014680 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.929+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e81575e0 con 0x7f01e80ade00 2023-11-04T01:43:50.934 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.930+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e80684b0 con 0x7f01e80ade00 2023-11-04T01:43:50.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.931+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01e001d3b0 con 0x7f01e80ade00 2023-11-04T01:43:50.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.931+0000 7f01e4ff9640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 0x7f01d406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.931+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f01e0089f70 con 0x7f01e80ade00 2023-11-04T01:43:50.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.931+0000 7f01e7fff640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 0x7f01d406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.935 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.932+0000 7f01e7fff640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 0x7f01d406d360 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f01dc035000 tx=0x7f01dc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.937 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:50.935+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01e00bcca0 con 0x7f01e80ade00 2023-11-04T01:43:51.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.099+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01e80ae510 con 0x7f01e80ade00 2023-11-04T01:43:51.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.100+0000 7f01e4ff9640 1 -- 172.21.15.93:0/492331117 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01e0019070 con 0x7f01e80ade00 2023-11-04T01:43:51.102 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.101+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 msgr2=0x7f01d406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 0x7f01d406d360 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f01dc035000 tx=0x7f01dc008030 comp rx=0 tx=0).stop 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 msgr2=0x7f01e81536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b970 tx=0x7f01e000be30 comp rx=0 tx=0).stop 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 shutdown_connections 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f01d406aea0 0x7f01d406d360 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e80ade00 0x7f01e81536b0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.104 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01e806d9c0 0x7f01e81edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 --2- 172.21.15.93:0/492331117 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f01e806c5f0 0x7f01e80c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 >> 172.21.15.93:0/492331117 conn(0x7f01e80cb530 msgr2=0x7f01e80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 shutdown_connections 2023-11-04T01:43:51.105 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.102+0000 7f01ee6d4640 1 -- 172.21.15.93:0/492331117 wait complete. 2023-11-04T01:43:51.115 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:51.216 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.214+0000 7f2699ff5640 1 Processor -- start 2023-11-04T01:43:51.217 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.214+0000 7f2699ff5640 1 -- start start 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2699ff5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f26940b2810 0x7f269406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2699ff5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269415d4f0 con 0x7f269415d110 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2699ff5640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269406b9f0 con 0x7f26940b3ca0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2699ff5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26940664f0 con 0x7f26940b2810 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2693fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f26940b2810 0x7f269406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2693fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f26940b2810 0x7f269406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39728/0 (socket says 172.21.15.93:39728) 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f2693fff640 1 -- 172.21.15.93:0/1461826797 learned_addr learned my addr 172.21.15.93:0/1461826797 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.215+0000 7f26937fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f269415d110 0x7f26940ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:55474/0 (socket says 172.21.15.93:55474) 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f2693fff640 1 -- 172.21.15.93:0/1461826797 >> v1:172.21.15.125:6789/0 conn(0x7f26940b3ca0 legacy=0x7f26940b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f2693fff640 1 -- 172.21.15.93:0/1461826797 >> v1:172.21.15.93:6789/0 conn(0x7f269415d110 legacy=0x7f26940ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.219 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f2693fff640 1 -- 172.21.15.93:0/1461826797 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269406c2e0 con 0x7f26940b2810 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f2693fff640 1 --2- 172.21.15.93:0/1461826797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b2810 0x7f269406b2f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f268c009e50 tx=0x7f268c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf89a39dec868b0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f26927fc640 1 -- 172.21.15.93:0/1461826797 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c02cb20 con 0x7f26940b2810 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f26927fc640 1 -- 172.21.15.93:0/1461826797 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c02cc80 con 0x7f26940b2810 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.216+0000 7f26927fc640 1 -- 172.21.15.93:0/1461826797 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0343f0 con 0x7f26940b2810 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 -- 172.21.15.93:0/1461826797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b2810 msgr2=0x7f269406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 --2- 172.21.15.93:0/1461826797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b2810 0x7f269406b2f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f268c009e50 tx=0x7f268c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 -- 172.21.15.93:0/1461826797 shutdown_connections 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 --2- 172.21.15.93:0/1461826797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b2810 0x7f269406b2f0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 -- 172.21.15.93:0/1461826797 >> 172.21.15.93:0/1461826797 conn(0x7f26940cbd30 msgr2=0x7f26940cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 -- 172.21.15.93:0/1461826797 shutdown_connections 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.217+0000 7f2699ff5640 1 -- 172.21.15.93:0/1461826797 wait complete. 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.218+0000 7f2699ff5640 1 Processor -- start 2023-11-04T01:43:51.222 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.218+0000 7f2699ff5640 1 -- start start 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26940b2810 0x7f26940c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f269415d110 0x7f269415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940c68c0 con 0x7f26940b3ca0 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26941f6ca0 con 0x7f269415d110 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2699ff5640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26941f6120 con 0x7f26940b2810 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39730/0 (socket says 172.21.15.93:39730) 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 -- 172.21.15.93:0/3021265751 learned_addr learned my addr 172.21.15.93:0/3021265751 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f26937fe640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26940b2810 0x7f26940c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2693fff640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f269415d110 0x7f269415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 -- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26940b2810 msgr2=0x7f26940c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26940b2810 0x7f26940c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 -- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f269415d110 msgr2=0x7f269415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f269415d110 0x7f269415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.219+0000 7f2692ffd640 1 -- 172.21.15.93:0/3021265751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c009b30 con 0x7f26940b3ca0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f2692ffd640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f268800b420 tx=0x7f268800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011830 con 0x7f26940b3ca0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688011990 con 0x7f26940b3ca0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26941f6400 con 0x7f26940b3ca0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011d40 con 0x7f26940b3ca0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.220+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26941f69c0 con 0x7f26940b3ca0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.221+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940aec80 con 0x7f26940b3ca0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.221+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f268801b460 con 0x7f26940b3ca0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.222+0000 7f267bfff640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 0x7f268006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.222+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f2688089990 con 0x7f26940b3ca0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.222+0000 7f26937fe640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 0x7f268006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.222+0000 7f26937fe640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 0x7f268006d360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2684001020 tx=0x7f2684009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.228 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.226+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26940aec80 con 0x7f26940b3ca0 2023-11-04T01:43:51.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.391+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f26940aec80 con 0x7f26940b3ca0 2023-11-04T01:43:51.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.392+0000 7f267bfff640 1 -- 172.21.15.93:0/3021265751 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v118) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26940aec80 con 0x7f26940b3ca0 2023-11-04T01:43:51.394 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:51.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 msgr2=0x7f268006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 0x7f268006d360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2684001020 tx=0x7f2684009040 comp rx=0 tx=0).stop 2023-11-04T01:43:51.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 msgr2=0x7f2694159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f268800b420 tx=0x7f268800b8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 shutdown_connections 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f268006aea0 0x7f268006d360 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f269415d110 0x7f269415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f26940b3ca0 0x7f2694159780 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 --2- 172.21.15.93:0/3021265751 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f26940b2810 0x7f26940c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 >> 172.21.15.93:0/3021265751 conn(0x7f26940cbd30 msgr2=0x7f26940b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 shutdown_connections 2023-11-04T01:43:51.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.394+0000 7f2699ff5640 1 -- 172.21.15.93:0/3021265751 wait complete. 2023-11-04T01:43:51.406 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:51.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.507+0000 7f20b504f640 1 Processor -- start 2023-11-04T01:43:51.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.507+0000 7f20b504f640 1 -- start start 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f20b00ade00 0x7f20b00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20b006d9c0 0x7f20b00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b006c5f0 0x7f20b0071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b006cc90 con 0x7f20b006d9c0 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b0071b50 con 0x7f20b00ade00 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20b504f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b0e60 con 0x7f20b006c5f0 2023-11-04T01:43:51.512 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20b006d9c0 0x7f20b00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f20b006d9c0 0x7f20b00710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46434/0 (socket says 172.21.15.93:46434) 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 -- 172.21.15.93:0/2231054824 learned_addr learned my addr 172.21.15.93:0/2231054824 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20af59e640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b006c5f0 0x7f20b0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20aed9d640 1 --2- 172.21.15.93:0/2231054824 >> v2:172.21.15.125:3300/0 conn(0x7f20b00ade00 0x7f20b00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 -- 172.21.15.93:0/2231054824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b006c5f0 msgr2=0x7f20b0071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b006c5f0 0x7f20b0071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 -- 172.21.15.93:0/2231054824 >> v2:172.21.15.125:3300/0 conn(0x7f20b00ade00 msgr2=0x7f20b00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 --2- 172.21.15.93:0/2231054824 >> v2:172.21.15.125:3300/0 conn(0x7f20b00ade00 0x7f20b00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.508+0000 7f20a7fff640 1 -- 172.21.15.93:0/2231054824 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b006cee0 con 0x7f20b006d9c0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20a7fff640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b00710d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f20b00cb430 tx=0x7f209802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c06b6c26978b6e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20ae59c640 1 -- 172.21.15.93:0/2231054824 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098031750 con 0x7f20b006d9c0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20ae59c640 1 -- 172.21.15.93:0/2231054824 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980318b0 con 0x7f20b006d9c0 2023-11-04T01:43:51.513 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20ae59c640 1 -- 172.21.15.93:0/2231054824 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098031c40 con 0x7f20b006d9c0 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20b504f640 1 -- 172.21.15.93:0/2231054824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 msgr2=0x7f20b00710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.509+0000 7f20b504f640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b00710d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f20b00cb430 tx=0x7f209802b7f0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 -- 172.21.15.93:0/2231054824 shutdown_connections 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b00710d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 --2- 172.21.15.93:0/2231054824 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b006c5f0 0x7f20b0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 --2- 172.21.15.93:0/2231054824 >> v2:172.21.15.125:3300/0 conn(0x7f20b00ade00 0x7f20b00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 -- 172.21.15.93:0/2231054824 >> 172.21.15.93:0/2231054824 conn(0x7f20b00cb530 msgr2=0x7f20b00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 -- 172.21.15.93:0/2231054824 shutdown_connections 2023-11-04T01:43:51.514 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.510+0000 7f20b504f640 1 -- 172.21.15.93:0/2231054824 wait complete. 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.511+0000 7f20b504f640 1 Processor -- start 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.511+0000 7f20b504f640 1 -- start start 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 0x7f20b0152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00ade00 0x7f20b00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0155e20 con 0x7f20b006d9c0 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0157800 con 0x7f20b006c5f0 2023-11-04T01:43:51.517 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0152850 con 0x7f20b00ade00 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46438/0 (socket says 172.21.15.93:46438) 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 -- 172.21.15.93:0/1218159952 learned_addr learned my addr 172.21.15.93:0/1218159952 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20aed9d640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 0x7f20b0152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20af59e640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00ade00 0x7f20b00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 -- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00ade00 msgr2=0x7f20b00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00ade00 0x7f20b00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 -- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 msgr2=0x7f20b0152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 0x7f20b0152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 -- 172.21.15.93:0/1218159952 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980094d0 con 0x7f20b006d9c0 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20aed9d640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 0x7f20b0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:51.518 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a7fff640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2098009960 tx=0x7f20980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098033c80 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098033e00 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209803c640 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.512+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b0156ed0 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.513+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b0157490 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.513+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00684b0 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.514+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f209803a040 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.514+0000 7f20a77fe640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 0x7f209006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.514+0000 7f20aed9d640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 0x7f209006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.515+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f20980abaa0 con 0x7f20b006d9c0 2023-11-04T01:43:51.519 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.515+0000 7f20aed9d640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 0x7f209006d360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b970 tx=0x7f20a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.521 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.519+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20980761d0 con 0x7f20b006d9c0 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.683+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f20b00cddc0 con 0x7f20b006d9c0 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.684+0000 7f20a77fe640 1 -- 172.21.15.93:0/1218159952 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v118) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2098038020 con 0x7f20b006d9c0 2023-11-04T01:43:51.686 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 msgr2=0x7f209006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 0x7f209006d360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b970 tx=0x7f20a0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 msgr2=0x7f20b0155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2098009960 tx=0x7f20980046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 shutdown_connections 2023-11-04T01:43:51.688 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f209006aea0 0x7f209006d360 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f20b00ade00 0x7f20b00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f20b006d9c0 0x7f20b0155360 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 --2- 172.21.15.93:0/1218159952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20b006c5f0 0x7f20b0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.685+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 >> 172.21.15.93:0/1218159952 conn(0x7f20b00cb530 msgr2=0x7f20b00cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.686+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 shutdown_connections 2023-11-04T01:43:51.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.686+0000 7f20b504f640 1 -- 172.21.15.93:0/1218159952 wait complete. 2023-11-04T01:43:51.699 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:51.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 Processor -- start 2023-11-04T01:43:51.801 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 -- start start 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 0x7fd4e80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4e815d4e0 0x7fd4e80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 0x7fd4e80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80b32b0 con 0x7fd4e815d4e0 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80cee10 con 0x7fd4e80d3b60 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.799+0000 7fd4ee0f3640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b2980 con 0x7fd4e815d100 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4e815d4e0 0x7fd4e80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd4e815d4e0 0x7fd4e80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46440/0 (socket says 172.21.15.93:46440) 2023-11-04T01:43:51.803 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 -- 172.21.15.93:0/592916050 learned_addr learned my addr 172.21.15.93:0/592916050 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e77fe640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 0x7fd4e80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e7fff640 1 --2- 172.21.15.93:0/592916050 >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 0x7fd4e80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 -- 172.21.15.93:0/592916050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 msgr2=0x7fd4e80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 0x7fd4e80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 -- 172.21.15.93:0/592916050 >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 msgr2=0x7fd4e80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/592916050 >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 0x7fd4e80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e6ffd640 1 -- 172.21.15.93:0/592916050 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80b2c60 con 0x7fd4e815d4e0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e77fe640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 0x7fd4e80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.800+0000 7fd4e7fff640 1 --2- 172.21.15.93:0/592916050 >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 0x7fd4e80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e815d4e0 0x7fd4e80d14d0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b27a0 tx=0x7fd4dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689347579816194e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4e67fc640 1 -- 172.21.15.93:0/592916050 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc031870 con 0x7fd4e815d4e0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4e67fc640 1 -- 172.21.15.93:0/592916050 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc0319d0 con 0x7fd4e815d4e0 2023-11-04T01:43:51.804 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4e67fc640 1 -- 172.21.15.93:0/592916050 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc031d60 con 0x7fd4e815d4e0 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/592916050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e815d4e0 msgr2=0x7fd4e80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e815d4e0 0x7fd4e80d14d0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b27a0 tx=0x7fd4dc02b910 comp rx=0 tx=0).stop 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/592916050 shutdown_connections 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e815d4e0 0x7fd4e80d14d0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/592916050 >> v2:172.21.15.125:3300/0 conn(0x7fd4e80d3b60 0x7fd4e80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.807 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/592916050 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d100 0x7fd4e80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/592916050 >> 172.21.15.93:0/592916050 conn(0x7fd4e80d2ef0 msgr2=0x7fd4e80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/592916050 shutdown_connections 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.801+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/592916050 wait complete. 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.802+0000 7fd4ee0f3640 1 Processor -- start 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 -- start start 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 0x7fd4e81f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d4e0 0x7fd4e80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8152930 con 0x7fd4e80d3b60 2023-11-04T01:43:51.808 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81f6580 con 0x7fd4e815d100 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4ee0f3640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80a0c60 con 0x7fd4e815d4e0 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.803+0000 7fd4e77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46450/0 (socket says 172.21.15.93:46450) 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 -- 172.21.15.93:0/1391919922 learned_addr learned my addr 172.21.15.93:0/1391919922 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 0x7fd4e81f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 -- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d4e0 msgr2=0x7fd4e80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e7fff640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d4e0 0x7fd4e80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d4e0 0x7fd4e80b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 -- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 msgr2=0x7fd4e81f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 0x7fd4e81f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 -- 172.21.15.93:0/1391919922 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0094d0 con 0x7fd4e80d3b60 2023-11-04T01:43:51.809 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 0x7fd4e81f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4e77fe640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800e810 tx=0x7fd4d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004030 con 0x7fd4e80d3b60 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8004190 con 0x7fd4e80d3b60 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8005990 con 0x7fd4e80d3b60 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e809deb0 con 0x7fd4e80d3b60 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.804+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e81f6a90 con 0x7fd4e80d3b60 2023-11-04T01:43:51.810 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.805+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e809e040 con 0x7fd4e80d3b60 2023-11-04T01:43:51.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.806+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4d8005af0 con 0x7fd4e80d3b60 2023-11-04T01:43:51.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.806+0000 7fd4cffff640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.806+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fd4d8089fa0 con 0x7fd4e80d3b60 2023-11-04T01:43:51.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.806+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.811 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.806+0000 7fd4e6ffd640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 0x7fd4d406d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc036000 tx=0x7fd4dc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.812 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.810+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4e809e040 con 0x7fd4e80d3b60 2023-11-04T01:43:51.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.977+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fd4e809e040 con 0x7fd4e80d3b60 2023-11-04T01:43:51.979 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.977+0000 7fd4cffff640 1 -- 172.21.15.93:0/1391919922 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v118) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd4e809e040 con 0x7fd4e80d3b60 2023-11-04T01:43:51.980 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 msgr2=0x7fd4d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 0x7fd4d406d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc036000 tx=0x7fd4dc03c040 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 msgr2=0x7fd4e81523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800e810 tx=0x7fd4d800ecd0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 shutdown_connections 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7fd4d406ae70 0x7fd4d406d330 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7fd4e815d4e0 0x7fd4e80b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4e815d100 0x7fd4e81f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 --2- 172.21.15.93:0/1391919922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd4e80d3b60 0x7fd4e81523f0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 >> 172.21.15.93:0/1391919922 conn(0x7fd4e80d2ef0 msgr2=0x7fd4e80c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 shutdown_connections 2023-11-04T01:43:51.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:51.979+0000 7fd4ee0f3640 1 -- 172.21.15.93:0/1391919922 wait complete. 2023-11-04T01:43:51.992 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:52.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.091+0000 7f1836aa9640 1 Processor -- start 2023-11-04T01:43:52.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.091+0000 7f1836aa9640 1 -- start start 2023-11-04T01:43:52.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1836aa9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300b0c40 0x7f18300ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.094 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1836aa9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300c9100 con 0x7f18301605b0 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1836aa9640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300ae230 con 0x7f183006b950 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1836aa9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300aceb0 con 0x7f18300b0c40 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300b0c40 0x7f18300ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1834845640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f18301605b0 0x7f18300b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44328/0 (socket says 172.21.15.93:44328) 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f18300b0c40 0x7f18300ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46460/0 (socket says 172.21.15.93:46460) 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f1834845640 1 -- 172.21.15.93:0/3902055447 learned_addr learned my addr 172.21.15.93:0/3902055447 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182ffff640 1 -- 172.21.15.93:0/3902055447 >> v1:172.21.15.125:6789/0 conn(0x7f183006b950 legacy=0x7f18300c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182ffff640 1 -- 172.21.15.93:0/3902055447 >> v1:172.21.15.93:6789/0 conn(0x7f18301605b0 legacy=0x7f18300b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182ffff640 1 -- 172.21.15.93:0/3902055447 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300ad190 con 0x7f18300b0c40 2023-11-04T01:43:52.095 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.092+0000 7f182f7fe640 1 -- 172.21.15.93:0/3902055447 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521499845 0 0) 0x7f18300c9100 con 0x7f18301605b0 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f182ffff640 1 --2- 172.21.15.93:0/3902055447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300b0c40 0x7f18300ac8d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a760a0e4d446286d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f182f7fe640 1 -- 172.21.15.93:0/3902055447 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c02e070 con 0x7f18300b0c40 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f182f7fe640 1 -- 172.21.15.93:0/3902055447 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c0315a0 con 0x7f18300b0c40 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f182f7fe640 1 -- 172.21.15.93:0/3902055447 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c031930 con 0x7f18300b0c40 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f1836aa9640 1 -- 172.21.15.93:0/3902055447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300b0c40 msgr2=0x7f18300ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f1836aa9640 1 --2- 172.21.15.93:0/3902055447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300b0c40 0x7f18300ac8d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c02b840 comp rx=0 tx=0).stop 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f1836aa9640 1 -- 172.21.15.93:0/3902055447 shutdown_connections 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f1836aa9640 1 --2- 172.21.15.93:0/3902055447 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18300b0c40 0x7f18300ac8d0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.093+0000 7f1836aa9640 1 -- 172.21.15.93:0/3902055447 >> 172.21.15.93:0/3902055447 conn(0x7f18300cb530 msgr2=0x7f18300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.094+0000 7f1836aa9640 1 -- 172.21.15.93:0/3902055447 shutdown_connections 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.094+0000 7f1836aa9640 1 -- 172.21.15.93:0/3902055447 wait complete. 2023-11-04T01:43:52.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.095+0000 7f1836aa9640 1 Processor -- start 2023-11-04T01:43:52.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.095+0000 7f1836aa9640 1 -- start start 2023-11-04T01:43:52.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0c40 0x7f183015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18301605b0 0x7f1830149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c7610 con 0x7f183006b950 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183015f210 con 0x7f18301605b0 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1836aa9640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183014a3f0 con 0x7f18300b0c40 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46472/0 (socket says 172.21.15.93:46472) 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 -- 172.21.15.93:0/447700570 learned_addr learned my addr 172.21.15.93:0/447700570 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1835046640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18301605b0 0x7f1830149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f182ffff640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0c40 0x7f183015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 -- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0c40 msgr2=0x7f183015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0c40 0x7f183015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 -- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18301605b0 msgr2=0x7f1830149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18301605b0 0x7f1830149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 -- 172.21.15.93:0/447700570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c009400 con 0x7f183006b950 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.096+0000 7f1834845640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f182400c430 tx=0x7f182400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.097+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240074e0 con 0x7f183006b950 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.097+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824007660 con 0x7f183006b950 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.097+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18300c6c70 con 0x7f183006b950 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.097+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824004a20 con 0x7f183006b950 2023-11-04T01:43:52.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.097+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300c7230 con 0x7f183006b950 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.098+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18300cd050 con 0x7f183006b950 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.099+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1824004b80 con 0x7f183006b950 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.099+0000 7f182d7fa640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 0x7f181406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.099+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f1824089dc0 con 0x7f183006b950 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.099+0000 7f182ffff640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 0x7f181406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.102 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.099+0000 7f182ffff640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 0x7f181406d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f181c036000 tx=0x7f181c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.106 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.104+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18240544f0 con 0x7f183006b950 2023-11-04T01:43:52.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.270+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18300684b0 con 0x7f183006b950 2023-11-04T01:43:52.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.270+0000 7f182d7fa640 1 -- 172.21.15.93:0/447700570 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1824057b10 con 0x7f183006b950 2023-11-04T01:43:52.272 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 32 2023-11-04T01:43:52.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 msgr2=0x7f181406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 0x7f181406d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f181c036000 tx=0x7f181c03d040 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 msgr2=0x7f18300b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f182400c430 tx=0x7f182400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 shutdown_connections 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f181406ae70 0x7f181406d330 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18301605b0 0x7f1830149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f18300b0c40 0x7f183015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 --2- 172.21.15.93:0/447700570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f183006b950 0x7f18300b21b0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 >> 172.21.15.93:0/447700570 conn(0x7f18300cb530 msgr2=0x7f18300b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 shutdown_connections 2023-11-04T01:43:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.272+0000 7f1836aa9640 1 -- 172.21.15.93:0/447700570 wait complete. 2023-11-04T01:43:52.285 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:52.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.385+0000 7f87f7d55640 1 Processor -- start 2023-11-04T01:43:52.387 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.385+0000 7f87f7d55640 1 -- start start 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f7d55640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 0x7f87f006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f7d55640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87f00b0210 0x7f87f00cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f7d55640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f0160ca0 con 0x7f87f006e5b0 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f7d55640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f0160f40 con 0x7f87f00b0210 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f7d55640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f0161220 con 0x7f87f00afe30 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87f00b0210 0x7f87f00cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f62f2640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f87f006e5b0 0x7f87f015c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44332/0 (socket says 172.21.15.93:44332) 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f87f00b0210 0x7f87f00cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46476/0 (socket says 172.21.15.93:46476) 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f62f2640 1 -- 172.21.15.93:0/3365653560 learned_addr learned my addr 172.21.15.93:0/3365653560 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f5af1640 1 --2- 172.21.15.93:0/3365653560 >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 0x7f87f006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 -- 172.21.15.93:0/3365653560 >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 msgr2=0x7f87f006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:52.389 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 --2- 172.21.15.93:0/3365653560 >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 0x7f87f006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 -- 172.21.15.93:0/3365653560 >> v1:172.21.15.93:6789/0 conn(0x7f87f006e5b0 legacy=0x7f87f015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f4aef640 1 -- 172.21.15.93:0/3365653560 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857417748 0 0) 0x7f87f0160ca0 con 0x7f87f006e5b0 2023-11-04T01:43:52.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f52f0640 1 -- 172.21.15.93:0/3365653560 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0161500 con 0x7f87f00b0210 2023-11-04T01:43:52.390 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.386+0000 7f87f5af1640 1 --2- 172.21.15.93:0/3365653560 >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 0x7f87f006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.387+0000 7f87f52f0640 1 --2- 172.21.15.93:0/3365653560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00b0210 0x7f87f00cd610 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f87f00ce280 tx=0x7f87e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791eb179b7b27fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.387+0000 7f87f4aef640 1 -- 172.21.15.93:0/3365653560 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031830 con 0x7f87f00b0210 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.387+0000 7f87f4aef640 1 -- 172.21.15.93:0/3365653560 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0031990 con 0x7f87f00b0210 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.387+0000 7f87f4aef640 1 -- 172.21.15.93:0/3365653560 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031d20 con 0x7f87f00b0210 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 -- 172.21.15.93:0/3365653560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00b0210 msgr2=0x7f87f00cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.391 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 --2- 172.21.15.93:0/3365653560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00b0210 0x7f87f00cd610 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f87f00ce280 tx=0x7f87e002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 -- 172.21.15.93:0/3365653560 shutdown_connections 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 --2- 172.21.15.93:0/3365653560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00b0210 0x7f87f00cd610 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 --2- 172.21.15.93:0/3365653560 >> v2:172.21.15.125:3300/0 conn(0x7f87f00afe30 0x7f87f006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 -- 172.21.15.93:0/3365653560 >> 172.21.15.93:0/3365653560 conn(0x7f87f006a0d0 msgr2=0x7f87f006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 -- 172.21.15.93:0/3365653560 shutdown_connections 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.388+0000 7f87f7d55640 1 -- 172.21.15.93:0/3365653560 wait complete. 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.389+0000 7f87f7d55640 1 Processor -- start 2023-11-04T01:43:52.392 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.389+0000 7f87f7d55640 1 -- start start 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87f006e5b0 0x7f87f00b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87f00b0210 0x7f87f00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00b17f0 con 0x7f87f00afe30 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00b3550 con 0x7f87f006e5b0 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f7d55640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00b3270 con 0x7f87f00b0210 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46478/0 (socket says 172.21.15.93:46478) 2023-11-04T01:43:52.394 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 -- 172.21.15.93:0/831490458 learned_addr learned my addr 172.21.15.93:0/831490458 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f5af1640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87f006e5b0 0x7f87f00b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f62f2640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87f00b0210 0x7f87f00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 -- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87f00b0210 msgr2=0x7f87f00b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87f00b0210 0x7f87f00b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 -- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87f006e5b0 msgr2=0x7f87f00b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87f006e5b0 0x7f87f00b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 -- 172.21.15.93:0/831490458 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009400 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.390+0000 7f87f52f0640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009890 tx=0x7f87e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e003aa60 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e003abc0 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00423f0 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00b1130 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f00b2150 con 0x7f87f00afe30 2023-11-04T01:43:52.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.391+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00b1930 con 0x7f87f00afe30 2023-11-04T01:43:52.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.392+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87e004b3b0 con 0x7f87f00afe30 2023-11-04T01:43:52.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.392+0000 7f87e67fc640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 0x7f87d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.392+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f87e00abf40 con 0x7f87f00afe30 2023-11-04T01:43:52.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.392+0000 7f87f5af1640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 0x7f87d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.396 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.393+0000 7f87f5af1640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 0x7f87d406d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.397+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87f00b1930 con 0x7f87f00afe30 2023-11-04T01:43:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.564+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87f00b1930 con 0x7f87f00afe30 2023-11-04T01:43:52.567 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.565+0000 7f87e67fc640 1 -- 172.21.15.93:0/831490458 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f00b1930 con 0x7f87f00afe30 2023-11-04T01:43:52.567 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 64 2023-11-04T01:43:52.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 msgr2=0x7f87d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 0x7f87d406d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:52.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 msgr2=0x7f87f00b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009890 tx=0x7f87e00046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.569 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 shutdown_connections 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f87d406ae70 0x7f87d406d330 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f87f00b0210 0x7f87f00b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f87f00afe30 0x7f87f00b54c0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 --2- 172.21.15.93:0/831490458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87f006e5b0 0x7f87f00b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 >> 172.21.15.93:0/831490458 conn(0x7f87f006a0d0 msgr2=0x7f87f0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 shutdown_connections 2023-11-04T01:43:52.570 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.567+0000 7f87f7d55640 1 -- 172.21.15.93:0/831490458 wait complete. 2023-11-04T01:43:52.580 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:52.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 Processor -- start 2023-11-04T01:43:52.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 -- start start 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f170c0ceda0 0x7f170c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0b0150 con 0x7f170c0cf890 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0b1170 con 0x7f170c0b2210 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.677+0000 7f1712621640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c0b1df0 con 0x7f170c0ceda0 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f170c0ceda0 0x7f170c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f1710bbe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f170c0cf890 0x7f170c06b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:44338/0 (socket says 172.21.15.93:44338) 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170bfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f170c0ceda0 0x7f170c15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46484/0 (socket says 172.21.15.93:46484) 2023-11-04T01:43:52.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f1710bbe640 1 -- 172.21.15.93:0/2150631040 learned_addr learned my addr 172.21.15.93:0/2150631040 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-04T01:43:52.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170bfff640 1 -- 172.21.15.93:0/2150631040 >> v1:172.21.15.125:6789/0 conn(0x7f170c0b2210 legacy=0x7f170c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:52.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170bfff640 1 -- 172.21.15.93:0/2150631040 >> v1:172.21.15.93:6789/0 conn(0x7f170c0cf890 legacy=0x7f170c06b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170bfff640 1 -- 172.21.15.93:0/2150631040 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0b1450 con 0x7f170c0ceda0 2023-11-04T01:43:52.681 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.678+0000 7f170affd640 1 -- 172.21.15.93:0/2150631040 <== mon.0 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254705106 0 0) 0x7f170c0b0150 con 0x7f170c0cf890 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f170bfff640 1 --2- 172.21.15.93:0/2150631040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c15cf20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009790 tx=0x7f16fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eb12179837f492 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f170affd640 1 -- 172.21.15.93:0/2150631040 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc02e070 con 0x7f170c0ceda0 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f170affd640 1 -- 172.21.15.93:0/2150631040 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc0315a0 con 0x7f170c0ceda0 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f170affd640 1 -- 172.21.15.93:0/2150631040 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc031930 con 0x7f170c0ceda0 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 -- 172.21.15.93:0/2150631040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 msgr2=0x7f170c15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 --2- 172.21.15.93:0/2150631040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c15cf20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009790 tx=0x7f16fc02b840 comp rx=0 tx=0).stop 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 -- 172.21.15.93:0/2150631040 shutdown_connections 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 --2- 172.21.15.93:0/2150631040 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c15cf20 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 -- 172.21.15.93:0/2150631040 >> 172.21.15.93:0/2150631040 conn(0x7f170c0d0c30 msgr2=0x7f170c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 -- 172.21.15.93:0/2150631040 shutdown_connections 2023-11-04T01:43:52.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.679+0000 7f1712621640 1 -- 172.21.15.93:0/2150631040 wait complete. 2023-11-04T01:43:52.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.680+0000 7f1712621640 1 Processor -- start 2023-11-04T01:43:52.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 -- start start 2023-11-04T01:43:52.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 0x7f170c1e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 0x7f170c0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1e7c80 con 0x7f170c0ceda0 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1e4810 con 0x7f170c0cf890 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f1712621640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1e7070 con 0x7f170c0b2210 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f170b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f170b7fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:46492/0 (socket says 172.21.15.93:46492) 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.681+0000 7f170b7fe640 1 -- 172.21.15.93:0/1219254383 learned_addr learned my addr 172.21.15.93:0/1219254383 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1710bbe640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 0x7f170c0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170bfff640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 0x7f170c1e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 -- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 msgr2=0x7f170c1e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 0x7f170c1e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 -- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 msgr2=0x7f170c0ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 0x7f170c0ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 -- 172.21.15.93:0/1219254383 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0093a0 con 0x7f170c0ceda0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170bfff640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 0x7f170c1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1710bbe640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 0x7f170c0ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f170b7fe640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f170000b410 tx=0x7f170000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700011830 con 0x7f170c0ceda0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700011990 con 0x7f170c0ceda0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700011d40 con 0x7f170c0ceda0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c1e7350 con 0x7f170c0ceda0 2023-11-04T01:43:52.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.682+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c1e7910 con 0x7f170c0ceda0 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.683+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c148180 con 0x7f170c0ceda0 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.684+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f170001a400 con 0x7f170c0ceda0 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.684+0000 7f1708ff9640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 0x7f16f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.684+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f170008a220 con 0x7f170c0ceda0 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.684+0000 7f170bfff640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 0x7f16f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.684+0000 7f170bfff640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 0x7f16f806d330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f16fc036000 tx=0x7f16fc03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.690 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.688+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17000548c0 con 0x7f170c0ceda0 2023-11-04T01:43:52.825 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:52.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:52.837 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2023-11-04T01:43:52.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.868+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f170c0684b0 con 0x7f170c0ceda0 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.869+0000 7f1708ff9640 1 -- 172.21.15.93:0/1219254383 <== mon.0 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v118) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f1700015020 con 0x7f170c0ceda0 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/2573507659 2023-11-04T02:43:20.792492+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/769984368 2023-11-05T01:43:12.921244+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:52.871 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/2466276650 2023-11-05T01:42:21.696641+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6833/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/2025150673 2023-11-05T01:42:28.503726+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/596691451 2023-11-05T01:40:18.670910+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/1185165139 2023-11-05T01:41:43.618643+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/2331318607 2023-11-05T01:39:53.485629+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3505063928 2023-11-04T02:42:36.804546+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6832/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6834/4131141051 2023-11-05T01:41:09.121113+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6834/448915336 2023-11-05T01:40:43.904647+0000 2023-11-04T01:43:52.872 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.1:0/3671080369 2023-11-04T02:41:51.893134+0000 2023-11-04T01:43:52.873 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.125:6835/3282724716 2023-11-05T01:43:05.689518+0000 2023-11-04T01:43:52.873 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93:6836/3572539978 2023-11-05T01:41:36.780916+0000 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:listed 23 entries 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 msgr2=0x7f16f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 0x7f16f806d330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f16fc036000 tx=0x7f16fc03d040 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 msgr2=0x7f170c1e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f170000b410 tx=0x7f170000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 shutdown_connections 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:6832/4069824876,v1:172.21.15.93:6833/4069824876] conn(0x7f16f806ae70 0x7f16f806d330 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f170c0cf890 0x7f170c0ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f170c0ceda0 0x7f170c1e6740 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 --2- 172.21.15.93:0/1219254383 >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f170c0b2210 0x7f170c1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 >> 172.21.15.93:0/1219254383 conn(0x7f170c0d0c30 msgr2=0x7f170c0ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 shutdown_connections 2023-11-04T01:43:52.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52.871+0000 7f1712621640 1 -- 172.21.15.93:0/1219254383 wait complete. 2023-11-04T01:43:52.884 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-04T01:43:52.884 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:52.884 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:52.982 INFO:teuthology.orchestra.run.smithi093.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:43:52.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:52.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:52 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:43:52.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:52.989 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi093.front.sepia.ceph.com, aborting... 2023-11-04T01:43:52.989 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:52.989 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:43:54.002 INFO:teuthology.orchestra.run.smithi093.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.003 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.004 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.005 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 4u a_inode 0,14 0 1077 [eventpoll:5,6,8,9,11,14,15,16,17,44,45,47,49,50,57,60,73,74,85,86,87,97,98,109,110,111,116,117,118,120,122,123...] 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 5u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 6r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 8u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 9u a_inode 0,14 0 1077 [eventpoll:10,13] 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 10r REG 0,20 0 17710 /proc/1/mountinfo 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 11r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 12u netlink 0t0 18722 AUDIT 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 13r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:43:54.006 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 15u netlink 0t0 18714 KOBJECT_UEVENT 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 16u unix 0xffff94d3101d5500 0t0 18716 /run/systemd/private type=STREAM (LISTEN) 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 17u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 18r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 19r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 21u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 22u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 23u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 24u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 25u unix 0xffff94d30769ea40 0t0 19815 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 26u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 28u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 30u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.007 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 31u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 32u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 33u a_inode 0,14 0 1077 bpf-prog 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 44u unix 0xffff94d3103e0cc0 0t0 17718 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 45u unix 0xffff94d3103e50c0 0t0 17717 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 47u unix 0xffff94d3103d9980 0t0 17712 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 49u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 50u unix 0xffff94d3103da640 0t0 17713 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 54u unix 0xffff94d3103dbb80 0t0 17714 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 57r FIFO 0,13 0t0 19753 pipe 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 60u unix 0xffff94d307690000 0t0 19957 type=STREAM (CONNECTED) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 73u unix 0xffff94d307692200 0t0 19951 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 74u unix 0xffff94d307699540 0t0 19768 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 75u unix 0xffff94d307692640 0t0 19949 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:43:54.008 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 85u unix 0xffff94d307695500 0t0 19756 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 86u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 87u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 92u unix 0xffff94d307690440 0t0 19758 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 93u IPv4 18005 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 94u IPv4 18011 0t0 UDP *:sunrpc 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 95u IPv6 18730 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 96u IPv6 18017 0t0 UDP *:sunrpc 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 97u FIFO 0,24 0t0 447 /run/initctl 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 98u CHR 10,242 0t0 165 /dev/rfkill 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 99u unix 0xffff94d3103dc840 0t0 17727 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 100u unix 0xffff94d3103e5d80 0t0 17729 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 101u unix 0xffff94d307698440 0t0 19770 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:43:54.009 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 109u unix 0xffff94d308488000 0t0 197270 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 110u unix 0xffff94d310296e80 0t0 23292 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 111u unix 0xffff94d3101d1980 0t0 21938 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 112u unix 0xffff94d310297700 0t0 18308 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 113u unix 0xffff94d3101d3b80 0t0 18307 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 114u unix 0xffff94d310294400 0t0 18306 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 115u unix 0xffff94d308423300 0t0 18221 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 116u unix 0xffff94d3084261c0 0t0 18217 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 117u unix 0xffff94d3101d3300 0t0 18216 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 118u unix 0xffff94d30848d0c0 0t0 18215 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 119u unix 0xffff94d30848e1c0 0t0 18206 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 120u unix 0xffff94d3100ad500 0t0 21856 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 122u unix 0xffff94d3101d50c0 0t0 18856 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.010 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 123u unix 0xffff94d3103e3fc0 0t0 18773 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 129u netlink 0t0 19772 KOBJECT_UEVENT 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 1 root 130u unix 0xffff94d3103df2c0 0t0 17725 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.011 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.012 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-04T01:43:54.013 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.014 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.015 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.016 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.017 INFO:teuthology.orchestra.run.smithi093.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.018 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.019 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-04T01:43:54.020 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.021 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.022 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-04T01:43:54.023 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.024 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-11-04T01:43:54.025 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 85 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 85 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:tpm_dev_w 85 root txt unknown /proc/85/exe 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md 86 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md 86 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md 86 root txt unknown /proc/86/exe 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md_bitmap 87 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md_bitmap 87 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:md_bitmap 87 root txt unknown /proc/87/exe 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 88 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 88 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:edac-poll 88 root txt unknown /proc/88/exe 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 89 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 89 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.026 INFO:teuthology.orchestra.run.smithi093.stdout:watchdogd 89 root txt unknown /proc/89/exe 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 91 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 91 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 91 root txt unknown /proc/91/exe 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kswapd0 93 root txt unknown /proc/93/exe 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 100 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 100 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kthrotld 100 root txt unknown /proc/100/exe 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.027 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kaluad 110 root txt unknown /proc/110/exe 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:mld 111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:mld 111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:mld 111 root txt unknown /proc/111/exe 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 112 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 112 root txt unknown /proc/112/exe 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 113 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 113 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:ipv6_addr 113 root txt unknown /proc/113/exe 2023-11-04T01:43:54.028 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 122 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 122 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kstrp 122 root txt unknown /proc/122/exe 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 129 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 129 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:zswap-shr 129 root txt unknown /proc/129/exe 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 237 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 237 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 237 root txt unknown /proc/237/exe 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 276 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 276 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 276 root txt unknown /proc/276/exe 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 287 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.029 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 287 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 287 root txt unknown /proc/287/exe 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 290 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 290 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 290 root txt unknown /proc/290/exe 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 351 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 351 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 351 root txt unknown /proc/351/exe 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 377 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 377 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 377 root txt unknown /proc/377/exe 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 424 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 424 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.030 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-wq 424 root txt unknown /proc/424/exe 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 431 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 431 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ata_sff 431 root txt unknown /proc/431/exe 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 432 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 432 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-rese 432 root txt unknown /proc/432/exe 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 435 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 435 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-dele 435 root txt unknown /proc/435/exe 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-auth 436 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-auth 436 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:nvme-auth 436 root txt unknown /proc/436/exe 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 437 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 437 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.031 INFO:teuthology.orchestra.run.smithi093.stdout:ixgbe 437 root txt unknown /proc/437/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 441 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 441 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_0 441 root txt unknown /proc/441/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 442 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 442 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 442 root txt unknown /proc/442/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 443 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 443 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_1 443 root txt unknown /proc/443/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 444 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 444 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 444 root txt unknown /proc/444/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 445 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 445 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_2 445 root txt unknown /proc/445/exe 2023-11-04T01:43:54.032 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 446 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 446 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 446 root txt unknown /proc/446/exe 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 447 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 447 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_3 447 root txt unknown /proc/447/exe 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 448 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 448 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 448 root txt unknown /proc/448/exe 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 454 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 454 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_4 454 root txt unknown /proc/454/exe 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 455 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 455 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.033 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 455 root txt unknown /proc/455/exe 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 456 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 456 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_5 456 root txt unknown /proc/456/exe 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 457 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 457 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 457 root txt unknown /proc/457/exe 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 458 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 458 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_6 458 root txt unknown /proc/458/exe 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 459 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 459 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 459 root txt unknown /proc/459/exe 2023-11-04T01:43:54.034 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 460 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 460 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_7 460 root txt unknown /proc/460/exe 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 461 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 461 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 461 root txt unknown /proc/461/exe 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 462 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 462 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_8 462 root txt unknown /proc/462/exe 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 463 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 463 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 463 root txt unknown /proc/463/exe 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 464 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.035 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 464 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_eh_9 464 root txt unknown /proc/464/exe 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 465 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 465 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:scsi_tmf_ 465 root txt unknown /proc/465/exe 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 466 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 466 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 466 root txt unknown /proc/466/exe 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 467 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 467 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 467 root txt unknown /proc/467/exe 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 477 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 477 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 477 root txt unknown /proc/477/exe 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 490 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.036 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 490 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:jbd2/sda1 490 root txt unknown /proc/490/exe 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 491 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 491 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:ext4-rsv- 491 root txt unknown /proc/491/exe 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.037 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.038 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.039 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 3u unix 0xffff94d3103df2c0 0t0 17725 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 4u unix 0xffff94d3103dc840 0t0 17727 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 5u unix 0xffff94d3103e5d80 0t0 17729 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 7u a_inode 0,14 0 1077 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,22,23,24,25,27,28,29,30,32] 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 9u unix 0xffff94d3101d2640 0t0 18757 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 10r REG 0,20 0 14134 /proc/sys/kernel/hostname 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 11u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 12u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 13u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 14u unix 0xffff94d3101bb740 0t0 18758 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 15u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 17u unix 0xffff94d3103e3fc0 0t0 18773 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.040 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 18u unix 0xffff94d3100ad500 0t0 21856 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 19u unix 0xffff94d30848e1c0 0t0 18206 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 20u unix 0xffff94d3101d50c0 0t0 18856 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 21u unix 0xffff94d310296e80 0t0 23292 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 22u unix 0xffff94d308488000 0t0 197270 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 23u unix 0xffff94d30848d0c0 0t0 18215 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 24u unix 0xffff94d3101d3300 0t0 18216 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 25u unix 0xffff94d3084261c0 0t0 18217 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 27u unix 0xffff94d310294400 0t0 18306 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 28u unix 0xffff94d308423300 0t0 18221 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 29u unix 0xffff94d3101d3b80 0t0 18307 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 30u unix 0xffff94d310297700 0t0 18308 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-j 567 root 32u unix 0xffff94d3101d1980 0t0 21938 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 573 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 573 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.041 INFO:teuthology.orchestra.run.smithi093.stdout:ext4lazyi 573 root txt unknown /proc/573/exe 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.042 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.043 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 1u unix 0xffff94d3103e6600 0t0 18080 type=STREAM (CONNECTED) 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 2u unix 0xffff94d3103e6600 0t0 18080 type=STREAM (CONNECTED) 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 3u netlink 0t0 19772 KOBJECT_UEVENT 2023-11-04T01:43:54.044 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 4u unix 0xffff94d307698440 0t0 19770 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 5u unix 0xffff94d3103ddd80 0t0 18092 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 6u unix 0xffff94d3103dd940 0t0 18096 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 7u unix 0xffff94d3103daa80 0t0 18097 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 9u a_inode 0,14 0 1077 [eventpoll:3,4,6,8,10,11,14] 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 10u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 11u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-u 582 root 14u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 624 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 624 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:ipmi-msgh 624 root txt unknown /proc/624/exe 2023-11-04T01:43:54.045 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 646 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 646 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:kipmi0 646 root txt unknown /proc/646/exe 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.046 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.047 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 1u unix 0xffff94d3101d2a80 0t0 18853 type=STREAM (CONNECTED) 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 2u unix 0xffff94d3101d2a80 0t0 18853 type=STREAM (CONNECTED) 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 3u unix 0xffff94d307690440 0t0 19758 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 4u IPv4 18005 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 5u IPv4 18011 0t0 UDP *:sunrpc 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 6u IPv6 18730 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 7u IPv6 18017 0t0 UDP *:sunrpc 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpcbind 659 rpc 8rW REG 0,24 0 1038 /run/rpcbind/rpcbind.lock 2023-11-04T01:43:54.048 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 660 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 660 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:rpciod 660 root txt unknown /proc/660/exe 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 661 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 661 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:xprtiod 661 root txt unknown /proc/661/exe 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.049 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.050 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 3u netlink 0t0 18161 AUDIT 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 4w REG 8,1 7952866 64150 /var/log/audit/audit.log 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 6u unix 0xffff94d30850d940 0t0 20552 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 7u unix 0xffff94d310290cc0 0t0 20551 type=STREAM (CONNECTED) 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 8u unix 0xffff94d310293b80 0t0 20553 type=STREAM (CONNECTED) 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 9u unix 0xffff94d310295d80 0t0 20554 type=STREAM (CONNECTED) 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 root 10u a_inode 0,14 0 1077 [eventfd:0] 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.051 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:43:54.052 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 3u netlink 0t0 18161 AUDIT 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 4w REG 8,1 7952866 64150 /var/log/audit/audit.log 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 6u unix 0xffff94d30850d940 0t0 20552 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 7u unix 0xffff94d310290cc0 0t0 20551 type=STREAM (CONNECTED) 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 8u unix 0xffff94d310293b80 0t0 20553 type=STREAM (CONNECTED) 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 9u unix 0xffff94d310295d80 0t0 20554 type=STREAM (CONNECTED) 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 665 auditd root 10u a_inode 0,14 0 1077 [eventfd:0] 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.053 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.054 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 3u netlink 0t0 18161 AUDIT 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 4w REG 8,1 7952866 64150 /var/log/audit/audit.log 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 6u unix 0xffff94d30850d940 0t0 20552 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 7u unix 0xffff94d310290cc0 0t0 20551 type=STREAM (CONNECTED) 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 8u unix 0xffff94d310293b80 0t0 20553 type=STREAM (CONNECTED) 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 9u unix 0xffff94d310295d80 0t0 20554 type=STREAM (CONNECTED) 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:auditd 664 667 auditd root 10u a_inode 0,14 0 1077 [eventfd:0] 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.055 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.056 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root 0u unix 0xffff94d3102950c0 0t0 20550 type=STREAM (CONNECTED) 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:sedispatc 666 root 3u unix 0xffff94d30848ee80 0t0 23450 type=STREAM (CONNECTED) 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus DEL REG 0,1 1025 /memfd:dbus-broker-log 2023-11-04T01:43:54.057 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.058 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 1u unix 0xffff94d3100aaec0 0t0 16680 type=STREAM (CONNECTED) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 2u unix 0xffff94d3100aaec0 0t0 16680 type=STREAM (CONNECTED) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 3u unix 0xffff94d307692640 0t0 19949 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 4u unix 0xffff94d3139d1980 0t0 16690 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 5u a_inode 0,14 0 1077 [eventpoll:6,7,8,9,10,11] 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 6u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 7r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 8u unix 0xffff94d3100a8440 0t0 16692 type=STREAM (CONNECTED) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 9u unix 0xffff94d3100ab740 0t0 16694 type=STREAM (CONNECTED) 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 10u a_inode 0,14 0 1077 [pidfd:704] 2023-11-04T01:43:54.059 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 11u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 703 dbus 12u REG 0,1 2097152 1025 /memfd:dbus-broker-log (deleted) 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.060 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 1u unix 0xffff94d3100aaec0 0t0 16680 type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 2u unix 0xffff94d3100aaec0 0t0 16680 type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 3u sock 0,8 0t0 20589 protocol: NETLINK 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 4u unix 0xffff94d3139d1980 0t0 16690 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 5u a_inode 0,14 0 1077 [eventpoll:6,7,8,9,10,11,12,13,14,15,16,18] 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 6u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 7u unix 0xffff94d307692640 0t0 19949 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 8u unix 0xffff94d307694840 0t0 20590 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 9u unix 0xffff94d3100afb40 0t0 16693 type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 10u unix 0xffff94d3100ae600 0t0 20592 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 11u unix 0xffff94d308424c80 0t0 20594 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 12u unix 0xffff94d307691980 0t0 16711 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.061 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 13u unix 0xffff94d3101d4400 0t0 20606 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 14u unix 0xffff94d30848c840 0t0 26639 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 15u unix 0xffff94d3100aaa80 0t0 21927 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 16u unix 0xffff94d310291980 0t0 17343 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:dbus-brok 704 dbus 18u unix 0xffff94d3101d6600 0t0 20657 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:43:54.062 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.063 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.064 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:43:54.065 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.066 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.067 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 1u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 2u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 3u a_inode 0,14 0 1077 [eventfd:6] 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 4u a_inode 0,14 0 1077 [eventfd:7] 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 5u unix 0xffff94d3101b9980 0t0 18888 type=DGRAM (UNCONNECTED) 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 6u unix 0xffff94d3101d1dc0 0t0 18889 type=STREAM (CONNECTED) 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 7u a_inode 0,14 0 1077 [eventfd:8] 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 10u netlink 0t0 18893 KOBJECT_UEVENT 2023-11-04T01:43:54.068 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 11u netlink 0t0 18894 GENERIC 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 12u netlink 0t0 18895 GENERIC 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 13u netlink 0t0 18896 ROUTE 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 14r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 15r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 16u netlink 0t0 20019 KOBJECT_UEVENT 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 17u a_inode 0,14 0 1077 [eventpoll] 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 18u unix 0xffff94d3100a9980 0t0 16717 type=STREAM (CONNECTED) 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 19u a_inode 0,14 0 1077 [eventpoll:21,26] 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 20w FIFO 0,24 0t0 1158 /run/systemd/inhibit/1.ref 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 21u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 23u a_inode 0,14 0 1077 [eventpoll:24,25] 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 24u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.069 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 25u pack 22837 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 root 26u IPv4 22838 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.070 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.071 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.072 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.073 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:43:54.074 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 1u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 2u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 3u a_inode 0,14 0 1077 [eventfd:6] 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 4u a_inode 0,14 0 1077 [eventfd:7] 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 5u unix 0xffff94d3101b9980 0t0 18888 type=DGRAM (UNCONNECTED) 2023-11-04T01:43:54.075 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 6u unix 0xffff94d3101d1dc0 0t0 18889 type=STREAM (CONNECTED) 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 7u a_inode 0,14 0 1077 [eventfd:8] 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 10u netlink 0t0 18893 KOBJECT_UEVENT 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 11u netlink 0t0 18894 GENERIC 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 12u netlink 0t0 18895 GENERIC 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 13u netlink 0t0 18896 ROUTE 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 14r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 15r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 16u netlink 0t0 20019 KOBJECT_UEVENT 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 17u a_inode 0,14 0 1077 [eventpoll] 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 18u unix 0xffff94d3100a9980 0t0 16717 type=STREAM (CONNECTED) 2023-11-04T01:43:54.076 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 19u a_inode 0,14 0 1077 [eventpoll:21,26] 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 20w FIFO 0,24 0t0 1158 /run/systemd/inhibit/1.ref 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 21u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 23u a_inode 0,14 0 1077 [eventpoll:24,25] 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 24u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 25u pack 22837 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 733 gmain root 26u IPv4 22838 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:43:54.077 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.078 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.079 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.080 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.081 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.082 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 1u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 2u unix 0xffff94d308489100 0t0 22696 type=STREAM (CONNECTED) 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 3u a_inode 0,14 0 1077 [eventfd:6] 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 4u a_inode 0,14 0 1077 [eventfd:7] 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 5u unix 0xffff94d3101b9980 0t0 18888 type=DGRAM (UNCONNECTED) 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 6u unix 0xffff94d3101d1dc0 0t0 18889 type=STREAM (CONNECTED) 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 7u a_inode 0,14 0 1077 [eventfd:8] 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 10u netlink 0t0 18893 KOBJECT_UEVENT 2023-11-04T01:43:54.083 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 11u netlink 0t0 18894 GENERIC 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 12u netlink 0t0 18895 GENERIC 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 13u netlink 0t0 18896 ROUTE 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 14r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 15r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 16u netlink 0t0 20019 KOBJECT_UEVENT 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 17u a_inode 0,14 0 1077 [eventpoll] 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 18u unix 0xffff94d3100a9980 0t0 16717 type=STREAM (CONNECTED) 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 19u a_inode 0,14 0 1077 [eventpoll:21,26] 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 20w FIFO 0,24 0t0 1158 /run/systemd/inhibit/1.ref 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 21u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 23u a_inode 0,14 0 1077 [eventpoll:24,25] 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 24u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.084 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 25u pack 22837 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:NetworkMa 705 734 gdbus root 26u IPv4 22838 0t0 UDP smithi093.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.085 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 1u unix 0xffff94d308488cc0 0t0 22705 type=STREAM (CONNECTED) 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 2u unix 0xffff94d308488cc0 0t0 22705 type=STREAM (CONNECTED) 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 3u a_inode 0,14 0 1077 [eventfd:1] 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 4u a_inode 0,14 0 1077 [eventfd:2] 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 5u unix 0xffff94d30848a200 0t0 22721 /run/irqbalance/irqbalance708.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 root 6u unix 0xffff94d308490cc0 0t0 22920 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.086 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 1u unix 0xffff94d308488cc0 0t0 22705 type=STREAM (CONNECTED) 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 2u unix 0xffff94d308488cc0 0t0 22705 type=STREAM (CONNECTED) 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 3u a_inode 0,14 0 1077 [eventfd:1] 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 4u a_inode 0,14 0 1077 [eventfd:2] 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 5u unix 0xffff94d30848a200 0t0 22721 /run/irqbalance/irqbalance708.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:irqbalanc 708 715 gmain root 6u unix 0xffff94d308490cc0 0t0 22920 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.087 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 1u unix 0xffff94d3101d1100 0t0 18869 type=STREAM (CONNECTED) 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 2u unix 0xffff94d3101d1100 0t0 18869 type=STREAM (CONNECTED) 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 3uW REG 0,24 0 1130 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 5u unix 0xffff94d3101d72c0 0t0 18879 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:lsmd 709 libstoragemgmt 6u unix 0xffff94d3101d4c80 0t0 18880 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.088 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root 1u unix 0xffff94d308425d80 0t0 21860 type=STREAM (CONNECTED) 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root 2u unix 0xffff94d308425d80 0t0 21860 type=STREAM (CONNECTED) 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:mcelog 710 root 4u unix 0xffff94d3101d5940 0t0 18885 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.089 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.090 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.091 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.092 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.093 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.094 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 723 gmain polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.096 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.097 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.098 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 724 gdbus polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.099 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.100 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 725 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.102 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.103 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.104 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 726 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.105 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.106 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.107 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 727 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.108 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.109 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.110 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 728 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.111 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.113 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 729 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.114 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 730 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.116 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.117 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.118 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 731 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.119 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.120 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.121 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 732 JS\x20Hel polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.122 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.123 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.124 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 3r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 4u a_inode 0,14 0 1077 [eventfd:3] 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 5u a_inode 0,14 0 1077 [eventfd:4] 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 6u unix 0xffff94d307696a40 0t0 20017 type=STREAM (CONNECTED) 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 7u a_inode 0,14 0 1077 [eventfd:5] 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 8r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 9u a_inode 0,14 0 1077 [eventfd:10] 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:polkitd 711 737 polkitd polkitd 10u unix 0xffff94d30850aa80 0t0 20608 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.125 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:smartd 712 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root DEL REG 8,1 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.127 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.128 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.129 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 1u unix 0xffff94d308421100 0t0 21863 type=STREAM (CONNECTED) 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 2u unix 0xffff94d308421100 0t0 21863 type=STREAM (CONNECTED) 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 3u unix 0xffff94d308439dc0 0t0 21888 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 4u a_inode 0,14 0 1077 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 5u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 6u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 7r REG 0,21 4096 22919 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 8u netlink 0t0 21899 KOBJECT_UEVENT 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 9r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 10r FIFO 0,24 0t0 1158 /run/systemd/inhibit/1.ref 2023-11-04T01:43:54.130 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 11u netlink 0t0 21900 KOBJECT_UEVENT 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 12u netlink 0t0 21901 KOBJECT_UEVENT 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 13u netlink 0t0 21902 KOBJECT_UEVENT 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 14u unix 0xffff94d3084272c0 0t0 21903 type=STREAM (CONNECTED) 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 15u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:systemd-l 714 root 20r FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.131 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.132 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.133 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root 1u unix 0xffff94d3101d5d80 0t0 18943 type=STREAM (CONNECTED) 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root 2u unix 0xffff94d3101d5d80 0t0 18943 type=STREAM (CONNECTED) 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root 3u IPv4 18974 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 758 root 4u IPv6 18976 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.134 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.135 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.136 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.137 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.138 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 1u unix 0xffff94d310291540 0t0 20637 type=STREAM (CONNECTED) 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 2u unix 0xffff94d310291540 0t0 20637 type=STREAM (CONNECTED) 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 4u sock 0,8 0t0 18986 protocol: NETLINK 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 5u unix 0xffff94d3101d6a40 0t0 18998 type=STREAM (CONNECTED) 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 6u a_inode 0,14 0 1077 [eventfd:17] 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 7u unix 0xffff94d310290000 0t0 20659 type=STREAM (CONNECTED) 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 root 8u unix 0xffff94d310291100 0t0 20660 type=STREAM (CONNECTED) 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.139 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:43:54.140 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.141 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.142 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.143 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 1u unix 0xffff94d310291540 0t0 20637 type=STREAM (CONNECTED) 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 2u unix 0xffff94d310291540 0t0 20637 type=STREAM (CONNECTED) 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 4u sock 0,8 0t0 18986 protocol: NETLINK 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 5u unix 0xffff94d3101d6a40 0t0 18998 type=STREAM (CONNECTED) 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 6u a_inode 0,14 0 1077 [eventfd:17] 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 7u unix 0xffff94d310290000 0t0 20659 type=STREAM (CONNECTED) 2023-11-04T01:43:54.144 INFO:teuthology.orchestra.run.smithi093.stdout:tuned 761 853 tuned root 8u unix 0xffff94d310291100 0t0 20660 type=STREAM (CONNECTED) 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.145 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.146 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.147 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.148 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.149 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.150 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.151 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 773 gssproxy root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.152 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.153 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.154 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.155 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 774 gssproxy root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.156 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.157 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.158 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 775 gssproxy root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.160 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.161 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.162 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.163 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 776 gssproxy root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.164 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.165 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.166 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 1u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 2u unix 0xffff94d310291dc0 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 3u unix 0xffff94d308495500 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 4r FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 5u a_inode 0,14 0 1077 [eventpoll:4,6,7,8] 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 6u a_inode 0,14 0 1077 [eventfd:16] 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 7u unix 0xffff94d30848b740 0t0 22824 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 8u unix 0xffff94d30848d500 0t0 22825 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:gssproxy 772 777 gssproxy root 9w FIFO 0,13 0t0 22828 pipe 2023-11-04T01:43:54.167 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.168 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:atd 779 root 3uW REG 0,24 4 1181 /run/atd.pid 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.169 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 1u unix 0xffff94d3101d0cc0 0t0 18979 type=STREAM (CONNECTED) 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 2u unix 0xffff94d3101d0cc0 0t0 18979 type=STREAM (CONNECTED) 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 3uW REG 0,24 4 1180 /run/crond.pid 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 4u unix 0xffff94d30850bfc0 0t0 20650 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:crond 780 root 5r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.171 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 3u IPv4 19021 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 4u unix 0xffff94d3101bc840 0t0 19013 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:nrpe 874 nrpe 5u IPv6 19022 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.172 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1327 root 4r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.173 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:43:54.174 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:agetty 1329 root 4r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.175 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.176 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 1u unix 0xffff94d310294840 0t0 21095 type=STREAM (CONNECTED) 2023-11-04T01:43:54.177 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 2u unix 0xffff94d310294840 0t0 21095 type=STREAM (CONNECTED) 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 3u unix 0xffff94d30850ee80 0t0 21123 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 4u a_inode 0,14 0 1077 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 5u a_inode 0,14 0 1077 [signalfd] 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 6r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 7r DIR 0,25 0 3427 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 8u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 9u a_inode 0,14 0 1077 [eventpoll:10,13] 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 10r REG 0,20 0 21112 /proc/4859/mountinfo 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 11r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 12u unix 0xffff94d310296a40 0t0 21147 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 13r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:43:54.178 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 15u netlink 0t0 21129 KOBJECT_UEVENT 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 16u unix 0xffff94d30850c400 0t0 21134 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 17u unix 0xffff94d30850cc80 0t0 21135 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 18u unix 0xffff94d30850f700 0t0 21136 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 19u unix 0xffff94d310293300 0t0 21137 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 20u unix 0xffff94d310292a80 0t0 21139 type=STREAM (CONNECTED) 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:systemd 4859 ubuntu 21u a_inode 0,14 0 1077 [timerfd] 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:54.179 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.180 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.181 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.182 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 1u unix 0xffff94d310294840 0t0 21095 type=STREAM (CONNECTED) 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 2u unix 0xffff94d310294840 0t0 21095 type=STREAM (CONNECTED) 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 3u a_inode 0,14 0 1077 [eventfd:9] 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 4u a_inode 0,14 0 1077 [eventfd:11] 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 6w FIFO 0,13 0t0 21099 pipe 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:(sd-pam) 4861 ubuntu 7u unix 0xffff94d308508880 0t0 21115 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.183 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.184 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 4u unix 0xffff94d3101bd940 0t0 23949 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 5w REG 8,1 1071127 1642 /var/log/secure 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 6r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 8w REG 8,1 1444368 1641 /var/log/messages 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:43:54.185 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.186 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 4u unix 0xffff94d3101bd940 0t0 23949 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 5w REG 8,1 1071127 1642 /var/log/secure 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 6r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 8w REG 8,1 1444368 1641 /var/log/messages 2023-11-04T01:43:54.187 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5126 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.188 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 4u unix 0xffff94d3101bd940 0t0 23949 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.189 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 5w REG 8,1 1071127 1642 /var/log/secure 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 6r a_inode 0,14 0 1077 inotify 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 8w REG 8,1 1444368 1641 /var/log/messages 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:rsyslogd 5124 5127 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 6366 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 6366 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 6366 root txt unknown /proc/6366/exe 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:tls-strp 61021 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:tls-strp 61021 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:tls-strp 61021 root txt unknown /proc/61021/exe 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62652 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62652 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 62652 root txt unknown /proc/62652/exe 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100753 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.190 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100753 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100753 root txt unknown /proc/100753/exe 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100874 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100874 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100874 root txt unknown /proc/100874/exe 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100994 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100994 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 100994 root txt unknown /proc/100994/exe 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101114 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101114 root txt unknown /proc/101114/exe 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101234 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101234 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:kdmflush/ 101234 root txt unknown /proc/101234/exe 2023-11-04T01:43:54.191 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 102127 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 102127 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfsalloc 102127 root txt unknown /proc/102127/exe 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 102128 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 102128 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs_mru_c 102128 root txt unknown /proc/102128/exe 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 102129 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 102129 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 102129 root txt unknown /proc/102129/exe 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 102130 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 102130 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 102130 root txt unknown /proc/102130/exe 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 102131 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.192 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 102131 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 102131 root txt unknown /proc/102131/exe 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 102132 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 102132 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 102132 root txt unknown /proc/102132/exe 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 102133 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 102133 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 102133 root txt unknown /proc/102133/exe 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 102134 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 102134 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 102134 root txt unknown /proc/102134/exe 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 102135 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 102135 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 102135 root txt unknown /proc/102135/exe 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 102136 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.193 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 102136 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 102136 root txt unknown /proc/102136/exe 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:54.194 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:54.195 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.197 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.197 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.197 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.198 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.199 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 3u unix 0xffff94d30843bfc0 0t0 196706 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 4u IPv4 193708 0t0 TCP smithi093.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:41726 (ESTABLISHED) 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 6u unix 0xffff94d308421980 0t0 196681 type=STREAM (CONNECTED) 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 7w FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105158 root 8u unix 0xffff94d308426e80 0t0 196710 type=STREAM (CONNECTED) 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:43:54.200 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:54.201 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.202 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.203 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 3u unix 0xffff94d30843bfc0 0t0 196706 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 4u IPv4 193708 0t0 TCP smithi093.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:41726 (ESTABLISHED) 2023-11-04T01:43:54.204 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 5u unix 0xffff94d308427700 0t0 196709 type=STREAM (CONNECTED) 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 6u unix 0xffff94d308421980 0t0 196681 type=STREAM (CONNECTED) 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 7w FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 11w FIFO 0,13 0t0 209490 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 12r FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 13w FIFO 0,13 0t0 209520 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 14r FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 15r FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 16w FIFO 0,13 0t0 208845 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 17r FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 18r FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 19w FIFO 0,13 0t0 213100 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 20r FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 21r FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:54.205 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 22w FIFO 0,13 0t0 209632 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 23r FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 24r FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 25w FIFO 0,13 0t0 211148 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 26r FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 27r FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 28w FIFO 0,13 0t0 264674 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 29r FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 30r FIFO 0,13 0t0 264675 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 31w FIFO 0,13 0t0 280183 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 32r FIFO 0,13 0t0 264676 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 33r FIFO 0,13 0t0 280184 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 34w FIFO 0,13 0t0 290239 pipe 2023-11-04T01:43:54.206 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 35r FIFO 0,13 0t0 292880 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 36r FIFO 0,13 0t0 280185 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 37r FIFO 0,13 0t0 290240 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 38r FIFO 0,13 0t0 292881 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 39r FIFO 0,13 0t0 293074 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 41r FIFO 0,13 0t0 293075 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:sshd 105161 ubuntu 42r FIFO 0,13 0t0 290241 pipe 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.207 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.208 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 3u unix 0xffff94d3086ac840 0t0 191815 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 5u IPv4 191820 0t0 UDP localhost:323 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 6u IPv6 191821 0t0 UDP localhost:323 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:chronyd 105221 chrony 7u unix 0xffff94d3086a9100 0t0 191822 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph 1u unix 0xffff94d30848d940 0t0 191427 type=STREAM (CONNECTED) 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-cras 105464 ceph 2u unix 0xffff94d30848d940 0t0 191427 type=STREAM (CONNECTED) 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 105475 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 105475 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/u 105475 root txt unknown /proc/105475/exe 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106738 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106738 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106738 root txt unknown /proc/106738/exe 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106745 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106745 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 106745 root txt unknown /proc/106745/exe 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112664 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.211 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112664 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112664 root txt unknown /proc/112664/exe 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112665 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112665 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112665 root txt unknown /proc/112665/exe 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112666 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112666 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112666 root txt unknown /proc/112666/exe 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112667 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112667 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112667 root txt unknown /proc/112667/exe 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112668 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112668 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112668 root txt unknown /proc/112668/exe 2023-11-04T01:43:54.212 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112669 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112669 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112669 root txt unknown /proc/112669/exe 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112670 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112670 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112670 root txt unknown /proc/112670/exe 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112671 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112671 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112671 root txt unknown /proc/112671/exe 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112748 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112748 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112748 root txt unknown /proc/112748/exe 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112749 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112749 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.213 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112749 root txt unknown /proc/112749/exe 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112750 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112750 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112750 root txt unknown /proc/112750/exe 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112751 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112751 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112751 root txt unknown /proc/112751/exe 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112752 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112752 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112752 root txt unknown /proc/112752/exe 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112753 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112753 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112753 root txt unknown /proc/112753/exe 2023-11-04T01:43:54.214 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112754 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112754 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112754 root txt unknown /proc/112754/exe 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112755 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112755 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112755 root txt unknown /proc/112755/exe 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112832 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112832 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112832 root txt unknown /proc/112832/exe 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112833 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112833 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112833 root txt unknown /proc/112833/exe 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112834 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112834 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.215 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112834 root txt unknown /proc/112834/exe 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112835 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112835 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112835 root txt unknown /proc/112835/exe 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112836 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112836 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112836 root txt unknown /proc/112836/exe 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112837 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112837 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112837 root txt unknown /proc/112837/exe 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112838 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112838 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112838 root txt unknown /proc/112838/exe 2023-11-04T01:43:54.216 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112839 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112839 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112839 root txt unknown /proc/112839/exe 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112916 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112916 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-buf/d 112916 root txt unknown /proc/112916/exe 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112917 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112917 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-conv/ 112917 root txt unknown /proc/112917/exe 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112918 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112918 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-recla 112918 root txt unknown /proc/112918/exe 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112919 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112919 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.217 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-block 112919 root txt unknown /proc/112919/exe 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112920 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112920 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-inode 112920 root txt unknown /proc/112920/exe 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112921 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112921 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-log/d 112921 root txt unknown /proc/112921/exe 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112922 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112922 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfs-cil/d 112922 root txt unknown /proc/112922/exe 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112923 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112923 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.218 INFO:teuthology.orchestra.run.smithi093.stdout:xfsaild/d 112923 root txt unknown /proc/112923/exe 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-0 112969 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-0 112969 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-0 112969 root txt unknown /proc/112969/exe 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-1 114131 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-1 114131 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-1 114131 root txt unknown /proc/114131/exe 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-2 115294 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-2 115294 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-2 115294 root txt unknown /proc/115294/exe 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-3 116467 root cwd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-3 116467 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:dio/dm-3 116467 root txt unknown /proc/116467/exe 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.219 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:54.220 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.221 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.222 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.223 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 0r FIFO 0,13 0t0 209490 pipe 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 3r FIFO 0,13 0t0 209506 pipe 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 4w FIFO 0,13 0t0 209506 pipe 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 5u netlink 0t0 209511 AUDIT 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118266 root 6u unix 0xffff94d308494840 0t0 209512 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.224 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.225 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root 0r FIFO 0,13 0t0 209490 pipe 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118283 root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.226 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:54.227 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.228 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:54.229 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 0r FIFO 0,13 0t0 209520 pipe 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 3r FIFO 0,13 0t0 209532 pipe 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 4w FIFO 0,13 0t0 209532 pipe 2023-11-04T01:43:54.230 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 5u netlink 0t0 209537 AUDIT 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118285 root 6u unix 0xffff94d3084972c0 0t0 209538 type=DGRAM (CONNECTED) 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118321 log root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118322 service root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118323 admin_soc root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118324 signal_ha root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118326 rocksdb:l root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118327 rocksdb:h root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118343 ceph-mon root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118344 fn_monsto root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118345 msgr-work root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118346 msgr-work root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118347 msgr-work root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118348 OpHistory root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118350 fin root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118351 safe_time root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118352 cpu_tp root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118353 cpu_tp root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118354 cpu_tp root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118355 cpu_tp root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118356 ms_dispat root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118357 ms_local root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118358 safe_time root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118359 ms_dispat root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 118360 ms_local root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root txt REG 8,1 12250256 2974 /usr/bin/ceph-mon 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:54.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 1w FIFO 0,13 0t0 209491 pipe 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 2w FIFO 0,13 0t0 209492 pipe 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 3r FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 4w FIFO 0,13 0t0 207596 pipe 2023-11-04T01:43:54.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 5w REG 8,1 56791714 265460 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 6uW REG 0,24 7 1752 /run/ceph/ceph-mon.a.pid 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 7r FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 8w FIFO 0,13 0t0 207598 pipe 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 9u unix 0xffff94d3100aee80 0t0 207599 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 10r FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 11w FIFO 0,13 0t0 207600 pipe 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 15u IPv4 292928 0t0 TCP smithi093.front.sepia.ceph.com:3300->192.168.0.1:51344 (ESTABLISHED) 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 16r REG 253,4 5734720 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:43:54.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 18u a_inode 0,14 0 1077 [eventpoll:15,19,27,28,37,41,44] 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 19r FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 20w FIFO 0,13 0t0 207606 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 21u a_inode 0,14 0 1077 [eventpoll:22,34,42,45] 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 22r FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 23w FIFO 0,13 0t0 207607 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 24u a_inode 0,14 0 1077 [eventpoll:25,38,39,43,46] 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 25r FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 26w FIFO 0,13 0t0 207608 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 27u IPv4 203661 0t0 TCP smithi093.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 28u IPv4 203662 0t0 TCP smithi093.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 29w REG 8,1 188194 265463 /var/log/ceph/ceph.audit.log 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 30r FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 31w FIFO 0,13 0t0 209559 pipe 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 32r FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 33w FIFO 0,13 0t0 209560 pipe 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 34u IPv4 214280 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40670 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 35r FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 36w FIFO 0,13 0t0 209561 pipe 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 37u IPv4 203683 0t0 TCP smithi093.front.sepia.ceph.com:60106->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 38u IPv4 212282 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40692 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 39u IPv4 207612 0t0 TCP smithi093.front.sepia.ceph.com:57746->smithi125.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 40w REG 8,1 101472 265461 /var/log/ceph/ceph.log 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 41u IPv4 211432 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:40702 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 42u IPv4 210621 0t0 TCP smithi093.front.sepia.ceph.com:56992->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 43u IPv4 211486 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46490 (ESTABLISHED) 2023-11-04T01:43:54.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 44u IPv4 211489 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46500 (ESTABLISHED) 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 45u IPv4 207673 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:46542 (ESTABLISHED) 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 46u IPv4 281155 0t0 TCP smithi093.front.sepia.ceph.com:3300->smithi093.front.sepia.ceph.com:57700 (ESTABLISHED) 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mon 118297 152652 rstore_co root 49w REG 253,4 1880093 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.449 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.450 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root 0r FIFO 0,13 0t0 209520 pipe 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118319 root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 14w REG 8,1 8925651 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118362 log root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 14w REG 8,1 8925651 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118364 msgr-work root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118365 msgr-work root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118366 msgr-work root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118390 service root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118391 admin_soc root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118392 ceph_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118393 fn_anonym root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118394 signal_ha root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118395 mgrsb-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118396 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 14w REG 8,1 8925844 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118397 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118398 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118399 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118400 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118401 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118402 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118403 fn_anonym root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118404 flusher root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118405 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118753 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118754 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118755 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118756 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118757 cmdfin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118761 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118762 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118763 ceph_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118764 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118765 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118766 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118767 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:54.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:54.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:54.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:54.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:54.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:54.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:54.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118768 balancer root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:54.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:54.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:54.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:54.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:54.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:54.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118769 m-fin-bal root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118770 crash root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118771 m-fin-cra root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118772 devicehea root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118773 m-fin-dev root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118775 m-fin-ios root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118777 m-fin-nfs root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118779 m-fin-orc root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118780 pg_autosc root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118781 m-fin-pg_ root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118782 progress root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118783 m-fin-pro root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118787 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118788 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118789 ceph_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118790 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118791 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118792 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118793 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118794 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118796 m-fin-rbd root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118797 restful root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118798 m-fin-res root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118800 m-fin-sta root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118801 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118802 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118803 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118804 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118805 telemetry root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118806 m-fin-tel root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118807 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118811 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118812 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118813 ceph_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118814 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118815 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118816 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118817 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118818 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118819 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118820 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118821 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118822 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118823 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118824 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118825 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118826 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118827 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118828 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118829 mgr-fin root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 118831 m-fin-vol root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123870 devicehea root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123874 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123875 io_contex root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123876 ceph_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123877 ms_dispat root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123878 ms_local root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123879 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root txt REG 8,1 4625312 2814 /usr/bin/ceph-mgr 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 65240 274222 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 783584 273557 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 60264 273562 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 331936 273535 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 237384 273537 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 654400 273568 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 41112936 2621 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 70784 273559 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 87608 273560 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 177920 273563 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 7042240 272926 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 96304 273558 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 155704 273445 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 2883920 2335 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 3870704 2633 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 3784896 272976 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 73976 273343 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 132136 272975 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 40328 272924 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 382824 272927 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 299952 2331 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 20504 273446 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 8003360 1562 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1129568 2782 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 721976 270389 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 2154416 270391 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 16192 266083 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 2103760 1902 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 515320 2344 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 198136 2438 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 49328 270928 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1129032 1904 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1892920 1558 /usr/lib64/librados.so.2.0.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 435816 2194 /usr/lib64/libcephsqlite.so 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 1w FIFO 0,13 0t0 209521 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 2w FIFO 0,13 0t0 209522 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 3r FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 4w FIFO 0,13 0t0 213087 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,24,28,29,33,36,39,41,42,48,51,56,59,62,65,68] 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 6r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 7w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:43:55.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,34,37,40,43,46,49,52,54,57,60,63,67,69] 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 9r FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 10w FIFO 0,13 0t0 213090 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,35,38,44,45,47,50,53,55,58,61,64] 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 12r FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 13w FIFO 0,13 0t0 213091 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 14w REG 8,1 8926592 265462 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 15uW REG 0,24 7 1755 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 16r FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 17w FIFO 0,13 0t0 209568 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 18u unix 0xffff94d30848aa80 0t0 209569 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 19r FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 20w FIFO 0,13 0t0 209573 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 21r FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 22w FIFO 0,13 0t0 209574 pipe 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 23r FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 24u IPv4 210578 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 25w FIFO 0,13 0t0 211429 pipe 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 26r FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 27w FIFO 0,13 0t0 211430 pipe 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 28u IPv4 210612 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 29u IPv4 210545 0t0 TCP smithi093.front.sepia.ceph.com:40670->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 30u IPv4 207619 0t0 TCP smithi093.front.sepia.ceph.com:40692->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 31u IPv4 214291 0t0 TCP smithi093.front.sepia.ceph.com:56964->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 32u IPv4 215081 0t0 TCP smithi093.front.sepia.ceph.com:40702->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 33u IPv4 207620 0t0 TCP smithi093.front.sepia.ceph.com:60310->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 34u IPv4 211435 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-04T01:43:55.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 35u IPv4 214292 0t0 TCP smithi093.front.sepia.ceph.com:56980->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 36u IPv4 211438 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56980 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 37u IPv4 209809 0t0 TCP smithi093.front.sepia.ceph.com:56984->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 38u IPv4 211441 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56984 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 39u IPv4 211444 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:56992 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 40u IPv4 211445 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45046 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 41u IPv4 211544 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45208 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 42u IPv4 211451 0t0 TCP smithi093.front.sepia.ceph.com:57002->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 43u IPv4 211452 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45070 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 44u IPv4 211453 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57002 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 45u IPv4 209817 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 46u IPv4 211547 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 47u IPv4 211550 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57158 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 48u IPv4 213273 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57172 (ESTABLISHED) 2023-11-04T01:43:55.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 49u IPv4 213276 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45226 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 50u IPv4 213279 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:45240 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 51u IPv4 213282 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57176 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 52u IPv4 213285 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57186 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 53u IPv4 211556 0t0 TCP smithi093.front.sepia.ceph.com:38672->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 54u IPv4 213289 0t0 TCP smithi093.front.sepia.ceph.com:46542->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 55u IPv4 213290 0t0 TCP smithi093.front.sepia.ceph.com:57196->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 56u IPv4 212362 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:57196 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 57u IPv4 215179 0t0 TCP smithi093.front.sepia.ceph.com:38682->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 58u IPv4 213291 0t0 TCP smithi093.front.sepia.ceph.com:38522->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 59u IPv4 212376 0t0 TCP smithi093.front.sepia.ceph.com:43788->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 60u IPv4 213292 0t0 TCP smithi093.front.sepia.ceph.com:40388->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 61u IPv4 213293 0t0 TCP smithi093.front.sepia.ceph.com:58696->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 62u IPv4 212429 0t0 TCP smithi093.front.sepia.ceph.com:39078->smithi125.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 63u IPv4 213306 0t0 TCP smithi093.front.sepia.ceph.com:47570->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:43:55.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 64u IPv4 209911 0t0 TCP smithi093.front.sepia.ceph.com:59274->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 65u IPv4 212430 0t0 TCP smithi093.front.sepia.ceph.com:35102->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 67u IPv4 285719 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:51454 (ESTABLISHED) 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 68u IPv4 262589 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi093.front.sepia.ceph.com:59314 (ESTABLISHED) 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mgr 118361 123880 safe_time root 69u IPv4 288775 0t0 TCP smithi093.front.sepia.ceph.com:6832->smithi125.front.sepia.ceph.com:51948 (ESTABLISHED) 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:55.964 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.965 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.966 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:55.967 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 0r FIFO 0,13 0t0 208845 pipe 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 3r FIFO 0,13 0t0 208857 pipe 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 4w FIFO 0,13 0t0 208857 pipe 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 5u netlink 0t0 208862 AUDIT 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118481 root 6u unix 0xffff94d30843aec0 0t0 208863 type=DGRAM (CONNECTED) 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:55.969 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.970 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.971 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:55.972 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.973 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 0r FIFO 0,13 0t0 213100 pipe 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 3r FIFO 0,13 0t0 209640 pipe 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 4w FIFO 0,13 0t0 209640 pipe 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 5u netlink 0t0 209654 AUDIT 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118484 root 6u unix 0xffff94d308493b80 0t0 209655 type=DGRAM (CONNECTED) 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.974 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:55.975 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.976 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:55.977 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.978 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 0r FIFO 0,13 0t0 209632 pipe 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 3r FIFO 0,13 0t0 210452 pipe 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 4w FIFO 0,13 0t0 210452 pipe 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 5u netlink 0t0 210458 AUDIT 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118511 root 6u unix 0xffff94d3086a8000 0t0 210459 type=DGRAM (CONNECTED) 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.980 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root 0r FIFO 0,13 0t0 208845 pipe 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118531 root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:43:55.981 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.982 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.983 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:43:55.984 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:43:55.985 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 0r FIFO 0,13 0t0 211148 pipe 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 3r FIFO 0,13 0t0 208882 pipe 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 4w FIFO 0,13 0t0 208882 pipe 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 5u netlink 0t0 208887 AUDIT 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 118533 root 6u unix 0xffff94d308438000 0t0 208888 type=DGRAM (CONNECTED) 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:55.986 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.987 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root 0r FIFO 0,13 0t0 213100 pipe 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118535 root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.988 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.989 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root 0r FIFO 0,13 0t0 209632 pipe 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118552 root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:43:55.990 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.991 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root 0r FIFO 0,13 0t0 211148 pipe 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 118555 root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:55.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:55.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:55.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:55.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:55.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:55.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:55.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:55.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118575 log root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118577 msgr-work root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118578 msgr-work root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118579 msgr-work root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118592 service root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118593 admin_soc root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118654 signal_ha root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118655 io_contex root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118656 io_contex root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118667 OpHistory root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 14w REG 8,1 145205705 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118668 ceph_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118729 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118739 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118747 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118834 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118842 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118850 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 118858 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119057 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119059 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119061 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119064 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119065 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119067 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119070 fn_anonym root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119075 rocksdb:l root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119078 rocksdb:l root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119079 rocksdb:l root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 119082 rocksdb:h root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 120546 bstore_ai root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121317 bstore_ai root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121679 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121680 cfin root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121681 bstore_kv root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121682 bstore_kv root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 14w REG 8,1 145205988 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121683 bstore_me root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121689 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121690 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121691 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121692 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121693 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121694 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121695 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121696 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121697 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121698 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121699 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121700 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121701 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121702 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121703 ms_dispat root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121704 ms_local root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121705 fn_anonym root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121706 finisher root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121707 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121708 safe_time root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121709 ceph-osd root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121710 osd_srv_a root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121711 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121712 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121713 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 14w REG 8,1 145206271 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121714 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121715 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121716 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:56.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:56.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:56.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121717 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:56.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:56.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:56.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:56.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:56.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:56.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:56.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:56.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121718 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121719 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121720 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121721 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121722 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121723 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121724 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121725 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121726 tp_osd_tp root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root DEL REG 0,17 214310 /[aio] 2023-11-04T01:43:57.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root DEL REG 0,17 212292 /[aio] 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 1w FIFO 0,13 0t0 208846 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 2w FIFO 0,13 0t0 208847 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 3r FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 4w FIFO 0,13 0t0 214024 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,73,74,79,82,85,88,91,94,98] 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 6r FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 7w FIFO 0,13 0t0 214026 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,66,67,75,76,77,80,83,86,89,92,95,97,100] 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 9r FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 10w FIFO 0,13 0t0 214027 pipe 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 11u a_inode 0,14 0 1077 [eventpoll:12,59,65,69,71,72,78,81,84,87,90,93,96,101] 2023-11-04T01:43:57.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 12r FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 13w FIFO 0,13 0t0 214028 pipe 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 14w REG 8,1 145206554 265456 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 15uW REG 0,24 7 1757 /run/ceph/ceph-osd.0.pid 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 16r FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 17w FIFO 0,13 0t0 203733 pipe 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 18u unix 0xffff94d310292200 0t0 203734 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 19u IPv4 209705 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 20u IPv4 209715 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 21u IPv4 209726 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 22u IPv4 209738 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 23u IPv4 209751 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 24u IPv4 209765 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:43:57.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 25u IPv4 209780 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 26u IPv4 209796 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 27r FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 28w FIFO 0,13 0t0 214078 pipe 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 29r FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 30w FIFO 0,13 0t0 214079 pipe 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 31u sock 0,8 0t0 214298 protocol: UDPv6 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 58r FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 59u IPv4 215113 0t0 TCP smithi093.front.sepia.ceph.com:46500->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 60w FIFO 0,13 0t0 212308 pipe 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 61r FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 62w FIFO 0,13 0t0 212309 pipe 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 63u IPv4 209846 0t0 TCP smithi093.front.sepia.ceph.com:40448->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:57.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 64u IPv4 212319 0t0 TCP smithi093.front.sepia.ceph.com:44792->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 65u IPv4 214326 0t0 TCP smithi093.front.sepia.ceph.com:49242->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 66u IPv4 209847 0t0 TCP smithi093.front.sepia.ceph.com:52102->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 67u IPv4 209848 0t0 TCP smithi093.front.sepia.ceph.com:55356->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 68u IPv4 212320 0t0 TCP smithi093.front.sepia.ceph.com:43746->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 69u IPv4 215138 0t0 TCP smithi093.front.sepia.ceph.com:60852->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 70u IPv4 212321 0t0 TCP smithi093.front.sepia.ceph.com:59256->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 71u IPv4 215139 0t0 TCP smithi093.front.sepia.ceph.com:51462->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 72u IPv4 215140 0t0 TCP smithi093.front.sepia.ceph.com:38024->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 73u IPv4 212322 0t0 TCP smithi093.front.sepia.ceph.com:54598->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 74u IPv4 212323 0t0 TCP smithi093.front.sepia.ceph.com:42992->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 75u IPv4 214327 0t0 TCP smithi093.front.sepia.ceph.com:47002->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 76u IPv4 214328 0t0 TCP smithi093.front.sepia.ceph.com:53342->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 77u IPv4 212324 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52624 (ESTABLISHED) 2023-11-04T01:43:57.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 78u IPv4 212327 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57052 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 79u IPv4 212330 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50436 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 80u IPv4 212333 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47360 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 81u IPv4 210658 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52630 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 82u IPv4 212342 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57064 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 83u IPv4 213241 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57068 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 84u IPv4 213244 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52646 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 85u IPv4 213247 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi125.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 86u IPv4 213250 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi125.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 87u IPv4 213253 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47368 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 88u IPv4 213256 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50452 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 89u IPv4 210664 0t0 TCP smithi093.front.sepia.ceph.com:6814->smithi093.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 90u IPv4 212350 0t0 TCP smithi093.front.sepia.ceph.com:6812->smithi093.front.sepia.ceph.com:50466 (ESTABLISHED) 2023-11-04T01:43:57.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 91u IPv4 212359 0t0 TCP smithi093.front.sepia.ceph.com:57176->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 92u IPv4 215167 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57758 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 93u IPv4 215170 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35444 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 94u IPv4 209875 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:38522 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 95u IPv4 210676 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35456 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 96u IPv4 209869 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:57764 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 97u IPv4 211566 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi093.front.sepia.ceph.com:35470 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 98u IPv4 284407 0t0 TCP smithi093.front.sepia.ceph.com:6808->smithi093.front.sepia.ceph.com:55126 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 100u IPv4 212400 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34308 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118558 121727 osd_srv_h root 101u IPv4 212401 0t0 TCP smithi093.front.sepia.ceph.com:6810->smithi125.front.sepia.ceph.com:34312 (ESTABLISHED) 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118583 log root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118585 msgr-work root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118586 msgr-work root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118587 msgr-work root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118597 service root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118598 admin_soc root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118651 signal_ha root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118652 io_contex root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118653 io_contex root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118670 OpHistory root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118671 ceph_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118726 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118737 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118745 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118832 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118840 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 14w REG 8,1 130917807 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118848 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118856 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118864 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118865 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118866 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118867 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118868 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118869 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118870 fn_anonym root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118873 rocksdb:l root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118874 rocksdb:l root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118875 rocksdb:l root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 118876 rocksdb:h root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 120364 bstore_ai root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121092 bstore_ai root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121273 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121274 cfin root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121275 bstore_kv root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121276 bstore_kv root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121277 bstore_me root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121278 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121279 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121280 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121281 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121282 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121283 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 14w REG 8,1 130918090 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121284 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121285 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121286 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121287 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121288 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121289 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121290 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121291 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121292 ms_dispat root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121293 ms_local root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 14w REG 8,1 130918373 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121294 fn_anonym root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 14w REG 8,1 130931309 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121295 finisher root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 14w REG 8,1 130946566 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:57.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121296 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:57.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:57.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:57.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:57.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:57.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:57.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:57.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 14w REG 8,1 130957472 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:57.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:57.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:57.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121297 safe_time root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 14w REG 8,1 130957472 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121298 ceph-osd root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 14w REG 8,1 130957472 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121299 osd_srv_a root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 14w REG 8,1 130966122 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121300 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 14w REG 8,1 130966122 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121301 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 14w REG 8,1 130966122 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121302 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 14w REG 8,1 130971588 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121303 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121304 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121305 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121306 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121307 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121308 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 14w REG 8,1 130982520 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121309 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121310 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121311 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121312 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121313 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121314 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121315 tp_osd_tp root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root DEL REG 0,17 211485 /[aio] 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root DEL REG 0,17 211483 /[aio] 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 1w FIFO 0,13 0t0 213101 pipe 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 2w FIFO 0,13 0t0 213102 pipe 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 3r FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 4w FIFO 0,13 0t0 210482 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,73,76,77,78,79,80,91,95,97,103] 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 6r FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 7w FIFO 0,13 0t0 210484 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,65,68,71,74,81,82,83,84,86,92,99,100] 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 9r FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 10w FIFO 0,13 0t0 210485 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 11u a_inode 0,14 0 1077 [eventpoll:12,64,66,69,72,75,85,87,88,89,90,93,94,96] 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 12r FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 13w FIFO 0,13 0t0 210486 pipe 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 14w REG 8,1 130982803 265457 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:43:58.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 15uW REG 0,24 7 1759 /run/ceph/ceph-osd.1.pid 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 16r FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 17w FIFO 0,13 0t0 213132 pipe 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 18u unix 0xffff94d3103e7b40 0t0 213133 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 19u IPv4 214039 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 20u IPv4 214041 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 21u IPv4 214044 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 22u IPv4 214048 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 23u IPv4 214053 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 24u IPv4 214059 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 25u IPv4 214066 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 26u IPv4 214074 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 27r FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 28w FIFO 0,13 0t0 213151 pipe 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 29r FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 30w FIFO 0,13 0t0 213152 pipe 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 31u sock 0,8 0t0 211461 protocol: UDPv6 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 58r FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 59w FIFO 0,13 0t0 215122 pipe 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 60u IPv4 212294 0t0 TCP smithi093.front.sepia.ceph.com:46490->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 61r FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 62w FIFO 0,13 0t0 215123 pipe 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 63u IPv4 211529 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40448 (ESTABLISHED) 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 64u IPv4 211532 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44792 (ESTABLISHED) 2023-11-04T01:43:58.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 65u IPv4 210651 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47352 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 66u IPv4 210652 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40452 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 67u IPv4 210655 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51138 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 68u IPv4 215155 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44794 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 69u IPv4 215156 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51144 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 70u IPv4 215159 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47356 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 71u IPv4 214330 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi093.front.sepia.ceph.com:40466 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 72u IPv4 214333 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi093.front.sepia.ceph.com:44796 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 73u IPv4 214336 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51154 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 74u IPv4 214339 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47372 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 75u IPv4 213259 0t0 TCP smithi093.front.sepia.ceph.com:6806->smithi125.front.sepia.ceph.com:47380 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 76u IPv4 213262 0t0 TCP smithi093.front.sepia.ceph.com:6804->smithi125.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-04T01:43:58.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 77u IPv4 213265 0t0 TCP smithi093.front.sepia.ceph.com:60860->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 78u IPv4 213266 0t0 TCP smithi093.front.sepia.ceph.com:43018->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 79u IPv4 213267 0t0 TCP smithi093.front.sepia.ceph.com:52128->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 80u IPv4 213268 0t0 TCP smithi093.front.sepia.ceph.com:53376->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 81u IPv4 214356 0t0 TCP smithi093.front.sepia.ceph.com:47372->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 82u IPv4 214357 0t0 TCP smithi093.front.sepia.ceph.com:59272->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 83u IPv4 214358 0t0 TCP smithi093.front.sepia.ceph.com:47016->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 84u IPv4 214359 0t0 TCP smithi093.front.sepia.ceph.com:49264->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 85u IPv4 209856 0t0 TCP smithi093.front.sepia.ceph.com:50466->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 86u IPv4 214360 0t0 TCP smithi093.front.sepia.ceph.com:43774->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 87u IPv4 209857 0t0 TCP smithi093.front.sepia.ceph.com:38046->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 88u IPv4 209858 0t0 TCP smithi093.front.sepia.ceph.com:51476->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 89u IPv4 209859 0t0 TCP smithi093.front.sepia.ceph.com:54636->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 90u IPv4 209860 0t0 TCP smithi093.front.sepia.ceph.com:55392->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 91u IPv4 207652 0t0 TCP smithi093.front.sepia.ceph.com:57710->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 92u IPv4 212358 0t0 TCP smithi093.front.sepia.ceph.com:57158->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 93u IPv4 209862 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50420 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 94u IPv4 211561 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:43788 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 95u IPv4 207659 0t0 TCP smithi093.front.sepia.ceph.com:35456->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 96u IPv4 207660 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi093.front.sepia.ceph.com:50434 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 97u IPv4 286262 0t0 TCP smithi093.front.sepia.ceph.com:6800->smithi093.front.sepia.ceph.com:35596 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 99u IPv4 211554 0t0 TCP smithi093.front.sepia.ceph.com:55818->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 100u IPv4 207664 0t0 TCP smithi093.front.sepia.ceph.com:6802->smithi125.front.sepia.ceph.com:48252 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118559 121316 osd_srv_h root 103u IPv4 207669 0t0 TCP smithi093.front.sepia.ceph.com:36054->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118605 log root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118607 msgr-work root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118608 msgr-work root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118609 msgr-work root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118613 service root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118614 admin_soc root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118659 signal_ha root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118660 io_contex root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118661 io_contex root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118673 OpHistory root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118674 ceph_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 14w REG 8,1 124071814 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118731 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118741 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118749 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118836 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118844 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118852 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 118860 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119058 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119060 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119062 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119063 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119066 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119068 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119069 fn_anonym root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119076 rocksdb:l root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119077 rocksdb:l root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119080 rocksdb:l root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 119081 rocksdb:h root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 120547 bstore_ai root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121360 bstore_ai root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121684 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121685 cfin root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121686 bstore_kv root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121687 bstore_kv root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121688 bstore_me root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121728 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 14w REG 8,1 124072097 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121729 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121730 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121731 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121732 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121733 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121734 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121735 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121736 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121737 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:58.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:58.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:58.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:58.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:58.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:58.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:58.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:58.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:58.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:58.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121738 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:58.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:58.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121739 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121740 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121741 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121742 ms_dispat root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121743 ms_local root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121744 fn_anonym root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121745 finisher root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121746 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121747 safe_time root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.128 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121748 ceph-osd root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121749 osd_srv_a root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121750 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121751 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121752 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121753 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121754 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 14w REG 8,1 124072380 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121755 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121756 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121757 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121758 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121759 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121760 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121761 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121762 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121763 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121764 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121765 tp_osd_tp root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root DEL REG 0,17 209822 /[aio] 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root DEL REG 0,17 215110 /[aio] 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 1w FIFO 0,13 0t0 209633 pipe 2023-11-04T01:43:59.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 2w FIFO 0,13 0t0 209634 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 3r FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 4w FIFO 0,13 0t0 210496 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,76,78,79,80,82,88,91,95,97,103] 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 6r FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 7w FIFO 0,13 0t0 210498 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 8u a_inode 0,14 0 1077 [eventpoll:9,58,65,68,71,74,77,83,84,85,89,92,93,98] 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 9r FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 10w FIFO 0,13 0t0 210499 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 11u a_inode 0,14 0 1077 [eventpoll:12,61,66,69,72,73,75,81,86,87,90,94,96,101] 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 12r FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 13w FIFO 0,13 0t0 210500 pipe 2023-11-04T01:43:59.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 14w REG 8,1 124072663 265458 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 15uW REG 0,24 7 1761 /run/ceph/ceph-osd.2.pid 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 16r FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 17w FIFO 0,13 0t0 210509 pipe 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 18u unix 0xffff94d302a0bfc0 0t0 210510 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 19u IPv4 212127 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 20u IPv4 212145 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 21u IPv4 212164 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 22u IPv4 212184 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 23u IPv4 212205 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 24u IPv4 212227 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 25u IPv4 212250 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 26u IPv4 212274 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 27r FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 28w FIFO 0,13 0t0 203749 pipe 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 29r FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 30w FIFO 0,13 0t0 203750 pipe 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 31u sock 0,8 0t0 215099 protocol: UDPv6 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 58u IPv4 213174 0t0 TCP smithi093.front.sepia.ceph.com:55188->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 59r FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 60w FIFO 0,13 0t0 215128 pipe 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 61u IPv4 210645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59256 (ESTABLISHED) 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 62r FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 63w FIFO 0,13 0t0 215129 pipe 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 64u IPv4 210648 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60852 (ESTABLISHED) 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 65u IPv4 213223 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45762 (ESTABLISHED) 2023-11-04T01:43:59.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 66u IPv4 213226 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60854 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 67u IPv4 213229 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47258 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 68u IPv4 213232 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59266 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 69u IPv4 213235 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47270 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 70u IPv4 213238 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45776 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 71u IPv4 214329 0t0 TCP smithi093.front.sepia.ceph.com:40466->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 72u IPv4 207635 0t0 TCP smithi093.front.sepia.ceph.com:44796->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 73u IPv4 207636 0t0 TCP smithi093.front.sepia.ceph.com:54620->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 74u IPv4 215162 0t0 TCP smithi093.front.sepia.ceph.com:51474->smithi093.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 75u IPv4 207637 0t0 TCP smithi093.front.sepia.ceph.com:49260->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 76u IPv4 207638 0t0 TCP smithi093.front.sepia.ceph.com:47010->smithi093.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 77u IPv4 215163 0t0 TCP smithi093.front.sepia.ceph.com:52124->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 78u IPv4 207639 0t0 TCP smithi093.front.sepia.ceph.com:53360->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 79u IPv4 207640 0t0 TCP smithi093.front.sepia.ceph.com:38044->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 80u IPv4 207641 0t0 TCP smithi093.front.sepia.ceph.com:55380->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 81u IPv4 207642 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47272 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 82u IPv4 207645 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45792 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 83u IPv4 215164 0t0 TCP smithi093.front.sepia.ceph.com:43008->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 84u IPv4 215165 0t0 TCP smithi093.front.sepia.ceph.com:47368->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 85u IPv4 215166 0t0 TCP smithi093.front.sepia.ceph.com:50452->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 86u IPv4 207648 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi125.front.sepia.ceph.com:45798 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 87u IPv4 207651 0t0 TCP smithi093.front.sepia.ceph.com:43770->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 88u IPv4 212345 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi125.front.sepia.ceph.com:47274 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 89u IPv4 210661 0t0 TCP smithi093.front.sepia.ceph.com:6822->smithi093.front.sepia.ceph.com:60860 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 90u IPv4 210665 0t0 TCP smithi093.front.sepia.ceph.com:6820->smithi093.front.sepia.ceph.com:59272 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 91u IPv4 213269 0t0 TCP smithi093.front.sepia.ceph.com:57708->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 92u IPv4 210674 0t0 TCP smithi093.front.sepia.ceph.com:57172->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 93u IPv4 211543 0t0 TCP smithi093.front.sepia.ceph.com:50420->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 94u IPv4 207712 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:40388 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 95u IPv4 287023 0t0 TCP smithi093.front.sepia.ceph.com:6816->smithi093.front.sepia.ceph.com:46188 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 96u IPv4 209865 0t0 TCP smithi093.front.sepia.ceph.com:35998->smithi093.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 97u IPv4 207658 0t0 TCP smithi093.front.sepia.ceph.com:35444->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 98u IPv4 210673 0t0 TCP smithi093.front.sepia.ceph.com:55810->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 101u IPv4 215174 0t0 TCP smithi093.front.sepia.ceph.com:6818->smithi125.front.sepia.ceph.com:55564 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118591 121766 osd_srv_h root 103u IPv4 215178 0t0 TCP smithi093.front.sepia.ceph.com:36038->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118617 log root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118619 msgr-work root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118620 msgr-work root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118621 msgr-work root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118625 service root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118626 admin_soc root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.541 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.542 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.543 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.544 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.545 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.546 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.547 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.548 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.549 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118663 signal_ha root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118664 io_contex root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.582 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.583 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.584 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.585 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118665 io_contex root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.586 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.587 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.588 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.591 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.592 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.593 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118676 OpHistory root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118677 ceph_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118733 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118743 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 14w REG 8,1 135526926 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118751 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.666 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.667 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.668 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.669 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.670 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.671 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.672 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118838 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.673 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118846 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118854 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 118862 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119443 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119444 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119445 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119446 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119447 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119448 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119449 fn_anonym root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119452 rocksdb:l root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119453 rocksdb:l root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.851 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.852 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.853 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.854 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.855 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.856 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.857 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.858 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.859 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.861 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.862 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.863 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.864 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119454 rocksdb:l root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 119455 rocksdb:h root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 120910 bstore_ai root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121767 bstore_ai root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 14w REG 8,1 135527208 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121948 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121949 cfin root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.944 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121950 bstore_kv root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121951 bstore_kv root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121952 bstore_me root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:43:59.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:43:59.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:43:59.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:43:59.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:43:59.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:43:59.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:43:59.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:43:59.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:43:59.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:43:59.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121953 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:43:59.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:43:59.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:43:59.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121954 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.017 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.018 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.019 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.020 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.021 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.022 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.023 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.024 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.025 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121955 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.027 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.028 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.029 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.030 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.031 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.032 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.039 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.040 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121956 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.041 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.042 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.043 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.044 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.045 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.046 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.047 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 14w REG 8,1 135527421 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121957 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.061 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.063 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.064 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.065 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.066 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.067 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.068 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.069 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121958 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.070 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.071 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.072 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.073 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.074 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.075 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.076 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.077 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.078 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.079 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.080 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.081 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.082 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.083 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.084 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121959 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.085 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.086 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.087 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.088 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.089 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.090 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.091 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.092 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.093 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.094 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.095 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.096 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.097 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.098 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.099 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121960 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.100 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.101 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.102 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.103 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.104 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.105 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.106 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.107 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.108 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.109 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.110 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.112 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.113 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121961 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.114 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.115 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.116 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.117 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.118 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.119 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.120 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.121 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.122 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.123 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.124 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.125 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.126 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.127 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121962 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.129 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.130 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.131 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.132 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.133 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.134 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.135 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.136 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.137 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.138 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.139 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.140 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.141 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.142 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121963 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.143 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.144 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.145 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.146 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.147 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.148 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.150 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.151 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.152 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.153 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.154 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.155 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.156 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.157 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121964 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.158 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.159 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.160 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.161 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.162 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.163 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.164 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.165 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.166 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.167 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.168 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.169 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.170 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.171 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121965 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.172 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.173 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.174 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.175 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.176 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.177 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.178 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.179 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.180 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.181 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.182 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.183 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.184 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.185 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.186 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121966 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.187 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.188 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.189 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.190 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.191 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.192 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.193 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.194 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.197 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.198 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.199 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.200 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121967 ms_dispat root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.201 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.202 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.203 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.205 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.206 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.207 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.208 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.209 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.210 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.211 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.212 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.213 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.214 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121968 ms_local root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.215 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.216 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.217 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.218 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.219 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.221 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.225 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.228 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121969 fn_anonym root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.229 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.230 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.231 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.232 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.233 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.234 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.235 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.236 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.237 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.238 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.239 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.240 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.241 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.242 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121970 finisher root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.243 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.244 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.245 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.246 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.247 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.248 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.249 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.250 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.251 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.252 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.253 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.254 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.255 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121971 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.256 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.257 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.258 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.259 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.260 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.261 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.262 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.263 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.264 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.265 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.266 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.267 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.268 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.269 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121972 safe_time root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.270 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.271 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.272 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.273 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.274 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.275 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.276 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.277 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.279 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.280 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.281 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.282 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.283 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121973 ceph-osd root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.284 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.285 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.286 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.287 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.288 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.289 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.290 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.291 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.292 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.293 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.294 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.295 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.296 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.297 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.298 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121974 osd_srv_a root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.299 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.300 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.301 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.302 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.303 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.304 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.305 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.306 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.307 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.308 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.309 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.310 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.311 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.312 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121975 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.313 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.314 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.315 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.316 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.317 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.318 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.319 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.320 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.321 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.323 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.324 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.325 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.326 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121976 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.327 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.328 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.329 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.330 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.331 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.332 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.333 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.334 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.335 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.336 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.337 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.338 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.339 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121977 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.340 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.341 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.342 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.343 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.344 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.345 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.346 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.347 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.348 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.349 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.350 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.351 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.352 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.353 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.354 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121978 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.355 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.356 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.357 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.358 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.359 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.360 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.361 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.362 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.363 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.364 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.365 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.366 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.367 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121979 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.376 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.382 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.383 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121980 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.385 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.386 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.387 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.388 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.389 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.390 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.391 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.392 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.393 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.394 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.395 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.396 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.397 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121981 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.398 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.400 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.401 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.402 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.403 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.404 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.405 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.406 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.407 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.408 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.409 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121982 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.412 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.416 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.417 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 14w REG 8,1 135527703 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.422 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.424 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.425 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121983 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.426 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.427 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.428 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.429 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.430 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.431 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.432 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.433 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.434 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.435 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.436 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.437 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.438 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.439 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121984 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.440 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.441 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.442 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.443 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.444 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.445 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.446 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.447 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.448 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.449 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.450 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.451 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.452 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.453 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121985 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.454 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.455 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.456 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.458 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.459 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.460 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.461 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.462 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.463 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.464 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.465 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.466 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121986 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.467 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.468 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.469 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.470 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.471 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.472 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.473 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.474 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.475 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.476 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.478 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.479 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.480 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.481 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121987 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.482 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.483 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.484 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.485 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.486 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.487 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.488 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.489 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.491 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.492 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.493 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.494 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121988 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.495 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.496 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.498 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.501 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.505 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121989 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.510 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.511 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.513 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.514 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.515 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.516 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.517 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.518 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.519 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.520 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.521 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.522 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.523 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121990 tp_osd_tp root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root txt REG 8,1 25615776 2955 /usr/bin/ceph-osd 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 74496 276307 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 116440 276334 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 128888 276286 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 91248 276322 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:00.524 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 83008 276304 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 49424 276310 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 1350912 276331 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 224600 276298 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 864280 276328 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 45176 276343 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 65968 276346 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 74936 276289 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 41168 276292 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 36976 276349 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 70536 276295 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 69736 2328 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 70424 276319 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:00.525 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 409304 276325 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 37064 276301 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 32512 276316 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 32664 276257 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root DEL REG 0,17 212296 /[aio] 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root DEL REG 0,17 209820 /[aio] 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 1469128 276276 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 353384 276272 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 74672 276282 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.526 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.528 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.529 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 1w FIFO 0,13 0t0 211149 pipe 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 2w FIFO 0,13 0t0 211150 pipe 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 3r FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 4w FIFO 0,13 0t0 211178 pipe 2023-11-04T01:44:00.530 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,21,22,23,24,25,26,66,69,72,73,74,76,82,85,88,91,94,97,100] 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 6r FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 7w FIFO 0,13 0t0 211180 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 8u a_inode 0,14 0 1077 [eventpoll:9,63,64,65,77,78,79,80,83,86,89,92,95,99] 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 9r FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 10w FIFO 0,13 0t0 211181 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 11u a_inode 0,14 0 1077 [eventpoll:12,59,67,68,70,71,75,81,84,87,90,93,96,98] 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 12r FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 13w FIFO 0,13 0t0 211182 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 14w REG 8,1 135527985 265459 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 15uW REG 0,24 7 1763 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 16r FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 17w FIFO 0,13 0t0 203741 pipe 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 18u unix 0xffff94d310295940 0t0 203742 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 19u IPv4 211213 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:44:00.531 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 20u IPv4 211239 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 21u IPv4 211266 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 22u IPv4 211294 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 23u IPv4 211323 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 24u IPv4 211353 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 25u IPv4 211384 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 26u IPv4 211416 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 27r FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 28w FIFO 0,13 0t0 203755 pipe 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 29r FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 30w FIFO 0,13 0t0 203756 pipe 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 31u sock 0,8 0t0 211477 protocol: UDPv6 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:00.532 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.533 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 58r FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 59u IPv4 210623 0t0 TCP smithi093.front.sepia.ceph.com:55194->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.534 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 60w FIFO 0,13 0t0 213203 pipe 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 61r FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 62w FIFO 0,13 0t0 213204 pipe 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 63u IPv4 213220 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51462 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 64u IPv4 215141 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47002 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 65u IPv4 215144 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37806 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 66u IPv4 215147 0t0 TCP smithi093.front.sepia.ceph.com:60854->smithi093.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 67u IPv4 209849 0t0 TCP smithi093.front.sepia.ceph.com:52116->smithi125.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 68u IPv4 209850 0t0 TCP smithi093.front.sepia.ceph.com:43002->smithi125.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 69u IPv4 215148 0t0 TCP smithi093.front.sepia.ceph.com:49248->smithi125.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 70u IPv4 209851 0t0 TCP smithi093.front.sepia.ceph.com:53352->smithi125.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 71u IPv4 209852 0t0 TCP smithi093.front.sepia.ceph.com:50436->smithi093.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 72u IPv4 215149 0t0 TCP smithi093.front.sepia.ceph.com:54610->smithi125.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.535 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 73u IPv4 215150 0t0 TCP smithi093.front.sepia.ceph.com:43762->smithi125.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:00.536 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 74u IPv4 215151 0t0 TCP smithi093.front.sepia.ceph.com:47360->smithi093.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 75u IPv4 209853 0t0 TCP smithi093.front.sepia.ceph.com:40452->smithi093.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 76u IPv4 215152 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59204 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 77u IPv4 211535 0t0 TCP smithi093.front.sepia.ceph.com:59266->smithi093.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 78u IPv4 211536 0t0 TCP smithi093.front.sepia.ceph.com:38032->smithi125.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 79u IPv4 209854 0t0 TCP smithi093.front.sepia.ceph.com:55368->smithi125.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 80u IPv4 209855 0t0 TCP smithi093.front.sepia.ceph.com:44794->smithi093.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 81u IPv4 212336 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59216 (ESTABLISHED) 2023-11-04T01:44:00.537 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 82u IPv4 212339 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37820 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 83u IPv4 214342 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59224 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 84u IPv4 214343 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47010 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 85u IPv4 214346 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37836 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 86u IPv4 214347 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51474 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 87u IPv4 214350 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi125.front.sepia.ceph.com:59228 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 88u IPv4 214353 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi125.front.sepia.ceph.com:37838 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 89u IPv4 210668 0t0 TCP smithi093.front.sepia.ceph.com:6830->smithi093.front.sepia.ceph.com:47016 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 90u IPv4 211537 0t0 TCP smithi093.front.sepia.ceph.com:6828->smithi093.front.sepia.ceph.com:51476 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 91u IPv4 210671 0t0 TCP smithi093.front.sepia.ceph.com:57690->smithi125.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 92u IPv4 209867 0t0 TCP smithi093.front.sepia.ceph.com:57186->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 93u IPv4 212355 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi093.front.sepia.ceph.com:35998 (ESTABLISHED) 2023-11-04T01:44:00.538 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 94u IPv4 214366 0t0 TCP smithi093.front.sepia.ceph.com:50434->smithi093.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 95u IPv4 209881 0t0 TCP smithi093.front.sepia.ceph.com:35470->smithi093.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 96u IPv4 210679 0t0 TCP smithi093.front.sepia.ceph.com:6826->smithi125.front.sepia.ceph.com:55682 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 97u IPv4 214429 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:58696 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 98u IPv4 281530 0t0 TCP smithi093.front.sepia.ceph.com:6824->smithi093.front.sepia.ceph.com:50820 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 99u IPv4 211579 0t0 TCP smithi093.front.sepia.ceph.com:55832->smithi125.front.sepia.ceph.com:6809 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-osd 118604 121991 osd_srv_h root 100u IPv4 214465 0t0 TCP smithi093.front.sepia.ceph.com:36072->smithi125.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122013 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122013 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122013 root txt unknown /proc/122013/exe 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122058 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122058 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.539 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122058 root txt unknown /proc/122058/exe 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122120 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122120 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 122120 root txt unknown /proc/122120/exe 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 122565 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 122565 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 122565 root txt unknown /proc/122565/exe 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122630 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122630 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122630 root txt unknown /proc/122630/exe 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122654 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122654 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.540 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/4 122654 root txt unknown /proc/122654/exe 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122920 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122920 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 122920 root txt unknown /proc/122920/exe 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123182 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123182 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123182 root txt unknown /proc/123182/exe 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123190 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123190 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 123190 root txt unknown /proc/123190/exe 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123338 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123338 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123338 root txt unknown /proc/123338/exe 2023-11-04T01:44:00.541 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123370 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123370 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 123370 root txt unknown /proc/123370/exe 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123384 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123384 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123384 root txt unknown /proc/123384/exe 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123395 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123395 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/7 123395 root txt unknown /proc/123395/exe 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123640 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123640 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123640 root txt unknown /proc/123640/exe 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123641 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.542 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123641 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 123641 root txt unknown /proc/123641/exe 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:00.543 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.544 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:00.545 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:00.546 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 0r FIFO 0,13 0t0 264674 pipe 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 3r FIFO 0,13 0t0 264686 pipe 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 4w FIFO 0,13 0t0 264686 pipe 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 5u netlink 0t0 264691 AUDIT 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 146901 root 6u unix 0xffff94d308493fc0 0t0 264692 type=DGRAM (CONNECTED) 2023-11-04T01:44:00.547 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.548 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root 0r FIFO 0,13 0t0 264674 pipe 2023-11-04T01:44:00.549 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 146952 root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.550 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.551 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.552 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.553 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.554 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.555 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.556 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.557 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.558 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.559 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.560 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146963 log root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.561 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.562 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.563 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.564 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.566 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146968 msgr-work root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.567 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.568 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.569 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.570 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.571 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.572 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146969 msgr-work root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.573 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.574 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.575 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.576 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.577 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146970 msgr-work root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.579 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.580 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.581 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.597 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.598 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.599 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146977 service root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.600 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.601 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.602 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.603 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.605 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.606 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146979 admin_soc root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.607 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.608 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.609 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.610 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.611 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.612 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.613 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146987 signal_ha root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.614 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.615 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.616 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.617 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.618 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.619 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146988 io_contex root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.620 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.621 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.622 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.623 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.624 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146989 io_contex root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.627 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.630 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.632 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146990 ms_dispat root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.633 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.634 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.635 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.636 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.637 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.638 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146991 ms_local root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.639 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.640 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.641 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.642 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.643 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.644 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.645 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146992 safe_time root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.646 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.647 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.648 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.649 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.650 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.651 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146995 safe_time root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.652 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.653 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.654 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.655 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.656 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.657 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.658 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 146996 ceph-mds root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.659 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.660 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.661 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.662 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 1w FIFO 0,13 0t0 264675 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 2w FIFO 0,13 0t0 264676 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 3r FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 4w FIFO 0,13 0t0 260064 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20] 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 6r FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 7w FIFO 0,13 0t0 261934 pipe 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,27] 2023-11-04T01:44:00.663 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 9r FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 10w FIFO 0,13 0t0 261935 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,30] 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 12r FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 13w FIFO 0,13 0t0 261936 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 14w REG 8,1 857466 265468 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 15uW REG 0,24 7 1769 /run/ceph/ceph-mds.a.pid 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 16r FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 17w FIFO 0,13 0t0 262572 pipe 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 18u unix 0xffff94d3103e5500 0t0 262573 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 19u IPv4 265785 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 20u IPv4 265823 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:44:00.664 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 21r FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 22w FIFO 0,13 0t0 262575 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 23r FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 24w FIFO 0,13 0t0 262576 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 25r FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 26w FIFO 0,13 0t0 263704 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 27u IPv4 264706 0t0 TCP smithi093.front.sepia.ceph.com:59728->smithi125.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 28r FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 29w FIFO 0,13 0t0 263705 pipe 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 146959 147019 safe_time root 30u IPv4 265837 0t0 TCP smithi093.front.sepia.ceph.com:59314->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152403 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.665 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152403 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152403 root txt unknown /proc/152403/exe 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152404 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152404 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/3 152404 root txt unknown /proc/152404/exe 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 154404 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 154404 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/0 154404 root txt unknown /proc/154404/exe 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 154507 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 154507 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/5 154507 root txt unknown /proc/154507/exe 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.666 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:00.667 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:00.668 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:00.670 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 0r FIFO 0,13 0t0 280183 pipe 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.671 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 3r FIFO 0,13 0t0 281970 pipe 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 4w FIFO 0,13 0t0 281970 pipe 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 5u netlink 0t0 281975 AUDIT 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 154676 root 6u unix 0xffff94d3103dea40 0t0 281976 type=DGRAM (CONNECTED) 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.672 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.673 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root 0r FIFO 0,13 0t0 280183 pipe 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:daemon-he 154710 root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.675 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.676 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.677 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.678 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.679 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.680 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.681 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.682 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.683 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.684 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.685 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.686 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154716 log root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.687 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.688 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.689 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.690 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.691 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.692 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.693 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154718 msgr-work root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.694 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.695 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.696 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.697 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.698 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.699 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.700 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154719 msgr-work root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.706 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.707 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154720 msgr-work root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.708 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.709 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.710 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.711 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.712 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.713 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.714 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.715 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154724 service root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.716 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.717 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.718 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.719 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.720 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.721 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.722 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154725 admin_soc root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.723 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.724 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.726 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.727 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.728 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.729 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154726 signal_ha root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.730 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.731 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.732 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.733 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.735 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154727 io_contex root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.742 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154728 io_contex root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.748 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.750 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154729 ms_dispat root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.751 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.752 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.753 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.754 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.755 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.756 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154730 ms_local root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.757 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.758 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.759 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.760 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.761 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.762 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.763 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154731 safe_time root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.764 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.765 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.766 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.767 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.768 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.769 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.770 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154732 safe_time root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.771 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.772 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.773 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.774 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.775 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.776 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154733 ceph-mds root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.777 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.778 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.779 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.780 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.781 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.782 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.783 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 154756 safe_time root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.784 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.785 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.786 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.788 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.789 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.790 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156453 ceph_time root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.791 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.792 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.793 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.794 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.795 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156454 OpHistory root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.797 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.798 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.799 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.800 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.801 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.802 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.803 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156455 ms_dispat root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.804 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.805 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.806 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.807 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.808 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.809 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156456 mds_rank_ root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.810 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.811 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.812 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.813 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.814 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.815 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.816 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156457 PQ_Finish root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.817 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.818 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.819 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.820 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.821 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.822 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.823 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156458 safe_time root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.824 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.825 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.826 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.827 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.828 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.829 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156459 MR_Finish root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.831 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.832 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.833 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.834 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.835 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.836 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 156461 md_submit root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.837 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.838 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.839 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.840 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.841 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.842 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157025 ms_dispat root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root txt REG 8,1 6696672 2968 /usr/bin/ceph-mds 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.844 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.845 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.846 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 326760 2399 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 61880 2389 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 1w FIFO 0,13 0t0 280184 pipe 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 2w FIFO 0,13 0t0 280185 pipe 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 3r FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 4w FIFO 0,13 0t0 281143 pipe 2023-11-04T01:44:00.847 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 5u a_inode 0,14 0 1077 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 6r FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 7w FIFO 0,13 0t0 281145 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 8u a_inode 0,14 0 1077 [eventpoll:9,30,32,35] 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 9r FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 10w FIFO 0,13 0t0 281146 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 11u a_inode 0,14 0 1077 [eventpoll:12,31,33,36,39] 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 12r FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 13w FIFO 0,13 0t0 281147 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 14w REG 8,1 6340942 265469 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 15uW REG 0,24 7 2410 /run/ceph/ceph-mds.c.pid 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 16r FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 17w FIFO 0,13 0t0 283889 pipe 2023-11-04T01:44:00.848 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 18u unix 0xffff94d3084250c0 0t0 283890 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 19u IPv4 282961 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 20u IPv4 282998 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 21r FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 22w FIFO 0,13 0t0 283892 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 23r FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 24w FIFO 0,13 0t0 283893 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 25r FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 26w FIFO 0,13 0t0 283894 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 27u IPv4 282999 0t0 TCP smithi093.front.sepia.ceph.com:57700->smithi093.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 28r FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 29w FIFO 0,13 0t0 283895 pipe 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 30u IPv4 283004 0t0 TCP smithi093.front.sepia.ceph.com:51454->smithi093.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:00.849 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 31u IPv4 287860 0t0 TCP smithi093.front.sepia.ceph.com:35596->smithi093.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 32u IPv4 287861 0t0 TCP smithi093.front.sepia.ceph.com:55126->smithi093.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 33u IPv4 287022 0t0 TCP smithi093.front.sepia.ceph.com:48362->smithi125.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 34u IPv4 282429 0t0 TCP smithi093.front.sepia.ceph.com:46188->smithi093.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 35u IPv4 287026 0t0 TCP smithi093.front.sepia.ceph.com:51360->smithi125.front.sepia.ceph.com:6805 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 36u IPv4 284410 0t0 TCP smithi093.front.sepia.ceph.com:50820->smithi093.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 37u IPv4 282430 0t0 TCP smithi093.front.sepia.ceph.com:48358->smithi125.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-mds 154715 157026 ms_dispat root 39u IPv4 291959 0t0 TCP smithi093.front.sepia.ceph.com:6834->192.168.0.1:32956 (ESTABLISHED) 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 156410 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 156410 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/6 156410 root txt unknown /proc/156410/exe 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:00.850 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:00.851 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu 0r FIFO 0,13 0t0 292879 pipe 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:bash 157711 ubuntu 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:00.852 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.853 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.854 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:00.855 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 0r FIFO 0,13 0t0 292879 pipe 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.856 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 3r FIFO 0,13 0t0 292903 pipe 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 4w FIFO 0,13 0t0 292903 pipe 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 5u netlink 0t0 292909 AUDIT 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157741 root 6u unix 0xffff94d30769e600 0t0 292910 type=DGRAM (CONNECTED) 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:00.857 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:00.858 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.859 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.860 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:00.861 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 0r FIFO 0,13 0t0 292879 pipe 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 3r FIFO 0,13 0t0 290952 pipe 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 4w FIFO 0,13 0t0 290952 pipe 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 5u sock 0,8 0t0 290958 protocol: NETLINK 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 157747 root 6u sock 0,8 0t0 290959 protocol: UNIX 2023-11-04T01:44:00.862 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.863 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root 0r FIFO 0,13 0t0 292879 pipe 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.864 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root 3r FIFO 0,13 0t0 288221 pipe 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 157749 root 4w FIFO 0,13 0t0 288221 pipe 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.865 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.866 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.867 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.868 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.869 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.870 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.871 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.872 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.873 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.874 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157768 log root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.876 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.877 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.878 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.879 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.880 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.881 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157770 msgr-work root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.882 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.883 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.884 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.885 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.887 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157771 msgr-work root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.888 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.889 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.890 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.891 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.892 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.893 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157772 msgr-work root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.894 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.895 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.896 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.897 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.898 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.899 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157776 service root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.900 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.901 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.902 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.903 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.904 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157777 admin_soc root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.905 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.906 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.907 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.908 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.909 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.910 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157778 signal_ha root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.911 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.912 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.913 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.914 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.915 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.916 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157779 io_contex root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.919 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.920 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.921 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157780 io_contex root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.922 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.927 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157781 ceph_time root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.932 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157782 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.933 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.935 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.936 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.937 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.938 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157783 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.939 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.941 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.942 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.943 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.945 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.946 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157784 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.947 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.948 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.949 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.950 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157785 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.952 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.953 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.954 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.955 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.956 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157786 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.958 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.959 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.960 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.961 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.962 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157787 safe_time root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.963 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.964 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.965 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.966 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.967 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.968 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157788 fn_anonym root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.969 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.970 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.971 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.972 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.973 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.974 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157789 flusher root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.975 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.976 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.977 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.978 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.979 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.980 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157790 ms_dispat root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.981 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.982 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.984 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.985 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.986 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157791 ms_local root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.987 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.988 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.989 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.990 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157792 safe_time root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.992 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.993 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:00.994 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:00.995 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.996 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:00.997 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157793 ceph-fuse root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:00.998 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:00.999 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:01.001 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:01.002 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:01.003 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157795 ceph-fuse root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:01.004 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:01.005 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:01.006 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.007 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.008 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:01.009 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157797 ceph-fuse root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root txt REG 8,1 2635024 3986 /usr/bin/ceph-fuse 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 53272 1884 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:01.010 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 53816 1491 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.011 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 639224 1848 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:01.012 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 9894040 265627 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.013 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 0r FIFO 0,13 0t0 288222 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 1w FIFO 0,13 0t0 292880 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 2w FIFO 0,13 0t0 292881 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 3w REG 8,1 295592 267544 /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 4u a_inode 0,14 0 1077 [eventpoll:5,20] 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 5r FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 6w FIFO 0,13 0t0 286535 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 7u a_inode 0,14 0 1077 [eventpoll:8] 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 8r FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 9w FIFO 0,13 0t0 286536 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 10u a_inode 0,14 0 1077 [eventpoll:11,22] 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 11r FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 12w FIFO 0,13 0t0 286537 pipe 2023-11-04T01:44:01.014 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 13r FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 14w FIFO 0,13 0t0 286538 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 15u sock 0,8 0t0 286539 protocol: UNIX-STREAM 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 16r FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 17w FIFO 0,13 0t0 286540 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 18r FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 19w FIFO 0,13 0t0 286541 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 20u sock 0,8 0t0 291958 protocol: TCP 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 22u sock 0,8 0t0 289988 protocol: TCP 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 24r FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 25w FIFO 0,13 0t0 288949 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 26r FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.015 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 27w FIFO 0,13 0t0 290966 pipe 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 28r FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-fuse 157767 157992 ceph-fuse root 29w FIFO 0,13 0t0 288283 pipe 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:01.016 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu 0r FIFO 0,13 0t0 293073 pipe 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu 1w FIFO 0,13 0t0 293074 pipe 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:bash 158139 ubuntu 2w FIFO 0,13 0t0 293075 pipe 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu cwd DIR 0,43 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.017 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu txt REG 8,1 69752 10054 /usr/bin/mkdir 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:01.018 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu 0r FIFO 0,13 0t0 293073 pipe 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu 1w FIFO 0,13 0t0 293074 pipe 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir 158155 ubuntu 2w FIFO 0,13 0t0 293075 pipe 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 158362 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 158362 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/2 158362 root txt unknown /proc/158362/exe 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 158363 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 158363 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.019 INFO:teuthology.orchestra.run.smithi093.stdout:kworker/1 158363 root txt unknown /proc/158363/exe 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:01.020 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu 0r FIFO 0,13 0t0 290239 pipe 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu 1w FIFO 0,13 0t0 290240 pipe 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:bash 159105 ubuntu 2w FIFO 0,13 0t0 290241 pipe 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:01.021 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:01.022 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 0r FIFO 0,13 0t0 290239 pipe 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 1w FIFO 0,13 0t0 290240 pipe 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 2w FIFO 0,13 0t0 290241 pipe 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 3r FIFO 0,13 0t0 293407 pipe 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 4w FIFO 0,13 0t0 293407 pipe 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 5u netlink 0t0 293413 AUDIT 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:sudo 159121 root 6u unix 0xffff94d30769cc80 0t0 293414 type=DGRAM (CONNECTED) 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 0r FIFO 0,13 0t0 290239 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 1w FIFO 0,13 0t0 290240 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 2w FIFO 0,13 0t0 290241 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 3r FIFO 0,13 0t0 292416 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 4w FIFO 0,13 0t0 292416 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:stdin-kil 159123 root 6w FIFO 0,13 0t0 292417 pipe 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 0r FIFO 0,13 0t0 292417 pipe 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 1w FIFO 0,13 0t0 290240 pipe 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 2w FIFO 0,13 0t0 290241 pipe 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 3r DIR 0,20 0 1 /proc 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 4r DIR 0,20 0 290247 /proc/159124/fd 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 5w FIFO 0,13 0t0 290259 pipe 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159124 root 6r FIFO 0,13 0t0 290260 pipe 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:01.031 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root 4r FIFO 0,13 0t0 290259 pipe 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi093.stdout:lsof 159125 root 7w FIFO 0,13 0t0 290260 pipe 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:43:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 2 0.0 0.0 0 0 ? S 01:12 0:00 [kthreadd] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 3 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [rcu_gp] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 4 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [rcu_par_gp] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 5 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [slub_flushwq] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 6 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [netns] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 8 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 11 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [mm_percpu_wq] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 13 0.0 0.0 0 0 ? I 01:12 0:00 \_ [rcu_tasks_kthre] 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi093.stdout:root 14 0.0 0.0 0 0 ? I 01:12 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 15 0.0 0.0 0 0 ? I 01:12 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 16 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/0] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 17 0.2 0.0 0 0 ? S 01:12 0:05 \_ [pr/ttyS1] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 18 0.0 0.0 0 0 ? I 01:12 0:00 \_ [rcu_preempt] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 19 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/0] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 20 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/0] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 21 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/0] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 22 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/1] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 23 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/1] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 24 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/1] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 25 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/1] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 27 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi093.stdout:root 28 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/2] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 29 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/2] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 30 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/2] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 31 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/2] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 33 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 34 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/3] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 35 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/3] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 36 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/3] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 37 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/3] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 39 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 40 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/4] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 41 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/4] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 42 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/4] 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi093.stdout:root 43 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/4] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 45 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 46 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/5] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 47 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/5] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 48 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/5] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 49 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/5] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 51 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 52 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/6] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 53 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/6] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 54 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/6] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 55 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/6] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 57 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 58 0.0 0.0 0 0 ? S 01:12 0:00 \_ [cpuhp/7] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 59 0.0 0.0 0 0 ? S 01:12 0:00 \_ [idle_inject/7] 2023-11-04T01:44:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:root 60 0.0 0.0 0 0 ? S 01:12 0:00 \_ [migration/7] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 61 0.0 0.0 0 0 ? S 01:12 0:00 \_ [ksoftirqd/7] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 63 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 71 0.0 0.0 0 0 ? S 01:12 0:00 \_ [kdevtmpfs] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 72 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [inet_frag_wq] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 73 0.0 0.0 0 0 ? S 01:12 0:00 \_ [kauditd] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 75 0.0 0.0 0 0 ? S 01:12 0:00 \_ [khungtaskd] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 76 0.0 0.0 0 0 ? S 01:12 0:00 \_ [oom_reaper] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 77 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [writeback] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 78 0.0 0.0 0 0 ? S 01:12 0:00 \_ [kcompactd0] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 79 0.0 0.0 0 0 ? SN 01:12 0:00 \_ [ksmd] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 80 0.0 0.0 0 0 ? SN 01:12 0:00 \_ [khugepaged] 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:root 81 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [cryptd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 82 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kintegrityd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 83 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kblockd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 84 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 85 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [tpm_dev_wq] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 86 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [md] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 87 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [md_bitmap] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 88 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [edac-poller] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 89 0.0 0.0 0 0 ? S 01:12 0:00 \_ [watchdogd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 91 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/4:1H-kblockd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 93 0.0 0.0 0 0 ? S 01:12 0:00 \_ [kswapd0] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 100 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kthrotld] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 108 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 109 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kmpath_rdacd] 2023-11-04T01:44:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:root 110 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kaluad] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 111 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [mld] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 112 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 113 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [ipv6_addrconf] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 122 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [kstrp] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 129 0.0 0.0 0 0 ? I< 01:12 0:00 \_ [zswap-shrink] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 237 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/u17:0] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 276 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/7:1H-xfs-log/dm-4] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 287 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/0:1H-xfs-log/dm-3] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 290 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/3:1H-xfs-log/dm-1] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 351 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/2:1H-xfs-log/dm-0] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 377 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/6:1H-kblockd] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 424 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [nvme-wq] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 431 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [ata_sff] 2023-11-04T01:44:01.040 INFO:teuthology.orchestra.run.smithi093.stdout:root 432 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [nvme-reset-wq] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 435 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [nvme-delete-wq] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 436 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [nvme-auth-wq] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 437 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [ixgbe] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 441 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_0] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 442 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_0] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 443 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_1] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 444 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_1] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 445 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_2] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 446 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_2] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 447 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_3] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 448 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_3] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 454 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_4] 2023-11-04T01:44:01.041 INFO:teuthology.orchestra.run.smithi093.stdout:root 455 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_4] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 456 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_5] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 457 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_5] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 458 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_6] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 459 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_6] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 460 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_7] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 461 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_7] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 462 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_8] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 463 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_8] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 464 0.0 0.0 0 0 ? S 01:13 0:00 \_ [scsi_eh_9] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 465 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [scsi_tmf_9] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 466 0.0 0.0 0 0 ? I 01:13 0:00 \_ [kworker/u16:8-flush-8:0] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 467 0.0 0.0 0 0 ? I 01:13 0:00 \_ [kworker/u16:9-events_unbound] 2023-11-04T01:44:01.042 INFO:teuthology.orchestra.run.smithi093.stdout:root 477 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [kworker/5:1H-xfs-log/dm-4] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 490 0.0 0.0 0 0 ? S 01:13 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 491 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 573 0.0 0.0 0 0 ? S 01:13 0:00 \_ [ext4lazyinit] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 624 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [ipmi-msghandler] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 646 0.0 0.0 0 0 ? SN 01:13 0:00 \_ [kipmi0] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 660 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [rpciod] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 661 0.0 0.0 0 0 ? I< 01:13 0:00 \_ [xprtiod] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 6366 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:0-events_unbound] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 61021 0.0 0.0 0 0 ? I< 01:29 0:00 \_ [tls-strp] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 62652 0.0 0.0 0 0 ? I 01:30 0:00 \_ [kworker/u16:3-flush-8:0] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 100753 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:0] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 100874 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:1] 2023-11-04T01:44:01.043 INFO:teuthology.orchestra.run.smithi093.stdout:root 100994 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:2] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 101114 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:3] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 101234 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102127 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfsalloc] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102128 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs_mru_cache] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102129 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102130 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102131 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102132 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102133 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102134 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102135 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 102136 0.0 0.0 0 0 ? S 01:32 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 105475 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/u16:5-events_unbound] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 106738 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/2:3-rcu_gp] 2023-11-04T01:44:01.044 INFO:teuthology.orchestra.run.smithi093.stdout:root 106745 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/2:10-events] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112664 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112665 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112666 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112667 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112668 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112669 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112670 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112671 0.0 0.0 0 0 ? S 01:34 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112748 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112749 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112750 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112751 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112752 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:01.045 INFO:teuthology.orchestra.run.smithi093.stdout:root 112753 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112754 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112755 0.0 0.0 0 0 ? S 01:34 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112832 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112833 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112834 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112835 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112836 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112837 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112838 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112839 0.0 0.0 0 0 ? S 01:34 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112916 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112917 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112918 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:44:01.046 INFO:teuthology.orchestra.run.smithi093.stdout:root 112919 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 112920 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 112921 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 112922 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 112923 0.0 0.0 0 0 ? S 01:34 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 112969 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [dio/dm-0] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 114131 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [dio/dm-1] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 115294 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-2] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 116467 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-3] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122013 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/6:6-events] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122058 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/5:35-mm_percpu_wq] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122120 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/5:90-mm_percpu_wq] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122565 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/0:251-rcu_gp] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122630 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/4:42-mm_percpu_wq] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122654 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/4:66-events] 2023-11-04T01:44:01.047 INFO:teuthology.orchestra.run.smithi093.stdout:root 122920 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/6:91-rcu_gp] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123182 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/1:343-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123190 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/1:347-events_long] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123338 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/0:315-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123370 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/0:347-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123384 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/7:168-ipv6_addrconf] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123395 0.1 0.0 0 0 ? I 01:35 0:00 \_ [kworker/7:179-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123640 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/3:227-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 123641 0.0 0.0 0 0 ? I 01:35 0:00 \_ [kworker/3:228-mm_percpu_wq] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 152403 0.0 0.0 0 0 ? I 01:41 0:00 \_ [kworker/3:0-rcu_gp] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 152404 0.0 0.0 0 0 ? I 01:41 0:00 \_ [kworker/3:1] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 154404 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/0:0-events] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 154507 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/5:0-mm_percpu_wq] 2023-11-04T01:44:01.048 INFO:teuthology.orchestra.run.smithi093.stdout:root 156410 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/6:0-mm_percpu_wq] 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 158362 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/2:0-mm_percpu_wq] 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 158363 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/1:0-events_power_efficient] 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 1 0.1 0.0 175984 20372 ? Ss 01:12 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 567 0.0 0.0 26800 17000 ? Ss 01:13 0:01 /usr/lib/systemd/systemd-journald 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 582 0.0 0.0 36640 14880 ? Ss 01:13 0:00 /usr/lib/systemd/systemd-udevd 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:rpc 659 0.0 0.0 13244 5652 ? Ss 01:13 0:00 /usr/bin/rpcbind -w -f 2023-11-04T01:44:01.049 INFO:teuthology.orchestra.run.smithi093.stdout:root 664 0.0 0.0 91928 4612 ? S stdin-killer -- python3 -c ' 2023-11-04T01:44:01.054 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-04T01:44:01.054 DEBUG:teuthology.orchestra.run.smithi093:> path = "/sys/fs/fuse/connections/43/abort" 2023-11-04T01:44:01.054 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists(path): 2023-11-04T01:44:01.054 DEBUG:teuthology.orchestra.run.smithi093:> open(path, "w").write("1") 2023-11-04T01:44:01.054 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-04T01:44:01.131 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:44:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:01.138 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:44:01.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:01.138 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:01.207 INFO:teuthology.orchestra.run.smithi093.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s33’: Software caused connection abort 2023-11-04T01:44:01.209 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:02.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~27s 2023-11-04T01:44:08.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~36s 2023-11-04T01:44:15.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~43s 2023-11-04T01:44:22.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~49s 2023-11-04T01:44:22.886 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:22.889 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:28.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~56s 2023-11-04T01:44:35.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~62s 2023-11-04T01:44:42.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~69s 2023-11-04T01:44:48.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-11-04T01:44:52.965 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:52.968 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:55.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~82s 2023-11-04T01:45:01.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~89s 2023-11-04T01:45:08.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~95s 2023-11-04T01:45:15.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~102s 2023-11-04T01:45:21.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~109s 2023-11-04T01:45:23.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:23.114 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:28.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~115s 2023-11-04T01:45:34.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2023-11-04T01:45:41.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~129s 2023-11-04T01:45:48.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~135s 2023-11-04T01:45:53.235 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:53.238 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:54.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~142s 2023-11-04T01:46:01.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~148s 2023-11-04T01:46:07.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~155s 2023-11-04T01:46:14.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~162s 2023-11-04T01:46:21.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~168s 2023-11-04T01:46:23.363 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:23.366 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:27.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~175s 2023-11-04T01:46:34.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~181s 2023-11-04T01:46:41.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~188s 2023-11-04T01:46:47.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~195s 2023-11-04T01:46:53.525 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:53.528 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:54.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~201s 2023-11-04T01:47:00.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~208s 2023-11-04T01:47:07.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~214s 2023-11-04T01:47:14.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~221s 2023-11-04T01:47:20.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~228s 2023-11-04T01:47:23.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:23.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:27.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~234s 2023-11-04T01:47:33.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~241s 2023-11-04T01:47:40.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~248s 2023-11-04T01:47:47.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~254s 2023-11-04T01:47:53.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~261s 2023-11-04T01:47:53.808 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:53.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:00.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~267s 2023-11-04T01:48:06.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~274s 2023-11-04T01:48:13.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~281s 2023-11-04T01:48:20.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~287s 2023-11-04T01:48:23.955 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:23.958 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:26.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~294s 2023-11-04T01:48:33.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~300s 2023-11-04T01:48:33.398 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:48:33.398 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:48:33.398 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:33.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:48:33.418 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi093.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:33.418 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:33.418 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:48:33.475 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:48:33.475 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:33.533 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:48:33.533 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi093.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:48:33.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:33.533 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:48:33.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:48:33.589 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:48:33.590 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:33.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:48:33.609 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:48:33.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:33.609 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:48:33.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:48:33.667 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:48:33.667 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:33.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:48:33.725 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi125.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:48:33.725 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:33.725 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:48:33.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:35.390 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:48:35.390 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:48:35.391 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:48:35.391 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:48:35.391 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:48:35.391 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:48:35.392 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:48:35.392 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:48:35.392 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-04T01:48:35.392 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-04T01:48:35.392 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:48:35.393 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:48:35.393 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:48:35.393 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:48:35.393 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:48:35.393 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:48:35.394 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:48:35.390+0000 7fe56946e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 87972) UID: 0 2023-11-04T01:48:35.394 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:48:35.390+0000 7fe56946e640 -1 osd.4 119 *** Got signal Terminated *** 2023-11-04T01:48:35.394 INFO:tasks.ceph.osd.4.smithi125.stderr:2023-11-04T01:48:35.390+0000 7fe56946e640 -1 osd.4 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f997a39a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 87976) UID: 0 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f997a39a640 -1 osd.5 119 *** Got signal Terminated *** 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.5.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f997a39a640 -1 osd.5 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f4ac7bf1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 87978) UID: 0 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f4ac7bf1640 -1 osd.6 119 *** Got signal Terminated *** 2023-11-04T01:48:35.395 INFO:tasks.ceph.osd.6.smithi125.stderr:2023-11-04T01:48:35.391+0000 7f4ac7bf1640 -1 osd.6 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.396 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:48:35.391+0000 7fa727884640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 87981) UID: 0 2023-11-04T01:48:35.396 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:48:35.391+0000 7fa727884640 -1 osd.7 119 *** Got signal Terminated *** 2023-11-04T01:48:35.396 INFO:tasks.ceph.osd.7.smithi125.stderr:2023-11-04T01:48:35.391+0000 7fa727884640 -1 osd.7 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.396 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:48:35.392+0000 7f54d24b6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 96732) UID: 0 2023-11-04T01:48:35.396 INFO:tasks.ceph.mds.d.smithi125.stderr:2023-11-04T01:48:35.392+0000 7f54d24b6640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:48:35.396 INFO:tasks.ceph.mon.b.smithi125.stderr:2023-11-04T01:48:35.392+0000 7f54f16c3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 87403) UID: 0 2023-11-04T01:48:35.397 INFO:tasks.ceph.mon.b.smithi125.stderr:2023-11-04T01:48:35.392+0000 7f54f16c3640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:48:35.397 INFO:tasks.ceph.mon.c.smithi125.stderr:2023-11-04T01:48:35.393+0000 7f4063580640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 87406) UID: 0 2023-11-04T01:48:35.397 INFO:tasks.ceph.mon.c.smithi125.stderr:2023-11-04T01:48:35.393+0000 7f4063580640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:48:35.397 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fdb1bc13640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 118531) UID: 0 2023-11-04T01:48:35.397 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fdb1bc13640 -1 osd.0 119 *** Got signal Terminated *** 2023-11-04T01:48:35.398 INFO:tasks.ceph.osd.0.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fdb1bc13640 -1 osd.0 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.398 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb3e7031640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 118535) UID: 0 2023-11-04T01:48:35.398 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb3e7031640 -1 osd.1 119 *** Got signal Terminated *** 2023-11-04T01:48:35.398 INFO:tasks.ceph.osd.1.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb3e7031640 -1 osd.1 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.398 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fd989048640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 118552) UID: 0 2023-11-04T01:48:35.399 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fd989048640 -1 osd.2 119 *** Got signal Terminated *** 2023-11-04T01:48:35.399 INFO:tasks.ceph.osd.2.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fd989048640 -1 osd.2 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.399 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb5ba33e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 118555) UID: 0 2023-11-04T01:48:35.399 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb5ba33e640 -1 osd.3 119 *** Got signal Terminated *** 2023-11-04T01:48:35.399 INFO:tasks.ceph.osd.3.smithi093.stderr:2023-11-04T01:48:35.390+0000 7fb5ba33e640 -1 osd.3 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:48:35.399 INFO:tasks.ceph.mds.a.smithi093.stderr:2023-11-04T01:48:35.391+0000 7f2f5ef85640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 146952) UID: 0 2023-11-04T01:48:35.399 INFO:tasks.ceph.mds.a.smithi093.stderr:2023-11-04T01:48:35.391+0000 7f2f5ef85640 -1 mds.a *** got signal Terminated *** 2023-11-04T01:48:35.400 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:48:35.391+0000 7fb9cf3c9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 154710) UID: 0 2023-11-04T01:48:35.400 INFO:tasks.ceph.mds.c.smithi093.stderr:2023-11-04T01:48:35.391+0000 7fb9cf3c9640 -1 mds.c *** got signal Terminated *** 2023-11-04T01:48:35.400 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:48:35.392+0000 7f76f98fd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 118283) UID: 0 2023-11-04T01:48:35.400 INFO:tasks.ceph.mon.a.smithi093.stderr:2023-11-04T01:48:35.392+0000 7f76f98fd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:48:35.400 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:48:35.392+0000 7fe765717640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 118319) UID: 0 2023-11-04T01:48:35.401 INFO:tasks.ceph.mgr.y.smithi093.stderr:2023-11-04T01:48:35.392+0000 7fe765717640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-04T01:48:35.595 INFO:tasks.ceph.mgr.x.smithi125.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:48:48.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:2023-11-04T01:48:48 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:48:48.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi093.stderr:bash: line 1: 157741 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:48:54.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:54.073 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:48:54.073 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:48:54.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:54.074 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:48:54.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:54.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:54.091 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:48:54.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.238+0000 7f7fdbb18640 1 Processor -- start 2023-11-04T01:48:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.238+0000 7f7fdbb18640 1 -- start start 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fdbb18640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fdbb18640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fdbb18640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fd406bb10 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fdbb18640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fd40addd0 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fdbb18640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fd40cc680 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 msgr2=0x7f7fd40cdbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fd406bf10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:48:54.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 msgr2=0x7f7fd40ca2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:48:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.239+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:48:54.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.440+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 msgr2=0x7f7fd40cdbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:48:54.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.440+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:48:54.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.440+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fd406bf10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:48:54.441 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.440+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 msgr2=0x7f7fd40ca2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:48:54.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.440+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:48:54.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.841+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fd406bf10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:48:54.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.841+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 msgr2=0x7f7fd40cdbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:48:54.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.841+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:48:54.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.841+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 msgr2=0x7f7fd40ca2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:48:54.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:54.841+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:48:55.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:55.642+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 msgr2=0x7f7fd40cdbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:48:55.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:55.642+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:48:55.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:55.642+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fd406bf10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:48:55.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:55.642+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 msgr2=0x7f7fd40ca2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:48:55.643 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:55.642+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 msgr2=0x7f7fd40ca2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fd40cc680 0x7f7fd40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 msgr2=0x7f7fd40cdbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fd40addd0 0x7f7fd40cdbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fd406bf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:48:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:57.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8007230 2023-11-04T01:48:57.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.239+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb80047a0 2023-11-04T01:48:57.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.240+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8007230 legacy=0x7f7fb80096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:48:57.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.240+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:48:57.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.240+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:48:57.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.441+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8007230 legacy=0x7f7fb80096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:48:57.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.441+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:48:57.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.441+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:48:57.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.842+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8007230 legacy=0x7f7fb80096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:48:57.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.842+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:48:57.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:57.842+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:48:58.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:58.643+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:48:58.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:58.643+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:48:58.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:48:58.643+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8007230 legacy=0x7f7fb80096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80047a0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8007230 legacy=0x7f7fb80096f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fd406bb10 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb800b6d0 2023-11-04T01:49:00.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fb800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:00.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8009e20 2023-11-04T01:49:00.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:00.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:00.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 msgr2=0x7f7fb8009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:00.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.239+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:00.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.440+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fb800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:00.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.440+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:00.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.440+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:00.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.440+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 msgr2=0x7f7fb8009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:00.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.440+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:00.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.841+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fb800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:00.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.841+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:00.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.841+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:00.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.841+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 msgr2=0x7f7fb8009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:00.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:00.841+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:01.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:01.642+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fb800afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:01.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:01.642+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:01.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:01.642+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:01.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:01.642+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 msgr2=0x7f7fb8009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:01.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:01.642+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:03.241 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 msgr2=0x7f7fb8009670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009e20 0x7f7fb8009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 msgr2=0x7f7fb8006bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800b6d0 0x7f7fb8006bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fd406bb10 legacy=0x7f7fb800afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb800a2d0 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8012180 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800a2d0 legacy=0x7f7fb800a6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:03.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.239+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:03.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.440+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800a2d0 legacy=0x7f7fb800a6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:03.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.440+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:03.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.440+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:03.842 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.841+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800a2d0 legacy=0x7f7fb800a6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:03.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.841+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:03.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:03.841+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:04.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:04.642+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800a2d0 legacy=0x7f7fb800a6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:04.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:04.642+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:04.644 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:04.642+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8012180 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800a2d0 legacy=0x7f7fb800a6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:06.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8015510 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8014f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:06.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.239+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:06.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.440+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8014f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:06.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.440+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:06.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.440+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:06.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.440+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:06.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.440+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:06.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.841+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:06.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.841+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:06.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.841+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8014f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:06.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.841+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:06.843 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:06.841+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:07.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:07.642+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:07.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:07.642+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8014f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:07.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:07.642+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:07.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:07.642+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:07.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:07.642+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:09.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.239+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.239+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.239+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8014f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.239+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8014f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.239+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8009620 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8006bb0 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:09.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.240+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:09.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.441+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:09.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.441+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:09.442 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.441+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:09.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.842+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:09.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.842+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:09.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:09.842+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:10.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:10.643+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:10.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:10.643+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:10.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:10.643+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:12.242 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800f870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8006bb0 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8015510 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800d860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:12.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:12.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:12.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:12.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.240+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.441+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.441+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800d860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.441+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.441+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:12.443 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.441+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:12.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.842+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:12.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.842+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800d860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:12.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.842+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:12.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.842+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:12.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:12.842+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:13.643+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:13.643+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800d860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:13.643+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:13.643+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:13.643+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 msgr2=0x7f7fb800d860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8006bb0 0x7f7fb800d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8014ad0 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014f10 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8014ad0 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:15.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.241+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:15.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.442+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:15.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.442+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8014ad0 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:15.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.442+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.843+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8014ad0 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.843+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:15.843+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:16.644+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:16.644+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8014ad0 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:16.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:16.644+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:18.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:18.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014f10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8014ad0 legacy=0x7f7fb800c140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:18.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.243 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8009620 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb801a220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:18.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.241+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:18.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.442+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:18.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.442+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:18.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.442+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:18.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.442+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb801a220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:18.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.442+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:18.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.843+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:18.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.843+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:18.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.843+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:18.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.843+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb801a220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:18.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:18.843+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:19.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:19.644+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:19.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:19.644+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:19.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:19.644+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:19.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:19.644+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb801a220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:19.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:19.644+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb801a220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb801a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:21.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8006bb0 2023-11-04T01:49:21.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8015510 2023-11-04T01:49:21.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:21.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8006bb0 legacy=0x7f7fb800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:21.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.241+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:21.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.442+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:21.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.442+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8006bb0 legacy=0x7f7fb800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:21.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.442+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:21.844 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.843+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8006bb0 legacy=0x7f7fb800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:21.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.843+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:21.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:21.843+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:22.645 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:22.644+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:22.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:22.644+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8006bb0 legacy=0x7f7fb800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:22.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:22.644+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:24.183 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:24.186 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8006bb0 legacy=0x7f7fb800e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8009620 2023-11-04T01:49:24.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:24.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:24.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:24.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:24.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.242+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:24.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.443+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:24.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.443+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:24.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.443+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:24.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.443+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:24.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.844+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:24.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.844+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:24.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.844+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:24.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:24.844+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:25.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:25.645+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:25.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:25.645+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:25.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:25.645+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:25.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:25.645+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:27.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:27.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:27.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:27.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8015510 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb800fd10 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb800f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.242+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.243+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:27.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.243+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:27.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.443+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb800f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:27.444 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.443+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:27.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.444+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:27.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.444+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:27.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.844+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb800f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:27.845 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.844+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:27.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.845+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:27.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:27.845+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:28.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:28.645+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb800f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:28.646 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:28.645+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:28.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:28.646+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:28.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:28.646+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:30.244 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 msgr2=0x7f7fb8017cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800fd10 0x7f7fb8017cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb800f7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb800f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800afc0 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8014ad0 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:30.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:30.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:30.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:30.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.243+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:30.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.444+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:30.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.444+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:30.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.444+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:30.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.444+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:30.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.444+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:30.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.845+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:30.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.845+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:30.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.845+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:30.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.845+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:30.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:30.845+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:31.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:31.646+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:31.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:31.646+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:31.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:31.646+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:31.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:31.646+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:31.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:31.646+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800eb30 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8015510 2023-11-04T01:49:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:33.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:33.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.243+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:33.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.444+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:33.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.444+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:33.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.444+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:33.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.845+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:33.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.845+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:33.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:33.845+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:34.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:34.646+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:34.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:34.646+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:34.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:34.646+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8015510 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800afc0 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800eb30 2023-11-04T01:49:36.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:36.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:36.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:36.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:36.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.243+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:36.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.444+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:36.445 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.444+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:36.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.445+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:36.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.445+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:36.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.845+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:36.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.845+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:36.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.846+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:36.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:36.846+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:37.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:37.646+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:37.647 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:37.646+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:37.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:37.647+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:37.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:37.647+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:39.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:39.245 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8015510 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8009620 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:39.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.244+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:39.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.445+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:39.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.445+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:39.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.445+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:39.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.445+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:39.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.846+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:39.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.846+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:39.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.846+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:39.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:39.846+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:40.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:40.647+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:40.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:40.647+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:40.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:40.647+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:40.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:40.647+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb800afc0 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8015510 2023-11-04T01:49:42.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8009620 2023-11-04T01:49:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:42.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.244+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:42.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.445+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:42.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.445+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:42.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.445+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:42.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.445+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:42.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.445+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.846+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.846+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.846+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.846+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:42.846+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:43.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:43.647+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:43.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:43.647+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:43.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:43.647+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:43.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:43.647+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:43.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:43.647+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 msgr2=0x7f7fb800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8009620 0x7f7fb800e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 msgr2=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8015510 0x7f7fb8012560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800eb30 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:45.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:45.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:45.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.244+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:45.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.445+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:45.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.445+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:45.446 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.445+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:45.846 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.846+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:45.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.846+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:45.847 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:45.846+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:46.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:46.647+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:46.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:46.647+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:46.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:46.647+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:48.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800c0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:48.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:48.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800eb30 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8011660 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb800afc0 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb80034b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011660 legacy=0x7f7fb8011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:48.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.244+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:48.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.445+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb80034b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:48.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.445+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:48.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.445+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011660 legacy=0x7f7fb8011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:48.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.445+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:48.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.445+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.846+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb80034b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.846+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.846+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011660 legacy=0x7f7fb8011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.846+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:48.846+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:49.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:49.647+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb80034b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:49.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:49.647+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:49.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:49.647+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011660 legacy=0x7f7fb8011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:49.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:49.647+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:49.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:49.647+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:51.246 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb80034b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014ad0 0x7f7fb80034b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011660 legacy=0x7f7fb8011a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb8015510 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8004100 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8015510 legacy=0x7f7fb80039f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:51.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.244+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:51.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.445+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8015510 legacy=0x7f7fb80039f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:51.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.445+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:51.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.445+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:51.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.846+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8015510 legacy=0x7f7fb80039f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:51.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.846+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:51.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:51.846+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:52.648 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:52.647+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8015510 legacy=0x7f7fb80039f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:52.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:52.647+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:52.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:52.647+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8004100 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8015510 legacy=0x7f7fb80039f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8009620 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014ad0 2023-11-04T01:49:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb800afc0 2023-11-04T01:49:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.244+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:54.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.445+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:54.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.445+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:54.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.445+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:54.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.445+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:54.447 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.445+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:54.454 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:54.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:54.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.846+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:54.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.846+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:54.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.846+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:54.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.846+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:54.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:54.846+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:55.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:55.647+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:49:55.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:55.647+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:49:55.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:55.647+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:49:55.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:55.647+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:55.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:55.647+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014ad0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800e5f0 2023-11-04T01:49:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8011d70 2023-11-04T01:49:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.245+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800e5f0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:57.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.446+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:57.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.446+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:57.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.446+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800e5f0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:57.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.847+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:57.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.847+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:57.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:57.847+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800e5f0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:49:58.649 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:58.648+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:49:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:58.648+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:58.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:49:58.648+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800e5f0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 msgr2=0x7f7fb8014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8011d70 0x7f7fb8014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800e5f0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8009620 2023-11-04T01:50:00.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800afc0 2023-11-04T01:50:00.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8017cd0 2023-11-04T01:50:00.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb801a100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:00.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:00.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:00.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.245+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:00.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.446+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb801a100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:00.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.446+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:00.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.446+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:00.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.446+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:00.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.847+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:00.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.847+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb801a100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:00.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.847+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:00.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:00.847+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:01.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:01.648+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:01.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:01.648+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb801a100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:01.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:01.648+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:01.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:01.648+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:03.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb801a100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:03.247 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb801a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb800e0b0 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8014ad0 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 msgr2=0x7f7fb800e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:03.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.245+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:03.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.446+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:03.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.446+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 msgr2=0x7f7fb800e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:03.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.446+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:03.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.446+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:03.848 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.847+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 msgr2=0x7f7fb800e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.847+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.847+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:03.849 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:03.847+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:04.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:04.648+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:04.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:04.648+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:04.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:04.648+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 msgr2=0x7f7fb800e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:04.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:04.648+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 msgr2=0x7f7fb800e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800e0b0 0x7f7fb800e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8017cd0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8014ad0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8013570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:06.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.246+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:06.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.447+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8013570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:06.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.447+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:06.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.447+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:06.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.447+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:06.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.447+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:06.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.848+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8013570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:06.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.848+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:06.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.848+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:06.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.848+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:06.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:06.848+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:07.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:07.649+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8013570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:07.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:07.649+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:07.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:07.649+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:07.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:07.649+0000 7f7fda0b5640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:07.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:07.649+0000 7f7fda0b5640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8013570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8013570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb8011660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8012560 2023-11-04T01:50:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:50:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:09.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.246+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:09.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.447+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:09.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.447+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:09.448 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.447+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.848+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.848+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:09.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:09.848+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:10.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:10.649+0000 7f7fd90b3640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:10.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:10.649+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:10.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:10.649+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:12.248 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8010f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8009620 0x7f7fb8010f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8014ad0 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:12.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:12.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:12.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.246+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.447+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.447+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.447+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.447+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:12.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.447+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:12.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.848+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:12.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.848+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:12.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.848+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:12.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.848+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:12.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:12.848+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:13.649+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:13.649+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:13.649+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:13.649+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:13.649+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 msgr2=0x7f7fb800a710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014ad0 0x7f7fb800a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8012560 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8017cd0 2023-11-04T01:50:15.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:15.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:15.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.247+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:15.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.448+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:15.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.448+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:15.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.448+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.849+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.849+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:15.849+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:16.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:16.650+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:16.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:16.650+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:16.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:16.650+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:18.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8017cd0 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800e0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:18.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.247+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:18.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.448+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:18.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.448+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:18.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.448+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800e0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:18.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.448+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:18.449 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.448+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:18.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.849+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:18.850 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.849+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:18.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.849+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:18.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.849+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800e0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:18.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:18.849+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:19.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:19.650+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:19.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:19.650+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:19.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:19.650+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:19.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:19.650+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800e0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:19.651 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:19.650+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800e0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:21.249 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.247+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8012560 2023-11-04T01:50:21.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.248+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb80040c0 2023-11-04T01:50:21.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.248+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:21.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.248+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:21.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.248+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:21.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.449+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:21.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.449+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:21.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.449+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:21.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.850+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:21.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.850+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:21.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:21.850+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:22.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:22.651+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:22.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:22.651+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:22.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:22.651+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb80040c0 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8012560 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8017cd0 2023-11-04T01:50:24.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb800e870 con 0x7f7fb800a710 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:24.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.248+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:24.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:24.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:24.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:24.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:24.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:24.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.449+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:24.533 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:24.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:24.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:24.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:24.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:24.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:24.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:24.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:24.850+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:25.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:25.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:25.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:25.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:25.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:25.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:25.651+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:27.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 msgr2=0x7f7fb8014950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:27.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a710 0x7f7fb8014950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:27.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8017cd0 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:27.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb800afc0 2023-11-04T01:50:27.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40ccdf0 con 0x7f7fb8011460 2023-11-04T01:50:27.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:27.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.248+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011460 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:27.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.449+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:27.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.449+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011460 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:27.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.850+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:27.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:27.850+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011460 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:28.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:28.651+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:28.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:28.651+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011460 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:30.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8011460 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:30.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb80039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:30.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:30.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:30.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb80039b0 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8009620 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb800afc0 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:30.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.248+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:30.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.449+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:30.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.449+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:30.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.449+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:30.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.449+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:30.450 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.449+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:30.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.850+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:30.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.850+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:30.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.850+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:30.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.850+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:30.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:30.850+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:31.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:31.651+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:31.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:31.651+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:31.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:31.651+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:31.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:31.651+0000 7f7fda0b5640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:31.652 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:31.651+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb800afc0 0x7f7fb800a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8009620 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb8013570 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014990 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.248+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:33.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.449+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:33.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.449+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:33.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.449+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:33.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.850+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:33.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.850+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:33.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:33.850+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:34.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:34.651+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:34.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:34.651+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:34.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:34.651+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 msgr2=0x7f7fb8011630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8014990 0x7f7fb8011630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb800afc0 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8003470 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8019ce0 2023-11-04T01:50:36.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 msgr2=0x7f7fb801c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:36.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.248+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:36.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.449+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:36.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.449+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:36.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.449+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 msgr2=0x7f7fb801c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:36.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.449+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:36.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.449+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:36.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.850+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:36.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.850+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:36.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.850+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 msgr2=0x7f7fb801c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:36.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.850+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:36.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:36.850+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:37.651+0000 7f7fd98b4640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 msgr2=0x7f7fb801c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:37.651+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:37.651+0000 7f7fda0b5640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:37.651+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:37.651+0000 7f7fd98b4640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 msgr2=0x7f7fb801c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8019ce0 0x7f7fb801c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb800afc0 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb8009620 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014570 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 msgr2=0x7f7fb80062a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.248+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.449+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.449+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 msgr2=0x7f7fb80062a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.449+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.850+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.850+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 msgr2=0x7f7fb80062a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:39.850+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:40.651+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:40.651+0000 7f7fd90b3640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 msgr2=0x7f7fb80062a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:40.651+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 msgr2=0x7f7fb80062a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb8014570 0x7f7fb80062a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb8009620 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb800afc0 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb8003470 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.249+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.450+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.450+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.450+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.450+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.450+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.851+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.851+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.851+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.851+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:42.851+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:43.652+0000 7f7fda0b5640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:43.652+0000 7f7fda0b5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:43.652+0000 7f7fd90b3640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:43.652+0000 7f7fd98b4640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:43.652+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 msgr2=0x7f7fb8003850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8003470 0x7f7fb8003850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb800a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb8013570 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8011630 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 msgr2=0x7f7fb8013950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.249+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:45.451 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.450+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:45.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.450+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 msgr2=0x7f7fb8013950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:45.452 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.450+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:45.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.851+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:45.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.851+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 msgr2=0x7f7fb8013950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:45.853 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:45.851+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:46.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:46.652+0000 7f7fd98b4640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:46.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:46.652+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 msgr2=0x7f7fb8013950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:46.654 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:46.652+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 msgr2=0x7f7fb8013950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb8011630 0x7f7fb8013950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb8013570 legacy=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fda0b5640 1 -- reap_dead start 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8006bb0 con 0x7f7fb80039b0 2023-11-04T01:50:48.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb800afc0 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fcb7fe640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ccb10 con 0x7f7fb800a6b0 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:48.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.250+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:48.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.451+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:48.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.451+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:48.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.451+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:48.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.451+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:48.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.451+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.852+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.852+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.852+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.852+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:48.852+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:49.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:49.653+0000 7f7fda0b5640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:49.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:49.653+0000 7f7fd98b4640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:49.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:49.653+0000 7f7fd98b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:49.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:49.653+0000 7f7fd90b3640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:49.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:49.653+0000 7f7fd90b3640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 msgr2=0x7f7fb8003470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f7fb800a6b0 0x7f7fb8003470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 msgr2=0x7f7fb800e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7fb800afc0 0x7f7fb800e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f7fb80039b0 legacy=0x7f7fb8012560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 0x7f7fb8010f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40cd720 con 0x7f7fb8009620 2023-11-04T01:50:51.252 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fcb7fe640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ae1b0 con 0x7f7fb8014390 2023-11-04T01:50:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8013c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:51.253 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.250+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.451+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.451+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8013c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:51.453 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.451+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:51.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.852+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:51.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.852+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8013c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:51.854 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:51.852+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:52.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:52.653+0000 7f7fd98b4640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f7fb8009620 legacy=0x7f7fb8013c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:52.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:52.653+0000 7f7fd90b3640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 msgr2=0x7f7fb8010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:52.655 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:52.653+0000 7f7fd90b3640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fb8014390 0x7f7fb8010f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:54.167 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:50:54.167 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:50:54.168 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:50:54.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:50:54.260 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:50:54.261 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:50:54.261 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:54.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:50:54.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:50:54.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:54.278 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:50:54.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:50:54.334 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:50:54.334 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:50:54.335 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:54.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:50:54.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:50:54.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:54.353 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:50:54.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:50:54.410 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:50:54.410 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:50:54.410 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:54.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:50:54.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:50:54.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:54.427 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:50:54.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:50:54.484 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:50:54.484 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:50:54.484 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:54.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:50:54.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:50:54.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:54.502 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:50:54.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:50:54.559 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:50:54.559 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:54.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:54.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:54.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.665+0000 7f2640bfb640 1 Processor -- start 2023-11-04T01:50:54.667 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.665+0000 7f2640bfb640 1 -- start start 2023-11-04T01:50:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2640bfb640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2640bfb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2640bfb640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f263c15d100 2023-11-04T01:50:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2640bfb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cec20 con 0x7f263c0d3b60 2023-11-04T01:50:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2640bfb640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f263c15d4e0 2023-11-04T01:50:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 msgr2=0x7f263c0d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f263c0d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f263c15d100 legacy=0x7f263c0ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.666+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:54.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.867+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 msgr2=0x7f263c0d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:54.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.867+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:54.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.867+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f263c15d100 legacy=0x7f263c0ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:54.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.867+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f263c0d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:54.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:54.867+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:55.268+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 msgr2=0x7f263c0d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:55.268+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:55.268+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f263c0d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:55.268+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f263c15d100 legacy=0x7f263c0ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:55.268+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:56.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:56.069+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 msgr2=0x7f263c0d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:50:56.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:56.069+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:56.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:56.069+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f263c15d100 legacy=0x7f263c0ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:50:56.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:56.069+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f263c0d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:50:56.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:56.069+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f263c0d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f263c0d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 msgr2=0x7f263c0d1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f263c0d3b60 0x7f263c0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f263c15d100 legacy=0x7f263c0ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c006120 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c003690 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c006120 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:57.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 msgr2=0x7f261c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:57.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.667+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:57.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.868+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c006120 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:57.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.868+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 msgr2=0x7f261c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:57.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:57.868+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:58.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:58.269+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c006120 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:58.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:58.269+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 msgr2=0x7f261c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:58.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:58.269+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:59.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:59.070+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c006120 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:50:59.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:59.070+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 msgr2=0x7f261c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:50:59.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:50:59.070+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 msgr2=0x7f261c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c003690 0x7f261c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c006120 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:00.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00a930 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f263c15d4e0 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00a430 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00a930 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f261c009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:00.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.667+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:00.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.868+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f261c009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:00.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.868+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00a930 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:00.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.868+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:00.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.868+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:00.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:00.868+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:01.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:01.269+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00a930 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:01.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:01.269+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f261c009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:01.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:01.269+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:01.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:01.269+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:01.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:01.269+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:02.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:02.070+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:02.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:02.070+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00a930 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:02.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:02.070+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f261c009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:02.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:02.070+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:02.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:02.070+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a430 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 msgr2=0x7f261c009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f263c15d4e0 0x7f261c009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00a930 legacy=0x7f261c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:03.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c0090b0 2023-11-04T01:51:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c011130 2023-11-04T01:51:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0090b0 legacy=0x7f261c009520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:03.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.667+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:03.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.868+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0090b0 legacy=0x7f261c009520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:03.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.868+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:03.869 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:03.868+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:04.269+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0090b0 legacy=0x7f261c009520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:04.269+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:04.270 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:04.269+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:05.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:05.070+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0090b0 legacy=0x7f261c009520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:05.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:05.070+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:05.071 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:05.070+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:06.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c011130 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0090b0 legacy=0x7f261c009520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c013b90 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c014720 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c0094c0 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c013b90 legacy=0x7f261c013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:06.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:06.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:06.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.668+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.869+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.869+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c013b90 legacy=0x7f261c013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.869+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.869+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:06.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:06.869+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:07.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:07.270+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:07.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:07.270+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c013b90 legacy=0x7f261c013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:07.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:07.270+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:07.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:07.270+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:07.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:07.270+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:08.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:08.071+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:08.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:08.071+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c013b90 legacy=0x7f261c013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:08.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:08.071+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:08.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:08.071+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:08.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:08.071+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:09.669 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c013550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c013550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c014720 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c013b90 legacy=0x7f261c013f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c009ef0 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00a300 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 msgr2=0x7f261c00e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c0085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:09.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.668+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:09.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.869+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 msgr2=0x7f261c00e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:09.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.869+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c0085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:09.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:09.869+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:10.270+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 msgr2=0x7f261c00e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:10.270+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c0085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:10.271 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:10.270+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:11.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:11.071+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c0085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:11.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:11.071+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 msgr2=0x7f261c00e0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:11.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:11.071+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 msgr2=0x7f261c00e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00a300 0x7f261c00e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c0085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:12.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c0094c0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c009ef0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c010fc0 con 0x7f261c00e5f0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:12.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.668+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:12.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:12.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:12.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:12.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:12.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:12.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:12.869+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:13.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:13.270+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:14.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:14.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:14.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:14.072 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:14.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:14.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:14.071+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:15.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00dbc0 2023-11-04T01:51:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c00b090 2023-11-04T01:51:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:15.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.669+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00b090 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:15.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.870+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:15.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:15.870+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00b090 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:16.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:16.271+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:16.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:16.271+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00b090 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:17.072+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:17.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:17.072+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00b090 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:18.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00b090 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:18.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c00dfd0 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c0094c0 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00e5f0 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:18.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c018300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:18.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.669+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:18.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.870+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:18.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.870+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:18.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.870+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c018300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:18.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.870+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:18.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:18.870+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:19.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:19.271+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:19.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:19.271+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:19.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:19.271+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c018300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:19.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:19.271+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:19.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:19.271+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:20.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:20.071+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:20.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:20.071+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:20.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:20.071+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:20.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:20.071+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c018300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:20.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:20.071+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:21.670 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c018300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00dbc0 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009ef0 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:21.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.668+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:21.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.869+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:21.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.869+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:21.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:21.869+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:22.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:22.270+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:22.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:22.270+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:22.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:22.270+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:23.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:23.071+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:23.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:23.071+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:23.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:23.071+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c00dbc0 legacy=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c0162f0 2023-11-04T01:51:24.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00dfd0 2023-11-04T01:51:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00e5f0 2023-11-04T01:51:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0186e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:24.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.668+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:24.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:24.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:24.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.869+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0186e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:24.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.869+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:24.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.869+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:24.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:24.869+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:25.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:25.270+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0186e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:25.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:25.270+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:25.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:25.270+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:25.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:25.270+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:26.071+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0186e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:26.071+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:26.071+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:26.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:26.071+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:27.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:27.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:27.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfd0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:27.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0186e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:27.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009ef0 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c0094c0 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:27.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.669+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.870+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.870+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.870+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:27.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:27.870+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:28.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:28.271+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:28.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:28.271+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:28.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:28.271+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:28.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:28.271+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:29.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:29.072+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:29.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:29.072+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:29.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:29.072+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:29.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:29.072+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:30.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:30.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0094c0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009ef0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c0162f0 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c015110 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00e5f0 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:30.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.669+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:30.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.870+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:30.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.870+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:30.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.870+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:30.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.870+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:30.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:30.870+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:31.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:31.271+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:31.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:31.271+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:31.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:31.271+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:31.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:31.271+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:31.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:31.271+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:32.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:32.072+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0154f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:32.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:32.072+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:32.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:32.072+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:32.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:32.072+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:32.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:32.072+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:33.671 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c015110 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0162f0 legacy=0x7f261c0154f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c009ef0 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00dfd0 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:33.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.669+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.870+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.870+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:33.870+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:34.272 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:34.271+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:34.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:34.271+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:34.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:34.271+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:35.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:35.072+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:35.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:35.072+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:35.073 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:35.072+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 msgr2=0x7f261c0085a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfd0 0x7f261c0085a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009ef0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:36.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00dfa0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c009ef0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c010fc0 con 0x7f261c00e5f0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:36.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.669+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:36.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:36.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:36.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:36.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:36.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:36.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:36.870+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:37.273 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:37.271+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:38.074 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:38.072+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 msgr2=0x7f261c014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00e5f0 0x7f261c014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 msgr2=0x7f261c005a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009ef0 0x7f261c005a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:39.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:39.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c0085a0 2023-11-04T01:51:39.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c012520 2023-11-04T01:51:39.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:39.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.670+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012520 legacy=0x7f261c0129d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:39.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.871+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:39.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:39.871+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012520 legacy=0x7f261c0129d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:40.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:40.272+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:40.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:40.272+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012520 legacy=0x7f261c0129d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:41.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:41.073+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:41.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:41.073+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012520 legacy=0x7f261c0129d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:42.672 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012520 legacy=0x7f261c0129d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c00d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c009e40 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c00e5f0 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00dfa0 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:42.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.670+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:42.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.871+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:42.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.871+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:42.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.871+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:42.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:42.871+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:43.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:43.272+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:43.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:43.272+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:43.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:43.272+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:43.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:43.272+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:44.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:44.073+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:44.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:44.073+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:44.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:44.073+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:44.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:44.073+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c005a80 2023-11-04T01:51:45.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c0085a0 2023-11-04T01:51:45.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:45.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:45.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:45.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.671+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:45.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.872+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:45.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.872+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:45.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.872+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:45.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:45.872+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:46.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:46.273+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:46.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:46.273+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:46.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:46.273+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:46.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:46.273+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:47.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:47.074+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:47.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:47.074+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:47.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:47.074+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:47.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:47.074+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c0085a0 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:48.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c00e5f0 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00dfa0 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c005a80 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:48.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.671+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:48.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.872+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:48.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.872+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:48.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.872+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:48.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.872+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:48.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:48.872+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:49.273+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:49.273+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:49.273+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:49.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:49.273+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:49.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:49.273+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:50.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:50.074+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:50.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:50.074+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:50.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:50.074+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:50.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:50.074+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:50.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:50.074+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c00dfa0 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00e5f0 legacy=0x7f261c011510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:51.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c0085a0 2023-11-04T01:51:51.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:51:51.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.671+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:51.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.672+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:51.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.672+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:51.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.872+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:51.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.873+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:51.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:51.873+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:52.274 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:52.273+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:52.274+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:52.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:52.274+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:53.075 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:53.074+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:53.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:53.075+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:53.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:53.075+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:54.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.671+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.671+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.671+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0085a0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.671+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c012160 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c005a80 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c009e40 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:54.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:54.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:54.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:54.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.672+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:54.824 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:54.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:54.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.873+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:54.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.873+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:54.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.873+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:54.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.873+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:54.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:54.873+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:55.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:55.274+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:55.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:55.274+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:55.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:55.274+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:55.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:55.274+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:55.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:55.274+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:56.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:56.075+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:51:56.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:56.075+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:51:56.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:56.075+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:51:56.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:56.075+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:56.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:56.075+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:57.673 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0140f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0140f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00dfa0 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c012540 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:57.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.672+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfa0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:57.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.873+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:57.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.873+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:57.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:57.873+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfa0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:58.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:58.274+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:58.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:58.274+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:58.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:58.274+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfa0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:51:59.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:59.075+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:51:59.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:59.075+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:59.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:51:59.075+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfa0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00dfa0 legacy=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c012160 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c00c480 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:00.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c00c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:00.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:00.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.672+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:00.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.873+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:00.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.873+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:00.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.873+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c00c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:00.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:00.873+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:01.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:01.274+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:01.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:01.274+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:01.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:01.274+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c00c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:01.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:01.274+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:02.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:02.075+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:02.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:02.075+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c00c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:02.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:02.075+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:02.076 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:02.075+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:03.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:03.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c009e40 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:03.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c00c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:03.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012160 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c012540 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00cf70 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 msgr2=0x7f261c00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:03.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.673+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:03.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.874+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:03.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.874+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:03.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.874+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 msgr2=0x7f261c00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:03.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:03.874+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:04.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:04.275+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:04.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:04.275+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:04.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:04.275+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 msgr2=0x7f261c00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:04.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:04.275+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:05.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:05.076+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:05.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:05.076+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:05.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:05.076+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 msgr2=0x7f261c00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:05.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:05.076+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:06.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 msgr2=0x7f261c00d400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:06.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00cf70 0x7f261c00d400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:06.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 msgr2=0x7f261c011510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012540 0x7f261c011510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c005a80 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c011510 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:06.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.672+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.873+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.873+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.873+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.873+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:06.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:06.873+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:07.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:07.274+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:07.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:07.274+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:07.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:07.274+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:07.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:07.274+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:07.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:07.274+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:08.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:08.075+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:08.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:08.075+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:08.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:08.075+0000 7f263ad9d640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:08.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:08.075+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:08.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:08.075+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:09.674 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c011af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c011af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c00d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0105d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c012030 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c0140d0 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012030 legacy=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:09.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.672+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:09.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.873+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012030 legacy=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.873+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:09.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:09.873+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:10.274+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:10.274+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012030 legacy=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:10.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:10.274+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:11.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:11.075+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:11.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:11.075+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012030 legacy=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:11.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:11.075+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0140d0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012030 legacy=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:12.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c011510 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c005a80 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c011a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:12.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.672+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:12.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.873+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c011a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:12.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.873+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:12.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.873+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:12.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.873+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:12.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:12.873+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:13.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:13.274+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c011a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:13.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:13.274+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:13.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:13.274+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:13.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:13.274+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:13.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:13.274+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:14.075+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c011a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:14.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:14.075+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:14.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:14.075+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:14.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:14.075+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:14.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:14.075+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c005a80 0x7f261c0139c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c011a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c011a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:15.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c0105d0 2023-11-04T01:52:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00cb90 2023-11-04T01:52:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0105d0 legacy=0x7f261c00b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:15.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.673+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:15.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.874+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0105d0 legacy=0x7f261c00b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:15.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.874+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:15.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:15.874+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:16.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:16.275+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0105d0 legacy=0x7f261c00b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:16.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:16.275+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:16.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:16.275+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:17.077 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:17.076+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0105d0 legacy=0x7f261c00b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:17.076+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:17.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:17.076+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:18.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 msgr2=0x7f261c0109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:18.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00cb90 0x7f261c0109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0105d0 legacy=0x7f261c00b470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c009e40 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c0119b0 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c011510 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:18.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.673+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:18.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.874+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:18.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.874+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:18.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.874+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:18.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.874+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:18.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:18.874+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:19.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:19.275+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:19.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:19.275+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:19.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:19.275+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:19.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:19.275+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:19.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:19.275+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:20.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:20.076+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:20.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:20.076+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:20.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:20.076+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:20.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:20.076+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:20.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:20.076+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:21.675 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0119b0 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c012ef0 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c005a80 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0129b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.673+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012ef0 legacy=0x7f261c013300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:21.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.874+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0129b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:21.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.874+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:21.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:21.874+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012ef0 legacy=0x7f261c013300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:22.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:22.275+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0129b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:22.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:22.275+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:22.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:22.275+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012ef0 legacy=0x7f261c013300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:23.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:23.076+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0129b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:23.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:23.076+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:23.078 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:23.076+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012ef0 legacy=0x7f261c013300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0129b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0129b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c012ef0 legacy=0x7f261c013300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c0129b0 2023-11-04T01:52:24.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0146e0 con 0x7f261c009e40 2023-11-04T01:52:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c011510 2023-11-04T01:52:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0129b0 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:24.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.674+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.875+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0129b0 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.875+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.875+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:24.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:24.875+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:25.032 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:25.035 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:25.276+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0129b0 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:25.276+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:25.276+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:25.276+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:26.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:26.077+0000 7f263ad9d640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0129b0 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:26.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:26.077+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:26.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:26.077+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:26.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:26.077+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c00c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c00c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c009e40 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c0129b0 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c0109b0 2023-11-04T01:52:27.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c0139e0 2023-11-04T01:52:27.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:27.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:27.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 msgr2=0x7f261c004a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:27.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.674+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.875+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.875+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.875+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 msgr2=0x7f261c004a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:27.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:27.875+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:28.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:28.276+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:28.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:28.276+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:28.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:28.276+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 msgr2=0x7f261c004a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:28.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:28.276+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:29.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:29.077+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:29.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:29.077+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:29.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:29.077+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 msgr2=0x7f261c004a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:29.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:29.077+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:30.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 msgr2=0x7f261c004a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:30.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c0139e0 0x7f261c004a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:30.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c0109b0 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c011510 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00c480 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:30.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.674+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:30.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.875+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:30.876 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.875+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:30.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.875+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:30.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.875+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:30.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:30.875+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:31.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:31.276+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:31.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:31.276+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:31.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:31.276+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:31.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:31.276+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:31.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:31.276+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:32.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:32.078+0000 7f263a59c640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:32.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:32.078+0000 7f263a59c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:32.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:32.078+0000 7f263ad9d640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:32.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:32.078+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:32.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:32.078+0000 7f263ad9d640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:33.676 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c00c480 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c009e40 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c005a80 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c012920 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:33.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.675+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:33.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.876+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:33.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.876+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:33.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:33.876+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:34.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:34.277+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:34.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:34.277+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:34.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:34.277+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:35.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:35.078+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:35.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:35.078+0000 7f2633fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:35.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:35.078+0000 7f2633fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:36.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c012920 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c011510 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012920 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:36.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.675+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:36.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.876+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012920 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:36.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.876+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:36.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.876+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:36.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.876+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:36.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:36.876+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:37.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:37.277+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012920 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:37.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:37.277+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:37.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:37.277+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:37.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:37.277+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:37.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:37.277+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:38.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:38.078+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012920 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:38.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:38.078+0000 7f2633fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:38.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:38.078+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:38.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:38.078+0000 7f2633fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:38.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:38.078+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:39.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:39.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c011510 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:39.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:39.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:39.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c012920 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c00c480 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c005a80 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:39.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.675+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:39.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.876+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:39.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.876+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:39.877 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:39.876+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:40.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:40.277+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:40.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:40.277+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:40.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:40.277+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:41.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:41.078+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:41.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:41.078+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:41.079 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:41.078+0000 7f263a59c640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:42.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:42.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c005a80 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:42.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c00c480 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c011510 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c009e40 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c00c480 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:42.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.676+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:42.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.877+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:42.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.877+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:42.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.877+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:42.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.877+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:42.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:42.877+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:43.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:43.278+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:43.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:43.278+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:43.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:43.278+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:43.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:43.278+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:43.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:43.278+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:44.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:44.079+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:44.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:44.079+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:44.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:44.079+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:44.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:44.079+0000 7f263ad9d640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:44.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:44.079+0000 7f263ad9d640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:45.677 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c005a80 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c012920 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:45.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.676+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:45.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.877+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:45.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.877+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:45.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:45.877+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:46.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:46.278+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:46.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:46.278+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:46.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:46.278+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:47.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:47.079+0000 7f2633fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:47.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:47.079+0000 7f263a59c640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:47.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:47.079+0000 7f2633fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:48.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c005a80 legacy=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f263ad9d640 1 -- reap_dead start 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b32b0 con 0x7f261c011510 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c012920 2023-11-04T01:52:48.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2638d99640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c008eb0 con 0x7f261c009e40 2023-11-04T01:52:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:48.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.676+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:48.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.877+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:48.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.877+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:48.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.877+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:48.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.877+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:48.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:48.877+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:49.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:49.278+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:49.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:49.278+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:49.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:49.278+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:49.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:49.278+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:49.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:49.278+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:50.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:50.079+0000 7f263ad9d640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:50.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:50.079+0000 7f2633fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:50.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:50.079+0000 7f263ad9d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:50.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:50.079+0000 7f263a59c640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:50.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:50.079+0000 7f263a59c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:51.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 msgr2=0x7f261c0119b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:51.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f261c009e40 0x7f261c0119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:51.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 msgr2=0x7f261c0109b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:51.678 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f261c012920 0x7f261c0109b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f261c011510 legacy=0x7f261c00d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0b4750 con 0x7f261c005a80 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2638d99640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0cee10 con 0x7f261c00c480 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:51.679 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.677+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0132d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:51.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.878+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:51.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.878+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:51.879 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:51.878+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0132d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:52.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:52.279+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:52.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:52.279+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:52.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:52.279+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0132d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:53.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:53.079+0000 7f2633fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f261c005a80 legacy=0x7f261c013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:53.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:53.079+0000 7f263a59c640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 msgr2=0x7f261c0132d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:53.081 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:53.079+0000 7f263a59c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f261c00c480 0x7f261c0132d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:54.594 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:52:54.596 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:52:54.597 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:52:54.597 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.597 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:52:54.597 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:52:54.598 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:52:54.599 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:52:54.600 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:52:54.601 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:Ran 5 tests in 974.495s 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:52:54.602 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:52:54.603 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.604 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:52:54.605 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:52:54.606 INFO:tasks.cephfs_test_runner: 2023-11-04T01:52:54.606 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.701 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=222750fa9afc40ce93ae3faaa4448e2d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:52:54.702 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:52:54.711 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:52:54.724 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:52:54.724 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:52:54.724 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:54.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:52:54.744 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-04T01:52:54.744 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:54.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056338,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19753 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:52:54.803 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:52:54.803 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:54.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:52:54.821 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-11-04T01:52:54.821 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:54.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056364,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15926 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497720k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:52:54.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:54.878 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-11-04T01:52:54.935 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:52:54.936 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:52:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:54.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:52:55.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.006 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:52:55.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.077 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-11-04T01:52:55.103 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:55.106 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:55.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.177 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-04T01:52:55.195 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:52:55.196 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:52:55.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.196 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:52:55.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.267 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:52:55.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:55.337 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-11-04T01:52:55.434 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:52:55.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:52:55.444 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:52:55.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.544+0000 7f54c9b4c640 1 Processor -- start 2023-11-04T01:52:55.547 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.544+0000 7f54c9b4c640 1 -- start start 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c9b4c640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c9b4c640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c9b4c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54c40d3b60 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c9b4c640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54c415d4e0 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c9b4c640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54c415d100 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54c40d3b60 legacy=0x7f54c40cf520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:55.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54c40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:55.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54c40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:55.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:55.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.545+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:55.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.746+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54c40d3b60 legacy=0x7f54c40cf520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:55.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.746+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54c40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:55.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.746+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54c40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:55.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.746+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:55.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:55.746+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.147+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54c40d3b60 legacy=0x7f54c40cf520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.147+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54c40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.147+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54c40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.147+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:56.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.147+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:56.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.948+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54c40d3b60 legacy=0x7f54c40cf520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:52:56.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.948+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54c40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:52:56.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.948+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54c40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:52:56.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.948+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:56.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:56.948+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:58.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54c40ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54c40ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:58.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54c40d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54c40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54c40d3b60 legacy=0x7f54c40cf520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0006190 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00036c0 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 msgr2=0x7f54b0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:58.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.545+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0006190 legacy=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:58.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.746+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 msgr2=0x7f54b0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:58.748 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.746+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:58.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:58.747+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0006190 legacy=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:59.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.147+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 msgr2=0x7f54b0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:59.149 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.147+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:59.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.148+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0006190 legacy=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:52:59.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.948+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 msgr2=0x7f54b0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:52:59.950 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.948+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:59.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:52:59.949+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0006190 legacy=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:01.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 msgr2=0x7f54b0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00036c0 0x7f54b0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0006190 legacy=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:01.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0009ef0 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54c415d4e0 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54c415d100 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54b000f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:01.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.546+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:01.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.747+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54b000f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:01.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.747+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:01.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.747+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:01.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.747+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:01.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:01.747+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:02.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.148+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54b000f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:02.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.148+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:02.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.148+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:02.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.148+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:02.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.148+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:02.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.949+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54b000f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:02.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.949+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:02.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.949+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:02.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.949+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:02.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:02.949+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:04.548 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 msgr2=0x7f54b000f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54c415d100 0x7f54b000f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b000aab0 2023-11-04T01:53:04.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0005c70 2023-11-04T01:53:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 msgr2=0x7f54b0012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000aab0 legacy=0x7f54b000f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:04.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.546+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:04.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.747+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 msgr2=0x7f54b0012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:04.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.747+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000aab0 legacy=0x7f54b000f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:04.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:04.747+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:05.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.148+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000aab0 legacy=0x7f54b000f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:05.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.148+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 msgr2=0x7f54b0012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:05.150 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.148+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:05.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.949+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000aab0 legacy=0x7f54b000f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:05.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.949+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 msgr2=0x7f54b0012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:05.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:05.949+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:07.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 msgr2=0x7f54b0012d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:07.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0005c70 0x7f54b0012d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:07.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000aab0 legacy=0x7f54b000f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:07.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:07.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b00133a0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0009ef0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54c415d4e0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:07.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.547+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:07.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.748+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:07.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.748+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:07.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.748+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:07.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:07.748+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:08.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.149+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:08.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.149+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:08.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.149+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:08.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.149+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:08.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.950+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:08.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.950+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:08.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.950+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:08.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:08.950+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:10.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 msgr2=0x7f54b0008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54c415d4e0 0x7f54b0008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0009ef0 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003f10 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:53:10.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 msgr2=0x7f54b0004320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:10.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:10.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:10.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.547+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:10.749 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.748+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 msgr2=0x7f54b0004320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.748+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.748+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:10.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:10.748+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.149+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 msgr2=0x7f54b0004320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:11.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.149+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:11.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.149+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:11.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.149+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:11.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.950+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 msgr2=0x7f54b0004320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:11.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.950+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:11.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.950+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:11.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:11.950+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:13.549 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 msgr2=0x7f54b0004320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0003f10 0x7f54b0004320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b00133a0 2023-11-04T01:53:13.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0004320 2023-11-04T01:53:13.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003b30 2023-11-04T01:53:13.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:13.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:13.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:13.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.547+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:13.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.748+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:13.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.748+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:13.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.748+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:13.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:13.748+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:14.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.149+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:14.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.149+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:14.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.149+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:14.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.149+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:14.951 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.950+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:14.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.950+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:14.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.950+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:14.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:14.950+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:16.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:16.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000d5a0 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0008630 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 msgr2=0x7f54b000fa20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:16.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:16.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:16.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.548+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:16.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.749+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 msgr2=0x7f54b000fa20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:16.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.749+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:16.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.749+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:16.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:16.749+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:17.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.150+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 msgr2=0x7f54b000fa20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:17.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.150+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:17.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.150+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:17.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.150+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.951+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 msgr2=0x7f54b000fa20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.951+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.951+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:17.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:17.951+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:19.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:19.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:19.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 msgr2=0x7f54b000fa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000d5a0 0x7f54b000fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b00133a0 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000ff60 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:53:19.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 msgr2=0x7f54b0010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:19.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:19.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:19.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.548+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:19.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.549+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:19.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.749+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 msgr2=0x7f54b0010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:19.750 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.749+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:19.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.749+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:19.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.750+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:19.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:19.750+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:20.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.150+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 msgr2=0x7f54b0010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:20.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.150+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:20.151 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.150+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:20.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.151+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:20.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.151+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:20.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.951+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 msgr2=0x7f54b0010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:20.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.951+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:20.952 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.951+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:20.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.952+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:20.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:20.952+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:22.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.548+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.550 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.548+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.548+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 msgr2=0x7f54b0010340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.548+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff60 0x7f54b0010340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.548+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00133a0 legacy=0x7f54b0013780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0004320 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0008630 2023-11-04T01:53:22.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:22.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:22.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.549+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:22.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.750+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:22.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.750+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:22.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:22.750+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:23.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.151+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:23.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.151+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:23.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.151+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:23.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.952+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:23.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.952+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:23.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:23.952+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:25.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:25.268 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:25.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b000d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:25.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0008630 0x7f54b000d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:25.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:25.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0008630 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0004320 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0005990 con 0x7f54b0003b30 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:25.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:25.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:25.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:25.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:25.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.549+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:25.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:25.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:25.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:25.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:25.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:25.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:25.750+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:26.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:26.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:26.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:26.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:26.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:26.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.151+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:26.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:26.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:26.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:26.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:26.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:26.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:26.952+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:28.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0013380 2023-11-04T01:53:28.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b000d020 2023-11-04T01:53:28.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:28.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.549+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b000d020 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:28.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.750+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:28.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:28.750+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b000d020 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:29.151+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:29.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:29.151+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b000d020 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:29.952+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:29.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:29.952+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b000d020 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:31.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b000d020 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.551 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0013380 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0010670 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0004320 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.549+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.550+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0010670 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:31.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.550+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:31.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.550+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:31.751 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.750+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:31.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.751+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0010670 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:31.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.751+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:31.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:31.751+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:32.152 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.151+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:32.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.152+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:32.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.152+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0010670 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:32.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.152+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:32.953 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.952+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:32.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.953+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0010670 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:32.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.953+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:32.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:32.953+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:34.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:34.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0010670 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0008630 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:34.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.550+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.751+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:34.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.751+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:34.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.751+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:34.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:34.751+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:35.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.152+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:35.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.152+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:35.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.152+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:35.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.152+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:35.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.953+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:35.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.953+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:35.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.953+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:35.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:35.953+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b000f9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b000f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0008630 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:37.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0003b30 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00137f0 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0004320 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:37.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:37.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.550+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:37.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.751+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:37.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.751+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:37.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.751+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:37.752 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.751+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:37.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:37.751+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:38.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.152+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:38.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.152+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:38.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.152+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:38.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.152+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:38.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.152+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:38.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.952+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:38.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.952+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:38.954 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.952+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:38.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.952+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:38.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:38.952+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:40.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:40.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0013380 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000f9c0 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:40.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.550+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:40.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.751+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:40.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.751+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:40.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:40.751+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:41.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.152+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:41.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.152+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:41.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.152+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:41.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.953+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:41.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.953+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:41.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:41.953+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:43.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000f9c0 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0003b30 2023-11-04T01:53:43.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00137f0 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0004320 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:43.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.550+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:43.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.751+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.751+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.751+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.751+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:43.751+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:44.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.152+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:44.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.152+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:44.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.152+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:44.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.152+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:44.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.152+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:44.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.953+0000 7f54c3fff640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:44.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.953+0000 7f54c3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:44.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.953+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:44.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.953+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:44.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:44.953+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:46.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:46.552 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b000f9c0 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0013380 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000f9c0 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:46.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.550+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:46.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.751+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000f9c0 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:46.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.751+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:46.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:46.751+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:47.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.152+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000f9c0 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:47.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.152+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:47.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.152+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:47.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.953+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000f9c0 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:47.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.953+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:47.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:47.953+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0010670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0010670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b000f9c0 legacy=0x7f54b0008d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0009450 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00137f0 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0004320 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b0019410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:49.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.550+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.751+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b0019410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:49.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.751+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:49.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.751+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:49.753 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.751+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:49.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:49.751+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:50.153 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.152+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:50.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.152+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b0019410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:50.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.152+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:50.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.152+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:50.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.152+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:50.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.953+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b0019410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:50.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.953+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:50.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.953+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:50.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.953+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:50.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:50.953+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:52.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0004320 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b0019410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0013380 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003b30 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:52.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.551+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:52.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.752+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:52.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.752+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:52.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:52.752+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:53.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.153+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:53.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.153+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:53.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.153+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:53.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.954+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:53.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.954+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:53.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:53.954+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:55.330 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:55.333 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:55.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0013380 legacy=0x7f54b000ff60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0009450 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0004320 2023-11-04T01:53:55.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003b30 2023-11-04T01:53:55.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b00163c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:55.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:55.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:55.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.551+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:55.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.752+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b00163c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:55.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.752+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:55.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.752+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:55.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:55.752+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:56.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.153+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b00163c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:56.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.153+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:56.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.153+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:56.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.153+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:56.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.954+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b00163c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:53:56.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.954+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:53:56.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.954+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:56.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:56.954+0000 7f54c3fff640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:53:58.553 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0004320 legacy=0x7f54b000ff40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009450 legacy=0x7f54b00163c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:58.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00137f0 2023-11-04T01:53:58.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0013380 2023-11-04T01:53:58.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:58.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:58.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:58.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.551+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:58.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.752+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:58.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.752+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:58.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.752+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:58.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:58.752+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:59.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.153+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:59.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.153+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:59.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.153+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:59.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.153+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:59.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.954+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:53:59.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.954+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:59.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.954+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:53:59.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:53:59.954+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:01.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:01.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:01.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 msgr2=0x7f54b0012c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:01.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00137f0 0x7f54b0012c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0013380 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003b30 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b00042f0 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:01.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:01.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:01.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:01.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.551+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:01.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.752+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:01.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.752+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:01.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.752+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:01.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.752+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:01.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:01.752+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:02.154 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.153+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:02.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.153+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:02.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.153+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:02.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.153+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:02.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.153+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:02.955 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.954+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:02.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.954+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:02.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.954+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:02.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.954+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:02.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:02.954+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:04.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b00128a0 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000ff40 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 msgr2=0x7f54b0012360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:04.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.552+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00128a0 legacy=0x7f54b0016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:04.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.753+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 msgr2=0x7f54b0012360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:04.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.753+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:04.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:04.753+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00128a0 legacy=0x7f54b0016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:05.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.154+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 msgr2=0x7f54b0012360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:05.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.154+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:05.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.154+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00128a0 legacy=0x7f54b0016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:05.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.955+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 msgr2=0x7f54b0012360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:05.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.955+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:05.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:05.955+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00128a0 legacy=0x7f54b0016390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:07.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 msgr2=0x7f54b0012360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:07.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000ff40 0x7f54b0012360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:07.554 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00128a0 legacy=0x7f54b0016390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0013380 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b0012c80 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0003b30 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.552+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.553+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:07.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.553+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:07.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.553+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:07.754 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.753+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:07.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.754+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:07.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.754+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:07.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:07.754+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:08.155 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.154+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:08.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.155+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:08.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.155+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:08.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.155+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:08.956 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.955+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:08.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.956+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:08.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.956+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:08.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:08.956+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:10.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:10.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:10.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0019ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:10.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0013380 legacy=0x7f54b0009450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:10.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00042f0 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b000ff40 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 msgr2=0x7f54b0012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:10.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.553+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.754+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.754+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:10.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.754+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 msgr2=0x7f54b0012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:10.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:10.754+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:11.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.155+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.155+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.155+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 msgr2=0x7f54b0012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:11.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.155+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:11.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.956+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:11.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.956+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:11.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.956+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 msgr2=0x7f54b0012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:11.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:11.956+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 msgr2=0x7f54b0012330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b000ff40 0x7f54b0012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b00042f0 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:13.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0012c80 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0014380 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:13.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:13.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0018cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:13.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.553+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:13.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.754+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:13.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.754+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:13.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.754+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:13.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.754+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0018cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:13.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:13.754+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.155+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.155+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.155+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:14.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.155+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0018cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:14.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.155+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:14.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.956+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:14.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.956+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:14.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.956+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0018cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:14.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.956+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:14.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:14.956+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:16.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 msgr2=0x7f54b000a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:16.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0003b30 0x7f54b000a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:16.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:16.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0018cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0009410 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0013380 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009410 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:16.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.553+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:16.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.754+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009410 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:16.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.754+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:16.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:16.754+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:17.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.155+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009410 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:17.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.155+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:17.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.155+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.956+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009410 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.956+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:17.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:17.956+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:19.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:19.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:19.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0009410 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:19.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:19.555 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0012c80 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0014380 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0013380 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0004eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:19.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.553+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:19.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.754+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:19.755 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.754+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:19.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.754+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0004eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:19.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.754+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:19.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:19.754+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:20.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.155+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:20.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.155+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:20.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.155+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:20.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.155+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0004eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:20.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.155+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:20.957 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.956+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:20.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.956+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:20.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.956+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0004eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:20.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.956+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:20.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:20.956+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:22.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:22.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0013380 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:22.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 msgr2=0x7f54b0016770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:22.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b0014380 0x7f54b0016770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:22.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b0004eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0003b30 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:22.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.554+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:22.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.755+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:22.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.755+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:22.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:22.755+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:23.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.156+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:23.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.156+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:23.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.156+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:23.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.957+0000 7f54c37fe640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:23.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.957+0000 7f54c2ffd640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:23.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:23.957+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:25.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:25.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b000a2d0 0x7f54b0009410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0003b30 legacy=0x7f54b00047a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:25.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0012c80 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:25.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.554+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:25.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.754+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:25.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.754+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:25.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.754+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:25.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.754+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:25.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:25.754+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:26.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.155+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:26.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.155+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:26.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.155+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:26.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.155+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:26.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.155+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:26.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.956+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:26.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.956+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:26.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.956+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:26.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.956+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:26.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:26.956+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:28.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:28.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:28.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:28.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:28.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b00148a0 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0013380 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:28.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.553+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.754+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.754+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:28.754+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:29.156 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.155+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:29.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.155+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:29.157 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.155+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:29.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.956+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:29.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.956+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:29.958 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:29.956+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:31.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:31.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0013380 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:31.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b0012c80 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:31.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:31.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:31.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.554+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:31.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.755+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:31.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.755+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:31.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.755+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:31.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.755+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:31.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:31.755+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:32.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.156+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:32.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.156+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:32.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.156+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:32.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.156+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:32.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.156+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:32.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.957+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:32.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.957+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:32.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.957+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:32.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.957+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:32.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:32.957+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:34.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b00148a0 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b00132e0 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:34.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.554+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:34.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.755+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:34.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.755+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:34.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:34.755+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:35.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.156+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:35.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.156+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:35.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.156+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:35.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.957+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:35.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.957+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:35.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:35.957+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:37.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:37.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b00132e0 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0005990 con 0x7f54b0003b30 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:37.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:37.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:37.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.554+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:37.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:37.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:37.755+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:38.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:38.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:38.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.156+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:38.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:38.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:38.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c2ffd640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:38.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c3fff640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:38.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c2ffd640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:38.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:38.957+0000 7f54c3fff640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:40.556 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b00132e0 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:40.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b00148a0 2023-11-04T01:54:40.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2980 con 0x7f54b0012c80 2023-11-04T01:54:40.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:40.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.554+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:40.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.755+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:40.757 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:40.755+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:41.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:41.156+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:41.158 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:41.156+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:41.959 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:41.957+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:41.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:41.957+0000 7f54c37fe640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:43.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b0012c80 legacy=0x7f54b000ff00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:43.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:43.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:43.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b00148a0 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:43.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:43.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:43.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.555+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.756+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.756+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.756+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.756+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:43.756+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:44.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.157+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:44.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.157+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:44.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.157+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:44.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.157+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:44.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.157+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:44.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.958+0000 7f54c2ffd640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:44.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.958+0000 7f54c2ffd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:44.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.958+0000 7f54c3fff640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:44.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.958+0000 7f54c37fe640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:44.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:44.958+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:46.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:46.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:46.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:46.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b00132e0 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0012c80 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132e0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:46.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.555+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:46.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.756+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132e0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:46.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.756+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:46.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:46.756+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:47.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.157+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132e0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:47.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.157+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:47.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.157+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:47.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.959+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:47.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.959+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132e0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:47.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:47.959+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:49.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132e0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c3fff640 1 -- reap_dead start 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:49.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b0013f60 con 0x7f54b00148a0 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b000a2d0 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c17fa640 1 -- --> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b4750 con 0x7f54b0003b30 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:49.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.555+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:49.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.756+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:49.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.756+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:49.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.756+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:49.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.756+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:49.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:49.756+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:50.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.157+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:50.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.157+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:50.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.157+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:50.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.157+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:50.160 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.157+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:50.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.958+0000 7f54c2ffd640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.93:6789/0 2023-11-04T01:54:50.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.958+0000 7f54c37fe640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.93:3300/0 2023-11-04T01:54:50.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.958+0000 7f54c37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:50.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.958+0000 7f54c3fff640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3301/0 2023-11-04T01:54:50.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:50.958+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:52.557 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 -- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 msgr2=0x7f54b0008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 --2- >> [v2:172.21.15.125:3301/0,v1:172.21.15.125:6790/0] conn(0x7f54b0003b30 0x7f54b0008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 -- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 msgr2=0x7f54b0009380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b000a2d0 0x7f54b0009380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 -- >> v1:172.21.15.93:6789/0 conn(0x7f54b00148a0 legacy=0x7f54b0016c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b32b0 con 0x7f54b00132a0 2023-11-04T01:54:52.558 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c17fa640 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cee10 con 0x7f54b0012c80 2023-11-04T01:54:52.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132a0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:52.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:52.559 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.556+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:52.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.757+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:52.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.757+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132a0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:52.758 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:52.757+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:53.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.158+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:53.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.158+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132a0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:53.159 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.158+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:53.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.959+0000 7f54c2ffd640 1 -- >> v1:172.21.15.125:6789/0 conn(0x7f54b00132a0 legacy=0x7f54b0011f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.125:6789/0 2023-11-04T01:54:53.960 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.959+0000 7f54c37fe640 1 -- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 msgr2=0x7f54b0014360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.125:3300/0 2023-11-04T01:54:53.961 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-04T01:54:53.959+0000 7f54c37fe640 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f54b0012c80 0x7f54b0014360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:55.477 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:54:55.477 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:54:55.490 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T01:54:55.491 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:54:55.491 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.493 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:54:55.493 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:54:55.494 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.494 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:54:55.494 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:54:55.494 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:54:55.495 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:54:55.505 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:54:55.506 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:54:55.506 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.506 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:54:55.506 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T01:54:55.506 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T01:54:55.507 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.507 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T01:54:55.507 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T01:54:55.507 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.507 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T01:54:55.508 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T01:54:55.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.508 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T01:54:55.508 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T01:54:55.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.508 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T01:54:55.508 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T01:54:55.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.509 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T01:54:55.509 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T01:54:55.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.509 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T01:54:55.509 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T01:54:55.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.510 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T01:54:55.510 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T01:54:55.510 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.510 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T01:54:55.510 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T01:54:55.511 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T01:54:55.511 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.511 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T01:54:55.511 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T01:54:55.511 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:54:55.512 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-11-04T01:54:55.522 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T01:54:55.522 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T01:54:55.523 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T01:54:55.523 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.523 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T01:54:55.523 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T01:54:55.523 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.523 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T01:54:55.524 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T01:54:55.524 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:54:55.524 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T01:54:55.524 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T01:54:55.525 DEBUG:teuthology.orchestra.run.smithi093:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T01:54:55.582 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:54:55.583 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T01:54:55.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:55.628 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:55.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:54:55.667 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T01:54:55.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:54:55.810 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T01:54:55.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:54:55.918 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T01:54:55.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:54:55.984 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T01:54:56.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:54:56.059 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T01:54:56.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:54:56.114 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T01:54:56.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:54:56.165 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T01:54:56.223 INFO:tasks.ceph:Archiving mon data... 2023-11-04T01:54:56.224 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/data/mon.a.tgz 2023-11-04T01:54:56.224 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-11-04T01:54:56.239 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.Zo2CkdczjC 2023-11-04T01:54:56.239 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Zo2CkdczjC 2023-11-04T01:54:56.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.Zo2CkdczjC 2023-11-04T01:54:56.480 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.Zo2CkdczjC is 370KB 2023-11-04T01:54:56.547 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.Zo2CkdczjC 2023-11-04T01:54:56.562 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/data/mon.b.tgz 2023-11-04T01:54:56.562 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-11-04T01:54:56.578 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.CqbICYe7hy 2023-11-04T01:54:56.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CqbICYe7hy 2023-11-04T01:54:56.724 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.CqbICYe7hy 2023-11-04T01:54:56.808 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.CqbICYe7hy is 373KB 2023-11-04T01:54:56.904 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.CqbICYe7hy 2023-11-04T01:54:56.918 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/data/mon.c.tgz 2023-11-04T01:54:56.918 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-11-04T01:54:56.972 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.e09Mk2y3NH 2023-11-04T01:54:56.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.e09Mk2y3NH 2023-11-04T01:54:57.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.e09Mk2y3NH 2023-11-04T01:54:57.194 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.e09Mk2y3NH is 373KB 2023-11-04T01:54:57.291 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.e09Mk2y3NH 2023-11-04T01:54:57.305 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T01:54:57.305 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:54:57.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:54:57.371 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T01:54:57.371 DEBUG:teuthology.orchestra.run.smithi093:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:54:57.375 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:54:57.403 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:54:57.440 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:54:57.444 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T01:54:57.446 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi093/crash 2023-11-04T01:54:57.446 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:54:57.523 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi125/crash 2023-11-04T01:54:57.524 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:54:57.623 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T01:54:57.623 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:57.626 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:57.975 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:58.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:58.029 INFO:tasks.ceph:Compressing logs... 2023-11-04T01:54:58.029 DEBUG:teuthology.orchestra.run.smithi093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:54:58.044 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:54:58.114 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87723.log 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87883.log 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87643.log 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87883.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.87723.log.gz 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94176.log 2023-11-04T01:54:58.115 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87883.log.gz 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87803.log 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.3.94176.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87643.log.gz 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87803.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.audit.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87803.log.gz 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87843.log 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: 91.4% -- replaced with /var/log/ceph/ceph-client.3.94176.log.gz 2023-11-04T01:54:58.116 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87843.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.7.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87843.log.gz 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93724.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.1.93724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87683.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/ceph-client.1.93724.log.gz 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87603.log 2023-11-04T01:54:58.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87683.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87683.log.gz 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87603.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87603.log.gz 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87763.log 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.b.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.87763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87763.log.gz 2023-11-04T01:54:58.118 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T01:54:58.121 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T01:54:58.170 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T01:54:58.231 INFO:teuthology.orchestra.run.smithi125.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T01:54:58.305 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135050.log 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137998.log 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147422.log 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135050.log: /var/log/ceph/ceph-client.admin.137998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153157.log 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135050.log.gz 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143202.log 2023-11-04T01:54:58.306 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137998.log.gz 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147422.log.gz 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142847.log 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137312.log 88.6% 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153157.log.gz 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142847.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143202.log.gz 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143671.log 2023-11-04T01:54:58.307 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142847.log.gz 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137312.log.gz 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141750.log 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136676.log 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124351.log 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143671.log.gz 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158237.log 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.141750.log.gz 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124351.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136676.log.gz 2023-11-04T01:54:58.308 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144047.log 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158237.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124351.log.gz -5 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.146111.log 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3%/var/log/ceph/ceph-client.admin.144047.log: -- replaced with /var/log/ceph/ceph-client.admin.158237.log.gz 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148920.log 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130579.log 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144047.log.gz 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.146111.log.gz 2023-11-04T01:54:58.309 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159456.log 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7%/var/log/ceph/ceph-client.admin.130579.log: -- replaced with /var/log/ceph/ceph-client.admin.148920.log.gz 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148794.log 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.159456.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130579.log.gz -5 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.126281.log 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127029.log 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148794.log.gz 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156608.log 2023-11-04T01:54:58.310 INFO:teuthology.orchestra.run.smithi093.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126281.log.gz 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142889.log 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127029.log: /var/log/ceph/ceph-client.admin.156608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158116.log 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127029.log.gz 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156608.log.gz 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131416.log 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142889.log.gz 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133404.log 2023-11-04T01:54:58.311 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158116.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.159456.log.gz 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136154.log 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131416.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158116.log.gz 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151675.log 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131416.log.gz 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136154.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.133404.log.gz -5 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.154115.log 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151675.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136154.log.gz 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144091.log 2023-11-04T01:54:58.312 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125766.log 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5%/var/log/ceph/ceph-client.admin.144091.log: -- replaced with /var/log/ceph/ceph-client.admin.154115.log.gz 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.151675.log.gz 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139352.log 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144091.log.gz 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155399.log 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125766.log: /var/log/ceph/ceph-client.admin.139352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139562.log 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125766.log.gz 2023-11-04T01:54:58.313 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139352.log.gz 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158793.log 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139562.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155399.log.gz 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137956.log 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139562.log.gz 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130958.log 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158793.log.gz 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127032.log 2023-11-04T01:54:58.314 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137956.log.gz 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134238.log 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127032.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130958.log.gz 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125824.log 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0%/var/log/ceph/ceph-client.admin.134238.log: -- replaced with /var/log/ceph/ceph-client.admin.127032.log.gz 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144261.log 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134238.log.gz 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125992.log 2023-11-04T01:54:58.315 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127712.log 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125824.log.gz 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125992.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144261.log.gz 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132737.log 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125992.log.gz 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125908.log 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144345.log 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127712.log.gz 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125908.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132737.log.gzgzip 2023-11-04T01:54:58.316 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.152954.log 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144345.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125908.log.gz 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131190.log 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144345.log.gz 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140816.log 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152954.log.gz 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139875.log 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131190.log.gz 2023-11-04T01:54:58.317 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137150.log 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143496.log 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140816.log.gz 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137150.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.139875.log.gz 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142469.log 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137150.log.gz 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138591.log 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142469.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143496.log.gzgzip 2023-11-04T01:54:58.318 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.149577.log 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.138591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147852.log 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142469.log.gz 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127028.log 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124309.log 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.0.138591.log.gz 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.149577.log.gz 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147852.log.gz 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132427.log 2023-11-04T01:54:58.319 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127028.log.gz 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156524.log 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124309.log: /var/log/ceph/ceph-client.admin.132427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135958.log 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124309.log.gz 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156524.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132427.log.gz 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133320.log 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156524.log.gz 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150618.log 2023-11-04T01:54:58.320 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.129621.log 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135958.log.gz 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150618.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.133320.log.gz 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143879.log 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3%/var/log/ceph/ceph-client.2.129621.log: -- replaced with /var/log/ceph/ceph-client.admin.150618.log.gz 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143076.log 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137610.log 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143076.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.143879.log.gz --verbose 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.138124.log 2023-11-04T01:54:58.321 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143076.log.gz 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151228.log 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.2.129621.log.gz 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137610.log.gz 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158195.log 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138124.log: /var/log/ceph/ceph-client.admin.151228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140986.log 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138124.log.gz 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158195.log: gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.151228.log.gz 2023-11-04T01:54:58.322 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/ceph-client.admin.137660.log 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158195.log.gz 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155028.log 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145943.log 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140986.log.gz 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155028.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137660.log.gz 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129949.log 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155028.log.gz 2023-11-04T01:54:58.323 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142021.log 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137914.log 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145943.log.gz 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129949.log.gz 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129991.log 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142021.log.gz 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137830.log 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147250.log 2023-11-04T01:54:58.324 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137914.log.gz 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137830.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129991.log.gz 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135874.log 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137830.log.gz 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134798.log 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153802.log 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147250.log.gz 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134798.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135874.log.gz 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159003.log 2023-11-04T01:54:58.325 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9%/var/log/ceph/ceph-client.0.153802.log: -- replaced with /var/log/ceph/ceph-client.admin.134798.log.gz 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150803.log 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.159003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128477.log 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159003.log.gz 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152485.log 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147124.log 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150803.log.gz 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152485.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128477.log.gz 2023-11-04T01:54:58.326 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131999.log 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152485.log.gz 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.148217.log 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147124.log: /var/log/ceph/ceph-client.admin.131999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146237.log 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147124.log.gz 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.148217.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131999.log.gz 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151807.log 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146237.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.153802.log.gz 2023-11-04T01:54:58.327 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134364.log 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130915.log 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151807.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146237.log.gz 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134364.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151807.log.gzgzip 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.139030.log 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134364.log.gz 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128141.log 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130915.log: /var/log/ceph/ceph-client.admin.139030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144513.log 2023-11-04T01:54:58.328 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130915.log.gz 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139030.log.gz 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144387.log 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147472.log 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128141.log.gz 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149794.log 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144513.log.gz 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144387.log.gz 2023-11-04T01:54:58.329 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158567.log 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130747.log 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147472.log.gz 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149794.log.gz 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149535.log 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158567.log.gz 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127717.log 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156984.log 2023-11-04T01:54:58.330 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130747.log.gz 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.149535.log.gz 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145817.log 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159045.log 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156984.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127717.log.gz 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157510.log 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156984.log.gz 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145817.log.gz 2023-11-04T01:54:58.331 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.159045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132900.log 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150373.log 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159045.log.gz 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132900.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157510.log.gz 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155441.log 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132900.log.gz 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157122.log 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147378.log 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155441.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150373.log.gz 2023-11-04T01:54:58.332 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132984.log 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155441.log.gz 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157122.log.gz 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144597.log 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145901.log 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147378.log.gz 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144597.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.132984.log.gz 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149710.log 2023-11-04T01:54:58.333 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128621.log 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145901.log.gz 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158321.log 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.144597.log.gz 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149710.log.gz -5 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.154818.log 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128621.log: /var/log/ceph/ceph-client.admin.158321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140127.log 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154818.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158321.log.gz 2023-11-04T01:54:58.334 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134924.log 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140127.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154818.log.gz 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.128621.log.gz 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150307.log 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6%/var/log/ceph/ceph-client.admin.134924.log: -- replaced with /var/log/ceph/ceph-client.admin.140127.log.gz 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141681.log 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134924.log.gz 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130537.log 2023-11-04T01:54:58.335 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150307.log: /var/log/ceph/ceph-client.admin.141681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141519.log 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130537.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141681.log.gzgzip 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.151451.log 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.150307.log.gz 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141824.log 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.141519.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130537.log.gz 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155356.log 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151451.log.gz 2023-11-04T01:54:58.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147726.log 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.0.141519.log.gz 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155356.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141824.log.gz 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157332.log 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136761.log 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147726.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.155356.log.gz 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157332.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.147726.log.gz 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.155272.log 2023-11-04T01:54:58.337 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153199.log 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136761.log: 93.1% -- replaced with /var/log/ceph/ceph-client.0.148217.log.gz 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157332.log.gz 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155272.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136761.log.gz 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158835.log 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155272.log.gz 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143244.log 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124183.log 87.8% 2023-11-04T01:54:58.338 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153199.log.gz 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158835.log.gz 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133782.log 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143244.log.gz 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148399.log 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133782.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.124183.log.gz 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.132858.log 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133782.log.gz/var/log/ceph/ceph-client.admin.148399.log: 2023-11-04T01:54:58.339 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124669.log 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148399.log.gz 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135754.log 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145119.log 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.132858.log.gz 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135754.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124669.log.gz 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141902.log 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.135754.log.gz 2023-11-04T01:54:58.340 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127595.log 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134840.log 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145119.log.gz 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127595.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.141902.log.gz 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127358.log 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1%/var/log/ceph/ceph-client.admin.134840.log: -- replaced with /var/log/ceph/ceph-client.admin.127595.log.gz 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140468.log 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127358.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.134840.log.gz /var/log/ceph/ceph-client.admin.151367.log 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157767.log 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127358.log.gz 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151367.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140468.log.gz 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134882.log 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151367.log.gz 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.157767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124395.log 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153409.log 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124395.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134882.log.gz 2023-11-04T01:54:58.342 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146573.log 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5%/var/log/ceph/ceph-client.admin.153409.log: -- replaced with /var/log/ceph/ceph-client.admin.124395.log.gz 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137396.log 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153409.log.gz 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142553.log 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146573.log.gz 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133530.log 2023-11-04T01:54:58.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137396.log: /var/log/ceph/ceph-client.admin.142553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126716.log 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137396.log.gz 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154714.log 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142553.log.gz 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126716.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.133530.log.gz 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137230.log 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126716.log.gz 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128393.log 2023-11-04T01:54:58.344 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154714.log: /var/log/ceph/ceph-client.admin.137230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140344.log 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154714.log.gz 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128393.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137230.log.gz 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140724.log 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149999.log 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140344.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128393.log.gz 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140724.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140344.log.gz 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153963.log 2023-11-04T01:54:58.345 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140724.log.gzgzip 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.137522.log 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149999.log: /var/log/ceph/ceph-client.admin.153963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143591.log 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149999.log.gz 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151325.log 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137522.log.gz 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143591.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.153963.log.gz 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148501.log 2023-11-04T01:54:58.346 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143591.log.gz 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142679.log 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133698.log 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151325.log.gz 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158483.log 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148501.log.gz 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142679.log.gz 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156942.log 2023-11-04T01:54:58.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.144920.log 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133698.log.gz 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156942.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158483.log.gz 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133362.log 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154424.log 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.144920.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156942.log.gz 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132469.log 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133362.log.gz 2023-11-04T01:54:58.348 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156183.log 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128057.log 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132469.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154424.log.gz 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134111.log 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.157767.log.gz 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132469.log.gz 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141846.log 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156183.log.gz 2023-11-04T01:54:58.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158012.log 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128057.log.gz 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134111.log.gz 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151186.log 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131626.log 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.141846.log.gz 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158651.log 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158012.log.gz 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151186.log.gz 2023-11-04T01:54:58.350 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133824.log 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131626.log.gz 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126491.log 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158651.log: 92.4% -- replaced with /var/log/ceph/ceph-client.0.144920.log.gz 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151012.log 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158651.log.gz 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126491.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133824.log.gz 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157206.log 2023-11-04T01:54:58.351 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151012.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126491.log.gz 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136971.log 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145495.log 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136971.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157206.log.gz 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.151012.log.gz 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141154.log 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145495.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136971.log.gz 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144005.log 2023-11-04T01:54:58.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141154.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145495.log.gz 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139790.log 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141154.log.gz 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138208.log 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139790.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.144005.log.gz 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.149430.log 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138208.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139790.log.gz 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132283.log 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138208.log.gz 2023-11-04T01:54:58.353 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148651.log 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118349.log 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149430.log.gz 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129791.log 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132283.log.gz 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.118349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128749.log 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129791.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.148651.log.gz 2023-11-04T01:54:58.354 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132527.log 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118349.log.gz 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129791.log.gz 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132167.log 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128749.log.gz 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126533.log 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144219.log 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132527.log.gz 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126533.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132167.log.gz 2023-11-04T01:54:58.355 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158609.log 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126533.log.gz 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130243.log 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152219.log 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144219.log.gz 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130243.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.158609.log.gz -5 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143118.log 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152219.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130243.log.gz 2023-11-04T01:54:58.356 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130873.log 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130495.log 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152219.log.gz 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130873.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143118.log.gz 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152852.log 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130495.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130873.log.gz 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156019.log 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152852.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.130495.log.gz 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156327.log 2023-11-04T01:54:58.357 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148543.log 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152852.log.gz 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133614.log 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156019.log.gz 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148543.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156327.log.gz 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150199.log 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148543.log.gz 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142973.log 2023-11-04T01:54:58.358 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136322.log 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133614.log.gz 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3%/var/log/ceph/ceph-client.admin.142973.log: -- replaced with /var/log/ceph/ceph-client.admin.150199.log.gz 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147082.log 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136322.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.142973.log.gz 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.127419.log 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147082.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.136322.log.gz 2023-11-04T01:54:58.359 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147082.log.gz 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146615.log 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127419.log.gz 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139730.log 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131705.log 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146615.log.gz 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134406.log 2023-11-04T01:54:58.360 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127889.log 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139730.log.gz 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127359.log 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.131705.log.gz 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154029.log 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127889.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134406.log.gz 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156430.log 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127889.log.gz 2023-11-04T01:54:58.361 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127359.log.gz 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156369.log 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141196.log 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154029.log.gz 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156369.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156430.log.gz 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143033.log 2023-11-04T01:54:58.362 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156369.log.gz 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140043.log 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128099.log 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140043.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143033.log.gz 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.141196.log.gz 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.151409.log 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152547.log 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128099.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140043.log.gz 2023-11-04T01:54:58.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124140.log 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128099.log.gz 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152547.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151409.log.gz 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136196.log 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127716.log 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152547.log.gz 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124140.log.gz 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131500.log 2023-11-04T01:54:58.364 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136196.log.gz 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155188.log 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139072.log 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127716.log.gz 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131500.log.gz 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154569.log 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155188.log.gz 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131358.log 2023-11-04T01:54:58.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141943.log 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139072.log.gz 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147768.log 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154569.log.gz 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131358.log.gz 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150576.log 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.141943.log.gz 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128225.log 2023-11-04T01:54:58.366 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150576.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.147768.log.gz --verbose 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.140510.log 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128225.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150576.log.gz 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145369.log 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128225.log.gz 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129133.log 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137480.log 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140510.log.gz 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.145369.log.gz 2023-11-04T01:54:58.367 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.129133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153325.log 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130663.log 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153325.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.137480.log.gz 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.140264.log 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153325.log.gz 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152117.log 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.129133.log.gz 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154071.log 2023-11-04T01:54:58.368 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130663.log.gz 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152117.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140264.log.gz 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124585.log 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154071.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152117.log.gz 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142273.log 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124585.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154071.log.gz -5 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.154611.log 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152768.log 2023-11-04T01:54:58.369 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124585.log.gz 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142273.log.gz 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145411.log 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154611.log.gz 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148982.log 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133152.log 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152768.log.gz 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145411.log.gz 2023-11-04T01:54:58.370 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128519.log 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148982.log.gz 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123829.log 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157248.log 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133152.log.gz 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.123829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128519.log.gz 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140680.log 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123829.log.gz 2023-11-04T01:54:58.371 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149267.log 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140680.log: gzip -5 --verbose 89.4% -- -- replaced with /var/log/ceph/ceph-client.admin.157248.log.gz /var/log/ceph/ceph-client.admin.156482.log 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140680.log.gz 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128561.log 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130117.log 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149267.log.gz 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156482.log: /var/log/ceph/ceph-client.admin.128561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156482.log.gz 2023-11-04T01:54:58.372 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148441.log 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128561.log.gz 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128183.log 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130117.log: /var/log/ceph/ceph-client.admin.148441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149165.log 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130117.log.gz 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152997.log 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148441.log.gz 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128183.log.gz 2023-11-04T01:54:58.373 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118683.log 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130369.log 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152997.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149165.log.gz 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.118683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132083.log 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152997.log.gz 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130369.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118683.log.gz 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146878.log 2023-11-04T01:54:58.374 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130369.log.gz 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137704.log 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132083.log: /var/log/ceph/ceph-client.admin.146878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147684.log 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132083.log.gz 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146878.log.gz 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140858.log 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150928.log 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147684.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137704.log.gz 2023-11-04T01:54:58.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.140858.log: /var/log/ceph/ceph-client.admin.135620.log 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.147684.log.gz 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140552.log 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140858.log.gz 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135620.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.150928.log.gz 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.134670.log 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140552.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135620.log.gz 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147810.log 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140552.log.gz 2023-11-04T01:54:58.376 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157416.log 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133110.log 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134670.log.gz 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132125.log 88.9% 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.147810.log.gz 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157416.log.gz 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154195.log 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133110.log: /var/log/ceph/ceph-client.admin.132125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138166.log 2023-11-04T01:54:58.377 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133110.log.gz 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154195.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132125.log.gz 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130705.log 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154195.log.gz 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.138166.log: -- /var/log/ceph/ceph-client.admin.138082.log 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126710.log 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138166.log.gz 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130705.log.gz 2023-11-04T01:54:58.378 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159629.log 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138082.log.gz 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156061.log 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.159629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133950.log 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126710.log.gz 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151633.log 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156061.log.gz 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134322.log 2023-11-04T01:54:58.379 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142105.log 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133950.log.gz 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151633.log: /var/log/ceph/ceph-client.admin.134322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138946.log 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151633.log.gz 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134322.log.gz 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135916.log 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138946.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142105.log.gz 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135008.log 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138946.log.gz 2023-11-04T01:54:58.380 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124267.log 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.159629.log.gz 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126708.log 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135008.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135916.log.gz 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126707.log 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135008.log.gz 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124267.log.gz 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145327.log 2023-11-04T01:54:58.381 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126708.log.gz 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134195.log 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126707.log: /var/log/ceph/ceph-client.admin.145327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155535.log 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126707.log.gz 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134195.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145327.log.gz 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135413.log 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155535.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134195.log.gz 2023-11-04T01:54:58.382 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.0.135413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130159.log 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.155535.log.gz 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135676.log 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125682.log 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130159.log.gz 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.0.135413.log.gz 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149957.log 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125682.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135676.log.gz 2023-11-04T01:54:58.383 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141070.log 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153039.log 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149957.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125682.log.gz 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135832.log 88.8% 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149957.log.gz 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136364.log 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153039.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141070.log.gz 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156816.log 2023-11-04T01:54:58.384 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153039.log.gz 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146195.log 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136364.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135832.log.gz 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156816.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136364.log.gz 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130075.log 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.156816.log.gz 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157290.log 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135577.log 2023-11-04T01:54:58.385 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146195.log.gz 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157290.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.130075.log.gz 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152726.log 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157290.log.gz 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127035.log 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0%/var/log/ceph/ceph-client.admin.152726.log: -- replaced with /var/log/ceph/ceph-client.admin.135577.log.gz 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149207.log 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152726.log.gz 2023-11-04T01:54:58.386 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128015.log 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127035.log: /var/log/ceph/ceph-client.admin.149207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132653.log 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127035.log.gz 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133740.log 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149207.log.gz 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126239.log 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128015.log.gz 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131274.log 2023-11-04T01:54:58.387 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132653.log.gz 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133740.log.gz 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158877.log 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126239.log: /var/log/ceph/ceph-client.admin.131274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154321.log 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126239.log.gz 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131274.log.gz 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133278.log 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158877.log.gz 2023-11-04T01:54:58.388 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156566.log 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154321.log: /var/log/ceph/ceph-client.admin.133278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139114.log 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154321.log.gz 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156566.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133278.log.gz 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146027.log 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156566.log.gz 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146153.log 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139114.log: /var/log/ceph/ceph-client.admin.146027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138316.log 2023-11-04T01:54:58.389 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139114.log.gz 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146027.log.gz 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130327.log 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146153.log.gz 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146447.log 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138316.log: /var/log/ceph/ceph-client.admin.130327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146699.log 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138316.log.gz 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146447.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130327.log.gz 2023-11-04T01:54:58.390 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134490.log 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146363.log 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146699.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146447.log.gz 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146531.log 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146699.log.gz 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134490.log.gz 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.146363.log: /var/log/ceph/ceph-client.admin.127297.log 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148878.log 2023-11-04T01:54:58.391 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146363.log.gz 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146531.log.gz 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153545.log 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127297.log.gz 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128267.log 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148878.log: /var/log/ceph/ceph-client.admin.153545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147514.log 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148878.log.gz 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128267.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153545.log.gz 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131957.log 2023-11-04T01:54:58.392 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147514.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128267.log.gz 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125598.log 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147514.log.gz 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147208.log 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131957.log: /var/log/ceph/ceph-client.admin.125598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125950.log 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131957.log.gz 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147208.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125598.log.gz 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124017.log 2023-11-04T01:54:58.393 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158961.log 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6%/var/log/ceph/ceph-client.admin.125950.log: -- replaced with /var/log/ceph/ceph-client.admin.147208.log.gz 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125950.log.gz 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136238.log 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124017.log.gz 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131831.log 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158961.log: /var/log/ceph/ceph-client.admin.136238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132695.log 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158961.log.gz 2023-11-04T01:54:58.394 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150435.log 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136238.log.gz 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1%/var/log/ceph/ceph-client.admin.132695.log: -- replaced with /var/log/ceph/ceph-client.admin.131831.log.gz 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131747.log 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132695.log.gz 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139959.log 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150435.log: /var/log/ceph/ceph-client.admin.131747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141028.log 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150435.log.gz 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131747.log.gz 2023-11-04T01:54:58.395 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124879.log 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148836.log 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139959.log.gz 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143921.log 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141028.log.gz 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126197.log 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148836.log: /var/log/ceph/ceph-client.admin.143921.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.124879.log.gz 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158279.log 2023-11-04T01:54:58.396 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148836.log.gz 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143921.log.gz 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156243.log 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139520.log 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126197.log.gz 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158279.log.gz 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143370.log 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149915.log 2023-11-04T01:54:58.397 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139520.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156243.log.gz 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154363.log 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139520.log.gz 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143370.log.gz 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144303.log 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149915.log: /var/log/ceph/ceph-client.admin.154363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155070.log 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149915.log.gz 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154363.log.gz 2023-11-04T01:54:58.398 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142763.log 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133194.log 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155070.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144303.log.gz 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142763.log: gzip -5 87.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.155070.log.gz -- 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/ceph-client.admin.146279.log 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142763.log.gz 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155953.log 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133194.log: /var/log/ceph/ceph-client.admin.146279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150660.log 2023-11-04T01:54:58.399 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133194.log.gz 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155953.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146279.log.gz 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145733.log 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156670.log 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150660.log.gz 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139310.log 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145733.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.155953.log.gz 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159864.log 2023-11-04T01:54:58.400 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145733.log.gz 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124541.log 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139310.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156670.log.gz 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.159864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123921.log 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139310.log.gz 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131789.log 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.123921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130201.log 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124541.log.gz 2023-11-04T01:54:58.401 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134280.log 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123921.log.gz 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131789.log.gz 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130201.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152018.log 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134280.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130201.log.gz 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134280.log.gz 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.147166.log 2023-11-04T01:54:58.402 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152018.log: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.159864.log.gz 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139394.log 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152018.log.gz 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131002.log 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139394.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147166.log.gz 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126709.log 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139394.log.gz 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.131002.log: -- /var/log/ceph/ceph-client.admin.131148.log 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143160.log 2023-11-04T01:54:58.403 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131002.log.gz 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131148.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126709.log.gz 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133068.log 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150041.log 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131148.log.gz 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133068.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143160.log.gz 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137788.log 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133068.log.gz 2023-11-04T01:54:58.404 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149024.log 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126705.log 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150041.log.gz 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137788.log: /var/log/ceph/ceph-client.admin.149024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146741.log 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137788.log.gz 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149024.log.gz 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142637.log 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126705.log: /var/log/ceph/ceph-client.admin.146741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129907.log 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146741.log.gz 2023-11-04T01:54:58.405 INFO:teuthology.orchestra.run.smithi093.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126705.log.gz 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148585.log 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142637.log.gz 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143795.log 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129907.log: /var/log/ceph/ceph-client.admin.148585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138868.log 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129907.log.gz 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141725.log 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.148585.log.gz 2023-11-04T01:54:58.406 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137354.log 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143795.log.gz 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124945.log 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141725.log: -- replaced with /var/log/ceph/ceph-client.admin.138868.log.gz 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155230.log 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141725.log.gz 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0%/var/log/ceph/ceph-client.admin.124945.log: -- replaced with /var/log/ceph/ceph-client.admin.137354.log.gz 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155146.log 2023-11-04T01:54:58.407 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155230.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.124945.log.gz 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.158693.log 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155230.log.gz 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147040.log 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128351.log 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155146.log.gz 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136929.log 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158693.log.gz 2023-11-04T01:54:58.408 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147040.log.gz 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154527.log 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118603.log 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136929.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128351.log.gz 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154466.log 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136929.log.gz 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142189.log 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154527.log.gz 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.118603.log: /var/log/ceph/ceph-client.admin.154466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145859.log 2023-11-04T01:54:58.409 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142189.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118603.log.gz 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154466.log.gz 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145775.log 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142189.log.gz 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156900.log 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145859.log: /var/log/ceph/ceph-client.admin.145775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133488.log 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145859.log.gz 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134448.log 2023-11-04T01:54:58.410 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145775.log.gz 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156900.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.133488.log: /var/log/ceph/ceph-client.admin.152894.log 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156900.log.gz 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124627.log 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133488.log.gz 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126113.log 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152894.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134448.log.gz 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126034.log 2023-11-04T01:54:58.411 INFO:teuthology.orchestra.run.smithi093.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152894.log.gz 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126113.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124627.log.gz 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131052.log 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126034.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126113.log.gz 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140944.log 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126034.log.gz 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140594.log 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140944.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.131052.log.gz --verbose 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.135092.log 2023-11-04T01:54:58.412 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140944.log.gz 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126365.log 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154986.log 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135092.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140594.log.gz 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133446.log 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157164.log 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154986.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126365.log.gz 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.135092.log.gz 2023-11-04T01:54:58.413 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138040.log 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154986.log.gz 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133446.log: /var/log/ceph/ceph-client.admin.157164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131316.log 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138040.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130411.log 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157164.log.gz 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133446.log.gz 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131316.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138040.log.gz 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139604.log 2023-11-04T01:54:58.414 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1%/var/log/ceph/ceph-client.admin.130411.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.131316.log.gz -5 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143963.log 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138771.log 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139604.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130411.log.gz 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124795.log 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139604.log.gz 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138771.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.145985.log -- replaced with /var/log/ceph/ceph-client.admin.143963.log.gz 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.415 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124795.log: 90.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139436.log 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.138771.log.gz 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127030.log 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124795.log.gz 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151078.log 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145985.log.gz 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149873.log 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139436.log.gz 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127635.log 2023-11-04T01:54:58.416 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127030.log.gz 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132569.log 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127635.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149873.log.gz 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.127735.log 91.2% -- replaced with /var/log/ceph/ceph-client.admin.151078.log.gz 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132569.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127635.log.gz 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132569.log.gz 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.156103.log 2023-11-04T01:54:58.417 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152362.log 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127735.log.gz 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158525.log 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152362.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142315.log 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156103.log.gz 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158525.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.152362.log.gz --verbose 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.124753.log 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131232.log 2023-11-04T01:54:58.418 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142315.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158525.log.gz 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124753.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142315.log.gz 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124753.log.gz 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151546.log 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131232.log.gz 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126155.log 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158751.log 2023-11-04T01:54:58.419 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151546.log.gz 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136532.log 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.126155.log.gz 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136887.log 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136532.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158751.log.gz 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127357.log 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136532.log.gz 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147600.log 2023-11-04T01:54:58.420 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136887.log.gz 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130285.log 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147600.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127357.log.gz 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.147600.log.gz 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/ceph-client.admin.154653.log 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156774.log 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130285.log.gz 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150702.log 2023-11-04T01:54:58.421 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154653.log.gz 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151144.log 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/ceph-client.admin.150702.log: --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156774.log.gz 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.127298.log 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151144.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150702.log.gz 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151741.log 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151144.log.gz 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132942.log 2023-11-04T01:54:58.422 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/ceph-client.admin.151741.log: --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127298.log.gz 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.143412.log 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132942.log: gzip -5 --verbose 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132942.log.gz 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.153241.log 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143412.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.151741.log.gz 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152674.log 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143412.log.gz 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142063.log 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153241.log.gz 2023-11-04T01:54:58.423 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137566.log 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr:gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152674.log.gz 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142063.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128435.log 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137566.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142063.log.gz 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143454.log 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137566.log.gz 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151914.log 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128435.log.gz 2023-11-04T01:54:58.424 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127033.log 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143454.log.gz 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150477.log 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/ceph-client.admin.127033.log: -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151914.log.gz 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr: -- /var/log/ceph/ceph-client.admin.137013.log 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150477.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127033.log.gz 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150477.log.gz 2023-11-04T01:54:58.425 INFO:teuthology.orchestra.run.smithi093.stderr: /var/log/ceph/ceph-client.admin.149493.log 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136042.log 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137013.log.gz 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138734.log 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149493.log.gz 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137872.log 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136042.log.gz 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155792.log 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.138734.log.gz 2023-11-04T01:54:58.426 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152424.log 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137872.log.gz 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/ceph-client.0.155792.log: --verbose -- /var/log/ceph/ceph-client.admin.128309.log 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127489.log 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152424.log.gz 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.128309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133572.log 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128309.log.gz/var/log/ceph/ceph-client.admin.127489.log: 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140774.log 2023-11-04T01:54:58.427 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127489.log.gz 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144429.log 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133572.log.gz 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151493.log 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3%/var/log/ceph/ceph-client.admin.144429.log: -- replaced with /var/log/ceph/ceph-client.admin.140774.log.gz 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134532.log 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.144429.log.gz 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr: 92.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145579.log 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.0.155792.log.gz 2023-11-04T01:54:58.428 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151493.log: /var/log/ceph/ceph-client.admin.134532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147292.log 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151493.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134754.log 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134532.log.gz 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139268.log 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147292.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145579.log.gz 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134712.log 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147292.log.gz 2023-11-04T01:54:58.429 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142231.log 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134754.log.gz/var/log/ceph/ceph-client.admin.139268.log: 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140085.log 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132041.log 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139268.log.gz 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134712.log.gz 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140085.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142231.log.gz 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130453.log 2023-11-04T01:54:58.430 INFO:teuthology.orchestra.run.smithi093.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140085.log.gz 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127973.log 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132041.log: /var/log/ceph/ceph-client.admin.130453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146489.log 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.132041.log.gz 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127973.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130453.log.gz 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133236.log 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127973.log.gz 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139156.log 2023-11-04T01:54:58.431 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146489.log: gzip -5/var/log/ceph/ceph-client.admin.133236.log: --verbose -- /var/log/ceph/ceph-client.admin.153283.log 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146489.log.gz/var/log/ceph/ceph-client.admin.139156.log: 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133236.log.gz 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127027.log 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139156.log.gz 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156285.log 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153283.log.gz 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131458.log 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127027.log.gz 2023-11-04T01:54:58.432 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153451.log 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131458.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156285.log.gz 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124098.log 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131458.log.gz 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124837.log 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153451.log.gz 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153367.log 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124837.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124098.log.gz 2023-11-04T01:54:58.433 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137438.log 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124837.log.gz 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145453.log 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137438.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153367.log.gz 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155314.log 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137438.log.gz 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125724.log 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145453.log.gz 2023-11-04T01:54:58.434 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.155314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147556.log 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125724.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155314.log.gz 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154860.log 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125724.log.gz 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142931.log 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147556.log.gz 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127056.log 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142931.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154860.log.gz 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-04T01:54:58.435 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142931.log.gz 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151591.log 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127056.log.gz 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124711.log 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.151591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149752.log 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133026.log 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151591.log.gz 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124711.log: /var/log/ceph/ceph-client.admin.149752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139688.log 2023-11-04T01:54:58.436 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124711.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149752.log.gz 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133026.log: 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140636.log 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133026.log.gz 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr:gzip/var/log/ceph/ceph-client.admin.139688.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.131915.log 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140636.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139688.log.gz 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132611.log 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140636.log.gz 2023-11-04T01:54:58.437 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134576.log 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146321.log 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131915.log.gz 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134576.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149644.log 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.132611.log.gz 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134576.log.gz 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149123.log 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146321.log: /var/log/ceph/ceph-client.admin.149644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136448.log 2023-11-04T01:54:58.438 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149123.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146321.log.gz 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127634.log 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149123.log.gz 90.9% 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149644.log.gz 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154776.log 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr: 89.1%/var/log/ceph/ceph-client.admin.127634.log: -- replaced with /var/log/ceph/ceph-client.admin.136448.log.gz 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151976.log 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127634.log.gz 2023-11-04T01:54:58.439 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142805.log 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154776.log: /var/log/ceph/ceph-client.admin.151976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158441.log 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142805.log: 89.3% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154776.log.gz 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151976.log.gz 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142805.log.gz 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125640.log 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158441.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.145197.log 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158441.log.gz 2023-11-04T01:54:58.440 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125640.log: /var/log/ceph/ceph-client.admin.145197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125640.log.gz 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144135.log 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145197.log.gz 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152589.log 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5/var/log/ceph/ceph-client.admin.144135.log: --verbose -- /var/log/ceph/ceph-client.admin.136000.log 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152589.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139646.log 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144135.log.gz 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152589.log.gz 2023-11-04T01:54:58.441 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139833.log 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr: 88.1%/var/log/ceph/ceph-client.admin.139646.log: -- replaced with /var/log/ceph/ceph-client.admin.136000.log.gz 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139917.log 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139646.log.gz 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130831.log 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139833.log: /var/log/ceph/ceph-client.admin.139917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142511.log 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130831.log: 88.8% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139917.log.gz 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139833.log.gz 2023-11-04T01:54:58.442 INFO:teuthology.orchestra.run.smithi093.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130831.log.gz 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146405.log 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142511.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146405.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142511.log.gz 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130621.log 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146405.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136406.log 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.130621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143286.log 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136406.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130621.log.gz 2023-11-04T01:54:58.443 INFO:teuthology.orchestra.run.smithi093.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136406.log.gz 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125866.log 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147960.log 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125866.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143286.log.gz 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125866.log.gz 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154237.log 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144177.log 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154237.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147960.log.gz 2023-11-04T01:54:58.444 INFO:teuthology.orchestra.run.smithi093.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154237.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137746.log 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152631.log 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158919.log 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144177.log.gz 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137746.log: /var/log/ceph/ceph-client.admin.152631.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137746.log.gz 2023-11-04T01:54:58.445 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158919.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152631.log.gz 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142595.log 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158919.log.gz/var/log/ceph/ceph-osd.2.log: 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150970.log 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157374.log 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142595.log.gz 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124225.log 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157374.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150970.log.gz 2023-11-04T01:54:58.446 INFO:teuthology.orchestra.run.smithi093.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157374.log.gz 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154279.log 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144471.log 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124225.log.gz/var/log/ceph/ceph-client.admin.154279.log: 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125359.log 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144471.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154279.log.gz 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130033.log 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144471.log.gz 2023-11-04T01:54:58.447 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136280.log 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130033.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130033.log.gz 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136280.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.136280.log.gz 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.125359.log.gz 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154944.log 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131542.log 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154944.log.gz 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137055.log 2023-11-04T01:54:58.448 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131542.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131542.log.gz 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140902.log 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.137055.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137055.log.gz 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134620.log 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140902.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.140902.log.gz 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149368.log 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134620.log.gz 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129749.log 2023-11-04T01:54:58.449 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.149368.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149368.log.gz 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136574.log 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129749.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129749.log.gz 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150865.log 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136574.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136574.log.gz 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138250.log 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150865.log.gz 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133656.log 2023-11-04T01:54:58.450 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138250.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.138250.log.gz 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150094.log 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133656.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133656.log.gz 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143753.log 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150094.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150094.log.gz 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135158.log 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143753.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143753.log.gz 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150157.log 2023-11-04T01:54:58.451 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135158.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135158.log.gz 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124499.log 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150157.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150157.log.gz 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142427.log 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124499.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124499.log.gz 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147894.log 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142427.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142427.log.gz 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153081.log 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147894.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.147894.log.gz 2023-11-04T01:54:58.452 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126706.log 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.153081.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153081.log.gz 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148752.log 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126706.log.gz 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134966.log 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.148752.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148752.log.gz 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147642.log 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134966.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134966.log.gz 2023-11-04T01:54:58.453 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146657.log 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147642.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147642.log.gz 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132385.log 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146657.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146657.log.gz 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126449.log 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132385.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132385.log.gz 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140426.log 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126449.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126449.log.gz 2023-11-04T01:54:58.454 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142147.log 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140426.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140426.log.gz 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136719.log 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142147.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142147.log.gz 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126323.log 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136719.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136719.log.gz 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154902.log 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126323.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126323.log.gz 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150241.log 2023-11-04T01:54:58.455 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.154902.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154902.log.gz 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147334.log 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.150241.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.150241.log.gz 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144555.log 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.147334.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147334.log.gz 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157046.log 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144555.log.gz 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141112.log 2023-11-04T01:54:58.456 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157046.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157046.log.gz 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133908.log 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141112.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141112.log.gz 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132816.log 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133908.log.gz 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136616.log 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132816.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132816.log.gz 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131584.log 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136616.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136616.log.gz 2023-11-04T01:54:58.457 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140169.log 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131584.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131584.log.gz 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135698.log 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140169.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140169.log.gz 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157928.log 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.135698.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.135698.log.gz 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144663.log 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.157928.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.157928.log.gz 2023-11-04T01:54:58.458 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136490.log 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.144663.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144663.log.gz 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136803.log 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136490.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136490.log.gz 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156732.log 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136803.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136803.log.gz 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152261.log 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156732.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156732.log.gz 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124457.log 2023-11-04T01:54:58.459 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152261.log.gz 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138827.log 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.124457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124457.log.gz 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143837.log 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138827.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138827.log.gz 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141262.log 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143837.log.gz 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158074.log 2023-11-04T01:54:58.460 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.141262.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141262.log.gz 2023-11-04T01:54:58.461 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126713.log 2023-11-04T01:54:58.461 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158074.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158074.log.gz 2023-11-04T01:54:58.462 INFO:teuthology.orchestra.run.smithi125.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146069.log 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126713.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126713.log.gz 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.112295.log 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146069.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.146069.log.gz 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158399.log 2023-11-04T01:54:58.472 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.tmp-client.admin.112295.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.112295.log.gz 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131873.log 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.158399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158399.log.gz 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156858.log 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.131873.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131873.log.gz 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129256.log 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.156858.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156858.log.gz 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146783.log 2023-11-04T01:54:58.473 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.129256.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129256.log.gz 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145537.log 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146783.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146783.log.gz 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145537.log.gz 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152810.log 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mds.a.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127299.log 2023-11-04T01:54:58.474 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152810.log.gz 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132241.log 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127299.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127299.log.gz 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134030.log 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.132241.log.gz 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138988.log 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134030.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134030.log.gz 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143328.log 2023-11-04T01:54:58.475 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.138988.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138988.log.gz 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132343.log 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.143328.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143328.log.gz 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126407.log 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.132343.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132343.log.gz 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152177.log 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.126407.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126407.log.gz 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127931.log 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.152177.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152177.log.gz 2023-11-04T01:54:58.476 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134153.log 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.127931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127931.log.gz 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130789.log 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.134153.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134153.log.gz 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142721.log 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.130789.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130789.log.gz 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133866.log 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.142721.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142721.log.gz 2023-11-04T01:54:58.477 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125556.log 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.133866.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133866.log.gz 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145621.log 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.125556.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125556.log.gz 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136845.log 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.145621.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145621.log.gz 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140001.log 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.136845.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136845.log.gz 2023-11-04T01:54:58.478 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146958.log 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.140001.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140001.log.gz 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139478.log 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.146958.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146958.log.gz 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.139478.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139478.log.gz 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T01:54:58.479 INFO:teuthology.orchestra.run.smithi093.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T01:54:58.482 INFO:teuthology.orchestra.run.smithi125.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T01:54:58.833 INFO:teuthology.orchestra.run.smithi093.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T01:54:59.265 INFO:teuthology.orchestra.run.smithi125.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T01:54:59.414 INFO:teuthology.orchestra.run.smithi125.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T01:54:59.434 INFO:teuthology.orchestra.run.smithi125.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T01:54:59.438 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T01:54:59.442 INFO:teuthology.orchestra.run.smithi125.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T01:54:59.444 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-11-04T01:54:59.444 INFO:teuthology.orchestra.run.smithi125.stderr:real 0m1.356s 2023-11-04T01:54:59.444 INFO:teuthology.orchestra.run.smithi125.stderr:user 0m5.778s 2023-11-04T01:54:59.445 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m0.233s 2023-11-04T01:54:59.589 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T01:54:59.625 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T01:54:59.651 INFO:teuthology.orchestra.run.smithi093.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T01:54:59.653 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-04T01:54:59.653 INFO:teuthology.orchestra.run.smithi093.stderr:real 0m1.597s 2023-11-04T01:54:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:user 0m6.674s 2023-11-04T01:54:59.654 INFO:teuthology.orchestra.run.smithi093.stderr:sys 0m0.564s 2023-11-04T01:54:59.654 INFO:tasks.ceph:Archiving logs... 2023-11-04T01:54:59.655 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi093/log 2023-11-04T01:54:59.656 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:55:01.140 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi125/log 2023-11-04T01:55:01.141 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:55:01.974 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:01.988 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T01:55:02.006 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:02.010 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T01:55:02.011 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:55:02.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:55:02.097 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T01:55:02.106 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T01:55:02.107 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:55:02.109 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:55:02.123 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:55:02.126 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:55:02.127 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:55:02.127 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-11-04T01:55:02.127 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 +1666us[+1666us] +/- 82ms 2023-11-04T01:55:02.127 INFO:teuthology.orchestra.run.smithi093.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -408us[ -412us] +/- 78ms 2023-11-04T01:55:02.128 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -1462us[-1466us] +/- 94ms 2023-11-04T01:55:02.128 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:55:02.130 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:55:02.130 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-11-04T01:55:02.130 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +1667us[+1667us] +/- 82ms 2023-11-04T01:55:02.130 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -406us[ -402us] +/- 78ms 2023-11-04T01:55:02.130 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -1456us[-1453us] +/- 94ms 2023-11-04T01:55:02.131 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:55:02.131 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T01:55:02.140 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T01:55:02.140 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T01:55:02.148 DEBUG:teuthology.orchestra.run.smithi093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:55:02.286 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:55:02.387 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:55:02.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:02.421 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:55:02.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:02.454 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T01:55:02.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T01:55:02.473 INFO:teuthology.task.internal:Duration was 1829.903956 seconds 2023-11-04T01:55:02.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T01:55:02.483 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T01:55:02.483 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:55:02.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:55:02.526 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:55:02.538 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:55:02.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T01:55:02.794 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-11-04T01:55:02.794 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:55:02.813 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-11-04T01:55:02.813 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:55:02.835 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T01:55:02.835 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:55:02.855 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:55:02.904 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T01:55:02.904 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:55:02.923 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:55:03.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T01:55:03.062 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T01:55:03.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:55:03.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:55:03.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T01:55:03.126 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:03.131 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:03.154 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-11-04T01:55:03.180 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-11-04T01:55:03.196 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:03.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:03.225 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:55:03.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:03.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T01:55:03.261 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T01:55:03.262 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi093 2023-11-04T01:55:03.262 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:55:03.303 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919/remote/smithi125 2023-11-04T01:55:03.303 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:55:03.339 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T01:55:03.340 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:55:03.342 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:55:03.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T01:55:03.399 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T01:55:03.399 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T01:55:03.409 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T01:55:03.409 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:55:03.412 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:55:03.423 INFO:teuthology.orchestra.run.smithi093.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:55 /home/ubuntu/cephtest 2023-11-04T01:55:03.442 INFO:teuthology.orchestra.run.smithi125.stdout: 265756 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:55 /home/ubuntu/cephtest 2023-11-04T01:55:03.443 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T01:55:03.455 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T01:55:03.465 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:03.466 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:55:03.489 DEBUG:teuthology.nuke:shortname: smithi093 2023-11-04T01:55:03.490 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:55:03.518 DEBUG:teuthology.nuke:shortname: smithi125 2023-11-04T01:55:03.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:55:03.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.709431', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd1V3htK5J+6UMoV/b32NQraS+rYC07ZBofi4cORbpKRsmgg2F4pQDqNWN/GHmDCBqncrv/iSWN5TaGBSCJYhs='} 2023-11-04T01:55:03.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.705980', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIB3bMpXE6SKK2rBX2MEDzeur8W0Ch7DQRTXqZD+YZxuC+dXPogiTOM2LUfNSZgNxOJRWi6w+K9ZeJA+6YmNdyw='} 2023-11-04T01:55:03.573 INFO:teuthology.orchestra.console.smithi093:Power off 2023-11-04T01:55:03.574 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:55:03.597 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-11-04T01:55:03.598 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:03.615 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-04T01:55:03.615 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:55:03.629 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-11-04T01:55:03.643 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-04T01:55:03.643 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:03.667 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-04T01:55:07.630 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:07.669 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:07.740 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-11-04T01:55:07.779 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-04T01:55:11.745 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:11.780 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:55:11.859 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-11-04T01:55:11.890 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-04T01:55:11.961 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-11-04T01:55:11.992 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-04T01:55:12.096 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 1829.9039556980133 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=222750fa9afc40ce93ae3faaa4448e2d status: fail success: false 2023-11-04T01:55:12.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:55:12.179 INFO:teuthology.run:FAIL